2024-04-18T10:23:13.663 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-18T10:23:13.663 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976 --owner scheduled_teuthology@teuthology --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/orig.config.yaml 2024-04-18T10:23:13.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T10:23:13.802 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976 branch: main description: fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7660976' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/octopus latest ' name: teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: main ceph: cephfs: max_mds: 2 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request - missing required features sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf nuke-on-error: false selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 08d35a8d8529783882dd092c73c0b27be41c4d86 owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 seed: 7975 sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf sleep_before_teardown: 0 subset: 475/512 suite: fs suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_08d35a8d8529783882dd092c73c0b27be41c4d86/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 08d35a8d8529783882dd092c73c0b27be41c4d86 targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDGKbvab7ZottKj9UbKPO0dvlNYkkMGJq1PatHYcfvlv6bEWqZOJF6YPeQvmM7OoTFOeOyEkXdPYsC2MqGofcOg= smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSXgzPovjgpB4X41p8ikplMudE1NsypxXMBo/I458GfOvuvhxo6sqlu12AjFZMMe9bS122DgwaYEuH83LksQqk= smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/EQKS5EIJvJJ6vZOL876jxcikh5nibBDG/0A1ILl7ZBGYQeEG1ktITtk8OTGmpNxM1d2Y/Q5FTvMAfzgFHZ8I= tasks: - install: branch: octopus exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing octopus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client octopus - print: '**** done ceph' - ceph-fuse: null - print: '**** done octopus client' - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: quincy - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph osd require-osd-release quincy - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - install.upgrade: client.0: branch: quincy - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: mounted: false client.1: skip: true - ceph-fuse: client.0: null client.1: skip: true - print: '**** done remount client' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs required_client_features cephfs add metric_collect - sleep: duration: 5 - fs.clients_evicted: clients: client.0: false client.1: true - workunit: clients: client.0: - suites/fsstress.sh - print: '**** done fsstress' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-17_20:24:14 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-18T10:23:13.802 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_08d35a8d8529783882dd092c73c0b27be41c4d86/qa; will attempt to use it 2024-04-18T10:23:13.803 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_08d35a8d8529783882dd092c73c0b27be41c4d86/qa/tasks 2024-04-18T10:23:13.803 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-18T10:23:13.804 INFO:teuthology.task.internal:Checking packages... 2024-04-18T10:23:13.827 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a6549451253d26216d353246c0fe6f6d80f3b9cf' 2024-04-18T10:23:13.828 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:23:13.828 INFO:teuthology.packaging:ref: None 2024-04-18T10:23:13.828 INFO:teuthology.packaging:tag: None 2024-04-18T10:23:13.828 INFO:teuthology.packaging:branch: main 2024-04-18T10:23:13.828 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:23:13.828 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2024-04-18T10:23:14.035 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3141.g5be49cd9 2024-04-18T10:23:14.037 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-18T10:23:14.042 INFO:teuthology.task.internal:no buildpackages task found 2024-04-18T10:23:14.042 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-18T10:23:14.051 INFO:teuthology.task.internal:Saving configuration 2024-04-18T10:23:14.070 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-18T10:23:14.075 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-18T10:23:14.096 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 10:17:32.056237', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDGKbvab7ZottKj9UbKPO0dvlNYkkMGJq1PatHYcfvlv6bEWqZOJF6YPeQvmM7OoTFOeOyEkXdPYsC2MqGofcOg='} 2024-04-18T10:23:14.118 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 10:17:32.054061', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSXgzPovjgpB4X41p8ikplMudE1NsypxXMBo/I458GfOvuvhxo6sqlu12AjFZMMe9bS122DgwaYEuH83LksQqk='} 2024-04-18T10:23:14.137 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 10:17:32.055230', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/EQKS5EIJvJJ6vZOL876jxcikh5nibBDG/0A1ILl7ZBGYQeEG1ktITtk8OTGmpNxM1d2Y/Q5FTvMAfzgFHZ8I='} 2024-04-18T10:23:14.137 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-18T10:23:14.142 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-18T10:23:14.143 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['client.0'] 2024-04-18T10:23:14.143 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['client.1'] 2024-04-18T10:23:14.143 INFO:teuthology.run_tasks:Running task console_log... 2024-04-18T10:23:14.275 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f45476f9160>, signals=[15]) 2024-04-18T10:23:14.276 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-18T10:23:14.282 INFO:teuthology.task.internal:Opening connections... 2024-04-18T10:23:14.282 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:23:14.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:23:14.398 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-04-18T10:23:14.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:23:14.469 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-04-18T10:23:14.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:23:14.541 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-18T10:23:14.546 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-04-18T10:23:14.569 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-04-18T10:23:14.569 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-04-18T10:23:14.631 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T10:23:14.632 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T10:23:14.633 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-04-18T10:23:14.654 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-04-18T10:23:14.678 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-04-18T10:23:14.678 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-18T10:23:14.740 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T10:23:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T10:23:14.742 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-18T10:23:14.763 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-18T10:23:14.787 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-18T10:23:14.787 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-18T10:23:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T10:23:14.850 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T10:23:14.850 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T10:23:14.850 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-18T10:23:14.871 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-18T10:23:14.879 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-18T10:23:14.885 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-18T10:23:14.885 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-04-18T10:23:14.887 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-04-18T10:23:14.890 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-04-18T10:23:14.910 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-18T10:23:14.915 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-18T10:23:14.915 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-04-18T10:23:14.949 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-04-18T10:23:14.951 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-04-18T10:23:14.981 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-18T10:23:15.045 INFO:teuthology.run_tasks:Running task kernel... 2024-04-18T10:23:15.057 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-18T10:23:15.057 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}, 'client.1': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-18T10:23:15.058 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T10:23:15.058 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T10:23:15.058 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-18T10:23:15.079 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:23:15.079 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-18T10:23:15.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:23:15.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:23:15.081 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-04-18T10:23:15.081 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-04-18T10:23:15.140 INFO:teuthology.orchestra.run.smithi137.stdout:4.18.0-489.el8.x86_64 2024-04-18T10:23:15.141 INFO:teuthology.task.kernel:Running kernel on smithi137: 4.18.0-489.el8.x86_64 2024-04-18T10:23:15.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum install -y kernel 2024-04-18T10:23:15.143 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-489.el8.x86_64 2024-04-18T10:23:15.143 INFO:teuthology.task.kernel:Running kernel on smithi031: 4.18.0-489.el8.x86_64 2024-04-18T10:23:15.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum install -y kernel 2024-04-18T10:23:15.144 INFO:teuthology.orchestra.run.smithi040.stdout:4.18.0-489.el8.x86_64 2024-04-18T10:23:15.144 INFO:teuthology.task.kernel:Running kernel on smithi040: 4.18.0-489.el8.x86_64 2024-04-18T10:23:15.144 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y kernel 2024-04-18T10:23:18.787 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 24 MB/s | 28 MB 00:01 2024-04-18T10:23:19.233 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - AppStream 17 MB/s | 28 MB 00:01 2024-04-18T10:23:19.524 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - AppStream 16 MB/s | 28 MB 00:01 2024-04-18T10:23:26.233 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - BaseOS 6.0 MB/s | 10 MB 00:01 2024-04-18T10:23:27.640 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - BaseOS 3.3 MB/s | 10 MB 00:03 2024-04-18T10:23:27.945 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 2.7 MB/s | 10 MB 00:03 2024-04-18T10:23:28.175 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras 89 kB/s | 18 kB 00:00 2024-04-18T10:23:28.642 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 7.7 kB 00:00 2024-04-18T10:23:28.953 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2024-04-18T10:23:29.557 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2024-04-18T10:23:29.970 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 56 kB/s | 18 kB 00:00 2024-04-18T10:23:30.032 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 7.7 kB 00:00 2024-04-18T10:23:30.113 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2024-04-18T10:23:30.284 INFO:teuthology.orchestra.run.smithi137.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-04-18T10:23:30.329 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 32 kB/s | 7.7 kB 00:00 2024-04-18T10:23:30.606 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-04-18T10:23:31.862 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-04-18T10:23:31.948 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2024-04-18T10:23:34.103 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 412 kB/s | 24 kB 00:00 2024-04-18T10:23:35.670 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 467 kB/s | 24 kB 00:00 2024-04-18T10:23:35.932 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 425 kB/s | 24 kB 00:00 2024-04-18T10:23:37.350 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-18T10:23:37.350 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-18T10:23:37.485 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:23:37.486 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:23:37.486 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-18T10:23:37.486 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:23:37.486 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:23:37.486 INFO:teuthology.orchestra.run.smithi031.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-18T10:23:37.486 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-18T10:23:37.486 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-18T10:23:37.487 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-18T10:23:37.487 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:23:37.487 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:23:37.487 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:23:37.487 INFO:teuthology.orchestra.run.smithi031.stdout:Install 3 Packages 2024-04-18T10:23:37.487 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:23:37.487 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 90 M 2024-04-18T10:23:37.487 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 96 M 2024-04-18T10:23:37.488 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:23:38.642 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-18T10:23:38.642 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-18T10:23:38.742 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:23:38.743 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:23:38.743 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-18T10:23:38.743 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:23:38.743 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:23:38.743 INFO:teuthology.orchestra.run.smithi137.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-18T10:23:38.743 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-04-18T10:23:38.744 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-18T10:23:38.744 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-18T10:23:38.744 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:23:38.744 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:23:38.744 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:23:38.744 INFO:teuthology.orchestra.run.smithi137.stdout:Install 3 Packages 2024-04-18T10:23:38.744 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:23:38.744 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 90 M 2024-04-18T10:23:38.745 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 96 M 2024-04-18T10:23:38.745 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:23:39.225 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-18T10:23:39.225 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-18T10:23:39.356 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:23:39.357 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:23:39.358 INFO:teuthology.orchestra.run.smithi040.stdout:Install 3 Packages 2024-04-18T10:23:39.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:23:39.358 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 90 M 2024-04-18T10:23:39.358 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 96 M 2024-04-18T10:23:39.358 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:23:40.387 INFO:teuthology.orchestra.run.smithi031.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 3.8 MB/s | 10 MB 00:02 2024-04-18T10:23:41.221 INFO:teuthology.orchestra.run.smithi137.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 4.4 MB/s | 10 MB 00:02 2024-04-18T10:23:42.424 INFO:teuthology.orchestra.run.smithi040.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 3.5 MB/s | 10 MB 00:02 2024-04-18T10:23:45.871 INFO:teuthology.orchestra.run.smithi137.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 5.2 MB/s | 36 MB 00:07 2024-04-18T10:23:46.246 INFO:teuthology.orchestra.run.smithi137.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 5.9 MB/s | 44 MB 00:07 2024-04-18T10:23:46.247 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:23:46.247 INFO:teuthology.orchestra.run.smithi137.stdout:Total 12 MB/s | 90 MB 00:07 2024-04-18T10:23:46.928 INFO:teuthology.orchestra.run.smithi031.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 3.9 MB/s | 36 MB 00:09 2024-04-18T10:23:46.934 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:23:47.358 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:23:47.358 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:23:47.458 INFO:teuthology.orchestra.run.smithi040.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 4.6 MB/s | 36 MB 00:07 2024-04-18T10:23:48.333 INFO:teuthology.orchestra.run.smithi040.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 4.9 MB/s | 44 MB 00:08 2024-04-18T10:23:48.333 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:23:48.333 INFO:teuthology.orchestra.run.smithi040.stdout:Total 10 MB/s | 90 MB 00:08 2024-04-18T10:23:48.587 INFO:teuthology.orchestra.run.smithi031.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 4.0 MB/s | 44 MB 00:10 2024-04-18T10:23:48.587 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:23:48.587 INFO:teuthology.orchestra.run.smithi031.stdout:Total 8.1 MB/s | 90 MB 00:11 2024-04-18T10:23:48.606 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:23:48.627 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:23:49.049 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:23:49.303 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:23:49.502 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:23:49.503 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:23:49.747 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:23:49.747 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:23:50.804 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:23:50.824 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:23:51.077 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:23:51.096 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:23:51.434 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:23:52.065 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-18T10:23:53.766 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:23:54.136 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:23:54.267 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-18T10:23:54.791 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-18T10:23:55.622 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-18T10:23:56.032 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-18T10:23:58.029 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-18T10:23:58.408 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-18T10:23:58.750 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-18T10:23:59.124 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-18T10:23:59.473 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-18T10:23:59.731 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:02.090 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-18T10:24:02.394 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:02.809 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-18T10:24:03.119 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:21.468 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:21.492 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:21.851 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:21.851 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-18T10:24:21.851 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-18T10:24:22.323 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:22.323 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:24:22.323 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:24:22.323 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-18T10:24:22.323 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-18T10:24:22.324 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:24:22.324 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:24:22.526 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel | sort -rV | head -n 1 2024-04-18T10:24:22.741 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-18T10:24:22.742 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-18T10:24:22.742 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-18T10:24:22.742 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T10:24:22.742 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T10:24:22.742 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-04-18T10:24:22.742 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi137.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T10:24:22.742 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel | sort -rV | head -n 1 2024-04-18T10:24:22.954 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-18T10:24:22.954 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-18T10:24:22.954 DEBUG:teuthology.orchestra.run.smithi137:> sudo rpm -qi grub2-tools 2024-04-18T10:24:22.987 INFO:teuthology.orchestra.run.smithi137.stdout:Name : grub2-tools 2024-04-18T10:24:22.987 INFO:teuthology.orchestra.run.smithi137.stdout:Epoch : 1 2024-04-18T10:24:22.987 INFO:teuthology.orchestra.run.smithi137.stdout:Version : 2.02 2024-04-18T10:24:22.987 INFO:teuthology.orchestra.run.smithi137.stdout:Release : 129.el8 2024-04-18T10:24:22.987 INFO:teuthology.orchestra.run.smithi137.stdout:Architecture: x86_64 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Group : System Environment/Base 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Size : 9265586 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:License : GPLv3+ 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Relocations : (not relocatable) 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Packager : CentOS BuildSystem 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Vendor : CentOS 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Summary : Support tools for GRUB. 2024-04-18T10:24:22.988 INFO:teuthology.orchestra.run.smithi137.stdout:Description : 2024-04-18T10:24:22.989 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:24:22.989 INFO:teuthology.orchestra.run.smithi137.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-18T10:24:22.989 INFO:teuthology.orchestra.run.smithi137.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-18T10:24:22.989 INFO:teuthology.orchestra.run.smithi137.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-18T10:24:22.989 INFO:teuthology.orchestra.run.smithi137.stdout:hardware devices. 2024-04-18T10:24:22.989 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:24:22.989 INFO:teuthology.orchestra.run.smithi137.stdout:This subpackage provides tools for support of all platforms. 2024-04-18T10:24:22.990 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-18T10:24:22.990 INFO:teuthology.task.kernel:Updating grub on smithi137 to boot 4.18.0-552.el8.x86_64 2024-04-18T10:24:22.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-18T10:24:24.676 INFO:teuthology.orchestra.run.smithi137.stderr:Generating grub configuration file ... 2024-04-18T10:24:25.733 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:25.758 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:26.119 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:26.119 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-18T10:24:26.119 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-18T10:24:26.456 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:26.482 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:26.621 INFO:teuthology.orchestra.run.smithi137.stderr:done 2024-04-18T10:24:26.623 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-04-18T10:24:26.666 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:26.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:24:26.666 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:24:26.666 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-18T10:24:26.666 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-18T10:24:26.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:24:26.666 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:24:26.674 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.xrRYrcMcqL 2024-04-18T10:24:26.674 DEBUG:teuthology.orchestra.run.smithi137:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xrRYrcMcqL 2024-04-18T10:24:26.715 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.xrRYrcMcqL 2024-04-18T10:24:26.825 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-04-18T10:24:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-18T10:24:26.830 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-18T10:24:26.850 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.xrRYrcMcqL is 6KB 2024-04-18T10:24:26.898 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.xrRYrcMcqL 2024-04-18T10:24:26.915 DEBUG:teuthology.orchestra.run.smithi137:> sudo /bin/ls /boot/loader/entries || true 2024-04-18T10:24:26.992 INFO:teuthology.orchestra.run.smithi137.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-18T10:24:26.992 INFO:teuthology.orchestra.run.smithi137.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-18T10:24:26.992 INFO:teuthology.orchestra.run.smithi137.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-18T10:24:26.992 INFO:teuthology.orchestra.run.smithi137.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-18T10:24:26.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-18T10:24:27.052 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-18T10:24:27.052 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-18T10:24:27.052 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-18T10:24:27.052 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T10:24:27.053 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T10:24:27.053 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-18T10:24:27.053 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T10:24:27.053 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-04-18T10:24:27.147 DEBUG:teuthology.orchestra.run.smithi137:> sudo shutdown -r now 2024-04-18T10:24:27.274 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-18T10:24:27.274 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-18T10:24:27.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2024-04-18T10:24:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2024-04-18T10:24:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2024-04-18T10:24:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.02 2024-04-18T10:24:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 129.el8 2024-04-18T10:24:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Group : System Environment/Base 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 9265586 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Relocations : (not relocatable) 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : CentOS BuildSystem 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2024-04-18T10:24:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-18T10:24:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2024-04-18T10:24:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2024-04-18T10:24:27.311 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:24:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-18T10:24:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-18T10:24:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-18T10:24:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2024-04-18T10:24:27.311 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:24:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2024-04-18T10:24:27.312 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-18T10:24:27.312 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 4.18.0-552.el8.x86_64 2024-04-18T10:24:27.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-18T10:24:27.657 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-18T10:24:27.657 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:24:27.657 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:24:27.657 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-18T10:24:27.657 INFO:teuthology.orchestra.run.smithi031.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-18T10:24:27.657 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:24:27.657 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:24:27.803 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-04-18T10:24:28.070 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-18T10:24:28.070 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-18T10:24:28.070 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-18T10:24:28.070 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-18T10:24:28.071 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-18T10:24:28.071 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-18T10:24:28.071 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=None, version=distro) 2024-04-18T10:24:28.071 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2024-04-18T10:24:28.292 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-18T10:24:28.292 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-18T10:24:28.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -qi grub2-tools 2024-04-18T10:24:28.326 INFO:teuthology.orchestra.run.smithi031.stdout:Name : grub2-tools 2024-04-18T10:24:28.326 INFO:teuthology.orchestra.run.smithi031.stdout:Epoch : 1 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Version : 2.02 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Release : 129.el8 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: x86_64 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Group : System Environment/Base 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Size : 9265586 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:License : GPLv3+ 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-18T10:24:28.327 INFO:teuthology.orchestra.run.smithi031.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:Relocations : (not relocatable) 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:Packager : CentOS BuildSystem 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:Vendor : CentOS 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:Summary : Support tools for GRUB. 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:Description : 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:hardware devices. 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:24:28.328 INFO:teuthology.orchestra.run.smithi031.stdout:This subpackage provides tools for support of all platforms. 2024-04-18T10:24:28.329 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-18T10:24:28.329 INFO:teuthology.task.kernel:Updating grub on smithi031 to boot 4.18.0-552.el8.x86_64 2024-04-18T10:24:28.329 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-18T10:24:28.904 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-04-18T10:24:29.682 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-04-18T10:24:30.962 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-04-18T10:24:30.964 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-04-18T10:24:31.000 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.OTOilXgqmY 2024-04-18T10:24:31.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OTOilXgqmY 2024-04-18T10:24:31.072 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.OTOilXgqmY 2024-04-18T10:24:31.218 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.OTOilXgqmY is 6KB 2024-04-18T10:24:31.265 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.OTOilXgqmY 2024-04-18T10:24:31.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2024-04-18T10:24:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-18T10:24:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-18T10:24:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-18T10:24:31.359 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-18T10:24:31.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-18T10:24:31.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-04-18T10:24:31.993 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-04-18T10:24:31.995 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-18T10:24:32.022 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.TCRztzZQkL 2024-04-18T10:24:32.022 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TCRztzZQkL 2024-04-18T10:24:32.094 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.TCRztzZQkL 2024-04-18T10:24:32.245 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.TCRztzZQkL is 6KB 2024-04-18T10:24:32.293 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.TCRztzZQkL 2024-04-18T10:24:32.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo /bin/ls /boot/loader/entries || true 2024-04-18T10:24:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-18T10:24:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-18T10:24:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-18T10:24:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-18T10:24:32.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-18T10:24:32.560 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2024-04-18T10:24:57.166 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-18T10:24:57.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T10:24:57.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:25:01.522 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-18T10:25:01.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T10:25:01.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:25:02.565 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-18T10:25:02.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-18T10:25:02.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:25:15.551 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T10:25:19.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T10:25:20.926 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-18T10:25:24.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T10:25:24.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:25:27.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T10:25:28.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T10:25:28.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:25:29.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-18T10:25:29.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:25:39.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T10:25:39.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:25:48.318 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-18T10:26:00.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-18T10:26:00.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:26:00.692 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-04-18T10:26:00.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-18T10:26:00.979 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-552.el8.x86_64"... 2024-04-18T10:26:00.979 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-04-18T10:26:00.997 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-552.el8.x86_64 2024-04-18T10:26:00.997 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-18T10:26:00.997 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T10:26:00.997 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-18T10:26:01.998 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-18T10:26:01.998 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T10:26:02.084 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2024-04-18T10:26:02.101 DEBUG:teuthology.parallel:result is None 2024-04-18T10:26:11.964 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-18T10:26:12.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T10:26:12.763 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-552.el8.x86_64"... 2024-04-18T10:26:12.763 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-18T10:26:12.821 INFO:teuthology.orchestra.run.smithi137.stdout:4.18.0-552.el8.x86_64 2024-04-18T10:26:12.821 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-18T10:26:12.821 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T10:26:12.821 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-18T10:26:13.822 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2024-04-18T10:26:13.822 DEBUG:teuthology.orchestra.run.smithi137:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T10:26:13.892 INFO:teuthology.orchestra.run.smithi137.stdout:ttyS1 2024-04-18T10:26:13.905 DEBUG:teuthology.parallel:result is None 2024-04-18T10:26:28.908 DEBUG:teuthology.orchestra.remote:timed out 2024-04-18T10:26:40.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T10:26:40.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:26:41.257 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-18T10:26:41.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T10:26:41.523 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-552.el8.x86_64"... 2024-04-18T10:26:41.523 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-04-18T10:26:41.542 INFO:teuthology.orchestra.run.smithi040.stdout:4.18.0-552.el8.x86_64 2024-04-18T10:26:41.542 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-18T10:26:41.542 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-18T10:26:41.542 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-18T10:26:42.544 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-04-18T10:26:42.544 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-18T10:26:42.652 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2024-04-18T10:26:42.670 DEBUG:teuthology.parallel:result is None 2024-04-18T10:26:42.671 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-18T10:26:42.678 INFO:teuthology.task.internal:Creating test directory... 2024-04-18T10:26:42.679 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T10:26:42.682 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T10:26:42.685 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-18T10:26:42.706 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-18T10:26:42.713 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-18T10:26:42.724 INFO:teuthology.task.internal:Creating archive directory... 2024-04-18T10:26:42.724 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T10:26:42.747 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T10:26:42.749 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-18T10:26:42.796 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-18T10:26:42.802 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-18T10:26:42.802 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T10:26:42.820 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T10:26:42.822 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-18T10:26:42.866 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T10:26:42.867 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T10:26:42.877 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T10:26:42.878 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T10:26:42.900 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T10:26:42.911 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-18T10:26:42.912 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-18T10:26:42.919 INFO:teuthology.task.internal:Configuring sudo... 2024-04-18T10:26:42.920 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T10:26:42.922 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T10:26:42.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-18T10:26:42.953 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-18T10:26:42.962 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-18T10:26:42.962 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T10:26:42.993 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T10:26:42.995 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-18T10:26:43.014 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T10:26:43.097 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T10:26:43.152 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T10:26:43.238 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T10:26:43.281 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:26:43.282 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T10:26:43.350 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T10:26:43.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T10:26:43.461 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T10:26:43.509 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T10:26:43.555 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:26:43.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T10:26:43.625 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T10:26:43.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-18T10:26:43.731 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T10:26:43.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-18T10:26:43.864 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:26:43.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-18T10:26:43.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-04-18T10:26:43.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-04-18T10:26:43.937 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-04-18T10:26:44.006 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-18T10:26:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-18T10:26:44.034 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-18T10:26:44.420 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-18T10:26:44.430 INFO:teuthology.task.internal:Starting timer... 2024-04-18T10:26:44.430 INFO:teuthology.run_tasks:Running task pcp... 2024-04-18T10:26:44.440 INFO:teuthology.run_tasks:Running task selinux... 2024-04-18T10:26:44.448 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-18T10:26:44.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2024-04-18T10:26:44.524 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2024-04-18T10:26:44.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-04-18T10:26:44.617 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-04-18T10:26:44.619 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-04-18T10:26:44.715 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-04-18T10:26:44.717 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-18T10:26:44.717 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2024-04-18T10:26:44.742 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2024-04-18T10:26:44.743 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-04-18T10:26:44.810 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-04-18T10:26:44.810 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-04-18T10:26:44.843 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-04-18T10:26:44.843 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi137.front.sepia.ceph.com': 'permissive'} 2024-04-18T10:26:44.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-18T10:26:44.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:26:44.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-18T10:26:44.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:26:44.903 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-18T10:26:44.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:26:44.930 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-18T10:26:44.931 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2024-04-18T10:26:44.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-04-18T10:26:44.994 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-04-18T10:26:45.021 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-18T10:26:45.032 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-18T10:26:45.052 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-18T10:26:45.054 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi040.front.sepia.ceph.com,smithi137.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-18T10:32:49.837 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi137.front.sepia.ceph.com')] 2024-04-18T10:32:49.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-18T10:32:49.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:32:49.919 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-04-18T10:32:49.991 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-18T10:32:49.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T10:32:49.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:32:50.067 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-18T10:32:50.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T10:32:50.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T10:32:50.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T10:32:50.221 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-18T10:32:50.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T10:32:50.295 INFO:teuthology.run_tasks:Running task clock... 2024-04-18T10:32:50.306 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-18T10:32:50.306 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T10:32:50.307 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T10:32:50.310 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T10:32:50.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T10:32:50.315 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-18T10:32:50.315 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T10:32:50.346 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-18T10:32:50.350 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-18T10:32:50.362 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-18T10:32:50.366 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-18T10:32:50.371 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-18T10:32:50.387 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-18T10:32:50.427 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2024-04-18T10:32:50.432 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-04-18T10:32:50.439 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2024-04-18T10:32:50.444 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-04-18T10:32:50.452 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-04-18T10:32:50.453 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-18T10:32:50.459 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-18T10:32:50.464 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-04-18T10:32:50.468 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-18T10:32:50.473 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-18T10:32:50.479 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-18T10:32:50.492 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-18T10:32:50.540 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2024-04-18T10:32:50.544 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-18T10:32:50.545 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-04-18T10:32:50.545 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.545 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.545 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.545 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2024-04-18T10:32:50.551 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-18T10:32:50.551 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-04-18T10:32:50.551 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.551 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.551 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.551 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.556 INFO:teuthology.orchestra.run.smithi137.stderr:bash: ntpq: command not found 2024-04-18T10:32:50.559 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-18T10:32:50.559 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-04-18T10:32:50.559 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.560 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.560 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.560 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:32:50.561 INFO:teuthology.run_tasks:Running task install... 2024-04-18T10:32:50.569 DEBUG:teuthology.task.install:project ceph 2024-04-18T10:32:50.569 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf'}} 2024-04-18T10:32:50.570 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf'} 2024-04-18T10:32:50.570 INFO:teuthology.task.install:Using flavor: default 2024-04-18T10:32:50.576 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-18T10:32:50.576 INFO:teuthology.task.install:extra packages: ['librados2'] 2024-04-18T10:32:50.576 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf', 'tag': None, 'wait_for_package': False} 2024-04-18T10:32:50.576 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:32:50.577 INFO:teuthology.packaging:ref: None 2024-04-18T10:32:50.577 INFO:teuthology.packaging:tag: None 2024-04-18T10:32:50.577 INFO:teuthology.packaging:branch: octopus 2024-04-18T10:32:50.577 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:32:50.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-18T10:32:50.579 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf', 'tag': None, 'wait_for_package': False} 2024-04-18T10:32:50.579 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:32:50.579 INFO:teuthology.packaging:ref: None 2024-04-18T10:32:50.579 INFO:teuthology.packaging:tag: None 2024-04-18T10:32:50.579 INFO:teuthology.packaging:branch: octopus 2024-04-18T10:32:50.579 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:32:50.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-18T10:32:50.580 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf', 'tag': None, 'wait_for_package': False} 2024-04-18T10:32:50.581 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:32:50.581 INFO:teuthology.packaging:ref: None 2024-04-18T10:32:50.581 INFO:teuthology.packaging:tag: None 2024-04-18T10:32:50.581 INFO:teuthology.packaging:branch: octopus 2024-04-18T10:32:50.581 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:32:50.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-18T10:32:50.787 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-04-18T10:32:50.788 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-04-18T10:32:50.803 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-04-18T10:32:50.803 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-04-18T10:32:50.833 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-18T10:32:50.834 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:32:50.834 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-18T10:32:50.847 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-18T10:32:50.847 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:32:50.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-18T10:32:50.864 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-04-18T10:32:50.865 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:32:50.865 INFO:teuthology.packaging:ref: None 2024-04-18T10:32:50.865 INFO:teuthology.packaging:tag: None 2024-04-18T10:32:50.865 INFO:teuthology.packaging:branch: octopus 2024-04-18T10:32:50.865 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:32:50.865 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-18T10:32:50.877 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-04-18T10:32:50.878 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-04-18T10:32:50.882 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-04-18T10:32:50.882 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:32:50.882 INFO:teuthology.packaging:ref: None 2024-04-18T10:32:50.882 INFO:teuthology.packaging:tag: None 2024-04-18T10:32:50.882 INFO:teuthology.packaging:branch: octopus 2024-04-18T10:32:50.882 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:32:50.882 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-18T10:32:50.904 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-18T10:32:50.904 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:32:50.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-18T10:32:50.934 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-18T10:32:50.937 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-04-18T10:32:50.937 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:32:50.937 INFO:teuthology.packaging:ref: None 2024-04-18T10:32:50.937 INFO:teuthology.packaging:tag: None 2024-04-18T10:32:50.937 INFO:teuthology.packaging:branch: octopus 2024-04-18T10:32:50.937 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:32:50.937 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-18T10:32:50.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-18T10:32:51.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-18T10:32:51.012 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-18T10:32:51.035 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-18T10:32:51.079 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-04-18T10:32:51.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-04-18T10:32:51.091 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-18T10:32:51.104 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2024-04-18T10:32:51.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2024-04-18T10:32:51.161 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-04-18T10:32:51.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-04-18T10:32:51.345 INFO:teuthology.orchestra.run.smithi137.stdout:78 files removed 2024-04-18T10:32:51.373 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw 2024-04-18T10:32:51.386 INFO:teuthology.orchestra.run.smithi031.stdout:78 files removed 2024-04-18T10:32:51.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw 2024-04-18T10:32:51.436 INFO:teuthology.orchestra.run.smithi040.stdout:78 files removed 2024-04-18T10:32:51.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw 2024-04-18T10:32:51.861 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 805 kB/s | 68 kB 00:00 2024-04-18T10:32:51.931 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 787 kB/s | 68 kB 00:00 2024-04-18T10:32:51.965 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 907 kB/s | 68 kB 00:00 2024-04-18T10:32:51.978 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 188 kB/s | 15 kB 00:00 2024-04-18T10:32:52.049 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 193 kB/s | 15 kB 00:00 2024-04-18T10:32:52.083 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 193 kB/s | 15 kB 00:00 2024-04-18T10:32:52.137 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 13 kB/s | 1.7 kB 00:00 2024-04-18T10:32:52.159 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 22 kB/s | 1.7 kB 00:00 2024-04-18T10:32:52.192 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 22 kB/s | 1.7 kB 00:00 2024-04-18T10:32:53.291 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - AppStream 25 MB/s | 28 MB 00:01 2024-04-18T10:32:53.537 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - AppStream 20 MB/s | 28 MB 00:01 2024-04-18T10:32:54.583 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 12 MB/s | 28 MB 00:02 2024-04-18T10:32:59.692 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - BaseOS 9.8 MB/s | 10 MB 00:01 2024-04-18T10:33:00.097 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - BaseOS 6.5 MB/s | 10 MB 00:01 2024-04-18T10:33:01.309 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 7.2 MB/s | 10 MB 00:01 2024-04-18T10:33:01.692 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras 61 kB/s | 18 kB 00:00 2024-04-18T10:33:01.904 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - Extras 89 kB/s | 18 kB 00:00 2024-04-18T10:33:02.059 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras common packages 30 kB/s | 7.7 kB 00:00 2024-04-18T10:33:02.238 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - Extras common packages 34 kB/s | 7.7 kB 00:00 2024-04-18T10:33:02.661 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - PowerTools 9.8 MB/s | 5.0 MB 00:00 2024-04-18T10:33:02.956 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 8 - PowerTools 7.9 MB/s | 5.0 MB 00:00 2024-04-18T10:33:03.252 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 63 kB/s | 18 kB 00:00 2024-04-18T10:33:03.777 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 7.7 kB 00:00 2024-04-18T10:33:03.837 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-04-18T10:33:04.008 INFO:teuthology.orchestra.run.smithi137.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-04-18T10:33:04.495 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - PowerTools 8.0 MB/s | 5.0 MB 00:00 2024-04-18T10:33:05.059 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2024-04-18T10:33:05.597 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2024-04-18T10:33:08.892 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 422 kB/s | 24 kB 00:00 2024-04-18T10:33:12.540 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-04-18T10:33:12.543 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-04-18T10:33:12.544 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:33:12.545 INFO:teuthology.orchestra.run.smithi137.stdout:Install 22 Packages 2024-04-18T10:33:12.546 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 2 Packages 2024-04-18T10:33:12.546 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:12.546 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 49 M 2024-04-18T10:33:12.546 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:33:12.858 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 2.3 MB/s | 16 MB 00:07 2024-04-18T10:33:13.119 INFO:teuthology.orchestra.run.smithi137.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 28 MB/s | 5.6 MB 00:00 2024-04-18T10:33:13.144 INFO:teuthology.orchestra.run.smithi137.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-04-18T10:33:13.203 INFO:teuthology.orchestra.run.smithi137.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 8.5 MB/s | 508 kB 00:00 2024-04-18T10:33:13.345 INFO:teuthology.orchestra.run.smithi137.stdout:(4/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 23 MB/s | 9.9 MB 00:00 2024-04-18T10:33:13.428 INFO:teuthology.orchestra.run.smithi137.stdout:(5/24): libradosstriper1-15.2.17-0.el8.x86_64.r 1.6 MB/s | 380 kB 00:00 2024-04-18T10:33:13.537 INFO:teuthology.orchestra.run.smithi137.stdout:(6/24): librgw2-15.2.17-0.el8.x86_64.rpm 17 MB/s | 3.2 MB 00:00 2024-04-18T10:33:13.563 INFO:teuthology.orchestra.run.smithi137.stdout:(7/24): python3-ceph-argparse-15.2.17-0.el8.x86 298 kB/s | 40 kB 00:00 2024-04-18T10:33:13.588 INFO:teuthology.orchestra.run.smithi137.stdout:(8/24): python3-ceph-common-15.2.17-0.el8.x86_6 1.5 MB/s | 77 kB 00:00 2024-04-18T10:33:13.621 INFO:teuthology.orchestra.run.smithi137.stdout:(9/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-04-18T10:33:13.646 INFO:teuthology.orchestra.run.smithi137.stdout:(10/24): python3-rados-15.2.17-0.el8.x86_64.rpm 6.1 MB/s | 364 kB 00:00 2024-04-18T10:33:13.672 INFO:teuthology.orchestra.run.smithi137.stdout:(11/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 6.8 MB/s | 349 kB 00:00 2024-04-18T10:33:13.689 INFO:teuthology.orchestra.run.smithi137.stdout:(12/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 2.6 MB/s | 113 kB 00:00 2024-04-18T10:33:13.906 INFO:teuthology.orchestra.run.smithi137.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 21 MB/s | 21 MB 00:00 2024-04-18T10:33:13.940 INFO:teuthology.orchestra.run.smithi137.stdout:(14/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 MB/s | 259 kB 00:00 2024-04-18T10:33:13.965 INFO:teuthology.orchestra.run.smithi137.stdout:(15/24): librdkafka-1.6.1-1.el8.x86_64.rpm 2.3 MB/s | 677 kB 00:00 2024-04-18T10:33:13.999 INFO:teuthology.orchestra.run.smithi137.stdout:(16/24): python3-prettytable-0.7.2-14.el8.noarc 478 kB/s | 44 kB 00:00 2024-04-18T10:33:14.074 INFO:teuthology.orchestra.run.smithi137.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 352 kB/s | 47 kB 00:00 2024-04-18T10:33:14.182 INFO:teuthology.orchestra.run.smithi137.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 535 kB/s | 116 kB 00:00 2024-04-18T10:33:14.241 INFO:teuthology.orchestra.run.smithi137.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2024-04-18T10:33:14.275 INFO:teuthology.orchestra.run.smithi137.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2024-04-18T10:33:14.292 INFO:teuthology.orchestra.run.smithi137.stdout:(21/24): leveldb-1.22-1.el8.x86_64.rpm 834 kB/s | 181 kB 00:00 2024-04-18T10:33:14.317 INFO:teuthology.orchestra.run.smithi137.stdout:(22/24): libunwind-1.3.1-3.el8.x86_64.rpm 996 kB/s | 75 kB 00:00 2024-04-18T10:33:14.417 INFO:teuthology.orchestra.run.smithi137.stdout:(23/24): librados2-15.2.17-0.el8.x86_64.rpm 25 MB/s | 3.5 MB 00:00 2024-04-18T10:33:14.459 INFO:teuthology.orchestra.run.smithi137.stdout:(24/24): librbd1-15.2.17-0.el8.x86_64.rpm 12 MB/s | 1.9 MB 00:00 2024-04-18T10:33:14.464 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:33:14.464 INFO:teuthology.orchestra.run.smithi137.stdout:Total 25 MB/s | 49 MB 00:01 2024-04-18T10:33:14.506 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:33:14.553 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:33:14.553 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:33:14.849 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:33:14.852 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:33:15.826 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:33:16.033 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-04-18T10:33:16.287 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-04-18T10:33:16.466 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-18T10:33:16.840 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-18T10:33:16.889 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 399 kB/s | 24 kB 00:00 2024-04-18T10:33:17.025 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-18T10:33:17.108 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-18T10:33:17.372 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-04-18T10:33:17.566 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-18T10:33:17.770 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-18T10:33:17.966 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-18T10:33:18.031 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-18T10:33:18.259 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-04-18T10:33:18.728 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-04-18T10:33:18.907 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-18T10:33:18.987 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-18T10:33:19.170 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-04-18T10:33:19.358 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-04-18T10:33:19.536 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-04-18T10:33:19.564 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:15 2024-04-18T10:33:19.740 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-04-18T10:33:19.931 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-04-18T10:33:20.082 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-18T10:33:20.133 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-18T10:33:20.392 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-04-18T10:33:20.598 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-04-18T10:33:20.783 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:33:20.785 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-04-18T10:33:20.786 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-04-18T10:33:20.787 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:33:20.788 INFO:teuthology.orchestra.run.smithi040.stdout:Install 22 Packages 2024-04-18T10:33:20.789 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 2 Packages 2024-04-18T10:33:20.789 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:33:20.789 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 49 M 2024-04-18T10:33:20.789 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:33:20.806 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-04-18T10:33:20.999 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-04-18T10:33:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 39 MB/s | 5.6 MB 00:00 2024-04-18T10:33:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-04-18T10:33:21.408 INFO:teuthology.orchestra.run.smithi040.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 15 MB/s | 508 kB 00:00 2024-04-18T10:33:21.442 INFO:teuthology.orchestra.run.smithi040.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 11 MB/s | 380 kB 00:00 2024-04-18T10:33:21.545 INFO:teuthology.orchestra.run.smithi040.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 31 MB/s | 3.2 MB 00:00 2024-04-18T10:33:21.576 INFO:teuthology.orchestra.run.smithi040.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.3 MB/s | 40 kB 00:00 2024-04-18T10:33:21.593 INFO:teuthology.orchestra.run.smithi040.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 4.5 MB/s | 77 kB 00:00 2024-04-18T10:33:21.626 INFO:teuthology.orchestra.run.smithi040.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 4.8 MB/s | 164 kB 00:00 2024-04-18T10:33:21.660 INFO:teuthology.orchestra.run.smithi040.stdout:(9/24): python3-rados-15.2.17-0.el8.x86_64.rpm 11 MB/s | 364 kB 00:00 2024-04-18T10:33:21.694 INFO:teuthology.orchestra.run.smithi040.stdout:(10/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 10 MB/s | 349 kB 00:00 2024-04-18T10:33:21.719 INFO:teuthology.orchestra.run.smithi040.stdout:(11/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 4.5 MB/s | 113 kB 00:00 2024-04-18T10:33:21.853 INFO:teuthology.orchestra.run.smithi040.stdout:(12/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 15 MB/s | 9.9 MB 00:00 2024-04-18T10:33:21.911 INFO:teuthology.orchestra.run.smithi040.stdout:(13/24): librdkafka-1.6.1-1.el8.x86_64.rpm 3.4 MB/s | 677 kB 00:00 2024-04-18T10:33:21.937 INFO:teuthology.orchestra.run.smithi040.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2024-04-18T10:33:21.962 INFO:teuthology.orchestra.run.smithi040.stdout:(15/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2024-04-18T10:33:22.164 INFO:teuthology.orchestra.run.smithi040.stdout:(16/24): ceph-common-15.2.17-0.el8.x86_64.rpm 22 MB/s | 21 MB 00:00 2024-04-18T10:33:22.271 INFO:teuthology.orchestra.run.smithi040.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 141 kB/s | 47 kB 00:00 2024-04-18T10:33:22.330 INFO:teuthology.orchestra.run.smithi040.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 317 kB/s | 116 kB 00:00 2024-04-18T10:33:22.397 INFO:teuthology.orchestra.run.smithi040.stdout:(19/24): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2024-04-18T10:33:22.422 INFO:teuthology.orchestra.run.smithi040.stdout:(20/24): liboath-2.6.2-3.el8.x86_64.rpm 638 kB/s | 59 kB 00:00 2024-04-18T10:33:22.456 INFO:teuthology.orchestra.run.smithi040.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2024-04-18T10:33:22.489 INFO:teuthology.orchestra.run.smithi040.stdout:(22/24): leveldb-1.22-1.el8.x86_64.rpm 830 kB/s | 181 kB 00:00 2024-04-18T10:33:22.539 INFO:teuthology.orchestra.run.smithi040.stdout:(23/24): librbd1-15.2.17-0.el8.x86_64.rpm 23 MB/s | 1.9 MB 00:00 2024-04-18T10:33:22.590 INFO:teuthology.orchestra.run.smithi040.stdout:(24/24): librados2-15.2.17-0.el8.x86_64.rpm 21 MB/s | 3.5 MB 00:00 2024-04-18T10:33:22.592 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:33:22.592 INFO:teuthology.orchestra.run.smithi040.stdout:Total 27 MB/s | 49 MB 00:01 2024-04-18T10:33:22.638 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:33:22.689 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:33:22.689 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:33:23.011 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:33:23.015 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:33:23.164 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-18T10:33:23.357 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-18T10:33:23.812 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 396 kB/s | 24 kB 00:00 2024-04-18T10:33:24.013 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-18T10:33:24.068 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:33:24.264 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-18T10:33:24.302 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-04-18T10:33:24.374 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-18T10:33:24.490 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-18T10:33:24.517 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-04-18T10:33:24.682 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-18T10:33:25.086 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-18T10:33:25.249 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-18T10:33:25.348 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-18T10:33:25.583 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-04-18T10:33:25.774 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-18T10:33:26.004 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-18T10:33:26.198 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-18T10:33:26.263 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-18T10:33:26.471 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-04-18T10:33:26.950 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-04-18T10:33:27.090 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-18T10:33:27.153 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-18T10:33:27.312 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-04-18T10:33:27.508 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-04-18T10:33:27.670 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-04-18T10:33:27.706 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:33:27.708 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-04-18T10:33:27.709 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-04-18T10:33:27.710 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-18T10:33:27.711 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-04-18T10:33:27.711 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-04-18T10:33:27.711 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-04-18T10:33:27.711 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:33:27.711 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:33:27.711 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:33:27.711 INFO:teuthology.orchestra.run.smithi031.stdout:Install 22 Packages 2024-04-18T10:33:27.711 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 2 Packages 2024-04-18T10:33:27.711 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:33:27.712 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 49 M 2024-04-18T10:33:27.712 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:33:27.859 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-04-18T10:33:28.041 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-04-18T10:33:28.157 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-18T10:33:28.242 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-18T10:33:28.396 INFO:teuthology.orchestra.run.smithi031.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 19 MB/s | 5.6 MB 00:00 2024-04-18T10:33:28.421 INFO:teuthology.orchestra.run.smithi031.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-04-18T10:33:28.455 INFO:teuthology.orchestra.run.smithi031.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 15 MB/s | 508 kB 00:00 2024-04-18T10:33:28.489 INFO:teuthology.orchestra.run.smithi031.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 11 MB/s | 380 kB 00:00 2024-04-18T10:33:28.504 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-04-18T10:33:28.572 INFO:teuthology.orchestra.run.smithi031.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 39 MB/s | 3.2 MB 00:00 2024-04-18T10:33:28.598 INFO:teuthology.orchestra.run.smithi031.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-04-18T10:33:28.623 INFO:teuthology.orchestra.run.smithi031.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 3.0 MB/s | 77 kB 00:00 2024-04-18T10:33:28.650 INFO:teuthology.orchestra.run.smithi031.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 6.4 MB/s | 164 kB 00:00 2024-04-18T10:33:28.682 INFO:teuthology.orchestra.run.smithi031.stdout:(9/24): python3-rados-15.2.17-0.el8.x86_64.rpm 11 MB/s | 364 kB 00:00 2024-04-18T10:33:28.700 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-04-18T10:33:28.707 INFO:teuthology.orchestra.run.smithi031.stdout:(10/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 14 MB/s | 349 kB 00:00 2024-04-18T10:33:28.724 INFO:teuthology.orchestra.run.smithi031.stdout:(11/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 6.7 MB/s | 113 kB 00:00 2024-04-18T10:33:28.833 INFO:teuthology.orchestra.run.smithi031.stdout:(12/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 14 MB/s | 9.9 MB 00:00 2024-04-18T10:33:28.864 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-04-18T10:33:29.066 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-04-18T10:33:29.075 INFO:teuthology.orchestra.run.smithi031.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 21 MB/s | 21 MB 00:00 2024-04-18T10:33:29.100 INFO:teuthology.orchestra.run.smithi031.stdout:(14/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 973 kB/s | 259 kB 00:00 2024-04-18T10:33:29.125 INFO:teuthology.orchestra.run.smithi031.stdout:(15/24): librdkafka-1.6.1-1.el8.x86_64.rpm 1.6 MB/s | 677 kB 00:00 2024-04-18T10:33:29.142 INFO:teuthology.orchestra.run.smithi031.stdout:(16/24): python3-prettytable-0.7.2-14.el8.noarc 655 kB/s | 44 kB 00:00 2024-04-18T10:33:29.259 INFO:teuthology.orchestra.run.smithi031.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 296 kB/s | 47 kB 00:00 2024-04-18T10:33:29.509 INFO:teuthology.orchestra.run.smithi031.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 303 kB/s | 116 kB 00:00 2024-04-18T10:33:29.576 INFO:teuthology.orchestra.run.smithi031.stdout:(19/24): gperftools-libs-2.7-9.el8.x86_64.rpm 706 kB/s | 306 kB 00:00 2024-04-18T10:33:29.594 INFO:teuthology.orchestra.run.smithi031.stdout:(20/24): liboath-2.6.2-3.el8.x86_64.rpm 703 kB/s | 59 kB 00:00 2024-04-18T10:33:29.660 INFO:teuthology.orchestra.run.smithi031.stdout:(21/24): librados2-15.2.17-0.el8.x86_64.rpm 53 MB/s | 3.5 MB 00:00 2024-04-18T10:33:29.677 INFO:teuthology.orchestra.run.smithi031.stdout:(22/24): libunwind-1.3.1-3.el8.x86_64.rpm 747 kB/s | 75 kB 00:00 2024-04-18T10:33:29.702 INFO:teuthology.orchestra.run.smithi031.stdout:(23/24): leveldb-1.22-1.el8.x86_64.rpm 408 kB/s | 181 kB 00:00 2024-04-18T10:33:29.753 INFO:teuthology.orchestra.run.smithi031.stdout:(24/24): librbd1-15.2.17-0.el8.x86_64.rpm 21 MB/s | 1.9 MB 00:00 2024-04-18T10:33:29.754 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:33:29.755 INFO:teuthology.orchestra.run.smithi031.stdout:Total 24 MB/s | 49 MB 00:02 2024-04-18T10:33:29.798 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:33:29.849 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:33:29.849 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:33:30.180 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:33:30.183 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:33:31.202 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:33:31.411 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-04-18T10:33:31.411 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-18T10:33:31.632 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-18T10:33:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-04-18T10:33:31.829 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-18T10:33:32.220 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-18T10:33:32.329 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-18T10:33:32.379 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-18T10:33:32.470 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-18T10:33:32.563 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-18T10:33:32.677 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-18T10:33:32.689 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-04-18T10:33:32.782 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-18T10:33:32.887 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-18T10:33:33.116 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-18T10:33:33.321 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-18T10:33:33.408 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-18T10:33:33.618 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-04-18T10:33:34.308 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-04-18T10:33:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-18T10:33:34.545 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-18T10:33:34.725 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-04-18T10:33:34.881 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-04-18T10:33:35.059 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-04-18T10:33:35.284 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-04-18T10:33:35.514 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-04-18T10:33:35.670 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-18T10:33:35.746 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-18T10:33:35.950 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-04-18T10:33:36.139 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-04-18T10:33:36.352 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-04-18T10:33:36.513 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-04-18T10:33:38.867 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-18T10:33:39.070 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-18T10:33:39.753 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-18T10:33:39.981 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-18T10:33:40.095 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-18T10:33:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-18T10:33:43.273 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-18T10:33:43.273 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-04-18T10:33:43.273 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-04-18T10:33:43.273 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /dev 2024-04-18T10:33:43.273 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /run 2024-04-18T10:33:43.273 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-04-18T10:33:43.273 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-04-18T10:33:43.273 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-04-18T10:33:43.274 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-04-18T10:33:43.274 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /dev 2024-04-18T10:33:43.274 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:44.277 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-18T10:33:44.355 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-18T10:33:44.355 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-18T10:33:44.572 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-18T10:33:44.572 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-18T10:33:45.252 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-18T10:33:45.252 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-04-18T10:33:45.252 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-04-18T10:33:45.253 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-04-18T10:33:45.254 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-04-18T10:33:46.211 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-04-18T10:33:46.211 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:46.211 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-04-18T10:33:46.211 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.211 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:33:46.211 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.211 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.211 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: fmt-6.2.1-1.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: leveldb-1.22-1.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-18T10:33:46.212 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.213 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.213 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.213 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-18T10:33:46.213 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.213 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.213 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:46.213 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:46.213 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:33:46.547 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-test 2024-04-18T10:33:47.281 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:00:39 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:33:48.923 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:33:48.923 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:33:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-18T10:33:48.923 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:33:48.923 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:33:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-04-18T10:33:48.923 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-04-18T10:33:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-18T10:33:48.923 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-18T10:33:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-18T10:33:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-18T10:33:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:48.924 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:33:48.924 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:33:48.924 INFO:teuthology.orchestra.run.smithi137.stdout:Install 5 Packages 2024-04-18T10:33:48.924 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:48.925 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 43 M 2024-04-18T10:33:48.925 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 155 M 2024-04-18T10:33:48.925 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:33:49.196 INFO:teuthology.orchestra.run.smithi137.stdout:(1/5): jq-1.6-8.el8.x86_64.rpm 2.5 MB/s | 203 kB 00:00 2024-04-18T10:33:49.221 INFO:teuthology.orchestra.run.smithi137.stdout:(2/5): oniguruma-6.8.2-3.el8.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-04-18T10:33:49.246 INFO:teuthology.orchestra.run.smithi137.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2024-04-18T10:33:49.263 INFO:teuthology.orchestra.run.smithi137.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-04-18T10:33:50.064 INFO:teuthology.orchestra.run.smithi137.stdout:(5/5): ceph-test-15.2.17-0.el8.x86_64.rpm 44 MB/s | 42 MB 00:00 2024-04-18T10:33:50.065 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:33:50.065 INFO:teuthology.orchestra.run.smithi137.stdout:Total 38 MB/s | 43 MB 00:01 2024-04-18T10:33:50.108 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:33:50.127 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:33:50.128 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:33:50.404 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:33:50.407 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:33:50.820 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:33:51.020 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-18T10:33:51.196 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-18T10:33:51.311 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-18T10:33:51.394 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-18T10:33:52.302 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-18T10:33:52.302 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2024-04-18T10:33:52.302 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2024-04-18T10:33:52.303 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2024-04-18T10:33:52.303 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /run 2024-04-18T10:33:52.303 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2024-04-18T10:33:52.303 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2024-04-18T10:33:52.303 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2024-04-18T10:33:52.303 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2024-04-18T10:33:52.303 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2024-04-18T10:33:52.303 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:33:53.377 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-18T10:33:53.458 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-18T10:33:53.458 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-18T10:33:53.672 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-18T10:33:53.673 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-18T10:33:54.357 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-18T10:33:54.357 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-04-18T10:33:54.357 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-04-18T10:33:54.357 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-04-18T10:33:54.357 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-04-18T10:33:54.358 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-04-18T10:33:54.359 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-04-18T10:33:54.359 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-04-18T10:33:54.359 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-04-18T10:33:54.359 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-04-18T10:33:54.359 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-04-18T10:33:54.359 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-04-18T10:33:54.359 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-04-18T10:33:54.359 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-04-18T10:33:54.359 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.184 INFO:teuthology.orchestra.run.smithi040.stdout: fmt-6.2.1-1.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: leveldb-1.22-1.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.185 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-18T10:33:55.186 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.186 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.186 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-04-18T10:33:55.186 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:33:55.186 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:33:55.240 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-18T10:33:55.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-test 2024-04-18T10:33:55.492 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-18T10:33:55.762 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-18T10:33:55.763 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-04-18T10:33:55.763 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-18T10:33:55.763 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-18T10:33:55.763 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-18T10:33:56.188 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-18T10:33:56.188 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:56.188 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:33:56.189 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-18T10:33:56.189 INFO:teuthology.orchestra.run.smithi137.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-18T10:33:56.189 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-18T10:33:56.189 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:56.189 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:33:56.219 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:40 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:33:56.427 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph 2024-04-18T10:33:57.168 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:00:49 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:33:57.980 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:33:57.981 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:33:57.981 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-18T10:33:57.981 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout:Install 5 Packages 2024-04-18T10:33:57.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:33:57.983 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 43 M 2024-04-18T10:33:57.983 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 155 M 2024-04-18T10:33:57.983 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:33:58.249 INFO:teuthology.orchestra.run.smithi040.stdout:(1/5): oniguruma-6.8.2-3.el8.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-04-18T10:33:58.275 INFO:teuthology.orchestra.run.smithi040.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 2.0 MB/s | 203 kB 00:00 2024-04-18T10:33:58.308 INFO:teuthology.orchestra.run.smithi040.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-04-18T10:33:58.333 INFO:teuthology.orchestra.run.smithi040.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-04-18T10:33:58.788 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:33:58.791 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:33:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-04-18T10:33:58.791 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:33:58.791 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:33:58.791 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-04-18T10:33:58.791 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-18T10:33:58.792 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-18T10:33:58.793 INFO:teuthology.orchestra.run.smithi137.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-18T10:33:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-18T10:33:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-18T10:33:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-18T10:33:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-18T10:33:58.794 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:58.794 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:33:58.794 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:33:58.794 INFO:teuthology.orchestra.run.smithi137.stdout:Install 32 Packages 2024-04-18T10:33:58.795 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:33:58.795 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 28 M 2024-04-18T10:33:58.795 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 91 M 2024-04-18T10:33:58.795 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:33:58.809 INFO:teuthology.orchestra.run.smithi040.stdout:(5/5): ceph-test-15.2.17-0.el8.x86_64.rpm 67 MB/s | 42 MB 00:00 2024-04-18T10:33:58.810 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:33:58.810 INFO:teuthology.orchestra.run.smithi040.stdout:Total 52 MB/s | 43 MB 00:00 2024-04-18T10:33:58.854 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:33:58.875 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:33:58.875 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:33:59.164 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:33:59.167 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:33:59.230 INFO:teuthology.orchestra.run.smithi137.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 102 kB/s | 6.3 kB 00:00 2024-04-18T10:33:59.305 INFO:teuthology.orchestra.run.smithi137.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-04-18T10:33:59.347 INFO:teuthology.orchestra.run.smithi137.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 11 MB/s | 2.0 MB 00:00 2024-04-18T10:33:59.381 INFO:teuthology.orchestra.run.smithi137.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 5.7 MB/s | 193 kB 00:00 2024-04-18T10:33:59.456 INFO:teuthology.orchestra.run.smithi137.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 19 MB/s | 4.3 MB 00:00 2024-04-18T10:33:59.473 INFO:teuthology.orchestra.run.smithi137.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2024-04-18T10:33:59.506 INFO:teuthology.orchestra.run.smithi137.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 3.0 MB/s | 103 kB 00:00 2024-04-18T10:33:59.524 INFO:teuthology.orchestra.run.smithi137.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 578 kB/s | 39 kB 00:00 2024-04-18T10:33:59.541 INFO:teuthology.orchestra.run.smithi137.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.7 MB/s | 57 kB 00:00 2024-04-18T10:33:59.590 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:33:59.608 INFO:teuthology.orchestra.run.smithi137.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 5.3 MB/s | 457 kB 00:00 2024-04-18T10:33:59.735 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /run 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2024-04-18T10:33:59.736 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:33:59.783 INFO:teuthology.orchestra.run.smithi137.stdout:(11/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 35 MB/s | 17 MB 00:00 2024-04-18T10:33:59.808 INFO:teuthology.orchestra.run.smithi137.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 931 kB/s | 249 kB 00:00 2024-04-18T10:33:59.824 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-18T10:33:59.942 INFO:teuthology.orchestra.run.smithi137.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 688 kB/s | 109 kB 00:00 2024-04-18T10:33:59.976 INFO:teuthology.orchestra.run.smithi137.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 1.7 MB/s | 641 kB 00:00 2024-04-18T10:34:00.023 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-18T10:34:00.135 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-18T10:34:00.184 INFO:teuthology.orchestra.run.smithi137.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 116 kB/s | 44 kB 00:00 2024-04-18T10:34:00.214 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-18T10:34:00.410 INFO:teuthology.orchestra.run.smithi137.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 396 kB/s | 185 kB 00:00 2024-04-18T10:34:00.435 INFO:teuthology.orchestra.run.smithi137.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 376 kB/s | 173 kB 00:00 2024-04-18T10:34:00.485 INFO:teuthology.orchestra.run.smithi137.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.2 MB/s | 384 kB 00:00 2024-04-18T10:34:00.510 INFO:teuthology.orchestra.run.smithi137.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 110 kB/s | 11 kB 00:00 2024-04-18T10:34:00.536 INFO:teuthology.orchestra.run.smithi137.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 175 kB/s | 18 kB 00:00 2024-04-18T10:34:00.578 INFO:teuthology.orchestra.run.smithi137.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 528 kB/s | 49 kB 00:00 2024-04-18T10:34:00.611 INFO:teuthology.orchestra.run.smithi137.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 584 kB/s | 59 kB 00:00 2024-04-18T10:34:00.695 INFO:teuthology.orchestra.run.smithi137.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2024-04-18T10:34:00.720 INFO:teuthology.orchestra.run.smithi137.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 172 kB/s | 19 kB 00:00 2024-04-18T10:34:00.754 INFO:teuthology.orchestra.run.smithi137.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2024-04-18T10:34:00.803 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-18T10:34:00.818 INFO:teuthology.orchestra.run.smithi137.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 195 kB/s | 24 kB 00:00 2024-04-18T10:34:00.846 INFO:teuthology.orchestra.run.smithi137.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 233 kB/s | 29 kB 00:00 2024-04-18T10:34:00.865 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-18T10:34:00.865 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-18T10:34:00.871 INFO:teuthology.orchestra.run.smithi137.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 235 kB/s | 27 kB 00:00 2024-04-18T10:34:00.938 INFO:teuthology.orchestra.run.smithi137.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.1 MB/s | 255 kB 00:00 2024-04-18T10:34:00.989 INFO:teuthology.orchestra.run.smithi137.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 730 kB/s | 85 kB 00:00 2024-04-18T10:34:01.022 INFO:teuthology.orchestra.run.smithi137.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.4 MB/s | 251 kB 00:00 2024-04-18T10:34:01.047 INFO:teuthology.orchestra.run.smithi137.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 211 kB/s | 23 kB 00:00 2024-04-18T10:34:01.051 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:01.051 INFO:teuthology.orchestra.run.smithi137.stdout:Total 13 MB/s | 28 MB 00:02 2024-04-18T10:34:01.134 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:34:01.172 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:34:01.173 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:34:01.202 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-18T10:34:01.202 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-18T10:34:01.477 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:34:01.480 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-04-18T10:34:01.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-04-18T10:34:01.915 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-04-18T10:34:01.916 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-04-18T10:34:01.916 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-04-18T10:34:02.542 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:34:02.738 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-18T10:34:02.914 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-04-18T10:34:02.914 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:02.914 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2024-04-18T10:34:02.914 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.914 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:34:02.914 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.914 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.914 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: fmt-6.2.1-1.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: leveldb-1.22-1.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.915 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.916 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-18T10:34:02.916 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.916 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.916 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:02.916 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:02.916 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:02.932 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-18T10:34:03.149 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-18T10:34:03.190 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-test 2024-04-18T10:34:03.432 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-18T10:34:03.637 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-18T10:34:03.800 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-18T10:34:03.953 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:40 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:03.986 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-18T10:34:04.130 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-18T10:34:04.264 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-18T10:34:04.345 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-18T10:34:04.501 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-18T10:34:04.566 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-18T10:34:04.795 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-18T10:34:04.812 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-18T10:34:04.812 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-04-18T10:34:04.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-18T10:34:04.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-18T10:34:04.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-18T10:34:05.018 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-18T10:34:05.274 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-18T10:34:05.274 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:05.274 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:34:05.274 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-18T10:34:05.274 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-18T10:34:05.274 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-18T10:34:05.274 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:05.275 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:05.383 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-18T10:34:05.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph 2024-04-18T10:34:05.644 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-18T10:34:05.695 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:05.696 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:05.696 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:05.696 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:05.696 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:34:05.696 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-04-18T10:34:05.696 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-18T10:34:05.696 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-18T10:34:05.696 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-18T10:34:05.696 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-18T10:34:05.697 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-18T10:34:05.697 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:05.697 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:34:05.697 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:05.697 INFO:teuthology.orchestra.run.smithi031.stdout:Install 5 Packages 2024-04-18T10:34:05.697 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:05.697 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 43 M 2024-04-18T10:34:05.698 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 155 M 2024-04-18T10:34:05.698 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:34:05.843 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-18T10:34:06.004 INFO:teuthology.orchestra.run.smithi031.stdout:(1/5): oniguruma-6.8.2-3.el8.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-18T10:34:06.030 INFO:teuthology.orchestra.run.smithi031.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 1.4 MB/s | 203 kB 00:00 2024-04-18T10:34:06.057 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-18T10:34:06.063 INFO:teuthology.orchestra.run.smithi031.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-04-18T10:34:06.088 INFO:teuthology.orchestra.run.smithi031.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-04-18T10:34:06.250 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-18T10:34:06.362 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:50 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:06.547 INFO:teuthology.orchestra.run.smithi031.stdout:(5/5): ceph-test-15.2.17-0.el8.x86_64.rpm 64 MB/s | 42 MB 00:00 2024-04-18T10:34:06.548 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:06.548 INFO:teuthology.orchestra.run.smithi031.stdout:Total 50 MB/s | 43 MB 00:00 2024-04-18T10:34:06.558 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-18T10:34:06.591 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:34:06.612 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:34:06.612 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:34:06.747 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-18T10:34:06.900 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:34:06.903 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:34:06.926 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-18T10:34:07.088 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-18T10:34:07.321 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-18T10:34:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:34:07.528 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-18T10:34:07.573 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-18T10:34:07.734 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-18T10:34:07.760 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-18T10:34:07.882 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-18T10:34:07.977 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-18T10:34:08.072 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-18T10:34:08.113 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-04-18T10:34:08.117 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-18T10:34:08.118 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-18T10:34:08.119 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-18T10:34:08.120 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:08.120 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:34:08.120 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:08.120 INFO:teuthology.orchestra.run.smithi040.stdout:Install 32 Packages 2024-04-18T10:34:08.120 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:08.120 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 28 M 2024-04-18T10:34:08.120 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 91 M 2024-04-18T10:34:08.121 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:34:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-18T10:34:08.484 INFO:teuthology.orchestra.run.smithi040.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 108 kB/s | 6.3 kB 00:00 2024-04-18T10:34:08.543 INFO:teuthology.orchestra.run.smithi040.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-04-18T10:34:08.585 INFO:teuthology.orchestra.run.smithi040.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2024-04-18T10:34:08.610 INFO:teuthology.orchestra.run.smithi040.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 7.6 MB/s | 193 kB 00:00 2024-04-18T10:34:08.694 INFO:teuthology.orchestra.run.smithi040.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 21 MB/s | 4.3 MB 00:00 2024-04-18T10:34:08.710 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-04-18T10:34:08.719 INFO:teuthology.orchestra.run.smithi040.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2024-04-18T10:34:08.744 INFO:teuthology.orchestra.run.smithi040.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.1 MB/s | 103 kB 00:00 2024-04-18T10:34:08.761 INFO:teuthology.orchestra.run.smithi040.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 578 kB/s | 39 kB 00:00 2024-04-18T10:34:08.779 INFO:teuthology.orchestra.run.smithi040.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.6 MB/s | 57 kB 00:00 2024-04-18T10:34:08.829 INFO:teuthology.orchestra.run.smithi040.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 6.6 MB/s | 457 kB 00:00 2024-04-18T10:34:08.865 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-18T10:34:09.052 INFO:teuthology.orchestra.run.smithi040.stdout:(11/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 33 MB/s | 17 MB 00:00 2024-04-18T10:34:09.138 INFO:teuthology.orchestra.run.smithi040.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 693 kB/s | 249 kB 00:00 2024-04-18T10:34:09.163 INFO:teuthology.orchestra.run.smithi040.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 1.9 MB/s | 641 kB 00:00 2024-04-18T10:34:09.214 INFO:teuthology.orchestra.run.smithi040.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 675 kB/s | 109 kB 00:00 2024-04-18T10:34:09.647 INFO:teuthology.orchestra.run.smithi040.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 86 kB/s | 44 kB 00:00 2024-04-18T10:34:09.822 INFO:teuthology.orchestra.run.smithi040.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 281 kB/s | 185 kB 00:00 2024-04-18T10:34:09.890 INFO:teuthology.orchestra.run.smithi040.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 255 kB/s | 173 kB 00:00 2024-04-18T10:34:09.923 INFO:teuthology.orchestra.run.smithi040.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-04-18T10:34:09.999 INFO:teuthology.orchestra.run.smithi040.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 162 kB/s | 18 kB 00:00 2024-04-18T10:34:10.024 INFO:teuthology.orchestra.run.smithi040.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 486 kB/s | 49 kB 00:00 2024-04-18T10:34:10.166 INFO:teuthology.orchestra.run.smithi040.stdout:(21/32): python3-cherrypy-18.4.0-1.el8.noarch.r 742 kB/s | 384 kB 00:00 2024-04-18T10:34:10.191 INFO:teuthology.orchestra.run.smithi040.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 305 kB/s | 59 kB 00:00 2024-04-18T10:34:10.227 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-18T10:34:10.283 INFO:teuthology.orchestra.run.smithi040.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2024-04-18T10:34:10.308 INFO:teuthology.orchestra.run.smithi040.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 160 kB/s | 19 kB 00:00 2024-04-18T10:34:10.384 INFO:teuthology.orchestra.run.smithi040.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 238 kB/s | 24 kB 00:00 2024-04-18T10:34:10.417 INFO:teuthology.orchestra.run.smithi040.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 269 kB/s | 29 kB 00:00 2024-04-18T10:34:10.441 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-18T10:34:10.470 INFO:teuthology.orchestra.run.smithi040.stdout:(27/32): python3-pecan-1.3.2-9.el8.noarch.rpm 638 kB/s | 283 kB 00:00 2024-04-18T10:34:10.493 INFO:teuthology.orchestra.run.smithi040.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 253 kB/s | 27 kB 00:00 2024-04-18T10:34:10.716 INFO:teuthology.orchestra.run.smithi040.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 383 kB/s | 85 kB 00:00 2024-04-18T10:34:10.768 INFO:teuthology.orchestra.run.smithi040.stdout:(30/32): python3-waitress-1.4.3-1.el8.noarch.rp 728 kB/s | 255 kB 00:00 2024-04-18T10:34:10.818 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-18T10:34:10.819 INFO:teuthology.orchestra.run.smithi040.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 716 kB/s | 251 kB 00:00 2024-04-18T10:34:10.844 INFO:teuthology.orchestra.run.smithi040.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 180 kB/s | 23 kB 00:00 2024-04-18T10:34:10.848 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:10.848 INFO:teuthology.orchestra.run.smithi040.stdout:Total 10 MB/s | 28 MB 00:02 2024-04-18T10:34:10.933 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:34:10.975 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:34:10.975 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:34:10.982 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-18T10:34:11.165 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-18T10:34:11.297 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:34:11.301 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:34:11.324 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-18T10:34:11.342 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-18T10:34:11.440 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-18T10:34:11.835 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-18T10:34:11.836 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-04-18T10:34:11.836 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-04-18T10:34:11.836 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-04-18T10:34:11.836 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-04-18T10:34:11.836 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-04-18T10:34:11.836 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-04-18T10:34:11.836 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-18T10:34:11.837 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-18T10:34:11.837 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-18T10:34:11.837 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-18T10:34:11.837 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-18T10:34:11.837 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-18T10:34:11.837 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-18T10:34:11.837 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-18T10:34:11.838 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-18T10:34:11.838 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-18T10:34:11.839 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-18T10:34:11.840 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-18T10:34:11.840 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-18T10:34:11.840 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-18T10:34:11.840 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-18T10:34:11.840 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-18T10:34:12.055 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-18T10:34:12.297 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-18T10:34:12.407 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:34:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-18T10:34:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-04-18T10:34:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-18T10:34:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-18T10:34:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-18T10:34:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-18T10:34:12.604 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-18T10:34:12.605 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-2.6-1.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-18T10:34:12.606 INFO:teuthology.orchestra.run.smithi137.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-18T10:34:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-18T10:34:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-18T10:34:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-18T10:34:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-18T10:34:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-18T10:34:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-18T10:34:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-18T10:34:12.607 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:12.607 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:12.609 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-18T10:34:12.809 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-18T10:34:12.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-base 2024-04-18T10:34:13.005 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-18T10:34:13.127 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-18T10:34:13.127 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:13.128 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:34:13.128 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-18T10:34:13.128 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-18T10:34:13.128 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-18T10:34:13.128 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:13.128 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:13.304 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-18T10:34:13.342 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph 2024-04-18T10:34:13.488 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-18T10:34:13.609 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:05 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-18T10:34:13.837 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-18T10:34:14.035 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-18T10:34:14.097 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:51 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:14.261 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-18T10:34:14.496 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-18T10:34:14.719 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-18T10:34:14.959 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-18T10:34:15.211 INFO:teuthology.orchestra.run.smithi137.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:15.259 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:15.260 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:34:15.260 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:15.334 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-18T10:34:15.377 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-immutable-object-cache 2024-04-18T10:34:15.605 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-18T10:34:15.845 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:15.848 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-18T10:34:15.849 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-18T10:34:15.850 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:34:15.851 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:15.852 INFO:teuthology.orchestra.run.smithi031.stdout:Install 32 Packages 2024-04-18T10:34:15.852 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:15.852 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 28 M 2024-04-18T10:34:15.852 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 91 M 2024-04-18T10:34:15.852 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:34:15.857 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-18T10:34:16.105 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-18T10:34:16.115 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:08 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:16.310 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-18T10:34:16.314 INFO:teuthology.orchestra.run.smithi031.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 158 kB/s | 6.3 kB 00:00 2024-04-18T10:34:16.365 INFO:teuthology.orchestra.run.smithi031.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-04-18T10:34:16.406 INFO:teuthology.orchestra.run.smithi031.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 15 MB/s | 2.0 MB 00:00 2024-04-18T10:34:16.431 INFO:teuthology.orchestra.run.smithi031.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 7.6 MB/s | 193 kB 00:00 2024-04-18T10:34:16.507 INFO:teuthology.orchestra.run.smithi031.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 23 MB/s | 4.3 MB 00:00 2024-04-18T10:34:16.532 INFO:teuthology.orchestra.run.smithi031.stdout:(6/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2024-04-18T10:34:16.590 INFO:teuthology.orchestra.run.smithi031.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.7 MB/s | 103 kB 00:00 2024-04-18T10:34:16.615 INFO:teuthology.orchestra.run.smithi031.stdout:(8/32): python3-markupsafe-0.23-19.el8.x86_64.r 357 kB/s | 39 kB 00:00 2024-04-18T10:34:16.641 INFO:teuthology.orchestra.run.smithi031.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2024-04-18T10:34:16.649 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-18T10:34:16.700 INFO:teuthology.orchestra.run.smithi031.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 5.3 MB/s | 457 kB 00:00 2024-04-18T10:34:16.833 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-18T10:34:16.892 INFO:teuthology.orchestra.run.smithi031.stdout:(11/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 32 MB/s | 17 MB 00:00 2024-04-18T10:34:16.917 INFO:teuthology.orchestra.run.smithi031.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 903 kB/s | 249 kB 00:00 2024-04-18T10:34:16.996 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-18T10:34:17.026 INFO:teuthology.orchestra.run.smithi031.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 401 kB/s | 44 kB 00:00 2024-04-18T10:34:17.051 INFO:teuthology.orchestra.run.smithi031.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 686 kB/s | 109 kB 00:00 2024-04-18T10:34:17.101 INFO:teuthology.orchestra.run.smithi031.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.4 MB/s | 185 kB 00:00 2024-04-18T10:34:17.156 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-18T10:34:17.160 INFO:teuthology.orchestra.run.smithi031.stdout:(16/32): python3-cryptography-3.2.1-7.el8.x86_6 1.4 MB/s | 641 kB 00:00 2024-04-18T10:34:17.185 INFO:teuthology.orchestra.run.smithi031.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.3 MB/s | 173 kB 00:00 2024-04-18T10:34:17.211 INFO:teuthology.orchestra.run.smithi031.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 3.4 MB/s | 384 kB 00:00 2024-04-18T10:34:17.239 INFO:teuthology.orchestra.run.smithi031.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2024-04-18T10:34:17.261 INFO:teuthology.orchestra.run.smithi031.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 233 kB/s | 18 kB 00:00 2024-04-18T10:34:17.286 INFO:teuthology.orchestra.run.smithi031.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 647 kB/s | 49 kB 00:00 2024-04-18T10:34:17.312 INFO:teuthology.orchestra.run.smithi031.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 779 kB/s | 59 kB 00:00 2024-04-18T10:34:17.337 INFO:teuthology.orchestra.run.smithi031.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2024-04-18T10:34:17.362 INFO:teuthology.orchestra.run.smithi031.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 372 kB/s | 19 kB 00:00 2024-04-18T10:34:17.387 INFO:teuthology.orchestra.run.smithi031.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 479 kB/s | 24 kB 00:00 2024-04-18T10:34:17.409 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-18T10:34:17.413 INFO:teuthology.orchestra.run.smithi031.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 583 kB/s | 29 kB 00:00 2024-04-18T10:34:17.438 INFO:teuthology.orchestra.run.smithi031.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 547 kB/s | 27 kB 00:00 2024-04-18T10:34:17.464 INFO:teuthology.orchestra.run.smithi031.stdout:(28/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2024-04-18T10:34:17.489 INFO:teuthology.orchestra.run.smithi031.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2024-04-18T10:34:17.514 INFO:teuthology.orchestra.run.smithi031.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2024-04-18T10:34:17.539 INFO:teuthology.orchestra.run.smithi031.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.4 MB/s | 251 kB 00:00 2024-04-18T10:34:17.564 INFO:teuthology.orchestra.run.smithi031.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 304 kB/s | 23 kB 00:00 2024-04-18T10:34:17.566 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:17.566 INFO:teuthology.orchestra.run.smithi031.stdout:Total 17 MB/s | 28 MB 00:01 2024-04-18T10:34:17.652 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:34:17.657 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-18T10:34:17.694 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:34:17.694 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:34:17.758 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:17.759 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:17.759 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repo Size 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 203 k 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 599 k 2024-04-18T10:34:17.760 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:34:17.805 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 4.5 MB/s | 203 kB 00:00 2024-04-18T10:34:17.806 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:17.806 INFO:teuthology.orchestra.run.smithi137.stdout:Total 4.4 MB/s | 203 kB 00:00 2024-04-18T10:34:17.806 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:34:17.816 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:34:17.816 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:34:17.865 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:34:17.868 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:34:17.880 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-18T10:34:17.978 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:34:18.029 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:34:18.032 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:34:18.224 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-18T10:34:18.490 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:18.524 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-18T10:34:18.876 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-04-18T10:34:18.909 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:19.048 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-18T10:34:19.184 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:34:19.286 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:19.286 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:19.286 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:34:19.286 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:19.286 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:19.286 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:19.398 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-18T10:34:19.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-mgr 2024-04-18T10:34:19.613 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-18T10:34:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-18T10:34:20.075 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-18T10:34:20.242 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-18T10:34:20.245 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:12 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:20.391 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-18T10:34:20.499 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-18T10:34:20.550 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-18T10:34:20.718 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-18T10:34:20.727 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-18T10:34:20.931 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-18T10:34:21.128 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-18T10:34:21.226 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-18T10:34:21.308 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-18T10:34:21.448 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-18T10:34:21.501 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-18T10:34:21.681 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-18T10:34:21.683 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-18T10:34:21.702 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-18T10:34:21.825 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-18T10:34:21.839 INFO:teuthology.orchestra.run.smithi137.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:21.886 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:21.887 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:34:21.887 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:21.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-fuse 2024-04-18T10:34:22.082 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-18T10:34:22.250 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-18T10:34:22.250 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-04-18T10:34:22.250 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-04-18T10:34:22.250 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-04-18T10:34:22.251 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-04-18T10:34:22.251 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-04-18T10:34:22.251 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-04-18T10:34:22.251 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-18T10:34:22.251 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-18T10:34:22.251 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-18T10:34:22.251 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-18T10:34:22.252 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-18T10:34:22.252 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-18T10:34:22.252 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-18T10:34:22.252 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-18T10:34:22.252 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-18T10:34:22.252 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-18T10:34:22.253 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-18T10:34:22.253 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-18T10:34:22.253 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-18T10:34:22.253 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-18T10:34:22.253 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-18T10:34:22.253 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-18T10:34:22.253 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-18T10:34:22.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-18T10:34:22.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-18T10:34:22.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-18T10:34:22.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-18T10:34:22.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-18T10:34:22.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-18T10:34:22.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-18T10:34:22.254 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-18T10:34:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-18T10:34:22.511 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-18T10:34:22.724 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:14 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:22.733 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-18T10:34:22.931 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-18T10:34:23.149 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-18T10:34:23.149 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:23.149 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:34:23.149 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-18T10:34:23.150 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-2.6-1.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-18T10:34:23.151 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-18T10:34:23.152 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-18T10:34:23.152 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-18T10:34:23.152 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-18T10:34:23.152 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-18T10:34:23.152 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:23.152 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:23.245 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-18T10:34:23.436 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-18T10:34:23.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-base 2024-04-18T10:34:23.632 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-18T10:34:23.785 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-18T10:34:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-18T10:34:24.204 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:08 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:24.234 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-18T10:34:24.313 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:24.313 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout:Install 2 Packages 2024-04-18T10:34:24.314 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:24.315 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 656 k 2024-04-18T10:34:24.315 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 1.8 M 2024-04-18T10:34:24.315 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:34:24.439 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-18T10:34:24.798 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-18T10:34:24.840 INFO:teuthology.orchestra.run.smithi137.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 1.7 MB/s | 572 kB 00:00 2024-04-18T10:34:24.866 INFO:teuthology.orchestra.run.smithi137.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 233 kB/s | 83 kB 00:00 2024-04-18T10:34:24.866 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:24.866 INFO:teuthology.orchestra.run.smithi137.stdout:Total 1.2 MB/s | 656 kB 00:00 2024-04-18T10:34:24.876 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:34:24.897 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:34:24.897 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:34:24.979 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:34:24.982 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:34:25.055 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-18T10:34:25.149 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:34:25.351 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-18T10:34:25.426 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-04-18T10:34:25.521 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-18T10:34:25.573 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-18T10:34:25.896 INFO:teuthology.orchestra.run.smithi040.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:25.919 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-18T10:34:25.920 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-04-18T10:34:25.947 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:25.948 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:34:25.949 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:26.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-immutable-object-cache 2024-04-18T10:34:26.297 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-18T10:34:26.297 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:26.297 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:34:26.297 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-18T10:34:26.297 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:26.297 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:26.548 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librados-devel 2024-04-18T10:34:26.807 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:10 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:27.019 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-18T10:34:27.187 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-18T10:34:27.281 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:19 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:27.593 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-18T10:34:27.754 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-18T10:34:27.946 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-18T10:34:28.145 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-18T10:34:28.163 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-18T10:34:28.270 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-18T10:34:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:28.556 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repo Size 2024-04-18T10:34:28.556 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:34:28.557 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-04-18T10:34:28.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:34:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-04-18T10:34:28.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 203 k 2024-04-18T10:34:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 599 k 2024-04-18T10:34:28.558 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:34:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 5.7 MB/s | 203 kB 00:00 2024-04-18T10:34:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:Total 5.5 MB/s | 203 kB 00:00 2024-04-18T10:34:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:34:28.605 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:34:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:34:28.659 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:34:28.662 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:34:28.706 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-18T10:34:28.706 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-04-18T10:34:28.706 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-04-18T10:34:28.706 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-04-18T10:34:28.706 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-04-18T10:34:28.706 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-04-18T10:34:28.706 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-04-18T10:34:28.706 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-18T10:34:28.707 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-18T10:34:28.708 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-18T10:34:28.780 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:34:28.906 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 140 k 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 478 k 2024-04-18T10:34:28.907 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:34:28.923 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:28.952 INFO:teuthology.orchestra.run.smithi137.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 3.1 MB/s | 140 kB 00:00 2024-04-18T10:34:28.952 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:28.953 INFO:teuthology.orchestra.run.smithi137.stdout:Total 3.0 MB/s | 140 kB 00:00 2024-04-18T10:34:28.953 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:34:28.958 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:34:28.958 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:34:29.006 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:34:29.009 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:34:29.121 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:34:29.286 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:29.375 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:29.570 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-18T10:34:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:29.587 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:34:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-18T10:34:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-2.6-1.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-18T10:34:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:29.590 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:29.793 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:29.793 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:34:29.793 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:29.793 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:29.858 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-base 2024-04-18T10:34:30.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-mgr 2024-04-18T10:34:30.157 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:30.157 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:30.157 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:34:30.157 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:30.157 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:30.158 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:30.387 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install libcephfs2 2024-04-18T10:34:30.616 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:07 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:30.817 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:14 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:31.121 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:23 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:32.313 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:32.367 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:34:32.368 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:32.468 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-immutable-object-cache 2024-04-18T10:34:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:32.564 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:34:32.566 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:32.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-fuse 2024-04-18T10:34:32.717 INFO:teuthology.orchestra.run.smithi137.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:32.765 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:32.766 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:34:32.766 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:32.882 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install libcephfs-devel 2024-04-18T10:34:33.224 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:10 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:33.431 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:17 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:33.612 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:25 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:34.970 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repo Size 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:34.972 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 203 k 2024-04-18T10:34:34.973 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 599 k 2024-04-18T10:34:34.973 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:34:35.019 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 4.2 MB/s | 203 kB 00:00 2024-04-18T10:34:35.020 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:35.020 INFO:teuthology.orchestra.run.smithi031.stdout:Total 4.1 MB/s | 203 kB 00:00 2024-04-18T10:34:35.021 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:34:35.032 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:34:35.032 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:34:35.084 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:34:35.087 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:34:35.180 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:35.182 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:35.182 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:35.182 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:35.182 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:34:35.182 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-04-18T10:34:35.182 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-04-18T10:34:35.182 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-18T10:34:35.182 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:34:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:Install 2 Packages 2024-04-18T10:34:35.183 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 656 k 2024-04-18T10:34:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 1.8 M 2024-04-18T10:34:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:34:35.206 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:34:35.263 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:35.263 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 22 k 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 78 k 2024-04-18T10:34:35.264 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:34:35.297 INFO:teuthology.orchestra.run.smithi040.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 10 MB/s | 572 kB 00:00 2024-04-18T10:34:35.322 INFO:teuthology.orchestra.run.smithi137.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 378 kB/s | 22 kB 00:00 2024-04-18T10:34:35.322 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:35.322 INFO:teuthology.orchestra.run.smithi137.stdout:Total 370 kB/s | 22 kB 00:00 2024-04-18T10:34:35.323 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:34:35.327 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:34:35.327 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:34:35.328 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:34:35.331 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:34:35.344 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:35.380 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:34:35.405 INFO:teuthology.orchestra.run.smithi040.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 511 kB/s | 83 kB 00:00 2024-04-18T10:34:35.406 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:35.406 INFO:teuthology.orchestra.run.smithi040.stdout:Total 2.9 MB/s | 656 kB 00:00 2024-04-18T10:34:35.416 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:34:35.438 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:34:35.438 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:34:35.510 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:35.528 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:34:35.531 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:34:35.707 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:34:35.773 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:35.914 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-18T10:34:36.047 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-18T10:34:36.111 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:36.111 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:36.111 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:34:36.111 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:36.111 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:36.112 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:36.176 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:36.176 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:34:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:36.177 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:36.177 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:36.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librados2 2024-04-18T10:34:36.403 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-mgr 2024-04-18T10:34:36.462 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-18T10:34:36.462 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-04-18T10:34:36.912 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-18T10:34:36.912 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:36.912 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:34:36.912 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-18T10:34:36.912 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:36.913 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:36.999 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:28 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:37.132 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install librados-devel 2024-04-18T10:34:37.162 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:14 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:37.898 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:21 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:38.586 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:38.634 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:38.635 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:34:38.635 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:38.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librbd1 2024-04-18T10:34:38.872 INFO:teuthology.orchestra.run.smithi031.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:38.926 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:38.927 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:34:38.927 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:39.021 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-fuse 2024-04-18T10:34:39.482 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:31 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:39.687 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:39.687 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:39.688 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:39.688 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:34:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-18T10:34:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:39.688 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:34:39.688 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:39.688 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-04-18T10:34:39.688 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:39.689 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 140 k 2024-04-18T10:34:39.689 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 478 k 2024-04-18T10:34:39.689 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:34:39.725 INFO:teuthology.orchestra.run.smithi040.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 3.8 MB/s | 140 kB 00:00 2024-04-18T10:34:39.726 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:39.726 INFO:teuthology.orchestra.run.smithi040.stdout:Total 3.7 MB/s | 140 kB 00:00 2024-04-18T10:34:39.726 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:34:39.731 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:34:39.732 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:34:39.779 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:16 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:39.782 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:34:39.785 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:34:39.922 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:34:40.079 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:40.374 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:40.781 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:40.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:40.781 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:34:40.782 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:40.782 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:40.782 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:40.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install libcephfs2 2024-04-18T10:34:41.067 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:41.114 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:41.115 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:34:41.115 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:41.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rados 2024-04-18T10:34:41.526 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:41.527 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:41.527 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:41.527 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:34:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-04-18T10:34:41.527 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-18T10:34:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-18T10:34:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:41.528 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:34:41.528 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:41.528 INFO:teuthology.orchestra.run.smithi031.stdout:Install 2 Packages 2024-04-18T10:34:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:41.528 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 656 k 2024-04-18T10:34:41.528 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 1.8 M 2024-04-18T10:34:41.528 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:34:41.638 INFO:teuthology.orchestra.run.smithi031.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 11 MB/s | 572 kB 00:00 2024-04-18T10:34:41.746 INFO:teuthology.orchestra.run.smithi031.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 524 kB/s | 83 kB 00:00 2024-04-18T10:34:41.747 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:25 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:41.747 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:41.747 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.9 MB/s | 656 kB 00:00 2024-04-18T10:34:41.757 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:34:41.779 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:34:41.779 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:34:41.866 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:34:41.869 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:34:41.951 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:33 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:34:42.276 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-18T10:34:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-18T10:34:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-18T10:34:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-04-18T10:34:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-18T10:34:43.256 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:43.256 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:34:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-18T10:34:43.257 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:43.257 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:43.448 INFO:teuthology.orchestra.run.smithi040.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:43.462 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados-devel 2024-04-18T10:34:43.502 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:43.503 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:34:43.503 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:43.534 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:43.582 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:43.583 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:34:43.583 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:43.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install libcephfs-devel 2024-04-18T10:34:43.702 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rgw 2024-04-18T10:34:44.236 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:21 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:44.365 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:28 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:44.424 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:36 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:45.980 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:45.981 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:45.981 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 140 k 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 478 k 2024-04-18T10:34:45.982 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:34:46.008 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:46.050 INFO:teuthology.orchestra.run.smithi031.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 2.0 MB/s | 140 kB 00:00 2024-04-18T10:34:46.051 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:46.051 INFO:teuthology.orchestra.run.smithi031.stdout:Total 2.0 MB/s | 140 kB 00:00 2024-04-18T10:34:46.051 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:34:46.056 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:46.057 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:34:46.057 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:34:46.057 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:34:46.058 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:46.108 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:34:46.112 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:34:46.113 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-04-18T10:34:46.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:46.115 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 22 k 2024-04-18T10:34:46.115 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 78 k 2024-04-18T10:34:46.115 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:34:46.162 INFO:teuthology.orchestra.run.smithi040.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 466 kB/s | 22 kB 00:00 2024-04-18T10:34:46.162 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:46.162 INFO:teuthology.orchestra.run.smithi040.stdout:Total 454 kB/s | 22 kB 00:00 2024-04-18T10:34:46.163 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:34:46.166 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:34:46.166 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:34:46.168 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:34:46.171 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:34:46.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-cephfs 2024-04-18T10:34:46.219 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:34:46.224 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:34:46.378 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:46.383 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:46.650 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:46.894 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:38 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:47.010 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:47.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:47.011 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:34:47.011 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:47.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:34:47.011 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:47.045 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:47.045 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:47.046 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:34:47.046 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:47.046 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:47.046 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:47.146 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install librados2 2024-04-18T10:34:47.289 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs2 2024-04-18T10:34:47.901 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:31 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:48.045 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:25 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:48.480 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:48.528 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:48.529 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:34:48.530 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:48.640 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install python3-rbd 2024-04-18T10:34:49.364 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:41 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:49.593 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:49.648 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:34:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:49.733 INFO:teuthology.orchestra.run.smithi031.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:49.786 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:49.788 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:34:49.788 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:49.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install librbd1 2024-04-18T10:34:49.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install libcephfs-devel 2024-04-18T10:34:50.618 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:34 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:50.633 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:27 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:50.955 INFO:teuthology.orchestra.run.smithi137.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:51.003 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:51.004 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:34:51.005 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:51.120 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-fuse 2024-04-18T10:34:51.846 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:43 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:52.336 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:52.381 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:52.381 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:52.381 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:52.381 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:52.381 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:34:52.381 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-04-18T10:34:52.381 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:52.382 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:34:52.382 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:34:52.382 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-18T10:34:52.382 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:52.382 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 22 k 2024-04-18T10:34:52.383 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 78 k 2024-04-18T10:34:52.383 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:34:52.388 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:52.389 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:34:52.389 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:52.428 INFO:teuthology.orchestra.run.smithi031.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 477 kB/s | 22 kB 00:00 2024-04-18T10:34:52.429 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:52.429 INFO:teuthology.orchestra.run.smithi031.stdout:Total 464 kB/s | 22 kB 00:00 2024-04-18T10:34:52.429 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:34:52.433 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:34:52.433 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:34:52.434 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:34:52.438 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:34:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:34:52.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install python3-rados 2024-04-18T10:34:52.623 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:52.892 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:53.244 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:53.244 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:53.245 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:34:53.245 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:53.245 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:34:53.245 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:53.250 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:37 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:53.361 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados2 2024-04-18T10:34:53.482 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-04-18T10:34:53.483 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:53.484 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 73 k 2024-04-18T10:34:53.484 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 188 k 2024-04-18T10:34:53.484 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:34:53.525 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.7 MB/s | 73 kB 00:00 2024-04-18T10:34:53.526 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:53.526 INFO:teuthology.orchestra.run.smithi137.stdout:Total 1.7 MB/s | 73 kB 00:00 2024-04-18T10:34:53.526 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:34:53.536 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:34:53.536 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:34:53.581 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:34:53.584 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:34:53.684 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:34:53.856 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:54.121 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:31 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:54.144 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:54.508 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:54.508 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:54.508 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:34:54.508 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:54.508 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:54.509 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:54.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-mirror 2024-04-18T10:34:54.945 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:54.996 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:54.997 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:34:54.997 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:55.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install python3-rgw 2024-04-18T10:34:55.507 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:47 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:34:55.842 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:55.894 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:55.895 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:34:55.895 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:56.006 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librbd1 2024-04-18T10:34:56.053 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:40 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:56.763 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:33 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:57.140 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:34:57.140 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:57.140 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-18T10:34:57.140 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:57.141 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:34:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-04-18T10:34:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:57.141 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:34:57.141 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:34:57.141 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-04-18T10:34:57.141 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:57.142 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 2.7 M 2024-04-18T10:34:57.142 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 9.8 M 2024-04-18T10:34:57.142 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:34:57.304 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 17 MB/s | 2.7 MB 00:00 2024-04-18T10:34:57.304 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:34:57.304 INFO:teuthology.orchestra.run.smithi137.stdout:Total 17 MB/s | 2.7 MB 00:00 2024-04-18T10:34:57.304 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:34:57.314 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:34:57.315 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:34:57.372 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:34:57.375 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:34:57.713 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:34:57.744 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:57.796 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:34:57.797 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:34:57.797 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:34:57.858 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:57.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install python3-cephfs 2024-04-18T10:34:58.265 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:58.497 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:34:58.549 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:34:58.551 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:34:58.551 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:34:58.653 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rados 2024-04-18T10:34:58.667 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:42 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:34:58.676 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:34:58.676 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:58.677 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:34:58.677 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-04-18T10:34:58.677 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:34:58.677 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:34:58.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install rbd-nbd 2024-04-18T10:34:59.409 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:36 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:34:59.596 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:51 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:35:00.360 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:35:00.411 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:35:00.413 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:35:00.413 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:35:00.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install python3-rbd 2024-04-18T10:35:01.107 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:35:01.158 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:35:01.160 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:35:01.160 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:35:01.221 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout:Install 1 Package 2024-04-18T10:35:01.222 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:01.223 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 140 k 2024-04-18T10:35:01.223 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 418 k 2024-04-18T10:35:01.223 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-18T10:35:01.257 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rgw 2024-04-18T10:35:01.272 INFO:teuthology.orchestra.run.smithi137.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 2.8 MB/s | 140 kB 00:00 2024-04-18T10:35:01.272 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:35:01.272 INFO:teuthology.orchestra.run.smithi137.stdout:Total 2.7 MB/s | 140 kB 00:00 2024-04-18T10:35:01.273 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-18T10:35:01.280 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:45 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:35:01.282 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-18T10:35:01.282 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-18T10:35:01.329 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-18T10:35:01.332 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-18T10:35:01.441 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-18T10:35:01.639 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:01.933 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:02.011 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:39 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:35:02.306 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:02.306 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:02.306 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-18T10:35:02.306 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-04-18T10:35:02.306 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:02.307 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:35:02.537 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install librados2 2024-04-18T10:35:02.977 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:35:03.028 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:35:03.029 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:35:03.029 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:35:03.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install rbd-fuse 2024-04-18T10:35:03.276 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:01:55 ago on Thu 18 Apr 2024 10:33:08 AM UTC. 2024-04-18T10:35:03.712 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:35:03.765 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:35:03.766 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:35:03.766 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:35:03.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-cephfs 2024-04-18T10:35:03.896 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:47 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:35:04.647 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:41 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:35:04.873 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:35:04.920 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-18T10:35:04.922 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-18T10:35:04.922 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-18T10:35:05.039 DEBUG:teuthology.parallel:result is None 2024-04-18T10:35:05.644 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:35:05.644 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:35:05.644 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-18T10:35:05.644 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:35:05.645 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:35:05.645 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-04-18T10:35:05.645 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:05.645 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:35:05.645 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:35:05.645 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-04-18T10:35:05.645 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:05.646 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 73 k 2024-04-18T10:35:05.646 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 188 k 2024-04-18T10:35:05.646 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:35:05.691 INFO:teuthology.orchestra.run.smithi040.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.6 MB/s | 73 kB 00:00 2024-04-18T10:35:05.692 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:35:05.692 INFO:teuthology.orchestra.run.smithi040.stdout:Total 1.5 MB/s | 73 kB 00:00 2024-04-18T10:35:05.692 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:35:05.702 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:35:05.702 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:35:05.751 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:35:05.755 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:35:05.860 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:35:06.034 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:06.323 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:06.343 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:35:06.397 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:35:06.398 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:35:06.399 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:35:06.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install python3-rbd 2024-04-18T10:35:06.700 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:06.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:06.700 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:35:06.700 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-04-18T10:35:06.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:06.700 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:35:06.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install rbd-mirror 2024-04-18T10:35:07.256 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:44 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:35:07.656 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:51 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:35:08.956 INFO:teuthology.orchestra.run.smithi031.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:35:09.008 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:35:09.010 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:35:09.010 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:35:09.109 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-fuse 2024-04-18T10:35:09.417 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:35:09.418 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:35:09.418 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-18T10:35:09.418 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:35:09.418 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:35:09.418 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-04-18T10:35:09.418 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:09.418 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:35:09.419 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:35:09.419 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-04-18T10:35:09.419 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:09.419 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 2.7 M 2024-04-18T10:35:09.419 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 9.8 M 2024-04-18T10:35:09.419 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:35:09.493 INFO:teuthology.orchestra.run.smithi040.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 37 MB/s | 2.7 MB 00:00 2024-04-18T10:35:09.494 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:35:09.494 INFO:teuthology.orchestra.run.smithi040.stdout:Total 36 MB/s | 2.7 MB 00:00 2024-04-18T10:35:09.494 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:35:09.507 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:35:09.507 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:35:09.566 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:35:09.569 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:35:09.866 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:46 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:35:09.938 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:35:10.076 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:10.517 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:10.940 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:10.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:10.940 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:35:10.940 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-04-18T10:35:10.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:10.940 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:35:11.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install rbd-nbd 2024-04-18T10:35:11.622 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:35:11.623 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:35:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-18T10:35:11.623 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:35:11.623 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:35:11.623 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-04-18T10:35:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:11.624 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:35:11.624 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:35:11.624 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-18T10:35:11.624 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:11.624 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 73 k 2024-04-18T10:35:11.624 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 188 k 2024-04-18T10:35:11.624 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:35:11.692 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.1 MB/s | 73 kB 00:00 2024-04-18T10:35:11.692 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:35:11.692 INFO:teuthology.orchestra.run.smithi031.stdout:Total 1.0 MB/s | 73 kB 00:00 2024-04-18T10:35:11.693 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:35:11.703 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:35:11.703 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:35:11.753 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:35:11.757 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:35:11.909 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:55 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:35:12.003 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:35:12.170 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:12.464 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:12.848 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:12.849 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:12.849 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:35:12.849 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-04-18T10:35:12.849 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:12.849 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:35:13.051 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-mirror 2024-04-18T10:35:13.660 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:35:13.661 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:35:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-18T10:35:13.661 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:35:13.661 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-18T10:35:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-18T10:35:13.661 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:13.661 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:35:13.662 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:35:13.662 INFO:teuthology.orchestra.run.smithi040.stdout:Install 1 Package 2024-04-18T10:35:13.662 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:13.662 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 140 k 2024-04-18T10:35:13.662 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 418 k 2024-04-18T10:35:13.662 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:35:13.713 INFO:teuthology.orchestra.run.smithi040.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 2.7 MB/s | 140 kB 00:00 2024-04-18T10:35:13.714 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:35:13.714 INFO:teuthology.orchestra.run.smithi040.stdout:Total 2.6 MB/s | 140 kB 00:00 2024-04-18T10:35:13.714 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:35:13.725 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:35:13.725 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:35:13.775 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:35:13.779 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:35:13.808 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:50 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:35:13.893 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:35:14.091 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:14.391 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:14.790 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:14.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:14.791 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:35:14.791 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-04-18T10:35:14.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:14.791 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:35:15.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install librados2 2024-04-18T10:35:15.553 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:35:15.554 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:35:15.554 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-18T10:35:15.554 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:35:15.554 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:35:15.554 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-04-18T10:35:15.554 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:15.554 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:35:15.554 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:35:15.555 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-18T10:35:15.555 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:15.555 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 2.7 M 2024-04-18T10:35:15.555 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 9.8 M 2024-04-18T10:35:15.555 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:35:15.627 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 38 MB/s | 2.7 MB 00:00 2024-04-18T10:35:15.628 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:35:15.628 INFO:teuthology.orchestra.run.smithi031.stdout:Total 37 MB/s | 2.7 MB 00:00 2024-04-18T10:35:15.628 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:35:15.640 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:35:15.640 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:35:15.700 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:35:15.703 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:35:15.771 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:59 ago on Thu 18 Apr 2024 10:33:16 AM UTC. 2024-04-18T10:35:16.055 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:35:16.179 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:16.616 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:16.999 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:16.999 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:16.999 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:35:16.999 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-04-18T10:35:16.999 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:16.999 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:35:17.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install rbd-nbd 2024-04-18T10:35:17.498 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:35:17.549 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:35:17.551 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2024-04-18T10:35:17.551 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:35:17.652 DEBUG:teuthology.parallel:result is None 2024-04-18T10:35:17.984 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:54 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:35:19.752 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:35:19.753 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:35:19.753 INFO:teuthology.orchestra.run.smithi031.stdout: Package Architecture Version Repository Size 2024-04-18T10:35:19.753 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout:Install 1 Package 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 140 k 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout:Installed size: 418 k 2024-04-18T10:35:19.754 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:35:19.797 INFO:teuthology.orchestra.run.smithi031.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 3.2 MB/s | 140 kB 00:00 2024-04-18T10:35:19.797 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:35:19.797 INFO:teuthology.orchestra.run.smithi031.stdout:Total 3.1 MB/s | 140 kB 00:00 2024-04-18T10:35:19.798 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:35:19.808 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:35:19.808 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:35:19.859 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:35:19.863 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:35:19.977 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:35:20.144 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:20.430 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:20.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-18T10:35:20.808 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:20.808 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:35:20.808 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-04-18T10:35:20.808 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:20.808 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:35:21.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install librados2 2024-04-18T10:35:21.767 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:58 ago on Thu 18 Apr 2024 10:33:23 AM UTC. 2024-04-18T10:35:23.493 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-18T10:35:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:35:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2024-04-18T10:35:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:35:23.652 DEBUG:teuthology.parallel:result is None 2024-04-18T10:35:23.652 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:35:23.653 INFO:teuthology.packaging:ref: None 2024-04-18T10:35:23.653 INFO:teuthology.packaging:tag: None 2024-04-18T10:35:23.653 INFO:teuthology.packaging:branch: octopus 2024-04-18T10:35:23.653 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:35:23.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-18T10:35:23.948 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-18T10:35:23.972 INFO:teuthology.orchestra.run.smithi031.stdout:15.2.17-0.el8 2024-04-18T10:35:23.973 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-18T10:35:23.973 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-04-18T10:35:23.975 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:35:23.975 INFO:teuthology.packaging:ref: None 2024-04-18T10:35:23.976 INFO:teuthology.packaging:tag: None 2024-04-18T10:35:23.976 INFO:teuthology.packaging:branch: octopus 2024-04-18T10:35:23.976 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:35:23.976 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-18T10:35:24.179 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-18T10:35:24.207 INFO:teuthology.orchestra.run.smithi040.stdout:15.2.17-0.el8 2024-04-18T10:35:24.207 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-18T10:35:24.207 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-04-18T10:35:24.209 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-18T10:35:24.209 INFO:teuthology.packaging:ref: None 2024-04-18T10:35:24.209 INFO:teuthology.packaging:tag: None 2024-04-18T10:35:24.209 INFO:teuthology.packaging:branch: octopus 2024-04-18T10:35:24.209 INFO:teuthology.packaging:sha1: a6549451253d26216d353246c0fe6f6d80f3b9cf 2024-04-18T10:35:24.209 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-18T10:35:24.411 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-18T10:35:24.438 INFO:teuthology.orchestra.run.smithi137.stdout:15.2.17-0.el8 2024-04-18T10:35:24.438 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-18T10:35:24.438 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-04-18T10:35:24.440 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-18T10:35:24.440 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:24.440 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T10:35:24.472 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:35:24.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T10:35:24.505 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:35:24.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-18T10:35:24.538 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-18T10:35:24.538 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:24.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T10:35:24.569 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T10:35:24.640 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:35:24.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T10:35:24.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T10:35:24.745 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:35:24.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-04-18T10:35:24.776 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-18T10:35:24.846 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-18T10:35:24.847 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:24.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T10:35:24.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T10:35:24.948 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:35:24.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T10:35:24.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T10:35:25.053 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:35:25.053 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-18T10:35:25.085 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-18T10:35:25.157 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-18T10:35:25.157 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:25.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T10:35:25.191 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T10:35:25.263 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:35:25.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T10:35:25.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T10:35:25.367 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:35:25.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-04-18T10:35:25.399 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-18T10:35:25.469 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:35:25.482 INFO:teuthology.task.print:**** done installing octopus 2024-04-18T10:35:25.482 INFO:teuthology.run_tasks:Running task ceph... 2024-04-18T10:35:25.581 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-18T10:35:25.582 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2024-04-18T10:35:25.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2024-04-18T10:35:25.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-04-18T10:35:25.618 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-18T10:35:25.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T10:35:25.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T10:35:25.661 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-18T10:35:25.691 INFO:tasks.ceph:Creating extra log directories... 2024-04-18T10:35:25.691 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T10:35:25.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T10:35:25.735 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-18T10:35:25.776 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-18T10:35:25.776 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-18T10:35:25.776 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976', 'branch': 'main', 'description': 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7660976', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/octopus latest\n'}], 'name': 'teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'max_mds': 2}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf'}}, 'nuke-on-error': False, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '08d35a8d8529783882dd092c73c0b27be41c4d86'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'seed': 7975, 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf', 'sleep_before_teardown': 0, 'subset': '475/512', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_08d35a8d8529783882dd092c73c0b27be41c4d86/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '08d35a8d8529783882dd092c73c0b27be41c4d86', 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDGKbvab7ZottKj9UbKPO0dvlNYkkMGJq1PatHYcfvlv6bEWqZOJF6YPeQvmM7OoTFOeOyEkXdPYsC2MqGofcOg=', 'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSXgzPovjgpB4X41p8ikplMudE1NsypxXMBo/I458GfOvuvhxo6sqlu12AjFZMMe9bS122DgwaYEuH83LksQqk=', 'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/EQKS5EIJvJJ6vZOL876jxcikh5nibBDG/0A1ILl7ZBGYQeEG1ktITtk8OTGmpNxM1d2Y/Q5FTvMAfzgFHZ8I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf'}}, {'print': '**** done installing octopus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cephfs': {'max_mds': 2}, 'flavor': 'default', 'fs': 'xfs', 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client octopus']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done octopus client'}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'quincy'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph osd require-osd-release quincy', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'install.upgrade': {'client.0': {'branch': 'quincy'}}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': {'mounted': False}, 'client.1': {'skip': True}}}, {'ceph-fuse': {'client.0': None, 'client.1': {'skip': True}}}, {'print': '**** done remount client'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs required_client_features cephfs add metric_collect']}}, {'sleep': {'duration': 5}}, {'fs.clients_evicted': {'clients': {'client.0': False, 'client.1': True}}}, {'workunit': {'clients': {'client.0': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-17_20:24:14', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-18T10:35:25.777 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T10:35:25.806 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T10:35:25.808 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-18T10:35:25.827 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T10:35:25.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T10:35:25.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-04-18T10:35:25.899 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:25.899 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-04-18T10:35:25.955 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-18T10:35:25.956 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-04-18T10:35:26.015 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-18T10:35:26.015 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T10:35:26.015 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 168142 Links: 1 2024-04-18T10:35:26.015 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T10:35:26.015 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-18T10:35:26.015 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-18 10:35:16.363057859 +0000 2024-04-18T10:35:26.016 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-18 10:32:16.614595010 +0000 2024-04-18T10:35:26.016 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-18 10:32:16.614595010 +0000 2024-04-18T10:35:26.016 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-04-18T10:35:26.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-18T10:35:26.084 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-18T10:35:26.085 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-18T10:35:26.085 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000236984 s, 2.2 MB/s 2024-04-18T10:35:26.086 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-18T10:35:26.146 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-04-18T10:35:26.204 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-18T10:35:26.204 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T10:35:26.204 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 168189 Links: 1 2024-04-18T10:35:26.205 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T10:35:26.205 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-18T10:35:26.205 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-18 10:35:16.364057842 +0000 2024-04-18T10:35:26.205 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-18 10:32:16.965589075 +0000 2024-04-18T10:35:26.205 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-18 10:32:16.965589075 +0000 2024-04-18T10:35:26.205 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-04-18T10:35:26.205 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-18T10:35:26.271 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-18T10:35:26.272 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-18T10:35:26.272 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000216065 s, 2.4 MB/s 2024-04-18T10:35:26.273 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-18T10:35:26.332 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-04-18T10:35:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-18T10:35:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T10:35:26.391 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 172108 Links: 1 2024-04-18T10:35:26.391 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T10:35:26.392 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-18T10:35:26.392 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-18 10:35:16.364057842 +0000 2024-04-18T10:35:26.392 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-18 10:32:17.331582886 +0000 2024-04-18T10:35:26.392 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-18 10:32:17.331582886 +0000 2024-04-18T10:35:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-04-18T10:35:26.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-18T10:35:26.458 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-18T10:35:26.458 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-18T10:35:26.458 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000182914 s, 2.8 MB/s 2024-04-18T10:35:26.459 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-18T10:35:26.519 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-04-18T10:35:26.577 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-18T10:35:26.577 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-18T10:35:26.577 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 172160 Links: 1 2024-04-18T10:35:26.577 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T10:35:26.577 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-04-18T10:35:26.577 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-04-18 10:35:16.364057842 +0000 2024-04-18T10:35:26.577 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-04-18 10:32:17.703576596 +0000 2024-04-18T10:35:26.577 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-04-18 10:32:17.703576596 +0000 2024-04-18T10:35:26.577 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2024-04-18T10:35:26.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-18T10:35:26.643 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-04-18T10:35:26.643 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-04-18T10:35:26.643 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000235954 s, 2.2 MB/s 2024-04-18T10:35:26.644 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-18T10:35:26.704 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T10:35:26.704 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-18T10:35:26.704 INFO:tasks.ceph:Generating config... 2024-04-18T10:35:26.705 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-04-18T10:35:26.705 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-04-18T10:35:26.705 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2024-04-18T10:35:26.705 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2024-04-18T10:35:26.705 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-04-18T10:35:26.705 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-18T10:35:26.706 INFO:tasks.ceph:[client] debug client = 20 2024-04-18T10:35:26.706 INFO:tasks.ceph:[client] debug ms = 1 2024-04-18T10:35:26.706 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-18T10:35:26.706 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-18T10:35:26.706 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-18T10:35:26.707 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-18T10:35:26.707 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-18T10:35:26.707 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-18T10:35:26.707 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-18T10:35:26.707 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-18T10:35:26.707 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-18T10:35:26.707 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-18T10:35:26.707 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-18T10:35:26.707 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2024-04-18T10:35:26.707 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-18T10:35:26.707 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-18T10:35:26.707 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-18T10:35:26.707 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-18T10:35:26.707 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-18T10:35:26.707 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-18T10:35:26.708 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-18T10:35:26.708 INFO:tasks.ceph:Setting up mon.a... 2024-04-18T10:35:26.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-18T10:35:26.860 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2024-04-18T10:35:26.866 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-18T10:35:26.907 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T10:35:26.975 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]'), ('mon.c', '[v2:172.21.15.31:3302,v1:172.21.15.31:6791]')] 2024-04-18T10:35:26.976 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790],[v2:172.21.15.31:3302,v1:172.21.15.31:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-18T10:35:26.977 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:26.977 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T10:35:27.034 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --addv b '[v2:172.21.15.31:3301,v1:172.21.15.31:6790]' --addv c '[v2:172.21.15.31:3302,v1:172.21.15.31:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:27.118 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid 2dc05854-5716-4ea6-add8-fd949f4dd05c 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:fsid 2dc05854-5716-4ea6-add8-fd949f4dd05c 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2024-04-18T10:35:27.120203+0000 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-04-18T10:35:27.120203+0000 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 0 (unknown) 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] mon.b 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] mon.c 2024-04-18T10:35:27.119 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-18T10:35:27.120 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-18T10:35:27.138 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2dc05854-5716-4ea6-add8-fd949f4dd05c... 2024-04-18T10:35:27.139 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T10:35:27.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T10:35:27.182 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-18T10:35:27.223 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-04-18T10:35:27.223 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-04-18T10:35:27.223 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T10:35:27.223 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-04-18T10:35:27.223 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T10:35:27.224 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-04-18T10:35:27.225 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790],[v2:172.21.15.31:3302,v1:172.21.15.31:6791]" 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on pool no app = False 2024-04-18T10:35:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: ms bind msgr2 = False 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore warn on legacy statfs = False 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore warn on no per pool omap = False 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn min per osd = 0 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = 2dc05854-5716-4ea6-add8-fd949f4dd05c 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-04-18T10:35:27.227 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.228 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2024-04-18T10:35:27.229 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.230 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-04-18T10:35:27.231 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T10:35:27.232 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: mon down mkfs grace = 300 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = False 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-04-18T10:35:27.233 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-04-18T10:35:27.234 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-04-18T10:35:27.235 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-04-18T10:35:27.236 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-04-18T10:35:27.236 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2024-04-18T10:35:27.236 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T10:35:27.236 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2024-04-18T10:35:27.236 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T10:35:27.237 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T10:35:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790],[v2:172.21.15.31:3302,v1:172.21.15.31:6791]" 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on pool no app = False 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: ms bind msgr2 = False 2024-04-18T10:35:27.239 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore warn on legacy statfs = False 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore warn on no per pool omap = False 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn min per osd = 0 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 2dc05854-5716-4ea6-add8-fd949f4dd05c 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.240 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.241 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2024-04-18T10:35:27.242 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-04-18T10:35:27.243 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2024-04-18T10:35:27.244 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.245 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: mon down mkfs grace = 300 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = False 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-18T10:35:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2024-04-18T10:35:27.247 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-18T10:35:27.248 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-18T10:35:27.249 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.250 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.31,[v2:172.21.15.31:3301,v1:172.21.15.31:6790],[v2:172.21.15.31:3302,v1:172.21.15.31:6791]" 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on pool no app = False 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: ms bind msgr2 = False 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore warn on legacy statfs = False 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore warn on no per pool omap = False 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn min per osd = 0 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 2dc05854-5716-4ea6-add8-fd949f4dd05c 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-18T10:35:27.251 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.252 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-04-18T10:35:27.253 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-18T10:35:27.254 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-18T10:35:27.255 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-18T10:35:27.256 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = False 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-18T10:35:27.257 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-18T10:35:27.258 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-18T10:35:27.259 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-18T10:35:27.259 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-18T10:35:27.259 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-18T10:35:27.259 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-04-18T10:35:27.259 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-18T10:35:27.259 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-04-18T10:35:27.259 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-18T10:35:27.259 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-18T10:35:27.259 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-18T10:35:27.261 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-18T10:35:27.261 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-18T10:35:27.352 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-18T10:35:27.352 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:27.352 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-18T10:35:27.370 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:27.370 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-18T10:35:27.428 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:35:27.428 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:27.428 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T10:35:27.428 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T10:35:27.504 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:27.505 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:27.563 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2024-04-18T10:35:27.563 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:35:27.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T10:35:27.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T10:35:27.607 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:35:27.607 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:27.668 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-04-18T10:35:27.669 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:35:27.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-18T10:35:27.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-18T10:35:27.711 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:35:27.712 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:27.772 INFO:tasks.ceph:Setting up mon nodes... 2024-04-18T10:35:27.772 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-18T10:35:27.772 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T10:35:27.823 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-18T10:35:27.825 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T10:35:27.875 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-18T10:35:27.877 INFO:tasks.ceph:Setting up mds nodes... 2024-04-18T10:35:27.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T10:35:27.927 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-18T10:35:27.929 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-18T10:35:27.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-18T10:35:28.046 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-18T10:35:28.048 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-18T10:35:28.076 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-18T10:35:28.166 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-18T10:35:28.168 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-18T10:35:28.195 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-18T10:35:28.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-18T10:35:28.313 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-18T10:35:28.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-18T10:35:28.458 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-18T10:35:28.472 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-18T10:35:28.472 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-18T10:35:28.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-18T10:35:28.500 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T10:35:28.501 INFO:tasks.ceph:role: osd.0 2024-04-18T10:35:28.501 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:35:28.501 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-18T10:35:28.576 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T10:35:28.577 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T10:35:28.577 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T10:35:28.577 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T10:35:28.577 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T10:35:28.577 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-18T10:35:28.577 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T10:35:28.577 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T10:35:28.577 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T10:35:28.577 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T10:35:29.007 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-18T10:35:29.008 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-18T10:35:29.009 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-18T10:35:29.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-18T10:35:29.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-18T10:35:29.288 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T10:35:29.288 INFO:tasks.ceph:role: osd.1 2024-04-18T10:35:29.288 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:35:29.288 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-18T10:35:29.364 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T10:35:29.364 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T10:35:29.364 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T10:35:29.364 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T10:35:29.364 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T10:35:29.364 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-18T10:35:29.364 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T10:35:29.365 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T10:35:29.365 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T10:35:29.365 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T10:35:29.786 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-18T10:35:29.787 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-18T10:35:29.787 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-18T10:35:29.902 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-18T10:35:29.937 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-18T10:35:30.008 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T10:35:30.008 INFO:tasks.ceph:role: osd.2 2024-04-18T10:35:30.009 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:35:30.009 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-18T10:35:30.086 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T10:35:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T10:35:30.086 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T10:35:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T10:35:30.087 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T10:35:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-18T10:35:30.087 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T10:35:30.087 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T10:35:30.087 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T10:35:30.087 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T10:35:30.536 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-18T10:35:30.538 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-18T10:35:30.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-18T10:35:30.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-18T10:35:30.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-18T10:35:30.805 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-18T10:35:30.805 INFO:tasks.ceph:role: osd.3 2024-04-18T10:35:30.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:35:30.805 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-18T10:35:30.884 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-18T10:35:30.884 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-18T10:35:30.884 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-18T10:35:30.884 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-18T10:35:30.884 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-18T10:35:30.884 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-04-18T10:35:30.885 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-18T10:35:30.885 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-18T10:35:30.885 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-18T10:35:30.885 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-18T10:35:31.316 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-04-18T10:35:31.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-04-18T10:35:31.318 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-18T10:35:31.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-18T10:35:31.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:31.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:31.629+0000 7f3d37bdef00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-18T10:35:31.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:31.630+0000 7f3d37bdef00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-18T10:35:31.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:31.630+0000 7f3d37bdef00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T10:35:31.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:31.630+0000 7f3d37bdef00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T10:35:31.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:31.630+0000 7f3d37bdef00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-18T10:35:31.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:31.630+0000 7f3d37bdef00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-18T10:35:31.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:31.643+0000 7f3d37bdef00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-18T10:35:33.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-18T10:35:33.990 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:34.081+0000 7f2bd21f1f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-18T10:35:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:34.081+0000 7f2bd21f1f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-18T10:35:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:34.081+0000 7f2bd21f1f00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T10:35:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:34.081+0000 7f2bd21f1f00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T10:35:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:34.081+0000 7f2bd21f1f00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-18T10:35:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:34.082+0000 7f2bd21f1f00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-18T10:35:34.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:34.090+0000 7f2bd21f1f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-18T10:35:36.417 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-18T10:35:36.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:36.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:36.540+0000 7f6cf4d0cf00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-18T10:35:36.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:36.540+0000 7f6cf4d0cf00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-18T10:35:36.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:36.540+0000 7f6cf4d0cf00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T10:35:36.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:36.540+0000 7f6cf4d0cf00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T10:35:36.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:36.540+0000 7f6cf4d0cf00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-18T10:35:36.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:36.540+0000 7f6cf4d0cf00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-18T10:35:36.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:36.547+0000 7f6cf4d0cf00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-18T10:35:38.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-18T10:35:38.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:38.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:38.996+0000 7f8905f21f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-18T10:35:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:38.996+0000 7f8905f21f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-18T10:35:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:38.996+0000 7f8905f21f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T10:35:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:38.996+0000 7f8905f21f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T10:35:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:38.996+0000 7f8905f21f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-18T10:35:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:38.997+0000 7f8905f21f00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-18T10:35:39.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:39.004+0000 7f8905f21f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-18T10:35:41.329 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-18T10:35:41.364 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-18T10:35:41.364 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:41.364 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-18T10:35:41.435 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:41.435 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-18T10:35:41.507 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:41.507 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-18T10:35:41.577 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:41.578 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-18T10:35:41.649 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:41.649 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-18T10:35:41.720 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:41.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-18T10:35:41.791 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:41.791 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-18T10:35:41.862 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:41.862 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-18T10:35:41.933 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:41.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-18T10:35:42.004 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:35:42.004 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-18T10:35:42.027 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:35:42.027 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-18T10:35:42.052 INFO:tasks.ceph:Adding keys to all mons... 2024-04-18T10:35:42.052 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-18T10:35:42.081 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBv9yBmKbYqMRAA1bWtb85Y2fpNJ1xeFZsJaw== 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBv9yBmxvFBNBAAqxqH0E4s86Y3kk0hYAqYDQ== 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBv9yBm1fNcNxAAlulklbBCBAd5MgEAOuqidA== 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBw9yBmt9DcAhAAX89ues5oLdzyhQof/FaEKA== 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBw9yBmOmz/CRAA6Q6JmeOjxcOGFZ9YHA7tSg== 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBz9yBmJnigJRAAJtzmTzQ/Pd3O7qQVr0N/Xw== 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2024-04-18T10:35:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB29yBmIAPxBBAApdHN8VvRPKy6ulnD6YdcBw== 2024-04-18T10:35:42.083 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2024-04-18T10:35:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB49yBmEX9GIBAAXLu7n0Ztw6BzgfIcq/1cjw== 2024-04-18T10:35:42.083 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2024-04-18T10:35:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB69yBmgw17OxAAsi1Frq11/4v+rs/VPMjDJw== 2024-04-18T10:35:42.083 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-04-18T10:35:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBw9yBmmVbIEhAArCgC31HnOvV+Uc9231ggUg== 2024-04-18T10:35:42.083 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2024-04-18T10:35:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBw9yBmPflrGxAApUVqCGfSrfydqFOOu+8tNQ== 2024-04-18T10:35:42.084 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T10:35:42.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-18T10:35:42.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T10:35:42.283 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T10:35:42.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-18T10:35:42.386 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T10:35:42.435 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T10:35:42.484 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T10:35:42.532 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-18T10:35:42.581 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T10:35:42.633 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-18T10:35:42.685 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-18T10:35:42.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-18T10:35:42.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T10:35:42.807 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-18T10:35:42.834 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-18T10:35:42.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T10:35:42.995 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-18T10:35:43.023 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-18T10:35:43.090 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-18T10:35:43.184 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-18T10:35:43.211 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-18T10:35:43.269 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-18T10:35:43.270 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-18T10:35:43.270 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-18T10:35:43.312 INFO:tasks.ceph.mon.a:Started 2024-04-18T10:35:43.312 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T10:35:43.312 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T10:35:43.314 INFO:tasks.ceph.mon.b:Started 2024-04-18T10:35:43.314 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T10:35:43.314 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T10:35:43.316 INFO:tasks.ceph.mon.c:Started 2024-04-18T10:35:43.316 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-18T10:35:43.316 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-18T10:35:43.317 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-18T10:35:43.319 INFO:tasks.ceph.mgr.x:Started 2024-04-18T10:35:43.319 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-18T10:35:43.319 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-18T10:35:43.321 INFO:tasks.ceph.mgr.y:Started 2024-04-18T10:35:43.321 INFO:tasks.ceph:Setting crush tunables to default 2024-04-18T10:35:43.321 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2024-04-18T10:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.470+0000 7fd81d92f700 1 Processor -- start 2024-04-18T10:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.470+0000 7fd81d92f700 1 -- start start 2024-04-18T10:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd81d92f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd81d92f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd81d92f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81805c360 con 0x7fd81805cfc0 2024-04-18T10:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd81d92f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd818139630 con 0x7fd8180a8fb0 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd81d92f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8181398f0 con 0x7fd818133850 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd816ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd8167fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd816ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33372/0 (socket says 172.21.15.31:33372) 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd8177fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd81805cfc0 0x7fd8180ac490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34460/0 (socket says 172.21.15.31:34460) 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.471+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 learned_addr learned my addr 172.21.15.31:0/2691754282 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.472+0000 7fd8167fc700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 msgr2=0x7fd81805cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.472+0000 7fd8167fc700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 msgr2=0x7fd81805cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.472+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd818133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.472+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd818133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.472+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.472+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.472+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:43.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.472+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd8167fc700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 msgr2=0x7fd81805cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd8167fc700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 msgr2=0x7fd81805cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd818133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd818133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-18T10:35:43.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:43.673+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-18T10:35:44.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:44.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd8167fc700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 msgr2=0x7fd81805cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T10:35:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd8167fc700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 msgr2=0x7fd81805cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd818133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T10:35:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd818133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2024-04-18T10:35:44.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.074+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2024-04-18T10:35:44.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd8167fc700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 msgr2=0x7fd81805cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T10:35:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd8167fc700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 msgr2=0x7fd81805cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd818133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-18T10:35:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd818133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2024-04-18T10:35:44.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:44.875+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2024-04-18T10:35:46.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.471+0000 7fd814ff9700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 msgr2=0x7fd81805cad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.471+0000 7fd814ff9700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.471+0000 7fd814ff9700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd818133360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.471+0000 7fd814ff9700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd818133360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.471+0000 7fd814ff9700 1 -- 172.21.15.31:0/2691754282 >> v1:172.21.15.31:6789/0 conn(0x7fd81805cfc0 legacy=0x7fd8180ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.472+0000 7fd814ff9700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.472+0000 7fd814ff9700 1 -- 172.21.15.31:0/2691754282 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd818139630 con 0x7fd7f4003380 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.472+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.472+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.472+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.472+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.472+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.673+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.673+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T10:35:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.673+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.673+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:46.673+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-18T10:35:47.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.074+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:47.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.074+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T10:35:47.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.074+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:47.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.074+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:47.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.074+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2024-04-18T10:35:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.875+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.875+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-18T10:35:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.875+0000 7fd816ffd700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f40057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.875+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:47.875+0000 7fd816ffd700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2024-04-18T10:35:49.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd814ff9700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f40057d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T10:35:49.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd814ff9700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f40057d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd814ff9700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd7f400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd814ff9700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f400bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd814ff9700 1 -- 172.21.15.31:0/2691754282 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8180a79a0 con 0x7fd81805cfc0 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd814ff9700 1 -- 172.21.15.31:0/2691754282 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd818139630 con 0x7fd8180a8fb0 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd814ff9700 1 -- 172.21.15.31:0/2691754282 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8181398f0 con 0x7fd7f4003380 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd8177fe700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f400bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd7f400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd8177fe700 1 -- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 msgr2=0x7fd7f400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd8177fe700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd7f400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd815ffb700 1 -- 172.21.15.31:0/2691754282 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440225198 0 0) 0x7fd8180a79a0 con 0x7fd81805cfc0 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd8177fe700 1 -- 172.21.15.31:0/2691754282 >> v1:172.21.15.31:6789/0 conn(0x7fd81805cfc0 legacy=0x7fd7f4008000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd8177fe700 1 -- 172.21.15.31:0/2691754282 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f40058f0 con 0x7fd7f4003380 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.472+0000 7fd8167fc700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd7f400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.473+0000 7fd8177fe700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f400bc80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd81805ca20 tx=0x7fd810007f00).ready entity=mon.1 client_cookie=943035f901906886 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:49.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.473+0000 7fd815ffb700 1 -- 172.21.15.31:0/2691754282 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd810005ae0 con 0x7fd7f4003380 2024-04-18T10:35:49.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.473+0000 7fd815ffb700 1 -- 172.21.15.31:0/2691754282 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd810005c40 con 0x7fd7f4003380 2024-04-18T10:35:49.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.473+0000 7fd815ffb700 1 -- 172.21.15.31:0/2691754282 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8100070d0 con 0x7fd7f4003380 2024-04-18T10:35:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.474+0000 7fd81d92f700 1 -- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 msgr2=0x7fd7f400bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.474+0000 7fd81d92f700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f400bc80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd81805ca20 tx=0x7fd810007f00).stop 2024-04-18T10:35:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.474+0000 7fd81d92f700 1 -- 172.21.15.31:0/2691754282 shutdown_connections 2024-04-18T10:35:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.474+0000 7fd81d92f700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7f4003380 0x7fd7f400bc80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.474+0000 7fd81d92f700 1 --2- 172.21.15.31:0/2691754282 >> v2:172.21.15.31:3300/0 conn(0x7fd8180a8fb0 0x7fd7f400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.474+0000 7fd81d92f700 1 --2- 172.21.15.31:0/2691754282 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd818133850 0x7fd81805cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.474+0000 7fd81d92f700 1 -- 172.21.15.31:0/2691754282 >> 172.21.15.31:0/2691754282 conn(0x7fd818067a50 msgr2=0x7fd818066a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.474+0000 7fd81d92f700 1 -- 172.21.15.31:0/2691754282 shutdown_connections 2024-04-18T10:35:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.474+0000 7fd81d92f700 1 -- 172.21.15.31:0/2691754282 wait complete. 2024-04-18T10:35:49.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.475+0000 7fd81d92f700 1 Processor -- start 2024-04-18T10:35:49.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.476+0000 7fd81d92f700 1 -- start start 2024-04-18T10:35:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd81d92f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7f4003380 0x7fd8180a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd81d92f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd81805cfc0 0x7fd81813c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd81d92f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8180a8fb0 0x7fd8180a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd81d92f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8180a68a0 con 0x7fd81805cfc0 2024-04-18T10:35:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd81d92f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd818148d90 con 0x7fd8180a8fb0 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd81d92f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8180a1fb0 con 0x7fd7f4003380 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8167fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd81805cfc0 0x7fd81813c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8167fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd81805cfc0 0x7fd81813c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53142/0 (socket says 172.21.15.31:53142) 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8167fc700 1 -- 172.21.15.31:0/4218553615 learned_addr learned my addr 172.21.15.31:0/4218553615 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8177fe700 1 --2- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8180a8fb0 0x7fd8180a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8167fc700 1 -- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7f4003380 msgr2=0x7fd8180a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8167fc700 1 --2- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7f4003380 0x7fd8180a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8167fc700 1 -- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8180a8fb0 msgr2=0x7fd8180a3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8167fc700 1 --2- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8180a8fb0 0x7fd8180a3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8167fc700 1 -- 172.21.15.31:0/4218553615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80800e040 con 0x7fd81805cfc0 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8177fe700 1 --2- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8180a8fb0 0x7fd8180a3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.477+0000 7fd8167fc700 1 --2- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd81805cfc0 0x7fd81813c8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd80800a000 tx=0x7fd808008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.478+0000 7fd807fff700 1 -- 172.21.15.31:0/4218553615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd808017970 con 0x7fd81805cfc0 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.478+0000 7fd807fff700 1 -- 172.21.15.31:0/4218553615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd808017ad0 con 0x7fd81805cfc0 2024-04-18T10:35:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.478+0000 7fd81d92f700 1 -- 172.21.15.31:0/4218553615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81805c360 con 0x7fd81805cfc0 2024-04-18T10:35:49.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.478+0000 7fd807fff700 1 -- 172.21.15.31:0/4218553615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd808017e30 con 0x7fd81805cfc0 2024-04-18T10:35:49.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.478+0000 7fd81d92f700 1 -- 172.21.15.31:0/4218553615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81813cd90 con 0x7fd81805cfc0 2024-04-18T10:35:49.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.478+0000 7fd807fff700 1 -- 172.21.15.31:0/4218553615 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fd808012040 con 0x7fd81805cfc0 2024-04-18T10:35:49.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.478+0000 7fd807fff700 1 -- 172.21.15.31:0/4218553615 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd8080293f0 con 0x7fd81805cfc0 2024-04-18T10:35:49.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.479+0000 7fd81d92f700 1 -- 172.21.15.31:0/4218553615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8180a8c80 con 0x7fd81805cfc0 2024-04-18T10:35:49.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.483+0000 7fd807fff700 1 -- 172.21.15.31:0/4218553615 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fd808029630 con 0x7fd81805cfc0 2024-04-18T10:35:49.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.554+0000 7fd81d92f700 1 -- 172.21.15.31:0/4218553615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd818057a60 con 0x7fd81805cfc0 2024-04-18T10:35:49.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.557+0000 7fd807fff700 1 -- 172.21.15.31:0/4218553615 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd808006030 con 0x7fd81805cfc0 2024-04-18T10:35:49.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.558+0000 7fd81d92f700 1 -- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd81805cfc0 msgr2=0x7fd81813c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:49.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.558+0000 7fd81d92f700 1 --2- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd81805cfc0 0x7fd81813c8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd80800a000 tx=0x7fd808008040).stop 2024-04-18T10:35:49.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.558+0000 7fd81d92f700 1 -- 172.21.15.31:0/4218553615 shutdown_connections 2024-04-18T10:35:49.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.558+0000 7fd81d92f700 1 --2- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7f4003380 0x7fd8180a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:35:49.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.558+0000 7fd81d92f700 1 --2- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8180a8fb0 0x7fd8180a3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.558+0000 7fd81d92f700 1 --2- 172.21.15.31:0/4218553615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd81805cfc0 0x7fd81813c8a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.558+0000 7fd81d92f700 1 -- 172.21.15.31:0/4218553615 >> 172.21.15.31:0/4218553615 conn(0x7fd818067a50 msgr2=0x7fd818132420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:49.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.558+0000 7fd81d92f700 1 -- 172.21.15.31:0/4218553615 shutdown_connections 2024-04-18T10:35:49.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.558+0000 7fd81d92f700 1 -- 172.21.15.31:0/4218553615 wait complete. 2024-04-18T10:35:49.559 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-04-18T10:35:49.569 INFO:tasks.ceph:check_enable_crimson: False 2024-04-18T10:35:49.569 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-18T10:35:49.569 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:49.569 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-18T10:35:49.597 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:49.597 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-18T10:35:49.667 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:49.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-18T10:35:49.738 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:35:49.739 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-18T10:35:49.810 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 26ab35e2-f662-41bb-84a6-ae50230f2ff5 0 2024-04-18T10:35:49.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.959+0000 7efc14fc0700 1 Processor -- start 2024-04-18T10:35:49.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.960+0000 7efc14fc0700 1 -- start start 2024-04-18T10:35:49.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.960+0000 7efc14fc0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc10061ae0 0x7efc100aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.960+0000 7efc14fc0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc1013e9a0 0x7efc10140d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.960+0000 7efc14fc0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc10133bc0 con 0x7efc101366c0 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.960+0000 7efc14fc0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc101360c0 con 0x7efc10061ae0 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.960+0000 7efc14fc0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc100ab290 con 0x7efc1013e9a0 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0e59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efc101366c0 0x7efc10136aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59844/0 (socket says 172.21.15.31:59844) 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0dd9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc10061ae0 0x7efc100aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0e59c700 1 -- 172.21.15.31:0/3784772719 learned_addr learned my addr 172.21.15.31:0/3784772719 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0ed9d700 1 --2- 172.21.15.31:0/3784772719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc1013e9a0 0x7efc10140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0dd9b700 1 -- 172.21.15.31:0/3784772719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc1013e9a0 msgr2=0x7efc10140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0dd9b700 1 --2- 172.21.15.31:0/3784772719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc1013e9a0 0x7efc10140d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0dd9b700 1 -- 172.21.15.31:0/3784772719 >> v1:172.21.15.31:6789/0 conn(0x7efc101366c0 legacy=0x7efc10136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0dd9b700 1 -- 172.21.15.31:0/3784772719 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc100612a0 con 0x7efc10061ae0 2024-04-18T10:35:49.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0ed9d700 1 --2- 172.21.15.31:0/3784772719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc1013e9a0 0x7efc10140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0dd9b700 1 --2- 172.21.15.31:0/3784772719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc10061ae0 0x7efc100aa960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7efc100ab3d0 tx=0x7efc04006df0).ready entity=mon.0 client_cookie=eb837a435b95a5ba server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0d59a700 1 -- 172.21.15.31:0/3784772719 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0400d570 con 0x7efc10061ae0 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0d59a700 1 -- 172.21.15.31:0/3784772719 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc04000e90 con 0x7efc10061ae0 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.961+0000 7efc0d59a700 1 -- 172.21.15.31:0/3784772719 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0400d8c0 con 0x7efc10061ae0 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.962+0000 7efc14fc0700 1 -- 172.21.15.31:0/3784772719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc10061ae0 msgr2=0x7efc100aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.962+0000 7efc14fc0700 1 --2- 172.21.15.31:0/3784772719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc10061ae0 0x7efc100aa960 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7efc100ab3d0 tx=0x7efc04006df0).stop 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.962+0000 7efc14fc0700 1 -- 172.21.15.31:0/3784772719 shutdown_connections 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.962+0000 7efc14fc0700 1 --2- 172.21.15.31:0/3784772719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc1013e9a0 0x7efc10140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.962+0000 7efc14fc0700 1 --2- 172.21.15.31:0/3784772719 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc10061ae0 0x7efc100aa960 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.962+0000 7efc14fc0700 1 -- 172.21.15.31:0/3784772719 >> 172.21.15.31:0/3784772719 conn(0x7efc1006c0c0 msgr2=0x7efc1009ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.962+0000 7efc14fc0700 1 -- 172.21.15.31:0/3784772719 shutdown_connections 2024-04-18T10:35:49.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.962+0000 7efc14fc0700 1 -- 172.21.15.31:0/3784772719 wait complete. 2024-04-18T10:35:49.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.963+0000 7efc14fc0700 1 Processor -- start 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.963+0000 7efc14fc0700 1 -- start start 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc14fc0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc10061ae0 0x7efc10139d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc14fc0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101366c0 0x7efc101379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc14fc0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc1013e9a0 0x7efc1012ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc14fc0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1013b910 con 0x7efc1013e9a0 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc14fc0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc101395a0 con 0x7efc101366c0 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc14fc0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc1013bb40 con 0x7efc10061ae0 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc1013e9a0 0x7efc1012ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0ed9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc1013e9a0 0x7efc1012ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53162/0 (socket says 172.21.15.31:53162) 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0ed9d700 1 -- 172.21.15.31:0/292643005 learned_addr learned my addr 172.21.15.31:0/292643005 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0dd9b700 1 --2- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101366c0 0x7efc101379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0ed9d700 1 -- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc10061ae0 msgr2=0x7efc10139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0ed9d700 1 --2- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc10061ae0 0x7efc10139d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:35:49.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0ed9d700 1 -- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101366c0 msgr2=0x7efc101379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0ed9d700 1 --2- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101366c0 0x7efc101379c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0ed9d700 1 -- 172.21.15.31:0/292643005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009470 con 0x7efc1013e9a0 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0dd9b700 1 --2- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101366c0 0x7efc101379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efc0ed9d700 1 --2- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc1013e9a0 0x7efc1012ead0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7efc10139730 tx=0x7efc080091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efbff7fe700 1 -- 172.21.15.31:0/292643005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc080096b0 con 0x7efc1013e9a0 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.964+0000 7efbff7fe700 1 -- 172.21.15.31:0/292643005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0800c850 con 0x7efc1013e9a0 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.965+0000 7efc14fc0700 1 -- 172.21.15.31:0/292643005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0400b180 con 0x7efc1013e9a0 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.965+0000 7efbff7fe700 1 -- 172.21.15.31:0/292643005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc0800cbb0 con 0x7efc1013e9a0 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.965+0000 7efc14fc0700 1 -- 172.21.15.31:0/292643005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1013a200 con 0x7efc1013e9a0 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.965+0000 7efbff7fe700 1 -- 172.21.15.31:0/292643005 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7efc08022070 con 0x7efc1013e9a0 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.965+0000 7efbff7fe700 1 -- 172.21.15.31:0/292643005 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7efc0801ba90 con 0x7efc1013e9a0 2024-04-18T10:35:49.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.966+0000 7efc14fc0700 1 -- 172.21.15.31:0/292643005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc100a9460 con 0x7efc1013e9a0 2024-04-18T10:35:49.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:49.968+0000 7efbff7fe700 1 -- 172.21.15.31:0/292643005 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7efc08039870 con 0x7efc1013e9a0 2024-04-18T10:35:50.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.044+0000 7efc14fc0700 1 -- 172.21.15.31:0/292643005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26ab35e2-f662-41bb-84a6-ae50230f2ff5", "id": 0} v 0) v1 -- 0x7efc100aae50 con 0x7efc1013e9a0 2024-04-18T10:35:50.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.049+0000 7efbff7fe700 1 -- 172.21.15.31:0/292643005 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26ab35e2-f662-41bb-84a6-ae50230f2ff5", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7efc08029030 con 0x7efc1013e9a0 2024-04-18T10:35:50.049 INFO:teuthology.orchestra.run.smithi031.stdout:0 2024-04-18T10:35:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.050+0000 7efc14fc0700 1 -- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc1013e9a0 msgr2=0x7efc1012ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.050+0000 7efc14fc0700 1 --2- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc1013e9a0 0x7efc1012ead0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7efc10139730 tx=0x7efc080091d0).stop 2024-04-18T10:35:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.050+0000 7efc14fc0700 1 -- 172.21.15.31:0/292643005 shutdown_connections 2024-04-18T10:35:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.050+0000 7efc14fc0700 1 --2- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7efc10061ae0 0x7efc10139d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:35:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.050+0000 7efc14fc0700 1 --2- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc1013e9a0 0x7efc1012ead0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.050+0000 7efc14fc0700 1 --2- 172.21.15.31:0/292643005 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7efc101366c0 0x7efc101379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.050+0000 7efc14fc0700 1 -- 172.21.15.31:0/292643005 >> 172.21.15.31:0/292643005 conn(0x7efc1006c0c0 msgr2=0x7efc1009b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.051+0000 7efc14fc0700 1 -- 172.21.15.31:0/292643005 shutdown_connections 2024-04-18T10:35:50.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.051+0000 7efc14fc0700 1 -- 172.21.15.31:0/292643005 wait complete. 2024-04-18T10:35:50.062 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new 4e922862-50c2-4a41-8eba-8450b48538a9 1 2024-04-18T10:35:50.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.169+0000 7ff6e6c0a700 1 Processor -- start 2024-04-18T10:35:50.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.169+0000 7ff6e6c0a700 1 -- start start 2024-04-18T10:35:50.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e6c0a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e0064830 0x7ff6e0136df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e6c0a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e01339e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e6c0a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e006ca70 con 0x7ff6e006c690 2024-04-18T10:35:50.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e6c0a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0133270 con 0x7ff6e0064830 2024-04-18T10:35:50.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e6c0a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0132e50 con 0x7ff6e0133530 2024-04-18T10:35:50.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6dffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e0064830 0x7ff6e0136df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e49a6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff6e006c690 0x7ff6e01363a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59858/0 (socket says 172.21.15.31:59858) 2024-04-18T10:35:50.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e49a6700 1 -- 172.21.15.31:0/3936412076 learned_addr learned my addr 172.21.15.31:0/3936412076 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:35:50.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e51a7700 1 --2- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e01339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e51a7700 1 -- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 msgr2=0x7ff6e01339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T10:35:50.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e51a7700 1 -- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 msgr2=0x7ff6e01339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:50.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e51a7700 1 --2- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e01339e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:50.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6e51a7700 1 --2- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e01339e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:50.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6dffff700 1 -- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 msgr2=0x7ff6e01339e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T10:35:50.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6df7fe700 1 -- 172.21.15.31:0/3936412076 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289763457 0 0) 0x7ff6e006ca70 con 0x7ff6e006c690 2024-04-18T10:35:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6dffff700 1 --2- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e01339e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6dffff700 1 -- 172.21.15.31:0/3936412076 >> v1:172.21.15.31:6789/0 conn(0x7ff6e006c690 legacy=0x7ff6e01363a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6dffff700 1 -- 172.21.15.31:0/3936412076 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0133010 con 0x7ff6e0064830 2024-04-18T10:35:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6dffff700 1 --2- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e0064830 0x7ff6e0136df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff6cc002f70 tx=0x7ff6cc006df0).ready entity=mon.1 client_cookie=5f666142f75eced2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6df7fe700 1 -- 172.21.15.31:0/3936412076 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6cc00f970 con 0x7ff6e0064830 2024-04-18T10:35:50.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6df7fe700 1 -- 172.21.15.31:0/3936412076 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc000e90 con 0x7ff6e0064830 2024-04-18T10:35:50.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.170+0000 7ff6df7fe700 1 -- 172.21.15.31:0/3936412076 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6cc00fcc0 con 0x7ff6e0064830 2024-04-18T10:35:50.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.171+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e0064830 msgr2=0x7ff6e0136df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.171+0000 7ff6e6c0a700 1 --2- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e0064830 0x7ff6e0136df0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff6cc002f70 tx=0x7ff6cc006df0).stop 2024-04-18T10:35:50.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.171+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3936412076 shutdown_connections 2024-04-18T10:35:50.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.171+0000 7ff6e6c0a700 1 --2- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e01339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.171+0000 7ff6e6c0a700 1 --2- 172.21.15.31:0/3936412076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e0064830 0x7ff6e0136df0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.171+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3936412076 >> 172.21.15.31:0/3936412076 conn(0x7ff6e006c0c0 msgr2=0x7ff6e009b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:50.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.171+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3936412076 shutdown_connections 2024-04-18T10:35:50.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.171+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3936412076 wait complete. 2024-04-18T10:35:50.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.172+0000 7ff6e6c0a700 1 Processor -- start 2024-04-18T10:35:50.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.172+0000 7ff6e6c0a700 1 -- start start 2024-04-18T10:35:50.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e6c0a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6e006c690 0x7ff6e009aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e6c0a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e009dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e6c0a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e00974b0 0x7ff6e0097910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e6c0a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e009d400 con 0x7ff6e006c690 2024-04-18T10:35:50.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e6c0a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e009a300 con 0x7ff6e00974b0 2024-04-18T10:35:50.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e6c0a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e009a5c0 con 0x7ff6e0133530 2024-04-18T10:35:50.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6dffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e009dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6dffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e009dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41868/0 (socket says 172.21.15.31:41868) 2024-04-18T10:35:50.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6dffff700 1 -- 172.21.15.31:0/3831720741 learned_addr learned my addr 172.21.15.31:0/3831720741 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:50.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e51a7700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e00974b0 0x7ff6e0097910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e49a6700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6e006c690 0x7ff6e009aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6dffff700 1 -- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 msgr2=0x7ff6e009dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-18T10:35:50.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6dffff700 1 -- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 msgr2=0x7ff6e009dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T10:35:50.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6dffff700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e009dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:50.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6dffff700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e009dbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:50.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e51a7700 1 -- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 msgr2=0x7ff6e009dbe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:35:50.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e51a7700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e009dbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e51a7700 1 -- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6e006c690 msgr2=0x7ff6e009aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e51a7700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6e006c690 0x7ff6e009aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.173+0000 7ff6e51a7700 1 -- 172.21.15.31:0/3831720741 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc00b180 con 0x7ff6e00974b0 2024-04-18T10:35:50.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.174+0000 7ff6e51a7700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e00974b0 0x7ff6e0097910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff6d8001210 tx=0x7ff6d8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:50.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.174+0000 7ff6ddffb700 1 -- 172.21.15.31:0/3831720741 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6d800f710 con 0x7ff6e00974b0 2024-04-18T10:35:50.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.174+0000 7ff6ddffb700 1 -- 172.21.15.31:0/3831720741 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d800f870 con 0x7ff6e00974b0 2024-04-18T10:35:50.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.174+0000 7ff6ddffb700 1 -- 172.21.15.31:0/3831720741 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6d800fbd0 con 0x7ff6e00974b0 2024-04-18T10:35:50.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.174+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3831720741 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e0098a30 con 0x7ff6e00974b0 2024-04-18T10:35:50.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.174+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3831720741 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e00a8ba0 con 0x7ff6e00974b0 2024-04-18T10:35:50.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.174+0000 7ff6ddffb700 1 -- 172.21.15.31:0/3831720741 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7ff6d801a030 con 0x7ff6e00974b0 2024-04-18T10:35:50.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.174+0000 7ff6ddffb700 1 -- 172.21.15.31:0/3831720741 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7ff6d80063e0 con 0x7ff6e00974b0 2024-04-18T10:35:50.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.175+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3831720741 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e009afd0 con 0x7ff6e00974b0 2024-04-18T10:35:50.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.177+0000 7ff6ddffb700 1 -- 172.21.15.31:0/3831720741 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff6d8018070 con 0x7ff6e00974b0 2024-04-18T10:35:50.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.254+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3831720741 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4e922862-50c2-4a41-8eba-8450b48538a9", "id": 1} v 0) v1 -- 0x7ff6e009d900 con 0x7ff6e00974b0 2024-04-18T10:35:50.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.259+0000 7ff6ddffb700 1 -- 172.21.15.31:0/3831720741 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4e922862-50c2-4a41-8eba-8450b48538a9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6e009d900 con 0x7ff6e00974b0 2024-04-18T10:35:50.259 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-04-18T10:35:50.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.260+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e00974b0 msgr2=0x7ff6e0097910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.260+0000 7ff6e6c0a700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e00974b0 0x7ff6e0097910 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff6d8001210 tx=0x7ff6d8008040).stop 2024-04-18T10:35:50.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.260+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3831720741 shutdown_connections 2024-04-18T10:35:50.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.260+0000 7ff6e6c0a700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff6e00974b0 0x7ff6e0097910 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.260+0000 7ff6e6c0a700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6e006c690 0x7ff6e009aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.260+0000 7ff6e6c0a700 1 --2- 172.21.15.31:0/3831720741 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff6e0133530 0x7ff6e009dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.260+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3831720741 >> 172.21.15.31:0/3831720741 conn(0x7ff6e006c0c0 msgr2=0x7ff6e005c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:50.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.260+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3831720741 shutdown_connections 2024-04-18T10:35:50.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.260+0000 7ff6e6c0a700 1 -- 172.21.15.31:0/3831720741 wait complete. 2024-04-18T10:35:50.271 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new e7051e98-337d-4aee-91e3-86589be64be4 2 2024-04-18T10:35:50.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.381+0000 7f4cadf09700 1 Processor -- start 2024-04-18T10:35:50.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.381+0000 7f4cadf09700 1 -- start start 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4cadf09700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 0x7f4ca813a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4cadf09700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca805b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4cadf09700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca8139640 con 0x7f4ca8063600 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4cadf09700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca813a590 con 0x7f4ca8139cc0 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4cadf09700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80a8e00 con 0x7f4ca80631a0 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca6ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca7fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4ca8063600 0x7f4ca805be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59864/0 (socket says 172.21.15.31:59864) 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca7fff700 1 -- 172.21.15.31:0/1498634622 learned_addr learned my addr 172.21.15.31:0/1498634622 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca77fe700 1 --2- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 0x7f4ca813a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca6ffd700 1 -- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 msgr2=0x7f4ca805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca6ffd700 1 -- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 msgr2=0x7f4ca805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca6ffd700 1 --2- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca805b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca6ffd700 1 --2- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca805b970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca67fc700 1 -- 172.21.15.31:0/1498634622 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407224992 0 0) 0x7f4ca8139640 con 0x7f4ca8063600 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca67fc700 1 -- 172.21.15.31:0/1498634622 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c94003260 con 0x7f4ca8063600 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca77fe700 1 -- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 msgr2=0x7f4ca805b970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca77fe700 1 --2- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca805b970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca77fe700 1 -- 172.21.15.31:0/1498634622 >> v1:172.21.15.31:6789/0 conn(0x7f4ca8063600 legacy=0x7f4ca805be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.382+0000 7f4ca77fe700 1 -- 172.21.15.31:0/1498634622 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca8139870 con 0x7f4ca8139cc0 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4ca77fe700 1 --2- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 0x7f4ca813a0a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4c98002f70 tx=0x7f4c98006df0).ready entity=mon.1 client_cookie=17ae66a196eea920 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4ca67fc700 1 -- 172.21.15.31:0/1498634622 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9800d570 con 0x7f4ca8139cc0 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4ca67fc700 1 -- 172.21.15.31:0/1498634622 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98000e90 con 0x7f4ca8139cc0 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4ca67fc700 1 -- 172.21.15.31:0/1498634622 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9800d8c0 con 0x7f4ca8139cc0 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4cadf09700 1 -- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 msgr2=0x7f4ca813a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4cadf09700 1 --2- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 0x7f4ca813a0a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4c98002f70 tx=0x7f4c98006df0).stop 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4cadf09700 1 -- 172.21.15.31:0/1498634622 shutdown_connections 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4cadf09700 1 --2- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 0x7f4ca813a0a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4cadf09700 1 --2- 172.21.15.31:0/1498634622 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca805b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4cadf09700 1 -- 172.21.15.31:0/1498634622 >> 172.21.15.31:0/1498634622 conn(0x7f4ca806c0c0 msgr2=0x7f4ca809b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.383+0000 7f4cadf09700 1 -- 172.21.15.31:0/1498634622 shutdown_connections 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.384+0000 7f4cadf09700 1 -- 172.21.15.31:0/1498634622 wait complete. 2024-04-18T10:35:50.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.385+0000 7f4cadf09700 1 Processor -- start 2024-04-18T10:35:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.385+0000 7f4cadf09700 1 -- start start 2024-04-18T10:35:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4cadf09700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca8094dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4cadf09700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca8063600 0x7f4ca80980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4cadf09700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 0x7f4ca80985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4cadf09700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80941a0 con 0x7f4ca8063600 2024-04-18T10:35:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4cadf09700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80957a0 con 0x7f4ca8139cc0 2024-04-18T10:35:50.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4cadf09700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8097c60 con 0x7f4ca80631a0 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4ca6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca8063600 0x7f4ca80980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4ca6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca8063600 0x7f4ca80980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53176/0 (socket says 172.21.15.31:53176) 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4ca6ffd700 1 -- 172.21.15.31:0/1783414992 learned_addr learned my addr 172.21.15.31:0/1783414992 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4ca77fe700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca8094dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4ca77fe700 1 -- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 msgr2=0x7f4ca8094dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4ca77fe700 1 -- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 msgr2=0x7f4ca8094dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4ca77fe700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca8094dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4ca77fe700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca8094dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.386+0000 7f4ca7fff700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 0x7f4ca80985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca6ffd700 1 -- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 msgr2=0x7f4ca8094dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca6ffd700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca8094dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca6ffd700 1 -- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 msgr2=0x7f4ca80985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca6ffd700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 0x7f4ca80985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca6ffd700 1 -- 172.21.15.31:0/1783414992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9800b180 con 0x7f4ca8063600 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca6ffd700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca8063600 0x7f4ca80980b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f4c9c000e90 tx=0x7f4c9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca4ff9700 1 -- 172.21.15.31:0/1783414992 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9c011780 con 0x7f4ca8063600 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca4ff9700 1 -- 172.21.15.31:0/1783414992 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c0118e0 con 0x7f4ca8063600 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4cadf09700 1 -- 172.21.15.31:0/1783414992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca80966c0 con 0x7f4ca8063600 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca4ff9700 1 -- 172.21.15.31:0/1783414992 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9c011c40 con 0x7f4ca8063600 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4cadf09700 1 -- 172.21.15.31:0/1783414992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8095f00 con 0x7f4ca8063600 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.387+0000 7f4ca4ff9700 1 -- 172.21.15.31:0/1783414992 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4c9c01c460 con 0x7f4ca8063600 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.388+0000 7f4cadf09700 1 -- 172.21.15.31:0/1783414992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca80a9fc0 con 0x7f4ca8063600 2024-04-18T10:35:50.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.388+0000 7f4ca4ff9700 1 -- 172.21.15.31:0/1783414992 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f4c9c01c6f0 con 0x7f4ca8063600 2024-04-18T10:35:50.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.392+0000 7f4ca4ff9700 1 -- 172.21.15.31:0/1783414992 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4c9c01cd00 con 0x7f4ca8063600 2024-04-18T10:35:50.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.491+0000 7f4cadf09700 1 -- 172.21.15.31:0/1783414992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e7051e98-337d-4aee-91e3-86589be64be4", "id": 2} v 0) v1 -- 0x7f4ca8057a60 con 0x7f4ca8063600 2024-04-18T10:35:50.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.493+0000 7f4ca4ff9700 1 -- 172.21.15.31:0/1783414992 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e7051e98-337d-4aee-91e3-86589be64be4", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c9c026430 con 0x7f4ca8063600 2024-04-18T10:35:50.493 INFO:teuthology.orchestra.run.smithi031.stdout:2 2024-04-18T10:35:50.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.494+0000 7f4cadf09700 1 -- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca8063600 msgr2=0x7f4ca80980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.494+0000 7f4cadf09700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca8063600 0x7f4ca80980b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f4c9c000e90 tx=0x7f4c9c008040).stop 2024-04-18T10:35:50.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.494+0000 7f4cadf09700 1 -- 172.21.15.31:0/1783414992 shutdown_connections 2024-04-18T10:35:50.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.494+0000 7f4cadf09700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ca80631a0 0x7f4ca8094dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.494+0000 7f4cadf09700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ca8139cc0 0x7f4ca80985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.494+0000 7f4cadf09700 1 --2- 172.21.15.31:0/1783414992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ca8063600 0x7f4ca80980b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.494+0000 7f4cadf09700 1 -- 172.21.15.31:0/1783414992 >> 172.21.15.31:0/1783414992 conn(0x7f4ca806c0c0 msgr2=0x7f4ca809a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:50.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.494+0000 7f4cadf09700 1 -- 172.21.15.31:0/1783414992 shutdown_connections 2024-04-18T10:35:50.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.494+0000 7f4cadf09700 1 -- 172.21.15.31:0/1783414992 wait complete. 2024-04-18T10:35:50.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd new b3017445-c716-4557-9ef9-5cd838ef1cdf 3 2024-04-18T10:35:50.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.614+0000 7f8477e9c700 1 Processor -- start 2024-04-18T10:35:50.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.614+0000 7f8477e9c700 1 -- start start 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8477e9c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470066c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8477e9c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8470139ff0 0x7f84700a4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8477e9c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8470067180 con 0x7f84700a4840 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8477e9c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8470066790 con 0x7f8470139ff0 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8477e9c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84700a4d20 con 0x7f8470139c10 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8475437700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8470139ff0 0x7f84700a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8476439700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f84700a4840 0x7f847005b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59876/0 (socket says 172.21.15.31:59876) 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8476439700 1 -- 172.21.15.31:0/2372544318 learned_addr learned my addr 172.21.15.31:0/2372544318 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8475c38700 1 --2- 172.21.15.31:0/2372544318 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470066c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8475437700 1 -- 172.21.15.31:0/2372544318 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 msgr2=0x7f8470066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8475437700 1 --2- 172.21.15.31:0/2372544318 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470066c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8475437700 1 -- 172.21.15.31:0/2372544318 >> v1:172.21.15.31:6789/0 conn(0x7f84700a4840 legacy=0x7f847005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8475437700 1 -- 172.21.15.31:0/2372544318 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470139750 con 0x7f8470139ff0 2024-04-18T10:35:50.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.615+0000 7f8475c38700 1 --2- 172.21.15.31:0/2372544318 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470066c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:50.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8475437700 1 --2- 172.21.15.31:0/2372544318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 0x7f84700a4350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f8460002f70 tx=0x7f8460006df0).ready entity=mon.0 client_cookie=7964234ed5056699 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:50.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8474c36700 1 -- 172.21.15.31:0/2372544318 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f846000d570 con 0x7f8470139ff0 2024-04-18T10:35:50.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8474c36700 1 -- 172.21.15.31:0/2372544318 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8460000e90 con 0x7f8470139ff0 2024-04-18T10:35:50.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8474c36700 1 -- 172.21.15.31:0/2372544318 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f846000d8c0 con 0x7f8470139ff0 2024-04-18T10:35:50.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8477e9c700 1 -- 172.21.15.31:0/2372544318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 msgr2=0x7f84700a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8477e9c700 1 --2- 172.21.15.31:0/2372544318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 0x7f84700a4350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f8460002f70 tx=0x7f8460006df0).stop 2024-04-18T10:35:50.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8477e9c700 1 -- 172.21.15.31:0/2372544318 shutdown_connections 2024-04-18T10:35:50.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8477e9c700 1 --2- 172.21.15.31:0/2372544318 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470066c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8477e9c700 1 --2- 172.21.15.31:0/2372544318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 0x7f84700a4350 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8477e9c700 1 -- 172.21.15.31:0/2372544318 >> 172.21.15.31:0/2372544318 conn(0x7f84700a89a0 msgr2=0x7f84700a8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.616+0000 7f8477e9c700 1 -- 172.21.15.31:0/2372544318 shutdown_connections 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.617+0000 7f8477e9c700 1 -- 172.21.15.31:0/2372544318 wait complete. 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8477e9c700 1 Processor -- start 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8477e9c700 1 -- start start 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8477e9c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84700a4840 0x7f8470097200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8477e9c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470095460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8477e9c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 0x7f84701496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8477e9c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84700936d0 con 0x7f8470139ff0 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8477e9c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8470096840 con 0x7f8470139c10 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8477e9c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8470096b20 con 0x7f84700a4840 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8475437700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470095460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8475c38700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84700a4840 0x7f8470097200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8475437700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470095460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56610/0 (socket says 172.21.15.31:56610) 2024-04-18T10:35:50.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8475437700 1 -- 172.21.15.31:0/168275752 learned_addr learned my addr 172.21.15.31:0/168275752 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8475c38700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84700a4840 0x7f8470097200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41900/0 (socket says 172.21.15.31:41900) 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.618+0000 7f8476439700 1 --2- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 0x7f84701496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f8476439700 1 -- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84700a4840 msgr2=0x7f8470097200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f8476439700 1 --2- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84700a4840 0x7f8470097200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f8476439700 1 -- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 msgr2=0x7f8470095460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f8476439700 1 --2- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470095460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f8476439700 1 -- 172.21.15.31:0/168275752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c00b180 con 0x7f8470139ff0 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f8475437700 1 --2- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470095460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f8476439700 1 --2- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 0x7f84701496e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f84700a3c50 tx=0x7f8468007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f845effd700 1 -- 172.21.15.31:0/168275752 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8468005ba0 con 0x7f8470139ff0 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f845effd700 1 -- 172.21.15.31:0/168275752 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468005d00 con 0x7f8470139ff0 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f8477e9c700 1 -- 172.21.15.31:0/168275752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846000b180 con 0x7f8470139ff0 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f845effd700 1 -- 172.21.15.31:0/168275752 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84680072c0 con 0x7f8470139ff0 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f8477e9c700 1 -- 172.21.15.31:0/168275752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8470093cf0 con 0x7f8470139ff0 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f845effd700 1 -- 172.21.15.31:0/168275752 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f8468010070 con 0x7f8470139ff0 2024-04-18T10:35:50.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.619+0000 7f845effd700 1 -- 172.21.15.31:0/168275752 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f84680138f0 con 0x7f8470139ff0 2024-04-18T10:35:50.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.620+0000 7f8477e9c700 1 -- 172.21.15.31:0/168275752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8470095b10 con 0x7f8470139ff0 2024-04-18T10:35:50.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.622+0000 7f845effd700 1 -- 172.21.15.31:0/168275752 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f8470095b10 con 0x7f8470139ff0 2024-04-18T10:35:50.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.699+0000 7f8477e9c700 1 -- 172.21.15.31:0/168275752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b3017445-c716-4557-9ef9-5cd838ef1cdf", "id": 3} v 0) v1 -- 0x7f847013a4f0 con 0x7f8470139ff0 2024-04-18T10:35:50.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.702+0000 7f845effd700 1 -- 172.21.15.31:0/168275752 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3017445-c716-4557-9ef9-5cd838ef1cdf", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8470067180 con 0x7f8470139ff0 2024-04-18T10:35:50.702 INFO:teuthology.orchestra.run.smithi031.stdout:3 2024-04-18T10:35:50.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.703+0000 7f8477e9c700 1 -- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 msgr2=0x7f84701496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.703+0000 7f8477e9c700 1 --2- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 0x7f84701496e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f84700a3c50 tx=0x7f8468007e90).stop 2024-04-18T10:35:50.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.703+0000 7f8477e9c700 1 -- 172.21.15.31:0/168275752 shutdown_connections 2024-04-18T10:35:50.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.703+0000 7f8477e9c700 1 --2- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84700a4840 0x7f8470097200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.703+0000 7f8477e9c700 1 --2- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8470139ff0 0x7f84701496e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.703+0000 7f8477e9c700 1 --2- 172.21.15.31:0/168275752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8470139c10 0x7f8470095460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.703+0000 7f8477e9c700 1 -- 172.21.15.31:0/168275752 >> 172.21.15.31:0/168275752 conn(0x7f84700a89a0 msgr2=0x7f847005b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:50.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.704+0000 7f8477e9c700 1 -- 172.21.15.31:0/168275752 shutdown_connections 2024-04-18T10:35:50.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.704+0000 7f8477e9c700 1 -- 172.21.15.31:0/168275752 wait complete. 2024-04-18T10:35:50.715 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-18T10:35:50.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-18T10:35:50.717 INFO:tasks.ceph.osd.0:Started 2024-04-18T10:35:50.717 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-18T10:35:50.718 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-18T10:35:50.719 INFO:tasks.ceph.osd.1:Started 2024-04-18T10:35:50.719 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-18T10:35:50.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-18T10:35:50.721 INFO:tasks.ceph.osd.2:Started 2024-04-18T10:35:50.721 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-18T10:35:50.722 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-18T10:35:50.724 INFO:tasks.ceph.osd.3:Started 2024-04-18T10:35:50.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:35:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.880+0000 7ff9badc8700 1 Processor -- start 2024-04-18T10:35:50.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.880+0000 7ff9badc8700 1 -- start start 2024-04-18T10:35:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9badc8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9b405bb30 0x7ff9b4063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9badc8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b4061fe0 0x7ff9b4139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9badc8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4062400 0x7ff9b40a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9badc8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b4062b80 con 0x7ff9b405bb30 2024-04-18T10:35:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9badc8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4062e60 con 0x7ff9b4061fe0 2024-04-18T10:35:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9badc8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4139a40 con 0x7ff9b4062400 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b8b64700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9b405bb30 0x7ff9b4063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b8b64700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9b405bb30 0x7ff9b4063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53244/0 (socket says 172.21.15.31:53244) 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b8b64700 1 -- 172.21.15.31:0/199131332 learned_addr learned my addr 172.21.15.31:0/199131332 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b9365700 1 --2- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4062400 0x7ff9b40a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b3fff700 1 --2- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b4061fe0 0x7ff9b4139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b9365700 1 -- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4062400 msgr2=0x7ff9b40a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b9365700 1 -- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4062400 msgr2=0x7ff9b40a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b9365700 1 --2- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4062400 0x7ff9b40a8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b9365700 1 --2- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4062400 0x7ff9b40a8290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b3fff700 1 -- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4062400 msgr2=0x7ff9b40a8290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b3fff700 1 --2- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4062400 0x7ff9b40a8290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b3fff700 1 -- 172.21.15.31:0/199131332 >> v2:172.21.15.31:3300/0 conn(0x7ff9b405bb30 msgr2=0x7ff9b4063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b3fff700 1 --2- 172.21.15.31:0/199131332 >> v2:172.21.15.31:3300/0 conn(0x7ff9b405bb30 0x7ff9b4063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b3fff700 1 -- 172.21.15.31:0/199131332 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b4139d00 con 0x7ff9b4061fe0 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b8b64700 1 --2- 172.21.15.31:0/199131332 >> v2:172.21.15.31:3300/0 conn(0x7ff9b405bb30 0x7ff9b4063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.881+0000 7ff9b3fff700 1 --2- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b4061fe0 0x7ff9b4139fb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff9a0002f70 tx=0x7ff9a0006df0).ready entity=mon.1 client_cookie=c4c904043f2c8f7f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.882+0000 7ff9b37fe700 1 -- 172.21.15.31:0/199131332 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a000d570 con 0x7ff9b4061fe0 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.882+0000 7ff9b37fe700 1 -- 172.21.15.31:0/199131332 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a0000e90 con 0x7ff9b4061fe0 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.882+0000 7ff9b37fe700 1 -- 172.21.15.31:0/199131332 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a000d8c0 con 0x7ff9b4061fe0 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.882+0000 7ff9badc8700 1 -- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b4061fe0 msgr2=0x7ff9b4139fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.882+0000 7ff9badc8700 1 --2- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b4061fe0 0x7ff9b4139fb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7ff9a0002f70 tx=0x7ff9a0006df0).stop 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.883+0000 7ff9badc8700 1 -- 172.21.15.31:0/199131332 shutdown_connections 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.883+0000 7ff9badc8700 1 --2- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4062400 0x7ff9b40a8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.883+0000 7ff9badc8700 1 --2- 172.21.15.31:0/199131332 >> v2:172.21.15.31:3300/0 conn(0x7ff9b405bb30 0x7ff9b4063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.883+0000 7ff9badc8700 1 --2- 172.21.15.31:0/199131332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b4061fe0 0x7ff9b4139fb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.883+0000 7ff9badc8700 1 -- 172.21.15.31:0/199131332 >> 172.21.15.31:0/199131332 conn(0x7ff9b406c0c0 msgr2=0x7ff9b406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.883+0000 7ff9badc8700 1 -- 172.21.15.31:0/199131332 shutdown_connections 2024-04-18T10:35:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.883+0000 7ff9badc8700 1 -- 172.21.15.31:0/199131332 wait complete. 2024-04-18T10:35:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.884+0000 7ff9badc8700 1 Processor -- start 2024-04-18T10:35:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.884+0000 7ff9badc8700 1 -- start start 2024-04-18T10:35:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9badc8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b405bb30 0x7ff9b40958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9badc8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b4061fe0 0x7ff9b4096e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9badc8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4149130 0x7ff9b41495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9badc8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4095e10 con 0x7ff9b4061fe0 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9badc8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b41316b0 con 0x7ff9b405bb30 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9badc8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4094830 con 0x7ff9b4149130 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9b8b64700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b405bb30 0x7ff9b40958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9b8b64700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b405bb30 0x7ff9b40958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56648/0 (socket says 172.21.15.31:56648) 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9b8b64700 1 -- 172.21.15.31:0/3739529670 learned_addr learned my addr 172.21.15.31:0/3739529670 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b4061fe0 0x7ff9b4096e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.885+0000 7ff9b9365700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4149130 0x7ff9b41495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b9365700 1 -- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4149130 msgr2=0x7ff9b41495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b9365700 1 -- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4149130 msgr2=0x7ff9b41495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b9365700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4149130 0x7ff9b41495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b9365700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4149130 0x7ff9b41495b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b8b64700 1 -- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4149130 msgr2=0x7ff9b41495b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b8b64700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4149130 0x7ff9b41495b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b8b64700 1 -- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b4061fe0 msgr2=0x7ff9b4096e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b8b64700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b4061fe0 0x7ff9b4096e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b8b64700 1 -- 172.21.15.31:0/3739529670 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a800b1e0 con 0x7ff9b405bb30 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b3fff700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b4061fe0 0x7ff9b4096e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b8b64700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b405bb30 0x7ff9b40958a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff9a800c000 tx=0x7ff9a8006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b1ffb700 1 -- 172.21.15.31:0/3739529670 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a8012600 con 0x7ff9b405bb30 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b1ffb700 1 -- 172.21.15.31:0/3739529670 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a8012760 con 0x7ff9b405bb30 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9badc8700 1 -- 172.21.15.31:0/3739529670 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a000b180 con 0x7ff9b405bb30 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9b1ffb700 1 -- 172.21.15.31:0/3739529670 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a8012ac0 con 0x7ff9b405bb30 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.886+0000 7ff9badc8700 1 -- 172.21.15.31:0/3739529670 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b4094480 con 0x7ff9b405bb30 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.887+0000 7ff9b1ffb700 1 -- 172.21.15.31:0/3739529670 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7ff9a8022070 con 0x7ff9b405bb30 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.887+0000 7ff9b1ffb700 1 -- 172.21.15.31:0/3739529670 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7ff9a801ba00 con 0x7ff9b405bb30 2024-04-18T10:35:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.887+0000 7ff9badc8700 1 -- 172.21.15.31:0/3739529670 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b405bf10 con 0x7ff9b405bb30 2024-04-18T10:35:50.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.889+0000 7ff9b1ffb700 1 -- 172.21.15.31:0/3739529670 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff9a8039870 con 0x7ff9b405bb30 2024-04-18T10:35:50.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.953+0000 7ff9badc8700 1 -- 172.21.15.31:0/3739529670 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b41392c0 con 0x7ff9b405bb30 2024-04-18T10:35:50.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.953+0000 7ff9b1ffb700 1 -- 172.21.15.31:0/3739529670 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7ff9a8029070 con 0x7ff9b405bb30 2024-04-18T10:35:50.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:35:50.954 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:35:50.701218+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:35:50.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.954+0000 7ff9badc8700 1 -- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b405bb30 msgr2=0x7ff9b40958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:50.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.954+0000 7ff9badc8700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b405bb30 0x7ff9b40958a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff9a800c000 tx=0x7ff9a8006eb0).stop 2024-04-18T10:35:50.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.954+0000 7ff9badc8700 1 -- 172.21.15.31:0/3739529670 shutdown_connections 2024-04-18T10:35:50.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.954+0000 7ff9badc8700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9b4149130 0x7ff9b41495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.954+0000 7ff9badc8700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9b405bb30 0x7ff9b40958a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.954+0000 7ff9badc8700 1 --2- 172.21.15.31:0/3739529670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9b4061fe0 0x7ff9b4096e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:50.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.954+0000 7ff9badc8700 1 -- 172.21.15.31:0/3739529670 >> 172.21.15.31:0/3739529670 conn(0x7ff9b406c0c0 msgr2=0x7ff9b406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:50.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.954+0000 7ff9badc8700 1 -- 172.21.15.31:0/3739529670 shutdown_connections 2024-04-18T10:35:50.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:50.954+0000 7ff9badc8700 1 -- 172.21.15.31:0/3739529670 wait complete. 2024-04-18T10:35:50.965 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-18T10:35:50.965 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-18T10:35:51.363 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:35:51.362+0000 7fd198f4bf00 -1 Falling back to public interface 2024-04-18T10:35:51.367 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:35:51.367+0000 7f02cc607f00 -1 Falling back to public interface 2024-04-18T10:35:51.369 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T10:35:51.372 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:35:51.372+0000 7f51fec7df00 -1 Falling back to public interface 2024-04-18T10:35:51.372 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:35:51.372+0000 7f855a68af00 -1 Falling back to public interface 2024-04-18T10:35:51.372 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:35:51.372+0000 7f51f93e2700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6808/0: (98) Address already in use 2024-04-18T10:35:51.475 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.475+0000 7f2323995700 1 Processor -- start 2024-04-18T10:35:51.475 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.475+0000 7f2323995700 1 -- start start 2024-04-18T10:35:51.477 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2323995700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c062120 0x7f231c0632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:51.477 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2323995700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f231c05be70 0x7f231c136db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:51.477 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2323995700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c062500 con 0x7f231c05ba30 2024-04-18T10:35:51.477 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2323995700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c062900 con 0x7f231c05be70 2024-04-18T10:35:51.477 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2323995700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c063810 con 0x7f231c062120 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321f32700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f231c05be70 0x7f231c136db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321731700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c062120 0x7f231c0632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321731700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c062120 0x7f231c0632c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56712/0 (socket says 172.21.15.31:56712) 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321731700 1 -- 172.21.15.31:0/1668618984 learned_addr learned my addr 172.21.15.31:0/1668618984 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321f32700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f231c05be70 0x7f231c136db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53292/0 (socket says 172.21.15.31:53292) 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321731700 1 -- 172.21.15.31:0/1668618984 >> v2:172.21.15.31:3300/0 conn(0x7f231c05be70 msgr2=0x7f231c136db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321731700 1 --2- 172.21.15.31:0/1668618984 >> v2:172.21.15.31:3300/0 conn(0x7f231c05be70 0x7f231c136db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321731700 1 -- 172.21.15.31:0/1668618984 >> v1:172.21.15.31:6789/0 conn(0x7f231c05ba30 legacy=0x7f231c1366a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321731700 1 -- 172.21.15.31:0/1668618984 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0aa160 con 0x7f231c062120 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f2321731700 1 --2- 172.21.15.31:0/1668618984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c062120 0x7f231c0632c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f2318002f70 tx=0x7f2318006eb0).ready entity=mon.1 client_cookie=81c8d332c82234c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f230bfff700 1 -- 172.21.15.31:0/1668618984 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f231800d570 con 0x7f231c062120 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f230bfff700 1 -- 172.21.15.31:0/1668618984 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318000e90 con 0x7f231c062120 2024-04-18T10:35:51.478 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.476+0000 7f230bfff700 1 -- 172.21.15.31:0/1668618984 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f231800d900 con 0x7f231c062120 2024-04-18T10:35:51.479 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.477+0000 7f2323995700 1 -- 172.21.15.31:0/1668618984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c062120 msgr2=0x7f231c0632c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:51.479 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.477+0000 7f2323995700 1 --2- 172.21.15.31:0/1668618984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c062120 0x7f231c0632c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f2318002f70 tx=0x7f2318006eb0).stop 2024-04-18T10:35:51.479 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.477+0000 7f2323995700 1 -- 172.21.15.31:0/1668618984 shutdown_connections 2024-04-18T10:35:51.479 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.477+0000 7f2323995700 1 --2- 172.21.15.31:0/1668618984 >> v2:172.21.15.31:3300/0 conn(0x7f231c05be70 0x7f231c136db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:51.479 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.477+0000 7f2323995700 1 --2- 172.21.15.31:0/1668618984 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c062120 0x7f231c0632c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:51.479 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.477+0000 7f2323995700 1 -- 172.21.15.31:0/1668618984 >> 172.21.15.31:0/1668618984 conn(0x7f231c06c0c0 msgr2=0x7f231c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:51.479 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.477+0000 7f2323995700 1 -- 172.21.15.31:0/1668618984 shutdown_connections 2024-04-18T10:35:51.479 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.477+0000 7f2323995700 1 -- 172.21.15.31:0/1668618984 wait complete. 2024-04-18T10:35:51.481 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.478+0000 7f2323995700 1 Processor -- start 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.478+0000 7f2323995700 1 -- start start 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.478+0000 7f2323995700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f231c05ba30 0x7f231c0977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.478+0000 7f2323995700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c05be70 0x7f231c145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.478+0000 7f2323995700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f231c062120 0x7f231c1490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.478+0000 7f2323995700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c1466b0 con 0x7f231c05ba30 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.478+0000 7f2323995700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c146970 con 0x7f231c05be70 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.478+0000 7f2323995700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f231c098310 con 0x7f231c062120 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.478+0000 7f2320f30700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c05be70 0x7f231c145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2321731700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f231c05ba30 0x7f231c0977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2321f32700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f231c062120 0x7f231c1490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2320f30700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c05be70 0x7f231c145ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56724/0 (socket says 172.21.15.31:56724) 2024-04-18T10:35:51.482 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2320f30700 1 -- 172.21.15.31:0/3729817759 learned_addr learned my addr 172.21.15.31:0/3729817759 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2321f32700 1 -- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f231c062120 msgr2=0x7f231c1490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2321f32700 1 -- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f231c062120 msgr2=0x7f231c1490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2321f32700 1 --2- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f231c062120 0x7f231c1490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2321f32700 1 --2- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f231c062120 0x7f231c1490c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2320f30700 1 -- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f231c062120 msgr2=0x7f231c1490c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2320f30700 1 --2- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f231c062120 0x7f231c1490c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2320f30700 1 -- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f231c05ba30 msgr2=0x7f231c0977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2320f30700 1 --2- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f231c05ba30 0x7f231c0977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2320f30700 1 -- 172.21.15.31:0/3729817759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231800b1e0 con 0x7f231c05be70 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2320f30700 1 --2- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c05be70 0x7f231c145ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f231c05c4f0 tx=0x7f230c007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f230a7fc700 1 -- 172.21.15.31:0/3729817759 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230c012400 con 0x7f231c05be70 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f230a7fc700 1 -- 172.21.15.31:0/3729817759 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c012560 con 0x7f231c05be70 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2323995700 1 -- 172.21.15.31:0/3729817759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c09cdb0 con 0x7f231c05be70 2024-04-18T10:35:51.483 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f230a7fc700 1 -- 172.21.15.31:0/3729817759 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230c0128c0 con 0x7f231c05be70 2024-04-18T10:35:51.484 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.479+0000 7f2323995700 1 -- 172.21.15.31:0/3729817759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c093f20 con 0x7f231c05be70 2024-04-18T10:35:51.484 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.480+0000 7f230a7fc700 1 -- 172.21.15.31:0/3729817759 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 2) v1 ==== 20942+0+0 (secure 0 0 0) 0x7f230c019030 con 0x7f231c05be70 2024-04-18T10:35:51.484 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.480+0000 7f230a7fc700 1 -- 172.21.15.31:0/3729817759 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f230c029130 con 0x7f231c05be70 2024-04-18T10:35:51.484 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.480+0000 7f2323995700 1 -- 172.21.15.31:0/3729817759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c06b210 con 0x7f231c05be70 2024-04-18T10:35:51.484 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.482+0000 7f230a7fc700 1 -- 172.21.15.31:0/3729817759 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f230c019b20 con 0x7f231c05be70 2024-04-18T10:35:51.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.545+0000 7f2323995700 1 -- 172.21.15.31:0/3729817759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f231c097d40 con 0x7f231c05be70 2024-04-18T10:35:51.545 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.545+0000 7f230a7fc700 1 -- 172.21.15.31:0/3729817759 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7f230c019730 con 0x7f231c05be70 2024-04-18T10:35:51.546 INFO:teuthology.misc.health.smithi031.stdout: 2024-04-18T10:35:51.546 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":6,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:35:50.701218+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:35:51.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.546+0000 7f2323995700 1 -- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c05be70 msgr2=0x7f231c145ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:51.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.546+0000 7f2323995700 1 --2- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c05be70 0x7f231c145ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f231c05c4f0 tx=0x7f230c007c20).stop 2024-04-18T10:35:51.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.546+0000 7f2323995700 1 -- 172.21.15.31:0/3729817759 shutdown_connections 2024-04-18T10:35:51.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.546+0000 7f2323995700 1 --2- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f231c062120 0x7f231c1490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:51.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.546+0000 7f2323995700 1 --2- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f231c05ba30 0x7f231c0977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:51.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.546+0000 7f2323995700 1 --2- 172.21.15.31:0/3729817759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f231c05be70 0x7f231c145ce0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:51.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.546+0000 7f2323995700 1 -- 172.21.15.31:0/3729817759 >> 172.21.15.31:0/3729817759 conn(0x7f231c06c0c0 msgr2=0x7f231c0a7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:51.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.546+0000 7f2323995700 1 -- 172.21.15.31:0/3729817759 shutdown_connections 2024-04-18T10:35:51.547 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:51.546+0000 7f2323995700 1 -- 172.21.15.31:0/3729817759 wait complete. 2024-04-18T10:35:51.555 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-18T10:35:52.445 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:35:52.445+0000 7f02cc607f00 -1 osd.1 0 log_to_monitors {default=true} 2024-04-18T10:35:52.446 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:35:52.446+0000 7fd198f4bf00 -1 osd.0 0 log_to_monitors {default=true} 2024-04-18T10:35:52.459 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:35:52.460+0000 7f51fec7df00 -1 osd.3 0 log_to_monitors {default=true} 2024-04-18T10:35:52.472 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:35:52.472+0000 7f855a68af00 -1 osd.2 0 log_to_monitors {default=true} 2024-04-18T10:35:54.402 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:35:54.402+0000 7f8542b55700 -1 osd.2 0 waiting for initial osdmap 2024-04-18T10:35:54.403 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:35:54.402+0000 7f02b4ad2700 -1 osd.1 0 waiting for initial osdmap 2024-04-18T10:35:54.403 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:35:54.403+0000 7fd181416700 -1 osd.0 0 waiting for initial osdmap 2024-04-18T10:35:54.412 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:35:54.411+0000 7f51e7148700 -1 osd.3 0 waiting for initial osdmap 2024-04-18T10:35:54.412 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:35:54.412+0000 7fd18ce33700 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T10:35:54.412 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:35:54.412+0000 7f02c04ef700 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T10:35:54.413 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:35:54.413+0000 7f854e572700 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T10:35:54.415 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:35:54.415+0000 7f51f2b65700 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T10:35:57.959 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-18T10:35:58.069 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.069+0000 7ff38e6f2700 1 Processor -- start 2024-04-18T10:35:58.069 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.069+0000 7ff38e6f2700 1 -- start start 2024-04-18T10:35:58.072 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff38e6f2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388136770 0x7ff388136b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.072 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff38e6f2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff38809c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.072 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff38e6f2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38809c250 con 0x7ff388061420 2024-04-18T10:35:58.072 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff38e6f2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff388135f30 con 0x7ff388136770 2024-04-18T10:35:58.072 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff38e6f2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff38806cb50 con 0x7ff38809ad30 2024-04-18T10:35:58.072 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff38809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.072 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff38cc8f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff388061420 0x7ff388067470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50216/0 (socket says 172.21.15.31:50216) 2024-04-18T10:35:58.072 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff387fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388136770 0x7ff388136b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff38cc8f700 1 -- 172.21.15.31:0/2923781795 learned_addr learned my addr 172.21.15.31:0/2923781795 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff386ffd700 1 -- 172.21.15.31:0/2923781795 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355687806 0 0) 0x7ff38809c250 con 0x7ff388061420 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff386ffd700 1 -- 172.21.15.31:0/2923781795 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff368003260 con 0x7ff388061420 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff387fff700 1 -- 172.21.15.31:0/2923781795 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 msgr2=0x7ff38809c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff387fff700 1 --2- 172.21.15.31:0/2923781795 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff38809c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff387fff700 1 -- 172.21.15.31:0/2923781795 >> v1:172.21.15.31:6789/0 conn(0x7ff388061420 legacy=0x7ff388067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff387fff700 1 -- 172.21.15.31:0/2923781795 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38806cd10 con 0x7ff388136770 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff3877fe700 1 --2- 172.21.15.31:0/2923781795 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff38809c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff387fff700 1 --2- 172.21.15.31:0/2923781795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388136770 0x7ff388136b50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff378002f70 tx=0x7ff378006df0).ready entity=mon.1 client_cookie=c76a6b4d19aec84c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff386ffd700 1 -- 172.21.15.31:0/2923781795 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff37800d570 con 0x7ff388136770 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.070+0000 7ff386ffd700 1 -- 172.21.15.31:0/2923781795 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378000e90 con 0x7ff388136770 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.071+0000 7ff386ffd700 1 -- 172.21.15.31:0/2923781795 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff37800d8c0 con 0x7ff388136770 2024-04-18T10:35:58.073 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.071+0000 7ff38e6f2700 1 -- 172.21.15.31:0/2923781795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388136770 msgr2=0x7ff388136b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:58.074 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.071+0000 7ff38e6f2700 1 --2- 172.21.15.31:0/2923781795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388136770 0x7ff388136b50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff378002f70 tx=0x7ff378006df0).stop 2024-04-18T10:35:58.074 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.071+0000 7ff38e6f2700 1 -- 172.21.15.31:0/2923781795 shutdown_connections 2024-04-18T10:35:58.074 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.071+0000 7ff38e6f2700 1 --2- 172.21.15.31:0/2923781795 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388136770 0x7ff388136b50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.074 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.071+0000 7ff38e6f2700 1 --2- 172.21.15.31:0/2923781795 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff38809c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.074 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.071+0000 7ff38e6f2700 1 -- 172.21.15.31:0/2923781795 >> 172.21.15.31:0/2923781795 conn(0x7ff3880623b0 msgr2=0x7ff38806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:58.074 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.071+0000 7ff38e6f2700 1 -- 172.21.15.31:0/2923781795 shutdown_connections 2024-04-18T10:35:58.074 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.071+0000 7ff38e6f2700 1 -- 172.21.15.31:0/2923781795 wait complete. 2024-04-18T10:35:58.074 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.072+0000 7ff38e6f2700 1 Processor -- start 2024-04-18T10:35:58.074 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.072+0000 7ff38e6f2700 1 -- start start 2024-04-18T10:35:58.077 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff38e6f2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388061420 0x7ff388145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff38e6f2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff388149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff38e6f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff388136770 0x7ff388149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff38e6f2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388148e90 con 0x7ff388136770 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff38e6f2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880968e0 con 0x7ff388061420 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff38e6f2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff388145b00 con 0x7ff38809ad30 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff387fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388061420 0x7ff388145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff38cc8f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff388136770 0x7ff388149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff387fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388061420 0x7ff388145f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38320/0 (socket says 172.21.15.31:38320) 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff387fff700 1 -- 172.21.15.31:0/3662137491 learned_addr learned my addr 172.21.15.31:0/3662137491 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff38cc8f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff388136770 0x7ff388149570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38234/0 (socket says 172.21.15.31:38234) 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff3877fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff388149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff387fff700 1 -- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 msgr2=0x7ff388149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:58.078 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff387fff700 1 --2- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff388149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff387fff700 1 -- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff388136770 msgr2=0x7ff388149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff387fff700 1 --2- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff388136770 0x7ff388149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff387fff700 1 -- 172.21.15.31:0/3662137491 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37000b180 con 0x7ff388061420 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff38cc8f700 1 --2- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff388136770 0x7ff388149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff3877fe700 1 --2- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff388149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.073+0000 7ff387fff700 1 --2- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388061420 0x7ff388145f90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff378002f70 tx=0x7ff378014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.074+0000 7ff3857fa700 1 -- 172.21.15.31:0/3662137491 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff37800dea0 con 0x7ff388061420 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.074+0000 7ff3857fa700 1 -- 172.21.15.31:0/3662137491 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378013de0 con 0x7ff388061420 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.074+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37800b180 con 0x7ff388061420 2024-04-18T10:35:58.079 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.074+0000 7ff3857fa700 1 -- 172.21.15.31:0/3662137491 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff37801e5f0 con 0x7ff388061420 2024-04-18T10:35:58.080 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.074+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff388094910 con 0x7ff388061420 2024-04-18T10:35:58.080 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.075+0000 7ff3857fa700 1 -- 172.21.15.31:0/3662137491 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff378025030 con 0x7ff388061420 2024-04-18T10:35:58.080 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.075+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff388097540 con 0x7ff388061420 2024-04-18T10:35:58.080 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.075+0000 7ff3857fa700 1 -- 172.21.15.31:0/3662137491 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2469+0+0 (secure 0 0 0) 0x7ff37804b0f0 con 0x7ff388061420 2024-04-18T10:35:58.080 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.078+0000 7ff3857fa700 1 -- 172.21.15.31:0/3662137491 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff378028440 con 0x7ff388061420 2024-04-18T10:35:58.196 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.196+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff388057a60 con 0x7ff388061420 2024-04-18T10:35:58.197 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.197+0000 7ff3857fa700 1 -- 172.21.15.31:0/3662137491 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6242 (secure 0 0 0) 0x7ff378023020 con 0x7ff388061420 2024-04-18T10:35:58.197 INFO:teuthology.misc.health.smithi031.stdout: 2024-04-18T10:35:58.197 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":12,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:35:57.420716+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:35:58.198 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 >> v1:172.21.15.31:6816/39551 conn(0x7ff36c038da0 legacy=0x7ff36c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:58.198 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388061420 msgr2=0x7ff388145f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:58.198 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 --2- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388061420 0x7ff388145f90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff378002f70 tx=0x7ff378014000).stop 2024-04-18T10:35:58.199 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 shutdown_connections 2024-04-18T10:35:58.199 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 --2- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff388136770 0x7ff388149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.199 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 --2- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff388061420 0x7ff388145f90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.199 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 --2- 172.21.15.31:0/3662137491 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff38809ad30 0x7ff388149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.199 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 >> 172.21.15.31:0/3662137491 conn(0x7ff3880623b0 msgr2=0x7ff3881357e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:58.199 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 shutdown_connections 2024-04-18T10:35:58.199 INFO:teuthology.misc.health.smithi031.stderr:2024-04-18T10:35:58.198+0000 7ff38e6f2700 1 -- 172.21.15.31:0/3662137491 wait complete. 2024-04-18T10:35:58.208 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-18T10:35:58.208 INFO:tasks.ceph:Creating RBD pool 2024-04-18T10:35:58.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-18T10:35:58.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.314+0000 7fd1a53df700 1 Processor -- start 2024-04-18T10:35:58.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.314+0000 7fd1a53df700 1 -- start start 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.314+0000 7fd1a53df700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a0133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.314+0000 7fd1a53df700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1a0062fb0 0x7fd1a0063680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.314+0000 7fd1a53df700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a01365f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.314+0000 7fd1a53df700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a0065150 con 0x7fd1a0062fb0 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.314+0000 7fd1a53df700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0130bd0 con 0x7fd1a0064600 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.314+0000 7fd1a53df700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0063b70 con 0x7fd1a00a92a0 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a0133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a01365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a0133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38322/0 (socket says 172.21.15.31:38322) 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1a0062fb0 0x7fd1a0063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19effd700 1 -- 172.21.15.31:0/1914371814 learned_addr learned my addr 172.21.15.31:0/1914371814 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19effd700 1 -- 172.21.15.31:0/1914371814 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 msgr2=0x7fd1a01365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19effd700 1 --2- 172.21.15.31:0/1914371814 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a01365f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19effd700 1 -- 172.21.15.31:0/1914371814 >> v2:172.21.15.31:3300/0 conn(0x7fd1a0062fb0 msgr2=0x7fd1a0063680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19effd700 1 --2- 172.21.15.31:0/1914371814 >> v2:172.21.15.31:3300/0 conn(0x7fd1a0062fb0 0x7fd1a0063680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19effd700 1 -- 172.21.15.31:0/1914371814 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a0061ee0 con 0x7fd1a0064600 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19f7fe700 1 --2- 172.21.15.31:0/1914371814 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a01365f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19e7fc700 1 --2- 172.21.15.31:0/1914371814 >> v2:172.21.15.31:3300/0 conn(0x7fd1a0062fb0 0x7fd1a0063680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19effd700 1 --2- 172.21.15.31:0/1914371814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a0133110 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd1a00a9c50 tx=0x7fd190006eb0).ready entity=mon.1 client_cookie=561452e8484e4f9a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19dffb700 1 -- 172.21.15.31:0/1914371814 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd19000d570 con 0x7fd1a0064600 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19dffb700 1 -- 172.21.15.31:0/1914371814 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190000e90 con 0x7fd1a0064600 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.315+0000 7fd19dffb700 1 -- 172.21.15.31:0/1914371814 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd19000d900 con 0x7fd1a0064600 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.316+0000 7fd1a53df700 1 -- 172.21.15.31:0/1914371814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 msgr2=0x7fd1a0133110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.316+0000 7fd1a53df700 1 --2- 172.21.15.31:0/1914371814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a0133110 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd1a00a9c50 tx=0x7fd190006eb0).stop 2024-04-18T10:35:58.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.316+0000 7fd1a53df700 1 -- 172.21.15.31:0/1914371814 shutdown_connections 2024-04-18T10:35:58.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.316+0000 7fd1a53df700 1 --2- 172.21.15.31:0/1914371814 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a01365f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.316+0000 7fd1a53df700 1 --2- 172.21.15.31:0/1914371814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a0133110 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.316+0000 7fd1a53df700 1 --2- 172.21.15.31:0/1914371814 >> v2:172.21.15.31:3300/0 conn(0x7fd1a0062fb0 0x7fd1a0063680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.316+0000 7fd1a53df700 1 -- 172.21.15.31:0/1914371814 >> 172.21.15.31:0/1914371814 conn(0x7fd1a006c0c0 msgr2=0x7fd1a006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:58.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.316+0000 7fd1a53df700 1 -- 172.21.15.31:0/1914371814 shutdown_connections 2024-04-18T10:35:58.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.316+0000 7fd1a53df700 1 -- 172.21.15.31:0/1914371814 wait complete. 2024-04-18T10:35:58.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd1a53df700 1 Processor -- start 2024-04-18T10:35:58.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd1a53df700 1 -- start start 2024-04-18T10:35:58.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd1a53df700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a01381d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd1a53df700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a0067370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd1a53df700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a00a8730 0x7fd1a005ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:58.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd1a53df700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0097c00 con 0x7fd1a00a8730 2024-04-18T10:35:58.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd1a53df700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0097330 con 0x7fd1a0064600 2024-04-18T10:35:58.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd1a53df700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a00975f0 con 0x7fd1a00a92a0 2024-04-18T10:35:58.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd19e7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a0067370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd19f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a00a8730 0x7fd1a005ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd19effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a01381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd19e7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a0067370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34452/0 (socket says 172.21.15.31:34452) 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.317+0000 7fd19e7fc700 1 -- 172.21.15.31:0/1741638148 learned_addr learned my addr 172.21.15.31:0/1741638148 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd19e7fc700 1 -- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 msgr2=0x7fd1a01381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd19e7fc700 1 --2- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a01381d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd19e7fc700 1 -- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a00a8730 msgr2=0x7fd1a005ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd19e7fc700 1 --2- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a00a8730 0x7fd1a005ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd19e7fc700 1 -- 172.21.15.31:0/1741638148 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18800b180 con 0x7fd1a00a92a0 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd19e7fc700 1 --2- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a0067370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd18800c000 tx=0x7fd188006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd197fff700 1 -- 172.21.15.31:0/1741638148 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd188010780 con 0x7fd1a00a92a0 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd197fff700 1 -- 172.21.15.31:0/1741638148 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1880108e0 con 0x7fd1a00a92a0 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd197fff700 1 -- 172.21.15.31:0/1741638148 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd188010c40 con 0x7fd1a00a92a0 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd198009470 con 0x7fd1a00a92a0 2024-04-18T10:35:58.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.318+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19000b1e0 con 0x7fd1a00a92a0 2024-04-18T10:35:58.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.319+0000 7fd197fff700 1 -- 172.21.15.31:0/1741638148 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd18801c460 con 0x7fd1a00a92a0 2024-04-18T10:35:58.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.319+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a0137ef0 con 0x7fd1a00a92a0 2024-04-18T10:35:58.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.319+0000 7fd197fff700 1 -- 172.21.15.31:0/1741638148 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2469+0+0 (secure 0 0 0) 0x7fd18804a9d0 con 0x7fd1a00a92a0 2024-04-18T10:35:58.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.323+0000 7fd197fff700 1 -- 172.21.15.31:0/1741638148 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd1a0137ef0 con 0x7fd1a00a92a0 2024-04-18T10:35:58.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:58.442+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd1a0137ef0 con 0x7fd1a00a92a0 2024-04-18T10:35:59.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.515+0000 7fd197fff700 1 -- 172.21.15.31:0/1741638148 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd1a0137ef0 con 0x7fd1a00a92a0 2024-04-18T10:35:59.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 >> v1:172.21.15.31:6816/39551 conn(0x7fd184038e30 legacy=0x7fd18403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:59.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 msgr2=0x7fd1a0067370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:59.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 --2- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a0067370 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd18800c000 tx=0x7fd188006df0).stop 2024-04-18T10:35:59.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 shutdown_connections 2024-04-18T10:35:59.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 --2- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1a00a8730 0x7fd1a005ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:59.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 --2- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1a0064600 0x7fd1a01381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:59.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 --2- 172.21.15.31:0/1741638148 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1a00a92a0 0x7fd1a0067370 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:59.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 >> 172.21.15.31:0/1741638148 conn(0x7fd1a006c0c0 msgr2=0x7fd1a0135780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:59.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 shutdown_connections 2024-04-18T10:35:59.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.518+0000 7fd1a53df700 1 -- 172.21.15.31:0/1741638148 wait complete. 2024-04-18T10:35:59.519 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'rbd' created 2024-04-18T10:35:59.531 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-18T10:35:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.645+0000 7f3a6f7d8700 1 Processor -- start 2024-04-18T10:35:59.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.645+0000 7f3a6f7d8700 1 -- start start 2024-04-18T10:35:59.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6f7d8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a68136f40 0x7f3a6813b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6f7d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a6813bd20 0x7f3a6813e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6f7d8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a68068220 con 0x7f3a68136b60 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6f7d8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a680a1be0 con 0x7f3a68136f40 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6f7d8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680a2e30 con 0x7f3a6813bd20 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6dd75700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a6813bd20 0x7f3a6813e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6cd73700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a68136f40 0x7f3a6813b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6cd73700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a68136f40 0x7f3a6813b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38262/0 (socket says 172.21.15.31:38262) 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6dd75700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a6813bd20 0x7f3a6813e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34470/0 (socket says 172.21.15.31:34470) 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6cd73700 1 -- 172.21.15.31:0/3741076051 learned_addr learned my addr 172.21.15.31:0/3741076051 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6d574700 1 --1- 172.21.15.31:0/3741076051 >> v1:172.21.15.31:6789/0 conn(0x7f3a68136b60 0x7f3a680a14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50224/0 (socket says 172.21.15.31:50224) 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6cd73700 1 -- 172.21.15.31:0/3741076051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a6813bd20 msgr2=0x7f3a6813e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6cd73700 1 --2- 172.21.15.31:0/3741076051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a6813bd20 0x7f3a6813e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:59.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6cd73700 1 -- 172.21.15.31:0/3741076051 >> v1:172.21.15.31:6789/0 conn(0x7f3a68136b60 legacy=0x7f3a680a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6cd73700 1 -- 172.21.15.31:0/3741076051 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680a1060 con 0x7f3a68136f40 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a57fff700 1 -- 172.21.15.31:0/3741076051 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229286169 0 0) 0x7f3a68068220 con 0x7f3a68136b60 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6dd75700 1 --2- 172.21.15.31:0/3741076051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a6813bd20 0x7f3a6813e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.646+0000 7f3a6cd73700 1 --2- 172.21.15.31:0/3741076051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 0x7f3a6813b830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3a64002f70 tx=0x7f3a64006eb0).ready entity=mon.0 client_cookie=dc8ef9ea6b3ab003 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a57fff700 1 -- 172.21.15.31:0/3741076051 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6400d570 con 0x7f3a68136f40 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a57fff700 1 -- 172.21.15.31:0/3741076051 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64000e90 con 0x7f3a68136f40 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a57fff700 1 -- 172.21.15.31:0/3741076051 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6400d8c0 con 0x7f3a68136f40 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/3741076051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 msgr2=0x7f3a6813b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a6f7d8700 1 --2- 172.21.15.31:0/3741076051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 0x7f3a6813b830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3a64002f70 tx=0x7f3a64006eb0).stop 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/3741076051 shutdown_connections 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a6f7d8700 1 --2- 172.21.15.31:0/3741076051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a6813bd20 0x7f3a6813e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a6f7d8700 1 --2- 172.21.15.31:0/3741076051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 0x7f3a6813b830 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/3741076051 >> 172.21.15.31:0/3741076051 conn(0x7f3a680a9450 msgr2=0x7f3a680a5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:35:59.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/3741076051 shutdown_connections 2024-04-18T10:35:59.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.647+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/3741076051 wait complete. 2024-04-18T10:35:59.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.648+0000 7f3a6f7d8700 1 Processor -- start 2024-04-18T10:35:59.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.648+0000 7f3a6f7d8700 1 -- start start 2024-04-18T10:35:59.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6f7d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a68136b60 0x7f3a68064930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:59.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6f7d8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 0x7f3a68144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:59.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6f7d8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a6813bd20 0x7f3a6813a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:35:59.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6f7d8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68064f70 con 0x7f3a68136f40 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6f7d8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a68064230 con 0x7f3a6813bd20 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6f7d8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a681454a0 con 0x7f3a68136b60 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6d574700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a68136b60 0x7f3a68064930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6d574700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a68136b60 0x7f3a68064930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34478/0 (socket says 172.21.15.31:34478) 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6d574700 1 -- 172.21.15.31:0/726591709 learned_addr learned my addr 172.21.15.31:0/726591709 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6cd73700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 0x7f3a68144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.649+0000 7f3a6dd75700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a6813bd20 0x7f3a6813a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a6cd73700 1 -- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a68136b60 msgr2=0x7f3a68064930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a6cd73700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a68136b60 0x7f3a68064930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a6cd73700 1 -- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a6813bd20 msgr2=0x7f3a6813a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a6cd73700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a6813bd20 0x7f3a6813a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a6cd73700 1 -- 172.21.15.31:0/726591709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60009470 con 0x7f3a68136f40 2024-04-18T10:35:59.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a6d574700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a68136b60 0x7f3a68064930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:35:59.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a6cd73700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 0x7f3a68144ad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3a680650e0 tx=0x7f3a64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:35:59.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a567fc700 1 -- 172.21.15.31:0/726591709 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a640117e0 con 0x7f3a68136f40 2024-04-18T10:35:59.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a567fc700 1 -- 172.21.15.31:0/726591709 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a64011940 con 0x7f3a68136f40 2024-04-18T10:35:59.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6400b1e0 con 0x7f3a68136f40 2024-04-18T10:35:59.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a567fc700 1 -- 172.21.15.31:0/726591709 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a64011ca0 con 0x7f3a68136f40 2024-04-18T10:35:59.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.650+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6813b850 con 0x7f3a68136f40 2024-04-18T10:35:59.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.651+0000 7f3a567fc700 1 -- 172.21.15.31:0/726591709 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3a64025030 con 0x7f3a68136f40 2024-04-18T10:35:59.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.651+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a68065120 con 0x7f3a68136f40 2024-04-18T10:35:59.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.651+0000 7f3a567fc700 1 -- 172.21.15.31:0/726591709 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2811+0+0 (secure 0 0 0) 0x7f3a6404b780 con 0x7f3a68136f40 2024-04-18T10:35:59.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.654+0000 7f3a567fc700 1 -- 172.21.15.31:0/726591709 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3a68065120 con 0x7f3a68136f40 2024-04-18T10:35:59.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:35:59.771+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3a68065120 con 0x7f3a68136f40 2024-04-18T10:36:00.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.522+0000 7f3a567fc700 1 -- 172.21.15.31:0/726591709 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3a68065120 con 0x7f3a68136f40 2024-04-18T10:36:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.525+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 >> v1:172.21.15.31:6816/39551 conn(0x7f3a48038da0 legacy=0x7f3a4803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.525+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 msgr2=0x7f3a68144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.525+0000 7f3a6f7d8700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 0x7f3a68144ad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3a680650e0 tx=0x7f3a64015000).stop 2024-04-18T10:36:00.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.526+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 shutdown_connections 2024-04-18T10:36:00.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.526+0000 7f3a6f7d8700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3a68136b60 0x7f3a68064930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.526+0000 7f3a6f7d8700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3a6813bd20 0x7f3a6813a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.526+0000 7f3a6f7d8700 1 --2- 172.21.15.31:0/726591709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a68136f40 0x7f3a68144ad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.526+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 >> 172.21.15.31:0/726591709 conn(0x7f3a680a9450 msgr2=0x7f3a680a0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:00.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.526+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 shutdown_connections 2024-04-18T10:36:00.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.526+0000 7f3a6f7d8700 1 -- 172.21.15.31:0/726591709 wait complete. 2024-04-18T10:36:00.529 INFO:teuthology.orchestra.run.smithi031.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-18T10:36:00.541 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-18T10:36:00.541 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-18T10:36:00.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-18T10:36:00.544 INFO:tasks.ceph.mds.a:Started 2024-04-18T10:36:00.544 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-18T10:36:00.544 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-18T10:36:00.546 INFO:tasks.ceph.mds.b:Started 2024-04-18T10:36:00.546 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-18T10:36:00.546 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-18T10:36:00.548 INFO:tasks.ceph.mds.c:Started 2024-04-18T10:36:00.548 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-18T10:36:00.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:00.630 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2024-04-18T10:36:00.630 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-04-18T10:36:00.635 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-04-18T10:36:00.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.674+0000 7f8f12549700 1 Processor -- start 2024-04-18T10:36:00.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.674+0000 7f8f12549700 1 -- start start 2024-04-18T10:36:00.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f12549700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f0c05b970 0x7f8f0c0655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f12549700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 0x7f8f0c0646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f12549700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c134af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f12549700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c1341f0 con 0x7f8f0c05b970 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f12549700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c064bd0 con 0x7f8f0c064260 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f12549700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1343e0 con 0x7f8f0c134660 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f10ae6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f10ae6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c134af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34504/0 (socket says 172.21.15.31:34504) 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f0bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f0c05b970 0x7f8f0c0655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f10ae6700 1 -- 172.21.15.31:0/1999389561 learned_addr learned my addr 172.21.15.31:0/1999389561 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f0b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 0x7f8f0c0646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.675+0000 7f8f10ae6700 1 -- 172.21.15.31:0/1999389561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 msgr2=0x7f8f0c0646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f10ae6700 1 --2- 172.21.15.31:0/1999389561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 0x7f8f0c0646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f10ae6700 1 -- 172.21.15.31:0/1999389561 >> v2:172.21.15.31:3300/0 conn(0x7f8f0c05b970 msgr2=0x7f8f0c0655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f10ae6700 1 --2- 172.21.15.31:0/1999389561 >> v2:172.21.15.31:3300/0 conn(0x7f8f0c05b970 0x7f8f0c0655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f10ae6700 1 -- 172.21.15.31:0/1999389561 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c064e50 con 0x7f8f0c134660 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f0bfff700 1 --2- 172.21.15.31:0/1999389561 >> v2:172.21.15.31:3300/0 conn(0x7f8f0c05b970 0x7f8f0c0655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f10ae6700 1 --2- 172.21.15.31:0/1999389561 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c134af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f8f040032f0 tx=0x7f8f04009290).ready entity=mon.2 client_cookie=51a06c9daff5585a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f0affd700 1 -- 172.21.15.31:0/1999389561 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0400b660 con 0x7f8f0c134660 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f0affd700 1 -- 172.21.15.31:0/1999389561 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0400b7c0 con 0x7f8f0c134660 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f0affd700 1 -- 172.21.15.31:0/1999389561 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0400b930 con 0x7f8f0c134660 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f12549700 1 -- 172.21.15.31:0/1999389561 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 msgr2=0x7f8f0c134af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f12549700 1 --2- 172.21.15.31:0/1999389561 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c134af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f8f040032f0 tx=0x7f8f04009290).stop 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f12549700 1 -- 172.21.15.31:0/1999389561 shutdown_connections 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f12549700 1 --2- 172.21.15.31:0/1999389561 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c134af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f12549700 1 --2- 172.21.15.31:0/1999389561 >> v2:172.21.15.31:3300/0 conn(0x7f8f0c05b970 0x7f8f0c0655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f12549700 1 --2- 172.21.15.31:0/1999389561 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 0x7f8f0c0646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f12549700 1 -- 172.21.15.31:0/1999389561 >> 172.21.15.31:0/1999389561 conn(0x7f8f0c06c0c0 msgr2=0x7f8f0c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:00.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f12549700 1 -- 172.21.15.31:0/1999389561 shutdown_connections 2024-04-18T10:36:00.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.676+0000 7f8f12549700 1 -- 172.21.15.31:0/1999389561 wait complete. 2024-04-18T10:36:00.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.677+0000 7f8f12549700 1 Processor -- start 2024-04-18T10:36:00.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.677+0000 7f8f12549700 1 -- start start 2024-04-18T10:36:00.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f12549700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c05b970 0x7f8f0c0924f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f12549700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 0x7f8f0c092b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f12549700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f12549700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c136ac0 con 0x7f8f0c05b970 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f12549700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1415b0 con 0x7f8f0c064260 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f12549700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c1371d0 con 0x7f8f0c134660 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f10ae6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f0bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c05b970 0x7f8f0c0924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f10ae6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c141870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34512/0 (socket says 172.21.15.31:34512) 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f10ae6700 1 -- 172.21.15.31:0/356428763 learned_addr learned my addr 172.21.15.31:0/356428763 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f0bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c05b970 0x7f8f0c0924f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38308/0 (socket says 172.21.15.31:38308) 2024-04-18T10:36:00.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f0b7fe700 1 --2- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 0x7f8f0c092b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f10ae6700 1 -- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 msgr2=0x7f8f0c092b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f10ae6700 1 --2- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 0x7f8f0c092b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f10ae6700 1 -- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c05b970 msgr2=0x7f8f0c0924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f10ae6700 1 --2- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c05b970 0x7f8f0c0924f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f10ae6700 1 -- 172.21.15.31:0/356428763 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc00d590 con 0x7f8f0c134660 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.678+0000 7f8f0bfff700 1 --2- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c05b970 0x7f8f0c0924f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.679+0000 7f8f10ae6700 1 --2- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c141870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8f040032f0 tx=0x7f8f04016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.679+0000 7f8f097fa700 1 -- 172.21.15.31:0/356428763 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0400b660 con 0x7f8f0c134660 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.679+0000 7f8f097fa700 1 -- 172.21.15.31:0/356428763 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04021670 con 0x7f8f0c134660 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.679+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f04009530 con 0x7f8f0c134660 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.679+0000 7f8f097fa700 1 -- 172.21.15.31:0/356428763 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f040219d0 con 0x7f8f0c134660 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.679+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c094310 con 0x7f8f0c134660 2024-04-18T10:36:00.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.680+0000 7f8f097fa700 1 -- 172.21.15.31:0/356428763 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8f0400f070 con 0x7f8f0c134660 2024-04-18T10:36:00.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.680+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c057a60 con 0x7f8f0c134660 2024-04-18T10:36:00.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.680+0000 7f8f097fa700 1 -- 172.21.15.31:0/356428763 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f8f0404b6d0 con 0x7f8f0c134660 2024-04-18T10:36:00.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.683+0000 7f8f097fa700 1 -- 172.21.15.31:0/356428763 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8f040236c0 con 0x7f8f0c134660 2024-04-18T10:36:00.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.800+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f0c066020 con 0x7f8f0c134660 2024-04-18T10:36:00.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.801+0000 7f8f097fa700 1 -- 172.21.15.31:0/356428763 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7626 (secure 0 0 0) 0x7f8f04048090 con 0x7f8f0c134660 2024-04-18T10:36:00.801 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:00.801 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":14,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:00.510828+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:00.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 >> v1:172.21.15.31:6816/39551 conn(0x7f8eec038da0 legacy=0x7f8eec03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 msgr2=0x7f8f0c141870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 --2- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c141870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f8f040032f0 tx=0x7f8f04016000).stop 2024-04-18T10:36:00.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 shutdown_connections 2024-04-18T10:36:00.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 --2- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8f0c134660 0x7f8f0c141870 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 --2- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f0c05b970 0x7f8f0c0924f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 --2- 172.21.15.31:0/356428763 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8f0c064260 0x7f8f0c092b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 >> 172.21.15.31:0/356428763 conn(0x7f8f0c06c0c0 msgr2=0x7f8f0c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:00.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 shutdown_connections 2024-04-18T10:36:00.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.802+0000 7f8f12549700 1 -- 172.21.15.31:0/356428763 wait complete. 2024-04-18T10:36:00.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-18T10:36:00.813 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-18T10:36:00.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.922+0000 7f8d4cc49700 1 Processor -- start 2024-04-18T10:36:00.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.922+0000 7f8d4cc49700 1 -- start start 2024-04-18T10:36:00.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.922+0000 7f8d4cc49700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d4805bb30 0x7f8d48063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.922+0000 7f8d4cc49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.922+0000 7f8d4cc49700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d48062b80 con 0x7f8d48062400 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.922+0000 7f8d4cc49700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48062e60 con 0x7f8d4805bb30 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.922+0000 7f8d4cc49700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48139a40 con 0x7f8d48061fe0 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d45d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d4659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d4805bb30 0x7f8d48063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d46d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8d48062400 0x7f8d480a8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50280/0 (socket says 172.21.15.31:50280) 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d46d9d700 1 -- 172.21.15.31:0/1475197075 learned_addr learned my addr 172.21.15.31:0/1475197075 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d45d9b700 1 -- 172.21.15.31:0/1475197075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d4805bb30 msgr2=0x7f8d48063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d45d9b700 1 --2- 172.21.15.31:0/1475197075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d4805bb30 0x7f8d48063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d4559a700 1 -- 172.21.15.31:0/1475197075 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472161454 0 0) 0x7f8d48062b80 con 0x7f8d48062400 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d45d9b700 1 -- 172.21.15.31:0/1475197075 >> v1:172.21.15.31:6789/0 conn(0x7f8d48062400 legacy=0x7f8d480a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d45d9b700 1 -- 172.21.15.31:0/1475197075 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d48139d00 con 0x7f8d48061fe0 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d4659c700 1 --2- 172.21.15.31:0/1475197075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d4805bb30 0x7f8d48063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d45d9b700 1 --2- 172.21.15.31:0/1475197075 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48139fb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f8d3c002f70 tx=0x7f8d3c006df0).ready entity=mon.2 client_cookie=e453674badfb3aaa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d4559a700 1 -- 172.21.15.31:0/1475197075 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d3c00d570 con 0x7f8d48061fe0 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d4559a700 1 -- 172.21.15.31:0/1475197075 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c000e90 con 0x7f8d48061fe0 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.923+0000 7f8d4559a700 1 -- 172.21.15.31:0/1475197075 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d3c00d8c0 con 0x7f8d48061fe0 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.924+0000 7f8d4cc49700 1 -- 172.21.15.31:0/1475197075 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 msgr2=0x7f8d48139fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.924+0000 7f8d4cc49700 1 --2- 172.21.15.31:0/1475197075 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48139fb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f8d3c002f70 tx=0x7f8d3c006df0).stop 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.924+0000 7f8d4cc49700 1 -- 172.21.15.31:0/1475197075 shutdown_connections 2024-04-18T10:36:00.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.924+0000 7f8d4cc49700 1 --2- 172.21.15.31:0/1475197075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d4805bb30 0x7f8d48063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.924+0000 7f8d4cc49700 1 --2- 172.21.15.31:0/1475197075 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48139fb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.924+0000 7f8d4cc49700 1 -- 172.21.15.31:0/1475197075 >> 172.21.15.31:0/1475197075 conn(0x7f8d4806c0c0 msgr2=0x7f8d4806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:00.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.924+0000 7f8d4cc49700 1 -- 172.21.15.31:0/1475197075 shutdown_connections 2024-04-18T10:36:00.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.924+0000 7f8d4cc49700 1 -- 172.21.15.31:0/1475197075 wait complete. 2024-04-18T10:36:00.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4cc49700 1 Processor -- start 2024-04-18T10:36:00.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4cc49700 1 -- start start 2024-04-18T10:36:00.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4cc49700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d4805bb30 0x7f8d48095ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4cc49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4cc49700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d48093a60 0x7f8d48149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4cc49700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48093ef0 con 0x7f8d4805bb30 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4cc49700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d480941b0 con 0x7f8d48093a60 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4cc49700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d48131a30 con 0x7f8d48061fe0 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d4805bb30 0x7f8d48095ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d45d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d46d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d48093a60 0x7f8d48149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d4805bb30 0x7f8d48095ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38314/0 (socket says 172.21.15.31:38314) 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d45d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34526/0 (socket says 172.21.15.31:34526) 2024-04-18T10:36:00.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.925+0000 7f8d4659c700 1 -- 172.21.15.31:0/3388881856 learned_addr learned my addr 172.21.15.31:0/3388881856 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d45d9b700 1 -- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d48093a60 msgr2=0x7f8d48149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d45d9b700 1 --2- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d48093a60 0x7f8d48149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d45d9b700 1 -- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d4805bb30 msgr2=0x7f8d48095ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d45d9b700 1 --2- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d4805bb30 0x7f8d48095ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d45d9b700 1 -- 172.21.15.31:0/3388881856 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3800b180 con 0x7f8d48061fe0 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d46d9d700 1 --2- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d48093a60 0x7f8d48149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d45d9b700 1 --2- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48149280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8d3c002f70 tx=0x7f8d3c014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d377fe700 1 -- 172.21.15.31:0/3388881856 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d3c013de0 con 0x7f8d48061fe0 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d377fe700 1 -- 172.21.15.31:0/3388881856 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c01e400 con 0x7f8d48061fe0 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c00b180 con 0x7f8d48061fe0 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d377fe700 1 -- 172.21.15.31:0/3388881856 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d3c01e760 con 0x7f8d48061fe0 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.926+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d48138c80 con 0x7f8d48061fe0 2024-04-18T10:36:00.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.927+0000 7f8d377fe700 1 -- 172.21.15.31:0/3388881856 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8d3c025030 con 0x7f8d48061fe0 2024-04-18T10:36:00.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.927+0000 7f8d377fe700 1 -- 172.21.15.31:0/3388881856 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f8d3c04b200 con 0x7f8d48061fe0 2024-04-18T10:36:00.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.927+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4805bf10 con 0x7f8d48061fe0 2024-04-18T10:36:00.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:00.930+0000 7f8d377fe700 1 -- 172.21.15.31:0/3388881856 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8d3c023030 con 0x7f8d48061fe0 2024-04-18T10:36:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.046+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8d48057a60 con 0x7f8d48061fe0 2024-04-18T10:36:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.046+0000 7f8d377fe700 1 -- 172.21.15.31:0/3388881856 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v14) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8d3c019020 con 0x7f8d48061fe0 2024-04-18T10:36:01.047 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.047+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 >> v1:172.21.15.31:6816/39551 conn(0x7f8d24038ec0 legacy=0x7f8d2403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.047+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 msgr2=0x7f8d48149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.047+0000 7f8d4cc49700 1 --2- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48149280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8d3c002f70 tx=0x7f8d3c014000).stop 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.047+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 shutdown_connections 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.047+0000 7f8d4cc49700 1 --2- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8d48093a60 0x7f8d48149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.047+0000 7f8d4cc49700 1 --2- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d4805bb30 0x7f8d48095ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.047+0000 7f8d4cc49700 1 --2- 172.21.15.31:0/3388881856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8d48061fe0 0x7f8d48149280 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.048+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 >> 172.21.15.31:0/3388881856 conn(0x7f8d4806c0c0 msgr2=0x7f8d48135570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.048+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 shutdown_connections 2024-04-18T10:36:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.048+0000 7f8d4cc49700 1 -- 172.21.15.31:0/3388881856 wait complete. 2024-04-18T10:36:01.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:36:01.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.167+0000 7f9f025fc700 1 Processor -- start 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.167+0000 7f9f025fc700 1 -- start start 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9f025fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9f025fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc05b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9f025fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9efc0a4f80 0x7f9efc05be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9f025fc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc0660f0 con 0x7f9efc0a4f80 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9f025fc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0668d0 con 0x7f9efc1365d0 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9f025fc700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0a4590 con 0x7f9efc066d80 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efb7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc05b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38406/0 (socket says 172.21.15.31:38406) 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efb7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc05b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34530/0 (socket says 172.21.15.31:34530) 2024-04-18T10:36:01.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efbfff700 1 -- 172.21.15.31:0/720717252 learned_addr learned my addr 172.21.15.31:0/720717252 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9f00b99700 1 --2- 172.21.15.31:0/720717252 >> v2:172.21.15.31:3300/0 conn(0x7f9efc0a4f80 0x7f9efc05be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efbfff700 1 -- 172.21.15.31:0/720717252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 msgr2=0x7f9efc05b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efbfff700 1 --2- 172.21.15.31:0/720717252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc05b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efbfff700 1 -- 172.21.15.31:0/720717252 >> v2:172.21.15.31:3300/0 conn(0x7f9efc0a4f80 msgr2=0x7f9efc05be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efbfff700 1 --2- 172.21.15.31:0/720717252 >> v2:172.21.15.31:3300/0 conn(0x7f9efc0a4f80 0x7f9efc05be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efbfff700 1 -- 172.21.15.31:0/720717252 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc0a4850 con 0x7f9efc1365d0 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efb7fe700 1 --2- 172.21.15.31:0/720717252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc05b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9f00b99700 1 --2- 172.21.15.31:0/720717252 >> v2:172.21.15.31:3300/0 conn(0x7f9efc0a4f80 0x7f9efc05be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.168+0000 7f9efbfff700 1 --2- 172.21.15.31:0/720717252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1369b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9eec002f70 tx=0x7f9eec006eb0).ready entity=mon.1 client_cookie=f67f68c3737421fe server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9efaffd700 1 -- 172.21.15.31:0/720717252 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eec00d570 con 0x7f9efc1365d0 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9efaffd700 1 -- 172.21.15.31:0/720717252 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec000e90 con 0x7f9efc1365d0 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9efaffd700 1 -- 172.21.15.31:0/720717252 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eec00d900 con 0x7f9efc1365d0 2024-04-18T10:36:01.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9f025fc700 1 -- 172.21.15.31:0/720717252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 msgr2=0x7f9efc1369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9f025fc700 1 --2- 172.21.15.31:0/720717252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1369b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9eec002f70 tx=0x7f9eec006eb0).stop 2024-04-18T10:36:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9f025fc700 1 -- 172.21.15.31:0/720717252 shutdown_connections 2024-04-18T10:36:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9f025fc700 1 --2- 172.21.15.31:0/720717252 >> v2:172.21.15.31:3300/0 conn(0x7f9efc0a4f80 0x7f9efc05be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9f025fc700 1 --2- 172.21.15.31:0/720717252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1369b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9f025fc700 1 --2- 172.21.15.31:0/720717252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc05b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9f025fc700 1 -- 172.21.15.31:0/720717252 >> 172.21.15.31:0/720717252 conn(0x7f9efc060ac0 msgr2=0x7f9efc0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9f025fc700 1 -- 172.21.15.31:0/720717252 shutdown_connections 2024-04-18T10:36:01.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.169+0000 7f9f025fc700 1 -- 172.21.15.31:0/720717252 wait complete. 2024-04-18T10:36:01.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.170+0000 7f9f025fc700 1 Processor -- start 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.170+0000 7f9f025fc700 1 -- start start 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9f025fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc092110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9f025fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9efc0a4f80 0x7f9efc093d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9f025fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9f025fc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc145530 con 0x7f9efc0a4f80 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9f025fc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc093850 con 0x7f9efc1365d0 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9f025fc700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc0a2b50 con 0x7f9efc066d80 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efbfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efbfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc092110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34536/0 (socket says 172.21.15.31:34536) 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9efc0a4f80 0x7f9efc093d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efbfff700 1 -- 172.21.15.31:0/1927942777 learned_addr learned my addr 172.21.15.31:0/1927942777 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:01.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9f00b99700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efbfff700 1 -- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 msgr2=0x7f9efc1459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efbfff700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efbfff700 1 -- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9efc0a4f80 msgr2=0x7f9efc093d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efbfff700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9efc0a4f80 0x7f9efc093d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efbfff700 1 -- 172.21.15.31:0/1927942777 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee400b180 con 0x7f9efc066d80 2024-04-18T10:36:01.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9efb7fe700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9efc0a4f80 0x7f9efc093d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:01.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.171+0000 7f9f00b99700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:01.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.172+0000 7f9efbfff700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc092110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9efc093c30 tx=0x7f9eec015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:01.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.172+0000 7f9ef97fa700 1 -- 172.21.15.31:0/1927942777 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eec00dea0 con 0x7f9efc066d80 2024-04-18T10:36:01.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.172+0000 7f9ef97fa700 1 -- 172.21.15.31:0/1927942777 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec006b40 con 0x7f9efc066d80 2024-04-18T10:36:01.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.172+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef4009470 con 0x7f9efc066d80 2024-04-18T10:36:01.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.172+0000 7f9ef97fa700 1 -- 172.21.15.31:0/1927942777 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eec011e00 con 0x7f9efc066d80 2024-04-18T10:36:01.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.172+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec00b1e0 con 0x7f9efc066d80 2024-04-18T10:36:01.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.172+0000 7f9ef97fa700 1 -- 172.21.15.31:0/1927942777 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9eec025030 con 0x7f9efc066d80 2024-04-18T10:36:01.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.173+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc092f40 con 0x7f9efc066d80 2024-04-18T10:36:01.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.173+0000 7f9ef97fa700 1 -- 172.21.15.31:0/1927942777 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f9eec04b620 con 0x7f9efc066d80 2024-04-18T10:36:01.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.176+0000 7f9ef97fa700 1 -- 172.21.15.31:0/1927942777 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9eec01eb90 con 0x7f9efc066d80 2024-04-18T10:36:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.292+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9efc057a60 con 0x7f9efc066d80 2024-04-18T10:36:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.293+0000 7f9ef97fa700 1 -- 172.21.15.31:0/1927942777 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9eec0080e0 con 0x7f9efc066d80 2024-04-18T10:36:01.293 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:36:01.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 >> v1:172.21.15.31:6816/39551 conn(0x7f9ee0038da0 legacy=0x7f9ee003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 msgr2=0x7f9efc092110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc092110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9efc093c30 tx=0x7f9eec015000).stop 2024-04-18T10:36:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 shutdown_connections 2024-04-18T10:36:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9efc066d80 0x7f9efc092110 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9efc1365d0 0x7f9efc1459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 --2- 172.21.15.31:0/1927942777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9efc0a4f80 0x7f9efc093d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 >> 172.21.15.31:0/1927942777 conn(0x7f9efc060ac0 msgr2=0x7f9efc05c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 shutdown_connections 2024-04-18T10:36:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.294+0000 7f9f025fc700 1 -- 172.21.15.31:0/1927942777 wait complete. 2024-04-18T10:36:01.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.412+0000 7f3cb0d5c700 1 Processor -- start 2024-04-18T10:36:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.412+0000 7f3cb0d5c700 1 -- start start 2024-04-18T10:36:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.412+0000 7f3cb0d5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3cb0d5c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cac062400 0x7f3cac140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3cb0d5c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cac062b80 con 0x7f3cac05bb30 2024-04-18T10:36:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3cb0d5c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cac062e60 con 0x7f3cac062400 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3cb0d5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac139a40 con 0x7f3cac061fe0 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca9d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3caad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cac062400 0x7f3cac140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3caad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cac062400 0x7f3cac140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38352/0 (socket says 172.21.15.31:38352) 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca9d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38428/0 (socket says 172.21.15.31:38428) 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3caad9d700 1 -- 172.21.15.31:0/906143274 learned_addr learned my addr 172.21.15.31:0/906143274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca9d9b700 1 -- 172.21.15.31:0/906143274 >> v2:172.21.15.31:3300/0 conn(0x7f3cac062400 msgr2=0x7f3cac140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca9d9b700 1 --2- 172.21.15.31:0/906143274 >> v2:172.21.15.31:3300/0 conn(0x7f3cac062400 0x7f3cac140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca9d9b700 1 -- 172.21.15.31:0/906143274 >> v1:172.21.15.31:6789/0 conn(0x7f3cac05bb30 legacy=0x7f3cac063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca9d9b700 1 -- 172.21.15.31:0/906143274 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac139d00 con 0x7f3cac061fe0 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca959a700 1 -- 172.21.15.31:0/906143274 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046411787 0 0) 0x7f3cac062b80 con 0x7f3cac05bb30 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3caad9d700 1 --2- 172.21.15.31:0/906143274 >> v2:172.21.15.31:3300/0 conn(0x7f3cac062400 0x7f3cac140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca9d9b700 1 --2- 172.21.15.31:0/906143274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac139fb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3ca0002f70 tx=0x7f3ca0006df0).ready entity=mon.1 client_cookie=8983b2f8a4a93dee server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca959a700 1 -- 172.21.15.31:0/906143274 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca000d570 con 0x7f3cac061fe0 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca959a700 1 -- 172.21.15.31:0/906143274 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca0000e90 con 0x7f3cac061fe0 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.413+0000 7f3ca959a700 1 -- 172.21.15.31:0/906143274 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca000d8c0 con 0x7f3cac061fe0 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.414+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/906143274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 msgr2=0x7f3cac139fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.414+0000 7f3cb0d5c700 1 --2- 172.21.15.31:0/906143274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac139fb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f3ca0002f70 tx=0x7f3ca0006df0).stop 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.414+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/906143274 shutdown_connections 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.414+0000 7f3cb0d5c700 1 --2- 172.21.15.31:0/906143274 >> v2:172.21.15.31:3300/0 conn(0x7f3cac062400 0x7f3cac140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.414+0000 7f3cb0d5c700 1 --2- 172.21.15.31:0/906143274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac139fb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.414+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/906143274 >> 172.21.15.31:0/906143274 conn(0x7f3cac06c0c0 msgr2=0x7f3cac06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.414+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/906143274 shutdown_connections 2024-04-18T10:36:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.414+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/906143274 wait complete. 2024-04-18T10:36:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.415+0000 7f3cb0d5c700 1 Processor -- start 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.415+0000 7f3cb0d5c700 1 -- start start 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.415+0000 7f3cb0d5c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac05bb30 0x7f3cac094530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.415+0000 7f3cb0d5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.415+0000 7f3cb0d5c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cac149840 0x7f3cac149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.415+0000 7f3cb0d5c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac095550 con 0x7f3cac05bb30 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.415+0000 7f3cb0d5c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac14a1e0 con 0x7f3cac061fe0 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.415+0000 7f3cb0d5c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cac095d00 con 0x7f3cac149840 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.415+0000 7f3caa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac05bb30 0x7f3cac094530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3caad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cac149840 0x7f3cac149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3ca9d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3caa59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac05bb30 0x7f3cac094530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38356/0 (socket says 172.21.15.31:38356) 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3caa59c700 1 -- 172.21.15.31:0/3613706216 learned_addr learned my addr 172.21.15.31:0/3613706216 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3caa59c700 1 -- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cac149840 msgr2=0x7f3cac149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3caa59c700 1 --2- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cac149840 0x7f3cac149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3caa59c700 1 -- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 msgr2=0x7f3cac149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3caa59c700 1 --2- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3caa59c700 1 -- 172.21.15.31:0/3613706216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4009530 con 0x7f3cac05bb30 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3ca9d9b700 1 --2- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3caa59c700 1 --2- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac05bb30 0x7f3cac094530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3cac14a320 tx=0x7f3c9c007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3c9b7fe700 1 -- 172.21.15.31:0/3613706216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c00cea0 con 0x7f3cac05bb30 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3c9b7fe700 1 -- 172.21.15.31:0/3613706216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c012400 con 0x7f3cac05bb30 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca000b180 con 0x7f3cac05bb30 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3c9b7fe700 1 -- 172.21.15.31:0/3613706216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c012760 con 0x7f3cac05bb30 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.416+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cac094e90 con 0x7f3cac05bb30 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.417+0000 7f3c9b7fe700 1 -- 172.21.15.31:0/3613706216 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3c9c019030 con 0x7f3cac05bb30 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.417+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cac093870 con 0x7f3cac05bb30 2024-04-18T10:36:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.417+0000 7f3c9b7fe700 1 -- 172.21.15.31:0/3613706216 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f3c9c049690 con 0x7f3cac05bb30 2024-04-18T10:36:01.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.420+0000 7f3c9b7fe700 1 -- 172.21.15.31:0/3613706216 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3c9c02e8e0 con 0x7f3cac05bb30 2024-04-18T10:36:01.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.574+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cac094e90 con 0x7f3cac05bb30 2024-04-18T10:36:01.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.574+0000 7f3c9b7fe700 1 -- 172.21.15.31:0/3613706216 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+795 (secure 0 0 0) 0x7f3cac094e90 con 0x7f3cac05bb30 2024-04-18T10:36:01.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:01.575 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-04-18T10:36:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 >> v1:172.21.15.31:6816/39551 conn(0x7f3c88038dd0 legacy=0x7f3c8803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac05bb30 msgr2=0x7f3cac094530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 --2- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac05bb30 0x7f3cac094530 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3cac14a320 tx=0x7f3c9c007a70).stop 2024-04-18T10:36:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 shutdown_connections 2024-04-18T10:36:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 --2- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cac149840 0x7f3cac149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 --2- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cac05bb30 0x7f3cac094530 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 --2- 172.21.15.31:0/3613706216 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cac061fe0 0x7f3cac149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 >> 172.21.15.31:0/3613706216 conn(0x7f3cac06c0c0 msgr2=0x7f3cac0a7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 shutdown_connections 2024-04-18T10:36:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:01.576+0000 7f3cb0d5c700 1 -- 172.21.15.31:0/3613706216 wait complete. 2024-04-18T10:36:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2024-04-18T10:36:03.587 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:03.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.705+0000 7f69b5912700 1 Processor -- start 2024-04-18T10:36:03.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.705+0000 7f69b5912700 1 -- start start 2024-04-18T10:36:03.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69b5912700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b005bb30 0x7f69b0063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:03.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69b5912700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b0061fe0 0x7f69b0139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:03.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69b5912700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69b0062400 0x7f69b00a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:03.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69b5912700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b0062b80 con 0x7f69b0062400 2024-04-18T10:36:03.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69b5912700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0062e60 con 0x7f69b005bb30 2024-04-18T10:36:03.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69b5912700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0139a40 con 0x7f69b0061fe0 2024-04-18T10:36:03.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69ae7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b0061fe0 0x7f69b0139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:03.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69aeffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b005bb30 0x7f69b0063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69af7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69b0062400 0x7f69b00a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69af7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f69b0062400 0x7f69b00a8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38368/0 (socket says 172.21.15.31:38368) 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69ae7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b0061fe0 0x7f69b0139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34546/0 (socket says 172.21.15.31:34546) 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69aeffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b005bb30 0x7f69b0063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38450/0 (socket says 172.21.15.31:38450) 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.706+0000 7f69af7fe700 1 -- 172.21.15.31:0/3933198105 learned_addr learned my addr 172.21.15.31:0/3933198105 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69ae7fc700 1 -- 172.21.15.31:0/3933198105 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b005bb30 msgr2=0x7f69b0063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69ae7fc700 1 --2- 172.21.15.31:0/3933198105 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b005bb30 0x7f69b0063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69ae7fc700 1 -- 172.21.15.31:0/3933198105 >> v2:172.21.15.31:3300/0 conn(0x7f69b0062400 msgr2=0x7f69b00a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69ae7fc700 1 --2- 172.21.15.31:0/3933198105 >> v2:172.21.15.31:3300/0 conn(0x7f69b0062400 0x7f69b00a8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69ae7fc700 1 -- 172.21.15.31:0/3933198105 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0139d00 con 0x7f69b0061fe0 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69af7fe700 1 --2- 172.21.15.31:0/3933198105 >> v2:172.21.15.31:3300/0 conn(0x7f69b0062400 0x7f69b00a8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69aeffd700 1 --2- 172.21.15.31:0/3933198105 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b005bb30 0x7f69b0063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:03.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69ae7fc700 1 --2- 172.21.15.31:0/3933198105 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b0061fe0 0x7f69b0139fb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f69a0002f70 tx=0x7f69a0006df0).ready entity=mon.2 client_cookie=4e8cb7f236cf591f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69adffb700 1 -- 172.21.15.31:0/3933198105 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69a000d4a0 con 0x7f69b0061fe0 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69adffb700 1 -- 172.21.15.31:0/3933198105 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a0000e90 con 0x7f69b0061fe0 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69adffb700 1 -- 172.21.15.31:0/3933198105 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69a000d7f0 con 0x7f69b0061fe0 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69b5912700 1 -- 172.21.15.31:0/3933198105 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b0061fe0 msgr2=0x7f69b0139fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.707+0000 7f69b5912700 1 --2- 172.21.15.31:0/3933198105 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b0061fe0 0x7f69b0139fb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f69a0002f70 tx=0x7f69a0006df0).stop 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.708+0000 7f69b5912700 1 -- 172.21.15.31:0/3933198105 shutdown_connections 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.708+0000 7f69b5912700 1 --2- 172.21.15.31:0/3933198105 >> v2:172.21.15.31:3300/0 conn(0x7f69b0062400 0x7f69b00a8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.708+0000 7f69b5912700 1 --2- 172.21.15.31:0/3933198105 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b005bb30 0x7f69b0063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.708+0000 7f69b5912700 1 --2- 172.21.15.31:0/3933198105 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b0061fe0 0x7f69b0139fb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.708+0000 7f69b5912700 1 -- 172.21.15.31:0/3933198105 >> 172.21.15.31:0/3933198105 conn(0x7f69b006c0c0 msgr2=0x7f69b006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:03.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.708+0000 7f69b5912700 1 -- 172.21.15.31:0/3933198105 shutdown_connections 2024-04-18T10:36:03.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.708+0000 7f69b5912700 1 -- 172.21.15.31:0/3933198105 wait complete. 2024-04-18T10:36:03.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69b5912700 1 Processor -- start 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69b5912700 1 -- start start 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69b5912700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b005bb30 0x7f69b0146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69b5912700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b0061fe0 0x7f69b01495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69b5912700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b0097830 0x7f69b0149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69b5912700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0095ca0 con 0x7f69b0097830 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69b5912700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0146010 con 0x7f69b0061fe0 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69b5912700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69b0146dd0 con 0x7f69b005bb30 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69aeffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b005bb30 0x7f69b0146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69aeffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b005bb30 0x7f69b0146400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34558/0 (socket says 172.21.15.31:34558) 2024-04-18T10:36:03.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69aeffd700 1 -- 172.21.15.31:0/4007759446 learned_addr learned my addr 172.21.15.31:0/4007759446 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69ae7fc700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b0061fe0 0x7f69b01495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.709+0000 7f69af7fe700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b0097830 0x7f69b0149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69aeffd700 1 -- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b0061fe0 msgr2=0x7f69b01495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69aeffd700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b0061fe0 0x7f69b01495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69aeffd700 1 -- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b0097830 msgr2=0x7f69b0149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69aeffd700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b0097830 0x7f69b0149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69aeffd700 1 -- 172.21.15.31:0/4007759446 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a400b180 con 0x7f69b005bb30 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69ae7fc700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b0061fe0 0x7f69b01495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69af7fe700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b0097830 0x7f69b0149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69aeffd700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b005bb30 0x7f69b0146400 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f69a400c000 tx=0x7f69a4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f699ffff700 1 -- 172.21.15.31:0/4007759446 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69a400c5f0 con 0x7f69b005bb30 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f699ffff700 1 -- 172.21.15.31:0/4007759446 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a400c750 con 0x7f69b005bb30 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a8009530 con 0x7f69b005bb30 2024-04-18T10:36:03.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f699ffff700 1 -- 172.21.15.31:0/4007759446 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69a400cab0 con 0x7f69b005bb30 2024-04-18T10:36:03.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.710+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a000b180 con 0x7f69b005bb30 2024-04-18T10:36:03.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.711+0000 7f699ffff700 1 -- 172.21.15.31:0/4007759446 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f69a400cc10 con 0x7f69b005bb30 2024-04-18T10:36:03.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.711+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b005bf10 con 0x7f69b005bb30 2024-04-18T10:36:03.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.711+0000 7f699ffff700 1 -- 172.21.15.31:0/4007759446 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f69a404a9d0 con 0x7f69b005bb30 2024-04-18T10:36:03.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.714+0000 7f699ffff700 1 -- 172.21.15.31:0/4007759446 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f69a402fca0 con 0x7f69b005bb30 2024-04-18T10:36:03.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.865+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69b0095230 con 0x7f69b005bb30 2024-04-18T10:36:03.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.866+0000 7f699ffff700 1 -- 172.21.15.31:0/4007759446 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+795 (secure 0 0 0) 0x7f69a4033240 con 0x7f69b005bb30 2024-04-18T10:36:03.866 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:03.866 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-04-18T10:36:03.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 >> v1:172.21.15.31:6816/39551 conn(0x7f698c038dd0 legacy=0x7f698c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:03.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b005bb30 msgr2=0x7f69b0146400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:03.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b005bb30 0x7f69b0146400 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f69a400c000 tx=0x7f69a4006df0).stop 2024-04-18T10:36:03.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 shutdown_connections 2024-04-18T10:36:03.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f69b005bb30 0x7f69b0146400 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f69b0097830 0x7f69b0149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 --2- 172.21.15.31:0/4007759446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f69b0061fe0 0x7f69b01495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:03.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 >> 172.21.15.31:0/4007759446 conn(0x7f69b006c0c0 msgr2=0x7f69b006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:03.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 shutdown_connections 2024-04-18T10:36:03.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:03.867+0000 7f69b5912700 1 -- 172.21.15.31:0/4007759446 wait complete. 2024-04-18T10:36:03.868 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2024-04-18T10:36:05.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:05.999+0000 7fec699a3700 1 Processor -- start 2024-04-18T10:36:05.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:05.999+0000 7fec699a3700 1 -- start start 2024-04-18T10:36:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec699a3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec64064600 0x7fec64133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec699a3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec64063680 0x7fec6413d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec699a3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec64061ee0 con 0x7fec64062fb0 2024-04-18T10:36:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec699a3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec64065150 con 0x7fec64063680 2024-04-18T10:36:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec699a3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec64130bd0 con 0x7fec64064600 2024-04-18T10:36:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec62ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec64064600 0x7fec64133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec637fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec64063680 0x7fec6413d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec62ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec64064600 0x7fec64133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46264/0 (socket says 172.21.15.31:46264) 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec637fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec64063680 0x7fec6413d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35382/0 (socket says 172.21.15.31:35382) 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec62ffd700 1 -- 172.21.15.31:0/3572802817 learned_addr learned my addr 172.21.15.31:0/3572802817 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.000+0000 7fec627fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fec64062fb0 0x7fec640a92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56542/0 (socket says 172.21.15.31:56542) 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec61ffb700 1 -- 172.21.15.31:0/3572802817 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739186998 0 0) 0x7fec64061ee0 con 0x7fec64062fb0 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec61ffb700 1 -- 172.21.15.31:0/3572802817 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec48003260 con 0x7fec64062fb0 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec637fe700 1 -- 172.21.15.31:0/3572802817 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec64064600 msgr2=0x7fec64133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec637fe700 1 --2- 172.21.15.31:0/3572802817 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec64064600 0x7fec64133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec637fe700 1 -- 172.21.15.31:0/3572802817 >> v1:172.21.15.31:6789/0 conn(0x7fec64062fb0 legacy=0x7fec640a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec637fe700 1 -- 172.21.15.31:0/3572802817 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640a9db0 con 0x7fec64063680 2024-04-18T10:36:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec62ffd700 1 --2- 172.21.15.31:0/3572802817 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec64064600 0x7fec64133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec637fe700 1 --2- 172.21.15.31:0/3572802817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 0x7fec6413d930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fec640a9c50 tx=0x7fec5c0091d0).ready entity=mon.0 client_cookie=dff5f55d19ab3bbf server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec61ffb700 1 -- 172.21.15.31:0/3572802817 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5c00b600 con 0x7fec64063680 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec61ffb700 1 -- 172.21.15.31:0/3572802817 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c00b760 con 0x7fec64063680 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.001+0000 7fec61ffb700 1 -- 172.21.15.31:0/3572802817 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5c00b8d0 con 0x7fec64063680 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.002+0000 7fec699a3700 1 -- 172.21.15.31:0/3572802817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 msgr2=0x7fec6413d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.002+0000 7fec699a3700 1 --2- 172.21.15.31:0/3572802817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 0x7fec6413d930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fec640a9c50 tx=0x7fec5c0091d0).stop 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.002+0000 7fec699a3700 1 -- 172.21.15.31:0/3572802817 shutdown_connections 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.002+0000 7fec699a3700 1 --2- 172.21.15.31:0/3572802817 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 0x7fec6413d930 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.002+0000 7fec699a3700 1 --2- 172.21.15.31:0/3572802817 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec64064600 0x7fec64133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.002+0000 7fec699a3700 1 -- 172.21.15.31:0/3572802817 >> 172.21.15.31:0/3572802817 conn(0x7fec6406c0c0 msgr2=0x7fec6406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.002+0000 7fec699a3700 1 -- 172.21.15.31:0/3572802817 shutdown_connections 2024-04-18T10:36:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.002+0000 7fec699a3700 1 -- 172.21.15.31:0/3572802817 wait complete. 2024-04-18T10:36:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec699a3700 1 Processor -- start 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec699a3700 1 -- start start 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec699a3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 0x7fec64098220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec699a3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec64064600 0x7fec64096810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec699a3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec641328c0 0x7fec64131010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec699a3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec640971e0 con 0x7fec64063680 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec699a3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec64097480 con 0x7fec64064600 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec699a3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec64098710 con 0x7fec641328c0 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec62ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 0x7fec64098220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec637fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec641328c0 0x7fec64131010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec62ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 0x7fec64098220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35396/0 (socket says 172.21.15.31:35396) 2024-04-18T10:36:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec62ffd700 1 -- 172.21.15.31:0/2506965322 learned_addr learned my addr 172.21.15.31:0/2506965322 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.003+0000 7fec627fc700 1 --2- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec64064600 0x7fec64096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec637fe700 1 -- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec64064600 msgr2=0x7fec64096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec637fe700 1 --2- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec64064600 0x7fec64096810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec637fe700 1 -- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 msgr2=0x7fec64098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec637fe700 1 --2- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 0x7fec64098220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec637fe700 1 -- 172.21.15.31:0/2506965322 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5800b1e0 con 0x7fec641328c0 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec62ffd700 1 --2- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 0x7fec64098220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec637fe700 1 --2- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec641328c0 0x7fec64131010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fec640a9c50 tx=0x7fec5c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec53fff700 1 -- 172.21.15.31:0/2506965322 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5c011b60 con 0x7fec641328c0 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c009470 con 0x7fec641328c0 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec53fff700 1 -- 172.21.15.31:0/2506965322 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c011cc0 con 0x7fec641328c0 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec53fff700 1 -- 172.21.15.31:0/2506965322 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5c01f5e0 con 0x7fec641328c0 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.004+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec640a8940 con 0x7fec641328c0 2024-04-18T10:36:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.005+0000 7fec53fff700 1 -- 172.21.15.31:0/2506965322 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fec5c00f070 con 0x7fec641328c0 2024-04-18T10:36:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.005+0000 7fec53fff700 1 -- 172.21.15.31:0/2506965322 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fec5c04ade0 con 0x7fec641328c0 2024-04-18T10:36:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.005+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec64098960 con 0x7fec641328c0 2024-04-18T10:36:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.008+0000 7fec53fff700 1 -- 172.21.15.31:0/2506965322 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fec5c024030 con 0x7fec641328c0 2024-04-18T10:36:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.156+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec64133980 con 0x7fec641328c0 2024-04-18T10:36:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.156+0000 7fec53fff700 1 -- 172.21.15.31:0/2506965322 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1379 (secure 0 0 0) 0x7fec5c007c30 con 0x7fec641328c0 2024-04-18T10:36:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:06.156 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":14138,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":14141,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[]} 2024-04-18T10:36:06.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 >> v1:172.21.15.31:6816/39551 conn(0x7fec40038da0 legacy=0x7fec4003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec641328c0 msgr2=0x7fec64131010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 --2- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec641328c0 0x7fec64131010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fec640a9c50 tx=0x7fec5c016000).stop 2024-04-18T10:36:06.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 shutdown_connections 2024-04-18T10:36:06.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 --2- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec641328c0 0x7fec64131010 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 --2- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec64063680 0x7fec64098220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 --2- 172.21.15.31:0/2506965322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec64064600 0x7fec64096810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 >> 172.21.15.31:0/2506965322 conn(0x7fec6406c0c0 msgr2=0x7fec6405b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 shutdown_connections 2024-04-18T10:36:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.158+0000 7fec699a3700 1 -- 172.21.15.31:0/2506965322 wait complete. 2024-04-18T10:36:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2024-04-18T10:36:06.167 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:06.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.274+0000 7f9249537700 1 Processor -- start 2024-04-18T10:36:06.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.274+0000 7f9249537700 1 -- start start 2024-04-18T10:36:06.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9249537700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f924405b970 0x7f92440655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9249537700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9244134d70 0x7f92440646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9249537700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92441343e0 con 0x7f9244064260 2024-04-18T10:36:06.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9249537700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92441341f0 con 0x7f924405b970 2024-04-18T10:36:06.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9249537700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9244064bd0 con 0x7f9244134d70 2024-04-18T10:36:06.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9242ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f924405b970 0x7f92440655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f92437fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9244134d70 0x7f92440646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9242ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f924405b970 0x7f92440655c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35400/0 (socket says 172.21.15.31:35400) 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9242ffd700 1 -- 172.21.15.31:0/4087641834 learned_addr learned my addr 172.21.15.31:0/4087641834 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f92427fc700 1 --1- 172.21.15.31:0/4087641834 >> v1:172.21.15.31:6789/0 conn(0x7f9244064260 0x7f9244134660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56544/0 (socket says 172.21.15.31:56544) 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f92437fe700 1 -- 172.21.15.31:0/4087641834 >> v2:172.21.15.31:3300/0 conn(0x7f924405b970 msgr2=0x7f92440655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f92437fe700 1 --2- 172.21.15.31:0/4087641834 >> v2:172.21.15.31:3300/0 conn(0x7f924405b970 0x7f92440655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f92437fe700 1 -- 172.21.15.31:0/4087641834 >> v1:172.21.15.31:6789/0 conn(0x7f9244064260 legacy=0x7f9244134660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f92437fe700 1 -- 172.21.15.31:0/4087641834 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244064e50 con 0x7f9244134d70 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9241ffb700 1 -- 172.21.15.31:0/4087641834 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700895915 0 0) 0x7f92441343e0 con 0x7f9244064260 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f9242ffd700 1 --2- 172.21.15.31:0/4087641834 >> v2:172.21.15.31:3300/0 conn(0x7f924405b970 0x7f92440655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.275+0000 7f92437fe700 1 --2- 172.21.15.31:0/4087641834 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9244134d70 0x7f92440646e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f923c0032f0 tx=0x7f923c0091d0).ready entity=mon.2 client_cookie=6ada6bcc284e42d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9241ffb700 1 -- 172.21.15.31:0/4087641834 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923c00b6c0 con 0x7f9244134d70 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9241ffb700 1 -- 172.21.15.31:0/4087641834 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c00b820 con 0x7f9244134d70 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9241ffb700 1 -- 172.21.15.31:0/4087641834 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923c00b990 con 0x7f9244134d70 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9249537700 1 -- 172.21.15.31:0/4087641834 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9244134d70 msgr2=0x7f92440646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9249537700 1 --2- 172.21.15.31:0/4087641834 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9244134d70 0x7f92440646e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f923c0032f0 tx=0x7f923c0091d0).stop 2024-04-18T10:36:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9249537700 1 -- 172.21.15.31:0/4087641834 shutdown_connections 2024-04-18T10:36:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9249537700 1 --2- 172.21.15.31:0/4087641834 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9244134d70 0x7f92440646e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9249537700 1 --2- 172.21.15.31:0/4087641834 >> v2:172.21.15.31:3300/0 conn(0x7f924405b970 0x7f92440655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9249537700 1 -- 172.21.15.31:0/4087641834 >> 172.21.15.31:0/4087641834 conn(0x7f924406c0c0 msgr2=0x7f924406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9249537700 1 -- 172.21.15.31:0/4087641834 shutdown_connections 2024-04-18T10:36:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.276+0000 7f9249537700 1 -- 172.21.15.31:0/4087641834 wait complete. 2024-04-18T10:36:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.277+0000 7f9249537700 1 Processor -- start 2024-04-18T10:36:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.277+0000 7f9249537700 1 -- start start 2024-04-18T10:36:06.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9249537700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f924405b970 0x7f9244092670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9249537700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9244064260 0x7f92441362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9249537700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9244134d70 0x7f92441367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9249537700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9244093bf0 con 0x7f9244064260 2024-04-18T10:36:06.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9249537700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9244092f30 con 0x7f9244134d70 2024-04-18T10:36:06.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9249537700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92440931f0 con 0x7f924405b970 2024-04-18T10:36:06.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9242ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f924405b970 0x7f9244092670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f92427fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9244064260 0x7f92441362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9242ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f924405b970 0x7f9244092670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46298/0 (socket says 172.21.15.31:46298) 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9242ffd700 1 -- 172.21.15.31:0/2790706243 learned_addr learned my addr 172.21.15.31:0/2790706243 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f92437fe700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9244134d70 0x7f92441367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9242ffd700 1 -- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9244134d70 msgr2=0x7f92441367e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9242ffd700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9244134d70 0x7f92441367e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9242ffd700 1 -- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9244064260 msgr2=0x7f92441362f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9242ffd700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9244064260 0x7f92441362f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9242ffd700 1 -- 172.21.15.31:0/2790706243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923800b1e0 con 0x7f924405b970 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f92427fc700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9244064260 0x7f92441362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f92437fe700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9244134d70 0x7f92441367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9242ffd700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f924405b970 0x7f9244092670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f923800c000 tx=0x7f9238006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9233fff700 1 -- 172.21.15.31:0/2790706243 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9238012600 con 0x7f924405b970 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9233fff700 1 -- 172.21.15.31:0/2790706243 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9238012760 con 0x7f924405b970 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.278+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c009470 con 0x7f924405b970 2024-04-18T10:36:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.279+0000 7f9233fff700 1 -- 172.21.15.31:0/2790706243 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9238012ac0 con 0x7f924405b970 2024-04-18T10:36:06.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.279+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9244137460 con 0x7f924405b970 2024-04-18T10:36:06.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.279+0000 7f9233fff700 1 -- 172.21.15.31:0/2790706243 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9238022070 con 0x7f924405b970 2024-04-18T10:36:06.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.279+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9244138550 con 0x7f924405b970 2024-04-18T10:36:06.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.280+0000 7f9233fff700 1 -- 172.21.15.31:0/2790706243 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f923804a990 con 0x7f924405b970 2024-04-18T10:36:06.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.283+0000 7f9233fff700 1 -- 172.21.15.31:0/2790706243 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9238033610 con 0x7f924405b970 2024-04-18T10:36:06.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.400+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f924405bd50 con 0x7f924405b970 2024-04-18T10:36:06.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.400+0000 7f9233fff700 1 -- 172.21.15.31:0/2790706243 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+7613 (secure 0 0 0) 0x7f9238033200 con 0x7f924405b970 2024-04-18T10:36:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:06.400 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":15,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:01.519875+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.401+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 >> v1:172.21.15.31:6816/39551 conn(0x7f9220038e30 legacy=0x7f922003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.401+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f924405b970 msgr2=0x7f9244092670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.401+0000 7f9249537700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f924405b970 0x7f9244092670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f923800c000 tx=0x7f9238006eb0).stop 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.401+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 shutdown_connections 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.401+0000 7f9249537700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f924405b970 0x7f9244092670 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.401+0000 7f9249537700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9244134d70 0x7f92441367e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.401+0000 7f9249537700 1 --2- 172.21.15.31:0/2790706243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9244064260 0x7f92441362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.402+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 >> 172.21.15.31:0/2790706243 conn(0x7f924406c0c0 msgr2=0x7f9244132df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.402+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 shutdown_connections 2024-04-18T10:36:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.402+0000 7f9249537700 1 -- 172.21.15.31:0/2790706243 wait complete. 2024-04-18T10:36:06.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-18T10:36:06.412 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-18T10:36:06.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.521+0000 7ff83e304700 1 Processor -- start 2024-04-18T10:36:06.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.521+0000 7ff83e304700 1 -- start start 2024-04-18T10:36:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff83e304700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff83805bb30 0x7ff838063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff83e304700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838062400 0x7ff838140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff83e304700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff838062b80 con 0x7ff838061fe0 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff83e304700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff838062e60 con 0x7ff83805bb30 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff83e304700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff838139a40 con 0x7ff838062400 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff837fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff83805bb30 0x7ff838063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff83c8a1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838062400 0x7ff838140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff837fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff83805bb30 0x7ff838063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35420/0 (socket says 172.21.15.31:35420) 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff8377fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff838061fe0 0x7ff838139fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56550/0 (socket says 172.21.15.31:56550) 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff837fff700 1 -- 172.21.15.31:0/3888419699 learned_addr learned my addr 172.21.15.31:0/3888419699 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.522+0000 7ff83c8a1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838062400 0x7ff838140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46300/0 (socket says 172.21.15.31:46300) 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff837fff700 1 -- 172.21.15.31:0/3888419699 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838062400 msgr2=0x7ff838140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff837fff700 1 --2- 172.21.15.31:0/3888419699 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838062400 0x7ff838140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff837fff700 1 -- 172.21.15.31:0/3888419699 >> v1:172.21.15.31:6789/0 conn(0x7ff838061fe0 legacy=0x7ff838139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff837fff700 1 -- 172.21.15.31:0/3888419699 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838139d00 con 0x7ff83805bb30 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff836ffd700 1 -- 172.21.15.31:0/3888419699 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615365870 0 0) 0x7ff838062b80 con 0x7ff838061fe0 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff83c8a1700 1 --2- 172.21.15.31:0/3888419699 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838062400 0x7ff838140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff837fff700 1 --2- 172.21.15.31:0/3888419699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 0x7ff838063360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff828002f70 tx=0x7ff828006eb0).ready entity=mon.0 client_cookie=938829e152ce6c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff836ffd700 1 -- 172.21.15.31:0/3888419699 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff82800d570 con 0x7ff83805bb30 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff836ffd700 1 -- 172.21.15.31:0/3888419699 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828000e90 con 0x7ff83805bb30 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff836ffd700 1 -- 172.21.15.31:0/3888419699 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff82800d8c0 con 0x7ff83805bb30 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff83e304700 1 -- 172.21.15.31:0/3888419699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 msgr2=0x7ff838063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff83e304700 1 --2- 172.21.15.31:0/3888419699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 0x7ff838063360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff828002f70 tx=0x7ff828006eb0).stop 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff83e304700 1 -- 172.21.15.31:0/3888419699 shutdown_connections 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff83e304700 1 --2- 172.21.15.31:0/3888419699 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838062400 0x7ff838140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff83e304700 1 --2- 172.21.15.31:0/3888419699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 0x7ff838063360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.523+0000 7ff83e304700 1 -- 172.21.15.31:0/3888419699 >> 172.21.15.31:0/3888419699 conn(0x7ff83806c0c0 msgr2=0x7ff83806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:06.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.524+0000 7ff83e304700 1 -- 172.21.15.31:0/3888419699 shutdown_connections 2024-04-18T10:36:06.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.524+0000 7ff83e304700 1 -- 172.21.15.31:0/3888419699 wait complete. 2024-04-18T10:36:06.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.524+0000 7ff83e304700 1 Processor -- start 2024-04-18T10:36:06.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.524+0000 7ff83e304700 1 -- start start 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff83e304700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 0x7ff838136610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff83e304700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838061fe0 0x7ff838149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff83e304700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8380939b0 0x7ff838149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff83e304700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838093400 con 0x7ff83805bb30 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff83e304700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8380954f0 con 0x7ff8380939b0 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff83e304700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8380959f0 con 0x7ff838061fe0 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff8377fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838061fe0 0x7ff838149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff837fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 0x7ff838136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff8377fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838061fe0 0x7ff838149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46312/0 (socket says 172.21.15.31:46312) 2024-04-18T10:36:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff837fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 0x7ff838136610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35434/0 (socket says 172.21.15.31:35434) 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff8377fe700 1 -- 172.21.15.31:0/3733797948 learned_addr learned my addr 172.21.15.31:0/3733797948 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff83c8a1700 1 --2- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8380939b0 0x7ff838149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff837fff700 1 -- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838061fe0 msgr2=0x7ff838149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff837fff700 1 --2- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838061fe0 0x7ff838149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.525+0000 7ff837fff700 1 -- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8380939b0 msgr2=0x7ff838149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.526+0000 7ff837fff700 1 --2- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8380939b0 0x7ff838149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.526+0000 7ff837fff700 1 -- 172.21.15.31:0/3733797948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830009470 con 0x7ff83805bb30 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.526+0000 7ff837fff700 1 --2- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 0x7ff838136610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff828002f70 tx=0x7ff828015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.526+0000 7ff8357fa700 1 -- 172.21.15.31:0/3733797948 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff828011860 con 0x7ff83805bb30 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.526+0000 7ff8357fa700 1 -- 172.21.15.31:0/3733797948 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8280119c0 con 0x7ff83805bb30 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.526+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82800b1e0 con 0x7ff83805bb30 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.526+0000 7ff8357fa700 1 -- 172.21.15.31:0/3733797948 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff828011d20 con 0x7ff83805bb30 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.526+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff838095f50 con 0x7ff83805bb30 2024-04-18T10:36:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.527+0000 7ff8357fa700 1 -- 172.21.15.31:0/3733797948 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff828025030 con 0x7ff83805bb30 2024-04-18T10:36:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.527+0000 7ff8357fa700 1 -- 172.21.15.31:0/3733797948 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7ff82804b6f0 con 0x7ff83805bb30 2024-04-18T10:36:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.527+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83805bf10 con 0x7ff83805bb30 2024-04-18T10:36:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.530+0000 7ff8357fa700 1 -- 172.21.15.31:0/3733797948 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff828023030 con 0x7ff83805bb30 2024-04-18T10:36:06.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.646+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff838057a60 con 0x7ff83805bb30 2024-04-18T10:36:06.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.646+0000 7ff8357fa700 1 -- 172.21.15.31:0/3733797948 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v15) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff828028b30 con 0x7ff83805bb30 2024-04-18T10:36:06.646 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:36:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 >> v1:172.21.15.31:6816/39551 conn(0x7ff818038dd0 legacy=0x7ff81803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 msgr2=0x7ff838136610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 --2- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 0x7ff838136610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7ff828002f70 tx=0x7ff828015000).stop 2024-04-18T10:36:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 shutdown_connections 2024-04-18T10:36:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 --2- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8380939b0 0x7ff838149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 --2- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff83805bb30 0x7ff838136610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 --2- 172.21.15.31:0/3733797948 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff838061fe0 0x7ff838149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 >> 172.21.15.31:0/3733797948 conn(0x7ff83806c0c0 msgr2=0x7ff8380a8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:06.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 shutdown_connections 2024-04-18T10:36:06.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.648+0000 7ff83e304700 1 -- 172.21.15.31:0/3733797948 wait complete. 2024-04-18T10:36:06.657 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:36:06.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.767+0000 7f9d0d2fe700 1 Processor -- start 2024-04-18T10:36:06.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.767+0000 7f9d0d2fe700 1 -- start start 2024-04-18T10:36:06.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d0d2fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d080aa5c0 0x7f9d080aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d0d2fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d08063d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d0d2fe700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d080aae90 con 0x7f9d081344e0 2024-04-18T10:36:06.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d0d2fe700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d08064dc0 con 0x7f9d080aa5c0 2024-04-18T10:36:06.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d0d2fe700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d080650a0 con 0x7f9d081340e0 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d06ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d080aa5c0 0x7f9d080aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d067fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d08063d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d06ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d080aa5c0 0x7f9d080aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35436/0 (socket says 172.21.15.31:35436) 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d067fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d08063d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46322/0 (socket says 172.21.15.31:46322) 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d06ffd700 1 -- 172.21.15.31:0/4012410487 learned_addr learned my addr 172.21.15.31:0/4012410487 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d077fe700 1 --1- 172.21.15.31:0/4012410487 >> v1:172.21.15.31:6789/0 conn(0x7f9d081344e0 0x7f9d08137660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56564/0 (socket says 172.21.15.31:56564) 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d067fc700 1 -- 172.21.15.31:0/4012410487 >> v2:172.21.15.31:3300/0 conn(0x7f9d080aa5c0 msgr2=0x7f9d080aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d067fc700 1 --2- 172.21.15.31:0/4012410487 >> v2:172.21.15.31:3300/0 conn(0x7f9d080aa5c0 0x7f9d080aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d067fc700 1 -- 172.21.15.31:0/4012410487 >> v1:172.21.15.31:6789/0 conn(0x7f9d081344e0 legacy=0x7f9d08137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d067fc700 1 -- 172.21.15.31:0/4012410487 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d081349a0 con 0x7f9d081340e0 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d05ffb700 1 -- 172.21.15.31:0/4012410487 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029810588 0 0) 0x7f9d080aae90 con 0x7f9d081344e0 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d06ffd700 1 --2- 172.21.15.31:0/4012410487 >> v2:172.21.15.31:3300/0 conn(0x7f9d080aa5c0 0x7f9d080aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:06.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.768+0000 7f9d067fc700 1 --2- 172.21.15.31:0/4012410487 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d08063d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9cf8002f70 tx=0x7f9cf8006df0).ready entity=mon.2 client_cookie=d71821d4064cb067 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d05ffb700 1 -- 172.21.15.31:0/4012410487 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf800d570 con 0x7f9d081340e0 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d05ffb700 1 -- 172.21.15.31:0/4012410487 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8000e90 con 0x7f9d081340e0 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d05ffb700 1 -- 172.21.15.31:0/4012410487 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf800d8c0 con 0x7f9d081340e0 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/4012410487 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 msgr2=0x7f9d08063d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d0d2fe700 1 --2- 172.21.15.31:0/4012410487 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d08063d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9cf8002f70 tx=0x7f9cf8006df0).stop 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/4012410487 shutdown_connections 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d0d2fe700 1 --2- 172.21.15.31:0/4012410487 >> v2:172.21.15.31:3300/0 conn(0x7f9d080aa5c0 0x7f9d080aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d0d2fe700 1 --2- 172.21.15.31:0/4012410487 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d08063d80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/4012410487 >> 172.21.15.31:0/4012410487 conn(0x7f9d0806c0c0 msgr2=0x7f9d0806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/4012410487 shutdown_connections 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.769+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/4012410487 wait complete. 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.770+0000 7f9d0d2fe700 1 Processor -- start 2024-04-18T10:36:06.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.770+0000 7f9d0d2fe700 1 -- start start 2024-04-18T10:36:06.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d0d2fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d080aa5c0 0x7f9d08092a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d0d2fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d081473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d0d2fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d081344e0 0x7f9d081478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:06.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d0d2fe700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08147020 con 0x7f9d081344e0 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d0d2fe700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08094360 con 0x7f9d080aa5c0 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d0d2fe700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d08137c60 con 0x7f9d081340e0 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d06ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d080aa5c0 0x7f9d08092a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d077fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d081344e0 0x7f9d081478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d067fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d081473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d06ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d080aa5c0 0x7f9d08092a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60618/0 (socket says 172.21.15.31:60618) 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d06ffd700 1 -- 172.21.15.31:0/3214153032 learned_addr learned my addr 172.21.15.31:0/3214153032 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d077fe700 1 -- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 msgr2=0x7f9d081473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d077fe700 1 --2- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d081473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d077fe700 1 -- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d080aa5c0 msgr2=0x7f9d08092a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d077fe700 1 --2- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d080aa5c0 0x7f9d08092a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d077fe700 1 -- 172.21.15.31:0/3214153032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc00b1e0 con 0x7f9d081344e0 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d067fc700 1 --2- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d081473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d077fe700 1 --2- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d081344e0 0x7f9d081478d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9d00001250 tx=0x7f9d00007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:06.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9cf7fff700 1 -- 172.21.15.31:0/3214153032 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0000ce80 con 0x7f9d081344e0 2024-04-18T10:36:06.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9cf7fff700 1 -- 172.21.15.31:0/3214153032 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d00005ae0 con 0x7f9d081344e0 2024-04-18T10:36:06.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf800b180 con 0x7f9d081344e0 2024-04-18T10:36:06.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.771+0000 7f9cf7fff700 1 -- 172.21.15.31:0/3214153032 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d00005e40 con 0x7f9d081344e0 2024-04-18T10:36:06.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.772+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d08147dc0 con 0x7f9d081344e0 2024-04-18T10:36:06.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.772+0000 7f9cf7fff700 1 -- 172.21.15.31:0/3214153032 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9d00010070 con 0x7f9d081344e0 2024-04-18T10:36:06.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.772+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d08092660 con 0x7f9d081344e0 2024-04-18T10:36:06.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.773+0000 7f9cf7fff700 1 -- 172.21.15.31:0/3214153032 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f9d00049cc0 con 0x7f9d081344e0 2024-04-18T10:36:06.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.776+0000 7f9cf7fff700 1 -- 172.21.15.31:0/3214153032 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9d0002ef10 con 0x7f9d081344e0 2024-04-18T10:36:06.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.892+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9d08134c40 con 0x7f9d081344e0 2024-04-18T10:36:06.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.893+0000 7f9cf7fff700 1 -- 172.21.15.31:0/3214153032 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9d00032530 con 0x7f9d081344e0 2024-04-18T10:36:06.892 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:36:06.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 >> v1:172.21.15.31:6816/39551 conn(0x7f9ce4038da0 legacy=0x7f9ce403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d081344e0 msgr2=0x7f9d081478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:06.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 --2- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d081344e0 0x7f9d081478d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f9d00001250 tx=0x7f9d00007f20).stop 2024-04-18T10:36:06.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 shutdown_connections 2024-04-18T10:36:06.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 --2- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d081344e0 0x7f9d081478d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 --2- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d080aa5c0 0x7f9d08092a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 --2- 172.21.15.31:0/3214153032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d081340e0 0x7f9d081473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:06.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 >> 172.21.15.31:0/3214153032 conn(0x7f9d0806c0c0 msgr2=0x7f9d0806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:06.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 shutdown_connections 2024-04-18T10:36:06.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:06.894+0000 7f9d0d2fe700 1 -- 172.21.15.31:0/3214153032 wait complete. 2024-04-18T10:36:06.904 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-18T10:36:07.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.011+0000 7f1895680700 1 Processor -- start 2024-04-18T10:36:07.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.011+0000 7f1895680700 1 -- start start 2024-04-18T10:36:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.011+0000 7f1895680700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f1890133360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f1895680700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f189013e920 0x7f1890140d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f1895680700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189005c360 con 0x7f1890133850 2024-04-18T10:36:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f1895680700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1890139630 con 0x7f189013e920 2024-04-18T10:36:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f1895680700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18901398f0 con 0x7f18900a8fb0 2024-04-18T10:36:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f1890133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f189013e920 0x7f1890140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f1890133360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60632/0 (socket says 172.21.15.31:60632) 2024-04-18T10:36:07.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188effd700 1 -- 172.21.15.31:0/3555025021 learned_addr learned my addr 172.21.15.31:0/3555025021 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188f7fe700 1 -- 172.21.15.31:0/3555025021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 msgr2=0x7f1890133360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188f7fe700 1 --2- 172.21.15.31:0/3555025021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f1890133360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188f7fe700 1 -- 172.21.15.31:0/3555025021 >> v1:172.21.15.31:6789/0 conn(0x7f1890133850 legacy=0x7f189005cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188f7fe700 1 -- 172.21.15.31:0/3555025021 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900a79a0 con 0x7f189013e920 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188dffb700 1 -- 172.21.15.31:0/3555025021 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512776275 0 0) 0x7f189005c360 con 0x7f1890133850 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188effd700 1 --2- 172.21.15.31:0/3555025021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f1890133360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188f7fe700 1 --2- 172.21.15.31:0/3555025021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 0x7f1890140d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f18880032f0 tx=0x7f18880091d0).ready entity=mon.0 client_cookie=a371c8f7f8bdb488 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188dffb700 1 -- 172.21.15.31:0/3555025021 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188800b6c0 con 0x7f189013e920 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188dffb700 1 -- 172.21.15.31:0/3555025021 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188800b820 con 0x7f189013e920 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.012+0000 7f188dffb700 1 -- 172.21.15.31:0/3555025021 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188800b990 con 0x7f189013e920 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.013+0000 7f1895680700 1 -- 172.21.15.31:0/3555025021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 msgr2=0x7f1890140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.013+0000 7f1895680700 1 --2- 172.21.15.31:0/3555025021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 0x7f1890140d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f18880032f0 tx=0x7f18880091d0).stop 2024-04-18T10:36:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.013+0000 7f1895680700 1 -- 172.21.15.31:0/3555025021 shutdown_connections 2024-04-18T10:36:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.013+0000 7f1895680700 1 --2- 172.21.15.31:0/3555025021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 0x7f1890140d10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.013+0000 7f1895680700 1 --2- 172.21.15.31:0/3555025021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f1890133360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.013+0000 7f1895680700 1 -- 172.21.15.31:0/3555025021 >> 172.21.15.31:0/3555025021 conn(0x7f1890067a50 msgr2=0x7f1890066a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.013+0000 7f1895680700 1 -- 172.21.15.31:0/3555025021 shutdown_connections 2024-04-18T10:36:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.013+0000 7f1895680700 1 -- 172.21.15.31:0/3555025021 wait complete. 2024-04-18T10:36:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.014+0000 7f1895680700 1 Processor -- start 2024-04-18T10:36:07.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.014+0000 7f1895680700 1 -- start start 2024-04-18T10:36:07.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.014+0000 7f1895680700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f18901452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.014+0000 7f1895680700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1890133850 0x7f189013b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.014+0000 7f1895680700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 0x7f189013bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.014+0000 7f1895680700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1890136d80 con 0x7f189013e920 2024-04-18T10:36:07.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.014+0000 7f1895680700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18901361c0 con 0x7f18900a8fb0 2024-04-18T10:36:07.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.014+0000 7f1895680700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1890135f50 con 0x7f1890133850 2024-04-18T10:36:07.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.014+0000 7f188effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f18901452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f18901452e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60636/0 (socket says 172.21.15.31:60636) 2024-04-18T10:36:07.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 0x7f189013bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188effd700 1 -- 172.21.15.31:0/389349721 learned_addr learned my addr 172.21.15.31:0/389349721 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188e7fc700 1 --2- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1890133850 0x7f189013b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188effd700 1 -- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1890133850 msgr2=0x7f189013b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188effd700 1 --2- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1890133850 0x7f189013b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188effd700 1 -- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 msgr2=0x7f189013bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188effd700 1 --2- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 0x7f189013bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188effd700 1 -- 172.21.15.31:0/389349721 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188000b1e0 con 0x7f18900a8fb0 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188f7fe700 1 --2- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 0x7f189013bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f188effd700 1 --2- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f18901452e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f18901360e0 tx=0x7f1880006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f187ffff700 1 -- 172.21.15.31:0/389349721 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1880012600 con 0x7f18900a8fb0 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f187ffff700 1 -- 172.21.15.31:0/389349721 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880012760 con 0x7f18900a8fb0 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1888009470 con 0x7f18900a8fb0 2024-04-18T10:36:07.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f187ffff700 1 -- 172.21.15.31:0/389349721 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1880012ac0 con 0x7f18900a8fb0 2024-04-18T10:36:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.015+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1890145a40 con 0x7f18900a8fb0 2024-04-18T10:36:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.016+0000 7f187ffff700 1 -- 172.21.15.31:0/389349721 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1880022070 con 0x7f18900a8fb0 2024-04-18T10:36:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.016+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1890145d90 con 0x7f18900a8fb0 2024-04-18T10:36:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.016+0000 7f187ffff700 1 -- 172.21.15.31:0/389349721 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f188004aa10 con 0x7f18900a8fb0 2024-04-18T10:36:07.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.019+0000 7f187ffff700 1 -- 172.21.15.31:0/389349721 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f18800335f0 con 0x7f18900a8fb0 2024-04-18T10:36:07.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.137+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f18900a8c80 con 0x7f18900a8fb0 2024-04-18T10:36:07.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.137+0000 7f187ffff700 1 -- 172.21.15.31:0/389349721 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v15) v1 ==== 84+0+143 (secure 0 0 0) 0x7f18800331e0 con 0x7f18900a8fb0 2024-04-18T10:36:07.137 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:07.137 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-04-18T10:36:07.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:36:07.137 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-04-18T10:36:07.137 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": "device_health_metrics" 2024-04-18T10:36:07.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:36:07.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:36:07.137 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 2, 2024-04-18T10:36:07.138 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": "rbd" 2024-04-18T10:36:07.138 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:36:07.138 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 >> v1:172.21.15.31:6816/39551 conn(0x7f186c038ec0 legacy=0x7f186c03b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 msgr2=0x7f18901452e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 --2- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f18901452e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f18901360e0 tx=0x7f1880006eb0).stop 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 shutdown_connections 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 --2- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f189013e920 0x7f189013bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 --2- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f18900a8fb0 0x7f18901452e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 --2- 172.21.15.31:0/389349721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1890133850 0x7f189013b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 >> 172.21.15.31:0/389349721 conn(0x7f1890067a50 msgr2=0x7f18900ac490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 shutdown_connections 2024-04-18T10:36:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.139+0000 7f1895680700 1 -- 172.21.15.31:0/389349721 wait complete. 2024-04-18T10:36:07.148 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-18T10:36:07.148 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-18T10:36:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.259+0000 7f4da9d09700 1 Processor -- start 2024-04-18T10:36:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.259+0000 7f4da9d09700 1 -- start start 2024-04-18T10:36:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da9d09700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4da41361b0 0x7f4da4097b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da9d09700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da4136970 0x7f4da4136de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da9d09700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da40aa0a0 con 0x7f4da405b970 2024-04-18T10:36:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da9d09700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da4097060 con 0x7f4da41361b0 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da9d09700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da40976f0 con 0x7f4da4136970 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da4136970 0x7f4da4136de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4da41361b0 0x7f4da4097b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da2ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4da41361b0 0x7f4da4097b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35468/0 (socket says 172.21.15.31:35468) 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da2ffd700 1 -- 172.21.15.31:0/3862318027 learned_addr learned my addr 172.21.15.31:0/3862318027 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da4136970 0x7f4da4136de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60640/0 (socket says 172.21.15.31:60640) 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da37fe700 1 --1- 172.21.15.31:0/3862318027 >> v1:172.21.15.31:6789/0 conn(0x7f4da405b970 0x7f4da4096520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56568/0 (socket says 172.21.15.31:56568) 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da3fff700 1 -- 172.21.15.31:0/3862318027 >> v2:172.21.15.31:3300/0 conn(0x7f4da41361b0 msgr2=0x7f4da4097b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da3fff700 1 --2- 172.21.15.31:0/3862318027 >> v2:172.21.15.31:3300/0 conn(0x7f4da41361b0 0x7f4da4097b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da3fff700 1 -- 172.21.15.31:0/3862318027 >> v1:172.21.15.31:6789/0 conn(0x7f4da405b970 legacy=0x7f4da4096520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da3fff700 1 -- 172.21.15.31:0/3862318027 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da41366b0 con 0x7f4da4136970 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da27fc700 1 -- 172.21.15.31:0/3862318027 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942571254 0 0) 0x7f4d94001110 con 0x7f4da405b970 2024-04-18T10:36:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da2ffd700 1 --2- 172.21.15.31:0/3862318027 >> v2:172.21.15.31:3300/0 conn(0x7f4da41361b0 0x7f4da4097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da3fff700 1 --2- 172.21.15.31:0/3862318027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da4136970 0x7f4da4136de0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4d9c0032f0 tx=0x7f4d9c0091d0).ready entity=mon.1 client_cookie=41334c4898de6fef server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da27fc700 1 -- 172.21.15.31:0/3862318027 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9c00b6c0 con 0x7f4da4136970 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da27fc700 1 -- 172.21.15.31:0/3862318027 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c00b820 con 0x7f4da4136970 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.260+0000 7f4da27fc700 1 -- 172.21.15.31:0/3862318027 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9c00b990 con 0x7f4da4136970 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.261+0000 7f4da9d09700 1 -- 172.21.15.31:0/3862318027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da4136970 msgr2=0x7f4da4136de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.261+0000 7f4da9d09700 1 --2- 172.21.15.31:0/3862318027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da4136970 0x7f4da4136de0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f4d9c0032f0 tx=0x7f4d9c0091d0).stop 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.261+0000 7f4da9d09700 1 -- 172.21.15.31:0/3862318027 shutdown_connections 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.261+0000 7f4da9d09700 1 --2- 172.21.15.31:0/3862318027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da4136970 0x7f4da4136de0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.261+0000 7f4da9d09700 1 --2- 172.21.15.31:0/3862318027 >> v2:172.21.15.31:3300/0 conn(0x7f4da41361b0 0x7f4da4097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.261+0000 7f4da9d09700 1 -- 172.21.15.31:0/3862318027 >> 172.21.15.31:0/3862318027 conn(0x7f4da406c0c0 msgr2=0x7f4da406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.261+0000 7f4da9d09700 1 -- 172.21.15.31:0/3862318027 shutdown_connections 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.261+0000 7f4da9d09700 1 -- 172.21.15.31:0/3862318027 wait complete. 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.262+0000 7f4da9d09700 1 Processor -- start 2024-04-18T10:36:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.262+0000 7f4da9d09700 1 -- start start 2024-04-18T10:36:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da9d09700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4da405b970 0x7f4da4064270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da9d09700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da41361b0 0x7f4da4130e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da9d09700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da4136970 0x7f4da4131310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da9d09700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4061f60 con 0x7f4da4136970 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da9d09700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4066160 con 0x7f4da41361b0 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da9d09700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4064a10 con 0x7f4da405b970 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4da405b970 0x7f4da4064270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da4136970 0x7f4da4131310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da2ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da41361b0 0x7f4da4130e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da4136970 0x7f4da4131310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35476/0 (socket says 172.21.15.31:35476) 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4da405b970 0x7f4da4064270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46338/0 (socket says 172.21.15.31:46338) 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da3fff700 1 -- 172.21.15.31:0/2125734184 learned_addr learned my addr 172.21.15.31:0/2125734184 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da3fff700 1 -- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4da405b970 msgr2=0x7f4da4064270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da3fff700 1 --2- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4da405b970 0x7f4da4064270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da3fff700 1 -- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da41361b0 msgr2=0x7f4da4130e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da3fff700 1 --2- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da41361b0 0x7f4da4130e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da3fff700 1 -- 172.21.15.31:0/2125734184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c00b1e0 con 0x7f4da4136970 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da37fe700 1 --2- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4da405b970 0x7f4da4064270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.263+0000 7f4da2ffd700 1 --2- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da41361b0 0x7f4da4130e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.264+0000 7f4da3fff700 1 --2- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da4136970 0x7f4da4131310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4d9c0032f0 tx=0x7f4d9c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.264+0000 7f4da0ff9700 1 -- 172.21.15.31:0/2125734184 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9c00b6c0 con 0x7f4da4136970 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.264+0000 7f4da0ff9700 1 -- 172.21.15.31:0/2125734184 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c021630 con 0x7f4da4136970 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.264+0000 7f4da0ff9700 1 -- 172.21.15.31:0/2125734184 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9c021990 con 0x7f4da4136970 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.264+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c009470 con 0x7f4da4136970 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.264+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da40650b0 con 0x7f4da4136970 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.265+0000 7f4da0ff9700 1 -- 172.21.15.31:0/2125734184 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4d9c027020 con 0x7f4da4136970 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.265+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da405bd50 con 0x7f4da4136970 2024-04-18T10:36:07.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.265+0000 7f4da0ff9700 1 -- 172.21.15.31:0/2125734184 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f4d9c04b930 con 0x7f4da4136970 2024-04-18T10:36:07.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.268+0000 7f4da0ff9700 1 -- 172.21.15.31:0/2125734184 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4d9c021d20 con 0x7f4da4136970 2024-04-18T10:36:07.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.384+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4da4057a60 con 0x7f4da4136970 2024-04-18T10:36:07.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.675+0000 7f4da0ff9700 1 -- 172.21.15.31:0/2125734184 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v16) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4d9c015020 con 0x7f4da4136970 2024-04-18T10:36:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.681+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 >> v1:172.21.15.31:6816/39551 conn(0x7f4d88038da0 legacy=0x7f4d8803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.681+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da4136970 msgr2=0x7f4da4131310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.681+0000 7f4da9d09700 1 --2- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da4136970 0x7f4da4131310 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f4d9c0032f0 tx=0x7f4d9c016000).stop 2024-04-18T10:36:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.681+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 shutdown_connections 2024-04-18T10:36:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.681+0000 7f4da9d09700 1 --2- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4da405b970 0x7f4da4064270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.681+0000 7f4da9d09700 1 --2- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4da4136970 0x7f4da4131310 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.681+0000 7f4da9d09700 1 --2- 172.21.15.31:0/2125734184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4da41361b0 0x7f4da4130e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.681+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 >> 172.21.15.31:0/2125734184 conn(0x7f4da406c0c0 msgr2=0x7f4da4133230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.681+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 shutdown_connections 2024-04-18T10:36:07.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.682+0000 7f4da9d09700 1 -- 172.21.15.31:0/2125734184 wait complete. 2024-04-18T10:36:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-04-18T10:36:07.693 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-18T10:36:07.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.807+0000 7f8469cac700 1 Processor -- start 2024-04-18T10:36:07.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.807+0000 7f8469cac700 1 -- start start 2024-04-18T10:36:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.807+0000 7f8469cac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84640a5050 0x7f84641348e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.807+0000 7f8469cac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8464134dd0 0x7f846413e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.807+0000 7f8469cac700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84640a4870 con 0x7f8464134500 2024-04-18T10:36:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.807+0000 7f8469cac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84640a3e30 con 0x7f8464134dd0 2024-04-18T10:36:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.807+0000 7f8469cac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84640a4050 con 0x7f84640a5050 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8462ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84640a5050 0x7f84641348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8463fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8464134dd0 0x7f846413e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8462ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84640a5050 0x7f84641348e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46348/0 (socket says 172.21.15.31:46348) 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f84637fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8464134500 0x7f84640a3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56582/0 (socket says 172.21.15.31:56582) 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8462ffd700 1 -- 172.21.15.31:0/4189113933 learned_addr learned my addr 172.21.15.31:0/4189113933 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8463fff700 1 -- 172.21.15.31:0/4189113933 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84640a5050 msgr2=0x7f84641348e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8463fff700 1 --2- 172.21.15.31:0/4189113933 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84640a5050 0x7f84641348e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f84627fc700 1 -- 172.21.15.31:0/4189113933 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431549711 0 0) 0x7f84640a4870 con 0x7f8464134500 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8463fff700 1 -- 172.21.15.31:0/4189113933 >> v1:172.21.15.31:6789/0 conn(0x7f8464134500 legacy=0x7f84640a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8463fff700 1 -- 172.21.15.31:0/4189113933 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84640a42f0 con 0x7f8464134dd0 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8462ffd700 1 --2- 172.21.15.31:0/4189113933 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84640a5050 0x7f84641348e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f8463fff700 1 --2- 172.21.15.31:0/4189113933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8464134dd0 0x7f846413e820 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f845c0032f0 tx=0x7f845c0091d0).ready entity=mon.1 client_cookie=acc3d21e2522d513 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f84627fc700 1 -- 172.21.15.31:0/4189113933 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f845c00b6c0 con 0x7f8464134dd0 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f84627fc700 1 -- 172.21.15.31:0/4189113933 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00b820 con 0x7f8464134dd0 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.808+0000 7f84627fc700 1 -- 172.21.15.31:0/4189113933 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f845c00b990 con 0x7f8464134dd0 2024-04-18T10:36:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.809+0000 7f8469cac700 1 -- 172.21.15.31:0/4189113933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8464134dd0 msgr2=0x7f846413e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.809+0000 7f8469cac700 1 --2- 172.21.15.31:0/4189113933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8464134dd0 0x7f846413e820 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f845c0032f0 tx=0x7f845c0091d0).stop 2024-04-18T10:36:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.809+0000 7f8469cac700 1 -- 172.21.15.31:0/4189113933 shutdown_connections 2024-04-18T10:36:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.809+0000 7f8469cac700 1 --2- 172.21.15.31:0/4189113933 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8464134dd0 0x7f846413e820 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.809+0000 7f8469cac700 1 --2- 172.21.15.31:0/4189113933 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84640a5050 0x7f84641348e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.809+0000 7f8469cac700 1 -- 172.21.15.31:0/4189113933 >> 172.21.15.31:0/4189113933 conn(0x7f8464060ac0 msgr2=0x7f84640a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.809+0000 7f8469cac700 1 -- 172.21.15.31:0/4189113933 shutdown_connections 2024-04-18T10:36:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.809+0000 7f8469cac700 1 -- 172.21.15.31:0/4189113933 wait complete. 2024-04-18T10:36:07.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.810+0000 7f8469cac700 1 Processor -- start 2024-04-18T10:36:07.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.810+0000 7f8469cac700 1 -- start start 2024-04-18T10:36:07.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.810+0000 7f8469cac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84640a5050 0x7f8464093420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.810+0000 7f8469cac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8464134500 0x7f8464132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.810+0000 7f8469cac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8464134dd0 0x7f8464132a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.810+0000 7f8469cac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8464093de0 con 0x7f8464134500 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.810+0000 7f8469cac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84640940c0 con 0x7f84640a5050 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.810+0000 7f8469cac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8464093910 con 0x7f8464134dd0 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8463fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8464134dd0 0x7f8464132a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8462ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8464134500 0x7f8464132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f84637fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84640a5050 0x7f8464093420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8463fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8464134dd0 0x7f8464132a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46350/0 (socket says 172.21.15.31:46350) 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8463fff700 1 -- 172.21.15.31:0/58194761 learned_addr learned my addr 172.21.15.31:0/58194761 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8463fff700 1 -- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84640a5050 msgr2=0x7f8464093420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8463fff700 1 --2- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84640a5050 0x7f8464093420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8463fff700 1 -- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8464134500 msgr2=0x7f8464132570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8463fff700 1 --2- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8464134500 0x7f8464132570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8463fff700 1 -- 172.21.15.31:0/58194761 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845800b1e0 con 0x7f8464134dd0 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8462ffd700 1 --2- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8464134500 0x7f8464132570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f84637fe700 1 --2- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84640a5050 0x7f8464093420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8463fff700 1 --2- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8464134dd0 0x7f8464132a60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f845c0032f0 tx=0x7f845c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8460ff9700 1 -- 172.21.15.31:0/58194761 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f845c00b6c0 con 0x7f8464134dd0 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8460ff9700 1 -- 172.21.15.31:0/58194761 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00b030 con 0x7f8464134dd0 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c009470 con 0x7f8464134dd0 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8460ff9700 1 -- 172.21.15.31:0/58194761 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f845c0207d0 con 0x7f8464134dd0 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.811+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8464094c10 con 0x7f8464134dd0 2024-04-18T10:36:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.812+0000 7f8460ff9700 1 -- 172.21.15.31:0/58194761 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f845c01e070 con 0x7f8464134dd0 2024-04-18T10:36:07.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.812+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846405bd30 con 0x7f8464134dd0 2024-04-18T10:36:07.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.812+0000 7f8460ff9700 1 -- 172.21.15.31:0/58194761 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3192+0+0 (secure 0 0 0) 0x7f845c04b370 con 0x7f8464134dd0 2024-04-18T10:36:07.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.815+0000 7f8460ff9700 1 -- 172.21.15.31:0/58194761 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f845c020ec0 con 0x7f8464134dd0 2024-04-18T10:36:07.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:07.931+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8464057a60 con 0x7f8464134dd0 2024-04-18T10:36:08.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.677+0000 7f8460ff9700 1 -- 172.21.15.31:0/58194761 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v17) v1 ==== 170+0+0 (secure 0 0 0) 0x7f845c008f30 con 0x7f8464134dd0 2024-04-18T10:36:08.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.686+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 >> v1:172.21.15.31:6816/39551 conn(0x7f8444038e30 legacy=0x7f844403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:08.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.686+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8464134dd0 msgr2=0x7f8464132a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:08.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.686+0000 7f8469cac700 1 --2- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8464134dd0 0x7f8464132a60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f845c0032f0 tx=0x7f845c016000).stop 2024-04-18T10:36:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.686+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 shutdown_connections 2024-04-18T10:36:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.686+0000 7f8469cac700 1 --2- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8464134dd0 0x7f8464132a60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.686+0000 7f8469cac700 1 --2- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84640a5050 0x7f8464093420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.686+0000 7f8469cac700 1 --2- 172.21.15.31:0/58194761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8464134500 0x7f8464132570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.686+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 >> 172.21.15.31:0/58194761 conn(0x7f8464060ac0 msgr2=0x7f84640a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.687+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 shutdown_connections 2024-04-18T10:36:08.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.688+0000 7f8469cac700 1 -- 172.21.15.31:0/58194761 wait complete. 2024-04-18T10:36:08.693 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-04-18T10:36:08.716 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-18T10:36:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.830+0000 7fe9495a1700 1 Processor -- start 2024-04-18T10:36:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.830+0000 7fe9495a1700 1 -- start start 2024-04-18T10:36:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9495a1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe944067370 0x7fe944065bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9495a1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9440a3ef0 0x7fe9441404f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9495a1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9440661a0 con 0x7fe9441363a0 2024-04-18T10:36:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9495a1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe944136e90 con 0x7fe9440a3ef0 2024-04-18T10:36:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9495a1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe944066440 con 0x7fe944067370 2024-04-18T10:36:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9437fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe944067370 0x7fe944065bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe943fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe9441363a0 0x7fe944136780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56594/0 (socket says 172.21.15.31:56594) 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9437fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe944067370 0x7fe944065bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46360/0 (socket says 172.21.15.31:46360) 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe943fff700 1 -- 172.21.15.31:0/871878379 learned_addr learned my addr 172.21.15.31:0/871878379 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe948da0700 1 --2- 172.21.15.31:0/871878379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9440a3ef0 0x7fe9441404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe942ffd700 1 -- 172.21.15.31:0/871878379 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864266196 0 0) 0x7fe9440661a0 con 0x7fe9441363a0 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9437fe700 1 -- 172.21.15.31:0/871878379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9440a3ef0 msgr2=0x7fe9441404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9437fe700 1 --2- 172.21.15.31:0/871878379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9440a3ef0 0x7fe9441404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9437fe700 1 -- 172.21.15.31:0/871878379 >> v1:172.21.15.31:6789/0 conn(0x7fe9441363a0 legacy=0x7fe944136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9437fe700 1 -- 172.21.15.31:0/871878379 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944067090 con 0x7fe944067370 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe948da0700 1 --2- 172.21.15.31:0/871878379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9440a3ef0 0x7fe9441404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe9437fe700 1 --2- 172.21.15.31:0/871878379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe944067370 0x7fe944065bf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe92c002f70 tx=0x7fe92c006df0).ready entity=mon.2 client_cookie=38218d4664fea6c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.831+0000 7fe942ffd700 1 -- 172.21.15.31:0/871878379 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe92c00d570 con 0x7fe944067370 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe942ffd700 1 -- 172.21.15.31:0/871878379 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c000e90 con 0x7fe944067370 2024-04-18T10:36:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe942ffd700 1 -- 172.21.15.31:0/871878379 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe92c00d8c0 con 0x7fe944067370 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe9495a1700 1 -- 172.21.15.31:0/871878379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe944067370 msgr2=0x7fe944065bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe9495a1700 1 --2- 172.21.15.31:0/871878379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe944067370 0x7fe944065bf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe92c002f70 tx=0x7fe92c006df0).stop 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe9495a1700 1 -- 172.21.15.31:0/871878379 shutdown_connections 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe9495a1700 1 --2- 172.21.15.31:0/871878379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9440a3ef0 0x7fe9441404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe9495a1700 1 --2- 172.21.15.31:0/871878379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe944067370 0x7fe944065bf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe9495a1700 1 -- 172.21.15.31:0/871878379 >> 172.21.15.31:0/871878379 conn(0x7fe944060940 msgr2=0x7fe9440a87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe9495a1700 1 -- 172.21.15.31:0/871878379 shutdown_connections 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.832+0000 7fe9495a1700 1 -- 172.21.15.31:0/871878379 wait complete. 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.833+0000 7fe9495a1700 1 Processor -- start 2024-04-18T10:36:08.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.833+0000 7fe9495a1700 1 -- start start 2024-04-18T10:36:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe9495a1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440a3ef0 0x7fe9440968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe9495a1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9441363a0 0x7fe944133400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe9495a1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9440a2540 0x7fe9441338f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe9495a1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe944096170 con 0x7fe9440a3ef0 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe9495a1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440963a0 con 0x7fe9441363a0 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe9495a1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe944094200 con 0x7fe9440a2540 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe943fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440a3ef0 0x7fe9440968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe948da0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9440a2540 0x7fe9441338f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe9437fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9441363a0 0x7fe944133400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe943fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440a3ef0 0x7fe9440968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35482/0 (socket says 172.21.15.31:35482) 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe948da0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9440a2540 0x7fe9441338f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46374/0 (socket says 172.21.15.31:46374) 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.834+0000 7fe943fff700 1 -- 172.21.15.31:0/2453772447 learned_addr learned my addr 172.21.15.31:0/2453772447 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe948da0700 1 -- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9441363a0 msgr2=0x7fe944133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe948da0700 1 --2- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9441363a0 0x7fe944133400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe948da0700 1 -- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440a3ef0 msgr2=0x7fe9440968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe948da0700 1 --2- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440a3ef0 0x7fe9440968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe948da0700 1 -- 172.21.15.31:0/2453772447 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c009470 con 0x7fe9440a2540 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe943fff700 1 --2- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440a3ef0 0x7fe9440968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe948da0700 1 --2- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9440a2540 0x7fe9441338f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe93c00c000 tx=0x7fe93c0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe9417fa700 1 -- 172.21.15.31:0/2453772447 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe93c00c6a0 con 0x7fe9440a2540 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe9417fa700 1 -- 172.21.15.31:0/2453772447 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c00c800 con 0x7fe9440a2540 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c00b180 con 0x7fe9440a2540 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe9417fa700 1 -- 172.21.15.31:0/2453772447 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe93c00cb60 con 0x7fe9440a2540 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.835+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe944133de0 con 0x7fe9440a2540 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.836+0000 7fe9417fa700 1 -- 172.21.15.31:0/2453772447 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe93c00ccc0 con 0x7fe9440a2540 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.836+0000 7fe9417fa700 1 -- 172.21.15.31:0/2453772447 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3574+0+0 (secure 0 0 0) 0x7fe93c04b130 con 0x7fe9440a2540 2024-04-18T10:36:08.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.836+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9440a4e00 con 0x7fe9440a2540 2024-04-18T10:36:08.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.839+0000 7fe9417fa700 1 -- 172.21.15.31:0/2453772447 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe93c016070 con 0x7fe9440a2540 2024-04-18T10:36:08.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.986+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe944057a60 con 0x7fe9440a2540 2024-04-18T10:36:08.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:08.993+0000 7fe9417fa700 1 -- 172.21.15.31:0/2453772447 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe93c016020 con 0x7fe9440a2540 2024-04-18T10:36:09.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.002+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 >> v1:172.21.15.31:6816/39551 conn(0x7fe928038dd0 legacy=0x7fe92803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.002+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9440a2540 msgr2=0x7fe9441338f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.002+0000 7fe9495a1700 1 --2- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9440a2540 0x7fe9441338f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe93c00c000 tx=0x7fe93c0091d0).stop 2024-04-18T10:36:09.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.002+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 shutdown_connections 2024-04-18T10:36:09.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.002+0000 7fe9495a1700 1 --2- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe9440a2540 0x7fe9441338f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.002+0000 7fe9495a1700 1 --2- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9440a3ef0 0x7fe9440968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.002+0000 7fe9495a1700 1 --2- 172.21.15.31:0/2453772447 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe9441363a0 0x7fe944133400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.002+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 >> 172.21.15.31:0/2453772447 conn(0x7fe944060940 msgr2=0x7fe944136fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:09.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.002+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 shutdown_connections 2024-04-18T10:36:09.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.003+0000 7fe9495a1700 1 -- 172.21.15.31:0/2453772447 wait complete. 2024-04-18T10:36:09.008 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 3 and data pool 4 2024-04-18T10:36:09.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:09.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.139+0000 7fbdb4059700 1 Processor -- start 2024-04-18T10:36:09.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.139+0000 7fbdb4059700 1 -- start start 2024-04-18T10:36:09.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb4059700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac133970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb4059700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac0a82c0 0x7fbdac05ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb4059700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac139bc0 con 0x7fbdac05d300 2024-04-18T10:36:09.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb4059700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac139e60 con 0x7fbdac0a82c0 2024-04-18T10:36:09.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb4059700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1398f0 con 0x7fbdac133590 2024-04-18T10:36:09.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb1df5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb15f4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac0a82c0 0x7fbdac05ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb25f6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbdac05d300 0x7fbdac0ac480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56604/0 (socket says 172.21.15.31:56604) 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb25f6700 1 -- 172.21.15.31:0/1424157439 learned_addr learned my addr 172.21.15.31:0/1424157439 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb1df5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac133970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46378/0 (socket says 172.21.15.31:46378) 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb15f4700 1 -- 172.21.15.31:0/1424157439 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 msgr2=0x7fbdac133970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb15f4700 1 --2- 172.21.15.31:0/1424157439 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac133970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb0df3700 1 -- 172.21.15.31:0/1424157439 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877263174 0 0) 0x7fbdac139bc0 con 0x7fbdac05d300 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb15f4700 1 -- 172.21.15.31:0/1424157439 >> v1:172.21.15.31:6789/0 conn(0x7fbdac05d300 legacy=0x7fbdac0ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb15f4700 1 -- 172.21.15.31:0/1424157439 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac0a86c0 con 0x7fbdac0a82c0 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb1df5700 1 --2- 172.21.15.31:0/1424157439 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb15f4700 1 --2- 172.21.15.31:0/1424157439 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac0a82c0 0x7fbdac05ce10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fbda8002f70 tx=0x7fbda8006df0).ready entity=mon.1 client_cookie=814ffd33cfb2db92 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.140+0000 7fbdb0df3700 1 -- 172.21.15.31:0/1424157439 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda800d570 con 0x7fbdac0a82c0 2024-04-18T10:36:09.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb0df3700 1 -- 172.21.15.31:0/1424157439 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8000e90 con 0x7fbdac0a82c0 2024-04-18T10:36:09.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb0df3700 1 -- 172.21.15.31:0/1424157439 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda800d8c0 con 0x7fbdac0a82c0 2024-04-18T10:36:09.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb4059700 1 -- 172.21.15.31:0/1424157439 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac0a82c0 msgr2=0x7fbdac05ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb4059700 1 --2- 172.21.15.31:0/1424157439 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac0a82c0 0x7fbdac05ce10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fbda8002f70 tx=0x7fbda8006df0).stop 2024-04-18T10:36:09.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb4059700 1 -- 172.21.15.31:0/1424157439 shutdown_connections 2024-04-18T10:36:09.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb4059700 1 --2- 172.21.15.31:0/1424157439 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac133970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb4059700 1 --2- 172.21.15.31:0/1424157439 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac0a82c0 0x7fbdac05ce10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb4059700 1 -- 172.21.15.31:0/1424157439 >> 172.21.15.31:0/1424157439 conn(0x7fbdac061480 msgr2=0x7fbdac066a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:09.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb4059700 1 -- 172.21.15.31:0/1424157439 shutdown_connections 2024-04-18T10:36:09.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.141+0000 7fbdb4059700 1 -- 172.21.15.31:0/1424157439 wait complete. 2024-04-18T10:36:09.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.142+0000 7fbdb4059700 1 Processor -- start 2024-04-18T10:36:09.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.142+0000 7fbdb4059700 1 -- start start 2024-04-18T10:36:09.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb4059700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac05d300 0x7fbdac12ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb4059700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac0a82c0 0x7fbdac1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb4059700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac1497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb4059700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac130230 con 0x7fbdac0a82c0 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb4059700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac12f680 con 0x7fbdac05d300 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb4059700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac12f110 con 0x7fbdac133590 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb15f4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac0a82c0 0x7fbdac1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb25f6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac1497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb1df5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac05d300 0x7fbdac12ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb15f4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac0a82c0 0x7fbdac1492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35494/0 (socket says 172.21.15.31:35494) 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb15f4700 1 -- 172.21.15.31:0/39549027 learned_addr learned my addr 172.21.15.31:0/39549027 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb25f6700 1 -- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac05d300 msgr2=0x7fbdac12ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb25f6700 1 --2- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac05d300 0x7fbdac12ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb25f6700 1 -- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac0a82c0 msgr2=0x7fbdac1492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb25f6700 1 --2- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac0a82c0 0x7fbdac1492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb25f6700 1 -- 172.21.15.31:0/39549027 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c00b180 con 0x7fbdac133590 2024-04-18T10:36:09.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb15f4700 1 --2- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac0a82c0 0x7fbdac1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:09.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb25f6700 1 --2- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac1497c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fbdac1390f0 tx=0x7fbda4007f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:09.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbd9affd700 1 -- 172.21.15.31:0/39549027 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda400ce70 con 0x7fbdac133590 2024-04-18T10:36:09.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbd9affd700 1 -- 172.21.15.31:0/39549027 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda4005ba0 con 0x7fbdac133590 2024-04-18T10:36:09.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda800b180 con 0x7fbdac133590 2024-04-18T10:36:09.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbd9affd700 1 -- 172.21.15.31:0/39549027 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbda40048a0 con 0x7fbdac133590 2024-04-18T10:36:09.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.143+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac130480 con 0x7fbdac133590 2024-04-18T10:36:09.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.144+0000 7fbd9affd700 1 -- 172.21.15.31:0/39549027 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbda4004a00 con 0x7fbdac133590 2024-04-18T10:36:09.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.144+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac05da20 con 0x7fbdac133590 2024-04-18T10:36:09.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.144+0000 7fbd9affd700 1 -- 172.21.15.31:0/39549027 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbda404a390 con 0x7fbdac133590 2024-04-18T10:36:09.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.148+0000 7fbd9affd700 1 -- 172.21.15.31:0/39549027 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbda402f1f0 con 0x7fbdac133590 2024-04-18T10:36:09.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.265+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdac057a60 con 0x7fbdac133590 2024-04-18T10:36:09.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.265+0000 7fbd9affd700 1 -- 172.21.15.31:0/39549027 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10549 (secure 0 0 0) 0x7fbda4032810 con 0x7fbdac133590 2024-04-18T10:36:09.265 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:09.265 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:08.987233+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:09.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 >> v1:172.21.15.31:6816/39551 conn(0x7fbd8c038f50 legacy=0x7fbd8c03b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 msgr2=0x7fbdac1497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 --2- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac1497c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fbdac1390f0 tx=0x7fbda4007f20).stop 2024-04-18T10:36:09.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 shutdown_connections 2024-04-18T10:36:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 --2- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbdac133590 0x7fbdac1497c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 --2- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbdac05d300 0x7fbdac12ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 --2- 172.21.15.31:0/39549027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdac0a82c0 0x7fbdac1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 >> 172.21.15.31:0/39549027 conn(0x7fbdac061480 msgr2=0x7fbdac1352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 shutdown_connections 2024-04-18T10:36:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.267+0000 7fbdb4059700 1 -- 172.21.15.31:0/39549027 wait complete. 2024-04-18T10:36:09.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:09.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.383+0000 7f3188316700 1 Processor -- start 2024-04-18T10:36:09.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.383+0000 7f3188316700 1 -- start start 2024-04-18T10:36:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f3188316700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f318005bb30 0x7f3180063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f3188316700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3180062400 0x7f3180140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f3188316700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3180062b80 con 0x7f3180061fe0 2024-04-18T10:36:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f3188316700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3180062e60 con 0x7f3180062400 2024-04-18T10:36:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f3188316700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3180139a40 con 0x7f318005bb30 2024-04-18T10:36:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31860b2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f318005bb30 0x7f3180063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31868b3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3180062400 0x7f3180140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31860b2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f318005bb30 0x7f3180063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46390/0 (socket says 172.21.15.31:46390) 2024-04-18T10:36:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31858b1700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3180061fe0 0x7f3180139fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56608/0 (socket says 172.21.15.31:56608) 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31868b3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3180062400 0x7f3180140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35506/0 (socket says 172.21.15.31:35506) 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31860b2700 1 -- 172.21.15.31:0/2372308285 learned_addr learned my addr 172.21.15.31:0/2372308285 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31868b3700 1 -- 172.21.15.31:0/2372308285 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f318005bb30 msgr2=0x7f3180063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31868b3700 1 --2- 172.21.15.31:0/2372308285 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f318005bb30 0x7f3180063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31868b3700 1 -- 172.21.15.31:0/2372308285 >> v1:172.21.15.31:6789/0 conn(0x7f3180061fe0 legacy=0x7f3180139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31868b3700 1 -- 172.21.15.31:0/2372308285 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3180139d00 con 0x7f3180062400 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31850b0700 1 -- 172.21.15.31:0/2372308285 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339612421 0 0) 0x7f3180062b80 con 0x7f3180061fe0 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31860b2700 1 --2- 172.21.15.31:0/2372308285 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f318005bb30 0x7f3180063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.384+0000 7f31868b3700 1 --2- 172.21.15.31:0/2372308285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3180062400 0x7f3180140c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f31780032f0 tx=0x7f31780091d0).ready entity=mon.0 client_cookie=64fec4ab104a0a45 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f31850b0700 1 -- 172.21.15.31:0/2372308285 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f317800b6c0 con 0x7f3180062400 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f31850b0700 1 -- 172.21.15.31:0/2372308285 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317800b820 con 0x7f3180062400 2024-04-18T10:36:09.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f31850b0700 1 -- 172.21.15.31:0/2372308285 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f317800b990 con 0x7f3180062400 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f3188316700 1 -- 172.21.15.31:0/2372308285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3180062400 msgr2=0x7f3180140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f3188316700 1 --2- 172.21.15.31:0/2372308285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3180062400 0x7f3180140c40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f31780032f0 tx=0x7f31780091d0).stop 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f3188316700 1 -- 172.21.15.31:0/2372308285 shutdown_connections 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f3188316700 1 --2- 172.21.15.31:0/2372308285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3180062400 0x7f3180140c40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f3188316700 1 --2- 172.21.15.31:0/2372308285 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f318005bb30 0x7f3180063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f3188316700 1 -- 172.21.15.31:0/2372308285 >> 172.21.15.31:0/2372308285 conn(0x7f318006c0c0 msgr2=0x7f318006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f3188316700 1 -- 172.21.15.31:0/2372308285 shutdown_connections 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.385+0000 7f3188316700 1 -- 172.21.15.31:0/2372308285 wait complete. 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.386+0000 7f3188316700 1 Processor -- start 2024-04-18T10:36:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.386+0000 7f3188316700 1 -- start start 2024-04-18T10:36:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f3188316700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f318005bb30 0x7f3180096190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f3188316700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3180061fe0 0x7f31801493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f3188316700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3180093d70 0x7f31801498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f3188316700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180095d40 con 0x7f318005bb30 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f3188316700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31800955d0 con 0x7f3180061fe0 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f3188316700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3180094200 con 0x7f3180093d70 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31860b2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f318005bb30 0x7f3180096190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31860b2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f318005bb30 0x7f3180096190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35508/0 (socket says 172.21.15.31:35508) 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31860b2700 1 -- 172.21.15.31:0/3124367951 learned_addr learned my addr 172.21.15.31:0/3124367951 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31868b3700 1 --2- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3180093d70 0x7f31801498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31858b1700 1 --2- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3180061fe0 0x7f31801493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31860b2700 1 -- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3180093d70 msgr2=0x7f31801498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31860b2700 1 --2- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3180093d70 0x7f31801498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31860b2700 1 -- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3180061fe0 msgr2=0x7f31801493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31860b2700 1 --2- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3180061fe0 0x7f31801493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31860b2700 1 -- 172.21.15.31:0/3124367951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317000b1e0 con 0x7f318005bb30 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.387+0000 7f31860b2700 1 --2- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f318005bb30 0x7f3180096190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3180095eb0 tx=0x7f3170006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.388+0000 7f316f7fe700 1 -- 172.21.15.31:0/3124367951 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3170012600 con 0x7f318005bb30 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.388+0000 7f316f7fe700 1 -- 172.21.15.31:0/3124367951 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170012760 con 0x7f318005bb30 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.388+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3178009470 con 0x7f318005bb30 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.388+0000 7f316f7fe700 1 -- 172.21.15.31:0/3124367951 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3170012ac0 con 0x7f318005bb30 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.388+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3180136c60 con 0x7f318005bb30 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.389+0000 7f316f7fe700 1 -- 172.21.15.31:0/3124367951 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3170022070 con 0x7f318005bb30 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.389+0000 7f316f7fe700 1 -- 172.21.15.31:0/3124367951 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f317004acf0 con 0x7f318005bb30 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.389+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318005bf10 con 0x7f318005bb30 2024-04-18T10:36:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.392+0000 7f316f7fe700 1 -- 172.21.15.31:0/3124367951 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3170033620 con 0x7f318005bb30 2024-04-18T10:36:09.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.508+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3180057a60 con 0x7f318005bb30 2024-04-18T10:36:09.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.509+0000 7f316f7fe700 1 -- 172.21.15.31:0/3124367951 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10549 (secure 0 0 0) 0x7f3170033230 con 0x7f318005bb30 2024-04-18T10:36:09.508 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:09.508 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:08.987233+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:09.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 >> v1:172.21.15.31:6816/39551 conn(0x7f3160038dd0 legacy=0x7f316003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f318005bb30 msgr2=0x7f3180096190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 --2- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f318005bb30 0x7f3180096190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3180095eb0 tx=0x7f3170006eb0).stop 2024-04-18T10:36:09.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 shutdown_connections 2024-04-18T10:36:09.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 --2- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3180093d70 0x7f31801498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 --2- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f318005bb30 0x7f3180096190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 --2- 172.21.15.31:0/3124367951 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3180061fe0 0x7f31801493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 >> 172.21.15.31:0/3124367951 conn(0x7f318006c0c0 msgr2=0x7f318006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:09.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 shutdown_connections 2024-04-18T10:36:09.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.510+0000 7f3188316700 1 -- 172.21.15.31:0/3124367951 wait complete. 2024-04-18T10:36:09.520 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-18T10:36:09.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.629+0000 7f73336e8700 1 Processor -- start 2024-04-18T10:36:09.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.629+0000 7f73336e8700 1 -- start start 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f73336e8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f732c0aa5c0 0x7f732c0aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f73336e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c1340e0 0x7f732c063d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f73336e8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c137660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f73336e8700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c0aae90 con 0x7f732c0aa5c0 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f73336e8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c064dc0 con 0x7f732c1340e0 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f73336e8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f732c0650a0 con 0x7f732c1344e0 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331c85700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c137660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7330c83700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c1340e0 0x7f732c063d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331484700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f732c0aa5c0 0x7f732c0aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7330c83700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c1340e0 0x7f732c063d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60730/0 (socket says 172.21.15.31:60730) 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331c85700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c137660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46408/0 (socket says 172.21.15.31:46408) 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7330c83700 1 -- 172.21.15.31:0/3723558941 learned_addr learned my addr 172.21.15.31:0/3723558941 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331484700 1 -- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 msgr2=0x7f732c137660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331484700 1 --2- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c137660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331484700 1 -- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c1340e0 msgr2=0x7f732c063d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331484700 1 --2- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c1340e0 0x7f732c063d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331484700 1 -- 172.21.15.31:0/3723558941 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c1349a0 con 0x7f732c0aa5c0 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331c85700 1 --2- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7330c83700 1 --2- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c1340e0 0x7f732c063d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f7331484700 1 --2- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732c0aa5c0 0x7f732c0aa9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f731c002f70 tx=0x7f731c006df0).ready entity=mon.0 client_cookie=ffd8920f475bff8d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f731bfff700 1 -- 172.21.15.31:0/3723558941 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f731c00d4a0 con 0x7f732c0aa5c0 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.630+0000 7f731bfff700 1 -- 172.21.15.31:0/3723558941 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c000e90 con 0x7f732c0aa5c0 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f731bfff700 1 -- 172.21.15.31:0/3723558941 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f731c00d7f0 con 0x7f732c0aa5c0 2024-04-18T10:36:09.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f73336e8700 1 -- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732c0aa5c0 msgr2=0x7f732c0aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f73336e8700 1 --2- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732c0aa5c0 0x7f732c0aa9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f731c002f70 tx=0x7f731c006df0).stop 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f73336e8700 1 -- 172.21.15.31:0/3723558941 shutdown_connections 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f73336e8700 1 --2- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c137660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f73336e8700 1 --2- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732c0aa5c0 0x7f732c0aa9a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f73336e8700 1 --2- 172.21.15.31:0/3723558941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c1340e0 0x7f732c063d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f73336e8700 1 -- 172.21.15.31:0/3723558941 >> 172.21.15.31:0/3723558941 conn(0x7f732c06c0c0 msgr2=0x7f732c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f73336e8700 1 -- 172.21.15.31:0/3723558941 shutdown_connections 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.631+0000 7f73336e8700 1 -- 172.21.15.31:0/3723558941 wait complete. 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.632+0000 7f73336e8700 1 Processor -- start 2024-04-18T10:36:09.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.632+0000 7f73336e8700 1 -- start start 2024-04-18T10:36:09.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f73336e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c0aa5c0 0x7f732c098360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f73336e8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732c1340e0 0x7f732c098c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f73336e8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f73336e8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c099150 con 0x7f732c1340e0 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f73336e8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c061c60 con 0x7f732c0aa5c0 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f73336e8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f732c0999e0 con 0x7f732c1344e0 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331484700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c0aa5c0 0x7f732c098360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331c85700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331484700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c0aa5c0 0x7f732c098360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60744/0 (socket says 172.21.15.31:60744) 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331484700 1 -- 172.21.15.31:0/2050860754 learned_addr learned my addr 172.21.15.31:0/2050860754 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7330c83700 1 --2- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732c1340e0 0x7f732c098c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331484700 1 -- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 msgr2=0x7f732c146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331484700 1 --2- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331484700 1 -- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732c1340e0 msgr2=0x7f732c098c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331484700 1 --2- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732c1340e0 0x7f732c098c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331484700 1 -- 172.21.15.31:0/2050860754 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732800b1e0 con 0x7f732c0aa5c0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331c85700 1 --2- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f7331484700 1 --2- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c0aa5c0 0x7f732c098360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f732c097c50 tx=0x7f731c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f731a7fc700 1 -- 172.21.15.31:0/2050860754 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f731c013a40 con 0x7f732c0aa5c0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f731a7fc700 1 -- 172.21.15.31:0/2050860754 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c013ba0 con 0x7f732c0aa5c0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f731a7fc700 1 -- 172.21.15.31:0/2050860754 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f731c01e400 con 0x7f732c0aa5c0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.633+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7324009470 con 0x7f732c0aa5c0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.634+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c00b180 con 0x7f732c0aa5c0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.634+0000 7f731a7fc700 1 -- 172.21.15.31:0/2050860754 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f731c025030 con 0x7f732c0aa5c0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.634+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732c134c40 con 0x7f732c0aa5c0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.635+0000 7f731a7fc700 1 -- 172.21.15.31:0/2050860754 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f731c04b730 con 0x7f732c0aa5c0 2024-04-18T10:36:09.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.638+0000 7f731a7fc700 1 -- 172.21.15.31:0/2050860754 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f731c005e20 con 0x7f732c0aa5c0 2024-04-18T10:36:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.790+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f732c057a60 con 0x7f732c0aa5c0 2024-04-18T10:36:09.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.995+0000 7f731a7fc700 1 -- 172.21.15.31:0/2050860754 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f731c023030 con 0x7f732c0aa5c0 2024-04-18T10:36:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.998+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 >> v1:172.21.15.31:6816/39551 conn(0x7f730c038da0 legacy=0x7f730c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.998+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c0aa5c0 msgr2=0x7f732c098360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:09.998+0000 7f73336e8700 1 --2- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c0aa5c0 0x7f732c098360 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f732c097c50 tx=0x7f731c014000).stop 2024-04-18T10:36:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.000+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 shutdown_connections 2024-04-18T10:36:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.000+0000 7f73336e8700 1 --2- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f732c1344e0 0x7f732c146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.000+0000 7f73336e8700 1 --2- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f732c0aa5c0 0x7f732c098360 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0x7f732c097c50 tx=0x7f731c014000).stop 2024-04-18T10:36:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.000+0000 7f73336e8700 1 --2- 172.21.15.31:0/2050860754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f732c1340e0 0x7f732c098c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:09.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.000+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 >> 172.21.15.31:0/2050860754 conn(0x7f732c06c0c0 msgr2=0x7f732c09b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:10.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.000+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 shutdown_connections 2024-04-18T10:36:10.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.000+0000 7f73336e8700 1 -- 172.21.15.31:0/2050860754 wait complete. 2024-04-18T10:36:10.010 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 2} 2024-04-18T10:36:10.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-04-18T10:36:10.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.120+0000 7f25d3006700 1 Processor -- start 2024-04-18T10:36:10.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.120+0000 7f25d3006700 1 -- start start 2024-04-18T10:36:10.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d3006700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc05bb30 0x7f25cc063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:10.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d3006700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25cc062400 0x7f25cc140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:10.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d3006700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc062b80 con 0x7f25cc061fe0 2024-04-18T10:36:10.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d3006700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc062e60 con 0x7f25cc062400 2024-04-18T10:36:10.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d3006700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc139a40 con 0x7f25cc05bb30 2024-04-18T10:36:10.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d0da2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc05bb30 0x7f25cc063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:10.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d15a3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25cc062400 0x7f25cc140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:10.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d0da2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc05bb30 0x7f25cc063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46418/0 (socket says 172.21.15.31:46418) 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d15a3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25cc062400 0x7f25cc140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35534/0 (socket says 172.21.15.31:35534) 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25cbfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f25cc061fe0 0x7f25cc139fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56622/0 (socket says 172.21.15.31:56622) 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d0da2700 1 -- 172.21.15.31:0/4185065894 learned_addr learned my addr 172.21.15.31:0/4185065894 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d15a3700 1 -- 172.21.15.31:0/4185065894 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc05bb30 msgr2=0x7f25cc063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d15a3700 1 --2- 172.21.15.31:0/4185065894 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc05bb30 0x7f25cc063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d15a3700 1 -- 172.21.15.31:0/4185065894 >> v1:172.21.15.31:6789/0 conn(0x7f25cc061fe0 legacy=0x7f25cc139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d15a3700 1 -- 172.21.15.31:0/4185065894 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc139d00 con 0x7f25cc062400 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25cb7fe700 1 -- 172.21.15.31:0/4185065894 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054721495 0 0) 0x7f25cc062b80 con 0x7f25cc061fe0 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d0da2700 1 --2- 172.21.15.31:0/4185065894 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc05bb30 0x7f25cc063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25d15a3700 1 --2- 172.21.15.31:0/4185065894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc062400 0x7f25cc140c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f25c40032f0 tx=0x7f25c40091d0).ready entity=mon.0 client_cookie=34bff9f37c66944b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.121+0000 7f25cb7fe700 1 -- 172.21.15.31:0/4185065894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25c400b6c0 con 0x7f25cc062400 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25cb7fe700 1 -- 172.21.15.31:0/4185065894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c400b820 con 0x7f25cc062400 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25cb7fe700 1 -- 172.21.15.31:0/4185065894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25c400b990 con 0x7f25cc062400 2024-04-18T10:36:10.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25d3006700 1 -- 172.21.15.31:0/4185065894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc062400 msgr2=0x7f25cc140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:10.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25d3006700 1 --2- 172.21.15.31:0/4185065894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc062400 0x7f25cc140c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f25c40032f0 tx=0x7f25c40091d0).stop 2024-04-18T10:36:10.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25d3006700 1 -- 172.21.15.31:0/4185065894 shutdown_connections 2024-04-18T10:36:10.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25d3006700 1 --2- 172.21.15.31:0/4185065894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc062400 0x7f25cc140c40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:10.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25d3006700 1 --2- 172.21.15.31:0/4185065894 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc05bb30 0x7f25cc063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:10.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25d3006700 1 -- 172.21.15.31:0/4185065894 >> 172.21.15.31:0/4185065894 conn(0x7f25cc06c0c0 msgr2=0x7f25cc06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:10.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25d3006700 1 -- 172.21.15.31:0/4185065894 shutdown_connections 2024-04-18T10:36:10.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.122+0000 7f25d3006700 1 -- 172.21.15.31:0/4185065894 wait complete. 2024-04-18T10:36:10.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.123+0000 7f25d3006700 1 Processor -- start 2024-04-18T10:36:10.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.123+0000 7f25d3006700 1 -- start start 2024-04-18T10:36:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d3006700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc05bb30 0x7f25cc096190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d3006700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25cc061fe0 0x7f25cc1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d3006700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc093d70 0x7f25cc1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d3006700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc095d40 con 0x7f25cc05bb30 2024-04-18T10:36:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d3006700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0955d0 con 0x7f25cc061fe0 2024-04-18T10:36:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d3006700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc094200 con 0x7f25cc093d70 2024-04-18T10:36:10.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d0da2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc05bb30 0x7f25cc096190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d0da2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc05bb30 0x7f25cc096190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35544/0 (socket says 172.21.15.31:35544) 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d0da2700 1 -- 172.21.15.31:0/4196349535 learned_addr learned my addr 172.21.15.31:0/4196349535 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d15a3700 1 --2- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc093d70 0x7f25cc1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25cbfff700 1 --2- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25cc061fe0 0x7f25cc1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d15a3700 1 -- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25cc061fe0 msgr2=0x7f25cc1493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d15a3700 1 --2- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25cc061fe0 0x7f25cc1493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d15a3700 1 -- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc05bb30 msgr2=0x7f25cc096190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d15a3700 1 --2- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc05bb30 0x7f25cc096190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d15a3700 1 -- 172.21.15.31:0/4196349535 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c000b1e0 con 0x7f25cc093d70 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d15a3700 1 --2- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc093d70 0x7f25cc1498a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f25cc095eb0 tx=0x7f25c4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25c9ffb700 1 -- 172.21.15.31:0/4196349535 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25c400b6c0 con 0x7f25cc093d70 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25c9ffb700 1 -- 172.21.15.31:0/4196349535 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c40205f0 con 0x7f25cc093d70 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c4009470 con 0x7f25cc093d70 2024-04-18T10:36:10.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25c9ffb700 1 -- 172.21.15.31:0/4196349535 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25c4020950 con 0x7f25cc093d70 2024-04-18T10:36:10.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.124+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc094550 con 0x7f25cc093d70 2024-04-18T10:36:10.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.125+0000 7f25c9ffb700 1 -- 172.21.15.31:0/4196349535 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f25c401e070 con 0x7f25cc093d70 2024-04-18T10:36:10.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.125+0000 7f25c9ffb700 1 -- 172.21.15.31:0/4196349535 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f25c404b5b0 con 0x7f25cc093d70 2024-04-18T10:36:10.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.125+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc136420 con 0x7f25cc093d70 2024-04-18T10:36:10.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.129+0000 7f25c9ffb700 1 -- 172.21.15.31:0/4196349535 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f25c4020ab0 con 0x7f25cc093d70 2024-04-18T10:36:10.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.278+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f25cc05bf10 con 0x7f25cc093d70 2024-04-18T10:36:10.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.996+0000 7f25c9ffb700 1 -- 172.21.15.31:0/4196349535 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f25c4025020 con 0x7f25cc093d70 2024-04-18T10:36:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.999+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 >> v1:172.21.15.31:6816/39551 conn(0x7f25ac038dd0 legacy=0x7f25ac03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.999+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc093d70 msgr2=0x7f25cc1498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.999+0000 7f25d3006700 1 --2- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc093d70 0x7f25cc1498a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f25cc095eb0 tx=0x7f25c4016000).stop 2024-04-18T10:36:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.999+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 shutdown_connections 2024-04-18T10:36:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.999+0000 7f25d3006700 1 --2- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f25cc093d70 0x7f25cc1498a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.999+0000 7f25d3006700 1 --2- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25cc05bb30 0x7f25cc096190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.999+0000 7f25d3006700 1 --2- 172.21.15.31:0/4196349535 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f25cc061fe0 0x7f25cc1493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:10.999+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 >> 172.21.15.31:0/4196349535 conn(0x7f25cc06c0c0 msgr2=0x7f25cc06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:11.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.000+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 shutdown_connections 2024-04-18T10:36:11.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.000+0000 7f25d3006700 1 -- 172.21.15.31:0/4196349535 wait complete. 2024-04-18T10:36:11.017 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-18T10:36:11.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.133+0000 7f007e4f2700 1 Processor -- start 2024-04-18T10:36:11.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.133+0000 7f007e4f2700 1 -- start start 2024-04-18T10:36:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f007e4f2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0078067400 0x7f0078136d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f007e4f2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078141060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f007e4f2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0078060920 con 0x7f00781369a0 2024-04-18T10:36:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f007e4f2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0078061910 con 0x7f0078067400 2024-04-18T10:36:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f007e4f2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0078136310 con 0x7f007813ec70 2024-04-18T10:36:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f007ca8f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f00777fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0078067400 0x7f0078136d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f0077fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f00781369a0 0x7f0078061200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56632/0 (socket says 172.21.15.31:56632) 2024-04-18T10:36:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f00777fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0078067400 0x7f0078136d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35558/0 (socket says 172.21.15.31:35558) 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f0077fff700 1 -- 172.21.15.31:0/2768183386 learned_addr learned my addr 172.21.15.31:0/2768183386 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f007ca8f700 1 --2- 172.21.15.31:0/2768183386 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46428/0 (socket says 172.21.15.31:46428) 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f00777fe700 1 -- 172.21.15.31:0/2768183386 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 msgr2=0x7f0078141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f00777fe700 1 --2- 172.21.15.31:0/2768183386 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f00777fe700 1 -- 172.21.15.31:0/2768183386 >> v1:172.21.15.31:6789/0 conn(0x7f00781369a0 legacy=0x7f0078061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f00777fe700 1 -- 172.21.15.31:0/2768183386 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078137270 con 0x7f0078067400 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f007ca8f700 1 --2- 172.21.15.31:0/2768183386 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f0076ffd700 1 -- 172.21.15.31:0/2768183386 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494942463 0 0) 0x7f0078060920 con 0x7f00781369a0 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f00777fe700 1 --2- 172.21.15.31:0/2768183386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0078067400 0x7f0078136d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0068002f70 tx=0x7f0068006df0).ready entity=mon.0 client_cookie=45ac2be03e399cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f0076ffd700 1 -- 172.21.15.31:0/2768183386 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006800d570 con 0x7f0078067400 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f0076ffd700 1 -- 172.21.15.31:0/2768183386 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068000e90 con 0x7f0078067400 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.134+0000 7f0076ffd700 1 -- 172.21.15.31:0/2768183386 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006800d8c0 con 0x7f0078067400 2024-04-18T10:36:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.135+0000 7f007e4f2700 1 -- 172.21.15.31:0/2768183386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0078067400 msgr2=0x7f0078136d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.135+0000 7f007e4f2700 1 --2- 172.21.15.31:0/2768183386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0078067400 0x7f0078136d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0068002f70 tx=0x7f0068006df0).stop 2024-04-18T10:36:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.135+0000 7f007e4f2700 1 -- 172.21.15.31:0/2768183386 shutdown_connections 2024-04-18T10:36:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.135+0000 7f007e4f2700 1 --2- 172.21.15.31:0/2768183386 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.135+0000 7f007e4f2700 1 --2- 172.21.15.31:0/2768183386 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0078067400 0x7f0078136d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.135+0000 7f007e4f2700 1 -- 172.21.15.31:0/2768183386 >> 172.21.15.31:0/2768183386 conn(0x7f007806c0c0 msgr2=0x7f007806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.135+0000 7f007e4f2700 1 -- 172.21.15.31:0/2768183386 shutdown_connections 2024-04-18T10:36:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.135+0000 7f007e4f2700 1 -- 172.21.15.31:0/2768183386 wait complete. 2024-04-18T10:36:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.136+0000 7f007e4f2700 1 Processor -- start 2024-04-18T10:36:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.136+0000 7f007e4f2700 1 -- start start 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.136+0000 7f007e4f2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0078067400 0x7f0078137c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.136+0000 7f007e4f2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00781369a0 0x7f00781492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007e4f2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007e4f2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0078139b20 con 0x7f00781369a0 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007e4f2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00781392b0 con 0x7f0078067400 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007e4f2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0078138630 con 0x7f007813ec70 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f0077fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0078067400 0x7f0078137c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f00777fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00781369a0 0x7f00781492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007ca8f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f0077fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0078067400 0x7f0078137c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60762/0 (socket says 172.21.15.31:60762) 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f00777fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00781369a0 0x7f00781492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35566/0 (socket says 172.21.15.31:35566) 2024-04-18T10:36:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007ca8f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46440/0 (socket says 172.21.15.31:46440) 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f0077fff700 1 -- 172.21.15.31:0/3688120229 learned_addr learned my addr 172.21.15.31:0/3688120229 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007ca8f700 1 -- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0078067400 msgr2=0x7f0078137c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007ca8f700 1 --2- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0078067400 0x7f0078137c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007ca8f700 1 -- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00781369a0 msgr2=0x7f00781492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007ca8f700 1 --2- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00781369a0 0x7f00781492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007ca8f700 1 -- 172.21.15.31:0/3688120229 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070009470 con 0x7f007813ec70 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f00777fe700 1 --2- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00781369a0 0x7f00781492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007ca8f700 1 --2- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078149790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f007000c000 tx=0x7f00700091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f00757fa700 1 -- 172.21.15.31:0/3688120229 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007000c670 con 0x7f007813ec70 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f00757fa700 1 -- 172.21.15.31:0/3688120229 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007000c7d0 con 0x7f007813ec70 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006800b180 con 0x7f007813ec70 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f00757fa700 1 -- 172.21.15.31:0/3688120229 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007000cb30 con 0x7f007813ec70 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.137+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0078139840 con 0x7f007813ec70 2024-04-18T10:36:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.138+0000 7f00757fa700 1 -- 172.21.15.31:0/3688120229 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0070022070 con 0x7f007813ec70 2024-04-18T10:36:11.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.138+0000 7f00757fa700 1 -- 172.21.15.31:0/3688120229 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f007004af10 con 0x7f007813ec70 2024-04-18T10:36:11.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.138+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00781379a0 con 0x7f007813ec70 2024-04-18T10:36:11.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.142+0000 7f00757fa700 1 -- 172.21.15.31:0/3688120229 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f00781379a0 con 0x7f007813ec70 2024-04-18T10:36:11.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:11.291+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f00781379a0 con 0x7f007813ec70 2024-04-18T10:36:12.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.005+0000 7f00757fa700 1 -- 172.21.15.31:0/3688120229 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f00781379a0 con 0x7f007813ec70 2024-04-18T10:36:12.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.007+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 >> v1:172.21.15.31:6816/39551 conn(0x7f005c038da0 legacy=0x7f005c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.007+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 msgr2=0x7f0078149790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.007+0000 7f007e4f2700 1 --2- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078149790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f007000c000 tx=0x7f00700091d0).stop 2024-04-18T10:36:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.007+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 shutdown_connections 2024-04-18T10:36:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.007+0000 7f007e4f2700 1 --2- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f007813ec70 0x7f0078149790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.007+0000 7f007e4f2700 1 --2- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0078067400 0x7f0078137c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.007+0000 7f007e4f2700 1 --2- 172.21.15.31:0/3688120229 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00781369a0 0x7f00781492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.007+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 >> 172.21.15.31:0/3688120229 conn(0x7f007806c0c0 msgr2=0x7f007809b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.008+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 shutdown_connections 2024-04-18T10:36:12.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.008+0000 7f007e4f2700 1 -- 172.21.15.31:0/3688120229 wait complete. 2024-04-18T10:36:12.019 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-18T10:36:12.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:12.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.133+0000 7f20acdd8700 1 Processor -- start 2024-04-18T10:36:12.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.133+0000 7f20acdd8700 1 -- start start 2024-04-18T10:36:12.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20acdd8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a80655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20acdd8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a80646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20acdd8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a81343e0 con 0x7f20a8064260 2024-04-18T10:36:12.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20acdd8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a81341f0 con 0x7f20a8134d70 2024-04-18T10:36:12.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20acdd8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8064bd0 con 0x7f20a805b970 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a80646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a80655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a80646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60774/0 (socket says 172.21.15.31:60774) 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a5d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f20a8064260 0x7f20a8134660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56644/0 (socket says 172.21.15.31:56644) 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a6d9d700 1 -- 172.21.15.31:0/801178310 learned_addr learned my addr 172.21.15.31:0/801178310 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a559a700 1 -- 172.21.15.31:0/801178310 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879868303 0 0) 0x7f20a81343e0 con 0x7f20a8064260 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a6d9d700 1 -- 172.21.15.31:0/801178310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 msgr2=0x7f20a80655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a6d9d700 1 --2- 172.21.15.31:0/801178310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a80655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a6d9d700 1 -- 172.21.15.31:0/801178310 >> v1:172.21.15.31:6789/0 conn(0x7f20a8064260 legacy=0x7f20a8134660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a6d9d700 1 -- 172.21.15.31:0/801178310 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a8064e50 con 0x7f20a8134d70 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.134+0000 7f20a659c700 1 --2- 172.21.15.31:0/801178310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a80655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20a6d9d700 1 --2- 172.21.15.31:0/801178310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a80646e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f20980032f0 tx=0x7f2098009290).ready entity=mon.1 client_cookie=98c332ed8b7ea964 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:12.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20a559a700 1 -- 172.21.15.31:0/801178310 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f209800b840 con 0x7f20a8134d70 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20a559a700 1 -- 172.21.15.31:0/801178310 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209800b9a0 con 0x7f20a8134d70 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20a559a700 1 -- 172.21.15.31:0/801178310 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f209800bb10 con 0x7f20a8134d70 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20acdd8700 1 -- 172.21.15.31:0/801178310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 msgr2=0x7f20a80646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20acdd8700 1 --2- 172.21.15.31:0/801178310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a80646e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f20980032f0 tx=0x7f2098009290).stop 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20acdd8700 1 -- 172.21.15.31:0/801178310 shutdown_connections 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20acdd8700 1 --2- 172.21.15.31:0/801178310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a80646e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20acdd8700 1 --2- 172.21.15.31:0/801178310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a80655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20acdd8700 1 -- 172.21.15.31:0/801178310 >> 172.21.15.31:0/801178310 conn(0x7f20a806c0c0 msgr2=0x7f20a806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20acdd8700 1 -- 172.21.15.31:0/801178310 shutdown_connections 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.135+0000 7f20acdd8700 1 -- 172.21.15.31:0/801178310 wait complete. 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.136+0000 7f20acdd8700 1 Processor -- start 2024-04-18T10:36:12.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.136+0000 7f20acdd8700 1 -- start start 2024-04-18T10:36:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20acdd8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a8138070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20acdd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a8064260 0x7f20a812fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20acdd8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a812ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20acdd8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8092610 con 0x7f20a8064260 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20acdd8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8092810 con 0x7f20a8134d70 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20acdd8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8137b60 con 0x7f20a805b970 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a8138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a8138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46446/0 (socket says 172.21.15.31:46446) 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a6d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a812ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a659c700 1 -- 172.21.15.31:0/2663637835 learned_addr learned my addr 172.21.15.31:0/2663637835 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a5d9b700 1 --2- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a8064260 0x7f20a812fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a659c700 1 -- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 msgr2=0x7f20a812ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a659c700 1 --2- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a812ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a659c700 1 -- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a8064260 msgr2=0x7f20a812fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a659c700 1 --2- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a8064260 0x7f20a812fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a659c700 1 -- 172.21.15.31:0/2663637835 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a000b180 con 0x7f20a805b970 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20a659c700 1 --2- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a8138070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f20a000c000 tx=0x7f20a0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.137+0000 7f20977fe700 1 -- 172.21.15.31:0/2663637835 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a000c7e0 con 0x7f20a805b970 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.138+0000 7f20977fe700 1 -- 172.21.15.31:0/2663637835 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a000c940 con 0x7f20a805b970 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.138+0000 7f20977fe700 1 -- 172.21.15.31:0/2663637835 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a000cca0 con 0x7f20a805b970 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.138+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2098009530 con 0x7f20a805b970 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.138+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a8133020 con 0x7f20a805b970 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.139+0000 7f20977fe700 1 -- 172.21.15.31:0/2663637835 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f20a001c460 con 0x7f20a805b970 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.139+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a8137ea0 con 0x7f20a805b970 2024-04-18T10:36:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.139+0000 7f20977fe700 1 -- 172.21.15.31:0/2663637835 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f20a004adf0 con 0x7f20a805b970 2024-04-18T10:36:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.142+0000 7f20977fe700 1 -- 172.21.15.31:0/2663637835 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f20a0033720 con 0x7f20a805b970 2024-04-18T10:36:12.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.289+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20a8067880 con 0x7f20a805b970 2024-04-18T10:36:12.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.290+0000 7f20977fe700 1 -- 172.21.15.31:0/2663637835 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2325 (secure 0 0 0) 0x7f20a000ce00 con 0x7f20a805b970 2024-04-18T10:36:12.289 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:12.289 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:11.997545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 >> v1:172.21.15.31:6816/39551 conn(0x7f2084038da0 legacy=0x7f208403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 msgr2=0x7f20a8138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 --2- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a8138070 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f20a000c000 tx=0x7f20a0006df0).stop 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 shutdown_connections 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 --2- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f20a805b970 0x7f20a8138070 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 --2- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f20a8134d70 0x7f20a812ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 --2- 172.21.15.31:0/2663637835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f20a8064260 0x7f20a812fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 >> 172.21.15.31:0/2663637835 conn(0x7f20a806c0c0 msgr2=0x7f20a8139240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 shutdown_connections 2024-04-18T10:36:12.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.291+0000 7f20acdd8700 1 -- 172.21.15.31:0/2663637835 wait complete. 2024-04-18T10:36:12.292 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-18T10:36:12.301 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.408+0000 7f5909b95700 1 Processor -- start 2024-04-18T10:36:12.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.408+0000 7f5909b95700 1 -- start start 2024-04-18T10:36:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5909b95700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f590405bb30 0x7f5904063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5909b95700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5904061fe0 0x7f5904139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5909b95700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5904062b80 con 0x7f5904062400 2024-04-18T10:36:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5909b95700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5904062e60 con 0x7f5904061fe0 2024-04-18T10:36:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5909b95700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5904139a40 con 0x7f590405bb30 2024-04-18T10:36:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f58fbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5904061fe0 0x7f5904139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f59037fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f590405bb30 0x7f5904063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f58fbfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5904061fe0 0x7f5904139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35588/0 (socket says 172.21.15.31:35588) 2024-04-18T10:36:12.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f59037fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f590405bb30 0x7f5904063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60790/0 (socket says 172.21.15.31:60790) 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f58fbfff700 1 -- 172.21.15.31:0/794400053 learned_addr learned my addr 172.21.15.31:0/794400053 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5903fff700 1 --1- 172.21.15.31:0/794400053 >> v1:172.21.15.31:6789/0 conn(0x7f5904062400 0x7f59040a8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56656/0 (socket says 172.21.15.31:56656) 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f59037fe700 1 -- 172.21.15.31:0/794400053 >> v2:172.21.15.31:3300/0 conn(0x7f5904061fe0 msgr2=0x7f5904139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f59037fe700 1 --2- 172.21.15.31:0/794400053 >> v2:172.21.15.31:3300/0 conn(0x7f5904061fe0 0x7f5904139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f59037fe700 1 -- 172.21.15.31:0/794400053 >> v1:172.21.15.31:6789/0 conn(0x7f5904062400 legacy=0x7f59040a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f59037fe700 1 -- 172.21.15.31:0/794400053 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904139d00 con 0x7f590405bb30 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5902ffd700 1 -- 172.21.15.31:0/794400053 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160932949 0 0) 0x7f5904062b80 con 0x7f5904062400 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f58fbfff700 1 --2- 172.21.15.31:0/794400053 >> v2:172.21.15.31:3300/0 conn(0x7f5904061fe0 0x7f5904139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f59037fe700 1 --2- 172.21.15.31:0/794400053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f590405bb30 0x7f5904063360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f58f4002f70 tx=0x7f58f4006df0).ready entity=mon.1 client_cookie=3e92a497209dddc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5902ffd700 1 -- 172.21.15.31:0/794400053 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f400d570 con 0x7f590405bb30 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5902ffd700 1 -- 172.21.15.31:0/794400053 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f4000e90 con 0x7f590405bb30 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.409+0000 7f5902ffd700 1 -- 172.21.15.31:0/794400053 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f400d8c0 con 0x7f590405bb30 2024-04-18T10:36:12.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.410+0000 7f5909b95700 1 -- 172.21.15.31:0/794400053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f590405bb30 msgr2=0x7f5904063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.410+0000 7f5909b95700 1 --2- 172.21.15.31:0/794400053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f590405bb30 0x7f5904063360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f58f4002f70 tx=0x7f58f4006df0).stop 2024-04-18T10:36:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.410+0000 7f5909b95700 1 -- 172.21.15.31:0/794400053 shutdown_connections 2024-04-18T10:36:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.410+0000 7f5909b95700 1 --2- 172.21.15.31:0/794400053 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f590405bb30 0x7f5904063360 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.410+0000 7f5909b95700 1 --2- 172.21.15.31:0/794400053 >> v2:172.21.15.31:3300/0 conn(0x7f5904061fe0 0x7f5904139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.410+0000 7f5909b95700 1 -- 172.21.15.31:0/794400053 >> 172.21.15.31:0/794400053 conn(0x7f590406c0c0 msgr2=0x7f590406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.410+0000 7f5909b95700 1 -- 172.21.15.31:0/794400053 shutdown_connections 2024-04-18T10:36:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.410+0000 7f5909b95700 1 -- 172.21.15.31:0/794400053 wait complete. 2024-04-18T10:36:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.411+0000 7f5909b95700 1 Processor -- start 2024-04-18T10:36:12.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.411+0000 7f5909b95700 1 -- start start 2024-04-18T10:36:12.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.411+0000 7f5909b95700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f590405bb30 0x7f5904095e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.411+0000 7f5909b95700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5904061fe0 0x7f5904149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.411+0000 7f5909b95700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5904149530 0x7f59041499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.411+0000 7f5909b95700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5904149ed0 con 0x7f590405bb30 2024-04-18T10:36:12.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.411+0000 7f5909b95700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5904136c90 con 0x7f5904149530 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.411+0000 7f5909b95700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5904095420 con 0x7f5904061fe0 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f5903fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5904149530 0x7f59041499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f58fbfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5904061fe0 0x7f5904149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f59037fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f590405bb30 0x7f5904095e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f5903fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5904149530 0x7f59041499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60792/0 (socket says 172.21.15.31:60792) 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f5903fff700 1 -- 172.21.15.31:0/1385947831 learned_addr learned my addr 172.21.15.31:0/1385947831 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f58fbfff700 1 -- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5904149530 msgr2=0x7f59041499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f58fbfff700 1 --2- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5904149530 0x7f59041499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f58fbfff700 1 -- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f590405bb30 msgr2=0x7f5904095e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f58fbfff700 1 --2- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f590405bb30 0x7f5904095e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f58fbfff700 1 -- 172.21.15.31:0/1385947831 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec00b1e0 con 0x7f5904061fe0 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f59037fe700 1 --2- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f590405bb30 0x7f5904095e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:12.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f58fbfff700 1 --2- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5904061fe0 0x7f5904149040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5904095d20 tx=0x7f58ec006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f59017fa700 1 -- 172.21.15.31:0/1385947831 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58ec012600 con 0x7f5904061fe0 2024-04-18T10:36:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f59017fa700 1 -- 172.21.15.31:0/1385947831 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec012760 con 0x7f5904061fe0 2024-04-18T10:36:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f400b180 con 0x7f5904061fe0 2024-04-18T10:36:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f59017fa700 1 -- 172.21.15.31:0/1385947831 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58ec012ac0 con 0x7f5904061fe0 2024-04-18T10:36:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.412+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5904093df0 con 0x7f5904061fe0 2024-04-18T10:36:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.413+0000 7f59017fa700 1 -- 172.21.15.31:0/1385947831 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f58ec022070 con 0x7f5904061fe0 2024-04-18T10:36:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.413+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590405bf10 con 0x7f5904061fe0 2024-04-18T10:36:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.413+0000 7f59017fa700 1 -- 172.21.15.31:0/1385947831 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f58ec04ac90 con 0x7f5904061fe0 2024-04-18T10:36:12.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.416+0000 7f59017fa700 1 -- 172.21.15.31:0/1385947831 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f58ec033520 con 0x7f5904061fe0 2024-04-18T10:36:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.536+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5904057a60 con 0x7f5904061fe0 2024-04-18T10:36:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.536+0000 7f59017fa700 1 -- 172.21.15.31:0/1385947831 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f58ec033110 con 0x7f5904061fe0 2024-04-18T10:36:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:12.536 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:09.988938+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.537+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 >> v1:172.21.15.31:6816/39551 conn(0x7f58e8038e60 legacy=0x7f58e803b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.537+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5904061fe0 msgr2=0x7f5904149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.537+0000 7f5909b95700 1 --2- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5904061fe0 0x7f5904149040 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f5904095d20 tx=0x7f58ec006eb0).stop 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.537+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 shutdown_connections 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.538+0000 7f5909b95700 1 --2- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5904149530 0x7f59041499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.538+0000 7f5909b95700 1 --2- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f590405bb30 0x7f5904095e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.538+0000 7f5909b95700 1 --2- 172.21.15.31:0/1385947831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5904061fe0 0x7f5904149040 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.538+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 >> 172.21.15.31:0/1385947831 conn(0x7f590406c0c0 msgr2=0x7f590406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.538+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 shutdown_connections 2024-04-18T10:36:12.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.538+0000 7f5909b95700 1 -- 172.21.15.31:0/1385947831 wait complete. 2024-04-18T10:36:12.547 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-18T10:36:12.547 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:36:12.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.654+0000 7ff5d003c700 1 Processor -- start 2024-04-18T10:36:12.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.654+0000 7ff5d003c700 1 -- start start 2024-04-18T10:36:12.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5d003c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c8133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5d003c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c8063680 0x7ff5c813d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5d003c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c8063b10 con 0x7ff5c8062fb0 2024-04-18T10:36:12.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5d003c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8065150 con 0x7ff5c8064600 2024-04-18T10:36:12.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5d003c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8130bd0 con 0x7ff5c8063680 2024-04-18T10:36:12.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5ce5d9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c8063680 0x7ff5c813d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5cddd8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c8133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5cd5d7700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff5c8062fb0 0x7ff5c80a92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56668/0 (socket says 172.21.15.31:56668) 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5cd5d7700 1 -- 172.21.15.31:0/3672949380 learned_addr learned my addr 172.21.15.31:0/3672949380 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5cddd8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c8133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60796/0 (socket says 172.21.15.31:60796) 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5ce5d9700 1 --2- 172.21.15.31:0/3672949380 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c8063680 0x7ff5c813d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46458/0 (socket says 172.21.15.31:46458) 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5ce5d9700 1 -- 172.21.15.31:0/3672949380 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 msgr2=0x7ff5c8133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5ccdd6700 1 -- 172.21.15.31:0/3672949380 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653124419 0 0) 0x7ff5c8063b10 con 0x7ff5c8062fb0 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5ce5d9700 1 --2- 172.21.15.31:0/3672949380 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c8133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5ce5d9700 1 -- 172.21.15.31:0/3672949380 >> v1:172.21.15.31:6789/0 conn(0x7ff5c8062fb0 legacy=0x7ff5c80a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5ce5d9700 1 -- 172.21.15.31:0/3672949380 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c8061ee0 con 0x7ff5c8063680 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5cddd8700 1 --2- 172.21.15.31:0/3672949380 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c8133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.655+0000 7ff5ce5d9700 1 --2- 172.21.15.31:0/3672949380 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c8063680 0x7ff5c813d930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff5c00032f0 tx=0x7ff5c00091d0).ready entity=mon.2 client_cookie=5114a78101b0c80e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:12.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5ccdd6700 1 -- 172.21.15.31:0/3672949380 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c000b660 con 0x7ff5c8063680 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5ccdd6700 1 -- 172.21.15.31:0/3672949380 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c000b7c0 con 0x7ff5c8063680 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5ccdd6700 1 -- 172.21.15.31:0/3672949380 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c000b930 con 0x7ff5c8063680 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5d003c700 1 -- 172.21.15.31:0/3672949380 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c8063680 msgr2=0x7ff5c813d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5d003c700 1 --2- 172.21.15.31:0/3672949380 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c8063680 0x7ff5c813d930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff5c00032f0 tx=0x7ff5c00091d0).stop 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5d003c700 1 -- 172.21.15.31:0/3672949380 shutdown_connections 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5d003c700 1 --2- 172.21.15.31:0/3672949380 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c8063680 0x7ff5c813d930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5d003c700 1 --2- 172.21.15.31:0/3672949380 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c8133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5d003c700 1 -- 172.21.15.31:0/3672949380 >> 172.21.15.31:0/3672949380 conn(0x7ff5c806c0c0 msgr2=0x7ff5c806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5d003c700 1 -- 172.21.15.31:0/3672949380 shutdown_connections 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.656+0000 7ff5d003c700 1 -- 172.21.15.31:0/3672949380 wait complete. 2024-04-18T10:36:12.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.657+0000 7ff5d003c700 1 Processor -- start 2024-04-18T10:36:12.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.657+0000 7ff5d003c700 1 -- start start 2024-04-18T10:36:12.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5d003c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c8063680 0x7ff5c80931b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5d003c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c80941a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5d003c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c81469d0 0x7ff5c80662a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5d003c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8093ca0 con 0x7ff5c8063680 2024-04-18T10:36:12.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5d003c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8146f10 con 0x7ff5c8064600 2024-04-18T10:36:12.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5d003c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81471b0 con 0x7ff5c81469d0 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cddd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c8063680 0x7ff5c80931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cd5d7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c80941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5ce5d9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c81469d0 0x7ff5c80662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cddd8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c8063680 0x7ff5c80931b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35604/0 (socket says 172.21.15.31:35604) 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5ce5d9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c81469d0 0x7ff5c80662a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46474/0 (socket says 172.21.15.31:46474) 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cddd8700 1 -- 172.21.15.31:0/2027509966 learned_addr learned my addr 172.21.15.31:0/2027509966 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cddd8700 1 -- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c81469d0 msgr2=0x7ff5c80662a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cddd8700 1 --2- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c81469d0 0x7ff5c80662a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cddd8700 1 -- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 msgr2=0x7ff5c80941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cddd8700 1 --2- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c80941a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cddd8700 1 -- 172.21.15.31:0/2027509966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c400b180 con 0x7ff5c8063680 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cd5d7700 1 --2- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c80941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5ce5d9700 1 --2- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c81469d0 0x7ff5c80662a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5cddd8700 1 --2- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c8063680 0x7ff5c80931b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff5c400c000 tx=0x7ff5c4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.658+0000 7ff5baffd700 1 -- 172.21.15.31:0/2027509966 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c4010780 con 0x7ff5c8063680 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.659+0000 7ff5baffd700 1 -- 172.21.15.31:0/2027509966 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c40108e0 con 0x7ff5c8063680 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.659+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c0009470 con 0x7ff5c8063680 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.659+0000 7ff5baffd700 1 -- 172.21.15.31:0/2027509966 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c4010c40 con 0x7ff5c8063680 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.659+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c8094690 con 0x7ff5c8063680 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.660+0000 7ff5baffd700 1 -- 172.21.15.31:0/2027509966 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff5c401c460 con 0x7ff5c8063680 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.660+0000 7ff5baffd700 1 -- 172.21.15.31:0/2027509966 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff5c404acf0 con 0x7ff5c8063680 2024-04-18T10:36:12.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.660+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c8092df0 con 0x7ff5c8063680 2024-04-18T10:36:12.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.663+0000 7ff5baffd700 1 -- 172.21.15.31:0/2027509966 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff5c4033620 con 0x7ff5c8063680 2024-04-18T10:36:12.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.777+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 --> v1:172.21.15.31:6816/39551 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5c81336c0 con 0x7ff5a8038dd0 2024-04-18T10:36:12.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.784+0000 7ff5baffd700 1 -- 172.21.15.31:0/2027509966 <== mgr.4101 v1:172.21.15.31:6816/39551 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241202 (unknown 2965378022 0 1664244314) 0x7ff5c81336c0 con 0x7ff5a8038dd0 2024-04-18T10:36:12.786 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 >> v1:172.21.15.31:6816/39551 conn(0x7ff5a8038dd0 legacy=0x7ff5a803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c8063680 msgr2=0x7ff5c80931b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 --2- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c8063680 0x7ff5c80931b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff5c400c000 tx=0x7ff5c4006df0).stop 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 shutdown_connections 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 --2- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff5c81469d0 0x7ff5c80662a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 --2- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5c8063680 0x7ff5c80931b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 --2- 172.21.15.31:0/2027509966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff5c8064600 0x7ff5c80941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 >> 172.21.15.31:0/2027509966 conn(0x7ff5c806c0c0 msgr2=0x7ff5c805b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 shutdown_connections 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.786+0000 7ff5d003c700 1 -- 172.21.15.31:0/2027509966 wait complete. 2024-04-18T10:36:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:36:12.795 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-18T10:36:11.388066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4194848,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292512,"statfs":{"total":386547056640,"available":382251532288,"internally_reserved":4294967296,"allocated":524288,"data_stored":142760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000682"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.532138+0000","last_change":"2024-04-18T10:36:00.530860+0000","last_active":"2024-04-18T10:36:00.532138+0000","last_peered":"2024-04-18T10:36:00.532138+0000","last_clean":"2024-04-18T10:36:00.532138+0000","last_became_active":"2024-04-18T10:36:00.530496+0000","last_became_peered":"2024-04-18T10:36:00.530496+0000","last_unstale":"2024-04-18T10:36:00.532138+0000","last_undegraded":"2024-04-18T10:36:00.532138+0000","last_fullsized":"2024-04-18T10:36:00.532138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.533456+0000","last_change":"2024-04-18T10:36:00.529282+0000","last_active":"2024-04-18T10:36:00.533456+0000","last_peered":"2024-04-18T10:36:00.533456+0000","last_clean":"2024-04-18T10:36:00.533456+0000","last_became_active":"2024-04-18T10:36:00.528895+0000","last_became_peered":"2024-04-18T10:36:00.528895+0000","last_unstale":"2024-04-18T10:36:00.533456+0000","last_undegraded":"2024-04-18T10:36:00.533456+0000","last_fullsized":"2024-04-18T10:36:00.533456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.530583+0000","last_change":"2024-04-18T10:36:00.529420+0000","last_active":"2024-04-18T10:36:00.530583+0000","last_peered":"2024-04-18T10:36:00.530583+0000","last_clean":"2024-04-18T10:36:00.530583+0000","last_became_active":"2024-04-18T10:36:00.529029+0000","last_became_peered":"2024-04-18T10:36:00.529029+0000","last_unstale":"2024-04-18T10:36:00.530583+0000","last_undegraded":"2024-04-18T10:36:00.530583+0000","last_fullsized":"2024-04-18T10:36:00.530583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.533782+0000","last_change":"2024-04-18T10:36:00.530056+0000","last_active":"2024-04-18T10:36:00.533782+0000","last_peered":"2024-04-18T10:36:00.533782+0000","last_clean":"2024-04-18T10:36:00.533782+0000","last_became_active":"2024-04-18T10:36:00.529546+0000","last_became_peered":"2024-04-18T10:36:00.529546+0000","last_unstale":"2024-04-18T10:36:00.533782+0000","last_undegraded":"2024-04-18T10:36:00.533782+0000","last_fullsized":"2024-04-18T10:36:00.533782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'1","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.525331+0000","last_change":"2024-04-18T10:35:56.421744+0000","last_active":"2024-04-18T10:36:00.525331+0000","last_peered":"2024-04-18T10:36:00.525331+0000","last_clean":"2024-04-18T10:36:00.525331+0000","last_became_active":"2024-04-18T10:35:56.421316+0000","last_became_peered":"2024-04-18T10:35:56.421316+0000","last_unstale":"2024-04-18T10:36:00.525331+0000","last_undegraded":"2024-04-18T10:36:00.525331+0000","last_fullsized":"2024-04-18T10:36:00.525331+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.533460+0000","last_change":"2024-04-18T10:36:00.529398+0000","last_active":"2024-04-18T10:36:00.533460+0000","last_peered":"2024-04-18T10:36:00.533460+0000","last_clean":"2024-04-18T10:36:00.533460+0000","last_became_active":"2024-04-18T10:36:00.528912+0000","last_became_peered":"2024-04-18T10:36:00.528912+0000","last_unstale":"2024-04-18T10:36:00.533460+0000","last_undegraded":"2024-04-18T10:36:00.533460+0000","last_fullsized":"2024-04-18T10:36:00.533460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.529655+0000","last_change":"2024-04-18T10:36:00.527346+0000","last_active":"2024-04-18T10:36:00.529655+0000","last_peered":"2024-04-18T10:36:00.529655+0000","last_clean":"2024-04-18T10:36:00.529655+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:00.529655+0000","last_undegraded":"2024-04-18T10:36:00.529655+0000","last_fullsized":"2024-04-18T10:36:00.529655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.531537+0000","last_change":"2024-04-18T10:36:00.529862+0000","last_active":"2024-04-18T10:36:00.531537+0000","last_peered":"2024-04-18T10:36:00.531537+0000","last_clean":"2024-04-18T10:36:00.531537+0000","last_became_active":"2024-04-18T10:36:00.529451+0000","last_became_peered":"2024-04-18T10:36:00.529451+0000","last_unstale":"2024-04-18T10:36:00.531537+0000","last_undegraded":"2024-04-18T10:36:00.531537+0000","last_fullsized":"2024-04-18T10:36:00.531537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.529548+0000","last_change":"2024-04-18T10:36:00.527385+0000","last_active":"2024-04-18T10:36:00.529548+0000","last_peered":"2024-04-18T10:36:00.529548+0000","last_clean":"2024-04-18T10:36:00.529548+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:00.529548+0000","last_undegraded":"2024-04-18T10:36:00.529548+0000","last_fullsized":"2024-04-18T10:36:00.529548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672963,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":2,"up_from":10,"seq":42949672964,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]}]},{"osd":0,"up_from":10,"seq":42949672963,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]}]}]}} 2024-04-18T10:36:12.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:36:12.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.944+0000 7fd7d0193700 1 Processor -- start 2024-04-18T10:36:12.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.944+0000 7fd7d0193700 1 -- start start 2024-04-18T10:36:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.944+0000 7fd7d0193700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c8136710 0x7fd7c80a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.944+0000 7fd7d0193700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c805c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.944+0000 7fd7d0193700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c8066c10 con 0x7fd7c80a5000 2024-04-18T10:36:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.944+0000 7fd7d0193700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c8066eb0 con 0x7fd7c8136710 2024-04-18T10:36:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.944+0000 7fd7d0193700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c80a3b40 con 0x7fd7c8136af0 2024-04-18T10:36:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7ce730700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c805c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7cdf2f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c8136710 0x7fd7c80a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7cd72e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd7c80a5000 0x7fd7c805b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56678/0 (socket says 172.21.15.31:56678) 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7cd72e700 1 -- 172.21.15.31:0/1810227776 learned_addr learned my addr 172.21.15.31:0/1810227776 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7cdf2f700 1 -- 172.21.15.31:0/1810227776 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 msgr2=0x7fd7c805c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7cdf2f700 1 --2- 172.21.15.31:0/1810227776 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c805c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7cdf2f700 1 -- 172.21.15.31:0/1810227776 >> v1:172.21.15.31:6789/0 conn(0x7fd7c80a5000 legacy=0x7fd7c805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7ccf2d700 1 -- 172.21.15.31:0/1810227776 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586228558 0 0) 0x7fd7c8066c10 con 0x7fd7c80a5000 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7cdf2f700 1 -- 172.21.15.31:0/1810227776 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c80673f0 con 0x7fd7c8136710 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7ce730700 1 --2- 172.21.15.31:0/1810227776 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c805c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7cdf2f700 1 --2- 172.21.15.31:0/1810227776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c8136710 0x7fd7c80a3fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd7b8002f70 tx=0x7fd7b8006df0).ready entity=mon.1 client_cookie=4f72fd14cec03f2a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7ccf2d700 1 -- 172.21.15.31:0/1810227776 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7b800d570 con 0x7fd7c8136710 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7ccf2d700 1 -- 172.21.15.31:0/1810227776 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b8000e90 con 0x7fd7c8136710 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.945+0000 7fd7ccf2d700 1 -- 172.21.15.31:0/1810227776 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7b800d8c0 con 0x7fd7c8136710 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.946+0000 7fd7d0193700 1 -- 172.21.15.31:0/1810227776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c8136710 msgr2=0x7fd7c80a3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.946+0000 7fd7d0193700 1 --2- 172.21.15.31:0/1810227776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c8136710 0x7fd7c80a3fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd7b8002f70 tx=0x7fd7b8006df0).stop 2024-04-18T10:36:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.946+0000 7fd7d0193700 1 -- 172.21.15.31:0/1810227776 shutdown_connections 2024-04-18T10:36:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.946+0000 7fd7d0193700 1 --2- 172.21.15.31:0/1810227776 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c805c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.946+0000 7fd7d0193700 1 --2- 172.21.15.31:0/1810227776 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c8136710 0x7fd7c80a3fc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.946+0000 7fd7d0193700 1 -- 172.21.15.31:0/1810227776 >> 172.21.15.31:0/1810227776 conn(0x7fd7c8060ac0 msgr2=0x7fd7c80a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.946+0000 7fd7d0193700 1 -- 172.21.15.31:0/1810227776 shutdown_connections 2024-04-18T10:36:12.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.946+0000 7fd7d0193700 1 -- 172.21.15.31:0/1810227776 wait complete. 2024-04-18T10:36:12.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7d0193700 1 Processor -- start 2024-04-18T10:36:12.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7d0193700 1 -- start start 2024-04-18T10:36:12.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7d0193700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c80a5000 0x7fd7c8093050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7d0193700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7c8136710 0x7fd7c81335a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7d0193700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c8133a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:12.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7d0193700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c80a21e0 con 0x7fd7c8136710 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7d0193700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c80a24a0 con 0x7fd7c80a5000 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7d0193700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c813a130 con 0x7fd7c8136af0 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7cd72e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7c8136710 0x7fd7c81335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7ce730700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c8133a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7cdf2f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c80a5000 0x7fd7c8093050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7ce730700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c8133a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46484/0 (socket says 172.21.15.31:46484) 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7cd72e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7c8136710 0x7fd7c81335a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35616/0 (socket says 172.21.15.31:35616) 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7cdf2f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c80a5000 0x7fd7c8093050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60824/0 (socket says 172.21.15.31:60824) 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.947+0000 7fd7ce730700 1 -- 172.21.15.31:0/2952414682 learned_addr learned my addr 172.21.15.31:0/2952414682 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7cdf2f700 1 -- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 msgr2=0x7fd7c8133a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7cdf2f700 1 --2- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c8133a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7cdf2f700 1 -- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7c8136710 msgr2=0x7fd7c81335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7cdf2f700 1 --2- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7c8136710 0x7fd7c81335a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7cdf2f700 1 -- 172.21.15.31:0/2952414682 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c0009470 con 0x7fd7c80a5000 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7cdf2f700 1 --2- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c80a5000 0x7fd7c8093050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd7b8002f70 tx=0x7fd7b8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7b6ffd700 1 -- 172.21.15.31:0/2952414682 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7b8013da0 con 0x7fd7c80a5000 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7b6ffd700 1 -- 172.21.15.31:0/2952414682 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b801e400 con 0x7fd7c80a5000 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b800b180 con 0x7fd7c80a5000 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7b6ffd700 1 -- 172.21.15.31:0/2952414682 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7b801e760 con 0x7fd7c80a5000 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.948+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c80a1460 con 0x7fd7c80a5000 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.949+0000 7fd7b6ffd700 1 -- 172.21.15.31:0/2952414682 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd7b801c070 con 0x7fd7c80a5000 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.949+0000 7fd7b6ffd700 1 -- 172.21.15.31:0/2952414682 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd7b804b3b0 con 0x7fd7c80a5000 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.949+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c80a1680 con 0x7fd7c80a5000 2024-04-18T10:36:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:12.952+0000 7fd7b6ffd700 1 -- 172.21.15.31:0/2952414682 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd7c80a1680 con 0x7fd7c80a5000 2024-04-18T10:36:13.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.067+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 --> v1:172.21.15.31:6816/39551 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7c80a1680 con 0x7fd7a8038ef0 2024-04-18T10:36:13.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.074+0000 7fd7b6ffd700 1 -- 172.21.15.31:0/2952414682 <== mgr.4101 v1:172.21.15.31:6816/39551 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241202 (unknown 2965378022 0 1664244314) 0x7fd7c80a1680 con 0x7fd7a8038ef0 2024-04-18T10:36:13.076 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 >> v1:172.21.15.31:6816/39551 conn(0x7fd7a8038ef0 legacy=0x7fd7a803b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c80a5000 msgr2=0x7fd7c8093050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 --2- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c80a5000 0x7fd7c8093050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd7b8002f70 tx=0x7fd7b8014000).stop 2024-04-18T10:36:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 shutdown_connections 2024-04-18T10:36:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 --2- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7c8136af0 0x7fd7c8133a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 --2- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7c80a5000 0x7fd7c8093050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 --2- 172.21.15.31:0/2952414682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7c8136710 0x7fd7c81335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 >> 172.21.15.31:0/2952414682 conn(0x7fd7c8060ac0 msgr2=0x7fd7c80a5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:13.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 shutdown_connections 2024-04-18T10:36:13.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.076+0000 7fd7d0193700 1 -- 172.21.15.31:0/2952414682 wait complete. 2024-04-18T10:36:13.079 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:36:13.085 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-18T10:36:11.388066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4194848,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292512,"statfs":{"total":386547056640,"available":382251532288,"internally_reserved":4294967296,"allocated":524288,"data_stored":142760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000682"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.532138+0000","last_change":"2024-04-18T10:36:00.530860+0000","last_active":"2024-04-18T10:36:00.532138+0000","last_peered":"2024-04-18T10:36:00.532138+0000","last_clean":"2024-04-18T10:36:00.532138+0000","last_became_active":"2024-04-18T10:36:00.530496+0000","last_became_peered":"2024-04-18T10:36:00.530496+0000","last_unstale":"2024-04-18T10:36:00.532138+0000","last_undegraded":"2024-04-18T10:36:00.532138+0000","last_fullsized":"2024-04-18T10:36:00.532138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.533456+0000","last_change":"2024-04-18T10:36:00.529282+0000","last_active":"2024-04-18T10:36:00.533456+0000","last_peered":"2024-04-18T10:36:00.533456+0000","last_clean":"2024-04-18T10:36:00.533456+0000","last_became_active":"2024-04-18T10:36:00.528895+0000","last_became_peered":"2024-04-18T10:36:00.528895+0000","last_unstale":"2024-04-18T10:36:00.533456+0000","last_undegraded":"2024-04-18T10:36:00.533456+0000","last_fullsized":"2024-04-18T10:36:00.533456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.530583+0000","last_change":"2024-04-18T10:36:00.529420+0000","last_active":"2024-04-18T10:36:00.530583+0000","last_peered":"2024-04-18T10:36:00.530583+0000","last_clean":"2024-04-18T10:36:00.530583+0000","last_became_active":"2024-04-18T10:36:00.529029+0000","last_became_peered":"2024-04-18T10:36:00.529029+0000","last_unstale":"2024-04-18T10:36:00.530583+0000","last_undegraded":"2024-04-18T10:36:00.530583+0000","last_fullsized":"2024-04-18T10:36:00.530583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.533782+0000","last_change":"2024-04-18T10:36:00.530056+0000","last_active":"2024-04-18T10:36:00.533782+0000","last_peered":"2024-04-18T10:36:00.533782+0000","last_clean":"2024-04-18T10:36:00.533782+0000","last_became_active":"2024-04-18T10:36:00.529546+0000","last_became_peered":"2024-04-18T10:36:00.529546+0000","last_unstale":"2024-04-18T10:36:00.533782+0000","last_undegraded":"2024-04-18T10:36:00.533782+0000","last_fullsized":"2024-04-18T10:36:00.533782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'1","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.525331+0000","last_change":"2024-04-18T10:35:56.421744+0000","last_active":"2024-04-18T10:36:00.525331+0000","last_peered":"2024-04-18T10:36:00.525331+0000","last_clean":"2024-04-18T10:36:00.525331+0000","last_became_active":"2024-04-18T10:35:56.421316+0000","last_became_peered":"2024-04-18T10:35:56.421316+0000","last_unstale":"2024-04-18T10:36:00.525331+0000","last_undegraded":"2024-04-18T10:36:00.525331+0000","last_fullsized":"2024-04-18T10:36:00.525331+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.533460+0000","last_change":"2024-04-18T10:36:00.529398+0000","last_active":"2024-04-18T10:36:00.533460+0000","last_peered":"2024-04-18T10:36:00.533460+0000","last_clean":"2024-04-18T10:36:00.533460+0000","last_became_active":"2024-04-18T10:36:00.528912+0000","last_became_peered":"2024-04-18T10:36:00.528912+0000","last_unstale":"2024-04-18T10:36:00.533460+0000","last_undegraded":"2024-04-18T10:36:00.533460+0000","last_fullsized":"2024-04-18T10:36:00.533460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.529655+0000","last_change":"2024-04-18T10:36:00.527346+0000","last_active":"2024-04-18T10:36:00.529655+0000","last_peered":"2024-04-18T10:36:00.529655+0000","last_clean":"2024-04-18T10:36:00.529655+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:00.529655+0000","last_undegraded":"2024-04-18T10:36:00.529655+0000","last_fullsized":"2024-04-18T10:36:00.529655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.531537+0000","last_change":"2024-04-18T10:36:00.529862+0000","last_active":"2024-04-18T10:36:00.531537+0000","last_peered":"2024-04-18T10:36:00.531537+0000","last_clean":"2024-04-18T10:36:00.531537+0000","last_became_active":"2024-04-18T10:36:00.529451+0000","last_became_peered":"2024-04-18T10:36:00.529451+0000","last_unstale":"2024-04-18T10:36:00.531537+0000","last_undegraded":"2024-04-18T10:36:00.531537+0000","last_fullsized":"2024-04-18T10:36:00.531537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.529548+0000","last_change":"2024-04-18T10:36:00.527385+0000","last_active":"2024-04-18T10:36:00.529548+0000","last_peered":"2024-04-18T10:36:00.529548+0000","last_clean":"2024-04-18T10:36:00.529548+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:00.529548+0000","last_undegraded":"2024-04-18T10:36:00.529548+0000","last_fullsized":"2024-04-18T10:36:00.529548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672963,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":2,"up_from":10,"seq":42949672964,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]}]},{"osd":0,"up_from":10,"seq":42949672963,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]}]}]}} 2024-04-18T10:36:13.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:36:13.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.233+0000 7ff46c433700 1 Processor -- start 2024-04-18T10:36:13.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.233+0000 7ff46c433700 1 -- start start 2024-04-18T10:36:13.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46c433700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff46405bb30 0x7ff464063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46c433700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464062400 0x7ff464140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46c433700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff464062b80 con 0x7ff464061fe0 2024-04-18T10:36:13.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46c433700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff464062e60 con 0x7ff464062400 2024-04-18T10:36:13.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46c433700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff464139a40 con 0x7ff46405bb30 2024-04-18T10:36:13.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46a9d0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464062400 0x7ff464140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff4699ce700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff464061fe0 0x7ff464139fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56682/0 (socket says 172.21.15.31:56682) 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff4699ce700 1 -- 172.21.15.31:0/437068379 learned_addr learned my addr 172.21.15.31:0/437068379 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46a1cf700 1 --2- 172.21.15.31:0/437068379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff46405bb30 0x7ff464063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46a9d0700 1 -- 172.21.15.31:0/437068379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff46405bb30 msgr2=0x7ff464063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46a9d0700 1 --2- 172.21.15.31:0/437068379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff46405bb30 0x7ff464063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff4691cd700 1 -- 172.21.15.31:0/437068379 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235090834 0 0) 0x7ff464062b80 con 0x7ff464061fe0 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46a9d0700 1 -- 172.21.15.31:0/437068379 >> v1:172.21.15.31:6789/0 conn(0x7ff464061fe0 legacy=0x7ff464139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46a9d0700 1 -- 172.21.15.31:0/437068379 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464139d00 con 0x7ff464062400 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.234+0000 7ff46a1cf700 1 --2- 172.21.15.31:0/437068379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff46405bb30 0x7ff464063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:13.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff46a9d0700 1 --2- 172.21.15.31:0/437068379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464062400 0x7ff464140c40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff45c0032f0 tx=0x7ff45c0091d0).ready entity=mon.1 client_cookie=4208858c72ce88cc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff4691cd700 1 -- 172.21.15.31:0/437068379 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45c00b6c0 con 0x7ff464062400 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff4691cd700 1 -- 172.21.15.31:0/437068379 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c00b820 con 0x7ff464062400 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff4691cd700 1 -- 172.21.15.31:0/437068379 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45c00b990 con 0x7ff464062400 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff46c433700 1 -- 172.21.15.31:0/437068379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464062400 msgr2=0x7ff464140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff46c433700 1 --2- 172.21.15.31:0/437068379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464062400 0x7ff464140c40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff45c0032f0 tx=0x7ff45c0091d0).stop 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff46c433700 1 -- 172.21.15.31:0/437068379 shutdown_connections 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff46c433700 1 --2- 172.21.15.31:0/437068379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464062400 0x7ff464140c40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff46c433700 1 --2- 172.21.15.31:0/437068379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff46405bb30 0x7ff464063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff46c433700 1 -- 172.21.15.31:0/437068379 >> 172.21.15.31:0/437068379 conn(0x7ff46406c0c0 msgr2=0x7ff46406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff46c433700 1 -- 172.21.15.31:0/437068379 shutdown_connections 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.235+0000 7ff46c433700 1 -- 172.21.15.31:0/437068379 wait complete. 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.236+0000 7ff46c433700 1 Processor -- start 2024-04-18T10:36:13.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.236+0000 7ff46c433700 1 -- start start 2024-04-18T10:36:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46c433700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46405bb30 0x7ff4640a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46c433700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464061fe0 0x7ff464095390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46c433700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff464093d60 0x7ff464145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46c433700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464145d50 con 0x7ff46405bb30 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46c433700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff464094730 con 0x7ff464061fe0 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46c433700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff464094c20 con 0x7ff464093d60 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a1cf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46405bb30 0x7ff4640a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a1cf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46405bb30 0x7ff4640a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35620/0 (socket says 172.21.15.31:35620) 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a9d0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff464093d60 0x7ff464145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a1cf700 1 -- 172.21.15.31:0/3917751595 learned_addr learned my addr 172.21.15.31:0/3917751595 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff4699ce700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464061fe0 0x7ff464095390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a1cf700 1 -- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff464093d60 msgr2=0x7ff464145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a1cf700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff464093d60 0x7ff464145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a1cf700 1 -- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464061fe0 msgr2=0x7ff464095390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a1cf700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464061fe0 0x7ff464095390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a1cf700 1 -- 172.21.15.31:0/3917751595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45400b180 con 0x7ff46405bb30 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a9d0700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff464093d60 0x7ff464145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff4699ce700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464061fe0 0x7ff464095390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46a1cf700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46405bb30 0x7ff4640a8ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff464094db0 tx=0x7ff454006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff4537fe700 1 -- 172.21.15.31:0/3917751595 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45400c5f0 con 0x7ff46405bb30 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff4537fe700 1 -- 172.21.15.31:0/3917751595 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45400c750 con 0x7ff46405bb30 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c009470 con 0x7ff46405bb30 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff4537fe700 1 -- 172.21.15.31:0/3917751595 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff45400cab0 con 0x7ff46405bb30 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.237+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff464094210 con 0x7ff46405bb30 2024-04-18T10:36:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.238+0000 7ff4537fe700 1 -- 172.21.15.31:0/3917751595 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff45400cc10 con 0x7ff46405bb30 2024-04-18T10:36:13.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.238+0000 7ff4537fe700 1 -- 172.21.15.31:0/3917751595 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff45404aec0 con 0x7ff46405bb30 2024-04-18T10:36:13.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.239+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464095ac0 con 0x7ff46405bb30 2024-04-18T10:36:13.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.242+0000 7ff4537fe700 1 -- 172.21.15.31:0/3917751595 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff454033750 con 0x7ff46405bb30 2024-04-18T10:36:13.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.355+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 --> v1:172.21.15.31:6816/39551 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff46405bf10 con 0x7ff444038da0 2024-04-18T10:36:13.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.361+0000 7ff4537fe700 1 -- 172.21.15.31:0/3917751595 <== mgr.4101 v1:172.21.15.31:6816/39551 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+241202 (unknown 2965378022 0 1664244314) 0x7ff46405bf10 con 0x7ff444038da0 2024-04-18T10:36:13.363 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:13.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 >> v1:172.21.15.31:6816/39551 conn(0x7ff444038da0 legacy=0x7ff44403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46405bb30 msgr2=0x7ff4640a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46405bb30 0x7ff4640a8ad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff464094db0 tx=0x7ff454006df0).stop 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 shutdown_connections 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff464093d60 0x7ff464145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff46405bb30 0x7ff4640a8ad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 --2- 172.21.15.31:0/3917751595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff464061fe0 0x7ff464095390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 >> 172.21.15.31:0/3917751595 conn(0x7ff46406c0c0 msgr2=0x7ff464134210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 shutdown_connections 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.364+0000 7ff46c433700 1 -- 172.21.15.31:0/3917751595 wait complete. 2024-04-18T10:36:13.366 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:36:13.373 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-18T10:36:11.388066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4194848,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292512,"statfs":{"total":386547056640,"available":382251532288,"internally_reserved":4294967296,"allocated":524288,"data_stored":142760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000682"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.532138+0000","last_change":"2024-04-18T10:36:00.530860+0000","last_active":"2024-04-18T10:36:00.532138+0000","last_peered":"2024-04-18T10:36:00.532138+0000","last_clean":"2024-04-18T10:36:00.532138+0000","last_became_active":"2024-04-18T10:36:00.530496+0000","last_became_peered":"2024-04-18T10:36:00.530496+0000","last_unstale":"2024-04-18T10:36:00.532138+0000","last_undegraded":"2024-04-18T10:36:00.532138+0000","last_fullsized":"2024-04-18T10:36:00.532138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.533456+0000","last_change":"2024-04-18T10:36:00.529282+0000","last_active":"2024-04-18T10:36:00.533456+0000","last_peered":"2024-04-18T10:36:00.533456+0000","last_clean":"2024-04-18T10:36:00.533456+0000","last_became_active":"2024-04-18T10:36:00.528895+0000","last_became_peered":"2024-04-18T10:36:00.528895+0000","last_unstale":"2024-04-18T10:36:00.533456+0000","last_undegraded":"2024-04-18T10:36:00.533456+0000","last_fullsized":"2024-04-18T10:36:00.533456+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.530583+0000","last_change":"2024-04-18T10:36:00.529420+0000","last_active":"2024-04-18T10:36:00.530583+0000","last_peered":"2024-04-18T10:36:00.530583+0000","last_clean":"2024-04-18T10:36:00.530583+0000","last_became_active":"2024-04-18T10:36:00.529029+0000","last_became_peered":"2024-04-18T10:36:00.529029+0000","last_unstale":"2024-04-18T10:36:00.530583+0000","last_undegraded":"2024-04-18T10:36:00.530583+0000","last_fullsized":"2024-04-18T10:36:00.530583+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.533782+0000","last_change":"2024-04-18T10:36:00.530056+0000","last_active":"2024-04-18T10:36:00.533782+0000","last_peered":"2024-04-18T10:36:00.533782+0000","last_clean":"2024-04-18T10:36:00.533782+0000","last_became_active":"2024-04-18T10:36:00.529546+0000","last_became_peered":"2024-04-18T10:36:00.529546+0000","last_unstale":"2024-04-18T10:36:00.533782+0000","last_undegraded":"2024-04-18T10:36:00.533782+0000","last_fullsized":"2024-04-18T10:36:00.533782+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'1","reported_seq":13,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.525331+0000","last_change":"2024-04-18T10:35:56.421744+0000","last_active":"2024-04-18T10:36:00.525331+0000","last_peered":"2024-04-18T10:36:00.525331+0000","last_clean":"2024-04-18T10:36:00.525331+0000","last_became_active":"2024-04-18T10:35:56.421316+0000","last_became_peered":"2024-04-18T10:35:56.421316+0000","last_unstale":"2024-04-18T10:36:00.525331+0000","last_undegraded":"2024-04-18T10:36:00.525331+0000","last_fullsized":"2024-04-18T10:36:00.525331+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.533460+0000","last_change":"2024-04-18T10:36:00.529398+0000","last_active":"2024-04-18T10:36:00.533460+0000","last_peered":"2024-04-18T10:36:00.533460+0000","last_clean":"2024-04-18T10:36:00.533460+0000","last_became_active":"2024-04-18T10:36:00.528912+0000","last_became_peered":"2024-04-18T10:36:00.528912+0000","last_unstale":"2024-04-18T10:36:00.533460+0000","last_undegraded":"2024-04-18T10:36:00.533460+0000","last_fullsized":"2024-04-18T10:36:00.533460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.529655+0000","last_change":"2024-04-18T10:36:00.527346+0000","last_active":"2024-04-18T10:36:00.529655+0000","last_peered":"2024-04-18T10:36:00.529655+0000","last_clean":"2024-04-18T10:36:00.529655+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:00.529655+0000","last_undegraded":"2024-04-18T10:36:00.529655+0000","last_fullsized":"2024-04-18T10:36:00.529655+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.531537+0000","last_change":"2024-04-18T10:36:00.529862+0000","last_active":"2024-04-18T10:36:00.531537+0000","last_peered":"2024-04-18T10:36:00.531537+0000","last_clean":"2024-04-18T10:36:00.531537+0000","last_became_active":"2024-04-18T10:36:00.529451+0000","last_became_peered":"2024-04-18T10:36:00.529451+0000","last_unstale":"2024-04-18T10:36:00.531537+0000","last_undegraded":"2024-04-18T10:36:00.531537+0000","last_fullsized":"2024-04-18T10:36:00.531537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-18T10:36:00.529548+0000","last_change":"2024-04-18T10:36:00.527385+0000","last_active":"2024-04-18T10:36:00.529548+0000","last_peered":"2024-04-18T10:36:00.529548+0000","last_clean":"2024-04-18T10:36:00.529548+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:00.529548+0000","last_undegraded":"2024-04-18T10:36:00.529548+0000","last_fullsized":"2024-04-18T10:36:00.529548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:07.664891+0000","last_change":"2024-04-18T10:36:07.664891+0000","last_active":"2024-04-18T10:36:07.664891+0000","last_peered":"2024-04-18T10:36:07.664891+0000","last_clean":"2024-04-18T10:36:07.664891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:07.664891+0000","last_undegraded":"2024-04-18T10:36:07.664891+0000","last_fullsized":"2024-04-18T10:36:07.664891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-18T10:36:08.670552+0000","last_change":"2024-04-18T10:36:08.670552+0000","last_active":"2024-04-18T10:36:08.670552+0000","last_peered":"2024-04-18T10:36:08.670552+0000","last_clean":"2024-04-18T10:36:08.670552+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-18T10:36:08.670552+0000","last_undegraded":"2024-04-18T10:36:08.670552+0000","last_fullsized":"2024-04-18T10:36:08.670552+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672963,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":2,"up_from":10,"seq":42949672964,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]}]},{"osd":0,"up_from":10,"seq":42949672963,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672964,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048712,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323128,"statfs":{"total":96636764160,"available":95562883072,"internally_reserved":1073741824,"allocated":131072,"data_stored":35690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]}]}]}} 2024-04-18T10:36:13.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-18T10:36:13.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-18T10:36:13.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-18T10:36:13.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-18T10:36:13.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-18T10:36:13.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-18T10:36:13.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-18T10:36:13.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-18T10:36:13.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-18T10:36:13.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-18T10:36:13.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-18T10:36:13.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-18T10:36:13.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-18T10:36:13.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-18T10:36:13.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-18T10:36:13.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:07.664891+0000', 'last_change': '2024-04-18T10:36:07.664891+0000', 'last_active': '2024-04-18T10:36:07.664891+0000', 'last_peered': '2024-04-18T10:36:07.664891+0000', 'last_clean': '2024-04-18T10:36:07.664891+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:07.664891+0000', 'last_undegraded': '2024-04-18T10:36:07.664891+0000', 'last_fullsized': '2024-04-18T10:36:07.664891+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:07.664891+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-18T10:36:13.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-18T10:36:13.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-18T10:36:08.670552+0000', 'last_change': '2024-04-18T10:36:08.670552+0000', 'last_active': '2024-04-18T10:36:08.670552+0000', 'last_peered': '2024-04-18T10:36:08.670552+0000', 'last_clean': '2024-04-18T10:36:08.670552+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-18T10:36:08.670552+0000', 'last_undegraded': '2024-04-18T10:36:08.670552+0000', 'last_fullsized': '2024-04-18T10:36:08.670552+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'last_clean_scrub_stamp': '2024-04-18T10:36:08.670552+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-18T10:36:13.395 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-18T10:36:13.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.520+0000 7f481e20a700 1 Processor -- start 2024-04-18T10:36:13.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.520+0000 7f481e20a700 1 -- start start 2024-04-18T10:36:13.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.520+0000 7f481e20a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f481805bb30 0x7f4818063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.520+0000 7f481e20a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4818062400 0x7f4818140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.520+0000 7f481e20a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4818062b80 con 0x7f4818061fe0 2024-04-18T10:36:13.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.520+0000 7f481e20a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4818062e60 con 0x7f4818062400 2024-04-18T10:36:13.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.520+0000 7f481e20a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4818139a40 con 0x7f481805bb30 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.520+0000 7f48177fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f481805bb30 0x7f4818063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f4817fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4818062400 0x7f4818140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f48177fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f481805bb30 0x7f4818063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60844/0 (socket says 172.21.15.31:60844) 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f48177fe700 1 -- 172.21.15.31:0/3238447917 learned_addr learned my addr 172.21.15.31:0/3238447917 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f4817fff700 1 -- 172.21.15.31:0/3238447917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f481805bb30 msgr2=0x7f4818063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f4817fff700 1 --2- 172.21.15.31:0/3238447917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f481805bb30 0x7f4818063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f4817fff700 1 -- 172.21.15.31:0/3238447917 >> v1:172.21.15.31:6789/0 conn(0x7f4818061fe0 legacy=0x7f4818139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f4817fff700 1 -- 172.21.15.31:0/3238447917 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4818139d00 con 0x7f4818062400 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f48177fe700 1 --2- 172.21.15.31:0/3238447917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f481805bb30 0x7f4818063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f4817fff700 1 --2- 172.21.15.31:0/3238447917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4818062400 0x7f4818140c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f48100032f0 tx=0x7f48100091d0).ready entity=mon.0 client_cookie=6c4910e0b0c60a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f48167fc700 1 -- 172.21.15.31:0/3238447917 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481000b6c0 con 0x7f4818062400 2024-04-18T10:36:13.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f48167fc700 1 -- 172.21.15.31:0/3238447917 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481000b820 con 0x7f4818062400 2024-04-18T10:36:13.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.521+0000 7f48167fc700 1 -- 172.21.15.31:0/3238447917 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f481000b990 con 0x7f4818062400 2024-04-18T10:36:13.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.522+0000 7f481e20a700 1 -- 172.21.15.31:0/3238447917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4818062400 msgr2=0x7f4818140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.522+0000 7f481e20a700 1 --2- 172.21.15.31:0/3238447917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4818062400 0x7f4818140c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f48100032f0 tx=0x7f48100091d0).stop 2024-04-18T10:36:13.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.522+0000 7f481e20a700 1 -- 172.21.15.31:0/3238447917 shutdown_connections 2024-04-18T10:36:13.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.522+0000 7f481e20a700 1 --2- 172.21.15.31:0/3238447917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4818062400 0x7f4818140c40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.522+0000 7f481e20a700 1 --2- 172.21.15.31:0/3238447917 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f481805bb30 0x7f4818063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.522+0000 7f481e20a700 1 -- 172.21.15.31:0/3238447917 >> 172.21.15.31:0/3238447917 conn(0x7f481806c0c0 msgr2=0x7f481806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:13.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.522+0000 7f481e20a700 1 -- 172.21.15.31:0/3238447917 shutdown_connections 2024-04-18T10:36:13.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.522+0000 7f481e20a700 1 -- 172.21.15.31:0/3238447917 wait complete. 2024-04-18T10:36:13.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.523+0000 7f481e20a700 1 Processor -- start 2024-04-18T10:36:13.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.523+0000 7f481e20a700 1 -- start start 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f481e20a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481805bb30 0x7f4818094e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f481e20a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4818061fe0 0x7f48181495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f481e20a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4818095340 0x7f4818149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f481e20a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4818095820 con 0x7f481805bb30 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f481e20a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4818096840 con 0x7f4818095340 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f481e20a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4818094720 con 0x7f4818061fe0 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f48177fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481805bb30 0x7f4818094e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f48177fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481805bb30 0x7f4818094e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35644/0 (socket says 172.21.15.31:35644) 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f48177fe700 1 -- 172.21.15.31:0/960745469 learned_addr learned my addr 172.21.15.31:0/960745469 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f4816ffd700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4818061fe0 0x7f48181495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f48177fe700 1 -- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4818061fe0 msgr2=0x7f48181495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f48177fe700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4818061fe0 0x7f48181495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f48177fe700 1 -- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4818095340 msgr2=0x7f4818149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f4817fff700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4818095340 0x7f4818149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f48177fe700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4818095340 0x7f4818149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f48177fe700 1 -- 172.21.15.31:0/960745469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480800b1e0 con 0x7f481805bb30 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f4817fff700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4818095340 0x7f4818149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f48177fe700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481805bb30 0x7f4818094e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f480800c000 tx=0x7f4808006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f4814ff9700 1 -- 172.21.15.31:0/960745469 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4808012600 con 0x7f481805bb30 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f4814ff9700 1 -- 172.21.15.31:0/960745469 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4808012760 con 0x7f481805bb30 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4810009470 con 0x7f481805bb30 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f4814ff9700 1 -- 172.21.15.31:0/960745469 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4808012ac0 con 0x7f481805bb30 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.524+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4818095db0 con 0x7f481805bb30 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.525+0000 7f4814ff9700 1 -- 172.21.15.31:0/960745469 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4808022070 con 0x7f481805bb30 2024-04-18T10:36:13.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.525+0000 7f4814ff9700 1 -- 172.21.15.31:0/960745469 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f480804ad40 con 0x7f481805bb30 2024-04-18T10:36:13.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.525+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481805bf10 con 0x7f481805bb30 2024-04-18T10:36:13.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.529+0000 7f4814ff9700 1 -- 172.21.15.31:0/960745469 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f48080335d0 con 0x7f481805bb30 2024-04-18T10:36:13.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.685+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4818057a60 con 0x7f481805bb30 2024-04-18T10:36:13.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.685+0000 7f4814ff9700 1 -- 172.21.15.31:0/960745469 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1088 (secure 0 0 0) 0x7f4808029080 con 0x7f481805bb30 2024-04-18T10:36:13.685 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:13.685 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":24,"monmap":{"epoch":1,"min_mon_release_name":"octopus","num_mons":3},"osdmap":{"epoch":19,"num_osds":4,"num_up_osds":4,"osd_up_since":1713436555,"num_in_osds":4,"osd_in_since":1713436555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":1,"data_bytes":0,"bytes_used":4295524352,"bytes_avail":382251532288,"bytes_total":386547056640,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":8,"id":1,"up":2,"in":2,"max":2,"by_rank":[{"filesystem_id":1,"rank":1,"name":"b","status":"up:active","gid":14138},{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":14141}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-18T10:35:48.470959+0000","services":{}},"progress_events":{}} 2024-04-18T10:36:13.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 >> v1:172.21.15.31:6816/39551 conn(0x7f47f8038ec0 legacy=0x7f47f803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481805bb30 msgr2=0x7f4818094e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481805bb30 0x7f4818094e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f480800c000 tx=0x7f4808006eb0).stop 2024-04-18T10:36:13.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 shutdown_connections 2024-04-18T10:36:13.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4818095340 0x7f4818149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f481805bb30 0x7f4818094e50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 --2- 172.21.15.31:0/960745469 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4818061fe0 0x7f48181495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 >> 172.21.15.31:0/960745469 conn(0x7f481806c0c0 msgr2=0x7f4818138790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:13.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 shutdown_connections 2024-04-18T10:36:13.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.687+0000 7f481e20a700 1 -- 172.21.15.31:0/960745469 wait complete. 2024-04-18T10:36:13.696 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-18T10:36:13.697 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:36:13.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.803+0000 7fe69eeab700 1 Processor -- start 2024-04-18T10:36:13.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.803+0000 7fe69eeab700 1 -- start start 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69eeab700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe69805bb30 0x7fe698063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69eeab700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe698061fe0 0x7fe698139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69eeab700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe698062400 0x7fe6980a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69eeab700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe698062b80 con 0x7fe698061fe0 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69eeab700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe698062e60 con 0x7fe698062400 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69eeab700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe698139a40 con 0x7fe69805bb30 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69cc47700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe69805bb30 0x7fe698063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69d448700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe698062400 0x7fe6980a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe697fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe698061fe0 0x7fe698139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69cc47700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe69805bb30 0x7fe698063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46518/0 (socket says 172.21.15.31:46518) 2024-04-18T10:36:13.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69cc47700 1 -- 172.21.15.31:0/2329321690 learned_addr learned my addr 172.21.15.31:0/2329321690 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69d448700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe698062400 0x7fe6980a8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60858/0 (socket says 172.21.15.31:60858) 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69cc47700 1 -- 172.21.15.31:0/2329321690 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe698062400 msgr2=0x7fe6980a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.804+0000 7fe69cc47700 1 --2- 172.21.15.31:0/2329321690 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe698062400 0x7fe6980a8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69cc47700 1 -- 172.21.15.31:0/2329321690 >> v2:172.21.15.31:3300/0 conn(0x7fe698061fe0 msgr2=0x7fe698139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69cc47700 1 --2- 172.21.15.31:0/2329321690 >> v2:172.21.15.31:3300/0 conn(0x7fe698061fe0 0x7fe698139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69cc47700 1 -- 172.21.15.31:0/2329321690 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe698139d00 con 0x7fe69805bb30 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69d448700 1 --2- 172.21.15.31:0/2329321690 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe698062400 0x7fe6980a8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe697fff700 1 --2- 172.21.15.31:0/2329321690 >> v2:172.21.15.31:3300/0 conn(0x7fe698061fe0 0x7fe698139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69cc47700 1 --2- 172.21.15.31:0/2329321690 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe69805bb30 0x7fe698063360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe68c002f70 tx=0x7fe68c006eb0).ready entity=mon.2 client_cookie=1580c8931ddd8b33 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe6977fe700 1 -- 172.21.15.31:0/2329321690 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c00d570 con 0x7fe69805bb30 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe6977fe700 1 -- 172.21.15.31:0/2329321690 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c000e90 con 0x7fe69805bb30 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe6977fe700 1 -- 172.21.15.31:0/2329321690 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c00d900 con 0x7fe69805bb30 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69eeab700 1 -- 172.21.15.31:0/2329321690 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe69805bb30 msgr2=0x7fe698063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69eeab700 1 --2- 172.21.15.31:0/2329321690 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe69805bb30 0x7fe698063360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe68c002f70 tx=0x7fe68c006eb0).stop 2024-04-18T10:36:13.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69eeab700 1 -- 172.21.15.31:0/2329321690 shutdown_connections 2024-04-18T10:36:13.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69eeab700 1 --2- 172.21.15.31:0/2329321690 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe698062400 0x7fe6980a8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69eeab700 1 --2- 172.21.15.31:0/2329321690 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe69805bb30 0x7fe698063360 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69eeab700 1 --2- 172.21.15.31:0/2329321690 >> v2:172.21.15.31:3300/0 conn(0x7fe698061fe0 0x7fe698139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69eeab700 1 -- 172.21.15.31:0/2329321690 >> 172.21.15.31:0/2329321690 conn(0x7fe69806c0c0 msgr2=0x7fe69806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:13.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69eeab700 1 -- 172.21.15.31:0/2329321690 shutdown_connections 2024-04-18T10:36:13.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.805+0000 7fe69eeab700 1 -- 172.21.15.31:0/2329321690 wait complete. 2024-04-18T10:36:13.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.806+0000 7fe69eeab700 1 Processor -- start 2024-04-18T10:36:13.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.806+0000 7fe69eeab700 1 -- start start 2024-04-18T10:36:13.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.807+0000 7fe69eeab700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe69805bb30 0x7fe698095a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.807+0000 7fe69eeab700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe698061fe0 0x7fe698145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.807+0000 7fe69eeab700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6980953c0 0x7fe698093120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:13.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.807+0000 7fe69eeab700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe698094f30 con 0x7fe698061fe0 2024-04-18T10:36:13.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.807+0000 7fe69eeab700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe698146560 con 0x7fe69805bb30 2024-04-18T10:36:13.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.807+0000 7fe69eeab700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe698146820 con 0x7fe6980953c0 2024-04-18T10:36:13.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.807+0000 7fe69cc47700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe69805bb30 0x7fe698095a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.807+0000 7fe69cc47700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe69805bb30 0x7fe698095a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60866/0 (socket says 172.21.15.31:60866) 2024-04-18T10:36:13.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69cc47700 1 -- 172.21.15.31:0/1069173831 learned_addr learned my addr 172.21.15.31:0/1069173831 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:13.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69d448700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6980953c0 0x7fe698093120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe697fff700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe698061fe0 0x7fe698145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69cc47700 1 -- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6980953c0 msgr2=0x7fe698093120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69cc47700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6980953c0 0x7fe698093120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69cc47700 1 -- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe698061fe0 msgr2=0x7fe698145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69cc47700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe698061fe0 0x7fe698145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69cc47700 1 -- 172.21.15.31:0/1069173831 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68400b180 con 0x7fe69805bb30 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69d448700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6980953c0 0x7fe698093120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe697fff700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe698061fe0 0x7fe698145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69cc47700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe69805bb30 0x7fe698095a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe68c002f70 tx=0x7fe68c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe695ffb700 1 -- 172.21.15.31:0/1069173831 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c00dea0 con 0x7fe69805bb30 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe695ffb700 1 -- 172.21.15.31:0/1069173831 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c006b40 con 0x7fe69805bb30 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe690009470 con 0x7fe69805bb30 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe695ffb700 1 -- 172.21.15.31:0/1069173831 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe68c011d70 con 0x7fe69805bb30 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.808+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c00b1e0 con 0x7fe69805bb30 2024-04-18T10:36:13.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.809+0000 7fe695ffb700 1 -- 172.21.15.31:0/1069173831 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe68c025030 con 0x7fe69805bb30 2024-04-18T10:36:13.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.809+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe698095210 con 0x7fe69805bb30 2024-04-18T10:36:13.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.809+0000 7fe695ffb700 1 -- 172.21.15.31:0/1069173831 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe68c04b8d0 con 0x7fe69805bb30 2024-04-18T10:36:13.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.812+0000 7fe695ffb700 1 -- 172.21.15.31:0/1069173831 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe68c01eb90 con 0x7fe69805bb30 2024-04-18T10:36:13.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.924+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 --> v1:172.21.15.31:6816/39551 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe698094d90 con 0x7fe678038e30 2024-04-18T10:36:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.931+0000 7fe695ffb700 1 -- 172.21.15.31:0/1069173831 <== mgr.4101 v1:172.21.15.31:6816/39551 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246980 (unknown 2965378022 0 3103167527) 0x7fe68400bb30 con 0x7fe678038e30 2024-04-18T10:36:13.934 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:13.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 >> v1:172.21.15.31:6816/39551 conn(0x7fe678038e30 legacy=0x7fe67803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe69805bb30 msgr2=0x7fe698095a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:13.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe69805bb30 0x7fe698095a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fe68c002f70 tx=0x7fe68c015000).stop 2024-04-18T10:36:13.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 shutdown_connections 2024-04-18T10:36:13.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6980953c0 0x7fe698093120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe69805bb30 0x7fe698095a30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 --2- 172.21.15.31:0/1069173831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe698061fe0 0x7fe698145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:13.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 >> 172.21.15.31:0/1069173831 conn(0x7fe69806c0c0 msgr2=0x7fe698134210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:13.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 shutdown_connections 2024-04-18T10:36:13.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:13.933+0000 7fe69eeab700 1 -- 172.21.15.31:0/1069173831 wait complete. 2024-04-18T10:36:13.937 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:36:13.943 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-18T10:36:13.388378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195072,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292288,"statfs":{"total":386547056640,"available":382251302912,"internally_reserved":4294967296,"allocated":753664,"data_stored":216533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.715027"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038116+0000","last_change":"2024-04-18T10:36:09.029464+0000","last_active":"2024-04-18T10:36:09.038116+0000","last_peered":"2024-04-18T10:36:09.038116+0000","last_clean":"2024-04-18T10:36:09.038116+0000","last_became_active":"2024-04-18T10:36:09.029119+0000","last_became_peered":"2024-04-18T10:36:09.029119+0000","last_unstale":"2024-04-18T10:36:09.038116+0000","last_undegraded":"2024-04-18T10:36:09.038116+0000","last_fullsized":"2024-04-18T10:36:09.038116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021034+0000","last_change":"2024-04-18T10:36:09.016639+0000","last_active":"2024-04-18T10:36:09.021034+0000","last_peered":"2024-04-18T10:36:09.021034+0000","last_clean":"2024-04-18T10:36:09.021034+0000","last_became_active":"2024-04-18T10:36:09.016298+0000","last_became_peered":"2024-04-18T10:36:09.016298+0000","last_unstale":"2024-04-18T10:36:09.021034+0000","last_undegraded":"2024-04-18T10:36:09.021034+0000","last_fullsized":"2024-04-18T10:36:09.021034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.029214+0000","last_change":"2024-04-18T10:36:09.021729+0000","last_active":"2024-04-18T10:36:09.029214+0000","last_peered":"2024-04-18T10:36:09.029214+0000","last_clean":"2024-04-18T10:36:09.029214+0000","last_became_active":"2024-04-18T10:36:09.021089+0000","last_became_peered":"2024-04-18T10:36:09.021089+0000","last_unstale":"2024-04-18T10:36:09.029214+0000","last_undegraded":"2024-04-18T10:36:09.029214+0000","last_fullsized":"2024-04-18T10:36:09.029214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027739+0000","last_change":"2024-04-18T10:36:09.022509+0000","last_active":"2024-04-18T10:36:09.027739+0000","last_peered":"2024-04-18T10:36:09.027739+0000","last_clean":"2024-04-18T10:36:09.027739+0000","last_became_active":"2024-04-18T10:36:09.019360+0000","last_became_peered":"2024-04-18T10:36:09.019360+0000","last_unstale":"2024-04-18T10:36:09.027739+0000","last_undegraded":"2024-04-18T10:36:09.027739+0000","last_fullsized":"2024-04-18T10:36:09.027739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027607+0000","last_change":"2024-04-18T10:36:09.021300+0000","last_active":"2024-04-18T10:36:09.027607+0000","last_peered":"2024-04-18T10:36:09.027607+0000","last_clean":"2024-04-18T10:36:09.027607+0000","last_became_active":"2024-04-18T10:36:09.018608+0000","last_became_peered":"2024-04-18T10:36:09.018608+0000","last_unstale":"2024-04-18T10:36:09.027607+0000","last_undegraded":"2024-04-18T10:36:09.027607+0000","last_fullsized":"2024-04-18T10:36:09.027607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043852+0000","last_change":"2024-04-18T10:36:09.041400+0000","last_active":"2024-04-18T10:36:09.043852+0000","last_peered":"2024-04-18T10:36:09.043852+0000","last_clean":"2024-04-18T10:36:09.043852+0000","last_became_active":"2024-04-18T10:36:09.038827+0000","last_became_peered":"2024-04-18T10:36:09.038827+0000","last_unstale":"2024-04-18T10:36:09.043852+0000","last_undegraded":"2024-04-18T10:36:09.043852+0000","last_fullsized":"2024-04-18T10:36:09.043852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043983+0000","last_change":"2024-04-18T10:36:09.042033+0000","last_active":"2024-04-18T10:36:09.043983+0000","last_peered":"2024-04-18T10:36:09.043983+0000","last_clean":"2024-04-18T10:36:09.043983+0000","last_became_active":"2024-04-18T10:36:09.039118+0000","last_became_peered":"2024-04-18T10:36:09.039118+0000","last_unstale":"2024-04-18T10:36:09.043983+0000","last_undegraded":"2024-04-18T10:36:09.043983+0000","last_fullsized":"2024-04-18T10:36:09.043983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.035450+0000","last_change":"2024-04-18T10:36:09.032927+0000","last_active":"2024-04-18T10:36:09.035450+0000","last_peered":"2024-04-18T10:36:09.035450+0000","last_clean":"2024-04-18T10:36:09.035450+0000","last_became_active":"2024-04-18T10:36:09.032162+0000","last_became_peered":"2024-04-18T10:36:09.032162+0000","last_unstale":"2024-04-18T10:36:09.035450+0000","last_undegraded":"2024-04-18T10:36:09.035450+0000","last_fullsized":"2024-04-18T10:36:09.035450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028743+0000","last_change":"2024-04-18T10:36:09.022311+0000","last_active":"2024-04-18T10:36:09.028743+0000","last_peered":"2024-04-18T10:36:09.028743+0000","last_clean":"2024-04-18T10:36:09.028743+0000","last_became_active":"2024-04-18T10:36:09.021805+0000","last_became_peered":"2024-04-18T10:36:09.021805+0000","last_unstale":"2024-04-18T10:36:09.028743+0000","last_undegraded":"2024-04-18T10:36:09.028743+0000","last_fullsized":"2024-04-18T10:36:09.028743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038226+0000","last_change":"2024-04-18T10:36:09.034290+0000","last_active":"2024-04-18T10:36:09.038226+0000","last_peered":"2024-04-18T10:36:09.038226+0000","last_clean":"2024-04-18T10:36:09.038226+0000","last_became_active":"2024-04-18T10:36:09.034081+0000","last_became_peered":"2024-04-18T10:36:09.034081+0000","last_unstale":"2024-04-18T10:36:09.038226+0000","last_undegraded":"2024-04-18T10:36:09.038226+0000","last_fullsized":"2024-04-18T10:36:09.038226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023279+0000","last_change":"2024-04-18T10:36:09.016527+0000","last_active":"2024-04-18T10:36:09.023279+0000","last_peered":"2024-04-18T10:36:09.023279+0000","last_clean":"2024-04-18T10:36:09.023279+0000","last_became_active":"2024-04-18T10:36:09.014883+0000","last_became_peered":"2024-04-18T10:36:09.014883+0000","last_unstale":"2024-04-18T10:36:09.023279+0000","last_undegraded":"2024-04-18T10:36:09.023279+0000","last_fullsized":"2024-04-18T10:36:09.023279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.013927+0000","last_change":"2024-04-18T10:36:09.005314+0000","last_active":"2024-04-18T10:36:09.013927+0000","last_peered":"2024-04-18T10:36:09.013927+0000","last_clean":"2024-04-18T10:36:09.013927+0000","last_became_active":"2024-04-18T10:36:09.004979+0000","last_became_peered":"2024-04-18T10:36:09.004979+0000","last_unstale":"2024-04-18T10:36:09.013927+0000","last_undegraded":"2024-04-18T10:36:09.013927+0000","last_fullsized":"2024-04-18T10:36:09.013927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038097+0000","last_change":"2024-04-18T10:36:09.028839+0000","last_active":"2024-04-18T10:36:09.038097+0000","last_peered":"2024-04-18T10:36:09.038097+0000","last_clean":"2024-04-18T10:36:09.038097+0000","last_became_active":"2024-04-18T10:36:09.028502+0000","last_became_peered":"2024-04-18T10:36:09.028502+0000","last_unstale":"2024-04-18T10:36:09.038097+0000","last_undegraded":"2024-04-18T10:36:09.038097+0000","last_fullsized":"2024-04-18T10:36:09.038097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038555+0000","last_change":"2024-04-18T10:36:09.034002+0000","last_active":"2024-04-18T10:36:09.038555+0000","last_peered":"2024-04-18T10:36:09.038555+0000","last_clean":"2024-04-18T10:36:09.038555+0000","last_became_active":"2024-04-18T10:36:09.033512+0000","last_became_peered":"2024-04-18T10:36:09.033512+0000","last_unstale":"2024-04-18T10:36:09.038555+0000","last_undegraded":"2024-04-18T10:36:09.038555+0000","last_fullsized":"2024-04-18T10:36:09.038555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.018733+0000","last_change":"2024-04-18T10:36:09.008596+0000","last_active":"2024-04-18T10:36:09.018733+0000","last_peered":"2024-04-18T10:36:09.018733+0000","last_clean":"2024-04-18T10:36:09.018733+0000","last_became_active":"2024-04-18T10:36:09.008249+0000","last_became_peered":"2024-04-18T10:36:09.008249+0000","last_unstale":"2024-04-18T10:36:09.018733+0000","last_undegraded":"2024-04-18T10:36:09.018733+0000","last_fullsized":"2024-04-18T10:36:09.018733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048341+0000","last_change":"2024-04-18T10:36:09.043650+0000","last_active":"2024-04-18T10:36:09.048341+0000","last_peered":"2024-04-18T10:36:09.048341+0000","last_clean":"2024-04-18T10:36:09.048341+0000","last_became_active":"2024-04-18T10:36:09.039117+0000","last_became_peered":"2024-04-18T10:36:09.039117+0000","last_unstale":"2024-04-18T10:36:09.048341+0000","last_undegraded":"2024-04-18T10:36:09.048341+0000","last_fullsized":"2024-04-18T10:36:09.048341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028720+0000","last_change":"2024-04-18T10:36:09.022106+0000","last_active":"2024-04-18T10:36:09.028720+0000","last_peered":"2024-04-18T10:36:09.028720+0000","last_clean":"2024-04-18T10:36:09.028720+0000","last_became_active":"2024-04-18T10:36:09.021380+0000","last_became_peered":"2024-04-18T10:36:09.021380+0000","last_unstale":"2024-04-18T10:36:09.028720+0000","last_undegraded":"2024-04-18T10:36:09.028720+0000","last_fullsized":"2024-04-18T10:36:09.028720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.018007+0000","last_change":"2024-04-18T10:36:09.007051+0000","last_active":"2024-04-18T10:36:09.018007+0000","last_peered":"2024-04-18T10:36:09.018007+0000","last_clean":"2024-04-18T10:36:09.018007+0000","last_became_active":"2024-04-18T10:36:09.006731+0000","last_became_peered":"2024-04-18T10:36:09.006731+0000","last_unstale":"2024-04-18T10:36:09.018007+0000","last_undegraded":"2024-04-18T10:36:09.018007+0000","last_fullsized":"2024-04-18T10:36:09.018007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.025759+0000","last_change":"2024-04-18T10:36:09.021352+0000","last_active":"2024-04-18T10:36:09.025759+0000","last_peered":"2024-04-18T10:36:09.025759+0000","last_clean":"2024-04-18T10:36:09.025759+0000","last_became_active":"2024-04-18T10:36:09.018400+0000","last_became_peered":"2024-04-18T10:36:09.018400+0000","last_unstale":"2024-04-18T10:36:09.025759+0000","last_undegraded":"2024-04-18T10:36:09.025759+0000","last_fullsized":"2024-04-18T10:36:09.025759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040399+0000","last_change":"2024-04-18T10:36:09.037939+0000","last_active":"2024-04-18T10:36:09.040399+0000","last_peered":"2024-04-18T10:36:09.040399+0000","last_clean":"2024-04-18T10:36:09.040399+0000","last_became_active":"2024-04-18T10:36:09.037611+0000","last_became_peered":"2024-04-18T10:36:09.037611+0000","last_unstale":"2024-04-18T10:36:09.040399+0000","last_undegraded":"2024-04-18T10:36:09.040399+0000","last_fullsized":"2024-04-18T10:36:09.040399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040284+0000","last_change":"2024-04-18T10:36:09.036858+0000","last_active":"2024-04-18T10:36:09.040284+0000","last_peered":"2024-04-18T10:36:09.040284+0000","last_clean":"2024-04-18T10:36:09.040284+0000","last_became_active":"2024-04-18T10:36:09.036508+0000","last_became_peered":"2024-04-18T10:36:09.036508+0000","last_unstale":"2024-04-18T10:36:09.040284+0000","last_undegraded":"2024-04-18T10:36:09.040284+0000","last_fullsized":"2024-04-18T10:36:09.040284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028695+0000","last_change":"2024-04-18T10:36:09.021243+0000","last_active":"2024-04-18T10:36:09.028695+0000","last_peered":"2024-04-18T10:36:09.028695+0000","last_clean":"2024-04-18T10:36:09.028695+0000","last_became_active":"2024-04-18T10:36:09.019277+0000","last_became_peered":"2024-04-18T10:36:09.019277+0000","last_unstale":"2024-04-18T10:36:09.028695+0000","last_undegraded":"2024-04-18T10:36:09.028695+0000","last_fullsized":"2024-04-18T10:36:09.028695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043961+0000","last_change":"2024-04-18T10:36:09.041841+0000","last_active":"2024-04-18T10:36:09.043961+0000","last_peered":"2024-04-18T10:36:09.043961+0000","last_clean":"2024-04-18T10:36:09.043961+0000","last_became_active":"2024-04-18T10:36:09.038958+0000","last_became_peered":"2024-04-18T10:36:09.038958+0000","last_unstale":"2024-04-18T10:36:09.043961+0000","last_undegraded":"2024-04-18T10:36:09.043961+0000","last_fullsized":"2024-04-18T10:36:09.043961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038748+0000","last_change":"2024-04-18T10:36:09.035656+0000","last_active":"2024-04-18T10:36:09.038748+0000","last_peered":"2024-04-18T10:36:09.038748+0000","last_clean":"2024-04-18T10:36:09.038748+0000","last_became_active":"2024-04-18T10:36:09.035221+0000","last_became_peered":"2024-04-18T10:36:09.035221+0000","last_unstale":"2024-04-18T10:36:09.038748+0000","last_undegraded":"2024-04-18T10:36:09.038748+0000","last_fullsized":"2024-04-18T10:36:09.038748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.037238+0000","last_change":"2024-04-18T10:36:09.031118+0000","last_active":"2024-04-18T10:36:09.037238+0000","last_peered":"2024-04-18T10:36:09.037238+0000","last_clean":"2024-04-18T10:36:09.037238+0000","last_became_active":"2024-04-18T10:36:09.024843+0000","last_became_peered":"2024-04-18T10:36:09.024843+0000","last_unstale":"2024-04-18T10:36:09.037238+0000","last_undegraded":"2024-04-18T10:36:09.037238+0000","last_fullsized":"2024-04-18T10:36:09.037238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.034882+0000","last_change":"2024-04-18T10:36:09.032225+0000","last_active":"2024-04-18T10:36:09.034882+0000","last_peered":"2024-04-18T10:36:09.034882+0000","last_clean":"2024-04-18T10:36:09.034882+0000","last_became_active":"2024-04-18T10:36:09.031895+0000","last_became_peered":"2024-04-18T10:36:09.031895+0000","last_unstale":"2024-04-18T10:36:09.034882+0000","last_undegraded":"2024-04-18T10:36:09.034882+0000","last_fullsized":"2024-04-18T10:36:09.034882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043564+0000","last_change":"2024-04-18T10:36:09.040868+0000","last_active":"2024-04-18T10:36:09.043564+0000","last_peered":"2024-04-18T10:36:09.043564+0000","last_clean":"2024-04-18T10:36:09.043564+0000","last_became_active":"2024-04-18T10:36:09.038946+0000","last_became_peered":"2024-04-18T10:36:09.038946+0000","last_unstale":"2024-04-18T10:36:09.043564+0000","last_undegraded":"2024-04-18T10:36:09.043564+0000","last_fullsized":"2024-04-18T10:36:09.043564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.034159+0000","last_change":"2024-04-18T10:36:08.696988+0000","last_active":"2024-04-18T10:36:09.034159+0000","last_peered":"2024-04-18T10:36:09.034159+0000","last_clean":"2024-04-18T10:36:09.034159+0000","last_became_active":"2024-04-18T10:36:08.696639+0000","last_became_peered":"2024-04-18T10:36:08.696639+0000","last_unstale":"2024-04-18T10:36:09.034159+0000","last_undegraded":"2024-04-18T10:36:09.034159+0000","last_fullsized":"2024-04-18T10:36:09.034159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043580+0000","last_change":"2024-04-18T10:36:09.040997+0000","last_active":"2024-04-18T10:36:09.043580+0000","last_peered":"2024-04-18T10:36:09.043580+0000","last_clean":"2024-04-18T10:36:09.043580+0000","last_became_active":"2024-04-18T10:36:09.039544+0000","last_became_peered":"2024-04-18T10:36:09.039544+0000","last_unstale":"2024-04-18T10:36:09.043580+0000","last_undegraded":"2024-04-18T10:36:09.043580+0000","last_fullsized":"2024-04-18T10:36:09.043580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.002229+0000","last_change":"2024-04-18T10:36:08.706823+0000","last_active":"2024-04-18T10:36:09.002229+0000","last_peered":"2024-04-18T10:36:09.002229+0000","last_clean":"2024-04-18T10:36:09.002229+0000","last_became_active":"2024-04-18T10:36:08.706488+0000","last_became_peered":"2024-04-18T10:36:08.706488+0000","last_unstale":"2024-04-18T10:36:09.002229+0000","last_undegraded":"2024-04-18T10:36:09.002229+0000","last_fullsized":"2024-04-18T10:36:09.002229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028604+0000","last_change":"2024-04-18T10:36:09.020079+0000","last_active":"2024-04-18T10:36:09.028604+0000","last_peered":"2024-04-18T10:36:09.028604+0000","last_clean":"2024-04-18T10:36:09.028604+0000","last_became_active":"2024-04-18T10:36:09.019759+0000","last_became_peered":"2024-04-18T10:36:09.019759+0000","last_unstale":"2024-04-18T10:36:09.028604+0000","last_undegraded":"2024-04-18T10:36:09.028604+0000","last_fullsized":"2024-04-18T10:36:09.028604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.996687+0000","last_change":"2024-04-18T10:36:08.715008+0000","last_active":"2024-04-18T10:36:09.996687+0000","last_peered":"2024-04-18T10:36:09.996687+0000","last_clean":"2024-04-18T10:36:09.996687+0000","last_became_active":"2024-04-18T10:36:08.714642+0000","last_became_peered":"2024-04-18T10:36:08.714642+0000","last_unstale":"2024-04-18T10:36:09.996687+0000","last_undegraded":"2024-04-18T10:36:09.996687+0000","last_fullsized":"2024-04-18T10:36:09.996687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048447+0000","last_change":"2024-04-18T10:36:09.045728+0000","last_active":"2024-04-18T10:36:09.048447+0000","last_peered":"2024-04-18T10:36:09.048447+0000","last_clean":"2024-04-18T10:36:09.048447+0000","last_became_active":"2024-04-18T10:36:09.045122+0000","last_became_peered":"2024-04-18T10:36:09.045122+0000","last_unstale":"2024-04-18T10:36:09.048447+0000","last_undegraded":"2024-04-18T10:36:09.048447+0000","last_fullsized":"2024-04-18T10:36:09.048447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.013511+0000","last_change":"2024-04-18T10:36:08.706131+0000","last_active":"2024-04-18T10:36:11.013511+0000","last_peered":"2024-04-18T10:36:11.013511+0000","last_clean":"2024-04-18T10:36:11.013511+0000","last_became_active":"2024-04-18T10:36:08.705713+0000","last_became_peered":"2024-04-18T10:36:08.705713+0000","last_unstale":"2024-04-18T10:36:11.013511+0000","last_undegraded":"2024-04-18T10:36:11.013511+0000","last_fullsized":"2024-04-18T10:36:11.013511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048368+0000","last_change":"2024-04-18T10:36:09.043706+0000","last_active":"2024-04-18T10:36:09.048368+0000","last_peered":"2024-04-18T10:36:09.048368+0000","last_clean":"2024-04-18T10:36:09.048368+0000","last_became_active":"2024-04-18T10:36:09.039571+0000","last_became_peered":"2024-04-18T10:36:09.039571+0000","last_unstale":"2024-04-18T10:36:09.048368+0000","last_undegraded":"2024-04-18T10:36:09.048368+0000","last_fullsized":"2024-04-18T10:36:09.048368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.008477+0000","last_change":"2024-04-18T10:36:08.703814+0000","last_active":"2024-04-18T10:36:11.008477+0000","last_peered":"2024-04-18T10:36:11.008477+0000","last_clean":"2024-04-18T10:36:11.008477+0000","last_became_active":"2024-04-18T10:36:08.703206+0000","last_became_peered":"2024-04-18T10:36:08.703206+0000","last_unstale":"2024-04-18T10:36:11.008477+0000","last_undegraded":"2024-04-18T10:36:11.008477+0000","last_fullsized":"2024-04-18T10:36:11.008477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044003+0000","last_change":"2024-04-18T10:36:09.042232+0000","last_active":"2024-04-18T10:36:09.044003+0000","last_peered":"2024-04-18T10:36:09.044003+0000","last_clean":"2024-04-18T10:36:09.044003+0000","last_became_active":"2024-04-18T10:36:09.039432+0000","last_became_peered":"2024-04-18T10:36:09.039432+0000","last_unstale":"2024-04-18T10:36:09.044003+0000","last_undegraded":"2024-04-18T10:36:09.044003+0000","last_fullsized":"2024-04-18T10:36:09.044003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.997268+0000","last_change":"2024-04-18T10:36:08.705414+0000","last_active":"2024-04-18T10:36:09.997268+0000","last_peered":"2024-04-18T10:36:09.997268+0000","last_clean":"2024-04-18T10:36:09.997268+0000","last_became_active":"2024-04-18T10:36:08.705077+0000","last_became_peered":"2024-04-18T10:36:08.705077+0000","last_unstale":"2024-04-18T10:36:09.997268+0000","last_undegraded":"2024-04-18T10:36:09.997268+0000","last_fullsized":"2024-04-18T10:36:09.997268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040352+0000","last_change":"2024-04-18T10:36:09.036998+0000","last_active":"2024-04-18T10:36:09.040352+0000","last_peered":"2024-04-18T10:36:09.040352+0000","last_clean":"2024-04-18T10:36:09.040352+0000","last_became_active":"2024-04-18T10:36:09.036672+0000","last_became_peered":"2024-04-18T10:36:09.036672+0000","last_unstale":"2024-04-18T10:36:09.040352+0000","last_undegraded":"2024-04-18T10:36:09.040352+0000","last_fullsized":"2024-04-18T10:36:09.040352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.011384+0000","last_change":"2024-04-18T10:36:08.711520+0000","last_active":"2024-04-18T10:36:11.011384+0000","last_peered":"2024-04-18T10:36:11.011384+0000","last_clean":"2024-04-18T10:36:11.011384+0000","last_became_active":"2024-04-18T10:36:08.711135+0000","last_became_peered":"2024-04-18T10:36:08.711135+0000","last_unstale":"2024-04-18T10:36:11.011384+0000","last_undegraded":"2024-04-18T10:36:11.011384+0000","last_fullsized":"2024-04-18T10:36:11.011384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016697+0000","last_change":"2024-04-18T10:36:09.012564+0000","last_active":"2024-04-18T10:36:09.016697+0000","last_peered":"2024-04-18T10:36:09.016697+0000","last_clean":"2024-04-18T10:36:09.016697+0000","last_became_active":"2024-04-18T10:36:09.012232+0000","last_became_peered":"2024-04-18T10:36:09.012232+0000","last_unstale":"2024-04-18T10:36:09.016697+0000","last_undegraded":"2024-04-18T10:36:09.016697+0000","last_fullsized":"2024-04-18T10:36:09.016697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.011129+0000","last_change":"2024-04-18T10:36:08.715596+0000","last_active":"2024-04-18T10:36:11.011129+0000","last_peered":"2024-04-18T10:36:11.011129+0000","last_clean":"2024-04-18T10:36:11.011129+0000","last_became_active":"2024-04-18T10:36:08.715228+0000","last_became_peered":"2024-04-18T10:36:08.715228+0000","last_unstale":"2024-04-18T10:36:11.011129+0000","last_undegraded":"2024-04-18T10:36:11.011129+0000","last_fullsized":"2024-04-18T10:36:11.011129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044093+0000","last_change":"2024-04-18T10:36:09.039566+0000","last_active":"2024-04-18T10:36:09.044093+0000","last_peered":"2024-04-18T10:36:09.044093+0000","last_clean":"2024-04-18T10:36:09.044093+0000","last_became_active":"2024-04-18T10:36:09.039196+0000","last_became_peered":"2024-04-18T10:36:09.039196+0000","last_unstale":"2024-04-18T10:36:09.044093+0000","last_undegraded":"2024-04-18T10:36:09.044093+0000","last_fullsized":"2024-04-18T10:36:09.044093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012770+0000","last_change":"2024-04-18T10:36:08.700155+0000","last_active":"2024-04-18T10:36:11.012770+0000","last_peered":"2024-04-18T10:36:11.012770+0000","last_clean":"2024-04-18T10:36:11.012770+0000","last_became_active":"2024-04-18T10:36:08.699825+0000","last_became_peered":"2024-04-18T10:36:08.699825+0000","last_unstale":"2024-04-18T10:36:11.012770+0000","last_undegraded":"2024-04-18T10:36:11.012770+0000","last_fullsized":"2024-04-18T10:36:11.012770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045311+0000","last_change":"2024-04-18T10:36:09.043704+0000","last_active":"2024-04-18T10:36:09.045311+0000","last_peered":"2024-04-18T10:36:09.045311+0000","last_clean":"2024-04-18T10:36:09.045311+0000","last_became_active":"2024-04-18T10:36:09.043212+0000","last_became_peered":"2024-04-18T10:36:09.043212+0000","last_unstale":"2024-04-18T10:36:09.045311+0000","last_undegraded":"2024-04-18T10:36:09.045311+0000","last_fullsized":"2024-04-18T10:36:09.045311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016667+0000","last_change":"2024-04-18T10:36:08.712894+0000","last_active":"2024-04-18T10:36:09.016667+0000","last_peered":"2024-04-18T10:36:09.016667+0000","last_clean":"2024-04-18T10:36:09.016667+0000","last_became_active":"2024-04-18T10:36:08.712527+0000","last_became_peered":"2024-04-18T10:36:08.712527+0000","last_unstale":"2024-04-18T10:36:09.016667+0000","last_undegraded":"2024-04-18T10:36:09.016667+0000","last_fullsized":"2024-04-18T10:36:09.016667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.036388+0000","last_change":"2024-04-18T10:36:09.028482+0000","last_active":"2024-04-18T10:36:09.036388+0000","last_peered":"2024-04-18T10:36:09.036388+0000","last_clean":"2024-04-18T10:36:09.036388+0000","last_became_active":"2024-04-18T10:36:09.027131+0000","last_became_peered":"2024-04-18T10:36:09.027131+0000","last_unstale":"2024-04-18T10:36:09.036388+0000","last_undegraded":"2024-04-18T10:36:09.036388+0000","last_fullsized":"2024-04-18T10:36:09.036388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.010119+0000","last_change":"2024-04-18T10:36:08.696453+0000","last_active":"2024-04-18T10:36:11.010119+0000","last_peered":"2024-04-18T10:36:11.010119+0000","last_clean":"2024-04-18T10:36:11.010119+0000","last_became_active":"2024-04-18T10:36:08.691479+0000","last_became_peered":"2024-04-18T10:36:08.691479+0000","last_unstale":"2024-04-18T10:36:11.010119+0000","last_undegraded":"2024-04-18T10:36:11.010119+0000","last_fullsized":"2024-04-18T10:36:11.010119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048422+0000","last_change":"2024-04-18T10:36:09.045160+0000","last_active":"2024-04-18T10:36:09.048422+0000","last_peered":"2024-04-18T10:36:09.048422+0000","last_clean":"2024-04-18T10:36:09.048422+0000","last_became_active":"2024-04-18T10:36:09.044693+0000","last_became_peered":"2024-04-18T10:36:09.044693+0000","last_unstale":"2024-04-18T10:36:09.048422+0000","last_undegraded":"2024-04-18T10:36:09.048422+0000","last_fullsized":"2024-04-18T10:36:09.048422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.022802+0000","last_change":"2024-04-18T10:36:08.693031+0000","last_active":"2024-04-18T10:36:09.022802+0000","last_peered":"2024-04-18T10:36:09.022802+0000","last_clean":"2024-04-18T10:36:09.022802+0000","last_became_active":"2024-04-18T10:36:08.692741+0000","last_became_peered":"2024-04-18T10:36:08.692741+0000","last_unstale":"2024-04-18T10:36:09.022802+0000","last_undegraded":"2024-04-18T10:36:09.022802+0000","last_fullsized":"2024-04-18T10:36:09.022802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048417+0000","last_change":"2024-04-18T10:36:09.043925+0000","last_active":"2024-04-18T10:36:09.048417+0000","last_peered":"2024-04-18T10:36:09.048417+0000","last_clean":"2024-04-18T10:36:09.048417+0000","last_became_active":"2024-04-18T10:36:09.043223+0000","last_became_peered":"2024-04-18T10:36:09.043223+0000","last_unstale":"2024-04-18T10:36:09.048417+0000","last_undegraded":"2024-04-18T10:36:09.048417+0000","last_fullsized":"2024-04-18T10:36:09.048417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.005701+0000","last_change":"2024-04-18T10:36:08.693355+0000","last_active":"2024-04-18T10:36:09.005701+0000","last_peered":"2024-04-18T10:36:09.005701+0000","last_clean":"2024-04-18T10:36:09.005701+0000","last_became_active":"2024-04-18T10:36:08.693035+0000","last_became_peered":"2024-04-18T10:36:08.693035+0000","last_unstale":"2024-04-18T10:36:09.005701+0000","last_undegraded":"2024-04-18T10:36:09.005701+0000","last_fullsized":"2024-04-18T10:36:09.005701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016525+0000","last_change":"2024-04-18T10:36:09.013954+0000","last_active":"2024-04-18T10:36:09.016525+0000","last_peered":"2024-04-18T10:36:09.016525+0000","last_clean":"2024-04-18T10:36:09.016525+0000","last_became_active":"2024-04-18T10:36:09.013544+0000","last_became_peered":"2024-04-18T10:36:09.013544+0000","last_unstale":"2024-04-18T10:36:09.016525+0000","last_undegraded":"2024-04-18T10:36:09.016525+0000","last_fullsized":"2024-04-18T10:36:09.016525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045534+0000","last_change":"2024-04-18T10:36:08.710986+0000","last_active":"2024-04-18T10:36:09.045534+0000","last_peered":"2024-04-18T10:36:09.045534+0000","last_clean":"2024-04-18T10:36:09.045534+0000","last_became_active":"2024-04-18T10:36:08.710570+0000","last_became_peered":"2024-04-18T10:36:08.710570+0000","last_unstale":"2024-04-18T10:36:09.045534+0000","last_undegraded":"2024-04-18T10:36:09.045534+0000","last_fullsized":"2024-04-18T10:36:09.045534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017673+0000","last_change":"2024-04-18T10:36:09.013364+0000","last_active":"2024-04-18T10:36:09.017673+0000","last_peered":"2024-04-18T10:36:09.017673+0000","last_clean":"2024-04-18T10:36:09.017673+0000","last_became_active":"2024-04-18T10:36:09.013081+0000","last_became_peered":"2024-04-18T10:36:09.013081+0000","last_unstale":"2024-04-18T10:36:09.017673+0000","last_undegraded":"2024-04-18T10:36:09.017673+0000","last_fullsized":"2024-04-18T10:36:09.017673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:08.998936+0000","last_change":"2024-04-18T10:36:08.697479+0000","last_active":"2024-04-18T10:36:08.998936+0000","last_peered":"2024-04-18T10:36:08.998936+0000","last_clean":"2024-04-18T10:36:08.998936+0000","last_became_active":"2024-04-18T10:36:08.697086+0000","last_became_peered":"2024-04-18T10:36:08.697086+0000","last_unstale":"2024-04-18T10:36:08.998936+0000","last_undegraded":"2024-04-18T10:36:08.998936+0000","last_fullsized":"2024-04-18T10:36:08.998936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027946+0000","last_change":"2024-04-18T10:36:09.022846+0000","last_active":"2024-04-18T10:36:09.027946+0000","last_peered":"2024-04-18T10:36:09.027946+0000","last_clean":"2024-04-18T10:36:09.027946+0000","last_became_active":"2024-04-18T10:36:09.019048+0000","last_became_peered":"2024-04-18T10:36:09.019048+0000","last_unstale":"2024-04-18T10:36:09.027946+0000","last_undegraded":"2024-04-18T10:36:09.027946+0000","last_fullsized":"2024-04-18T10:36:09.027946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009476+0000","last_change":"2024-04-18T10:36:08.715657+0000","last_active":"2024-04-18T10:36:11.009476+0000","last_peered":"2024-04-18T10:36:11.009476+0000","last_clean":"2024-04-18T10:36:11.009476+0000","last_became_active":"2024-04-18T10:36:08.715283+0000","last_became_peered":"2024-04-18T10:36:08.715283+0000","last_unstale":"2024-04-18T10:36:11.009476+0000","last_undegraded":"2024-04-18T10:36:11.009476+0000","last_fullsized":"2024-04-18T10:36:11.009476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.009252+0000","last_change":"2024-04-18T10:36:09.006046+0000","last_active":"2024-04-18T10:36:09.009252+0000","last_peered":"2024-04-18T10:36:09.009252+0000","last_clean":"2024-04-18T10:36:09.009252+0000","last_became_active":"2024-04-18T10:36:09.005726+0000","last_became_peered":"2024-04-18T10:36:09.005726+0000","last_unstale":"2024-04-18T10:36:09.009252+0000","last_undegraded":"2024-04-18T10:36:09.009252+0000","last_fullsized":"2024-04-18T10:36:09.009252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017607+0000","last_change":"2024-04-18T10:36:08.710590+0000","last_active":"2024-04-18T10:36:09.017607+0000","last_peered":"2024-04-18T10:36:09.017607+0000","last_clean":"2024-04-18T10:36:09.017607+0000","last_became_active":"2024-04-18T10:36:08.710198+0000","last_became_peered":"2024-04-18T10:36:08.710198+0000","last_unstale":"2024-04-18T10:36:09.017607+0000","last_undegraded":"2024-04-18T10:36:09.017607+0000","last_fullsized":"2024-04-18T10:36:09.017607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048407+0000","last_change":"2024-04-18T10:36:09.045249+0000","last_active":"2024-04-18T10:36:09.048407+0000","last_peered":"2024-04-18T10:36:09.048407+0000","last_clean":"2024-04-18T10:36:09.048407+0000","last_became_active":"2024-04-18T10:36:09.044573+0000","last_became_peered":"2024-04-18T10:36:09.044573+0000","last_unstale":"2024-04-18T10:36:09.048407+0000","last_undegraded":"2024-04-18T10:36:09.048407+0000","last_fullsized":"2024-04-18T10:36:09.048407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012927+0000","last_change":"2024-04-18T10:36:08.709580+0000","last_active":"2024-04-18T10:36:11.012927+0000","last_peered":"2024-04-18T10:36:11.012927+0000","last_clean":"2024-04-18T10:36:11.012927+0000","last_became_active":"2024-04-18T10:36:08.709283+0000","last_became_peered":"2024-04-18T10:36:08.709283+0000","last_unstale":"2024-04-18T10:36:11.012927+0000","last_undegraded":"2024-04-18T10:36:11.012927+0000","last_fullsized":"2024-04-18T10:36:11.012927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.030365+0000","last_change":"2024-04-18T10:36:09.027970+0000","last_active":"2024-04-18T10:36:09.030365+0000","last_peered":"2024-04-18T10:36:09.030365+0000","last_clean":"2024-04-18T10:36:09.030365+0000","last_became_active":"2024-04-18T10:36:09.027650+0000","last_became_peered":"2024-04-18T10:36:09.027650+0000","last_unstale":"2024-04-18T10:36:09.030365+0000","last_undegraded":"2024-04-18T10:36:09.030365+0000","last_fullsized":"2024-04-18T10:36:09.030365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012959+0000","last_change":"2024-04-18T10:36:08.710914+0000","last_active":"2024-04-18T10:36:11.012959+0000","last_peered":"2024-04-18T10:36:11.012959+0000","last_clean":"2024-04-18T10:36:11.012959+0000","last_became_active":"2024-04-18T10:36:08.710619+0000","last_became_peered":"2024-04-18T10:36:08.710619+0000","last_unstale":"2024-04-18T10:36:11.012959+0000","last_undegraded":"2024-04-18T10:36:11.012959+0000","last_fullsized":"2024-04-18T10:36:11.012959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040449+0000","last_change":"2024-04-18T10:36:09.037889+0000","last_active":"2024-04-18T10:36:09.040449+0000","last_peered":"2024-04-18T10:36:09.040449+0000","last_clean":"2024-04-18T10:36:09.040449+0000","last_became_active":"2024-04-18T10:36:09.037533+0000","last_became_peered":"2024-04-18T10:36:09.037533+0000","last_unstale":"2024-04-18T10:36:09.040449+0000","last_undegraded":"2024-04-18T10:36:09.040449+0000","last_fullsized":"2024-04-18T10:36:09.040449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.009182+0000","last_change":"2024-04-18T10:36:00.530860+0000","last_active":"2024-04-18T10:36:09.009182+0000","last_peered":"2024-04-18T10:36:09.009182+0000","last_clean":"2024-04-18T10:36:09.009182+0000","last_became_active":"2024-04-18T10:36:00.530496+0000","last_became_peered":"2024-04-18T10:36:00.530496+0000","last_unstale":"2024-04-18T10:36:09.009182+0000","last_undegraded":"2024-04-18T10:36:09.009182+0000","last_fullsized":"2024-04-18T10:36:09.009182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.999498+0000","last_change":"2024-04-18T10:36:08.703862+0000","last_active":"2024-04-18T10:36:09.999498+0000","last_peered":"2024-04-18T10:36:09.999498+0000","last_clean":"2024-04-18T10:36:09.999498+0000","last_became_active":"2024-04-18T10:36:08.703311+0000","last_became_peered":"2024-04-18T10:36:08.703311+0000","last_unstale":"2024-04-18T10:36:09.999498+0000","last_undegraded":"2024-04-18T10:36:09.999498+0000","last_fullsized":"2024-04-18T10:36:09.999498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016742+0000","last_change":"2024-04-18T10:36:09.014696+0000","last_active":"2024-04-18T10:36:09.016742+0000","last_peered":"2024-04-18T10:36:09.016742+0000","last_clean":"2024-04-18T10:36:09.016742+0000","last_became_active":"2024-04-18T10:36:09.014208+0000","last_became_peered":"2024-04-18T10:36:09.014208+0000","last_unstale":"2024-04-18T10:36:09.016742+0000","last_undegraded":"2024-04-18T10:36:09.016742+0000","last_fullsized":"2024-04-18T10:36:09.016742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017998+0000","last_change":"2024-04-18T10:36:00.529282+0000","last_active":"2024-04-18T10:36:09.017998+0000","last_peered":"2024-04-18T10:36:09.017998+0000","last_clean":"2024-04-18T10:36:09.017998+0000","last_became_active":"2024-04-18T10:36:00.528895+0000","last_became_peered":"2024-04-18T10:36:00.528895+0000","last_unstale":"2024-04-18T10:36:09.017998+0000","last_undegraded":"2024-04-18T10:36:09.017998+0000","last_fullsized":"2024-04-18T10:36:09.017998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009897+0000","last_change":"2024-04-18T10:36:08.694077+0000","last_active":"2024-04-18T10:36:11.009897+0000","last_peered":"2024-04-18T10:36:11.009897+0000","last_clean":"2024-04-18T10:36:11.009897+0000","last_became_active":"2024-04-18T10:36:08.693727+0000","last_became_peered":"2024-04-18T10:36:08.693727+0000","last_unstale":"2024-04-18T10:36:11.009897+0000","last_undegraded":"2024-04-18T10:36:11.009897+0000","last_fullsized":"2024-04-18T10:36:11.009897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023410+0000","last_change":"2024-04-18T10:36:09.017243+0000","last_active":"2024-04-18T10:36:09.023410+0000","last_peered":"2024-04-18T10:36:09.023410+0000","last_clean":"2024-04-18T10:36:09.023410+0000","last_became_active":"2024-04-18T10:36:09.016843+0000","last_became_peered":"2024-04-18T10:36:09.016843+0000","last_unstale":"2024-04-18T10:36:09.023410+0000","last_undegraded":"2024-04-18T10:36:09.023410+0000","last_fullsized":"2024-04-18T10:36:09.023410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:08.995885+0000","last_change":"2024-04-18T10:36:00.529420+0000","last_active":"2024-04-18T10:36:08.995885+0000","last_peered":"2024-04-18T10:36:08.995885+0000","last_clean":"2024-04-18T10:36:08.995885+0000","last_became_active":"2024-04-18T10:36:00.529029+0000","last_became_peered":"2024-04-18T10:36:00.529029+0000","last_unstale":"2024-04-18T10:36:08.995885+0000","last_undegraded":"2024-04-18T10:36:08.995885+0000","last_fullsized":"2024-04-18T10:36:08.995885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:10.642771+0000","last_change":"2024-04-18T10:36:08.697102+0000","last_active":"2024-04-18T10:36:10.642771+0000","last_peered":"2024-04-18T10:36:10.642771+0000","last_clean":"2024-04-18T10:36:10.642771+0000","last_became_active":"2024-04-18T10:36:08.696687+0000","last_became_peered":"2024-04-18T10:36:08.696687+0000","last_unstale":"2024-04-18T10:36:10.642771+0000","last_undegraded":"2024-04-18T10:36:10.642771+0000","last_fullsized":"2024-04-18T10:36:10.642771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.037303+0000","last_change":"2024-04-18T10:36:09.031490+0000","last_active":"2024-04-18T10:36:09.037303+0000","last_peered":"2024-04-18T10:36:09.037303+0000","last_clean":"2024-04-18T10:36:09.037303+0000","last_became_active":"2024-04-18T10:36:09.030866+0000","last_became_peered":"2024-04-18T10:36:09.030866+0000","last_unstale":"2024-04-18T10:36:09.037303+0000","last_undegraded":"2024-04-18T10:36:09.037303+0000","last_fullsized":"2024-04-18T10:36:09.037303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.019884+0000","last_change":"2024-04-18T10:36:00.530056+0000","last_active":"2024-04-18T10:36:09.019884+0000","last_peered":"2024-04-18T10:36:09.019884+0000","last_clean":"2024-04-18T10:36:09.019884+0000","last_became_active":"2024-04-18T10:36:00.529546+0000","last_became_peered":"2024-04-18T10:36:00.529546+0000","last_unstale":"2024-04-18T10:36:09.019884+0000","last_undegraded":"2024-04-18T10:36:09.019884+0000","last_fullsized":"2024-04-18T10:36:09.019884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.010534+0000","last_change":"2024-04-18T10:35:56.421744+0000","last_active":"2024-04-18T10:36:09.010534+0000","last_peered":"2024-04-18T10:36:09.010534+0000","last_clean":"2024-04-18T10:36:09.010534+0000","last_became_active":"2024-04-18T10:35:56.421316+0000","last_became_peered":"2024-04-18T10:35:56.421316+0000","last_unstale":"2024-04-18T10:36:09.010534+0000","last_undegraded":"2024-04-18T10:36:09.010534+0000","last_fullsized":"2024-04-18T10:36:09.010534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017702+0000","last_change":"2024-04-18T10:36:08.711994+0000","last_active":"2024-04-18T10:36:09.017702+0000","last_peered":"2024-04-18T10:36:09.017702+0000","last_clean":"2024-04-18T10:36:09.017702+0000","last_became_active":"2024-04-18T10:36:08.711652+0000","last_became_peered":"2024-04-18T10:36:08.711652+0000","last_unstale":"2024-04-18T10:36:09.017702+0000","last_undegraded":"2024-04-18T10:36:09.017702+0000","last_fullsized":"2024-04-18T10:36:09.017702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048433+0000","last_change":"2024-04-18T10:36:09.045388+0000","last_active":"2024-04-18T10:36:09.048433+0000","last_peered":"2024-04-18T10:36:09.048433+0000","last_clean":"2024-04-18T10:36:09.048433+0000","last_became_active":"2024-04-18T10:36:09.044909+0000","last_became_peered":"2024-04-18T10:36:09.044909+0000","last_unstale":"2024-04-18T10:36:09.048433+0000","last_undegraded":"2024-04-18T10:36:09.048433+0000","last_fullsized":"2024-04-18T10:36:09.048433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.015086+0000","last_change":"2024-04-18T10:36:00.529398+0000","last_active":"2024-04-18T10:36:09.015086+0000","last_peered":"2024-04-18T10:36:09.015086+0000","last_clean":"2024-04-18T10:36:09.015086+0000","last_became_active":"2024-04-18T10:36:00.528912+0000","last_became_peered":"2024-04-18T10:36:00.528912+0000","last_unstale":"2024-04-18T10:36:09.015086+0000","last_undegraded":"2024-04-18T10:36:09.015086+0000","last_fullsized":"2024-04-18T10:36:09.015086+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.998962+0000","last_change":"2024-04-18T10:36:08.692668+0000","last_active":"2024-04-18T10:36:09.998962+0000","last_peered":"2024-04-18T10:36:09.998962+0000","last_clean":"2024-04-18T10:36:09.998962+0000","last_became_active":"2024-04-18T10:36:08.692317+0000","last_became_peered":"2024-04-18T10:36:08.692317+0000","last_unstale":"2024-04-18T10:36:09.998962+0000","last_undegraded":"2024-04-18T10:36:09.998962+0000","last_fullsized":"2024-04-18T10:36:09.998962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028580+0000","last_change":"2024-04-18T10:36:09.019756+0000","last_active":"2024-04-18T10:36:09.028580+0000","last_peered":"2024-04-18T10:36:09.028580+0000","last_clean":"2024-04-18T10:36:09.028580+0000","last_became_active":"2024-04-18T10:36:09.019251+0000","last_became_peered":"2024-04-18T10:36:09.019251+0000","last_unstale":"2024-04-18T10:36:09.028580+0000","last_undegraded":"2024-04-18T10:36:09.028580+0000","last_fullsized":"2024-04-18T10:36:09.028580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.025577+0000","last_change":"2024-04-18T10:36:00.527346+0000","last_active":"2024-04-18T10:36:09.025577+0000","last_peered":"2024-04-18T10:36:09.025577+0000","last_clean":"2024-04-18T10:36:09.025577+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:09.025577+0000","last_undegraded":"2024-04-18T10:36:09.025577+0000","last_fullsized":"2024-04-18T10:36:09.025577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.008891+0000","last_change":"2024-04-18T10:36:08.700410+0000","last_active":"2024-04-18T10:36:09.008891+0000","last_peered":"2024-04-18T10:36:09.008891+0000","last_clean":"2024-04-18T10:36:09.008891+0000","last_became_active":"2024-04-18T10:36:08.700048+0000","last_became_peered":"2024-04-18T10:36:08.700048+0000","last_unstale":"2024-04-18T10:36:09.008891+0000","last_undegraded":"2024-04-18T10:36:09.008891+0000","last_fullsized":"2024-04-18T10:36:09.008891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021403+0000","last_change":"2024-04-18T10:36:09.018239+0000","last_active":"2024-04-18T10:36:09.021403+0000","last_peered":"2024-04-18T10:36:09.021403+0000","last_clean":"2024-04-18T10:36:09.021403+0000","last_became_active":"2024-04-18T10:36:09.010612+0000","last_became_peered":"2024-04-18T10:36:09.010612+0000","last_unstale":"2024-04-18T10:36:09.021403+0000","last_undegraded":"2024-04-18T10:36:09.021403+0000","last_fullsized":"2024-04-18T10:36:09.021403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009918+0000","last_change":"2024-04-18T10:36:08.710579+0000","last_active":"2024-04-18T10:36:11.009918+0000","last_peered":"2024-04-18T10:36:11.009918+0000","last_clean":"2024-04-18T10:36:11.009918+0000","last_became_active":"2024-04-18T10:36:08.710165+0000","last_became_peered":"2024-04-18T10:36:08.710165+0000","last_unstale":"2024-04-18T10:36:11.009918+0000","last_undegraded":"2024-04-18T10:36:11.009918+0000","last_fullsized":"2024-04-18T10:36:11.009918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.011413+0000","last_change":"2024-04-18T10:36:00.529862+0000","last_active":"2024-04-18T10:36:09.011413+0000","last_peered":"2024-04-18T10:36:09.011413+0000","last_clean":"2024-04-18T10:36:09.011413+0000","last_became_active":"2024-04-18T10:36:00.529451+0000","last_became_peered":"2024-04-18T10:36:00.529451+0000","last_unstale":"2024-04-18T10:36:09.011413+0000","last_undegraded":"2024-04-18T10:36:09.011413+0000","last_fullsized":"2024-04-18T10:36:09.011413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048393+0000","last_change":"2024-04-18T10:36:09.043858+0000","last_active":"2024-04-18T10:36:09.048393+0000","last_peered":"2024-04-18T10:36:09.048393+0000","last_clean":"2024-04-18T10:36:09.048393+0000","last_became_active":"2024-04-18T10:36:09.042887+0000","last_became_peered":"2024-04-18T10:36:09.042887+0000","last_unstale":"2024-04-18T10:36:09.048393+0000","last_undegraded":"2024-04-18T10:36:09.048393+0000","last_fullsized":"2024-04-18T10:36:09.048393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023855+0000","last_change":"2024-04-18T10:36:00.527385+0000","last_active":"2024-04-18T10:36:09.023855+0000","last_peered":"2024-04-18T10:36:09.023855+0000","last_clean":"2024-04-18T10:36:09.023855+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:09.023855+0000","last_undegraded":"2024-04-18T10:36:09.023855+0000","last_fullsized":"2024-04-18T10:36:09.023855+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.999485+0000","last_change":"2024-04-18T10:36:08.703568+0000","last_active":"2024-04-18T10:36:09.999485+0000","last_peered":"2024-04-18T10:36:09.999485+0000","last_clean":"2024-04-18T10:36:09.999485+0000","last_became_active":"2024-04-18T10:36:08.702770+0000","last_became_peered":"2024-04-18T10:36:08.702770+0000","last_unstale":"2024-04-18T10:36:09.999485+0000","last_undegraded":"2024-04-18T10:36:09.999485+0000","last_fullsized":"2024-04-18T10:36:09.999485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.013798+0000","last_change":"2024-04-18T10:36:09.005270+0000","last_active":"2024-04-18T10:36:09.013798+0000","last_peered":"2024-04-18T10:36:09.013798+0000","last_clean":"2024-04-18T10:36:09.013798+0000","last_became_active":"2024-04-18T10:36:09.004929+0000","last_became_peered":"2024-04-18T10:36:09.004929+0000","last_unstale":"2024-04-18T10:36:09.013798+0000","last_undegraded":"2024-04-18T10:36:09.013798+0000","last_fullsized":"2024-04-18T10:36:09.013798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'5","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.013436+0000","last_change":"2024-04-18T10:36:08.698046+0000","last_active":"2024-04-18T10:36:11.013436+0000","last_peered":"2024-04-18T10:36:11.013436+0000","last_clean":"2024-04-18T10:36:11.013436+0000","last_became_active":"2024-04-18T10:36:08.697438+0000","last_became_peered":"2024-04-18T10:36:08.697438+0000","last_unstale":"2024-04-18T10:36:11.013436+0000","last_undegraded":"2024-04-18T10:36:11.013436+0000","last_fullsized":"2024-04-18T10:36:11.013436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021707+0000","last_change":"2024-04-18T10:36:09.016654+0000","last_active":"2024-04-18T10:36:09.021707+0000","last_peered":"2024-04-18T10:36:09.021707+0000","last_clean":"2024-04-18T10:36:09.021707+0000","last_became_active":"2024-04-18T10:36:09.016342+0000","last_became_peered":"2024-04-18T10:36:09.016342+0000","last_unstale":"2024-04-18T10:36:09.021707+0000","last_undegraded":"2024-04-18T10:36:09.021707+0000","last_fullsized":"2024-04-18T10:36:09.021707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.033999+0000","last_change":"2024-04-18T10:36:08.700728+0000","last_active":"2024-04-18T10:36:09.033999+0000","last_peered":"2024-04-18T10:36:09.033999+0000","last_clean":"2024-04-18T10:36:09.033999+0000","last_became_active":"2024-04-18T10:36:08.699603+0000","last_became_peered":"2024-04-18T10:36:08.699603+0000","last_unstale":"2024-04-18T10:36:09.033999+0000","last_undegraded":"2024-04-18T10:36:09.033999+0000","last_fullsized":"2024-04-18T10:36:09.033999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.026432+0000","last_change":"2024-04-18T10:36:09.021888+0000","last_active":"2024-04-18T10:36:09.026432+0000","last_peered":"2024-04-18T10:36:09.026432+0000","last_clean":"2024-04-18T10:36:09.026432+0000","last_became_active":"2024-04-18T10:36:09.018363+0000","last_became_peered":"2024-04-18T10:36:09.018363+0000","last_unstale":"2024-04-18T10:36:09.026432+0000","last_undegraded":"2024-04-18T10:36:09.026432+0000","last_fullsized":"2024-04-18T10:36:09.026432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043521+0000","last_change":"2024-04-18T10:36:08.714829+0000","last_active":"2024-04-18T10:36:09.043521+0000","last_peered":"2024-04-18T10:36:09.043521+0000","last_clean":"2024-04-18T10:36:09.043521+0000","last_became_active":"2024-04-18T10:36:08.714528+0000","last_became_peered":"2024-04-18T10:36:08.714528+0000","last_unstale":"2024-04-18T10:36:09.043521+0000","last_undegraded":"2024-04-18T10:36:09.043521+0000","last_fullsized":"2024-04-18T10:36:09.043521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.026421+0000","last_change":"2024-04-18T10:36:09.022031+0000","last_active":"2024-04-18T10:36:09.026421+0000","last_peered":"2024-04-18T10:36:09.026421+0000","last_clean":"2024-04-18T10:36:09.026421+0000","last_became_active":"2024-04-18T10:36:09.018240+0000","last_became_peered":"2024-04-18T10:36:09.018240+0000","last_unstale":"2024-04-18T10:36:09.026421+0000","last_undegraded":"2024-04-18T10:36:09.026421+0000","last_fullsized":"2024-04-18T10:36:09.026421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.041222+0000","last_change":"2024-04-18T10:36:08.712223+0000","last_active":"2024-04-18T10:36:09.041222+0000","last_peered":"2024-04-18T10:36:09.041222+0000","last_clean":"2024-04-18T10:36:09.041222+0000","last_became_active":"2024-04-18T10:36:08.711192+0000","last_became_peered":"2024-04-18T10:36:08.711192+0000","last_unstale":"2024-04-18T10:36:09.041222+0000","last_undegraded":"2024-04-18T10:36:09.041222+0000","last_fullsized":"2024-04-18T10:36:09.041222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043087+0000","last_change":"2024-04-18T10:36:09.030946+0000","last_active":"2024-04-18T10:36:09.043087+0000","last_peered":"2024-04-18T10:36:09.043087+0000","last_clean":"2024-04-18T10:36:09.043087+0000","last_became_active":"2024-04-18T10:36:09.030646+0000","last_became_peered":"2024-04-18T10:36:09.030646+0000","last_unstale":"2024-04-18T10:36:09.043087+0000","last_undegraded":"2024-04-18T10:36:09.043087+0000","last_fullsized":"2024-04-18T10:36:09.043087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.022671+0000","last_change":"2024-04-18T10:36:08.706957+0000","last_active":"2024-04-18T10:36:09.022671+0000","last_peered":"2024-04-18T10:36:09.022671+0000","last_clean":"2024-04-18T10:36:09.022671+0000","last_became_active":"2024-04-18T10:36:08.706598+0000","last_became_peered":"2024-04-18T10:36:08.706598+0000","last_unstale":"2024-04-18T10:36:09.022671+0000","last_undegraded":"2024-04-18T10:36:09.022671+0000","last_fullsized":"2024-04-18T10:36:09.022671+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023061+0000","last_change":"2024-04-18T10:36:09.017279+0000","last_active":"2024-04-18T10:36:09.023061+0000","last_peered":"2024-04-18T10:36:09.023061+0000","last_clean":"2024-04-18T10:36:09.023061+0000","last_became_active":"2024-04-18T10:36:09.016931+0000","last_became_peered":"2024-04-18T10:36:09.016931+0000","last_unstale":"2024-04-18T10:36:09.023061+0000","last_undegraded":"2024-04-18T10:36:09.023061+0000","last_fullsized":"2024-04-18T10:36:09.023061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.035473+0000","last_change":"2024-04-18T10:36:09.032926+0000","last_active":"2024-04-18T10:36:09.035473+0000","last_peered":"2024-04-18T10:36:09.035473+0000","last_clean":"2024-04-18T10:36:09.035473+0000","last_became_active":"2024-04-18T10:36:09.032571+0000","last_became_peered":"2024-04-18T10:36:09.032571+0000","last_unstale":"2024-04-18T10:36:09.035473+0000","last_undegraded":"2024-04-18T10:36:09.035473+0000","last_fullsized":"2024-04-18T10:36:09.035473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044024+0000","last_change":"2024-04-18T10:36:09.042985+0000","last_active":"2024-04-18T10:36:09.044024+0000","last_peered":"2024-04-18T10:36:09.044024+0000","last_clean":"2024-04-18T10:36:09.044024+0000","last_became_active":"2024-04-18T10:36:09.039602+0000","last_became_peered":"2024-04-18T10:36:09.039602+0000","last_unstale":"2024-04-18T10:36:09.044024+0000","last_undegraded":"2024-04-18T10:36:09.044024+0000","last_fullsized":"2024-04-18T10:36:09.044024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.036316+0000","last_change":"2024-04-18T10:36:09.028593+0000","last_active":"2024-04-18T10:36:09.036316+0000","last_peered":"2024-04-18T10:36:09.036316+0000","last_clean":"2024-04-18T10:36:09.036316+0000","last_became_active":"2024-04-18T10:36:09.028237+0000","last_became_peered":"2024-04-18T10:36:09.028237+0000","last_unstale":"2024-04-18T10:36:09.036316+0000","last_undegraded":"2024-04-18T10:36:09.036316+0000","last_fullsized":"2024-04-18T10:36:09.036316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045647+0000","last_change":"2024-04-18T10:36:09.043613+0000","last_active":"2024-04-18T10:36:09.045647+0000","last_peered":"2024-04-18T10:36:09.045647+0000","last_clean":"2024-04-18T10:36:09.045647+0000","last_became_active":"2024-04-18T10:36:09.042942+0000","last_became_peered":"2024-04-18T10:36:09.042942+0000","last_unstale":"2024-04-18T10:36:09.045647+0000","last_undegraded":"2024-04-18T10:36:09.045647+0000","last_fullsized":"2024-04-18T10:36:09.045647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023383+0000","last_change":"2024-04-18T10:36:09.017151+0000","last_active":"2024-04-18T10:36:09.023383+0000","last_peered":"2024-04-18T10:36:09.023383+0000","last_clean":"2024-04-18T10:36:09.023383+0000","last_became_active":"2024-04-18T10:36:09.016454+0000","last_became_peered":"2024-04-18T10:36:09.016454+0000","last_unstale":"2024-04-18T10:36:09.023383+0000","last_undegraded":"2024-04-18T10:36:09.023383+0000","last_fullsized":"2024-04-18T10:36:09.023383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672964,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":55679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":54268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]},{"osd":0,"up_from":10,"seq":42949672964,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":53320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]}]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":53266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]}]}]}} 2024-04-18T10:36:16.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:36:17.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.071+0000 7ff780da4700 1 Processor -- start 2024-04-18T10:36:17.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.071+0000 7ff780da4700 1 -- start start 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff780da4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff780da4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c0a5050 0x7ff77c1348e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff780da4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff77c134dd0 0x7ff77c0a2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff780da4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c0a4870 con 0x7ff77c134dd0 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff780da4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0a4050 con 0x7ff77c134500 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff780da4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0a42f0 con 0x7ff77c0a5050 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff77ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff77c134dd0 0x7ff77c0a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff77a59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff779d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c0a5050 0x7ff77c1348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff77ad9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff77c134dd0 0x7ff77c0a2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53502/0 (socket says 172.21.15.31:53502) 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff77ad9d700 1 -- 172.21.15.31:0/981048801 learned_addr learned my addr 172.21.15.31:0/981048801 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff779d9b700 1 -- 172.21.15.31:0/981048801 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 msgr2=0x7ff77c0a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff779d9b700 1 --2- 172.21.15.31:0/981048801 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c0a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff779d9b700 1 -- 172.21.15.31:0/981048801 >> v2:172.21.15.31:3300/0 conn(0x7ff77c134dd0 msgr2=0x7ff77c0a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff779d9b700 1 --2- 172.21.15.31:0/981048801 >> v2:172.21.15.31:3300/0 conn(0x7ff77c134dd0 0x7ff77c0a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff779d9b700 1 -- 172.21.15.31:0/981048801 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c05bd30 con 0x7ff77c0a5050 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff77ad9d700 1 --2- 172.21.15.31:0/981048801 >> v2:172.21.15.31:3300/0 conn(0x7ff77c134dd0 0x7ff77c0a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff77a59c700 1 --2- 172.21.15.31:0/981048801 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c0a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff779d9b700 1 --2- 172.21.15.31:0/981048801 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c0a5050 0x7ff77c1348e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff770002f70 tx=0x7ff770006df0).ready entity=mon.2 client_cookie=c664213815f49e2d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff77959a700 1 -- 172.21.15.31:0/981048801 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77000d4a0 con 0x7ff77c0a5050 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff77959a700 1 -- 172.21.15.31:0/981048801 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770000e90 con 0x7ff77c0a5050 2024-04-18T10:36:17.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.072+0000 7ff77959a700 1 -- 172.21.15.31:0/981048801 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77000d7f0 con 0x7ff77c0a5050 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.073+0000 7ff780da4700 1 -- 172.21.15.31:0/981048801 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c0a5050 msgr2=0x7ff77c1348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.073+0000 7ff780da4700 1 --2- 172.21.15.31:0/981048801 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c0a5050 0x7ff77c1348e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff770002f70 tx=0x7ff770006df0).stop 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.073+0000 7ff780da4700 1 -- 172.21.15.31:0/981048801 shutdown_connections 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.073+0000 7ff780da4700 1 --2- 172.21.15.31:0/981048801 >> v2:172.21.15.31:3300/0 conn(0x7ff77c134dd0 0x7ff77c0a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.073+0000 7ff780da4700 1 --2- 172.21.15.31:0/981048801 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c0a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.073+0000 7ff780da4700 1 --2- 172.21.15.31:0/981048801 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c0a5050 0x7ff77c1348e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.073+0000 7ff780da4700 1 -- 172.21.15.31:0/981048801 >> 172.21.15.31:0/981048801 conn(0x7ff77c060ac0 msgr2=0x7ff77c0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.073+0000 7ff780da4700 1 -- 172.21.15.31:0/981048801 shutdown_connections 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.073+0000 7ff780da4700 1 -- 172.21.15.31:0/981048801 wait complete. 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.074+0000 7ff780da4700 1 Processor -- start 2024-04-18T10:36:17.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.074+0000 7ff780da4700 1 -- start start 2024-04-18T10:36:17.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff780da4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff77c0a5050 0x7ff77c147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff780da4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff780da4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c134dd0 0x7ff77c143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff780da4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c147cd0 con 0x7ff77c0a5050 2024-04-18T10:36:17.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff780da4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c092520 con 0x7ff77c134500 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff780da4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c146df0 con 0x7ff77c134dd0 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff779d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff77ad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c134dd0 0x7ff77c143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff77a59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff77c0a5050 0x7ff77c147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff779d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c143a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54628/0 (socket says 172.21.15.31:54628) 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff779d9b700 1 -- 172.21.15.31:0/1696901908 learned_addr learned my addr 172.21.15.31:0/1696901908 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff779d9b700 1 -- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c134dd0 msgr2=0x7ff77c143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff779d9b700 1 --2- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c134dd0 0x7ff77c143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff779d9b700 1 -- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff77c0a5050 msgr2=0x7ff77c147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff779d9b700 1 --2- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff77c0a5050 0x7ff77c147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff779d9b700 1 -- 172.21.15.31:0/1696901908 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c00b180 con 0x7ff77c134500 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff77ad9d700 1 --2- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c134dd0 0x7ff77c143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff779d9b700 1 --2- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c143a20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff770002f70 tx=0x7ff770014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff76b7fe700 1 -- 172.21.15.31:0/1696901908 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff770012930 con 0x7ff77c134500 2024-04-18T10:36:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff76b7fe700 1 -- 172.21.15.31:0/1696901908 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770012a90 con 0x7ff77c134500 2024-04-18T10:36:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff774009530 con 0x7ff77c134500 2024-04-18T10:36:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff76b7fe700 1 -- 172.21.15.31:0/1696901908 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff770012df0 con 0x7ff77c134500 2024-04-18T10:36:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.075+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77000b180 con 0x7ff77c134500 2024-04-18T10:36:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.076+0000 7ff76b7fe700 1 -- 172.21.15.31:0/1696901908 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff77001c070 con 0x7ff77c134500 2024-04-18T10:36:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.076+0000 7ff76b7fe700 1 -- 172.21.15.31:0/1696901908 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff77004b3c0 con 0x7ff77c134500 2024-04-18T10:36:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.077+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c147020 con 0x7ff77c134500 2024-04-18T10:36:17.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.080+0000 7ff76b7fe700 1 -- 172.21.15.31:0/1696901908 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff77c147020 con 0x7ff77c134500 2024-04-18T10:36:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.194+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 --> v1:172.21.15.31:6816/39551 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff77c147020 con 0x7ff758038da0 2024-04-18T10:36:17.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.201+0000 7ff76b7fe700 1 -- 172.21.15.31:0/1696901908 <== mgr.4101 v1:172.21.15.31:6816/39551 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246980 (unknown 2965378022 0 2183561483) 0x7ff77c147020 con 0x7ff758038da0 2024-04-18T10:36:17.203 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:17.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 >> v1:172.21.15.31:6816/39551 conn(0x7ff758038da0 legacy=0x7ff75803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 msgr2=0x7ff77c143a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 --2- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c143a20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff770002f70 tx=0x7ff770014000).stop 2024-04-18T10:36:17.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 shutdown_connections 2024-04-18T10:36:17.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 --2- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff77c134dd0 0x7ff77c143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 --2- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff77c0a5050 0x7ff77c147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 --2- 172.21.15.31:0/1696901908 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff77c134500 0x7ff77c143a20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 >> 172.21.15.31:0/1696901908 conn(0x7ff77c060ac0 msgr2=0x7ff77c0a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:17.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 shutdown_connections 2024-04-18T10:36:17.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.203+0000 7ff780da4700 1 -- 172.21.15.31:0/1696901908 wait complete. 2024-04-18T10:36:17.206 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:36:17.212 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-18T10:36:15.388841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195072,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292288,"statfs":{"total":386547056640,"available":382251302912,"internally_reserved":4294967296,"allocated":753664,"data_stored":216533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.715294"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038116+0000","last_change":"2024-04-18T10:36:09.029464+0000","last_active":"2024-04-18T10:36:09.038116+0000","last_peered":"2024-04-18T10:36:09.038116+0000","last_clean":"2024-04-18T10:36:09.038116+0000","last_became_active":"2024-04-18T10:36:09.029119+0000","last_became_peered":"2024-04-18T10:36:09.029119+0000","last_unstale":"2024-04-18T10:36:09.038116+0000","last_undegraded":"2024-04-18T10:36:09.038116+0000","last_fullsized":"2024-04-18T10:36:09.038116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021034+0000","last_change":"2024-04-18T10:36:09.016639+0000","last_active":"2024-04-18T10:36:09.021034+0000","last_peered":"2024-04-18T10:36:09.021034+0000","last_clean":"2024-04-18T10:36:09.021034+0000","last_became_active":"2024-04-18T10:36:09.016298+0000","last_became_peered":"2024-04-18T10:36:09.016298+0000","last_unstale":"2024-04-18T10:36:09.021034+0000","last_undegraded":"2024-04-18T10:36:09.021034+0000","last_fullsized":"2024-04-18T10:36:09.021034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.029214+0000","last_change":"2024-04-18T10:36:09.021729+0000","last_active":"2024-04-18T10:36:09.029214+0000","last_peered":"2024-04-18T10:36:09.029214+0000","last_clean":"2024-04-18T10:36:09.029214+0000","last_became_active":"2024-04-18T10:36:09.021089+0000","last_became_peered":"2024-04-18T10:36:09.021089+0000","last_unstale":"2024-04-18T10:36:09.029214+0000","last_undegraded":"2024-04-18T10:36:09.029214+0000","last_fullsized":"2024-04-18T10:36:09.029214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027739+0000","last_change":"2024-04-18T10:36:09.022509+0000","last_active":"2024-04-18T10:36:09.027739+0000","last_peered":"2024-04-18T10:36:09.027739+0000","last_clean":"2024-04-18T10:36:09.027739+0000","last_became_active":"2024-04-18T10:36:09.019360+0000","last_became_peered":"2024-04-18T10:36:09.019360+0000","last_unstale":"2024-04-18T10:36:09.027739+0000","last_undegraded":"2024-04-18T10:36:09.027739+0000","last_fullsized":"2024-04-18T10:36:09.027739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027607+0000","last_change":"2024-04-18T10:36:09.021300+0000","last_active":"2024-04-18T10:36:09.027607+0000","last_peered":"2024-04-18T10:36:09.027607+0000","last_clean":"2024-04-18T10:36:09.027607+0000","last_became_active":"2024-04-18T10:36:09.018608+0000","last_became_peered":"2024-04-18T10:36:09.018608+0000","last_unstale":"2024-04-18T10:36:09.027607+0000","last_undegraded":"2024-04-18T10:36:09.027607+0000","last_fullsized":"2024-04-18T10:36:09.027607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043852+0000","last_change":"2024-04-18T10:36:09.041400+0000","last_active":"2024-04-18T10:36:09.043852+0000","last_peered":"2024-04-18T10:36:09.043852+0000","last_clean":"2024-04-18T10:36:09.043852+0000","last_became_active":"2024-04-18T10:36:09.038827+0000","last_became_peered":"2024-04-18T10:36:09.038827+0000","last_unstale":"2024-04-18T10:36:09.043852+0000","last_undegraded":"2024-04-18T10:36:09.043852+0000","last_fullsized":"2024-04-18T10:36:09.043852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043983+0000","last_change":"2024-04-18T10:36:09.042033+0000","last_active":"2024-04-18T10:36:09.043983+0000","last_peered":"2024-04-18T10:36:09.043983+0000","last_clean":"2024-04-18T10:36:09.043983+0000","last_became_active":"2024-04-18T10:36:09.039118+0000","last_became_peered":"2024-04-18T10:36:09.039118+0000","last_unstale":"2024-04-18T10:36:09.043983+0000","last_undegraded":"2024-04-18T10:36:09.043983+0000","last_fullsized":"2024-04-18T10:36:09.043983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.035450+0000","last_change":"2024-04-18T10:36:09.032927+0000","last_active":"2024-04-18T10:36:09.035450+0000","last_peered":"2024-04-18T10:36:09.035450+0000","last_clean":"2024-04-18T10:36:09.035450+0000","last_became_active":"2024-04-18T10:36:09.032162+0000","last_became_peered":"2024-04-18T10:36:09.032162+0000","last_unstale":"2024-04-18T10:36:09.035450+0000","last_undegraded":"2024-04-18T10:36:09.035450+0000","last_fullsized":"2024-04-18T10:36:09.035450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028743+0000","last_change":"2024-04-18T10:36:09.022311+0000","last_active":"2024-04-18T10:36:09.028743+0000","last_peered":"2024-04-18T10:36:09.028743+0000","last_clean":"2024-04-18T10:36:09.028743+0000","last_became_active":"2024-04-18T10:36:09.021805+0000","last_became_peered":"2024-04-18T10:36:09.021805+0000","last_unstale":"2024-04-18T10:36:09.028743+0000","last_undegraded":"2024-04-18T10:36:09.028743+0000","last_fullsized":"2024-04-18T10:36:09.028743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038226+0000","last_change":"2024-04-18T10:36:09.034290+0000","last_active":"2024-04-18T10:36:09.038226+0000","last_peered":"2024-04-18T10:36:09.038226+0000","last_clean":"2024-04-18T10:36:09.038226+0000","last_became_active":"2024-04-18T10:36:09.034081+0000","last_became_peered":"2024-04-18T10:36:09.034081+0000","last_unstale":"2024-04-18T10:36:09.038226+0000","last_undegraded":"2024-04-18T10:36:09.038226+0000","last_fullsized":"2024-04-18T10:36:09.038226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023279+0000","last_change":"2024-04-18T10:36:09.016527+0000","last_active":"2024-04-18T10:36:09.023279+0000","last_peered":"2024-04-18T10:36:09.023279+0000","last_clean":"2024-04-18T10:36:09.023279+0000","last_became_active":"2024-04-18T10:36:09.014883+0000","last_became_peered":"2024-04-18T10:36:09.014883+0000","last_unstale":"2024-04-18T10:36:09.023279+0000","last_undegraded":"2024-04-18T10:36:09.023279+0000","last_fullsized":"2024-04-18T10:36:09.023279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.013927+0000","last_change":"2024-04-18T10:36:09.005314+0000","last_active":"2024-04-18T10:36:09.013927+0000","last_peered":"2024-04-18T10:36:09.013927+0000","last_clean":"2024-04-18T10:36:09.013927+0000","last_became_active":"2024-04-18T10:36:09.004979+0000","last_became_peered":"2024-04-18T10:36:09.004979+0000","last_unstale":"2024-04-18T10:36:09.013927+0000","last_undegraded":"2024-04-18T10:36:09.013927+0000","last_fullsized":"2024-04-18T10:36:09.013927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038097+0000","last_change":"2024-04-18T10:36:09.028839+0000","last_active":"2024-04-18T10:36:09.038097+0000","last_peered":"2024-04-18T10:36:09.038097+0000","last_clean":"2024-04-18T10:36:09.038097+0000","last_became_active":"2024-04-18T10:36:09.028502+0000","last_became_peered":"2024-04-18T10:36:09.028502+0000","last_unstale":"2024-04-18T10:36:09.038097+0000","last_undegraded":"2024-04-18T10:36:09.038097+0000","last_fullsized":"2024-04-18T10:36:09.038097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038555+0000","last_change":"2024-04-18T10:36:09.034002+0000","last_active":"2024-04-18T10:36:09.038555+0000","last_peered":"2024-04-18T10:36:09.038555+0000","last_clean":"2024-04-18T10:36:09.038555+0000","last_became_active":"2024-04-18T10:36:09.033512+0000","last_became_peered":"2024-04-18T10:36:09.033512+0000","last_unstale":"2024-04-18T10:36:09.038555+0000","last_undegraded":"2024-04-18T10:36:09.038555+0000","last_fullsized":"2024-04-18T10:36:09.038555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.018733+0000","last_change":"2024-04-18T10:36:09.008596+0000","last_active":"2024-04-18T10:36:09.018733+0000","last_peered":"2024-04-18T10:36:09.018733+0000","last_clean":"2024-04-18T10:36:09.018733+0000","last_became_active":"2024-04-18T10:36:09.008249+0000","last_became_peered":"2024-04-18T10:36:09.008249+0000","last_unstale":"2024-04-18T10:36:09.018733+0000","last_undegraded":"2024-04-18T10:36:09.018733+0000","last_fullsized":"2024-04-18T10:36:09.018733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048341+0000","last_change":"2024-04-18T10:36:09.043650+0000","last_active":"2024-04-18T10:36:09.048341+0000","last_peered":"2024-04-18T10:36:09.048341+0000","last_clean":"2024-04-18T10:36:09.048341+0000","last_became_active":"2024-04-18T10:36:09.039117+0000","last_became_peered":"2024-04-18T10:36:09.039117+0000","last_unstale":"2024-04-18T10:36:09.048341+0000","last_undegraded":"2024-04-18T10:36:09.048341+0000","last_fullsized":"2024-04-18T10:36:09.048341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028720+0000","last_change":"2024-04-18T10:36:09.022106+0000","last_active":"2024-04-18T10:36:09.028720+0000","last_peered":"2024-04-18T10:36:09.028720+0000","last_clean":"2024-04-18T10:36:09.028720+0000","last_became_active":"2024-04-18T10:36:09.021380+0000","last_became_peered":"2024-04-18T10:36:09.021380+0000","last_unstale":"2024-04-18T10:36:09.028720+0000","last_undegraded":"2024-04-18T10:36:09.028720+0000","last_fullsized":"2024-04-18T10:36:09.028720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.018007+0000","last_change":"2024-04-18T10:36:09.007051+0000","last_active":"2024-04-18T10:36:09.018007+0000","last_peered":"2024-04-18T10:36:09.018007+0000","last_clean":"2024-04-18T10:36:09.018007+0000","last_became_active":"2024-04-18T10:36:09.006731+0000","last_became_peered":"2024-04-18T10:36:09.006731+0000","last_unstale":"2024-04-18T10:36:09.018007+0000","last_undegraded":"2024-04-18T10:36:09.018007+0000","last_fullsized":"2024-04-18T10:36:09.018007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.025759+0000","last_change":"2024-04-18T10:36:09.021352+0000","last_active":"2024-04-18T10:36:09.025759+0000","last_peered":"2024-04-18T10:36:09.025759+0000","last_clean":"2024-04-18T10:36:09.025759+0000","last_became_active":"2024-04-18T10:36:09.018400+0000","last_became_peered":"2024-04-18T10:36:09.018400+0000","last_unstale":"2024-04-18T10:36:09.025759+0000","last_undegraded":"2024-04-18T10:36:09.025759+0000","last_fullsized":"2024-04-18T10:36:09.025759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040399+0000","last_change":"2024-04-18T10:36:09.037939+0000","last_active":"2024-04-18T10:36:09.040399+0000","last_peered":"2024-04-18T10:36:09.040399+0000","last_clean":"2024-04-18T10:36:09.040399+0000","last_became_active":"2024-04-18T10:36:09.037611+0000","last_became_peered":"2024-04-18T10:36:09.037611+0000","last_unstale":"2024-04-18T10:36:09.040399+0000","last_undegraded":"2024-04-18T10:36:09.040399+0000","last_fullsized":"2024-04-18T10:36:09.040399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040284+0000","last_change":"2024-04-18T10:36:09.036858+0000","last_active":"2024-04-18T10:36:09.040284+0000","last_peered":"2024-04-18T10:36:09.040284+0000","last_clean":"2024-04-18T10:36:09.040284+0000","last_became_active":"2024-04-18T10:36:09.036508+0000","last_became_peered":"2024-04-18T10:36:09.036508+0000","last_unstale":"2024-04-18T10:36:09.040284+0000","last_undegraded":"2024-04-18T10:36:09.040284+0000","last_fullsized":"2024-04-18T10:36:09.040284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028695+0000","last_change":"2024-04-18T10:36:09.021243+0000","last_active":"2024-04-18T10:36:09.028695+0000","last_peered":"2024-04-18T10:36:09.028695+0000","last_clean":"2024-04-18T10:36:09.028695+0000","last_became_active":"2024-04-18T10:36:09.019277+0000","last_became_peered":"2024-04-18T10:36:09.019277+0000","last_unstale":"2024-04-18T10:36:09.028695+0000","last_undegraded":"2024-04-18T10:36:09.028695+0000","last_fullsized":"2024-04-18T10:36:09.028695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043961+0000","last_change":"2024-04-18T10:36:09.041841+0000","last_active":"2024-04-18T10:36:09.043961+0000","last_peered":"2024-04-18T10:36:09.043961+0000","last_clean":"2024-04-18T10:36:09.043961+0000","last_became_active":"2024-04-18T10:36:09.038958+0000","last_became_peered":"2024-04-18T10:36:09.038958+0000","last_unstale":"2024-04-18T10:36:09.043961+0000","last_undegraded":"2024-04-18T10:36:09.043961+0000","last_fullsized":"2024-04-18T10:36:09.043961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038748+0000","last_change":"2024-04-18T10:36:09.035656+0000","last_active":"2024-04-18T10:36:09.038748+0000","last_peered":"2024-04-18T10:36:09.038748+0000","last_clean":"2024-04-18T10:36:09.038748+0000","last_became_active":"2024-04-18T10:36:09.035221+0000","last_became_peered":"2024-04-18T10:36:09.035221+0000","last_unstale":"2024-04-18T10:36:09.038748+0000","last_undegraded":"2024-04-18T10:36:09.038748+0000","last_fullsized":"2024-04-18T10:36:09.038748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.037238+0000","last_change":"2024-04-18T10:36:09.031118+0000","last_active":"2024-04-18T10:36:09.037238+0000","last_peered":"2024-04-18T10:36:09.037238+0000","last_clean":"2024-04-18T10:36:09.037238+0000","last_became_active":"2024-04-18T10:36:09.024843+0000","last_became_peered":"2024-04-18T10:36:09.024843+0000","last_unstale":"2024-04-18T10:36:09.037238+0000","last_undegraded":"2024-04-18T10:36:09.037238+0000","last_fullsized":"2024-04-18T10:36:09.037238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.034882+0000","last_change":"2024-04-18T10:36:09.032225+0000","last_active":"2024-04-18T10:36:09.034882+0000","last_peered":"2024-04-18T10:36:09.034882+0000","last_clean":"2024-04-18T10:36:09.034882+0000","last_became_active":"2024-04-18T10:36:09.031895+0000","last_became_peered":"2024-04-18T10:36:09.031895+0000","last_unstale":"2024-04-18T10:36:09.034882+0000","last_undegraded":"2024-04-18T10:36:09.034882+0000","last_fullsized":"2024-04-18T10:36:09.034882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043564+0000","last_change":"2024-04-18T10:36:09.040868+0000","last_active":"2024-04-18T10:36:09.043564+0000","last_peered":"2024-04-18T10:36:09.043564+0000","last_clean":"2024-04-18T10:36:09.043564+0000","last_became_active":"2024-04-18T10:36:09.038946+0000","last_became_peered":"2024-04-18T10:36:09.038946+0000","last_unstale":"2024-04-18T10:36:09.043564+0000","last_undegraded":"2024-04-18T10:36:09.043564+0000","last_fullsized":"2024-04-18T10:36:09.043564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.034159+0000","last_change":"2024-04-18T10:36:08.696988+0000","last_active":"2024-04-18T10:36:09.034159+0000","last_peered":"2024-04-18T10:36:09.034159+0000","last_clean":"2024-04-18T10:36:09.034159+0000","last_became_active":"2024-04-18T10:36:08.696639+0000","last_became_peered":"2024-04-18T10:36:08.696639+0000","last_unstale":"2024-04-18T10:36:09.034159+0000","last_undegraded":"2024-04-18T10:36:09.034159+0000","last_fullsized":"2024-04-18T10:36:09.034159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043580+0000","last_change":"2024-04-18T10:36:09.040997+0000","last_active":"2024-04-18T10:36:09.043580+0000","last_peered":"2024-04-18T10:36:09.043580+0000","last_clean":"2024-04-18T10:36:09.043580+0000","last_became_active":"2024-04-18T10:36:09.039544+0000","last_became_peered":"2024-04-18T10:36:09.039544+0000","last_unstale":"2024-04-18T10:36:09.043580+0000","last_undegraded":"2024-04-18T10:36:09.043580+0000","last_fullsized":"2024-04-18T10:36:09.043580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.002229+0000","last_change":"2024-04-18T10:36:08.706823+0000","last_active":"2024-04-18T10:36:09.002229+0000","last_peered":"2024-04-18T10:36:09.002229+0000","last_clean":"2024-04-18T10:36:09.002229+0000","last_became_active":"2024-04-18T10:36:08.706488+0000","last_became_peered":"2024-04-18T10:36:08.706488+0000","last_unstale":"2024-04-18T10:36:09.002229+0000","last_undegraded":"2024-04-18T10:36:09.002229+0000","last_fullsized":"2024-04-18T10:36:09.002229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028604+0000","last_change":"2024-04-18T10:36:09.020079+0000","last_active":"2024-04-18T10:36:09.028604+0000","last_peered":"2024-04-18T10:36:09.028604+0000","last_clean":"2024-04-18T10:36:09.028604+0000","last_became_active":"2024-04-18T10:36:09.019759+0000","last_became_peered":"2024-04-18T10:36:09.019759+0000","last_unstale":"2024-04-18T10:36:09.028604+0000","last_undegraded":"2024-04-18T10:36:09.028604+0000","last_fullsized":"2024-04-18T10:36:09.028604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.996687+0000","last_change":"2024-04-18T10:36:08.715008+0000","last_active":"2024-04-18T10:36:09.996687+0000","last_peered":"2024-04-18T10:36:09.996687+0000","last_clean":"2024-04-18T10:36:09.996687+0000","last_became_active":"2024-04-18T10:36:08.714642+0000","last_became_peered":"2024-04-18T10:36:08.714642+0000","last_unstale":"2024-04-18T10:36:09.996687+0000","last_undegraded":"2024-04-18T10:36:09.996687+0000","last_fullsized":"2024-04-18T10:36:09.996687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048447+0000","last_change":"2024-04-18T10:36:09.045728+0000","last_active":"2024-04-18T10:36:09.048447+0000","last_peered":"2024-04-18T10:36:09.048447+0000","last_clean":"2024-04-18T10:36:09.048447+0000","last_became_active":"2024-04-18T10:36:09.045122+0000","last_became_peered":"2024-04-18T10:36:09.045122+0000","last_unstale":"2024-04-18T10:36:09.048447+0000","last_undegraded":"2024-04-18T10:36:09.048447+0000","last_fullsized":"2024-04-18T10:36:09.048447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.013511+0000","last_change":"2024-04-18T10:36:08.706131+0000","last_active":"2024-04-18T10:36:11.013511+0000","last_peered":"2024-04-18T10:36:11.013511+0000","last_clean":"2024-04-18T10:36:11.013511+0000","last_became_active":"2024-04-18T10:36:08.705713+0000","last_became_peered":"2024-04-18T10:36:08.705713+0000","last_unstale":"2024-04-18T10:36:11.013511+0000","last_undegraded":"2024-04-18T10:36:11.013511+0000","last_fullsized":"2024-04-18T10:36:11.013511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048368+0000","last_change":"2024-04-18T10:36:09.043706+0000","last_active":"2024-04-18T10:36:09.048368+0000","last_peered":"2024-04-18T10:36:09.048368+0000","last_clean":"2024-04-18T10:36:09.048368+0000","last_became_active":"2024-04-18T10:36:09.039571+0000","last_became_peered":"2024-04-18T10:36:09.039571+0000","last_unstale":"2024-04-18T10:36:09.048368+0000","last_undegraded":"2024-04-18T10:36:09.048368+0000","last_fullsized":"2024-04-18T10:36:09.048368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.008477+0000","last_change":"2024-04-18T10:36:08.703814+0000","last_active":"2024-04-18T10:36:11.008477+0000","last_peered":"2024-04-18T10:36:11.008477+0000","last_clean":"2024-04-18T10:36:11.008477+0000","last_became_active":"2024-04-18T10:36:08.703206+0000","last_became_peered":"2024-04-18T10:36:08.703206+0000","last_unstale":"2024-04-18T10:36:11.008477+0000","last_undegraded":"2024-04-18T10:36:11.008477+0000","last_fullsized":"2024-04-18T10:36:11.008477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044003+0000","last_change":"2024-04-18T10:36:09.042232+0000","last_active":"2024-04-18T10:36:09.044003+0000","last_peered":"2024-04-18T10:36:09.044003+0000","last_clean":"2024-04-18T10:36:09.044003+0000","last_became_active":"2024-04-18T10:36:09.039432+0000","last_became_peered":"2024-04-18T10:36:09.039432+0000","last_unstale":"2024-04-18T10:36:09.044003+0000","last_undegraded":"2024-04-18T10:36:09.044003+0000","last_fullsized":"2024-04-18T10:36:09.044003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.997268+0000","last_change":"2024-04-18T10:36:08.705414+0000","last_active":"2024-04-18T10:36:09.997268+0000","last_peered":"2024-04-18T10:36:09.997268+0000","last_clean":"2024-04-18T10:36:09.997268+0000","last_became_active":"2024-04-18T10:36:08.705077+0000","last_became_peered":"2024-04-18T10:36:08.705077+0000","last_unstale":"2024-04-18T10:36:09.997268+0000","last_undegraded":"2024-04-18T10:36:09.997268+0000","last_fullsized":"2024-04-18T10:36:09.997268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040352+0000","last_change":"2024-04-18T10:36:09.036998+0000","last_active":"2024-04-18T10:36:09.040352+0000","last_peered":"2024-04-18T10:36:09.040352+0000","last_clean":"2024-04-18T10:36:09.040352+0000","last_became_active":"2024-04-18T10:36:09.036672+0000","last_became_peered":"2024-04-18T10:36:09.036672+0000","last_unstale":"2024-04-18T10:36:09.040352+0000","last_undegraded":"2024-04-18T10:36:09.040352+0000","last_fullsized":"2024-04-18T10:36:09.040352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.011384+0000","last_change":"2024-04-18T10:36:08.711520+0000","last_active":"2024-04-18T10:36:11.011384+0000","last_peered":"2024-04-18T10:36:11.011384+0000","last_clean":"2024-04-18T10:36:11.011384+0000","last_became_active":"2024-04-18T10:36:08.711135+0000","last_became_peered":"2024-04-18T10:36:08.711135+0000","last_unstale":"2024-04-18T10:36:11.011384+0000","last_undegraded":"2024-04-18T10:36:11.011384+0000","last_fullsized":"2024-04-18T10:36:11.011384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016697+0000","last_change":"2024-04-18T10:36:09.012564+0000","last_active":"2024-04-18T10:36:09.016697+0000","last_peered":"2024-04-18T10:36:09.016697+0000","last_clean":"2024-04-18T10:36:09.016697+0000","last_became_active":"2024-04-18T10:36:09.012232+0000","last_became_peered":"2024-04-18T10:36:09.012232+0000","last_unstale":"2024-04-18T10:36:09.016697+0000","last_undegraded":"2024-04-18T10:36:09.016697+0000","last_fullsized":"2024-04-18T10:36:09.016697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.011129+0000","last_change":"2024-04-18T10:36:08.715596+0000","last_active":"2024-04-18T10:36:11.011129+0000","last_peered":"2024-04-18T10:36:11.011129+0000","last_clean":"2024-04-18T10:36:11.011129+0000","last_became_active":"2024-04-18T10:36:08.715228+0000","last_became_peered":"2024-04-18T10:36:08.715228+0000","last_unstale":"2024-04-18T10:36:11.011129+0000","last_undegraded":"2024-04-18T10:36:11.011129+0000","last_fullsized":"2024-04-18T10:36:11.011129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044093+0000","last_change":"2024-04-18T10:36:09.039566+0000","last_active":"2024-04-18T10:36:09.044093+0000","last_peered":"2024-04-18T10:36:09.044093+0000","last_clean":"2024-04-18T10:36:09.044093+0000","last_became_active":"2024-04-18T10:36:09.039196+0000","last_became_peered":"2024-04-18T10:36:09.039196+0000","last_unstale":"2024-04-18T10:36:09.044093+0000","last_undegraded":"2024-04-18T10:36:09.044093+0000","last_fullsized":"2024-04-18T10:36:09.044093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012770+0000","last_change":"2024-04-18T10:36:08.700155+0000","last_active":"2024-04-18T10:36:11.012770+0000","last_peered":"2024-04-18T10:36:11.012770+0000","last_clean":"2024-04-18T10:36:11.012770+0000","last_became_active":"2024-04-18T10:36:08.699825+0000","last_became_peered":"2024-04-18T10:36:08.699825+0000","last_unstale":"2024-04-18T10:36:11.012770+0000","last_undegraded":"2024-04-18T10:36:11.012770+0000","last_fullsized":"2024-04-18T10:36:11.012770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045311+0000","last_change":"2024-04-18T10:36:09.043704+0000","last_active":"2024-04-18T10:36:09.045311+0000","last_peered":"2024-04-18T10:36:09.045311+0000","last_clean":"2024-04-18T10:36:09.045311+0000","last_became_active":"2024-04-18T10:36:09.043212+0000","last_became_peered":"2024-04-18T10:36:09.043212+0000","last_unstale":"2024-04-18T10:36:09.045311+0000","last_undegraded":"2024-04-18T10:36:09.045311+0000","last_fullsized":"2024-04-18T10:36:09.045311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016667+0000","last_change":"2024-04-18T10:36:08.712894+0000","last_active":"2024-04-18T10:36:09.016667+0000","last_peered":"2024-04-18T10:36:09.016667+0000","last_clean":"2024-04-18T10:36:09.016667+0000","last_became_active":"2024-04-18T10:36:08.712527+0000","last_became_peered":"2024-04-18T10:36:08.712527+0000","last_unstale":"2024-04-18T10:36:09.016667+0000","last_undegraded":"2024-04-18T10:36:09.016667+0000","last_fullsized":"2024-04-18T10:36:09.016667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.036388+0000","last_change":"2024-04-18T10:36:09.028482+0000","last_active":"2024-04-18T10:36:09.036388+0000","last_peered":"2024-04-18T10:36:09.036388+0000","last_clean":"2024-04-18T10:36:09.036388+0000","last_became_active":"2024-04-18T10:36:09.027131+0000","last_became_peered":"2024-04-18T10:36:09.027131+0000","last_unstale":"2024-04-18T10:36:09.036388+0000","last_undegraded":"2024-04-18T10:36:09.036388+0000","last_fullsized":"2024-04-18T10:36:09.036388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.010119+0000","last_change":"2024-04-18T10:36:08.696453+0000","last_active":"2024-04-18T10:36:11.010119+0000","last_peered":"2024-04-18T10:36:11.010119+0000","last_clean":"2024-04-18T10:36:11.010119+0000","last_became_active":"2024-04-18T10:36:08.691479+0000","last_became_peered":"2024-04-18T10:36:08.691479+0000","last_unstale":"2024-04-18T10:36:11.010119+0000","last_undegraded":"2024-04-18T10:36:11.010119+0000","last_fullsized":"2024-04-18T10:36:11.010119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048422+0000","last_change":"2024-04-18T10:36:09.045160+0000","last_active":"2024-04-18T10:36:09.048422+0000","last_peered":"2024-04-18T10:36:09.048422+0000","last_clean":"2024-04-18T10:36:09.048422+0000","last_became_active":"2024-04-18T10:36:09.044693+0000","last_became_peered":"2024-04-18T10:36:09.044693+0000","last_unstale":"2024-04-18T10:36:09.048422+0000","last_undegraded":"2024-04-18T10:36:09.048422+0000","last_fullsized":"2024-04-18T10:36:09.048422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.022802+0000","last_change":"2024-04-18T10:36:08.693031+0000","last_active":"2024-04-18T10:36:09.022802+0000","last_peered":"2024-04-18T10:36:09.022802+0000","last_clean":"2024-04-18T10:36:09.022802+0000","last_became_active":"2024-04-18T10:36:08.692741+0000","last_became_peered":"2024-04-18T10:36:08.692741+0000","last_unstale":"2024-04-18T10:36:09.022802+0000","last_undegraded":"2024-04-18T10:36:09.022802+0000","last_fullsized":"2024-04-18T10:36:09.022802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048417+0000","last_change":"2024-04-18T10:36:09.043925+0000","last_active":"2024-04-18T10:36:09.048417+0000","last_peered":"2024-04-18T10:36:09.048417+0000","last_clean":"2024-04-18T10:36:09.048417+0000","last_became_active":"2024-04-18T10:36:09.043223+0000","last_became_peered":"2024-04-18T10:36:09.043223+0000","last_unstale":"2024-04-18T10:36:09.048417+0000","last_undegraded":"2024-04-18T10:36:09.048417+0000","last_fullsized":"2024-04-18T10:36:09.048417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.005701+0000","last_change":"2024-04-18T10:36:08.693355+0000","last_active":"2024-04-18T10:36:09.005701+0000","last_peered":"2024-04-18T10:36:09.005701+0000","last_clean":"2024-04-18T10:36:09.005701+0000","last_became_active":"2024-04-18T10:36:08.693035+0000","last_became_peered":"2024-04-18T10:36:08.693035+0000","last_unstale":"2024-04-18T10:36:09.005701+0000","last_undegraded":"2024-04-18T10:36:09.005701+0000","last_fullsized":"2024-04-18T10:36:09.005701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016525+0000","last_change":"2024-04-18T10:36:09.013954+0000","last_active":"2024-04-18T10:36:09.016525+0000","last_peered":"2024-04-18T10:36:09.016525+0000","last_clean":"2024-04-18T10:36:09.016525+0000","last_became_active":"2024-04-18T10:36:09.013544+0000","last_became_peered":"2024-04-18T10:36:09.013544+0000","last_unstale":"2024-04-18T10:36:09.016525+0000","last_undegraded":"2024-04-18T10:36:09.016525+0000","last_fullsized":"2024-04-18T10:36:09.016525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045534+0000","last_change":"2024-04-18T10:36:08.710986+0000","last_active":"2024-04-18T10:36:09.045534+0000","last_peered":"2024-04-18T10:36:09.045534+0000","last_clean":"2024-04-18T10:36:09.045534+0000","last_became_active":"2024-04-18T10:36:08.710570+0000","last_became_peered":"2024-04-18T10:36:08.710570+0000","last_unstale":"2024-04-18T10:36:09.045534+0000","last_undegraded":"2024-04-18T10:36:09.045534+0000","last_fullsized":"2024-04-18T10:36:09.045534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017673+0000","last_change":"2024-04-18T10:36:09.013364+0000","last_active":"2024-04-18T10:36:09.017673+0000","last_peered":"2024-04-18T10:36:09.017673+0000","last_clean":"2024-04-18T10:36:09.017673+0000","last_became_active":"2024-04-18T10:36:09.013081+0000","last_became_peered":"2024-04-18T10:36:09.013081+0000","last_unstale":"2024-04-18T10:36:09.017673+0000","last_undegraded":"2024-04-18T10:36:09.017673+0000","last_fullsized":"2024-04-18T10:36:09.017673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:08.998936+0000","last_change":"2024-04-18T10:36:08.697479+0000","last_active":"2024-04-18T10:36:08.998936+0000","last_peered":"2024-04-18T10:36:08.998936+0000","last_clean":"2024-04-18T10:36:08.998936+0000","last_became_active":"2024-04-18T10:36:08.697086+0000","last_became_peered":"2024-04-18T10:36:08.697086+0000","last_unstale":"2024-04-18T10:36:08.998936+0000","last_undegraded":"2024-04-18T10:36:08.998936+0000","last_fullsized":"2024-04-18T10:36:08.998936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027946+0000","last_change":"2024-04-18T10:36:09.022846+0000","last_active":"2024-04-18T10:36:09.027946+0000","last_peered":"2024-04-18T10:36:09.027946+0000","last_clean":"2024-04-18T10:36:09.027946+0000","last_became_active":"2024-04-18T10:36:09.019048+0000","last_became_peered":"2024-04-18T10:36:09.019048+0000","last_unstale":"2024-04-18T10:36:09.027946+0000","last_undegraded":"2024-04-18T10:36:09.027946+0000","last_fullsized":"2024-04-18T10:36:09.027946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009476+0000","last_change":"2024-04-18T10:36:08.715657+0000","last_active":"2024-04-18T10:36:11.009476+0000","last_peered":"2024-04-18T10:36:11.009476+0000","last_clean":"2024-04-18T10:36:11.009476+0000","last_became_active":"2024-04-18T10:36:08.715283+0000","last_became_peered":"2024-04-18T10:36:08.715283+0000","last_unstale":"2024-04-18T10:36:11.009476+0000","last_undegraded":"2024-04-18T10:36:11.009476+0000","last_fullsized":"2024-04-18T10:36:11.009476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.009252+0000","last_change":"2024-04-18T10:36:09.006046+0000","last_active":"2024-04-18T10:36:09.009252+0000","last_peered":"2024-04-18T10:36:09.009252+0000","last_clean":"2024-04-18T10:36:09.009252+0000","last_became_active":"2024-04-18T10:36:09.005726+0000","last_became_peered":"2024-04-18T10:36:09.005726+0000","last_unstale":"2024-04-18T10:36:09.009252+0000","last_undegraded":"2024-04-18T10:36:09.009252+0000","last_fullsized":"2024-04-18T10:36:09.009252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017607+0000","last_change":"2024-04-18T10:36:08.710590+0000","last_active":"2024-04-18T10:36:09.017607+0000","last_peered":"2024-04-18T10:36:09.017607+0000","last_clean":"2024-04-18T10:36:09.017607+0000","last_became_active":"2024-04-18T10:36:08.710198+0000","last_became_peered":"2024-04-18T10:36:08.710198+0000","last_unstale":"2024-04-18T10:36:09.017607+0000","last_undegraded":"2024-04-18T10:36:09.017607+0000","last_fullsized":"2024-04-18T10:36:09.017607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048407+0000","last_change":"2024-04-18T10:36:09.045249+0000","last_active":"2024-04-18T10:36:09.048407+0000","last_peered":"2024-04-18T10:36:09.048407+0000","last_clean":"2024-04-18T10:36:09.048407+0000","last_became_active":"2024-04-18T10:36:09.044573+0000","last_became_peered":"2024-04-18T10:36:09.044573+0000","last_unstale":"2024-04-18T10:36:09.048407+0000","last_undegraded":"2024-04-18T10:36:09.048407+0000","last_fullsized":"2024-04-18T10:36:09.048407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012927+0000","last_change":"2024-04-18T10:36:08.709580+0000","last_active":"2024-04-18T10:36:11.012927+0000","last_peered":"2024-04-18T10:36:11.012927+0000","last_clean":"2024-04-18T10:36:11.012927+0000","last_became_active":"2024-04-18T10:36:08.709283+0000","last_became_peered":"2024-04-18T10:36:08.709283+0000","last_unstale":"2024-04-18T10:36:11.012927+0000","last_undegraded":"2024-04-18T10:36:11.012927+0000","last_fullsized":"2024-04-18T10:36:11.012927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.030365+0000","last_change":"2024-04-18T10:36:09.027970+0000","last_active":"2024-04-18T10:36:09.030365+0000","last_peered":"2024-04-18T10:36:09.030365+0000","last_clean":"2024-04-18T10:36:09.030365+0000","last_became_active":"2024-04-18T10:36:09.027650+0000","last_became_peered":"2024-04-18T10:36:09.027650+0000","last_unstale":"2024-04-18T10:36:09.030365+0000","last_undegraded":"2024-04-18T10:36:09.030365+0000","last_fullsized":"2024-04-18T10:36:09.030365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012959+0000","last_change":"2024-04-18T10:36:08.710914+0000","last_active":"2024-04-18T10:36:11.012959+0000","last_peered":"2024-04-18T10:36:11.012959+0000","last_clean":"2024-04-18T10:36:11.012959+0000","last_became_active":"2024-04-18T10:36:08.710619+0000","last_became_peered":"2024-04-18T10:36:08.710619+0000","last_unstale":"2024-04-18T10:36:11.012959+0000","last_undegraded":"2024-04-18T10:36:11.012959+0000","last_fullsized":"2024-04-18T10:36:11.012959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040449+0000","last_change":"2024-04-18T10:36:09.037889+0000","last_active":"2024-04-18T10:36:09.040449+0000","last_peered":"2024-04-18T10:36:09.040449+0000","last_clean":"2024-04-18T10:36:09.040449+0000","last_became_active":"2024-04-18T10:36:09.037533+0000","last_became_peered":"2024-04-18T10:36:09.037533+0000","last_unstale":"2024-04-18T10:36:09.040449+0000","last_undegraded":"2024-04-18T10:36:09.040449+0000","last_fullsized":"2024-04-18T10:36:09.040449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.009182+0000","last_change":"2024-04-18T10:36:00.530860+0000","last_active":"2024-04-18T10:36:09.009182+0000","last_peered":"2024-04-18T10:36:09.009182+0000","last_clean":"2024-04-18T10:36:09.009182+0000","last_became_active":"2024-04-18T10:36:00.530496+0000","last_became_peered":"2024-04-18T10:36:00.530496+0000","last_unstale":"2024-04-18T10:36:09.009182+0000","last_undegraded":"2024-04-18T10:36:09.009182+0000","last_fullsized":"2024-04-18T10:36:09.009182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.999498+0000","last_change":"2024-04-18T10:36:08.703862+0000","last_active":"2024-04-18T10:36:09.999498+0000","last_peered":"2024-04-18T10:36:09.999498+0000","last_clean":"2024-04-18T10:36:09.999498+0000","last_became_active":"2024-04-18T10:36:08.703311+0000","last_became_peered":"2024-04-18T10:36:08.703311+0000","last_unstale":"2024-04-18T10:36:09.999498+0000","last_undegraded":"2024-04-18T10:36:09.999498+0000","last_fullsized":"2024-04-18T10:36:09.999498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016742+0000","last_change":"2024-04-18T10:36:09.014696+0000","last_active":"2024-04-18T10:36:09.016742+0000","last_peered":"2024-04-18T10:36:09.016742+0000","last_clean":"2024-04-18T10:36:09.016742+0000","last_became_active":"2024-04-18T10:36:09.014208+0000","last_became_peered":"2024-04-18T10:36:09.014208+0000","last_unstale":"2024-04-18T10:36:09.016742+0000","last_undegraded":"2024-04-18T10:36:09.016742+0000","last_fullsized":"2024-04-18T10:36:09.016742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017998+0000","last_change":"2024-04-18T10:36:00.529282+0000","last_active":"2024-04-18T10:36:09.017998+0000","last_peered":"2024-04-18T10:36:09.017998+0000","last_clean":"2024-04-18T10:36:09.017998+0000","last_became_active":"2024-04-18T10:36:00.528895+0000","last_became_peered":"2024-04-18T10:36:00.528895+0000","last_unstale":"2024-04-18T10:36:09.017998+0000","last_undegraded":"2024-04-18T10:36:09.017998+0000","last_fullsized":"2024-04-18T10:36:09.017998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009897+0000","last_change":"2024-04-18T10:36:08.694077+0000","last_active":"2024-04-18T10:36:11.009897+0000","last_peered":"2024-04-18T10:36:11.009897+0000","last_clean":"2024-04-18T10:36:11.009897+0000","last_became_active":"2024-04-18T10:36:08.693727+0000","last_became_peered":"2024-04-18T10:36:08.693727+0000","last_unstale":"2024-04-18T10:36:11.009897+0000","last_undegraded":"2024-04-18T10:36:11.009897+0000","last_fullsized":"2024-04-18T10:36:11.009897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023410+0000","last_change":"2024-04-18T10:36:09.017243+0000","last_active":"2024-04-18T10:36:09.023410+0000","last_peered":"2024-04-18T10:36:09.023410+0000","last_clean":"2024-04-18T10:36:09.023410+0000","last_became_active":"2024-04-18T10:36:09.016843+0000","last_became_peered":"2024-04-18T10:36:09.016843+0000","last_unstale":"2024-04-18T10:36:09.023410+0000","last_undegraded":"2024-04-18T10:36:09.023410+0000","last_fullsized":"2024-04-18T10:36:09.023410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:08.995885+0000","last_change":"2024-04-18T10:36:00.529420+0000","last_active":"2024-04-18T10:36:08.995885+0000","last_peered":"2024-04-18T10:36:08.995885+0000","last_clean":"2024-04-18T10:36:08.995885+0000","last_became_active":"2024-04-18T10:36:00.529029+0000","last_became_peered":"2024-04-18T10:36:00.529029+0000","last_unstale":"2024-04-18T10:36:08.995885+0000","last_undegraded":"2024-04-18T10:36:08.995885+0000","last_fullsized":"2024-04-18T10:36:08.995885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:10.642771+0000","last_change":"2024-04-18T10:36:08.697102+0000","last_active":"2024-04-18T10:36:10.642771+0000","last_peered":"2024-04-18T10:36:10.642771+0000","last_clean":"2024-04-18T10:36:10.642771+0000","last_became_active":"2024-04-18T10:36:08.696687+0000","last_became_peered":"2024-04-18T10:36:08.696687+0000","last_unstale":"2024-04-18T10:36:10.642771+0000","last_undegraded":"2024-04-18T10:36:10.642771+0000","last_fullsized":"2024-04-18T10:36:10.642771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.037303+0000","last_change":"2024-04-18T10:36:09.031490+0000","last_active":"2024-04-18T10:36:09.037303+0000","last_peered":"2024-04-18T10:36:09.037303+0000","last_clean":"2024-04-18T10:36:09.037303+0000","last_became_active":"2024-04-18T10:36:09.030866+0000","last_became_peered":"2024-04-18T10:36:09.030866+0000","last_unstale":"2024-04-18T10:36:09.037303+0000","last_undegraded":"2024-04-18T10:36:09.037303+0000","last_fullsized":"2024-04-18T10:36:09.037303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.019884+0000","last_change":"2024-04-18T10:36:00.530056+0000","last_active":"2024-04-18T10:36:09.019884+0000","last_peered":"2024-04-18T10:36:09.019884+0000","last_clean":"2024-04-18T10:36:09.019884+0000","last_became_active":"2024-04-18T10:36:00.529546+0000","last_became_peered":"2024-04-18T10:36:00.529546+0000","last_unstale":"2024-04-18T10:36:09.019884+0000","last_undegraded":"2024-04-18T10:36:09.019884+0000","last_fullsized":"2024-04-18T10:36:09.019884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.010534+0000","last_change":"2024-04-18T10:35:56.421744+0000","last_active":"2024-04-18T10:36:09.010534+0000","last_peered":"2024-04-18T10:36:09.010534+0000","last_clean":"2024-04-18T10:36:09.010534+0000","last_became_active":"2024-04-18T10:35:56.421316+0000","last_became_peered":"2024-04-18T10:35:56.421316+0000","last_unstale":"2024-04-18T10:36:09.010534+0000","last_undegraded":"2024-04-18T10:36:09.010534+0000","last_fullsized":"2024-04-18T10:36:09.010534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017702+0000","last_change":"2024-04-18T10:36:08.711994+0000","last_active":"2024-04-18T10:36:09.017702+0000","last_peered":"2024-04-18T10:36:09.017702+0000","last_clean":"2024-04-18T10:36:09.017702+0000","last_became_active":"2024-04-18T10:36:08.711652+0000","last_became_peered":"2024-04-18T10:36:08.711652+0000","last_unstale":"2024-04-18T10:36:09.017702+0000","last_undegraded":"2024-04-18T10:36:09.017702+0000","last_fullsized":"2024-04-18T10:36:09.017702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048433+0000","last_change":"2024-04-18T10:36:09.045388+0000","last_active":"2024-04-18T10:36:09.048433+0000","last_peered":"2024-04-18T10:36:09.048433+0000","last_clean":"2024-04-18T10:36:09.048433+0000","last_became_active":"2024-04-18T10:36:09.044909+0000","last_became_peered":"2024-04-18T10:36:09.044909+0000","last_unstale":"2024-04-18T10:36:09.048433+0000","last_undegraded":"2024-04-18T10:36:09.048433+0000","last_fullsized":"2024-04-18T10:36:09.048433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.015086+0000","last_change":"2024-04-18T10:36:00.529398+0000","last_active":"2024-04-18T10:36:09.015086+0000","last_peered":"2024-04-18T10:36:09.015086+0000","last_clean":"2024-04-18T10:36:09.015086+0000","last_became_active":"2024-04-18T10:36:00.528912+0000","last_became_peered":"2024-04-18T10:36:00.528912+0000","last_unstale":"2024-04-18T10:36:09.015086+0000","last_undegraded":"2024-04-18T10:36:09.015086+0000","last_fullsized":"2024-04-18T10:36:09.015086+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.998962+0000","last_change":"2024-04-18T10:36:08.692668+0000","last_active":"2024-04-18T10:36:09.998962+0000","last_peered":"2024-04-18T10:36:09.998962+0000","last_clean":"2024-04-18T10:36:09.998962+0000","last_became_active":"2024-04-18T10:36:08.692317+0000","last_became_peered":"2024-04-18T10:36:08.692317+0000","last_unstale":"2024-04-18T10:36:09.998962+0000","last_undegraded":"2024-04-18T10:36:09.998962+0000","last_fullsized":"2024-04-18T10:36:09.998962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028580+0000","last_change":"2024-04-18T10:36:09.019756+0000","last_active":"2024-04-18T10:36:09.028580+0000","last_peered":"2024-04-18T10:36:09.028580+0000","last_clean":"2024-04-18T10:36:09.028580+0000","last_became_active":"2024-04-18T10:36:09.019251+0000","last_became_peered":"2024-04-18T10:36:09.019251+0000","last_unstale":"2024-04-18T10:36:09.028580+0000","last_undegraded":"2024-04-18T10:36:09.028580+0000","last_fullsized":"2024-04-18T10:36:09.028580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.025577+0000","last_change":"2024-04-18T10:36:00.527346+0000","last_active":"2024-04-18T10:36:09.025577+0000","last_peered":"2024-04-18T10:36:09.025577+0000","last_clean":"2024-04-18T10:36:09.025577+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:09.025577+0000","last_undegraded":"2024-04-18T10:36:09.025577+0000","last_fullsized":"2024-04-18T10:36:09.025577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.008891+0000","last_change":"2024-04-18T10:36:08.700410+0000","last_active":"2024-04-18T10:36:09.008891+0000","last_peered":"2024-04-18T10:36:09.008891+0000","last_clean":"2024-04-18T10:36:09.008891+0000","last_became_active":"2024-04-18T10:36:08.700048+0000","last_became_peered":"2024-04-18T10:36:08.700048+0000","last_unstale":"2024-04-18T10:36:09.008891+0000","last_undegraded":"2024-04-18T10:36:09.008891+0000","last_fullsized":"2024-04-18T10:36:09.008891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021403+0000","last_change":"2024-04-18T10:36:09.018239+0000","last_active":"2024-04-18T10:36:09.021403+0000","last_peered":"2024-04-18T10:36:09.021403+0000","last_clean":"2024-04-18T10:36:09.021403+0000","last_became_active":"2024-04-18T10:36:09.010612+0000","last_became_peered":"2024-04-18T10:36:09.010612+0000","last_unstale":"2024-04-18T10:36:09.021403+0000","last_undegraded":"2024-04-18T10:36:09.021403+0000","last_fullsized":"2024-04-18T10:36:09.021403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009918+0000","last_change":"2024-04-18T10:36:08.710579+0000","last_active":"2024-04-18T10:36:11.009918+0000","last_peered":"2024-04-18T10:36:11.009918+0000","last_clean":"2024-04-18T10:36:11.009918+0000","last_became_active":"2024-04-18T10:36:08.710165+0000","last_became_peered":"2024-04-18T10:36:08.710165+0000","last_unstale":"2024-04-18T10:36:11.009918+0000","last_undegraded":"2024-04-18T10:36:11.009918+0000","last_fullsized":"2024-04-18T10:36:11.009918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.011413+0000","last_change":"2024-04-18T10:36:00.529862+0000","last_active":"2024-04-18T10:36:09.011413+0000","last_peered":"2024-04-18T10:36:09.011413+0000","last_clean":"2024-04-18T10:36:09.011413+0000","last_became_active":"2024-04-18T10:36:00.529451+0000","last_became_peered":"2024-04-18T10:36:00.529451+0000","last_unstale":"2024-04-18T10:36:09.011413+0000","last_undegraded":"2024-04-18T10:36:09.011413+0000","last_fullsized":"2024-04-18T10:36:09.011413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048393+0000","last_change":"2024-04-18T10:36:09.043858+0000","last_active":"2024-04-18T10:36:09.048393+0000","last_peered":"2024-04-18T10:36:09.048393+0000","last_clean":"2024-04-18T10:36:09.048393+0000","last_became_active":"2024-04-18T10:36:09.042887+0000","last_became_peered":"2024-04-18T10:36:09.042887+0000","last_unstale":"2024-04-18T10:36:09.048393+0000","last_undegraded":"2024-04-18T10:36:09.048393+0000","last_fullsized":"2024-04-18T10:36:09.048393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023855+0000","last_change":"2024-04-18T10:36:00.527385+0000","last_active":"2024-04-18T10:36:09.023855+0000","last_peered":"2024-04-18T10:36:09.023855+0000","last_clean":"2024-04-18T10:36:09.023855+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:09.023855+0000","last_undegraded":"2024-04-18T10:36:09.023855+0000","last_fullsized":"2024-04-18T10:36:09.023855+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.999485+0000","last_change":"2024-04-18T10:36:08.703568+0000","last_active":"2024-04-18T10:36:09.999485+0000","last_peered":"2024-04-18T10:36:09.999485+0000","last_clean":"2024-04-18T10:36:09.999485+0000","last_became_active":"2024-04-18T10:36:08.702770+0000","last_became_peered":"2024-04-18T10:36:08.702770+0000","last_unstale":"2024-04-18T10:36:09.999485+0000","last_undegraded":"2024-04-18T10:36:09.999485+0000","last_fullsized":"2024-04-18T10:36:09.999485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.013798+0000","last_change":"2024-04-18T10:36:09.005270+0000","last_active":"2024-04-18T10:36:09.013798+0000","last_peered":"2024-04-18T10:36:09.013798+0000","last_clean":"2024-04-18T10:36:09.013798+0000","last_became_active":"2024-04-18T10:36:09.004929+0000","last_became_peered":"2024-04-18T10:36:09.004929+0000","last_unstale":"2024-04-18T10:36:09.013798+0000","last_undegraded":"2024-04-18T10:36:09.013798+0000","last_fullsized":"2024-04-18T10:36:09.013798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'5","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.013436+0000","last_change":"2024-04-18T10:36:08.698046+0000","last_active":"2024-04-18T10:36:11.013436+0000","last_peered":"2024-04-18T10:36:11.013436+0000","last_clean":"2024-04-18T10:36:11.013436+0000","last_became_active":"2024-04-18T10:36:08.697438+0000","last_became_peered":"2024-04-18T10:36:08.697438+0000","last_unstale":"2024-04-18T10:36:11.013436+0000","last_undegraded":"2024-04-18T10:36:11.013436+0000","last_fullsized":"2024-04-18T10:36:11.013436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021707+0000","last_change":"2024-04-18T10:36:09.016654+0000","last_active":"2024-04-18T10:36:09.021707+0000","last_peered":"2024-04-18T10:36:09.021707+0000","last_clean":"2024-04-18T10:36:09.021707+0000","last_became_active":"2024-04-18T10:36:09.016342+0000","last_became_peered":"2024-04-18T10:36:09.016342+0000","last_unstale":"2024-04-18T10:36:09.021707+0000","last_undegraded":"2024-04-18T10:36:09.021707+0000","last_fullsized":"2024-04-18T10:36:09.021707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.033999+0000","last_change":"2024-04-18T10:36:08.700728+0000","last_active":"2024-04-18T10:36:09.033999+0000","last_peered":"2024-04-18T10:36:09.033999+0000","last_clean":"2024-04-18T10:36:09.033999+0000","last_became_active":"2024-04-18T10:36:08.699603+0000","last_became_peered":"2024-04-18T10:36:08.699603+0000","last_unstale":"2024-04-18T10:36:09.033999+0000","last_undegraded":"2024-04-18T10:36:09.033999+0000","last_fullsized":"2024-04-18T10:36:09.033999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.026432+0000","last_change":"2024-04-18T10:36:09.021888+0000","last_active":"2024-04-18T10:36:09.026432+0000","last_peered":"2024-04-18T10:36:09.026432+0000","last_clean":"2024-04-18T10:36:09.026432+0000","last_became_active":"2024-04-18T10:36:09.018363+0000","last_became_peered":"2024-04-18T10:36:09.018363+0000","last_unstale":"2024-04-18T10:36:09.026432+0000","last_undegraded":"2024-04-18T10:36:09.026432+0000","last_fullsized":"2024-04-18T10:36:09.026432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043521+0000","last_change":"2024-04-18T10:36:08.714829+0000","last_active":"2024-04-18T10:36:09.043521+0000","last_peered":"2024-04-18T10:36:09.043521+0000","last_clean":"2024-04-18T10:36:09.043521+0000","last_became_active":"2024-04-18T10:36:08.714528+0000","last_became_peered":"2024-04-18T10:36:08.714528+0000","last_unstale":"2024-04-18T10:36:09.043521+0000","last_undegraded":"2024-04-18T10:36:09.043521+0000","last_fullsized":"2024-04-18T10:36:09.043521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.026421+0000","last_change":"2024-04-18T10:36:09.022031+0000","last_active":"2024-04-18T10:36:09.026421+0000","last_peered":"2024-04-18T10:36:09.026421+0000","last_clean":"2024-04-18T10:36:09.026421+0000","last_became_active":"2024-04-18T10:36:09.018240+0000","last_became_peered":"2024-04-18T10:36:09.018240+0000","last_unstale":"2024-04-18T10:36:09.026421+0000","last_undegraded":"2024-04-18T10:36:09.026421+0000","last_fullsized":"2024-04-18T10:36:09.026421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.041222+0000","last_change":"2024-04-18T10:36:08.712223+0000","last_active":"2024-04-18T10:36:09.041222+0000","last_peered":"2024-04-18T10:36:09.041222+0000","last_clean":"2024-04-18T10:36:09.041222+0000","last_became_active":"2024-04-18T10:36:08.711192+0000","last_became_peered":"2024-04-18T10:36:08.711192+0000","last_unstale":"2024-04-18T10:36:09.041222+0000","last_undegraded":"2024-04-18T10:36:09.041222+0000","last_fullsized":"2024-04-18T10:36:09.041222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043087+0000","last_change":"2024-04-18T10:36:09.030946+0000","last_active":"2024-04-18T10:36:09.043087+0000","last_peered":"2024-04-18T10:36:09.043087+0000","last_clean":"2024-04-18T10:36:09.043087+0000","last_became_active":"2024-04-18T10:36:09.030646+0000","last_became_peered":"2024-04-18T10:36:09.030646+0000","last_unstale":"2024-04-18T10:36:09.043087+0000","last_undegraded":"2024-04-18T10:36:09.043087+0000","last_fullsized":"2024-04-18T10:36:09.043087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.022671+0000","last_change":"2024-04-18T10:36:08.706957+0000","last_active":"2024-04-18T10:36:09.022671+0000","last_peered":"2024-04-18T10:36:09.022671+0000","last_clean":"2024-04-18T10:36:09.022671+0000","last_became_active":"2024-04-18T10:36:08.706598+0000","last_became_peered":"2024-04-18T10:36:08.706598+0000","last_unstale":"2024-04-18T10:36:09.022671+0000","last_undegraded":"2024-04-18T10:36:09.022671+0000","last_fullsized":"2024-04-18T10:36:09.022671+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023061+0000","last_change":"2024-04-18T10:36:09.017279+0000","last_active":"2024-04-18T10:36:09.023061+0000","last_peered":"2024-04-18T10:36:09.023061+0000","last_clean":"2024-04-18T10:36:09.023061+0000","last_became_active":"2024-04-18T10:36:09.016931+0000","last_became_peered":"2024-04-18T10:36:09.016931+0000","last_unstale":"2024-04-18T10:36:09.023061+0000","last_undegraded":"2024-04-18T10:36:09.023061+0000","last_fullsized":"2024-04-18T10:36:09.023061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.035473+0000","last_change":"2024-04-18T10:36:09.032926+0000","last_active":"2024-04-18T10:36:09.035473+0000","last_peered":"2024-04-18T10:36:09.035473+0000","last_clean":"2024-04-18T10:36:09.035473+0000","last_became_active":"2024-04-18T10:36:09.032571+0000","last_became_peered":"2024-04-18T10:36:09.032571+0000","last_unstale":"2024-04-18T10:36:09.035473+0000","last_undegraded":"2024-04-18T10:36:09.035473+0000","last_fullsized":"2024-04-18T10:36:09.035473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044024+0000","last_change":"2024-04-18T10:36:09.042985+0000","last_active":"2024-04-18T10:36:09.044024+0000","last_peered":"2024-04-18T10:36:09.044024+0000","last_clean":"2024-04-18T10:36:09.044024+0000","last_became_active":"2024-04-18T10:36:09.039602+0000","last_became_peered":"2024-04-18T10:36:09.039602+0000","last_unstale":"2024-04-18T10:36:09.044024+0000","last_undegraded":"2024-04-18T10:36:09.044024+0000","last_fullsized":"2024-04-18T10:36:09.044024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.036316+0000","last_change":"2024-04-18T10:36:09.028593+0000","last_active":"2024-04-18T10:36:09.036316+0000","last_peered":"2024-04-18T10:36:09.036316+0000","last_clean":"2024-04-18T10:36:09.036316+0000","last_became_active":"2024-04-18T10:36:09.028237+0000","last_became_peered":"2024-04-18T10:36:09.028237+0000","last_unstale":"2024-04-18T10:36:09.036316+0000","last_undegraded":"2024-04-18T10:36:09.036316+0000","last_fullsized":"2024-04-18T10:36:09.036316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045647+0000","last_change":"2024-04-18T10:36:09.043613+0000","last_active":"2024-04-18T10:36:09.045647+0000","last_peered":"2024-04-18T10:36:09.045647+0000","last_clean":"2024-04-18T10:36:09.045647+0000","last_became_active":"2024-04-18T10:36:09.042942+0000","last_became_peered":"2024-04-18T10:36:09.042942+0000","last_unstale":"2024-04-18T10:36:09.045647+0000","last_undegraded":"2024-04-18T10:36:09.045647+0000","last_fullsized":"2024-04-18T10:36:09.045647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023383+0000","last_change":"2024-04-18T10:36:09.017151+0000","last_active":"2024-04-18T10:36:09.023383+0000","last_peered":"2024-04-18T10:36:09.023383+0000","last_clean":"2024-04-18T10:36:09.023383+0000","last_became_active":"2024-04-18T10:36:09.016454+0000","last_became_peered":"2024-04-18T10:36:09.016454+0000","last_unstale":"2024-04-18T10:36:09.023383+0000","last_undegraded":"2024-04-18T10:36:09.023383+0000","last_fullsized":"2024-04-18T10:36:09.023383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672964,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":55679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":54268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]},{"osd":0,"up_from":10,"seq":42949672964,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":53320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]}]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":53266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]}]}]}} 2024-04-18T10:36:17.216 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-18T10:36:17.216 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-18T10:36:17.217 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-18T10:36:17.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-18T10:36:17.217 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-18T10:36:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.360+0000 7fc9839fa700 1 Processor -- start 2024-04-18T10:36:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.360+0000 7fc9839fa700 1 -- start start 2024-04-18T10:36:17.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc9839fa700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc97c136710 0x7fc97c0a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc9839fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a5000 0x7fc97c136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc9839fa700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c05b970 0x7fc97c05be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc9839fa700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc97c066c10 con 0x7fc97c136710 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc9839fa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c136fe0 con 0x7fc97c0a5000 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc9839fa700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c066eb0 con 0x7fc97c05b970 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981f97700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c05b970 0x7fc97c05be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981796700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc97c136710 0x7fc97c0a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc980f95700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a5000 0x7fc97c136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981796700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc97c136710 0x7fc97c0a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53516/0 (socket says 172.21.15.31:53516) 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981f97700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c05b970 0x7fc97c05be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59910/0 (socket says 172.21.15.31:59910) 2024-04-18T10:36:17.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981796700 1 -- 172.21.15.31:0/3783510881 learned_addr learned my addr 172.21.15.31:0/3783510881 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981796700 1 -- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c05b970 msgr2=0x7fc97c05be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981796700 1 --2- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c05b970 0x7fc97c05be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981796700 1 -- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a5000 msgr2=0x7fc97c136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981796700 1 --2- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a5000 0x7fc97c136af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981796700 1 -- 172.21.15.31:0/3783510881 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0a3b40 con 0x7fc97c136710 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981f97700 1 --2- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c05b970 0x7fc97c05be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc980f95700 1 --2- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a5000 0x7fc97c136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.361+0000 7fc981796700 1 --2- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c136710 0x7fc97c0a3fc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fc96c002f70 tx=0x7fc96c006eb0).ready entity=mon.0 client_cookie=34935d689b6632ef server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc96bfff700 1 -- 172.21.15.31:0/3783510881 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c00d570 con 0x7fc97c136710 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc96bfff700 1 -- 172.21.15.31:0/3783510881 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c000e90 con 0x7fc97c136710 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc96bfff700 1 -- 172.21.15.31:0/3783510881 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c00d900 con 0x7fc97c136710 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc9839fa700 1 -- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c136710 msgr2=0x7fc97c0a3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc9839fa700 1 --2- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c136710 0x7fc97c0a3fc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fc96c002f70 tx=0x7fc96c006eb0).stop 2024-04-18T10:36:17.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc9839fa700 1 -- 172.21.15.31:0/3783510881 shutdown_connections 2024-04-18T10:36:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc9839fa700 1 --2- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c05b970 0x7fc97c05be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc9839fa700 1 --2- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c136710 0x7fc97c0a3fc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc9839fa700 1 --2- 172.21.15.31:0/3783510881 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c0a5000 0x7fc97c136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc9839fa700 1 -- 172.21.15.31:0/3783510881 >> 172.21.15.31:0/3783510881 conn(0x7fc97c060ac0 msgr2=0x7fc97c0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc9839fa700 1 -- 172.21.15.31:0/3783510881 shutdown_connections 2024-04-18T10:36:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.362+0000 7fc9839fa700 1 -- 172.21.15.31:0/3783510881 wait complete. 2024-04-18T10:36:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.363+0000 7fc9839fa700 1 Processor -- start 2024-04-18T10:36:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.363+0000 7fc9839fa700 1 -- start start 2024-04-18T10:36:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc9839fa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c05b970 0x7fc97c0a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc9839fa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0a5000 0x7fc97c139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc9839fa700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c136710 0x7fc97c139830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc9839fa700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0a18e0 con 0x7fc97c0a5000 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc9839fa700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0a1b80 con 0x7fc97c05b970 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc9839fa700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c0a2cc0 con 0x7fc97c136710 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981796700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c05b970 0x7fc97c0a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981f97700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c136710 0x7fc97c139830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981796700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c05b970 0x7fc97c0a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54658/0 (socket says 172.21.15.31:54658) 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981796700 1 -- 172.21.15.31:0/475831787 learned_addr learned my addr 172.21.15.31:0/475831787 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc980f95700 1 --2- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0a5000 0x7fc97c139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981796700 1 -- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c136710 msgr2=0x7fc97c139830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981796700 1 --2- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c136710 0x7fc97c139830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981796700 1 -- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0a5000 msgr2=0x7fc97c139340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981796700 1 --2- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0a5000 0x7fc97c139340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981796700 1 -- 172.21.15.31:0/475831787 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974009470 con 0x7fc97c05b970 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981f97700 1 --2- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c136710 0x7fc97c139830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc981796700 1 --2- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c05b970 0x7fc97c0a0e90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc96c002f70 tx=0x7fc96c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc96a7fc700 1 -- 172.21.15.31:0/475831787 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c00dea0 con 0x7fc97c05b970 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc96a7fc700 1 -- 172.21.15.31:0/475831787 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c006b40 con 0x7fc97c05b970 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97800b180 con 0x7fc97c05b970 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.364+0000 7fc96a7fc700 1 -- 172.21.15.31:0/475831787 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc96c011e20 con 0x7fc97c05b970 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.365+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c00b1e0 con 0x7fc97c05b970 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.365+0000 7fc96a7fc700 1 -- 172.21.15.31:0/475831787 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc96c025030 con 0x7fc97c05b970 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.365+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97c0673f0 con 0x7fc97c05b970 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.366+0000 7fc96a7fc700 1 -- 172.21.15.31:0/475831787 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc96c04ba30 con 0x7fc97c05b970 2024-04-18T10:36:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.369+0000 7fc96a7fc700 1 -- 172.21.15.31:0/475831787 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc96c01eb50 con 0x7fc97c05b970 2024-04-18T10:36:17.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.510+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc97c057a60 con 0x7fc97c05b970 2024-04-18T10:36:17.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.512+0000 7fc96a7fc700 1 -- 172.21.15.31:0/475831787 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+84879 (secure 0 0 0) 0x7fc96c023030 con 0x7fc97c05b970 2024-04-18T10:36:17.512 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 >> v1:172.21.15.31:6816/39551 conn(0x7fc95c038dd0 legacy=0x7fc95c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c05b970 msgr2=0x7fc97c0a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 --2- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c05b970 0x7fc97c0a0e90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc96c002f70 tx=0x7fc96c015000).stop 2024-04-18T10:36:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 shutdown_connections 2024-04-18T10:36:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 --2- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc97c136710 0x7fc97c139830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 --2- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc97c05b970 0x7fc97c0a0e90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 --2- 172.21.15.31:0/475831787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc97c0a5000 0x7fc97c139340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 >> 172.21.15.31:0/475831787 conn(0x7fc97c060ac0 msgr2=0x7fc97c133650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:17.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 shutdown_connections 2024-04-18T10:36:17.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.513+0000 7fc9839fa700 1 -- 172.21.15.31:0/475831787 wait complete. 2024-04-18T10:36:17.523 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6816","nonce":39551}]},"active_addr":"172.21.15.31:6816/39551","active_change":"2024-04-18T10:35:51.380919+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3252462560}]},{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2767636595}]},{"addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2921291208}]}]}} 2024-04-18T10:36:17.524 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-18T10:36:17.525 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T10:36:17.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:17.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.632+0000 7fbb20187700 1 Processor -- start 2024-04-18T10:36:17.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.632+0000 7fbb20187700 1 -- start start 2024-04-18T10:36:17.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.632+0000 7fbb20187700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb181365d0 0x7fbb181369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.632+0000 7fbb20187700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb180a4f80 0x7fbb1805c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.632+0000 7fbb20187700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180660f0 con 0x7fbb18066d80 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.632+0000 7fbb20187700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb180668d0 con 0x7fbb180a4f80 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.632+0000 7fbb20187700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180a4590 con 0x7fbb181365d0 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1df23700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb181365d0 0x7fbb181369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1e724700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbb180a4f80 0x7fbb1805c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1d722700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbb18066d80 0x7fbb1805b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45498/0 (socket says 172.21.15.31:45498) 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1d722700 1 -- 172.21.15.31:0/3762225091 learned_addr learned my addr 172.21.15.31:0/3762225091 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1df23700 1 -- 172.21.15.31:0/3762225091 >> v2:172.21.15.31:3300/0 conn(0x7fbb180a4f80 msgr2=0x7fbb1805c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1df23700 1 --2- 172.21.15.31:0/3762225091 >> v2:172.21.15.31:3300/0 conn(0x7fbb180a4f80 0x7fbb1805c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1df23700 1 -- 172.21.15.31:0/3762225091 >> v1:172.21.15.31:6789/0 conn(0x7fbb18066d80 legacy=0x7fbb1805b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1df23700 1 -- 172.21.15.31:0/3762225091 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb180a4850 con 0x7fbb181365d0 2024-04-18T10:36:17.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1e724700 1 --2- 172.21.15.31:0/3762225091 >> v2:172.21.15.31:3300/0 conn(0x7fbb180a4f80 0x7fbb1805c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1df23700 1 --2- 172.21.15.31:0/3762225091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb181365d0 0x7fbb181369b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbb14002f70 tx=0x7fbb14006df0).ready entity=mon.1 client_cookie=53838234efa61e95 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1cf21700 1 -- 172.21.15.31:0/3762225091 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1400d570 con 0x7fbb181365d0 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1cf21700 1 -- 172.21.15.31:0/3762225091 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb14000e90 con 0x7fbb181365d0 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.633+0000 7fbb1cf21700 1 -- 172.21.15.31:0/3762225091 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1400d8c0 con 0x7fbb181365d0 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.634+0000 7fbb20187700 1 -- 172.21.15.31:0/3762225091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb181365d0 msgr2=0x7fbb181369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.634+0000 7fbb20187700 1 --2- 172.21.15.31:0/3762225091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb181365d0 0x7fbb181369b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fbb14002f70 tx=0x7fbb14006df0).stop 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.634+0000 7fbb20187700 1 -- 172.21.15.31:0/3762225091 shutdown_connections 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.634+0000 7fbb20187700 1 --2- 172.21.15.31:0/3762225091 >> v2:172.21.15.31:3300/0 conn(0x7fbb180a4f80 0x7fbb1805c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.634+0000 7fbb20187700 1 --2- 172.21.15.31:0/3762225091 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb181365d0 0x7fbb181369b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.634+0000 7fbb20187700 1 -- 172.21.15.31:0/3762225091 >> 172.21.15.31:0/3762225091 conn(0x7fbb18060ac0 msgr2=0x7fbb180a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.634+0000 7fbb20187700 1 -- 172.21.15.31:0/3762225091 shutdown_connections 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.634+0000 7fbb20187700 1 -- 172.21.15.31:0/3762225091 wait complete. 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb20187700 1 Processor -- start 2024-04-18T10:36:17.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb20187700 1 -- start start 2024-04-18T10:36:17.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb20187700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb18066d80 0x7fbb18148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb20187700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb180a4f80 0x7fbb181341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb20187700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb181365d0 0x7fbb181346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb20187700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18149ad0 con 0x7fbb181365d0 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb20187700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180a2980 con 0x7fbb18066d80 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb20187700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18093a30 con 0x7fbb180a4f80 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb1df23700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb18066d80 0x7fbb18148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb1e724700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb181365d0 0x7fbb181346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb1df23700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb18066d80 0x7fbb18148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54676/0 (socket says 172.21.15.31:54676) 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb1df23700 1 -- 172.21.15.31:0/3744426922 learned_addr learned my addr 172.21.15.31:0/3744426922 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.635+0000 7fbb1d722700 1 --2- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb180a4f80 0x7fbb181341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb1df23700 1 -- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb180a4f80 msgr2=0x7fbb181341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb1df23700 1 --2- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb180a4f80 0x7fbb181341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb1df23700 1 -- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb181365d0 msgr2=0x7fbb181346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb1df23700 1 --2- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb181365d0 0x7fbb181346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb1df23700 1 -- 172.21.15.31:0/3744426922 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10009470 con 0x7fbb18066d80 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb1e724700 1 --2- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb181365d0 0x7fbb181346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb1df23700 1 --2- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb18066d80 0x7fbb18148e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbb14002f70 tx=0x7fbb14014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb06ffd700 1 -- 172.21.15.31:0/3744426922 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb14016070 con 0x7fbb18066d80 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb06ffd700 1 -- 172.21.15.31:0/3744426922 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1400d8f0 con 0x7fbb18066d80 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1400b180 con 0x7fbb18066d80 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb06ffd700 1 -- 172.21.15.31:0/3744426922 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb14013e90 con 0x7fbb18066d80 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.636+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb18093750 con 0x7fbb18066d80 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.637+0000 7fbb06ffd700 1 -- 172.21.15.31:0/3744426922 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbb1400f030 con 0x7fbb18066d80 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.637+0000 7fbb06ffd700 1 -- 172.21.15.31:0/3744426922 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbb1404b690 con 0x7fbb18066d80 2024-04-18T10:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.637+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb18057a60 con 0x7fbb18066d80 2024-04-18T10:36:17.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.640+0000 7fbb06ffd700 1 -- 172.21.15.31:0/3744426922 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbb140273f0 con 0x7fbb18066d80 2024-04-18T10:36:17.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.756+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb180672c0 con 0x7fbb18066d80 2024-04-18T10:36:17.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.756+0000 7fbb06ffd700 1 -- 172.21.15.31:0/3744426922 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7fbb14001f00 con 0x7fbb18066d80 2024-04-18T10:36:17.756 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:17.756 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:09.988938+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 >> v1:172.21.15.31:6816/39551 conn(0x7fbaf8038da0 legacy=0x7fbaf803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb18066d80 msgr2=0x7fbb18148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 --2- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb18066d80 0x7fbb18148e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbb14002f70 tx=0x7fbb14014000).stop 2024-04-18T10:36:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 shutdown_connections 2024-04-18T10:36:17.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 --2- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb181365d0 0x7fbb181346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 --2- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbb18066d80 0x7fbb18148e40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 --2- 172.21.15.31:0/3744426922 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbb180a4f80 0x7fbb181341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 >> 172.21.15.31:0/3744426922 conn(0x7fbb18060ac0 msgr2=0x7fbb1805c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 shutdown_connections 2024-04-18T10:36:17.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.758+0000 7fbb20187700 1 -- 172.21.15.31:0/3744426922 wait complete. 2024-04-18T10:36:17.767 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T10:36:17.768 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:17.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.874+0000 7f291ff16700 1 Processor -- start 2024-04-18T10:36:17.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.874+0000 7f291ff16700 1 -- start start 2024-04-18T10:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291ff16700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2918134500 0x7f29180a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291ff16700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f29181348e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291ff16700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134dd0 0x7f29180a2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291ff16700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29180a4870 con 0x7f2918134500 2024-04-18T10:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291ff16700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29180a4050 con 0x7f2918134dd0 2024-04-18T10:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291ff16700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29180a42f0 con 0x7f29180a5050 2024-04-18T10:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291e4b3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134dd0 0x7f29180a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291d4b1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f29181348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291dcb2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2918134500 0x7f29180a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291d4b1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f29181348e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59930/0 (socket says 172.21.15.31:59930) 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291e4b3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134dd0 0x7f29180a2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54688/0 (socket says 172.21.15.31:54688) 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291dcb2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2918134500 0x7f29180a3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53560/0 (socket says 172.21.15.31:53560) 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.875+0000 7f291d4b1700 1 -- 172.21.15.31:0/1994492648 learned_addr learned my addr 172.21.15.31:0/1994492648 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291d4b1700 1 -- 172.21.15.31:0/1994492648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134dd0 msgr2=0x7f29180a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291d4b1700 1 --2- 172.21.15.31:0/1994492648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134dd0 0x7f29180a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291d4b1700 1 -- 172.21.15.31:0/1994492648 >> v2:172.21.15.31:3300/0 conn(0x7f2918134500 msgr2=0x7f29180a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291d4b1700 1 --2- 172.21.15.31:0/1994492648 >> v2:172.21.15.31:3300/0 conn(0x7f2918134500 0x7f29180a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291d4b1700 1 -- 172.21.15.31:0/1994492648 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291805bd30 con 0x7f29180a5050 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291dcb2700 1 --2- 172.21.15.31:0/1994492648 >> v2:172.21.15.31:3300/0 conn(0x7f2918134500 0x7f29180a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291d4b1700 1 --2- 172.21.15.31:0/1994492648 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f29181348e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2914002f70 tx=0x7f2914006eb0).ready entity=mon.2 client_cookie=557690b160520612 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ccb0700 1 -- 172.21.15.31:0/1994492648 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f291400d570 con 0x7f29180a5050 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ccb0700 1 -- 172.21.15.31:0/1994492648 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2914000e90 con 0x7f29180a5050 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ccb0700 1 -- 172.21.15.31:0/1994492648 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f291400d900 con 0x7f29180a5050 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ff16700 1 -- 172.21.15.31:0/1994492648 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 msgr2=0x7f29181348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ff16700 1 --2- 172.21.15.31:0/1994492648 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f29181348e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2914002f70 tx=0x7f2914006eb0).stop 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ff16700 1 -- 172.21.15.31:0/1994492648 shutdown_connections 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ff16700 1 --2- 172.21.15.31:0/1994492648 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134dd0 0x7f29180a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ff16700 1 --2- 172.21.15.31:0/1994492648 >> v2:172.21.15.31:3300/0 conn(0x7f2918134500 0x7f29180a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ff16700 1 --2- 172.21.15.31:0/1994492648 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f29181348e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.876+0000 7f291ff16700 1 -- 172.21.15.31:0/1994492648 >> 172.21.15.31:0/1994492648 conn(0x7f2918060ac0 msgr2=0x7f29180a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.877+0000 7f291ff16700 1 -- 172.21.15.31:0/1994492648 shutdown_connections 2024-04-18T10:36:17.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.877+0000 7f291ff16700 1 -- 172.21.15.31:0/1994492648 wait complete. 2024-04-18T10:36:17.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.878+0000 7f291ff16700 1 Processor -- start 2024-04-18T10:36:17.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.878+0000 7f291ff16700 1 -- start start 2024-04-18T10:36:17.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.878+0000 7f291ff16700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f2918137d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.878+0000 7f291ff16700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134500 0x7f2918062460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.878+0000 7f291ff16700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2918134dd0 0x7f2918135e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.878+0000 7f291ff16700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2918062e30 con 0x7f2918134dd0 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.878+0000 7f291ff16700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2918137150 con 0x7f2918134500 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.878+0000 7f291ff16700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29180641c0 con 0x7f29180a5050 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.878+0000 7f291dcb2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f2918137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291e4b3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2918134dd0 0x7f2918135e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291dcb2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f2918137d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59944/0 (socket says 172.21.15.31:59944) 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291dcb2700 1 -- 172.21.15.31:0/2950713542 learned_addr learned my addr 172.21.15.31:0/2950713542 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291d4b1700 1 --2- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134500 0x7f2918062460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291dcb2700 1 -- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134500 msgr2=0x7f2918062460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291dcb2700 1 --2- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134500 0x7f2918062460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291dcb2700 1 -- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2918134dd0 msgr2=0x7f2918135e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:17.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291dcb2700 1 --2- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2918134dd0 0x7f2918135e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291dcb2700 1 -- 172.21.15.31:0/2950713542 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c00b180 con 0x7f29180a5050 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291e4b3700 1 --2- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2918134dd0 0x7f2918135e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291dcb2700 1 --2- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f2918137d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f290c00c000 tx=0x7f290c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f290affd700 1 -- 172.21.15.31:0/2950713542 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f290c00c7e0 con 0x7f29180a5050 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f290affd700 1 -- 172.21.15.31:0/2950713542 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c00c940 con 0x7f29180a5050 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f290affd700 1 -- 172.21.15.31:0/2950713542 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f290c00cca0 con 0x7f29180a5050 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291400b1e0 con 0x7f29180a5050 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.879+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2918131cf0 con 0x7f29180a5050 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.880+0000 7f290affd700 1 -- 172.21.15.31:0/2950713542 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f290c01c460 con 0x7f29180a5050 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.880+0000 7f290affd700 1 -- 172.21.15.31:0/2950713542 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f290c04ae00 con 0x7f29180a5050 2024-04-18T10:36:17.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.880+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2918061590 con 0x7f29180a5050 2024-04-18T10:36:17.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:17.884+0000 7f290affd700 1 -- 172.21.15.31:0/2950713542 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f290c033730 con 0x7f29180a5050 2024-04-18T10:36:18.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.001+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2918057a60 con 0x7f29180a5050 2024-04-18T10:36:18.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.002+0000 7f290affd700 1 -- 172.21.15.31:0/2950713542 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f290c00ce00 con 0x7f29180a5050 2024-04-18T10:36:18.001 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:18.001 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:09.988938+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:18.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 >> v1:172.21.15.31:6816/39551 conn(0x7f28f8038da0 legacy=0x7f28f803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 msgr2=0x7f2918137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 --2- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f2918137d20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f290c00c000 tx=0x7f290c006df0).stop 2024-04-18T10:36:18.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 shutdown_connections 2024-04-18T10:36:18.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 --2- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29180a5050 0x7f2918137d20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 --2- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2918134dd0 0x7f2918135e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 --2- 172.21.15.31:0/2950713542 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2918134500 0x7f2918062460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 >> 172.21.15.31:0/2950713542 conn(0x7f2918060ac0 msgr2=0x7f29180a2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 shutdown_connections 2024-04-18T10:36:18.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.003+0000 7f291ff16700 1 -- 172.21.15.31:0/2950713542 wait complete. 2024-04-18T10:36:18.014 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T10:36:18.015 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T10:36:18.015 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T10:36:18.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-18T10:36:18.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.131+0000 7f55f7e9a700 1 Processor -- start 2024-04-18T10:36:18.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f7e9a700 1 -- start start 2024-04-18T10:36:18.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f7e9a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f55f0136ab0 0x7f55f0064bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f7e9a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 0x7f55f00662b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f7e9a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136e90 0x7f55f0061ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f7e9a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f00652d0 con 0x7f55f0136ab0 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f7e9a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00650e0 con 0x7f55f0064740 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f7e9a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00667a0 con 0x7f55f0136e90 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f6437700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136e90 0x7f55f0061ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f6437700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136e90 0x7f55f0061ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59952/0 (socket says 172.21.15.31:59952) 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.132+0000 7f55f6437700 1 -- 172.21.15.31:0/3003730423 learned_addr learned my addr 172.21.15.31:0/3003730423 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f5435700 1 --2- 172.21.15.31:0/3003730423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 0x7f55f00662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f5c36700 1 --2- 172.21.15.31:0/3003730423 >> v2:172.21.15.31:3300/0 conn(0x7f55f0136ab0 0x7f55f0064bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f6437700 1 -- 172.21.15.31:0/3003730423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 msgr2=0x7f55f00662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f6437700 1 --2- 172.21.15.31:0/3003730423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 0x7f55f00662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f6437700 1 -- 172.21.15.31:0/3003730423 >> v2:172.21.15.31:3300/0 conn(0x7f55f0136ab0 msgr2=0x7f55f0064bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f6437700 1 --2- 172.21.15.31:0/3003730423 >> v2:172.21.15.31:3300/0 conn(0x7f55f0136ab0 0x7f55f0064bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f6437700 1 -- 172.21.15.31:0/3003730423 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f01365d0 con 0x7f55f0136e90 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f6437700 1 --2- 172.21.15.31:0/3003730423 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136e90 0x7f55f0061ef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f55f0132d20 tx=0x7f55e800b530).ready entity=mon.2 client_cookie=7bbf076a060529d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f4c34700 1 -- 172.21.15.31:0/3003730423 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e800dde0 con 0x7f55f0136e90 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f4c34700 1 -- 172.21.15.31:0/3003730423 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e8010470 con 0x7f55f0136e90 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.133+0000 7f55f4c34700 1 -- 172.21.15.31:0/3003730423 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55e80107d0 con 0x7f55f0136e90 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.134+0000 7f55f7e9a700 1 -- 172.21.15.31:0/3003730423 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136e90 msgr2=0x7f55f0061ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.134+0000 7f55f7e9a700 1 --2- 172.21.15.31:0/3003730423 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136e90 0x7f55f0061ef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f55f0132d20 tx=0x7f55e800b530).stop 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.134+0000 7f55f7e9a700 1 -- 172.21.15.31:0/3003730423 shutdown_connections 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.134+0000 7f55f7e9a700 1 --2- 172.21.15.31:0/3003730423 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136e90 0x7f55f0061ef0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.134+0000 7f55f7e9a700 1 --2- 172.21.15.31:0/3003730423 >> v2:172.21.15.31:3300/0 conn(0x7f55f0136ab0 0x7f55f0064bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.134+0000 7f55f7e9a700 1 --2- 172.21.15.31:0/3003730423 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 0x7f55f00662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.134+0000 7f55f7e9a700 1 -- 172.21.15.31:0/3003730423 >> 172.21.15.31:0/3003730423 conn(0x7f55f0060530 msgr2=0x7f55f005be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.134+0000 7f55f7e9a700 1 -- 172.21.15.31:0/3003730423 shutdown_connections 2024-04-18T10:36:18.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.134+0000 7f55f7e9a700 1 -- 172.21.15.31:0/3003730423 wait complete. 2024-04-18T10:36:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.135+0000 7f55f7e9a700 1 Processor -- start 2024-04-18T10:36:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.135+0000 7f55f7e9a700 1 -- start start 2024-04-18T10:36:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f7e9a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 0x7f55f0134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f7e9a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136ab0 0x7f55f0144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f7e9a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55f0136e90 0x7f55f0145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f7e9a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01343c0 con 0x7f55f0136e90 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f7e9a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01316a0 con 0x7f55f0064740 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f7e9a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01318d0 con 0x7f55f0136ab0 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f5c36700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 0x7f55f0134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f6437700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55f0136e90 0x7f55f0145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f5c36700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 0x7f55f0134ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54706/0 (socket says 172.21.15.31:54706) 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f5c36700 1 -- 172.21.15.31:0/2427641322 learned_addr learned my addr 172.21.15.31:0/2427641322 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f5435700 1 --2- 172.21.15.31:0/2427641322 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136ab0 0x7f55f0144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f5c36700 1 -- 172.21.15.31:0/2427641322 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136ab0 msgr2=0x7f55f0144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f5c36700 1 --2- 172.21.15.31:0/2427641322 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f55f0136ab0 0x7f55f0144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f5c36700 1 -- 172.21.15.31:0/2427641322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55f0136e90 msgr2=0x7f55f0145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f5c36700 1 --2- 172.21.15.31:0/2427641322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55f0136e90 0x7f55f0145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.136+0000 7f55f5c36700 1 -- 172.21.15.31:0/2427641322 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e800b7d0 con 0x7f55f0064740 2024-04-18T10:36:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.137+0000 7f55f6437700 1 --2- 172.21.15.31:0/2427641322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f55f0136e90 0x7f55f0145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.137+0000 7f55f5c36700 1 --2- 172.21.15.31:0/2427641322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 0x7f55f0134ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f55ec00c000 tx=0x7f55ec006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.137+0000 7f55deffd700 1 -- 172.21.15.31:0/2427641322 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55ec010780 con 0x7f55f0064740 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.137+0000 7f55deffd700 1 -- 172.21.15.31:0/2427641322 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0108e0 con 0x7f55f0064740 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.137+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f012e2c0 con 0x7f55f0064740 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.137+0000 7f55deffd700 1 -- 172.21.15.31:0/2427641322 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55ec010c40 con 0x7f55f0064740 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.137+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f01323d0 con 0x7f55f0064740 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.138+0000 7f55deffd700 1 -- 172.21.15.31:0/2427641322 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f55ec01c460 con 0x7f55f0064740 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.138+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55f0132960 con 0x7f55f0064740 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.138+0000 7f55deffd700 1 -- 172.21.15.31:0/2427641322 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f55ec04aba0 con 0x7f55f0064740 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.138+0000 7f55deffd700 1 -- 172.21.15.31:0/2427641322 --> v1:172.21.15.31:6809/40173 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55d0045620 con 0x7f55d00419d0 2024-04-18T10:36:18.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.138+0000 7f55deffd700 1 -- 172.21.15.31:0/2427641322 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55ec0334d0 con 0x7f55f0064740 2024-04-18T10:36:18.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.139+0000 7fd898945700 1 Processor -- start 2024-04-18T10:36:18.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.139+0000 7fd898945700 1 -- start start 2024-04-18T10:36:18.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7f55deffd700 1 -- 172.21.15.31:0/2427641322 <== osd.3 v1:172.21.15.31:6809/40173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f55d0045620 con 0x7f55d00419d0 2024-04-18T10:36:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7fd898945700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7fd898945700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894063680 0x7fd89413d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7fd898945700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd894063b10 con 0x7fd894062fb0 2024-04-18T10:36:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7fd898945700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd894065150 con 0x7fd894064600 2024-04-18T10:36:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7fd898945700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd894130bd0 con 0x7fd894063680 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7fd89259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7fd89259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54708/0 (socket says 172.21.15.31:54708) 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7fd89259c700 1 -- 172.21.15.31:0/4006852686 learned_addr learned my addr 172.21.15.31:0/4006852686 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.140+0000 7fd892d9d700 1 --2- 172.21.15.31:0/4006852686 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894063680 0x7fd89413d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.141+0000 7fd89259c700 1 -- 172.21.15.31:0/4006852686 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894063680 msgr2=0x7fd89413d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.141+0000 7fd89259c700 1 --2- 172.21.15.31:0/4006852686 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894063680 0x7fd89413d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.141+0000 7fd89259c700 1 -- 172.21.15.31:0/4006852686 >> v1:172.21.15.31:6789/0 conn(0x7fd894062fb0 legacy=0x7fd8940a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.141+0000 7fd89259c700 1 -- 172.21.15.31:0/4006852686 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd894061ee0 con 0x7fd894064600 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.141+0000 7fd892d9d700 1 --2- 172.21.15.31:0/4006852686 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894063680 0x7fd89413d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.141+0000 7fd89259c700 1 --2- 172.21.15.31:0/4006852686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894133110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd894060b30 tx=0x7fd884006eb0).ready entity=mon.1 client_cookie=24dd53ab69cb598a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.141+0000 7fd89159a700 1 -- 172.21.15.31:0/4006852686 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd88400d570 con 0x7fd894064600 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.141+0000 7fd89159a700 1 -- 172.21.15.31:0/4006852686 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd884000e90 con 0x7fd894064600 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.141+0000 7fd89159a700 1 -- 172.21.15.31:0/4006852686 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd88400d900 con 0x7fd894064600 2024-04-18T10:36:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.142+0000 7fd898945700 1 -- 172.21.15.31:0/4006852686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 msgr2=0x7fd894133110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.142+0000 7fd898945700 1 --2- 172.21.15.31:0/4006852686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894133110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd894060b30 tx=0x7fd884006eb0).stop 2024-04-18T10:36:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.142+0000 7fd898945700 1 -- 172.21.15.31:0/4006852686 shutdown_connections 2024-04-18T10:36:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.142+0000 7fd898945700 1 --2- 172.21.15.31:0/4006852686 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894063680 0x7fd89413d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.142+0000 7fd898945700 1 --2- 172.21.15.31:0/4006852686 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894133110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.142+0000 7fd898945700 1 -- 172.21.15.31:0/4006852686 >> 172.21.15.31:0/4006852686 conn(0x7fd89406c0c0 msgr2=0x7fd89406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.142+0000 7fd898945700 1 -- 172.21.15.31:0/4006852686 shutdown_connections 2024-04-18T10:36:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.142+0000 7fd898945700 1 -- 172.21.15.31:0/4006852686 wait complete. 2024-04-18T10:36:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.144+0000 7fd898945700 1 Processor -- start 2024-04-18T10:36:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.144+0000 7fd898945700 1 -- start start 2024-04-18T10:36:18.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd898945700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd894063680 0x7fd894093020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd898945700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd898945700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894146070 0x7fd894146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd898945700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd894146a10 con 0x7fd894063680 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd898945700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd894093510 con 0x7fd894064600 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd898945700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd894093750 con 0x7fd894146070 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd891d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd891d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54718/0 (socket says 172.21.15.31:54718) 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd891d9b700 1 -- 172.21.15.31:0/2235845111 learned_addr learned my addr 172.21.15.31:0/2235845111 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd89259c700 1 --2- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd894063680 0x7fd894093020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd892d9d700 1 --2- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894146070 0x7fd894146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd891d9b700 1 -- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894146070 msgr2=0x7fd894146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd891d9b700 1 --2- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894146070 0x7fd894146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd891d9b700 1 -- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd894063680 msgr2=0x7fd894093020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd891d9b700 1 --2- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd894063680 0x7fd894093020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd891d9b700 1 -- 172.21.15.31:0/2235845111 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c009470 con 0x7fd894064600 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.145+0000 7fd892d9d700 1 --2- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd894146070 0x7fd894146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.146+0000 7fd891d9b700 1 --2- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894145b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd894146b50 tx=0x7fd888007bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.146+0000 7fd8837fe700 1 -- 172.21.15.31:0/2235845111 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd888002ea0 con 0x7fd894064600 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.146+0000 7fd8837fe700 1 -- 172.21.15.31:0/2235845111 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd888013410 con 0x7fd894064600 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.146+0000 7fd8837fe700 1 -- 172.21.15.31:0/2235845111 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd888013770 con 0x7fd894064600 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.146+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88400b1e0 con 0x7fd894064600 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.146+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd894140180 con 0x7fd894064600 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.147+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd894066fa0 con 0x7fd894064600 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.148+0000 7fd8837fe700 1 -- 172.21.15.31:0/2235845111 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd888010030 con 0x7fd894064600 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.148+0000 7fd8837fe700 1 -- 172.21.15.31:0/2235845111 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd88804ad30 con 0x7fd894064600 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.148+0000 7fd8837fe700 1 -- 172.21.15.31:0/2235845111 --> v1:172.21.15.31:6808/40174 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd870045600 con 0x7fd870041910 2024-04-18T10:36:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.148+0000 7fd8837fe700 1 -- 172.21.15.31:0/2235845111 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd88804b110 con 0x7fd894064600 2024-04-18T10:36:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.150+0000 7fd8837fe700 1 -- 172.21.15.31:0/2235845111 <== osd.2 v1:172.21.15.31:6808/40174 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fd870045600 con 0x7fd870041910 2024-04-18T10:36:18.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.152+0000 7ff1e5c5a700 1 Processor -- start 2024-04-18T10:36:18.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.152+0000 7ff1e5c5a700 1 -- start start 2024-04-18T10:36:18.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1e5c5a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1e0133970 0x7ff1e00a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1e5c5a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e013ec80 0x7ff1e0141070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1e5c5a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e005d520 con 0x7ff1e0133590 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1e5c5a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e0139bc0 con 0x7ff1e0133970 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1e5c5a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0139e60 con 0x7ff1e013ec80 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1deffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1e0133970 0x7ff1e00a82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1deffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1e0133970 0x7ff1e00a82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53612/0 (socket says 172.21.15.31:53612) 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1deffd700 1 -- 172.21.15.31:0/2804059788 learned_addr learned my addr 172.21.15.31:0/2804059788 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1df7fe700 1 --1- 172.21.15.31:0/2804059788 >> v1:172.21.15.31:6789/0 conn(0x7ff1e0133590 0x7ff1e005ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45504/0 (socket says 172.21.15.31:45504) 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1deffd700 1 -- 172.21.15.31:0/2804059788 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e013ec80 msgr2=0x7ff1e0141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1deffd700 1 --2- 172.21.15.31:0/2804059788 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e013ec80 0x7ff1e0141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1deffd700 1 -- 172.21.15.31:0/2804059788 >> v1:172.21.15.31:6789/0 conn(0x7ff1e0133590 legacy=0x7ff1e005ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1de7fc700 1 -- 172.21.15.31:0/2804059788 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406419499 0 0) 0x7ff1e005d520 con 0x7ff1e0133590 2024-04-18T10:36:18.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1deffd700 1 -- 172.21.15.31:0/2804059788 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e00a87b0 con 0x7ff1e0133970 2024-04-18T10:36:18.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.153+0000 7ff1deffd700 1 --2- 172.21.15.31:0/2804059788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e0133970 0x7ff1e00a82c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff1d4002f70 tx=0x7ff1d4006eb0).ready entity=mon.0 client_cookie=d978f652c3071c8e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.154+0000 7ff1de7fc700 1 -- 172.21.15.31:0/2804059788 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1d400d5c0 con 0x7ff1e0133970 2024-04-18T10:36:18.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.154+0000 7ff1de7fc700 1 -- 172.21.15.31:0/2804059788 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d4000e90 con 0x7ff1e0133970 2024-04-18T10:36:18.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.154+0000 7ff1de7fc700 1 -- 172.21.15.31:0/2804059788 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1d400d910 con 0x7ff1e0133970 2024-04-18T10:36:18.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.154+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2804059788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e0133970 msgr2=0x7ff1e00a82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.154+0000 7ff1e5c5a700 1 --2- 172.21.15.31:0/2804059788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e0133970 0x7ff1e00a82c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff1d4002f70 tx=0x7ff1d4006eb0).stop 2024-04-18T10:36:18.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.155+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2804059788 shutdown_connections 2024-04-18T10:36:18.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.155+0000 7ff1e5c5a700 1 --2- 172.21.15.31:0/2804059788 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e013ec80 0x7ff1e0141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.155+0000 7ff1e5c5a700 1 --2- 172.21.15.31:0/2804059788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e0133970 0x7ff1e00a82c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.155+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2804059788 >> 172.21.15.31:0/2804059788 conn(0x7ff1e0061480 msgr2=0x7ff1e0066a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.155+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2804059788 shutdown_connections 2024-04-18T10:36:18.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.155+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2804059788 wait complete. 2024-04-18T10:36:18.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.156+0000 7ff1e5c5a700 1 Processor -- start 2024-04-18T10:36:18.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.156+0000 7f98d8b34700 1 Processor -- start 2024-04-18T10:36:18.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.156+0000 7f98d8b34700 1 -- start start 2024-04-18T10:36:18.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.156+0000 7ff1e5c5a700 1 -- start start 2024-04-18T10:36:18.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d8b34700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f98d405bb30 0x7f98d4063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d8b34700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4061fe0 0x7f98d4139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d8b34700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98d4062400 0x7f98d40a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d8b34700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d4062b80 con 0x7f98d405bb30 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d8b34700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4062e60 con 0x7f98d4061fe0 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d8b34700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4139a40 con 0x7f98d4062400 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d1d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4061fe0 0x7f98d4139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d1d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4061fe0 0x7f98d4139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54732/0 (socket says 172.21.15.31:54732) 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d1d9b700 1 -- 172.21.15.31:0/2653577721 learned_addr learned my addr 172.21.15.31:0/2653577721 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7f98d2d9d700 1 --2- 172.21.15.31:0/2653577721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98d4062400 0x7f98d40a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d259c700 1 --2- 172.21.15.31:0/2653577721 >> v2:172.21.15.31:3300/0 conn(0x7f98d405bb30 0x7f98d4063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7ff1e5c5a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff1e0133590 0x7ff1e00acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7ff1e5c5a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e0133970 0x7ff1e0149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7ff1e5c5a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e013ec80 0x7ff1e0149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7ff1e5c5a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00abfb0 con 0x7ff1e013ec80 2024-04-18T10:36:18.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7ff1e5c5a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00aab10 con 0x7ff1e0133970 2024-04-18T10:36:18.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.157+0000 7ff1e5c5a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00aadd0 con 0x7ff1e0133590 2024-04-18T10:36:18.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d2d9d700 1 -- 172.21.15.31:0/2653577721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4061fe0 msgr2=0x7f98d4139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d2d9d700 1 --2- 172.21.15.31:0/2653577721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4061fe0 0x7f98d4139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d2d9d700 1 -- 172.21.15.31:0/2653577721 >> v2:172.21.15.31:3300/0 conn(0x7f98d405bb30 msgr2=0x7f98d4063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d2d9d700 1 --2- 172.21.15.31:0/2653577721 >> v2:172.21.15.31:3300/0 conn(0x7f98d405bb30 0x7f98d4063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d2d9d700 1 -- 172.21.15.31:0/2653577721 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4139d00 con 0x7f98d4062400 2024-04-18T10:36:18.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d1d9b700 1 --2- 172.21.15.31:0/2653577721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4061fe0 0x7f98d4139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:18.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d2d9d700 1 --2- 172.21.15.31:0/2653577721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98d4062400 0x7f98d40a8290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f98cc0032f0 tx=0x7f98cc0091d0).ready entity=mon.2 client_cookie=fc7223aae142a583 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7ff1dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e013ec80 0x7ff1e0149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7ff1dffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e013ec80 0x7ff1e0149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53634/0 (socket says 172.21.15.31:53634) 2024-04-18T10:36:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7ff1dffff700 1 -- 172.21.15.31:0/2216728471 learned_addr learned my addr 172.21.15.31:0/2216728471 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d159a700 1 -- 172.21.15.31:0/2653577721 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98cc00b6c0 con 0x7f98d4062400 2024-04-18T10:36:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d159a700 1 -- 172.21.15.31:0/2653577721 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc00b820 con 0x7f98d4062400 2024-04-18T10:36:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7f98d159a700 1 -- 172.21.15.31:0/2653577721 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98cc00b990 con 0x7f98d4062400 2024-04-18T10:36:18.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.158+0000 7ff1df7fe700 1 --2- 172.21.15.31:0/2216728471 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff1e0133590 0x7ff1e00acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7ff1dffff700 1 -- 172.21.15.31:0/2216728471 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff1e0133590 msgr2=0x7ff1e00acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7ff1dffff700 1 --2- 172.21.15.31:0/2216728471 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff1e0133590 0x7ff1e00acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7ff1dffff700 1 -- 172.21.15.31:0/2216728471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e0133970 msgr2=0x7ff1e0149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7ff1dffff700 1 --2- 172.21.15.31:0/2216728471 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff1e0133970 0x7ff1e0149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7ff1dffff700 1 -- 172.21.15.31:0/2216728471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d400b1e0 con 0x7ff1e013ec80 2024-04-18T10:36:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7f98d8b34700 1 -- 172.21.15.31:0/2653577721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98d4062400 msgr2=0x7f98d40a8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7f98d8b34700 1 --2- 172.21.15.31:0/2653577721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98d4062400 0x7f98d40a8290 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f98cc0032f0 tx=0x7f98cc0091d0).stop 2024-04-18T10:36:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7f98d8b34700 1 -- 172.21.15.31:0/2653577721 shutdown_connections 2024-04-18T10:36:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7f98d8b34700 1 --2- 172.21.15.31:0/2653577721 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98d4062400 0x7f98d40a8290 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7f98d8b34700 1 --2- 172.21.15.31:0/2653577721 >> v2:172.21.15.31:3300/0 conn(0x7f98d405bb30 0x7f98d4063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7f98d8b34700 1 --2- 172.21.15.31:0/2653577721 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4061fe0 0x7f98d4139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7f98d8b34700 1 -- 172.21.15.31:0/2653577721 >> 172.21.15.31:0/2653577721 conn(0x7f98d406c0c0 msgr2=0x7f98d406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7f98d8b34700 1 -- 172.21.15.31:0/2653577721 shutdown_connections 2024-04-18T10:36:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7f98d8b34700 1 -- 172.21.15.31:0/2653577721 wait complete. 2024-04-18T10:36:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.159+0000 7ff1dffff700 1 --2- 172.21.15.31:0/2216728471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e013ec80 0x7ff1e0149940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff1d80032f0 tx=0x7ff1d8006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.160+0000 7ff1dcff9700 1 -- 172.21.15.31:0/2216728471 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1d800f510 con 0x7ff1e013ec80 2024-04-18T10:36:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.160+0000 7ff1dcff9700 1 -- 172.21.15.31:0/2216728471 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d800f670 con 0x7ff1e013ec80 2024-04-18T10:36:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.160+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e01332f0 con 0x7ff1e013ec80 2024-04-18T10:36:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.160+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e00abb20 con 0x7ff1e013ec80 2024-04-18T10:36:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.160+0000 7ff1dcff9700 1 -- 172.21.15.31:0/2216728471 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1d800f7e0 con 0x7ff1e013ec80 2024-04-18T10:36:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.160+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 --> v1:172.21.15.31:6809/40173 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f55f0136890 con 0x7f55d00419d0 2024-04-18T10:36:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.160+0000 7f98d8b34700 1 Processor -- start 2024-04-18T10:36:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.160+0000 7f98d8b34700 1 -- start start 2024-04-18T10:36:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1b8003660 con 0x7ff1e013ec80 2024-04-18T10:36:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f55deffd700 1 -- 172.21.15.31:0/2427641322 <== osd.3 v1:172.21.15.31:6809/40173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4003890288) 0x7f55f0136890 con 0x7f55d00419d0 2024-04-18T10:36:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f98d8b34700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98d405bb30 0x7f98d40a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f98d8b34700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98d4061fe0 0x7f98d4138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f98d8b34700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4094940 0x7f98d4138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f98d8b34700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4095900 con 0x7f98d405bb30 2024-04-18T10:36:18.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f98d8b34700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4095b80 con 0x7f98d4094940 2024-04-18T10:36:18.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f98d8b34700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4098ff0 con 0x7f98d4061fe0 2024-04-18T10:36:18.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f98d259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98d405bb30 0x7f98d40a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f98d259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98d405bb30 0x7f98d40a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53636/0 (socket says 172.21.15.31:53636) 2024-04-18T10:36:18.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f98d259c700 1 -- 172.21.15.31:0/1243287865 learned_addr learned my addr 172.21.15.31:0/1243287865 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.161+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 >> v1:172.21.15.31:6809/40173 conn(0x7f55d00419d0 legacy=0x7f55d0043e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.162+0000 7ff1dcff9700 1 -- 172.21.15.31:0/2216728471 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff1d800f070 con 0x7ff1e013ec80 2024-04-18T10:36:18.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.162+0000 7f98d2d9d700 1 --2- 172.21.15.31:0/1243287865 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4094940 0x7f98d4138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.162+0000 7ff1dcff9700 1 -- 172.21.15.31:0/2216728471 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff1d804a380 con 0x7ff1e013ec80 2024-04-18T10:36:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.162+0000 7f98d259c700 1 -- 172.21.15.31:0/1243287865 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98d4061fe0 msgr2=0x7f98d4138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.162+0000 7f98d259c700 1 --2- 172.21.15.31:0/1243287865 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98d4061fe0 0x7f98d4138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.162+0000 7f98d259c700 1 -- 172.21.15.31:0/1243287865 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4094940 msgr2=0x7f98d4138b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.162+0000 7f98d259c700 1 --2- 172.21.15.31:0/1243287865 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f98d4094940 0x7f98d4138b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.162+0000 7f98d259c700 1 -- 172.21.15.31:0/1243287865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c800b1e0 con 0x7f98d405bb30 2024-04-18T10:36:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.163+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 >> v1:172.21.15.31:6816/39551 conn(0x7f55d0038f80 legacy=0x7f55d003b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.163+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 msgr2=0x7f55f0134ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.163+0000 7f55f7e9a700 1 --2- 172.21.15.31:0/2427641322 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f55f0064740 0x7f55f0134ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f55ec00c000 tx=0x7f55ec006df0).stop 2024-04-18T10:36:18.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.163+0000 7f55f6437700 1 -- 172.21.15.31:0/2427641322 reap_dead start 2024-04-18T10:36:18.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.162+0000 7ff1dcff9700 1 -- 172.21.15.31:0/2216728471 --> v1:172.21.15.31:6804/40172 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1c0045590 con 0x7ff1c0041940 2024-04-18T10:36:18.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.163+0000 7f98d259c700 1 --2- 172.21.15.31:0/1243287865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98d405bb30 0x7f98d40a8ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f98c40030b0 tx=0x7f98c4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.163+0000 7ff1dcff9700 1 -- 172.21.15.31:0/2216728471 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1d802f2a0 con 0x7ff1e013ec80 2024-04-18T10:36:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7f98c37fe700 1 -- 172.21.15.31:0/1243287865 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c4011780 con 0x7f98d405bb30 2024-04-18T10:36:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7f98c37fe700 1 -- 172.21.15.31:0/1243287865 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c40118e0 con 0x7f98d405bb30 2024-04-18T10:36:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7f98c37fe700 1 -- 172.21.15.31:0/1243287865 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c4011c40 con 0x7f98d405bb30 2024-04-18T10:36:18.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 shutdown_connections 2024-04-18T10:36:18.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 >> 172.21.15.31:0/2427641322 conn(0x7f55f0060530 msgr2=0x7f55f0067450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc009470 con 0x7f98d405bb30 2024-04-18T10:36:18.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d4092550 con 0x7f98d405bb30 2024-04-18T10:36:18.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 shutdown_connections 2024-04-18T10:36:18.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7f55f7e9a700 1 -- 172.21.15.31:0/2427641322 wait complete. 2024-04-18T10:36:18.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.164+0000 7ff1dcff9700 1 -- 172.21.15.31:0/2216728471 <== osd.1 v1:172.21.15.31:6804/40172 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7ff1c0045590 con 0x7ff1c0041940 2024-04-18T10:36:18.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.165+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98d405bf10 con 0x7f98d405bb30 2024-04-18T10:36:18.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.166+0000 7f98c37fe700 1 -- 172.21.15.31:0/1243287865 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f98c4012420 con 0x7f98d405bb30 2024-04-18T10:36:18.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.166+0000 7f98c37fe700 1 -- 172.21.15.31:0/1243287865 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f98c404b870 con 0x7f98d405bb30 2024-04-18T10:36:18.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.166+0000 7f98c37fe700 1 -- 172.21.15.31:0/1243287865 --> v1:172.21.15.31:6800/40171 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98b0045660 con 0x7f98b0041970 2024-04-18T10:36:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.166+0000 7f98c37fe700 1 -- 172.21.15.31:0/1243287865 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98c404bc50 con 0x7f98d405bb30 2024-04-18T10:36:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.168+0000 7f98c37fe700 1 -- 172.21.15.31:0/1243287865 <== osd.0 v1:172.21.15.31:6800/40171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f98b0045660 con 0x7f98b0041970 2024-04-18T10:36:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.173+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 --> v1:172.21.15.31:6808/40174 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8940922d0 con 0x7fd870041910 2024-04-18T10:36:18.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.173+0000 7fd8837fe700 1 -- 172.21.15.31:0/2235845111 <== osd.2 v1:172.21.15.31:6808/40174 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 483198835) 0x7fd8940922d0 con 0x7fd870041910 2024-04-18T10:36:18.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.174+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 >> v1:172.21.15.31:6808/40174 conn(0x7fd870041910 legacy=0x7fd870043d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.174+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 >> v1:172.21.15.31:6816/39551 conn(0x7fd870038da0 legacy=0x7fd87003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.174+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 msgr2=0x7fd894145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.174+0000 7fd898945700 1 --2- 172.21.15.31:0/2235845111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd894064600 0x7fd894145b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd894146b50 tx=0x7fd888007bc0).stop 2024-04-18T10:36:18.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.174+0000 7fd892d9d700 1 -- 172.21.15.31:0/2235845111 reap_dead start 2024-04-18T10:36:18.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.174+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 shutdown_connections 2024-04-18T10:36:18.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.174+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 >> 172.21.15.31:0/2235845111 conn(0x7fd89406c0c0 msgr2=0x7fd894132ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.174+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 shutdown_connections 2024-04-18T10:36:18.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.174+0000 7fd898945700 1 -- 172.21.15.31:0/2235845111 wait complete. 2024-04-18T10:36:18.176 INFO:teuthology.orchestra.run.smithi031.stdout:42949672966 2024-04-18T10:36:18.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T10:36:18.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.181+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 --> v1:172.21.15.31:6804/40172 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff1b8002810 con 0x7ff1c0041940 2024-04-18T10:36:18.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.182+0000 7ff1dcff9700 1 -- 172.21.15.31:0/2216728471 <== osd.1 v1:172.21.15.31:6804/40172 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 483198835) 0x7ff1b8002810 con 0x7ff1c0041940 2024-04-18T10:36:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.182+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 >> v1:172.21.15.31:6804/40172 conn(0x7ff1c0041940 legacy=0x7ff1c0043dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.182+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 >> v1:172.21.15.31:6816/39551 conn(0x7ff1c0038ef0 legacy=0x7ff1c003b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.182+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e013ec80 msgr2=0x7ff1e0149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.182+0000 7ff1e5c5a700 1 --2- 172.21.15.31:0/2216728471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1e013ec80 0x7ff1e0149940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7ff1d80032f0 tx=0x7ff1d8006f90).stop 2024-04-18T10:36:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.182+0000 7ff1dffff700 1 -- 172.21.15.31:0/2216728471 reap_dead start 2024-04-18T10:36:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.183+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 shutdown_connections 2024-04-18T10:36:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.183+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 >> 172.21.15.31:0/2216728471 conn(0x7ff1e0061480 msgr2=0x7ff1e013e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.183+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 shutdown_connections 2024-04-18T10:36:18.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.183+0000 7ff1e5c5a700 1 -- 172.21.15.31:0/2216728471 wait complete. 2024-04-18T10:36:18.184 INFO:teuthology.orchestra.run.smithi031.stdout:42949672967 2024-04-18T10:36:18.184 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T10:36:18.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.186+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 --> v1:172.21.15.31:6800/40171 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98d4057a60 con 0x7f98b0041970 2024-04-18T10:36:18.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.187+0000 7f98c37fe700 1 -- 172.21.15.31:0/1243287865 <== osd.0 v1:172.21.15.31:6800/40171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4003890288) 0x7f98d4057a60 con 0x7f98b0041970 2024-04-18T10:36:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.187+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 >> v1:172.21.15.31:6800/40171 conn(0x7f98b0041970 legacy=0x7f98b0043df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.187+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 >> v1:172.21.15.31:6816/39551 conn(0x7f98b0038da0 legacy=0x7f98b003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.187+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98d405bb30 msgr2=0x7f98d40a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.187+0000 7f98d8b34700 1 --2- 172.21.15.31:0/1243287865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98d405bb30 0x7f98d40a8ad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f98c40030b0 tx=0x7f98c4008040).stop 2024-04-18T10:36:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.187+0000 7f98d2d9d700 1 -- 172.21.15.31:0/1243287865 reap_dead start 2024-04-18T10:36:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.188+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 shutdown_connections 2024-04-18T10:36:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.188+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 >> 172.21.15.31:0/1243287865 conn(0x7f98d406c0c0 msgr2=0x7f98d406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.188+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 shutdown_connections 2024-04-18T10:36:18.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.188+0000 7f98d8b34700 1 -- 172.21.15.31:0/1243287865 wait complete. 2024-04-18T10:36:18.198 INFO:teuthology.orchestra.run.smithi031.stdout:42949672967 2024-04-18T10:36:18.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T10:36:18.202 INFO:teuthology.orchestra.run.smithi031.stdout:42949672966 2024-04-18T10:36:18.202 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T10:36:18.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.293+0000 7fd22be6d700 1 Processor -- start 2024-04-18T10:36:18.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.293+0000 7fd22be6d700 1 -- start start 2024-04-18T10:36:18.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd22be6d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd224136710 0x7fd2240a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd22be6d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd224136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd22be6d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd224066c10 con 0x7fd22405b970 2024-04-18T10:36:18.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd22be6d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd224136fe0 con 0x7fd2240a5000 2024-04-18T10:36:18.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd22be6d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd224066eb0 con 0x7fd224136710 2024-04-18T10:36:18.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd229c09700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd224136710 0x7fd2240a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd229408700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd224136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd229408700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd224136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54760/0 (socket says 172.21.15.31:54760) 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd229c09700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd224136710 0x7fd2240a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60026/0 (socket says 172.21.15.31:60026) 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.294+0000 7fd229408700 1 -- 172.21.15.31:0/3827437554 learned_addr learned my addr 172.21.15.31:0/3827437554 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.295+0000 7fd229408700 1 -- 172.21.15.31:0/3827437554 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd224136710 msgr2=0x7fd2240a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.295+0000 7fd229408700 1 --2- 172.21.15.31:0/3827437554 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd224136710 0x7fd2240a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.295+0000 7fd229408700 1 -- 172.21.15.31:0/3827437554 >> v1:172.21.15.31:6789/0 conn(0x7fd22405b970 legacy=0x7fd22405be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.295+0000 7fd229408700 1 -- 172.21.15.31:0/3827437554 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2240a3b40 con 0x7fd2240a5000 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.295+0000 7fd229408700 1 --2- 172.21.15.31:0/3827437554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd224136af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd2240a4e70 tx=0x7fd214006eb0).ready entity=mon.1 client_cookie=6b64f4b334680b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.295+0000 7fd228c07700 1 -- 172.21.15.31:0/3827437554 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21400d570 con 0x7fd2240a5000 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.295+0000 7fd228c07700 1 -- 172.21.15.31:0/3827437554 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd214000e90 con 0x7fd2240a5000 2024-04-18T10:36:18.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.295+0000 7fd228c07700 1 -- 172.21.15.31:0/3827437554 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21400d900 con 0x7fd2240a5000 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.296+0000 7fd22be6d700 1 -- 172.21.15.31:0/3827437554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 msgr2=0x7fd224136af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.296+0000 7fd22be6d700 1 --2- 172.21.15.31:0/3827437554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd224136af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd2240a4e70 tx=0x7fd214006eb0).stop 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.296+0000 7fd22be6d700 1 -- 172.21.15.31:0/3827437554 shutdown_connections 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.296+0000 7fd22be6d700 1 --2- 172.21.15.31:0/3827437554 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd224136710 0x7fd2240a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.296+0000 7fd22be6d700 1 --2- 172.21.15.31:0/3827437554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd224136af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.296+0000 7fd22be6d700 1 -- 172.21.15.31:0/3827437554 >> 172.21.15.31:0/3827437554 conn(0x7fd224060ac0 msgr2=0x7fd2240a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.296+0000 7fd22be6d700 1 -- 172.21.15.31:0/3827437554 shutdown_connections 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.296+0000 7fd22be6d700 1 -- 172.21.15.31:0/3827437554 wait complete. 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.297+0000 7fd22be6d700 1 Processor -- start 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.297+0000 7fd22be6d700 1 -- start start 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.297+0000 7fd22be6d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd22405b970 0x7fd224092840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.297+0000 7fd22be6d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd22412f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.297+0000 7fd22be6d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd224136710 0x7fd22412f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.297+0000 7fd22be6d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240a14f0 con 0x7fd224136710 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.297+0000 7fd22be6d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240a17b0 con 0x7fd2240a5000 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.297+0000 7fd22be6d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd224139a50 con 0x7fd22405b970 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229c09700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd22405b970 0x7fd224092840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229c09700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd22405b970 0x7fd224092840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60042/0 (socket says 172.21.15.31:60042) 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229c09700 1 -- 172.21.15.31:0/1894730486 learned_addr learned my addr 172.21.15.31:0/1894730486 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd22a40a700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd224136710 0x7fd22412f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229408700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd22412f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229c09700 1 -- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 msgr2=0x7fd22412f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229c09700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd22412f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229c09700 1 -- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd224136710 msgr2=0x7fd22412f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229c09700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd224136710 0x7fd22412f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229c09700 1 -- 172.21.15.31:0/1894730486 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21400b1e0 con 0x7fd22405b970 2024-04-18T10:36:18.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd22a40a700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd224136710 0x7fd22412f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:36:18.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd229c09700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd22405b970 0x7fd224092840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd22000c000 tx=0x7fd220006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd212ffd700 1 -- 172.21.15.31:0/1894730486 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd220010780 con 0x7fd22405b970 2024-04-18T10:36:18.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd212ffd700 1 -- 172.21.15.31:0/1894730486 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2200108e0 con 0x7fd22405b970 2024-04-18T10:36:18.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd224139f30 con 0x7fd22405b970 2024-04-18T10:36:18.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd212ffd700 1 -- 172.21.15.31:0/1894730486 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd220010c40 con 0x7fd22405b970 2024-04-18T10:36:18.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.298+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2240a2630 con 0x7fd22405b970 2024-04-18T10:36:18.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.300+0000 7fd212ffd700 1 -- 172.21.15.31:0/1894730486 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd22001c460 con 0x7fd22405b970 2024-04-18T10:36:18.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.300+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2240673f0 con 0x7fd22405b970 2024-04-18T10:36:18.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.300+0000 7fd212ffd700 1 -- 172.21.15.31:0/1894730486 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd22004ac20 con 0x7fd22405b970 2024-04-18T10:36:18.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.302+0000 7fc29544a700 1 Processor -- start 2024-04-18T10:36:18.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.303+0000 7fc29544a700 1 -- start start 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc29544a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2901358a0 0x7fc2900a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc29544a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc29009f650 0x7fc290135c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc29544a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 0x7fc2900a3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc29544a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc290136170 con 0x7fc29009f650 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc29544a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900a20d0 con 0x7fc2901358a0 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc29544a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900a2370 con 0x7fc2900a0b90 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc28effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2901358a0 0x7fc2900a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc28effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2901358a0 0x7fc2900a2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54768/0 (socket says 172.21.15.31:54768) 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc28effd700 1 -- 172.21.15.31:0/2668534072 learned_addr learned my addr 172.21.15.31:0/2668534072 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc28effd700 1 -- 172.21.15.31:0/2668534072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 msgr2=0x7fc2900a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc28effd700 1 --2- 172.21.15.31:0/2668534072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 0x7fc2900a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc28effd700 1 -- 172.21.15.31:0/2668534072 >> v2:172.21.15.31:3300/0 conn(0x7fc29009f650 msgr2=0x7fc290135c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc28effd700 1 --2- 172.21.15.31:0/2668534072 >> v2:172.21.15.31:3300/0 conn(0x7fc29009f650 0x7fc290135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.304+0000 7fc28effd700 1 -- 172.21.15.31:0/2668534072 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2900a1e10 con 0x7fc2901358a0 2024-04-18T10:36:18.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.305+0000 7fc28effd700 1 --2- 172.21.15.31:0/2668534072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2901358a0 0x7fc2900a2a20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc2900a2290 tx=0x7fc280006eb0).ready entity=mon.1 client_cookie=ae46b4918ed96683 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.305+0000 7fc28dffb700 1 -- 172.21.15.31:0/2668534072 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc28000d570 con 0x7fc2901358a0 2024-04-18T10:36:18.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.305+0000 7fc28dffb700 1 -- 172.21.15.31:0/2668534072 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc280000e90 con 0x7fc2901358a0 2024-04-18T10:36:18.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.305+0000 7fc28dffb700 1 -- 172.21.15.31:0/2668534072 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc28000d900 con 0x7fc2901358a0 2024-04-18T10:36:18.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fc29544a700 1 -- 172.21.15.31:0/2668534072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2901358a0 msgr2=0x7fc2900a2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fc29544a700 1 --2- 172.21.15.31:0/2668534072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2901358a0 0x7fc2900a2a20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc2900a2290 tx=0x7fc280006eb0).stop 2024-04-18T10:36:18.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fc29544a700 1 -- 172.21.15.31:0/2668534072 shutdown_connections 2024-04-18T10:36:18.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fc29544a700 1 --2- 172.21.15.31:0/2668534072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 0x7fc2900a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fc29544a700 1 --2- 172.21.15.31:0/2668534072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc2901358a0 0x7fc2900a2a20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fc29544a700 1 --2- 172.21.15.31:0/2668534072 >> v2:172.21.15.31:3300/0 conn(0x7fc29009f650 0x7fc290135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fc29544a700 1 -- 172.21.15.31:0/2668534072 >> 172.21.15.31:0/2668534072 conn(0x7fc290060ac0 msgr2=0x7fc2900a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fc29544a700 1 -- 172.21.15.31:0/2668534072 shutdown_connections 2024-04-18T10:36:18.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fc29544a700 1 -- 172.21.15.31:0/2668534072 wait complete. 2024-04-18T10:36:18.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.306+0000 7fd212ffd700 1 -- 172.21.15.31:0/1894730486 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd22002f910 con 0x7fd22405b970 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.307+0000 7fc29544a700 1 Processor -- start 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.307+0000 7fc29544a700 1 -- start start 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.308+0000 7fc29544a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc29009f650 0x7fc2900653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.308+0000 7fc29544a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 0x7fc290063d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.308+0000 7fc29544a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2901358a0 0x7fc2901321a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.308+0000 7fc29544a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc290064940 con 0x7fc2901358a0 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.308+0000 7fc29544a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc290064b40 con 0x7fc29009f650 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.308+0000 7fc29544a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc290063540 con 0x7fc2900a0b90 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc29009f650 0x7fc2900653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28e7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 0x7fc290063d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc29009f650 0x7fc2900653c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54778/0 (socket says 172.21.15.31:54778) 2024-04-18T10:36:18.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28effd700 1 -- 172.21.15.31:0/1992659031 learned_addr learned my addr 172.21.15.31:0/1992659031 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28e7fc700 1 -- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc29009f650 msgr2=0x7fc2900653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28e7fc700 1 --2- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc29009f650 0x7fc2900653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28e7fc700 1 -- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2901358a0 msgr2=0x7fc2901321a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28e7fc700 1 --2- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2901358a0 0x7fc2901321a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28e7fc700 1 -- 172.21.15.31:0/1992659031 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28000b1e0 con 0x7fc2900a0b90 2024-04-18T10:36:18.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28effd700 1 --2- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc29009f650 0x7fc2900653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:18.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc28e7fc700 1 --2- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 0x7fc290063d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fc284002f70 tx=0x7fc284006e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.309+0000 7fc27ffff700 1 -- 172.21.15.31:0/1992659031 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc284009e20 con 0x7fc2900a0b90 2024-04-18T10:36:18.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.310+0000 7fc27ffff700 1 -- 172.21.15.31:0/1992659031 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284013460 con 0x7fc2900a0b90 2024-04-18T10:36:18.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.310+0000 7fc27ffff700 1 -- 172.21.15.31:0/1992659031 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2840137c0 con 0x7fc2900a0b90 2024-04-18T10:36:18.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.310+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2900637e0 con 0x7fc2900a0b90 2024-04-18T10:36:18.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.310+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2900632e0 con 0x7fc2900a0b90 2024-04-18T10:36:18.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.311+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2900a1020 con 0x7fc2900a0b90 2024-04-18T10:36:18.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.311+0000 7fc27ffff700 1 -- 172.21.15.31:0/1992659031 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc28400f070 con 0x7fc2900a0b90 2024-04-18T10:36:18.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.311+0000 7fc27ffff700 1 -- 172.21.15.31:0/1992659031 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc28404a070 con 0x7fc2900a0b90 2024-04-18T10:36:18.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.317+0000 7fc27ffff700 1 -- 172.21.15.31:0/1992659031 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc28402ef70 con 0x7fc2900a0b90 2024-04-18T10:36:18.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.365+0000 7f088610a700 1 Processor -- start 2024-04-18T10:36:18.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.365+0000 7f088610a700 1 -- start start 2024-04-18T10:36:18.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.366+0000 7f088610a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f088013de50 0x7f08800a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.366+0000 7f088610a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f088013e940 0x7f0880145420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.366+0000 7f088610a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08800a6bc0 con 0x7f088005bcf0 2024-04-18T10:36:18.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.366+0000 7f088610a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08800a94a0 con 0x7f088013e940 2024-04-18T10:36:18.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.366+0000 7f088610a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08800a9780 con 0x7f088013de50 2024-04-18T10:36:18.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.366+0000 7f087f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f088013de50 0x7f08800a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.366+0000 7f087effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f088005bcf0 0x7f088013e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45518/0 (socket says 172.21.15.31:45518) 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.366+0000 7f087effd700 1 -- 172.21.15.31:0/548598713 learned_addr learned my addr 172.21.15.31:0/548598713 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.366+0000 7f087ffff700 1 --2- 172.21.15.31:0/548598713 >> v2:172.21.15.31:3300/0 conn(0x7f088013e940 0x7f0880145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f087ffff700 1 -- 172.21.15.31:0/548598713 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f088013de50 msgr2=0x7f08800a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f087ffff700 1 --2- 172.21.15.31:0/548598713 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f088013de50 0x7f08800a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f087ffff700 1 -- 172.21.15.31:0/548598713 >> v1:172.21.15.31:6789/0 conn(0x7f088005bcf0 legacy=0x7f088013e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f087ffff700 1 -- 172.21.15.31:0/548598713 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08800a8cd0 con 0x7f088013e940 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f087e7fc700 1 -- 172.21.15.31:0/548598713 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295042690 0 0) 0x7f08800a6bc0 con 0x7f088005bcf0 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f087ffff700 1 --2- 172.21.15.31:0/548598713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f088013e940 0x7f0880145420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f08780032f0 tx=0x7f08780091d0).ready entity=mon.0 client_cookie=146daf2f885a48d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f087e7fc700 1 -- 172.21.15.31:0/548598713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087800b6c0 con 0x7f088013e940 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f087e7fc700 1 -- 172.21.15.31:0/548598713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087800b820 con 0x7f088013e940 2024-04-18T10:36:18.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f087e7fc700 1 -- 172.21.15.31:0/548598713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087800b990 con 0x7f088013e940 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f088610a700 1 -- 172.21.15.31:0/548598713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f088013e940 msgr2=0x7f0880145420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.367+0000 7f088610a700 1 --2- 172.21.15.31:0/548598713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f088013e940 0x7f0880145420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f08780032f0 tx=0x7f08780091d0).stop 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.368+0000 7f088610a700 1 -- 172.21.15.31:0/548598713 shutdown_connections 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.368+0000 7f088610a700 1 --2- 172.21.15.31:0/548598713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f088013e940 0x7f0880145420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.368+0000 7f088610a700 1 --2- 172.21.15.31:0/548598713 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f088013de50 0x7f08800a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.368+0000 7f088610a700 1 -- 172.21.15.31:0/548598713 >> 172.21.15.31:0/548598713 conn(0x7f088006c0c0 msgr2=0x7f088006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.368+0000 7f088610a700 1 -- 172.21.15.31:0/548598713 shutdown_connections 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.368+0000 7f088610a700 1 -- 172.21.15.31:0/548598713 wait complete. 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.369+0000 7f088610a700 1 Processor -- start 2024-04-18T10:36:18.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.369+0000 7f088610a700 1 -- start start 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f088610a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f088005bcf0 0x7f088014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f088610a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f088013de50 0x7f0880093de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f088610a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f088013e940 0x7f08800927b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f088610a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0880149fa0 con 0x7f088013de50 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f088610a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0880093690 con 0x7f088005bcf0 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f088610a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08800938e0 con 0x7f088013e940 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f088005bcf0 0x7f088014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f088013de50 0x7f0880093de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f088005bcf0 0x7f088014a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54790/0 (socket says 172.21.15.31:54790) 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087f7fe700 1 -- 172.21.15.31:0/2663125083 learned_addr learned my addr 172.21.15.31:0/2663125083 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087f7fe700 1 -- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f088013e940 msgr2=0x7f08800927b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087f7fe700 1 --2- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f088013e940 0x7f08800927b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087f7fe700 1 -- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f088013de50 msgr2=0x7f0880093de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087f7fe700 1 --2- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f088013de50 0x7f0880093de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087f7fe700 1 -- 172.21.15.31:0/2663125083 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878009470 con 0x7f088005bcf0 2024-04-18T10:36:18.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087f7fe700 1 --2- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f088005bcf0 0x7f088014a560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0880066b80 tx=0x7f0870006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087cff9700 1 -- 172.21.15.31:0/2663125083 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0870010780 con 0x7f088005bcf0 2024-04-18T10:36:18.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f087cff9700 1 -- 172.21.15.31:0/2663125083 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08700108e0 con 0x7f088005bcf0 2024-04-18T10:36:18.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.370+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08800924f0 con 0x7f088005bcf0 2024-04-18T10:36:18.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.371+0000 7f087cff9700 1 -- 172.21.15.31:0/2663125083 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0870010c40 con 0x7f088005bcf0 2024-04-18T10:36:18.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.371+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08800942d0 con 0x7f088005bcf0 2024-04-18T10:36:18.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.371+0000 7f087cff9700 1 -- 172.21.15.31:0/2663125083 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f087001c460 con 0x7f088005bcf0 2024-04-18T10:36:18.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.372+0000 7f087cff9700 1 -- 172.21.15.31:0/2663125083 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f087004ad90 con 0x7f088005bcf0 2024-04-18T10:36:18.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.372+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088014a3b0 con 0x7f088005bcf0 2024-04-18T10:36:18.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.375+0000 7f087cff9700 1 -- 172.21.15.31:0/2663125083 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f08700335b0 con 0x7f088005bcf0 2024-04-18T10:36:18.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.382+0000 7fa2e008a700 1 Processor -- start 2024-04-18T10:36:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.382+0000 7fa2e008a700 1 -- start start 2024-04-18T10:36:18.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.383+0000 7fa2e008a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2d8064600 0x7fa2d8133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.383+0000 7fa2e008a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8063680 0x7fa2d813d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.383+0000 7fa2e008a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d8063b10 con 0x7fa2d8062fb0 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.383+0000 7fa2e008a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d8065150 con 0x7fa2d8064600 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.383+0000 7fa2e008a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8130bd0 con 0x7fa2d8063680 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.383+0000 7fa2de627700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8063680 0x7fa2d813d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.383+0000 7fa2de627700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8063680 0x7fa2d813d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60088/0 (socket says 172.21.15.31:60088) 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.383+0000 7fa2de627700 1 -- 172.21.15.31:0/3599710405 learned_addr learned my addr 172.21.15.31:0/3599710405 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.384+0000 7fa2de627700 1 -- 172.21.15.31:0/3599710405 >> v2:172.21.15.31:3300/0 conn(0x7fa2d8064600 msgr2=0x7fa2d8133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.384+0000 7fa2de627700 1 --2- 172.21.15.31:0/3599710405 >> v2:172.21.15.31:3300/0 conn(0x7fa2d8064600 0x7fa2d8133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.384+0000 7fa2de627700 1 -- 172.21.15.31:0/3599710405 >> v1:172.21.15.31:6789/0 conn(0x7fa2d8062fb0 legacy=0x7fa2d80a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.384+0000 7fa2de627700 1 -- 172.21.15.31:0/3599710405 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8061ee0 con 0x7fa2d8063680 2024-04-18T10:36:18.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.384+0000 7fa2de627700 1 --2- 172.21.15.31:0/3599710405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8063680 0x7fa2d813d930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa2d8060b30 tx=0x7fa2d000b530).ready entity=mon.2 client_cookie=200960f08f51bb2e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.384+0000 7fa2dce24700 1 -- 172.21.15.31:0/3599710405 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d000be70 con 0x7fa2d8063680 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.384+0000 7fa2dce24700 1 -- 172.21.15.31:0/3599710405 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0010470 con 0x7fa2d8063680 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.384+0000 7fa2dce24700 1 -- 172.21.15.31:0/3599710405 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d0010810 con 0x7fa2d8063680 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.385+0000 7fa2e008a700 1 -- 172.21.15.31:0/3599710405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8063680 msgr2=0x7fa2d813d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.385+0000 7fa2e008a700 1 --2- 172.21.15.31:0/3599710405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8063680 0x7fa2d813d930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa2d8060b30 tx=0x7fa2d000b530).stop 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.385+0000 7fa2e008a700 1 -- 172.21.15.31:0/3599710405 shutdown_connections 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.385+0000 7fa2e008a700 1 --2- 172.21.15.31:0/3599710405 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8063680 0x7fa2d813d930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.385+0000 7fa2e008a700 1 --2- 172.21.15.31:0/3599710405 >> v2:172.21.15.31:3300/0 conn(0x7fa2d8064600 0x7fa2d8133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.385+0000 7fa2e008a700 1 -- 172.21.15.31:0/3599710405 >> 172.21.15.31:0/3599710405 conn(0x7fa2d806c0c0 msgr2=0x7fa2d806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.385+0000 7fa2e008a700 1 -- 172.21.15.31:0/3599710405 shutdown_connections 2024-04-18T10:36:18.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.385+0000 7fa2e008a700 1 -- 172.21.15.31:0/3599710405 wait complete. 2024-04-18T10:36:18.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.386+0000 7fa2e008a700 1 Processor -- start 2024-04-18T10:36:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.386+0000 7fa2e008a700 1 -- start start 2024-04-18T10:36:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.387+0000 7fa2e008a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2d8063680 0x7fa2d8067cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.387+0000 7fa2e008a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8064600 0x7fa2d80925e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.387+0000 7fa2e008a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2d8092ad0 0x7fa2d814d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.387+0000 7fa2e008a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8093670 con 0x7fa2d8092ad0 2024-04-18T10:36:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.387+0000 7fa2e008a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8098fd0 con 0x7fa2d8063680 2024-04-18T10:36:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.387+0000 7fa2e008a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d814d1c0 con 0x7fa2d8064600 2024-04-18T10:36:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dde26700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2d8063680 0x7fa2d8067cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dde26700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2d8063680 0x7fa2d8067cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54802/0 (socket says 172.21.15.31:54802) 2024-04-18T10:36:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dde26700 1 -- 172.21.15.31:0/144267972 learned_addr learned my addr 172.21.15.31:0/144267972 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dd625700 1 --2- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8064600 0x7fa2d80925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2de627700 1 --2- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2d8092ad0 0x7fa2d814d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dde26700 1 -- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8064600 msgr2=0x7fa2d80925e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dde26700 1 --2- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8064600 0x7fa2d80925e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dde26700 1 -- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2d8092ad0 msgr2=0x7fa2d814d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dde26700 1 --2- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2d8092ad0 0x7fa2d814d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dde26700 1 -- 172.21.15.31:0/144267972 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d000b7d0 con 0x7fa2d8063680 2024-04-18T10:36:18.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2dde26700 1 --2- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2d8063680 0x7fa2d8067cd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa2d4002f70 tx=0x7fa2d4006e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2c6ffd700 1 -- 172.21.15.31:0/144267972 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d4009e20 con 0x7fa2d8063680 2024-04-18T10:36:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2c6ffd700 1 -- 172.21.15.31:0/144267972 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4013460 con 0x7fa2d8063680 2024-04-18T10:36:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.388+0000 7fa2c6ffd700 1 -- 172.21.15.31:0/144267972 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2d40137c0 con 0x7fa2d8063680 2024-04-18T10:36:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.389+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d8066ac0 con 0x7fa2d8063680 2024-04-18T10:36:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.389+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d8094060 con 0x7fa2d8063680 2024-04-18T10:36:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.389+0000 7fa2c6ffd700 1 -- 172.21.15.31:0/144267972 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa2d400f070 con 0x7fa2d8063680 2024-04-18T10:36:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.390+0000 7fa2c6ffd700 1 -- 172.21.15.31:0/144267972 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa2d404a050 con 0x7fa2d8063680 2024-04-18T10:36:18.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.390+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d81336c0 con 0x7fa2d8063680 2024-04-18T10:36:18.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.393+0000 7fa2c6ffd700 1 -- 172.21.15.31:0/144267972 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa2d402ef50 con 0x7fa2d8063680 2024-04-18T10:36:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.457+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd224057a60 con 0x7fd22405b970 2024-04-18T10:36:18.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.457+0000 7fd212ffd700 1 -- 172.21.15.31:0/1894730486 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd2200330a0 con 0x7fd22405b970 2024-04-18T10:36:18.456 INFO:teuthology.orchestra.run.smithi031.stdout:42949672965 2024-04-18T10:36:18.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 >> v1:172.21.15.31:6816/39551 conn(0x7fd204038e60 legacy=0x7fd20403b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd22405b970 msgr2=0x7fd224092840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd22405b970 0x7fd224092840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd22000c000 tx=0x7fd220006df0).stop 2024-04-18T10:36:18.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 shutdown_connections 2024-04-18T10:36:18.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd22405b970 0x7fd224092840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd224136710 0x7fd22412f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 --2- 172.21.15.31:0/1894730486 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2240a5000 0x7fd22412f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 >> 172.21.15.31:0/1894730486 conn(0x7fd224060ac0 msgr2=0x7fd2240a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 shutdown_connections 2024-04-18T10:36:18.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.459+0000 7fd22be6d700 1 -- 172.21.15.31:0/1894730486 wait complete. 2024-04-18T10:36:18.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.3 2024-04-18T10:36:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.503+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc29009d800 con 0x7fc2900a0b90 2024-04-18T10:36:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.503+0000 7fc27ffff700 1 -- 172.21.15.31:0/1992659031 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc284032590 con 0x7fc2900a0b90 2024-04-18T10:36:18.502 INFO:teuthology.orchestra.run.smithi031.stdout:42949672966 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.504+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 >> v1:172.21.15.31:6816/39551 conn(0x7fc26c038e30 legacy=0x7fc26c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.504+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 msgr2=0x7fc290063d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.504+0000 7fc29544a700 1 --2- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 0x7fc290063d30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fc284002f70 tx=0x7fc284006e00).stop 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.505+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 shutdown_connections 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.505+0000 7fc29544a700 1 --2- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2901358a0 0x7fc2901321a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.505+0000 7fc29544a700 1 --2- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc29009f650 0x7fc2900653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.505+0000 7fc29544a700 1 --2- 172.21.15.31:0/1992659031 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc2900a0b90 0x7fc290063d30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.505+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 >> 172.21.15.31:0/1992659031 conn(0x7fc290060ac0 msgr2=0x7fc2900a5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.505+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 shutdown_connections 2024-04-18T10:36:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.505+0000 7fc29544a700 1 -- 172.21.15.31:0/1992659031 wait complete. 2024-04-18T10:36:18.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672966 for osd.2 2024-04-18T10:36:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.523+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08800a8f90 con 0x7f088005bcf0 2024-04-18T10:36:18.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.523+0000 7f087cff9700 1 -- 172.21.15.31:0/2663125083 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f087002b090 con 0x7f088005bcf0 2024-04-18T10:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:42949672965 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.524+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 >> v1:172.21.15.31:6816/39551 conn(0x7f0860038da0 legacy=0x7f086003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.524+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f088005bcf0 msgr2=0x7f088014a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.524+0000 7f088610a700 1 --2- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f088005bcf0 0x7f088014a560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f0880066b80 tx=0x7f0870006df0).stop 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.525+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 shutdown_connections 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.525+0000 7f088610a700 1 --2- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f088013e940 0x7f08800927b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.525+0000 7f088610a700 1 --2- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f088005bcf0 0x7f088014a560 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.525+0000 7f088610a700 1 --2- 172.21.15.31:0/2663125083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f088013de50 0x7f0880093de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.525+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 >> 172.21.15.31:0/2663125083 conn(0x7f088006c0c0 msgr2=0x7f088013c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.525+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 shutdown_connections 2024-04-18T10:36:18.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.525+0000 7f088610a700 1 -- 172.21.15.31:0/2663125083 wait complete. 2024-04-18T10:36:18.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.0 2024-04-18T10:36:18.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.549+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa2d8057a60 con 0x7fa2d8063680 2024-04-18T10:36:18.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.550+0000 7fa2c6ffd700 1 -- 172.21.15.31:0/144267972 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2d4032570 con 0x7fa2d8063680 2024-04-18T10:36:18.550 INFO:teuthology.orchestra.run.smithi031.stdout:42949672966 2024-04-18T10:36:18.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 >> v1:172.21.15.31:6816/39551 conn(0x7fa2b8038e30 legacy=0x7fa2b803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2d8063680 msgr2=0x7fa2d8067cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:18.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 --2- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2d8063680 0x7fa2d8067cd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa2d4002f70 tx=0x7fa2d4006e20).stop 2024-04-18T10:36:18.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 shutdown_connections 2024-04-18T10:36:18.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 --2- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2d8092ad0 0x7fa2d814d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 --2- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2d8063680 0x7fa2d8067cd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 --2- 172.21.15.31:0/144267972 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa2d8064600 0x7fa2d80925e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:18.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 >> 172.21.15.31:0/144267972 conn(0x7fa2d806c0c0 msgr2=0x7fa2d805b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:18.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 shutdown_connections 2024-04-18T10:36:18.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:18.551+0000 7fa2e008a700 1 -- 172.21.15.31:0/144267972 wait complete. 2024-04-18T10:36:18.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672966 for osd.1 2024-04-18T10:36:19.470 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T10:36:19.515 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T10:36:19.534 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T10:36:19.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T10:36:19.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.599+0000 7faee3c10700 1 Processor -- start 2024-04-18T10:36:19.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.599+0000 7faee3c10700 1 -- start start 2024-04-18T10:36:19.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.600+0000 7faee3c10700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc134500 0x7faedc0a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.600+0000 7faee3c10700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faedc13c810 0x7faedc13ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.600+0000 7faee3c10700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc0a4870 con 0x7faedc0a5050 2024-04-18T10:36:19.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.600+0000 7faee3c10700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc134ff0 con 0x7faedc13c810 2024-04-18T10:36:19.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.600+0000 7faee3c10700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0a4050 con 0x7faedc134500 2024-04-18T10:36:19.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee21ad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faedc13c810 0x7faedc13ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee21ad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faedc13c810 0x7faedc13ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53714/0 (socket says 172.21.15.31:53714) 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee21ad700 1 -- 172.21.15.31:0/1120702207 learned_addr learned my addr 172.21.15.31:0/1120702207 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee11ab700 1 --1- 172.21.15.31:0/1120702207 >> v1:172.21.15.31:6789/0 conn(0x7faedc0a5050 0x7faedc1348e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45528/0 (socket says 172.21.15.31:45528) 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee21ad700 1 -- 172.21.15.31:0/1120702207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc134500 msgr2=0x7faedc0a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee21ad700 1 --2- 172.21.15.31:0/1120702207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc134500 0x7faedc0a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee21ad700 1 -- 172.21.15.31:0/1120702207 >> v1:172.21.15.31:6789/0 conn(0x7faedc0a5050 legacy=0x7faedc1348e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee21ad700 1 -- 172.21.15.31:0/1120702207 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc0a42f0 con 0x7faedc13c810 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee09aa700 1 -- 172.21.15.31:0/1120702207 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528588222 0 0) 0x7faedc0a4870 con 0x7faedc0a5050 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee21ad700 1 --2- 172.21.15.31:0/1120702207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc13c810 0x7faedc13ec00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7faed40032f0 tx=0x7faed4009290).ready entity=mon.0 client_cookie=aafe1338714a346b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee09aa700 1 -- 172.21.15.31:0/1120702207 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed400b8a0 con 0x7faedc13c810 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee09aa700 1 -- 172.21.15.31:0/1120702207 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed400ba00 con 0x7faedc13c810 2024-04-18T10:36:19.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.602+0000 7faee09aa700 1 -- 172.21.15.31:0/1120702207 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed400bb70 con 0x7faedc13c810 2024-04-18T10:36:19.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.603+0000 7faee3c10700 1 -- 172.21.15.31:0/1120702207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc13c810 msgr2=0x7faedc13ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.603+0000 7faee3c10700 1 --2- 172.21.15.31:0/1120702207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc13c810 0x7faedc13ec00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7faed40032f0 tx=0x7faed4009290).stop 2024-04-18T10:36:19.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.603+0000 7faee3c10700 1 -- 172.21.15.31:0/1120702207 shutdown_connections 2024-04-18T10:36:19.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.603+0000 7faee3c10700 1 --2- 172.21.15.31:0/1120702207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc13c810 0x7faedc13ec00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.603+0000 7faee3c10700 1 --2- 172.21.15.31:0/1120702207 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc134500 0x7faedc0a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:19.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.603+0000 7faee3c10700 1 -- 172.21.15.31:0/1120702207 >> 172.21.15.31:0/1120702207 conn(0x7faedc060ac0 msgr2=0x7faedc0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:19.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.603+0000 7faee3c10700 1 -- 172.21.15.31:0/1120702207 shutdown_connections 2024-04-18T10:36:19.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.603+0000 7faee3c10700 1 -- 172.21.15.31:0/1120702207 wait complete. 2024-04-18T10:36:19.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.605+0000 7faee3c10700 1 Processor -- start 2024-04-18T10:36:19.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.605+0000 7faee3c10700 1 -- start start 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee3c10700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc0a5050 0x7faedc0a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee3c10700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc134500 0x7faedc139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee3c10700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faedc13c810 0x7faedc139c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee3c10700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0a2320 con 0x7faedc134500 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee3c10700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0a16d0 con 0x7faedc0a5050 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee3c10700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0a2bd0 con 0x7faedc13c810 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee19ac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc0a5050 0x7faedc0a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee19ac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc0a5050 0x7faedc0a0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54826/0 (socket says 172.21.15.31:54826) 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee21ad700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faedc13c810 0x7faedc139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee19ac700 1 -- 172.21.15.31:0/2014562696 learned_addr learned my addr 172.21.15.31:0/2014562696 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee11ab700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc134500 0x7faedc139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee21ad700 1 -- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc0a5050 msgr2=0x7faedc0a0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee21ad700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc0a5050 0x7faedc0a0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee21ad700 1 -- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc134500 msgr2=0x7faedc139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee21ad700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc134500 0x7faedc139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee21ad700 1 -- 172.21.15.31:0/2014562696 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed4009530 con 0x7faedc13c810 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee11ab700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc134500 0x7faedc139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee19ac700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc0a5050 0x7faedc0a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.606+0000 7faee21ad700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faedc13c810 0x7faedc139c70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faed40032f0 tx=0x7faed4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.607+0000 7faecaffd700 1 -- 172.21.15.31:0/2014562696 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed400bb70 con 0x7faedc13c810 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.607+0000 7faecaffd700 1 -- 172.21.15.31:0/2014562696 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed4020430 con 0x7faedc13c810 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.607+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc066ee0 con 0x7faedc13c810 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.607+0000 7faecaffd700 1 -- 172.21.15.31:0/2014562696 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed4020790 con 0x7faedc13c810 2024-04-18T10:36:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.607+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc0a1390 con 0x7faedc13c810 2024-04-18T10:36:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.608+0000 7faecaffd700 1 -- 172.21.15.31:0/2014562696 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7faed4026020 con 0x7faedc13c810 2024-04-18T10:36:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.608+0000 7faecaffd700 1 -- 172.21.15.31:0/2014562696 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7faed404b7d0 con 0x7faedc13c810 2024-04-18T10:36:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.608+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc05bd30 con 0x7faedc13c810 2024-04-18T10:36:19.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.614+0000 7faecaffd700 1 -- 172.21.15.31:0/2014562696 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7faed4015030 con 0x7faedc13c810 2024-04-18T10:36:19.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.641+0000 7f4fbf6af700 1 Processor -- start 2024-04-18T10:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.642+0000 7f4fbf6af700 1 -- start start 2024-04-18T10:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.642+0000 7f4fbf6af700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 0x7f4fb8133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.642+0000 7f4fbf6af700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4fb8062fb0 0x7f4fb8063680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.642+0000 7f4fbf6af700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80a92a0 0x7f4fb81365f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.642+0000 7f4fbf6af700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb8065150 con 0x7f4fb8062fb0 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.642+0000 7f4fbf6af700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8130bd0 con 0x7f4fb80a92a0 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.642+0000 7f4fbf6af700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8063b70 con 0x7f4fb8064600 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbd44b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 0x7f4fb8133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbd44b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 0x7f4fb8133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60098/0 (socket says 172.21.15.31:60098) 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbd44b700 1 -- 172.21.15.31:0/5705593 learned_addr learned my addr 172.21.15.31:0/5705593 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbcc4a700 1 --2- 172.21.15.31:0/5705593 >> v2:172.21.15.31:3300/0 conn(0x7f4fb8062fb0 0x7f4fb8063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbdc4c700 1 --2- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80a92a0 0x7f4fb81365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbcc4a700 1 -- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 msgr2=0x7f4fb8133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbcc4a700 1 --2- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 0x7f4fb8133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbcc4a700 1 -- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80a92a0 msgr2=0x7f4fb81365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbcc4a700 1 --2- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80a92a0 0x7f4fb81365f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbcc4a700 1 -- 172.21.15.31:0/5705593 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8061ee0 con 0x7f4fb8062fb0 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fbcc4a700 1 --2- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb8062fb0 0x7f4fb8063680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f4fb80a9c50 tx=0x7f4fa8006e80).ready entity=mon.0 client_cookie=2ed5ada761a19c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.643+0000 7f4fa7fff700 1 -- 172.21.15.31:0/5705593 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa8012070 con 0x7f4fb8062fb0 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fa7fff700 1 -- 172.21.15.31:0/5705593 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa8000e90 con 0x7f4fb8062fb0 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fa7fff700 1 -- 172.21.15.31:0/5705593 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa8017850 con 0x7f4fb8062fb0 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fbf6af700 1 -- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb8062fb0 msgr2=0x7f4fb8063680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fbf6af700 1 --2- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb8062fb0 0x7f4fb8063680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f4fb80a9c50 tx=0x7f4fa8006e80).stop 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fbf6af700 1 -- 172.21.15.31:0/5705593 shutdown_connections 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fbf6af700 1 --2- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb80a92a0 0x7f4fb81365f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fbf6af700 1 --2- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 0x7f4fb8133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fbf6af700 1 --2- 172.21.15.31:0/5705593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb8062fb0 0x7f4fb8063680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fbf6af700 1 -- 172.21.15.31:0/5705593 >> 172.21.15.31:0/5705593 conn(0x7f4fb806c0c0 msgr2=0x7f4fb806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fbf6af700 1 -- 172.21.15.31:0/5705593 shutdown_connections 2024-04-18T10:36:19.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.644+0000 7f4fbf6af700 1 -- 172.21.15.31:0/5705593 wait complete. 2024-04-18T10:36:19.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.645+0000 7f4fbf6af700 1 Processor -- start 2024-04-18T10:36:19.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.645+0000 7f4fbf6af700 1 -- start start 2024-04-18T10:36:19.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbf6af700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 0x7f4fb8092a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbf6af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80a92a0 0x7f4fb812ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbf6af700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb812ef00 0x7f4fb812f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbf6af700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb812f8a0 con 0x7f4fb80a92a0 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbf6af700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8093dd0 con 0x7f4fb812ef00 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbf6af700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb8098780 con 0x7f4fb8064600 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbcc4a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80a92a0 0x7f4fb812ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbcc4a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80a92a0 0x7f4fb812ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53738/0 (socket says 172.21.15.31:53738) 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbcc4a700 1 -- 172.21.15.31:0/4039471517 learned_addr learned my addr 172.21.15.31:0/4039471517 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbdc4c700 1 --2- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb812ef00 0x7f4fb812f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbd44b700 1 --2- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 0x7f4fb8092a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbcc4a700 1 -- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 msgr2=0x7f4fb8092a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbcc4a700 1 --2- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 0x7f4fb8092a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.646+0000 7f4fbcc4a700 1 -- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb812ef00 msgr2=0x7f4fb812f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.647+0000 7f4fbcc4a700 1 --2- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb812ef00 0x7f4fb812f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.647+0000 7f4fbcc4a700 1 -- 172.21.15.31:0/4039471517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa800d590 con 0x7f4fb80a92a0 2024-04-18T10:36:19.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.647+0000 7f4fbcc4a700 1 --2- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80a92a0 0x7f4fb812ea10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4fb80a9c50 tx=0x7f4fb8062690).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.647+0000 7f4fa67fc700 1 -- 172.21.15.31:0/4039471517 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa800b640 con 0x7f4fb80a92a0 2024-04-18T10:36:19.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.647+0000 7f4fa67fc700 1 -- 172.21.15.31:0/4039471517 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa800b7a0 con 0x7f4fb80a92a0 2024-04-18T10:36:19.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.647+0000 7f4fa67fc700 1 -- 172.21.15.31:0/4039471517 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa800bb00 con 0x7f4fb80a92a0 2024-04-18T10:36:19.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.647+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb8093030 con 0x7f4fb80a92a0 2024-04-18T10:36:19.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.647+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb8093af0 con 0x7f4fb80a92a0 2024-04-18T10:36:19.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.648+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb80949b0 con 0x7f4fb80a92a0 2024-04-18T10:36:19.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.649+0000 7f4fa67fc700 1 -- 172.21.15.31:0/4039471517 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4fa8029020 con 0x7f4fb80a92a0 2024-04-18T10:36:19.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.649+0000 7f4fa67fc700 1 -- 172.21.15.31:0/4039471517 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4fa804f500 con 0x7f4fb80a92a0 2024-04-18T10:36:19.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.655+0000 7f4fa67fc700 1 -- 172.21.15.31:0/4039471517 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4fa8001f00 con 0x7f4fb80a92a0 2024-04-18T10:36:19.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.679+0000 7f783fbf5700 1 Processor -- start 2024-04-18T10:36:19.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.679+0000 7f783fbf5700 1 -- start start 2024-04-18T10:36:19.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783fbf5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380a2a50 0x7f78380a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783fbf5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7838133b20 0x7f78380a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783fbf5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78380a5250 con 0x7f7838133740 2024-04-18T10:36:19.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783fbf5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78380a2e90 con 0x7f78380a2a50 2024-04-18T10:36:19.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783fbf5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78380a2210 con 0x7f7838133b20 2024-04-18T10:36:19.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783d991700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7838133740 0x7f78380a3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45530/0 (socket says 172.21.15.31:45530) 2024-04-18T10:36:19.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783d991700 1 -- 172.21.15.31:0/2188171323 learned_addr learned my addr 172.21.15.31:0/2188171323 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:19.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783e192700 1 --2- 172.21.15.31:0/2188171323 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7838133b20 0x7f78380a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783d190700 1 --2- 172.21.15.31:0/2188171323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380a2a50 0x7f78380a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783e192700 1 -- 172.21.15.31:0/2188171323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380a2a50 msgr2=0x7f78380a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783e192700 1 --2- 172.21.15.31:0/2188171323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380a2a50 0x7f78380a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783e192700 1 -- 172.21.15.31:0/2188171323 >> v1:172.21.15.31:6789/0 conn(0x7f7838133740 legacy=0x7f78380a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783e192700 1 -- 172.21.15.31:0/2188171323 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380a24d0 con 0x7f7838133b20 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.681+0000 7f783e192700 1 --2- 172.21.15.31:0/2188171323 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7838133b20 0x7f78380a3a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f78300032f0 tx=0x7f78300091d0).ready entity=mon.2 client_cookie=eefbfd7e079287b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.682+0000 7f783c98f700 1 -- 172.21.15.31:0/2188171323 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f783000b6c0 con 0x7f7838133b20 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.682+0000 7f783c98f700 1 -- 172.21.15.31:0/2188171323 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783000b820 con 0x7f7838133b20 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.682+0000 7f783c98f700 1 -- 172.21.15.31:0/2188171323 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f783000b990 con 0x7f7838133b20 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.682+0000 7f783fbf5700 1 -- 172.21.15.31:0/2188171323 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7838133b20 msgr2=0x7f78380a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.682+0000 7f783fbf5700 1 --2- 172.21.15.31:0/2188171323 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7838133b20 0x7f78380a3a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f78300032f0 tx=0x7f78300091d0).stop 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.682+0000 7f783fbf5700 1 -- 172.21.15.31:0/2188171323 shutdown_connections 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.682+0000 7f783fbf5700 1 --2- 172.21.15.31:0/2188171323 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7838133b20 0x7f78380a3a60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.682+0000 7f783fbf5700 1 --2- 172.21.15.31:0/2188171323 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380a2a50 0x7f78380a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.682+0000 7f783fbf5700 1 -- 172.21.15.31:0/2188171323 >> 172.21.15.31:0/2188171323 conn(0x7f7838060ac0 msgr2=0x7f78380a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.683+0000 7f783fbf5700 1 -- 172.21.15.31:0/2188171323 shutdown_connections 2024-04-18T10:36:19.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.683+0000 7f783fbf5700 1 -- 172.21.15.31:0/2188171323 wait complete. 2024-04-18T10:36:19.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783fbf5700 1 Processor -- start 2024-04-18T10:36:19.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783fbf5700 1 -- start start 2024-04-18T10:36:19.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783fbf5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380a2a50 0x7f7838092e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783fbf5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7838133740 0x7f7838145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783fbf5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7838133b20 0x7f7838146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783fbf5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7838065900 con 0x7f7838133b20 2024-04-18T10:36:19.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783fbf5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7838093360 con 0x7f7838133740 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783fbf5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7838065a70 con 0x7f78380a2a50 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783d190700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7838133740 0x7f7838145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783d190700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7838133740 0x7f7838145ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54858/0 (socket says 172.21.15.31:54858) 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.684+0000 7f783d190700 1 -- 172.21.15.31:0/524221955 learned_addr learned my addr 172.21.15.31:0/524221955 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783e192700 1 --2- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7838133b20 0x7f7838146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783d190700 1 -- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380a2a50 msgr2=0x7f7838092e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783d190700 1 --2- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380a2a50 0x7f7838092e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783d190700 1 -- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7838133b20 msgr2=0x7f7838146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783d190700 1 --2- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7838133b20 0x7f7838146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783d190700 1 -- 172.21.15.31:0/524221955 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7830009470 con 0x7f7838133740 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783e192700 1 --2- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7838133b20 0x7f7838146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783d190700 1 --2- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7838133740 0x7f7838145ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f782800c000 tx=0x7f7828006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f7826ffd700 1 -- 172.21.15.31:0/524221955 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7828010780 con 0x7f7838133740 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f7826ffd700 1 -- 172.21.15.31:0/524221955 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280108e0 con 0x7f7838133740 2024-04-18T10:36:19.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78380663a0 con 0x7f7838133740 2024-04-18T10:36:19.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f7826ffd700 1 -- 172.21.15.31:0/524221955 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7828010c40 con 0x7f7838133740 2024-04-18T10:36:19.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.685+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7838067500 con 0x7f7838133740 2024-04-18T10:36:19.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.686+0000 7f7826ffd700 1 -- 172.21.15.31:0/524221955 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f782801c460 con 0x7f7838133740 2024-04-18T10:36:19.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.687+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7838133f80 con 0x7f7838133740 2024-04-18T10:36:19.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.687+0000 7f7826ffd700 1 -- 172.21.15.31:0/524221955 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f782804aea0 con 0x7f7838133740 2024-04-18T10:36:19.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.690+0000 7f7826ffd700 1 -- 172.21.15.31:0/524221955 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7828033730 con 0x7f7838133740 2024-04-18T10:36:19.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.698+0000 7fa8778a3700 1 Processor -- start 2024-04-18T10:36:19.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.698+0000 7fa8778a3700 1 -- start start 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa8778a3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa87005bb30 0x7fa870063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa8778a3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 0x7fa870139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa8778a3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870062400 0x7fa8700a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa8778a3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa870062b80 con 0x7fa87005bb30 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa8778a3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa870062e60 con 0x7fa870062400 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa8778a3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa870139a40 con 0x7fa870061fe0 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa87563f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa87005bb30 0x7fa870063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa87563f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa87005bb30 0x7fa870063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53752/0 (socket says 172.21.15.31:53752) 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa87563f700 1 -- 172.21.15.31:0/1091936971 learned_addr learned my addr 172.21.15.31:0/1091936971 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.699+0000 7fa875e40700 1 --2- 172.21.15.31:0/1091936971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870062400 0x7fa8700a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa875e40700 1 -- 172.21.15.31:0/1091936971 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 msgr2=0x7fa870139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa875e40700 1 --2- 172.21.15.31:0/1091936971 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 0x7fa870139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa875e40700 1 -- 172.21.15.31:0/1091936971 >> v2:172.21.15.31:3300/0 conn(0x7fa87005bb30 msgr2=0x7fa870063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa875e40700 1 --2- 172.21.15.31:0/1091936971 >> v2:172.21.15.31:3300/0 conn(0x7fa87005bb30 0x7fa870063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa875e40700 1 -- 172.21.15.31:0/1091936971 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870139d00 con 0x7fa870062400 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa87563f700 1 --2- 172.21.15.31:0/1091936971 >> v2:172.21.15.31:3300/0 conn(0x7fa87005bb30 0x7fa870063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa875e40700 1 --2- 172.21.15.31:0/1091936971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870062400 0x7fa8700a8290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa8680032f0 tx=0x7fa8680091d0).ready entity=mon.1 client_cookie=372eac1f55929b82 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa85ffff700 1 -- 172.21.15.31:0/1091936971 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86800b6c0 con 0x7fa870062400 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa85ffff700 1 -- 172.21.15.31:0/1091936971 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86800b820 con 0x7fa870062400 2024-04-18T10:36:19.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.700+0000 7fa85ffff700 1 -- 172.21.15.31:0/1091936971 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86800b9d0 con 0x7fa870062400 2024-04-18T10:36:19.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.701+0000 7fa8778a3700 1 -- 172.21.15.31:0/1091936971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870062400 msgr2=0x7fa8700a8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.701+0000 7fa8778a3700 1 --2- 172.21.15.31:0/1091936971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870062400 0x7fa8700a8290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa8680032f0 tx=0x7fa8680091d0).stop 2024-04-18T10:36:19.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.701+0000 7fa8778a3700 1 -- 172.21.15.31:0/1091936971 shutdown_connections 2024-04-18T10:36:19.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.701+0000 7fa8778a3700 1 --2- 172.21.15.31:0/1091936971 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870062400 0x7fa8700a8290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.701+0000 7fa8778a3700 1 --2- 172.21.15.31:0/1091936971 >> v2:172.21.15.31:3300/0 conn(0x7fa87005bb30 0x7fa870063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.701+0000 7fa8778a3700 1 --2- 172.21.15.31:0/1091936971 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 0x7fa870139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:19.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.701+0000 7fa8778a3700 1 -- 172.21.15.31:0/1091936971 >> 172.21.15.31:0/1091936971 conn(0x7fa87006c0c0 msgr2=0x7fa87006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:19.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.701+0000 7fa8778a3700 1 -- 172.21.15.31:0/1091936971 shutdown_connections 2024-04-18T10:36:19.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.701+0000 7fa8778a3700 1 -- 172.21.15.31:0/1091936971 wait complete. 2024-04-18T10:36:19.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.702+0000 7fa8778a3700 1 Processor -- start 2024-04-18T10:36:19.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.702+0000 7fa8778a3700 1 -- start start 2024-04-18T10:36:19.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa8778a3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa87005bb30 0x7fa8700955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa8778a3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 0x7fa8701491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa8778a3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870095ae0 0x7fa870149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa8778a3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700973e0 con 0x7fa87005bb30 2024-04-18T10:36:19.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa8778a3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa870095f80 con 0x7fa870095ae0 2024-04-18T10:36:19.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa8778a3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa870096220 con 0x7fa870061fe0 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa874e3e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 0x7fa8701491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa875e40700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870095ae0 0x7fa870149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa874e3e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 0x7fa8701491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60150/0 (socket says 172.21.15.31:60150) 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa875e40700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870095ae0 0x7fa870149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54884/0 (socket says 172.21.15.31:54884) 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa874e3e700 1 -- 172.21.15.31:0/71980078 learned_addr learned my addr 172.21.15.31:0/71980078 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.703+0000 7fa875e40700 1 -- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 msgr2=0x7fa8701491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa875e40700 1 --2- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 0x7fa8701491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa875e40700 1 -- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa87005bb30 msgr2=0x7fa8700955f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa87563f700 1 --2- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa87005bb30 0x7fa8700955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa875e40700 1 --2- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa87005bb30 0x7fa8700955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa875e40700 1 -- 172.21.15.31:0/71980078 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c00b1e0 con 0x7fa870095ae0 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa87563f700 1 --2- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa87005bb30 0x7fa8700955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa875e40700 1 --2- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870095ae0 0x7fa870149690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa8680032f0 tx=0x7fa868016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa85e7fc700 1 -- 172.21.15.31:0/71980078 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86800b6c0 con 0x7fa870095ae0 2024-04-18T10:36:19.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa85e7fc700 1 -- 172.21.15.31:0/71980078 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa868020620 con 0x7fa870095ae0 2024-04-18T10:36:19.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa8778a3700 1 -- 172.21.15.31:0/71980078 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa868009470 con 0x7fa870095ae0 2024-04-18T10:36:19.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa85e7fc700 1 -- 172.21.15.31:0/71980078 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa868020980 con 0x7fa870095ae0 2024-04-18T10:36:19.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.704+0000 7fa8778a3700 1 -- 172.21.15.31:0/71980078 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8700987b0 con 0x7fa870095ae0 2024-04-18T10:36:19.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.705+0000 7fa8567fc700 1 -- 172.21.15.31:0/71980078 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa844003410 con 0x7fa870095ae0 2024-04-18T10:36:19.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.706+0000 7fa85e7fc700 1 -- 172.21.15.31:0/71980078 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa86800f070 con 0x7fa870095ae0 2024-04-18T10:36:19.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.707+0000 7fa85e7fc700 1 -- 172.21.15.31:0/71980078 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa86804b840 con 0x7fa870095ae0 2024-04-18T10:36:19.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.709+0000 7fa85e7fc700 1 -- 172.21.15.31:0/71980078 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa868021750 con 0x7fa870095ae0 2024-04-18T10:36:19.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.763+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faedc057a60 con 0x7faedc13c810 2024-04-18T10:36:19.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.763+0000 7faecaffd700 1 -- 172.21.15.31:0/2014562696 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faed40293f0 con 0x7faedc13c810 2024-04-18T10:36:19.763 INFO:teuthology.orchestra.run.smithi031.stdout:42949672966 2024-04-18T10:36:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 >> v1:172.21.15.31:6816/39551 conn(0x7faebc038da0 legacy=0x7faebc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faedc13c810 msgr2=0x7faedc139c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faedc13c810 0x7faedc139c70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faed40032f0 tx=0x7faed4016000).stop 2024-04-18T10:36:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 shutdown_connections 2024-04-18T10:36:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faedc13c810 0x7faedc139c70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faedc0a5050 0x7faedc0a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 --2- 172.21.15.31:0/2014562696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faedc134500 0x7faedc139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 >> 172.21.15.31:0/2014562696 conn(0x7faedc060ac0 msgr2=0x7faedc136890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 shutdown_connections 2024-04-18T10:36:19.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.765+0000 7faee3c10700 1 -- 172.21.15.31:0/2014562696 wait complete. 2024-04-18T10:36:19.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2024-04-18T10:36:19.776 DEBUG:teuthology.parallel:result is None 2024-04-18T10:36:19.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.777+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fb8133980 con 0x7f4fb80a92a0 2024-04-18T10:36:19.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.777+0000 7f4fa67fc700 1 -- 172.21.15.31:0/4039471517 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4fa801e020 con 0x7f4fb80a92a0 2024-04-18T10:36:19.777 INFO:teuthology.orchestra.run.smithi031.stdout:42949672967 2024-04-18T10:36:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 >> v1:172.21.15.31:6816/39551 conn(0x7f4f98038dd0 legacy=0x7f4f9803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80a92a0 msgr2=0x7f4fb812ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 --2- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80a92a0 0x7f4fb812ea10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4fb80a9c50 tx=0x7f4fb8062690).stop 2024-04-18T10:36:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 shutdown_connections 2024-04-18T10:36:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 --2- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4fb8064600 0x7f4fb8092a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 --2- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4fb812ef00 0x7f4fb812f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 --2- 172.21.15.31:0/4039471517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4fb80a92a0 0x7f4fb812ea10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 >> 172.21.15.31:0/4039471517 conn(0x7f4fb806c0c0 msgr2=0x7f4fb805bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:19.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 shutdown_connections 2024-04-18T10:36:19.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.779+0000 7f4fbf6af700 1 -- 172.21.15.31:0/4039471517 wait complete. 2024-04-18T10:36:19.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672967 for osd.2 2024-04-18T10:36:19.789 DEBUG:teuthology.parallel:result is None 2024-04-18T10:36:19.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.813+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f78380672a0 con 0x7f7838133740 2024-04-18T10:36:19.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.813+0000 7f7826ffd700 1 -- 172.21.15.31:0/524221955 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7828011760 con 0x7f7838133740 2024-04-18T10:36:19.813 INFO:teuthology.orchestra.run.smithi031.stdout:42949672967 2024-04-18T10:36:19.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 >> v1:172.21.15.31:6816/39551 conn(0x7f7818038da0 legacy=0x7f781803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7838133740 msgr2=0x7f7838145ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 --2- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7838133740 0x7f7838145ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f782800c000 tx=0x7f7828006df0).stop 2024-04-18T10:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 shutdown_connections 2024-04-18T10:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 --2- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380a2a50 0x7f7838092e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 --2- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7838133b20 0x7f7838146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 --2- 172.21.15.31:0/524221955 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7838133740 0x7f7838145ca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 >> 172.21.15.31:0/524221955 conn(0x7f7838060ac0 msgr2=0x7f78380a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 shutdown_connections 2024-04-18T10:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.815+0000 7f783fbf5700 1 -- 172.21.15.31:0/524221955 wait complete. 2024-04-18T10:36:19.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672967 for osd.1 2024-04-18T10:36:19.825 DEBUG:teuthology.parallel:result is None 2024-04-18T10:36:19.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.829+0000 7fa8567fc700 1 -- 172.21.15.31:0/71980078 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa8440036c0 con 0x7fa870095ae0 2024-04-18T10:36:19.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.829+0000 7fa85e7fc700 1 -- 172.21.15.31:0/71980078 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa868015020 con 0x7fa870095ae0 2024-04-18T10:36:19.829 INFO:teuthology.orchestra.run.smithi031.stdout:42949672966 2024-04-18T10:36:19.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.830+0000 7fa8567fc700 1 -- 172.21.15.31:0/71980078 >> v1:172.21.15.31:6816/39551 conn(0x7fa850038df0 legacy=0x7fa85003b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.830+0000 7fa8567fc700 1 -- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870095ae0 msgr2=0x7fa870149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.830+0000 7fa8567fc700 1 --2- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870095ae0 0x7fa870149690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa8680032f0 tx=0x7fa868016000).stop 2024-04-18T10:36:19.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.831+0000 7fa8567fc700 1 -- 172.21.15.31:0/71980078 shutdown_connections 2024-04-18T10:36:19.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.831+0000 7fa8567fc700 1 --2- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa870095ae0 0x7fa870149690 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.831+0000 7fa8567fc700 1 --2- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa87005bb30 0x7fa8700955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.831+0000 7fa8567fc700 1 --2- 172.21.15.31:0/71980078 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa870061fe0 0x7fa8701491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.831+0000 7fa8567fc700 1 -- 172.21.15.31:0/71980078 >> 172.21.15.31:0/71980078 conn(0x7fa87006c0c0 msgr2=0x7fa87006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:19.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.831+0000 7fa8567fc700 1 -- 172.21.15.31:0/71980078 shutdown_connections 2024-04-18T10:36:19.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.831+0000 7fa8567fc700 1 -- 172.21.15.31:0/71980078 wait complete. 2024-04-18T10:36:19.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.0 2024-04-18T10:36:19.841 DEBUG:teuthology.parallel:result is None 2024-04-18T10:36:19.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T10:36:19.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.986+0000 7fd7aef3f700 1 Processor -- start 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7aef3f700 1 -- start start 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7aef3f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd7a80aa5c0 0x7fd7a80aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7aef3f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8134510 0x7fd7a813ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7aef3f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a8064490 con 0x7fd7a81340e0 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7aef3f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a80aae90 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7aef3f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a8064dc0 con 0x7fd7a8134510 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7ad4dc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8134510 0x7fd7a813ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7accdb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd7a80aa5c0 0x7fd7a80aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7ad4dc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8134510 0x7fd7a813ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60152/0 (socket says 172.21.15.31:60152) 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7ad4dc700 1 -- 172.21.15.31:0/3025416585 learned_addr learned my addr 172.21.15.31:0/3025416585 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.987+0000 7fd7a7fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd7a81340e0 0x7fd7a8063d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45534/0 (socket says 172.21.15.31:45534) 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7ad4dc700 1 -- 172.21.15.31:0/3025416585 >> v2:172.21.15.31:3300/0 conn(0x7fd7a80aa5c0 msgr2=0x7fd7a80aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7ad4dc700 1 --2- 172.21.15.31:0/3025416585 >> v2:172.21.15.31:3300/0 conn(0x7fd7a80aa5c0 0x7fd7a80aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7ad4dc700 1 -- 172.21.15.31:0/3025416585 >> v1:172.21.15.31:6789/0 conn(0x7fd7a81340e0 legacy=0x7fd7a8063d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7ad4dc700 1 -- 172.21.15.31:0/3025416585 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a80650a0 con 0x7fd7a8134510 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7a77fe700 1 -- 172.21.15.31:0/3025416585 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680233128 0 0) 0x7fd794001110 con 0x7fd7a81340e0 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7accdb700 1 --2- 172.21.15.31:0/3025416585 >> v2:172.21.15.31:3300/0 conn(0x7fd7a80aa5c0 0x7fd7a80aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7ad4dc700 1 --2- 172.21.15.31:0/3025416585 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8134510 0x7fd7a813ea50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd7a00032f0 tx=0x7fd7a0009290).ready entity=mon.2 client_cookie=b239456b5316d794 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7a77fe700 1 -- 172.21.15.31:0/3025416585 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a000b8a0 con 0x7fd7a8134510 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7a77fe700 1 -- 172.21.15.31:0/3025416585 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a000ba00 con 0x7fd7a8134510 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7a77fe700 1 -- 172.21.15.31:0/3025416585 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7a000bb70 con 0x7fd7a8134510 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7aef3f700 1 -- 172.21.15.31:0/3025416585 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8134510 msgr2=0x7fd7a813ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7aef3f700 1 --2- 172.21.15.31:0/3025416585 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8134510 0x7fd7a813ea50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd7a00032f0 tx=0x7fd7a0009290).stop 2024-04-18T10:36:19.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7aef3f700 1 -- 172.21.15.31:0/3025416585 shutdown_connections 2024-04-18T10:36:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7aef3f700 1 --2- 172.21.15.31:0/3025416585 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8134510 0x7fd7a813ea50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7aef3f700 1 --2- 172.21.15.31:0/3025416585 >> v2:172.21.15.31:3300/0 conn(0x7fd7a80aa5c0 0x7fd7a80aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.988+0000 7fd7aef3f700 1 -- 172.21.15.31:0/3025416585 >> 172.21.15.31:0/3025416585 conn(0x7fd7a806c0c0 msgr2=0x7fd7a806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.989+0000 7fd7aef3f700 1 -- 172.21.15.31:0/3025416585 shutdown_connections 2024-04-18T10:36:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.989+0000 7fd7aef3f700 1 -- 172.21.15.31:0/3025416585 wait complete. 2024-04-18T10:36:19.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.989+0000 7fd7aef3f700 1 Processor -- start 2024-04-18T10:36:19.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.989+0000 7fd7aef3f700 1 -- start start 2024-04-18T10:36:19.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7aef3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a80aa5c0 0x7fd7a8144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7aef3f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7a81340e0 0x7fd7a8096580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7aef3f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8096a70 0x7fd7a8096ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:19.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7aef3f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a8097750 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7aef3f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80962e0 con 0x7fd7a81340e0 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7aef3f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a8095150 con 0x7fd7a8096a70 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7accdb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a80aa5c0 0x7fd7a8144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7ad4dc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8096a70 0x7fd7a8096ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7accdb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a80aa5c0 0x7fd7a8144730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53768/0 (socket says 172.21.15.31:53768) 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7accdb700 1 -- 172.21.15.31:0/368215256 learned_addr learned my addr 172.21.15.31:0/368215256 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.990+0000 7fd7a7fff700 1 --2- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7a81340e0 0x7fd7a8096580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7accdb700 1 -- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8096a70 msgr2=0x7fd7a8096ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7accdb700 1 --2- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8096a70 0x7fd7a8096ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7accdb700 1 -- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7a81340e0 msgr2=0x7fd7a8096580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7accdb700 1 --2- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7a81340e0 0x7fd7a8096580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7accdb700 1 -- 172.21.15.31:0/368215256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c00b180 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7accdb700 1 --2- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a80aa5c0 0x7fd7a8144730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fd79c00c000 tx=0x7fd79c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:19.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7a5ffb700 1 -- 172.21.15.31:0/368215256 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd79c010780 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7a5ffb700 1 -- 172.21.15.31:0/368215256 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79c0108e0 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a0009530 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7a5ffb700 1 -- 172.21.15.31:0/368215256 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd79c010c40 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.991+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a8144c20 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.992+0000 7fd7a5ffb700 1 -- 172.21.15.31:0/368215256 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd79c01c460 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.992+0000 7fd7a5ffb700 1 -- 172.21.15.31:0/368215256 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd79c04ad50 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.992+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a8144420 con 0x7fd7a80aa5c0 2024-04-18T10:36:19.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:19.995+0000 7fd7a5ffb700 1 -- 172.21.15.31:0/368215256 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd79c033680 con 0x7fd7a80aa5c0 2024-04-18T10:36:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.108+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 --> v1:172.21.15.31:6816/39551 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7a80947c0 con 0x7fd788038da0 2024-04-18T10:36:20.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.115+0000 7fd7a5ffb700 1 -- 172.21.15.31:0/368215256 <== mgr.4101 v1:172.21.15.31:6816/39551 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246931 (unknown 2965378022 0 1628694243) 0x7fd794007c20 con 0x7fd788038da0 2024-04-18T10:36:20.117 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 >> v1:172.21.15.31:6816/39551 conn(0x7fd788038da0 legacy=0x7fd78803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a80aa5c0 msgr2=0x7fd7a8144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 --2- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a80aa5c0 0x7fd7a8144730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fd79c00c000 tx=0x7fd79c006df0).stop 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 shutdown_connections 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 --2- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd7a8096a70 0x7fd7a8096ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 --2- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a80aa5c0 0x7fd7a8144730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 --2- 172.21.15.31:0/368215256 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd7a81340e0 0x7fd7a8096580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 >> 172.21.15.31:0/368215256 conn(0x7fd7a806c0c0 msgr2=0x7fd7a809b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 shutdown_connections 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.117+0000 7fd7aef3f700 1 -- 172.21.15.31:0/368215256 wait complete. 2024-04-18T10:36:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:36:20.127 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-18T10:36:19.389665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":217750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002006"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038116+0000","last_change":"2024-04-18T10:36:09.029464+0000","last_active":"2024-04-18T10:36:09.038116+0000","last_peered":"2024-04-18T10:36:09.038116+0000","last_clean":"2024-04-18T10:36:09.038116+0000","last_became_active":"2024-04-18T10:36:09.029119+0000","last_became_peered":"2024-04-18T10:36:09.029119+0000","last_unstale":"2024-04-18T10:36:09.038116+0000","last_undegraded":"2024-04-18T10:36:09.038116+0000","last_fullsized":"2024-04-18T10:36:09.038116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021034+0000","last_change":"2024-04-18T10:36:09.016639+0000","last_active":"2024-04-18T10:36:09.021034+0000","last_peered":"2024-04-18T10:36:09.021034+0000","last_clean":"2024-04-18T10:36:09.021034+0000","last_became_active":"2024-04-18T10:36:09.016298+0000","last_became_peered":"2024-04-18T10:36:09.016298+0000","last_unstale":"2024-04-18T10:36:09.021034+0000","last_undegraded":"2024-04-18T10:36:09.021034+0000","last_fullsized":"2024-04-18T10:36:09.021034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.029214+0000","last_change":"2024-04-18T10:36:09.021729+0000","last_active":"2024-04-18T10:36:09.029214+0000","last_peered":"2024-04-18T10:36:09.029214+0000","last_clean":"2024-04-18T10:36:09.029214+0000","last_became_active":"2024-04-18T10:36:09.021089+0000","last_became_peered":"2024-04-18T10:36:09.021089+0000","last_unstale":"2024-04-18T10:36:09.029214+0000","last_undegraded":"2024-04-18T10:36:09.029214+0000","last_fullsized":"2024-04-18T10:36:09.029214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027739+0000","last_change":"2024-04-18T10:36:09.022509+0000","last_active":"2024-04-18T10:36:09.027739+0000","last_peered":"2024-04-18T10:36:09.027739+0000","last_clean":"2024-04-18T10:36:09.027739+0000","last_became_active":"2024-04-18T10:36:09.019360+0000","last_became_peered":"2024-04-18T10:36:09.019360+0000","last_unstale":"2024-04-18T10:36:09.027739+0000","last_undegraded":"2024-04-18T10:36:09.027739+0000","last_fullsized":"2024-04-18T10:36:09.027739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027607+0000","last_change":"2024-04-18T10:36:09.021300+0000","last_active":"2024-04-18T10:36:09.027607+0000","last_peered":"2024-04-18T10:36:09.027607+0000","last_clean":"2024-04-18T10:36:09.027607+0000","last_became_active":"2024-04-18T10:36:09.018608+0000","last_became_peered":"2024-04-18T10:36:09.018608+0000","last_unstale":"2024-04-18T10:36:09.027607+0000","last_undegraded":"2024-04-18T10:36:09.027607+0000","last_fullsized":"2024-04-18T10:36:09.027607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043852+0000","last_change":"2024-04-18T10:36:09.041400+0000","last_active":"2024-04-18T10:36:09.043852+0000","last_peered":"2024-04-18T10:36:09.043852+0000","last_clean":"2024-04-18T10:36:09.043852+0000","last_became_active":"2024-04-18T10:36:09.038827+0000","last_became_peered":"2024-04-18T10:36:09.038827+0000","last_unstale":"2024-04-18T10:36:09.043852+0000","last_undegraded":"2024-04-18T10:36:09.043852+0000","last_fullsized":"2024-04-18T10:36:09.043852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043983+0000","last_change":"2024-04-18T10:36:09.042033+0000","last_active":"2024-04-18T10:36:09.043983+0000","last_peered":"2024-04-18T10:36:09.043983+0000","last_clean":"2024-04-18T10:36:09.043983+0000","last_became_active":"2024-04-18T10:36:09.039118+0000","last_became_peered":"2024-04-18T10:36:09.039118+0000","last_unstale":"2024-04-18T10:36:09.043983+0000","last_undegraded":"2024-04-18T10:36:09.043983+0000","last_fullsized":"2024-04-18T10:36:09.043983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.035450+0000","last_change":"2024-04-18T10:36:09.032927+0000","last_active":"2024-04-18T10:36:09.035450+0000","last_peered":"2024-04-18T10:36:09.035450+0000","last_clean":"2024-04-18T10:36:09.035450+0000","last_became_active":"2024-04-18T10:36:09.032162+0000","last_became_peered":"2024-04-18T10:36:09.032162+0000","last_unstale":"2024-04-18T10:36:09.035450+0000","last_undegraded":"2024-04-18T10:36:09.035450+0000","last_fullsized":"2024-04-18T10:36:09.035450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028743+0000","last_change":"2024-04-18T10:36:09.022311+0000","last_active":"2024-04-18T10:36:09.028743+0000","last_peered":"2024-04-18T10:36:09.028743+0000","last_clean":"2024-04-18T10:36:09.028743+0000","last_became_active":"2024-04-18T10:36:09.021805+0000","last_became_peered":"2024-04-18T10:36:09.021805+0000","last_unstale":"2024-04-18T10:36:09.028743+0000","last_undegraded":"2024-04-18T10:36:09.028743+0000","last_fullsized":"2024-04-18T10:36:09.028743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038226+0000","last_change":"2024-04-18T10:36:09.034290+0000","last_active":"2024-04-18T10:36:09.038226+0000","last_peered":"2024-04-18T10:36:09.038226+0000","last_clean":"2024-04-18T10:36:09.038226+0000","last_became_active":"2024-04-18T10:36:09.034081+0000","last_became_peered":"2024-04-18T10:36:09.034081+0000","last_unstale":"2024-04-18T10:36:09.038226+0000","last_undegraded":"2024-04-18T10:36:09.038226+0000","last_fullsized":"2024-04-18T10:36:09.038226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023279+0000","last_change":"2024-04-18T10:36:09.016527+0000","last_active":"2024-04-18T10:36:09.023279+0000","last_peered":"2024-04-18T10:36:09.023279+0000","last_clean":"2024-04-18T10:36:09.023279+0000","last_became_active":"2024-04-18T10:36:09.014883+0000","last_became_peered":"2024-04-18T10:36:09.014883+0000","last_unstale":"2024-04-18T10:36:09.023279+0000","last_undegraded":"2024-04-18T10:36:09.023279+0000","last_fullsized":"2024-04-18T10:36:09.023279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.013927+0000","last_change":"2024-04-18T10:36:09.005314+0000","last_active":"2024-04-18T10:36:09.013927+0000","last_peered":"2024-04-18T10:36:09.013927+0000","last_clean":"2024-04-18T10:36:09.013927+0000","last_became_active":"2024-04-18T10:36:09.004979+0000","last_became_peered":"2024-04-18T10:36:09.004979+0000","last_unstale":"2024-04-18T10:36:09.013927+0000","last_undegraded":"2024-04-18T10:36:09.013927+0000","last_fullsized":"2024-04-18T10:36:09.013927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038097+0000","last_change":"2024-04-18T10:36:09.028839+0000","last_active":"2024-04-18T10:36:09.038097+0000","last_peered":"2024-04-18T10:36:09.038097+0000","last_clean":"2024-04-18T10:36:09.038097+0000","last_became_active":"2024-04-18T10:36:09.028502+0000","last_became_peered":"2024-04-18T10:36:09.028502+0000","last_unstale":"2024-04-18T10:36:09.038097+0000","last_undegraded":"2024-04-18T10:36:09.038097+0000","last_fullsized":"2024-04-18T10:36:09.038097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038555+0000","last_change":"2024-04-18T10:36:09.034002+0000","last_active":"2024-04-18T10:36:09.038555+0000","last_peered":"2024-04-18T10:36:09.038555+0000","last_clean":"2024-04-18T10:36:09.038555+0000","last_became_active":"2024-04-18T10:36:09.033512+0000","last_became_peered":"2024-04-18T10:36:09.033512+0000","last_unstale":"2024-04-18T10:36:09.038555+0000","last_undegraded":"2024-04-18T10:36:09.038555+0000","last_fullsized":"2024-04-18T10:36:09.038555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.018733+0000","last_change":"2024-04-18T10:36:09.008596+0000","last_active":"2024-04-18T10:36:09.018733+0000","last_peered":"2024-04-18T10:36:09.018733+0000","last_clean":"2024-04-18T10:36:09.018733+0000","last_became_active":"2024-04-18T10:36:09.008249+0000","last_became_peered":"2024-04-18T10:36:09.008249+0000","last_unstale":"2024-04-18T10:36:09.018733+0000","last_undegraded":"2024-04-18T10:36:09.018733+0000","last_fullsized":"2024-04-18T10:36:09.018733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048341+0000","last_change":"2024-04-18T10:36:09.043650+0000","last_active":"2024-04-18T10:36:09.048341+0000","last_peered":"2024-04-18T10:36:09.048341+0000","last_clean":"2024-04-18T10:36:09.048341+0000","last_became_active":"2024-04-18T10:36:09.039117+0000","last_became_peered":"2024-04-18T10:36:09.039117+0000","last_unstale":"2024-04-18T10:36:09.048341+0000","last_undegraded":"2024-04-18T10:36:09.048341+0000","last_fullsized":"2024-04-18T10:36:09.048341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028720+0000","last_change":"2024-04-18T10:36:09.022106+0000","last_active":"2024-04-18T10:36:09.028720+0000","last_peered":"2024-04-18T10:36:09.028720+0000","last_clean":"2024-04-18T10:36:09.028720+0000","last_became_active":"2024-04-18T10:36:09.021380+0000","last_became_peered":"2024-04-18T10:36:09.021380+0000","last_unstale":"2024-04-18T10:36:09.028720+0000","last_undegraded":"2024-04-18T10:36:09.028720+0000","last_fullsized":"2024-04-18T10:36:09.028720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.018007+0000","last_change":"2024-04-18T10:36:09.007051+0000","last_active":"2024-04-18T10:36:09.018007+0000","last_peered":"2024-04-18T10:36:09.018007+0000","last_clean":"2024-04-18T10:36:09.018007+0000","last_became_active":"2024-04-18T10:36:09.006731+0000","last_became_peered":"2024-04-18T10:36:09.006731+0000","last_unstale":"2024-04-18T10:36:09.018007+0000","last_undegraded":"2024-04-18T10:36:09.018007+0000","last_fullsized":"2024-04-18T10:36:09.018007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.025759+0000","last_change":"2024-04-18T10:36:09.021352+0000","last_active":"2024-04-18T10:36:09.025759+0000","last_peered":"2024-04-18T10:36:09.025759+0000","last_clean":"2024-04-18T10:36:09.025759+0000","last_became_active":"2024-04-18T10:36:09.018400+0000","last_became_peered":"2024-04-18T10:36:09.018400+0000","last_unstale":"2024-04-18T10:36:09.025759+0000","last_undegraded":"2024-04-18T10:36:09.025759+0000","last_fullsized":"2024-04-18T10:36:09.025759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040399+0000","last_change":"2024-04-18T10:36:09.037939+0000","last_active":"2024-04-18T10:36:09.040399+0000","last_peered":"2024-04-18T10:36:09.040399+0000","last_clean":"2024-04-18T10:36:09.040399+0000","last_became_active":"2024-04-18T10:36:09.037611+0000","last_became_peered":"2024-04-18T10:36:09.037611+0000","last_unstale":"2024-04-18T10:36:09.040399+0000","last_undegraded":"2024-04-18T10:36:09.040399+0000","last_fullsized":"2024-04-18T10:36:09.040399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040284+0000","last_change":"2024-04-18T10:36:09.036858+0000","last_active":"2024-04-18T10:36:09.040284+0000","last_peered":"2024-04-18T10:36:09.040284+0000","last_clean":"2024-04-18T10:36:09.040284+0000","last_became_active":"2024-04-18T10:36:09.036508+0000","last_became_peered":"2024-04-18T10:36:09.036508+0000","last_unstale":"2024-04-18T10:36:09.040284+0000","last_undegraded":"2024-04-18T10:36:09.040284+0000","last_fullsized":"2024-04-18T10:36:09.040284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028695+0000","last_change":"2024-04-18T10:36:09.021243+0000","last_active":"2024-04-18T10:36:09.028695+0000","last_peered":"2024-04-18T10:36:09.028695+0000","last_clean":"2024-04-18T10:36:09.028695+0000","last_became_active":"2024-04-18T10:36:09.019277+0000","last_became_peered":"2024-04-18T10:36:09.019277+0000","last_unstale":"2024-04-18T10:36:09.028695+0000","last_undegraded":"2024-04-18T10:36:09.028695+0000","last_fullsized":"2024-04-18T10:36:09.028695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043961+0000","last_change":"2024-04-18T10:36:09.041841+0000","last_active":"2024-04-18T10:36:09.043961+0000","last_peered":"2024-04-18T10:36:09.043961+0000","last_clean":"2024-04-18T10:36:09.043961+0000","last_became_active":"2024-04-18T10:36:09.038958+0000","last_became_peered":"2024-04-18T10:36:09.038958+0000","last_unstale":"2024-04-18T10:36:09.043961+0000","last_undegraded":"2024-04-18T10:36:09.043961+0000","last_fullsized":"2024-04-18T10:36:09.043961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038748+0000","last_change":"2024-04-18T10:36:09.035656+0000","last_active":"2024-04-18T10:36:09.038748+0000","last_peered":"2024-04-18T10:36:09.038748+0000","last_clean":"2024-04-18T10:36:09.038748+0000","last_became_active":"2024-04-18T10:36:09.035221+0000","last_became_peered":"2024-04-18T10:36:09.035221+0000","last_unstale":"2024-04-18T10:36:09.038748+0000","last_undegraded":"2024-04-18T10:36:09.038748+0000","last_fullsized":"2024-04-18T10:36:09.038748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.037238+0000","last_change":"2024-04-18T10:36:09.031118+0000","last_active":"2024-04-18T10:36:09.037238+0000","last_peered":"2024-04-18T10:36:09.037238+0000","last_clean":"2024-04-18T10:36:09.037238+0000","last_became_active":"2024-04-18T10:36:09.024843+0000","last_became_peered":"2024-04-18T10:36:09.024843+0000","last_unstale":"2024-04-18T10:36:09.037238+0000","last_undegraded":"2024-04-18T10:36:09.037238+0000","last_fullsized":"2024-04-18T10:36:09.037238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.034882+0000","last_change":"2024-04-18T10:36:09.032225+0000","last_active":"2024-04-18T10:36:09.034882+0000","last_peered":"2024-04-18T10:36:09.034882+0000","last_clean":"2024-04-18T10:36:09.034882+0000","last_became_active":"2024-04-18T10:36:09.031895+0000","last_became_peered":"2024-04-18T10:36:09.031895+0000","last_unstale":"2024-04-18T10:36:09.034882+0000","last_undegraded":"2024-04-18T10:36:09.034882+0000","last_fullsized":"2024-04-18T10:36:09.034882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043564+0000","last_change":"2024-04-18T10:36:09.040868+0000","last_active":"2024-04-18T10:36:09.043564+0000","last_peered":"2024-04-18T10:36:09.043564+0000","last_clean":"2024-04-18T10:36:09.043564+0000","last_became_active":"2024-04-18T10:36:09.038946+0000","last_became_peered":"2024-04-18T10:36:09.038946+0000","last_unstale":"2024-04-18T10:36:09.043564+0000","last_undegraded":"2024-04-18T10:36:09.043564+0000","last_fullsized":"2024-04-18T10:36:09.043564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.034159+0000","last_change":"2024-04-18T10:36:08.696988+0000","last_active":"2024-04-18T10:36:09.034159+0000","last_peered":"2024-04-18T10:36:09.034159+0000","last_clean":"2024-04-18T10:36:09.034159+0000","last_became_active":"2024-04-18T10:36:08.696639+0000","last_became_peered":"2024-04-18T10:36:08.696639+0000","last_unstale":"2024-04-18T10:36:09.034159+0000","last_undegraded":"2024-04-18T10:36:09.034159+0000","last_fullsized":"2024-04-18T10:36:09.034159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043580+0000","last_change":"2024-04-18T10:36:09.040997+0000","last_active":"2024-04-18T10:36:09.043580+0000","last_peered":"2024-04-18T10:36:09.043580+0000","last_clean":"2024-04-18T10:36:09.043580+0000","last_became_active":"2024-04-18T10:36:09.039544+0000","last_became_peered":"2024-04-18T10:36:09.039544+0000","last_unstale":"2024-04-18T10:36:09.043580+0000","last_undegraded":"2024-04-18T10:36:09.043580+0000","last_fullsized":"2024-04-18T10:36:09.043580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.002229+0000","last_change":"2024-04-18T10:36:08.706823+0000","last_active":"2024-04-18T10:36:09.002229+0000","last_peered":"2024-04-18T10:36:09.002229+0000","last_clean":"2024-04-18T10:36:09.002229+0000","last_became_active":"2024-04-18T10:36:08.706488+0000","last_became_peered":"2024-04-18T10:36:08.706488+0000","last_unstale":"2024-04-18T10:36:09.002229+0000","last_undegraded":"2024-04-18T10:36:09.002229+0000","last_fullsized":"2024-04-18T10:36:09.002229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028604+0000","last_change":"2024-04-18T10:36:09.020079+0000","last_active":"2024-04-18T10:36:09.028604+0000","last_peered":"2024-04-18T10:36:09.028604+0000","last_clean":"2024-04-18T10:36:09.028604+0000","last_became_active":"2024-04-18T10:36:09.019759+0000","last_became_peered":"2024-04-18T10:36:09.019759+0000","last_unstale":"2024-04-18T10:36:09.028604+0000","last_undegraded":"2024-04-18T10:36:09.028604+0000","last_fullsized":"2024-04-18T10:36:09.028604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.996687+0000","last_change":"2024-04-18T10:36:08.715008+0000","last_active":"2024-04-18T10:36:09.996687+0000","last_peered":"2024-04-18T10:36:09.996687+0000","last_clean":"2024-04-18T10:36:09.996687+0000","last_became_active":"2024-04-18T10:36:08.714642+0000","last_became_peered":"2024-04-18T10:36:08.714642+0000","last_unstale":"2024-04-18T10:36:09.996687+0000","last_undegraded":"2024-04-18T10:36:09.996687+0000","last_fullsized":"2024-04-18T10:36:09.996687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048447+0000","last_change":"2024-04-18T10:36:09.045728+0000","last_active":"2024-04-18T10:36:09.048447+0000","last_peered":"2024-04-18T10:36:09.048447+0000","last_clean":"2024-04-18T10:36:09.048447+0000","last_became_active":"2024-04-18T10:36:09.045122+0000","last_became_peered":"2024-04-18T10:36:09.045122+0000","last_unstale":"2024-04-18T10:36:09.048447+0000","last_undegraded":"2024-04-18T10:36:09.048447+0000","last_fullsized":"2024-04-18T10:36:09.048447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.013511+0000","last_change":"2024-04-18T10:36:08.706131+0000","last_active":"2024-04-18T10:36:11.013511+0000","last_peered":"2024-04-18T10:36:11.013511+0000","last_clean":"2024-04-18T10:36:11.013511+0000","last_became_active":"2024-04-18T10:36:08.705713+0000","last_became_peered":"2024-04-18T10:36:08.705713+0000","last_unstale":"2024-04-18T10:36:11.013511+0000","last_undegraded":"2024-04-18T10:36:11.013511+0000","last_fullsized":"2024-04-18T10:36:11.013511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048368+0000","last_change":"2024-04-18T10:36:09.043706+0000","last_active":"2024-04-18T10:36:09.048368+0000","last_peered":"2024-04-18T10:36:09.048368+0000","last_clean":"2024-04-18T10:36:09.048368+0000","last_became_active":"2024-04-18T10:36:09.039571+0000","last_became_peered":"2024-04-18T10:36:09.039571+0000","last_unstale":"2024-04-18T10:36:09.048368+0000","last_undegraded":"2024-04-18T10:36:09.048368+0000","last_fullsized":"2024-04-18T10:36:09.048368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.008477+0000","last_change":"2024-04-18T10:36:08.703814+0000","last_active":"2024-04-18T10:36:11.008477+0000","last_peered":"2024-04-18T10:36:11.008477+0000","last_clean":"2024-04-18T10:36:11.008477+0000","last_became_active":"2024-04-18T10:36:08.703206+0000","last_became_peered":"2024-04-18T10:36:08.703206+0000","last_unstale":"2024-04-18T10:36:11.008477+0000","last_undegraded":"2024-04-18T10:36:11.008477+0000","last_fullsized":"2024-04-18T10:36:11.008477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044003+0000","last_change":"2024-04-18T10:36:09.042232+0000","last_active":"2024-04-18T10:36:09.044003+0000","last_peered":"2024-04-18T10:36:09.044003+0000","last_clean":"2024-04-18T10:36:09.044003+0000","last_became_active":"2024-04-18T10:36:09.039432+0000","last_became_peered":"2024-04-18T10:36:09.039432+0000","last_unstale":"2024-04-18T10:36:09.044003+0000","last_undegraded":"2024-04-18T10:36:09.044003+0000","last_fullsized":"2024-04-18T10:36:09.044003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.997268+0000","last_change":"2024-04-18T10:36:08.705414+0000","last_active":"2024-04-18T10:36:09.997268+0000","last_peered":"2024-04-18T10:36:09.997268+0000","last_clean":"2024-04-18T10:36:09.997268+0000","last_became_active":"2024-04-18T10:36:08.705077+0000","last_became_peered":"2024-04-18T10:36:08.705077+0000","last_unstale":"2024-04-18T10:36:09.997268+0000","last_undegraded":"2024-04-18T10:36:09.997268+0000","last_fullsized":"2024-04-18T10:36:09.997268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040352+0000","last_change":"2024-04-18T10:36:09.036998+0000","last_active":"2024-04-18T10:36:09.040352+0000","last_peered":"2024-04-18T10:36:09.040352+0000","last_clean":"2024-04-18T10:36:09.040352+0000","last_became_active":"2024-04-18T10:36:09.036672+0000","last_became_peered":"2024-04-18T10:36:09.036672+0000","last_unstale":"2024-04-18T10:36:09.040352+0000","last_undegraded":"2024-04-18T10:36:09.040352+0000","last_fullsized":"2024-04-18T10:36:09.040352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.011384+0000","last_change":"2024-04-18T10:36:08.711520+0000","last_active":"2024-04-18T10:36:11.011384+0000","last_peered":"2024-04-18T10:36:11.011384+0000","last_clean":"2024-04-18T10:36:11.011384+0000","last_became_active":"2024-04-18T10:36:08.711135+0000","last_became_peered":"2024-04-18T10:36:08.711135+0000","last_unstale":"2024-04-18T10:36:11.011384+0000","last_undegraded":"2024-04-18T10:36:11.011384+0000","last_fullsized":"2024-04-18T10:36:11.011384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016697+0000","last_change":"2024-04-18T10:36:09.012564+0000","last_active":"2024-04-18T10:36:09.016697+0000","last_peered":"2024-04-18T10:36:09.016697+0000","last_clean":"2024-04-18T10:36:09.016697+0000","last_became_active":"2024-04-18T10:36:09.012232+0000","last_became_peered":"2024-04-18T10:36:09.012232+0000","last_unstale":"2024-04-18T10:36:09.016697+0000","last_undegraded":"2024-04-18T10:36:09.016697+0000","last_fullsized":"2024-04-18T10:36:09.016697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.011129+0000","last_change":"2024-04-18T10:36:08.715596+0000","last_active":"2024-04-18T10:36:11.011129+0000","last_peered":"2024-04-18T10:36:11.011129+0000","last_clean":"2024-04-18T10:36:11.011129+0000","last_became_active":"2024-04-18T10:36:08.715228+0000","last_became_peered":"2024-04-18T10:36:08.715228+0000","last_unstale":"2024-04-18T10:36:11.011129+0000","last_undegraded":"2024-04-18T10:36:11.011129+0000","last_fullsized":"2024-04-18T10:36:11.011129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044093+0000","last_change":"2024-04-18T10:36:09.039566+0000","last_active":"2024-04-18T10:36:09.044093+0000","last_peered":"2024-04-18T10:36:09.044093+0000","last_clean":"2024-04-18T10:36:09.044093+0000","last_became_active":"2024-04-18T10:36:09.039196+0000","last_became_peered":"2024-04-18T10:36:09.039196+0000","last_unstale":"2024-04-18T10:36:09.044093+0000","last_undegraded":"2024-04-18T10:36:09.044093+0000","last_fullsized":"2024-04-18T10:36:09.044093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012770+0000","last_change":"2024-04-18T10:36:08.700155+0000","last_active":"2024-04-18T10:36:11.012770+0000","last_peered":"2024-04-18T10:36:11.012770+0000","last_clean":"2024-04-18T10:36:11.012770+0000","last_became_active":"2024-04-18T10:36:08.699825+0000","last_became_peered":"2024-04-18T10:36:08.699825+0000","last_unstale":"2024-04-18T10:36:11.012770+0000","last_undegraded":"2024-04-18T10:36:11.012770+0000","last_fullsized":"2024-04-18T10:36:11.012770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045311+0000","last_change":"2024-04-18T10:36:09.043704+0000","last_active":"2024-04-18T10:36:09.045311+0000","last_peered":"2024-04-18T10:36:09.045311+0000","last_clean":"2024-04-18T10:36:09.045311+0000","last_became_active":"2024-04-18T10:36:09.043212+0000","last_became_peered":"2024-04-18T10:36:09.043212+0000","last_unstale":"2024-04-18T10:36:09.045311+0000","last_undegraded":"2024-04-18T10:36:09.045311+0000","last_fullsized":"2024-04-18T10:36:09.045311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016667+0000","last_change":"2024-04-18T10:36:08.712894+0000","last_active":"2024-04-18T10:36:09.016667+0000","last_peered":"2024-04-18T10:36:09.016667+0000","last_clean":"2024-04-18T10:36:09.016667+0000","last_became_active":"2024-04-18T10:36:08.712527+0000","last_became_peered":"2024-04-18T10:36:08.712527+0000","last_unstale":"2024-04-18T10:36:09.016667+0000","last_undegraded":"2024-04-18T10:36:09.016667+0000","last_fullsized":"2024-04-18T10:36:09.016667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.036388+0000","last_change":"2024-04-18T10:36:09.028482+0000","last_active":"2024-04-18T10:36:09.036388+0000","last_peered":"2024-04-18T10:36:09.036388+0000","last_clean":"2024-04-18T10:36:09.036388+0000","last_became_active":"2024-04-18T10:36:09.027131+0000","last_became_peered":"2024-04-18T10:36:09.027131+0000","last_unstale":"2024-04-18T10:36:09.036388+0000","last_undegraded":"2024-04-18T10:36:09.036388+0000","last_fullsized":"2024-04-18T10:36:09.036388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.010119+0000","last_change":"2024-04-18T10:36:08.696453+0000","last_active":"2024-04-18T10:36:11.010119+0000","last_peered":"2024-04-18T10:36:11.010119+0000","last_clean":"2024-04-18T10:36:11.010119+0000","last_became_active":"2024-04-18T10:36:08.691479+0000","last_became_peered":"2024-04-18T10:36:08.691479+0000","last_unstale":"2024-04-18T10:36:11.010119+0000","last_undegraded":"2024-04-18T10:36:11.010119+0000","last_fullsized":"2024-04-18T10:36:11.010119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048422+0000","last_change":"2024-04-18T10:36:09.045160+0000","last_active":"2024-04-18T10:36:09.048422+0000","last_peered":"2024-04-18T10:36:09.048422+0000","last_clean":"2024-04-18T10:36:09.048422+0000","last_became_active":"2024-04-18T10:36:09.044693+0000","last_became_peered":"2024-04-18T10:36:09.044693+0000","last_unstale":"2024-04-18T10:36:09.048422+0000","last_undegraded":"2024-04-18T10:36:09.048422+0000","last_fullsized":"2024-04-18T10:36:09.048422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.022802+0000","last_change":"2024-04-18T10:36:08.693031+0000","last_active":"2024-04-18T10:36:09.022802+0000","last_peered":"2024-04-18T10:36:09.022802+0000","last_clean":"2024-04-18T10:36:09.022802+0000","last_became_active":"2024-04-18T10:36:08.692741+0000","last_became_peered":"2024-04-18T10:36:08.692741+0000","last_unstale":"2024-04-18T10:36:09.022802+0000","last_undegraded":"2024-04-18T10:36:09.022802+0000","last_fullsized":"2024-04-18T10:36:09.022802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048417+0000","last_change":"2024-04-18T10:36:09.043925+0000","last_active":"2024-04-18T10:36:09.048417+0000","last_peered":"2024-04-18T10:36:09.048417+0000","last_clean":"2024-04-18T10:36:09.048417+0000","last_became_active":"2024-04-18T10:36:09.043223+0000","last_became_peered":"2024-04-18T10:36:09.043223+0000","last_unstale":"2024-04-18T10:36:09.048417+0000","last_undegraded":"2024-04-18T10:36:09.048417+0000","last_fullsized":"2024-04-18T10:36:09.048417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.005701+0000","last_change":"2024-04-18T10:36:08.693355+0000","last_active":"2024-04-18T10:36:09.005701+0000","last_peered":"2024-04-18T10:36:09.005701+0000","last_clean":"2024-04-18T10:36:09.005701+0000","last_became_active":"2024-04-18T10:36:08.693035+0000","last_became_peered":"2024-04-18T10:36:08.693035+0000","last_unstale":"2024-04-18T10:36:09.005701+0000","last_undegraded":"2024-04-18T10:36:09.005701+0000","last_fullsized":"2024-04-18T10:36:09.005701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016525+0000","last_change":"2024-04-18T10:36:09.013954+0000","last_active":"2024-04-18T10:36:09.016525+0000","last_peered":"2024-04-18T10:36:09.016525+0000","last_clean":"2024-04-18T10:36:09.016525+0000","last_became_active":"2024-04-18T10:36:09.013544+0000","last_became_peered":"2024-04-18T10:36:09.013544+0000","last_unstale":"2024-04-18T10:36:09.016525+0000","last_undegraded":"2024-04-18T10:36:09.016525+0000","last_fullsized":"2024-04-18T10:36:09.016525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045534+0000","last_change":"2024-04-18T10:36:08.710986+0000","last_active":"2024-04-18T10:36:09.045534+0000","last_peered":"2024-04-18T10:36:09.045534+0000","last_clean":"2024-04-18T10:36:09.045534+0000","last_became_active":"2024-04-18T10:36:08.710570+0000","last_became_peered":"2024-04-18T10:36:08.710570+0000","last_unstale":"2024-04-18T10:36:09.045534+0000","last_undegraded":"2024-04-18T10:36:09.045534+0000","last_fullsized":"2024-04-18T10:36:09.045534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017673+0000","last_change":"2024-04-18T10:36:09.013364+0000","last_active":"2024-04-18T10:36:09.017673+0000","last_peered":"2024-04-18T10:36:09.017673+0000","last_clean":"2024-04-18T10:36:09.017673+0000","last_became_active":"2024-04-18T10:36:09.013081+0000","last_became_peered":"2024-04-18T10:36:09.013081+0000","last_unstale":"2024-04-18T10:36:09.017673+0000","last_undegraded":"2024-04-18T10:36:09.017673+0000","last_fullsized":"2024-04-18T10:36:09.017673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:08.998936+0000","last_change":"2024-04-18T10:36:08.697479+0000","last_active":"2024-04-18T10:36:08.998936+0000","last_peered":"2024-04-18T10:36:08.998936+0000","last_clean":"2024-04-18T10:36:08.998936+0000","last_became_active":"2024-04-18T10:36:08.697086+0000","last_became_peered":"2024-04-18T10:36:08.697086+0000","last_unstale":"2024-04-18T10:36:08.998936+0000","last_undegraded":"2024-04-18T10:36:08.998936+0000","last_fullsized":"2024-04-18T10:36:08.998936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027946+0000","last_change":"2024-04-18T10:36:09.022846+0000","last_active":"2024-04-18T10:36:09.027946+0000","last_peered":"2024-04-18T10:36:09.027946+0000","last_clean":"2024-04-18T10:36:09.027946+0000","last_became_active":"2024-04-18T10:36:09.019048+0000","last_became_peered":"2024-04-18T10:36:09.019048+0000","last_unstale":"2024-04-18T10:36:09.027946+0000","last_undegraded":"2024-04-18T10:36:09.027946+0000","last_fullsized":"2024-04-18T10:36:09.027946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009476+0000","last_change":"2024-04-18T10:36:08.715657+0000","last_active":"2024-04-18T10:36:11.009476+0000","last_peered":"2024-04-18T10:36:11.009476+0000","last_clean":"2024-04-18T10:36:11.009476+0000","last_became_active":"2024-04-18T10:36:08.715283+0000","last_became_peered":"2024-04-18T10:36:08.715283+0000","last_unstale":"2024-04-18T10:36:11.009476+0000","last_undegraded":"2024-04-18T10:36:11.009476+0000","last_fullsized":"2024-04-18T10:36:11.009476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.009252+0000","last_change":"2024-04-18T10:36:09.006046+0000","last_active":"2024-04-18T10:36:09.009252+0000","last_peered":"2024-04-18T10:36:09.009252+0000","last_clean":"2024-04-18T10:36:09.009252+0000","last_became_active":"2024-04-18T10:36:09.005726+0000","last_became_peered":"2024-04-18T10:36:09.005726+0000","last_unstale":"2024-04-18T10:36:09.009252+0000","last_undegraded":"2024-04-18T10:36:09.009252+0000","last_fullsized":"2024-04-18T10:36:09.009252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.998470+0000","last_change":"2024-04-18T10:36:08.710590+0000","last_active":"2024-04-18T10:36:09.998470+0000","last_peered":"2024-04-18T10:36:09.998470+0000","last_clean":"2024-04-18T10:36:09.998470+0000","last_became_active":"2024-04-18T10:36:08.710198+0000","last_became_peered":"2024-04-18T10:36:08.710198+0000","last_unstale":"2024-04-18T10:36:09.998470+0000","last_undegraded":"2024-04-18T10:36:09.998470+0000","last_fullsized":"2024-04-18T10:36:09.998470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048407+0000","last_change":"2024-04-18T10:36:09.045249+0000","last_active":"2024-04-18T10:36:09.048407+0000","last_peered":"2024-04-18T10:36:09.048407+0000","last_clean":"2024-04-18T10:36:09.048407+0000","last_became_active":"2024-04-18T10:36:09.044573+0000","last_became_peered":"2024-04-18T10:36:09.044573+0000","last_unstale":"2024-04-18T10:36:09.048407+0000","last_undegraded":"2024-04-18T10:36:09.048407+0000","last_fullsized":"2024-04-18T10:36:09.048407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012927+0000","last_change":"2024-04-18T10:36:08.709580+0000","last_active":"2024-04-18T10:36:11.012927+0000","last_peered":"2024-04-18T10:36:11.012927+0000","last_clean":"2024-04-18T10:36:11.012927+0000","last_became_active":"2024-04-18T10:36:08.709283+0000","last_became_peered":"2024-04-18T10:36:08.709283+0000","last_unstale":"2024-04-18T10:36:11.012927+0000","last_undegraded":"2024-04-18T10:36:11.012927+0000","last_fullsized":"2024-04-18T10:36:11.012927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.030365+0000","last_change":"2024-04-18T10:36:09.027970+0000","last_active":"2024-04-18T10:36:09.030365+0000","last_peered":"2024-04-18T10:36:09.030365+0000","last_clean":"2024-04-18T10:36:09.030365+0000","last_became_active":"2024-04-18T10:36:09.027650+0000","last_became_peered":"2024-04-18T10:36:09.027650+0000","last_unstale":"2024-04-18T10:36:09.030365+0000","last_undegraded":"2024-04-18T10:36:09.030365+0000","last_fullsized":"2024-04-18T10:36:09.030365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012959+0000","last_change":"2024-04-18T10:36:08.710914+0000","last_active":"2024-04-18T10:36:11.012959+0000","last_peered":"2024-04-18T10:36:11.012959+0000","last_clean":"2024-04-18T10:36:11.012959+0000","last_became_active":"2024-04-18T10:36:08.710619+0000","last_became_peered":"2024-04-18T10:36:08.710619+0000","last_unstale":"2024-04-18T10:36:11.012959+0000","last_undegraded":"2024-04-18T10:36:11.012959+0000","last_fullsized":"2024-04-18T10:36:11.012959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040449+0000","last_change":"2024-04-18T10:36:09.037889+0000","last_active":"2024-04-18T10:36:09.040449+0000","last_peered":"2024-04-18T10:36:09.040449+0000","last_clean":"2024-04-18T10:36:09.040449+0000","last_became_active":"2024-04-18T10:36:09.037533+0000","last_became_peered":"2024-04-18T10:36:09.037533+0000","last_unstale":"2024-04-18T10:36:09.040449+0000","last_undegraded":"2024-04-18T10:36:09.040449+0000","last_fullsized":"2024-04-18T10:36:09.040449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.009182+0000","last_change":"2024-04-18T10:36:00.530860+0000","last_active":"2024-04-18T10:36:09.009182+0000","last_peered":"2024-04-18T10:36:09.009182+0000","last_clean":"2024-04-18T10:36:09.009182+0000","last_became_active":"2024-04-18T10:36:00.530496+0000","last_became_peered":"2024-04-18T10:36:00.530496+0000","last_unstale":"2024-04-18T10:36:09.009182+0000","last_undegraded":"2024-04-18T10:36:09.009182+0000","last_fullsized":"2024-04-18T10:36:09.009182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.999498+0000","last_change":"2024-04-18T10:36:08.703862+0000","last_active":"2024-04-18T10:36:09.999498+0000","last_peered":"2024-04-18T10:36:09.999498+0000","last_clean":"2024-04-18T10:36:09.999498+0000","last_became_active":"2024-04-18T10:36:08.703311+0000","last_became_peered":"2024-04-18T10:36:08.703311+0000","last_unstale":"2024-04-18T10:36:09.999498+0000","last_undegraded":"2024-04-18T10:36:09.999498+0000","last_fullsized":"2024-04-18T10:36:09.999498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016742+0000","last_change":"2024-04-18T10:36:09.014696+0000","last_active":"2024-04-18T10:36:09.016742+0000","last_peered":"2024-04-18T10:36:09.016742+0000","last_clean":"2024-04-18T10:36:09.016742+0000","last_became_active":"2024-04-18T10:36:09.014208+0000","last_became_peered":"2024-04-18T10:36:09.014208+0000","last_unstale":"2024-04-18T10:36:09.016742+0000","last_undegraded":"2024-04-18T10:36:09.016742+0000","last_fullsized":"2024-04-18T10:36:09.016742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017998+0000","last_change":"2024-04-18T10:36:00.529282+0000","last_active":"2024-04-18T10:36:09.017998+0000","last_peered":"2024-04-18T10:36:09.017998+0000","last_clean":"2024-04-18T10:36:09.017998+0000","last_became_active":"2024-04-18T10:36:00.528895+0000","last_became_peered":"2024-04-18T10:36:00.528895+0000","last_unstale":"2024-04-18T10:36:09.017998+0000","last_undegraded":"2024-04-18T10:36:09.017998+0000","last_fullsized":"2024-04-18T10:36:09.017998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009897+0000","last_change":"2024-04-18T10:36:08.694077+0000","last_active":"2024-04-18T10:36:11.009897+0000","last_peered":"2024-04-18T10:36:11.009897+0000","last_clean":"2024-04-18T10:36:11.009897+0000","last_became_active":"2024-04-18T10:36:08.693727+0000","last_became_peered":"2024-04-18T10:36:08.693727+0000","last_unstale":"2024-04-18T10:36:11.009897+0000","last_undegraded":"2024-04-18T10:36:11.009897+0000","last_fullsized":"2024-04-18T10:36:11.009897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023410+0000","last_change":"2024-04-18T10:36:09.017243+0000","last_active":"2024-04-18T10:36:09.023410+0000","last_peered":"2024-04-18T10:36:09.023410+0000","last_clean":"2024-04-18T10:36:09.023410+0000","last_became_active":"2024-04-18T10:36:09.016843+0000","last_became_peered":"2024-04-18T10:36:09.016843+0000","last_unstale":"2024-04-18T10:36:09.023410+0000","last_undegraded":"2024-04-18T10:36:09.023410+0000","last_fullsized":"2024-04-18T10:36:09.023410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:08.995885+0000","last_change":"2024-04-18T10:36:00.529420+0000","last_active":"2024-04-18T10:36:08.995885+0000","last_peered":"2024-04-18T10:36:08.995885+0000","last_clean":"2024-04-18T10:36:08.995885+0000","last_became_active":"2024-04-18T10:36:00.529029+0000","last_became_peered":"2024-04-18T10:36:00.529029+0000","last_unstale":"2024-04-18T10:36:08.995885+0000","last_undegraded":"2024-04-18T10:36:08.995885+0000","last_fullsized":"2024-04-18T10:36:08.995885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:10.642771+0000","last_change":"2024-04-18T10:36:08.697102+0000","last_active":"2024-04-18T10:36:10.642771+0000","last_peered":"2024-04-18T10:36:10.642771+0000","last_clean":"2024-04-18T10:36:10.642771+0000","last_became_active":"2024-04-18T10:36:08.696687+0000","last_became_peered":"2024-04-18T10:36:08.696687+0000","last_unstale":"2024-04-18T10:36:10.642771+0000","last_undegraded":"2024-04-18T10:36:10.642771+0000","last_fullsized":"2024-04-18T10:36:10.642771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.037303+0000","last_change":"2024-04-18T10:36:09.031490+0000","last_active":"2024-04-18T10:36:09.037303+0000","last_peered":"2024-04-18T10:36:09.037303+0000","last_clean":"2024-04-18T10:36:09.037303+0000","last_became_active":"2024-04-18T10:36:09.030866+0000","last_became_peered":"2024-04-18T10:36:09.030866+0000","last_unstale":"2024-04-18T10:36:09.037303+0000","last_undegraded":"2024-04-18T10:36:09.037303+0000","last_fullsized":"2024-04-18T10:36:09.037303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.019884+0000","last_change":"2024-04-18T10:36:00.530056+0000","last_active":"2024-04-18T10:36:09.019884+0000","last_peered":"2024-04-18T10:36:09.019884+0000","last_clean":"2024-04-18T10:36:09.019884+0000","last_became_active":"2024-04-18T10:36:00.529546+0000","last_became_peered":"2024-04-18T10:36:00.529546+0000","last_unstale":"2024-04-18T10:36:09.019884+0000","last_undegraded":"2024-04-18T10:36:09.019884+0000","last_fullsized":"2024-04-18T10:36:09.019884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.010534+0000","last_change":"2024-04-18T10:35:56.421744+0000","last_active":"2024-04-18T10:36:09.010534+0000","last_peered":"2024-04-18T10:36:09.010534+0000","last_clean":"2024-04-18T10:36:09.010534+0000","last_became_active":"2024-04-18T10:35:56.421316+0000","last_became_peered":"2024-04-18T10:35:56.421316+0000","last_unstale":"2024-04-18T10:36:09.010534+0000","last_undegraded":"2024-04-18T10:36:09.010534+0000","last_fullsized":"2024-04-18T10:36:09.010534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017702+0000","last_change":"2024-04-18T10:36:08.711994+0000","last_active":"2024-04-18T10:36:09.017702+0000","last_peered":"2024-04-18T10:36:09.017702+0000","last_clean":"2024-04-18T10:36:09.017702+0000","last_became_active":"2024-04-18T10:36:08.711652+0000","last_became_peered":"2024-04-18T10:36:08.711652+0000","last_unstale":"2024-04-18T10:36:09.017702+0000","last_undegraded":"2024-04-18T10:36:09.017702+0000","last_fullsized":"2024-04-18T10:36:09.017702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048433+0000","last_change":"2024-04-18T10:36:09.045388+0000","last_active":"2024-04-18T10:36:09.048433+0000","last_peered":"2024-04-18T10:36:09.048433+0000","last_clean":"2024-04-18T10:36:09.048433+0000","last_became_active":"2024-04-18T10:36:09.044909+0000","last_became_peered":"2024-04-18T10:36:09.044909+0000","last_unstale":"2024-04-18T10:36:09.048433+0000","last_undegraded":"2024-04-18T10:36:09.048433+0000","last_fullsized":"2024-04-18T10:36:09.048433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.015086+0000","last_change":"2024-04-18T10:36:00.529398+0000","last_active":"2024-04-18T10:36:09.015086+0000","last_peered":"2024-04-18T10:36:09.015086+0000","last_clean":"2024-04-18T10:36:09.015086+0000","last_became_active":"2024-04-18T10:36:00.528912+0000","last_became_peered":"2024-04-18T10:36:00.528912+0000","last_unstale":"2024-04-18T10:36:09.015086+0000","last_undegraded":"2024-04-18T10:36:09.015086+0000","last_fullsized":"2024-04-18T10:36:09.015086+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.998962+0000","last_change":"2024-04-18T10:36:08.692668+0000","last_active":"2024-04-18T10:36:09.998962+0000","last_peered":"2024-04-18T10:36:09.998962+0000","last_clean":"2024-04-18T10:36:09.998962+0000","last_became_active":"2024-04-18T10:36:08.692317+0000","last_became_peered":"2024-04-18T10:36:08.692317+0000","last_unstale":"2024-04-18T10:36:09.998962+0000","last_undegraded":"2024-04-18T10:36:09.998962+0000","last_fullsized":"2024-04-18T10:36:09.998962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028580+0000","last_change":"2024-04-18T10:36:09.019756+0000","last_active":"2024-04-18T10:36:09.028580+0000","last_peered":"2024-04-18T10:36:09.028580+0000","last_clean":"2024-04-18T10:36:09.028580+0000","last_became_active":"2024-04-18T10:36:09.019251+0000","last_became_peered":"2024-04-18T10:36:09.019251+0000","last_unstale":"2024-04-18T10:36:09.028580+0000","last_undegraded":"2024-04-18T10:36:09.028580+0000","last_fullsized":"2024-04-18T10:36:09.028580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.025577+0000","last_change":"2024-04-18T10:36:00.527346+0000","last_active":"2024-04-18T10:36:09.025577+0000","last_peered":"2024-04-18T10:36:09.025577+0000","last_clean":"2024-04-18T10:36:09.025577+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:09.025577+0000","last_undegraded":"2024-04-18T10:36:09.025577+0000","last_fullsized":"2024-04-18T10:36:09.025577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.008891+0000","last_change":"2024-04-18T10:36:08.700410+0000","last_active":"2024-04-18T10:36:09.008891+0000","last_peered":"2024-04-18T10:36:09.008891+0000","last_clean":"2024-04-18T10:36:09.008891+0000","last_became_active":"2024-04-18T10:36:08.700048+0000","last_became_peered":"2024-04-18T10:36:08.700048+0000","last_unstale":"2024-04-18T10:36:09.008891+0000","last_undegraded":"2024-04-18T10:36:09.008891+0000","last_fullsized":"2024-04-18T10:36:09.008891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021403+0000","last_change":"2024-04-18T10:36:09.018239+0000","last_active":"2024-04-18T10:36:09.021403+0000","last_peered":"2024-04-18T10:36:09.021403+0000","last_clean":"2024-04-18T10:36:09.021403+0000","last_became_active":"2024-04-18T10:36:09.010612+0000","last_became_peered":"2024-04-18T10:36:09.010612+0000","last_unstale":"2024-04-18T10:36:09.021403+0000","last_undegraded":"2024-04-18T10:36:09.021403+0000","last_fullsized":"2024-04-18T10:36:09.021403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009918+0000","last_change":"2024-04-18T10:36:08.710579+0000","last_active":"2024-04-18T10:36:11.009918+0000","last_peered":"2024-04-18T10:36:11.009918+0000","last_clean":"2024-04-18T10:36:11.009918+0000","last_became_active":"2024-04-18T10:36:08.710165+0000","last_became_peered":"2024-04-18T10:36:08.710165+0000","last_unstale":"2024-04-18T10:36:11.009918+0000","last_undegraded":"2024-04-18T10:36:11.009918+0000","last_fullsized":"2024-04-18T10:36:11.009918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.011413+0000","last_change":"2024-04-18T10:36:00.529862+0000","last_active":"2024-04-18T10:36:09.011413+0000","last_peered":"2024-04-18T10:36:09.011413+0000","last_clean":"2024-04-18T10:36:09.011413+0000","last_became_active":"2024-04-18T10:36:00.529451+0000","last_became_peered":"2024-04-18T10:36:00.529451+0000","last_unstale":"2024-04-18T10:36:09.011413+0000","last_undegraded":"2024-04-18T10:36:09.011413+0000","last_fullsized":"2024-04-18T10:36:09.011413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048393+0000","last_change":"2024-04-18T10:36:09.043858+0000","last_active":"2024-04-18T10:36:09.048393+0000","last_peered":"2024-04-18T10:36:09.048393+0000","last_clean":"2024-04-18T10:36:09.048393+0000","last_became_active":"2024-04-18T10:36:09.042887+0000","last_became_peered":"2024-04-18T10:36:09.042887+0000","last_unstale":"2024-04-18T10:36:09.048393+0000","last_undegraded":"2024-04-18T10:36:09.048393+0000","last_fullsized":"2024-04-18T10:36:09.048393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023855+0000","last_change":"2024-04-18T10:36:00.527385+0000","last_active":"2024-04-18T10:36:09.023855+0000","last_peered":"2024-04-18T10:36:09.023855+0000","last_clean":"2024-04-18T10:36:09.023855+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:09.023855+0000","last_undegraded":"2024-04-18T10:36:09.023855+0000","last_fullsized":"2024-04-18T10:36:09.023855+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.999485+0000","last_change":"2024-04-18T10:36:08.703568+0000","last_active":"2024-04-18T10:36:09.999485+0000","last_peered":"2024-04-18T10:36:09.999485+0000","last_clean":"2024-04-18T10:36:09.999485+0000","last_became_active":"2024-04-18T10:36:08.702770+0000","last_became_peered":"2024-04-18T10:36:08.702770+0000","last_unstale":"2024-04-18T10:36:09.999485+0000","last_undegraded":"2024-04-18T10:36:09.999485+0000","last_fullsized":"2024-04-18T10:36:09.999485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.013798+0000","last_change":"2024-04-18T10:36:09.005270+0000","last_active":"2024-04-18T10:36:09.013798+0000","last_peered":"2024-04-18T10:36:09.013798+0000","last_clean":"2024-04-18T10:36:09.013798+0000","last_became_active":"2024-04-18T10:36:09.004929+0000","last_became_peered":"2024-04-18T10:36:09.004929+0000","last_unstale":"2024-04-18T10:36:09.013798+0000","last_undegraded":"2024-04-18T10:36:09.013798+0000","last_fullsized":"2024-04-18T10:36:09.013798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'5","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.013436+0000","last_change":"2024-04-18T10:36:08.698046+0000","last_active":"2024-04-18T10:36:11.013436+0000","last_peered":"2024-04-18T10:36:11.013436+0000","last_clean":"2024-04-18T10:36:11.013436+0000","last_became_active":"2024-04-18T10:36:08.697438+0000","last_became_peered":"2024-04-18T10:36:08.697438+0000","last_unstale":"2024-04-18T10:36:11.013436+0000","last_undegraded":"2024-04-18T10:36:11.013436+0000","last_fullsized":"2024-04-18T10:36:11.013436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021707+0000","last_change":"2024-04-18T10:36:09.016654+0000","last_active":"2024-04-18T10:36:09.021707+0000","last_peered":"2024-04-18T10:36:09.021707+0000","last_clean":"2024-04-18T10:36:09.021707+0000","last_became_active":"2024-04-18T10:36:09.016342+0000","last_became_peered":"2024-04-18T10:36:09.016342+0000","last_unstale":"2024-04-18T10:36:09.021707+0000","last_undegraded":"2024-04-18T10:36:09.021707+0000","last_fullsized":"2024-04-18T10:36:09.021707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.033999+0000","last_change":"2024-04-18T10:36:08.700728+0000","last_active":"2024-04-18T10:36:09.033999+0000","last_peered":"2024-04-18T10:36:09.033999+0000","last_clean":"2024-04-18T10:36:09.033999+0000","last_became_active":"2024-04-18T10:36:08.699603+0000","last_became_peered":"2024-04-18T10:36:08.699603+0000","last_unstale":"2024-04-18T10:36:09.033999+0000","last_undegraded":"2024-04-18T10:36:09.033999+0000","last_fullsized":"2024-04-18T10:36:09.033999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.026432+0000","last_change":"2024-04-18T10:36:09.021888+0000","last_active":"2024-04-18T10:36:09.026432+0000","last_peered":"2024-04-18T10:36:09.026432+0000","last_clean":"2024-04-18T10:36:09.026432+0000","last_became_active":"2024-04-18T10:36:09.018363+0000","last_became_peered":"2024-04-18T10:36:09.018363+0000","last_unstale":"2024-04-18T10:36:09.026432+0000","last_undegraded":"2024-04-18T10:36:09.026432+0000","last_fullsized":"2024-04-18T10:36:09.026432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043521+0000","last_change":"2024-04-18T10:36:08.714829+0000","last_active":"2024-04-18T10:36:09.043521+0000","last_peered":"2024-04-18T10:36:09.043521+0000","last_clean":"2024-04-18T10:36:09.043521+0000","last_became_active":"2024-04-18T10:36:08.714528+0000","last_became_peered":"2024-04-18T10:36:08.714528+0000","last_unstale":"2024-04-18T10:36:09.043521+0000","last_undegraded":"2024-04-18T10:36:09.043521+0000","last_fullsized":"2024-04-18T10:36:09.043521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.026421+0000","last_change":"2024-04-18T10:36:09.022031+0000","last_active":"2024-04-18T10:36:09.026421+0000","last_peered":"2024-04-18T10:36:09.026421+0000","last_clean":"2024-04-18T10:36:09.026421+0000","last_became_active":"2024-04-18T10:36:09.018240+0000","last_became_peered":"2024-04-18T10:36:09.018240+0000","last_unstale":"2024-04-18T10:36:09.026421+0000","last_undegraded":"2024-04-18T10:36:09.026421+0000","last_fullsized":"2024-04-18T10:36:09.026421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.041222+0000","last_change":"2024-04-18T10:36:08.712223+0000","last_active":"2024-04-18T10:36:09.041222+0000","last_peered":"2024-04-18T10:36:09.041222+0000","last_clean":"2024-04-18T10:36:09.041222+0000","last_became_active":"2024-04-18T10:36:08.711192+0000","last_became_peered":"2024-04-18T10:36:08.711192+0000","last_unstale":"2024-04-18T10:36:09.041222+0000","last_undegraded":"2024-04-18T10:36:09.041222+0000","last_fullsized":"2024-04-18T10:36:09.041222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043087+0000","last_change":"2024-04-18T10:36:09.030946+0000","last_active":"2024-04-18T10:36:09.043087+0000","last_peered":"2024-04-18T10:36:09.043087+0000","last_clean":"2024-04-18T10:36:09.043087+0000","last_became_active":"2024-04-18T10:36:09.030646+0000","last_became_peered":"2024-04-18T10:36:09.030646+0000","last_unstale":"2024-04-18T10:36:09.043087+0000","last_undegraded":"2024-04-18T10:36:09.043087+0000","last_fullsized":"2024-04-18T10:36:09.043087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.022671+0000","last_change":"2024-04-18T10:36:08.706957+0000","last_active":"2024-04-18T10:36:09.022671+0000","last_peered":"2024-04-18T10:36:09.022671+0000","last_clean":"2024-04-18T10:36:09.022671+0000","last_became_active":"2024-04-18T10:36:08.706598+0000","last_became_peered":"2024-04-18T10:36:08.706598+0000","last_unstale":"2024-04-18T10:36:09.022671+0000","last_undegraded":"2024-04-18T10:36:09.022671+0000","last_fullsized":"2024-04-18T10:36:09.022671+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023061+0000","last_change":"2024-04-18T10:36:09.017279+0000","last_active":"2024-04-18T10:36:09.023061+0000","last_peered":"2024-04-18T10:36:09.023061+0000","last_clean":"2024-04-18T10:36:09.023061+0000","last_became_active":"2024-04-18T10:36:09.016931+0000","last_became_peered":"2024-04-18T10:36:09.016931+0000","last_unstale":"2024-04-18T10:36:09.023061+0000","last_undegraded":"2024-04-18T10:36:09.023061+0000","last_fullsized":"2024-04-18T10:36:09.023061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.035473+0000","last_change":"2024-04-18T10:36:09.032926+0000","last_active":"2024-04-18T10:36:09.035473+0000","last_peered":"2024-04-18T10:36:09.035473+0000","last_clean":"2024-04-18T10:36:09.035473+0000","last_became_active":"2024-04-18T10:36:09.032571+0000","last_became_peered":"2024-04-18T10:36:09.032571+0000","last_unstale":"2024-04-18T10:36:09.035473+0000","last_undegraded":"2024-04-18T10:36:09.035473+0000","last_fullsized":"2024-04-18T10:36:09.035473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044024+0000","last_change":"2024-04-18T10:36:09.042985+0000","last_active":"2024-04-18T10:36:09.044024+0000","last_peered":"2024-04-18T10:36:09.044024+0000","last_clean":"2024-04-18T10:36:09.044024+0000","last_became_active":"2024-04-18T10:36:09.039602+0000","last_became_peered":"2024-04-18T10:36:09.039602+0000","last_unstale":"2024-04-18T10:36:09.044024+0000","last_undegraded":"2024-04-18T10:36:09.044024+0000","last_fullsized":"2024-04-18T10:36:09.044024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.036316+0000","last_change":"2024-04-18T10:36:09.028593+0000","last_active":"2024-04-18T10:36:09.036316+0000","last_peered":"2024-04-18T10:36:09.036316+0000","last_clean":"2024-04-18T10:36:09.036316+0000","last_became_active":"2024-04-18T10:36:09.028237+0000","last_became_peered":"2024-04-18T10:36:09.028237+0000","last_unstale":"2024-04-18T10:36:09.036316+0000","last_undegraded":"2024-04-18T10:36:09.036316+0000","last_fullsized":"2024-04-18T10:36:09.036316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045647+0000","last_change":"2024-04-18T10:36:09.043613+0000","last_active":"2024-04-18T10:36:09.045647+0000","last_peered":"2024-04-18T10:36:09.045647+0000","last_clean":"2024-04-18T10:36:09.045647+0000","last_became_active":"2024-04-18T10:36:09.042942+0000","last_became_peered":"2024-04-18T10:36:09.042942+0000","last_unstale":"2024-04-18T10:36:09.045647+0000","last_undegraded":"2024-04-18T10:36:09.045647+0000","last_fullsized":"2024-04-18T10:36:09.045647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023383+0000","last_change":"2024-04-18T10:36:09.017151+0000","last_active":"2024-04-18T10:36:09.023383+0000","last_peered":"2024-04-18T10:36:09.023383+0000","last_clean":"2024-04-18T10:36:09.023383+0000","last_became_active":"2024-04-18T10:36:09.016454+0000","last_became_peered":"2024-04-18T10:36:09.016454+0000","last_unstale":"2024-04-18T10:36:09.023383+0000","last_undegraded":"2024-04-18T10:36:09.023383+0000","last_fullsized":"2024-04-18T10:36:09.023383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":55679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]}]},{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":54268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]}]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":54537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1369999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]}]},{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":53266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]}]}]}} 2024-04-18T10:36:20.132 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:36:20.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.274+0000 7f84d4589700 1 Processor -- start 2024-04-18T10:36:20.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.274+0000 7f84d4589700 1 -- start start 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d4589700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc064600 0x7f84cc133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d4589700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f84cc063680 0x7f84cc13d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d4589700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84cc061ee0 con 0x7f84cc062fb0 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d4589700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84cc065150 con 0x7f84cc063680 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d4589700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc130bd0 con 0x7f84cc064600 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2b26700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f84cc063680 0x7f84cc13d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2325700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc064600 0x7f84cc133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2b26700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f84cc063680 0x7f84cc13d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53782/0 (socket says 172.21.15.31:53782) 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d1b24700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f84cc062fb0 0x7f84cc0a92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45540/0 (socket says 172.21.15.31:45540) 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2b26700 1 -- 172.21.15.31:0/2067775308 learned_addr learned my addr 172.21.15.31:0/2067775308 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2b26700 1 -- 172.21.15.31:0/2067775308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc064600 msgr2=0x7f84cc133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2b26700 1 --2- 172.21.15.31:0/2067775308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc064600 0x7f84cc133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2b26700 1 -- 172.21.15.31:0/2067775308 >> v1:172.21.15.31:6789/0 conn(0x7f84cc062fb0 legacy=0x7f84cc0a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2b26700 1 -- 172.21.15.31:0/2067775308 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc0a9db0 con 0x7f84cc063680 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d1323700 1 -- 172.21.15.31:0/2067775308 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151821515 0 0) 0x7f84cc061ee0 con 0x7f84cc062fb0 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2325700 1 --2- 172.21.15.31:0/2067775308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc064600 0x7f84cc133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d2b26700 1 --2- 172.21.15.31:0/2067775308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84cc063680 0x7f84cc13d930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f84cc0a9c50 tx=0x7f84c4009290).ready entity=mon.0 client_cookie=699cdaca4b4e50f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d1323700 1 -- 172.21.15.31:0/2067775308 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84c400b860 con 0x7f84cc063680 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d1323700 1 -- 172.21.15.31:0/2067775308 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c400b9c0 con 0x7f84cc063680 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.275+0000 7f84d1323700 1 -- 172.21.15.31:0/2067775308 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84c400bb30 con 0x7f84cc063680 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.276+0000 7f84d4589700 1 -- 172.21.15.31:0/2067775308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84cc063680 msgr2=0x7f84cc13d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.276+0000 7f84d4589700 1 --2- 172.21.15.31:0/2067775308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84cc063680 0x7f84cc13d930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f84cc0a9c50 tx=0x7f84c4009290).stop 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.276+0000 7f84d4589700 1 -- 172.21.15.31:0/2067775308 shutdown_connections 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.276+0000 7f84d4589700 1 --2- 172.21.15.31:0/2067775308 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84cc063680 0x7f84cc13d930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.276+0000 7f84d4589700 1 --2- 172.21.15.31:0/2067775308 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc064600 0x7f84cc133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.276+0000 7f84d4589700 1 -- 172.21.15.31:0/2067775308 >> 172.21.15.31:0/2067775308 conn(0x7f84cc06c0c0 msgr2=0x7f84cc06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:20.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.276+0000 7f84d4589700 1 -- 172.21.15.31:0/2067775308 shutdown_connections 2024-04-18T10:36:20.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.276+0000 7f84d4589700 1 -- 172.21.15.31:0/2067775308 wait complete. 2024-04-18T10:36:20.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.277+0000 7f84d4589700 1 Processor -- start 2024-04-18T10:36:20.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.277+0000 7f84d4589700 1 -- start start 2024-04-18T10:36:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.277+0000 7f84d4589700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84cc063680 0x7f84cc067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.277+0000 7f84d4589700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84cc064600 0x7f84cc066530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.277+0000 7f84d4589700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc148c90 0x7f84cc149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.277+0000 7f84d4589700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0672b0 con 0x7f84cc063680 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.277+0000 7f84d4589700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0656b0 con 0x7f84cc148c90 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.277+0000 7f84d4589700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc065970 con 0x7f84cc064600 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2b26700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc148c90 0x7f84cc149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d1b24700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84cc064600 0x7f84cc066530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2325700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84cc063680 0x7f84cc067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2b26700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc148c90 0x7f84cc149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54926/0 (socket says 172.21.15.31:54926) 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2b26700 1 -- 172.21.15.31:0/680888522 learned_addr learned my addr 172.21.15.31:0/680888522 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2b26700 1 -- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84cc064600 msgr2=0x7f84cc066530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2b26700 1 --2- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84cc064600 0x7f84cc066530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2b26700 1 -- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84cc063680 msgr2=0x7f84cc067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2b26700 1 --2- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84cc063680 0x7f84cc067b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2b26700 1 -- 172.21.15.31:0/680888522 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c800d410 con 0x7f84cc148c90 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d2b26700 1 --2- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc148c90 0x7f84cc149140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f84cc0a9c50 tx=0x7f84c4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84bb7fe700 1 -- 172.21.15.31:0/680888522 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84c4021670 con 0x7f84cc148c90 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84bb7fe700 1 -- 172.21.15.31:0/680888522 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c40217d0 con 0x7f84cc148c90 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c4009530 con 0x7f84cc148c90 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84bb7fe700 1 -- 172.21.15.31:0/680888522 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84c4021b30 con 0x7f84cc148c90 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.278+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84cc065290 con 0x7f84cc148c90 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.279+0000 7f84bb7fe700 1 -- 172.21.15.31:0/680888522 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f84c4028070 con 0x7f84cc148c90 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.279+0000 7f84bb7fe700 1 -- 172.21.15.31:0/680888522 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f84c404b670 con 0x7f84cc148c90 2024-04-18T10:36:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.279+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84cc067860 con 0x7f84cc148c90 2024-04-18T10:36:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.282+0000 7f84bb7fe700 1 -- 172.21.15.31:0/680888522 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f84c40497c0 con 0x7f84cc148c90 2024-04-18T10:36:20.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.394+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 --> v1:172.21.15.31:6816/39551 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84cc133980 con 0x7f84ac038ec0 2024-04-18T10:36:20.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.401+0000 7f84bb7fe700 1 -- 172.21.15.31:0/680888522 <== mgr.4101 v1:172.21.15.31:6816/39551 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246931 (unknown 2965378022 0 1628694243) 0x7f84cc133980 con 0x7f84ac038ec0 2024-04-18T10:36:20.404 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 >> v1:172.21.15.31:6816/39551 conn(0x7f84ac038ec0 legacy=0x7f84ac03b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc148c90 msgr2=0x7f84cc149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 --2- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc148c90 0x7f84cc149140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f84cc0a9c50 tx=0x7f84c4016000).stop 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 shutdown_connections 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 --2- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f84cc148c90 0x7f84cc149140 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 --2- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84cc063680 0x7f84cc067b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 --2- 172.21.15.31:0/680888522 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f84cc064600 0x7f84cc066530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 >> 172.21.15.31:0/680888522 conn(0x7f84cc06c0c0 msgr2=0x7f84cc09ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 shutdown_connections 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.403+0000 7f84d4589700 1 -- 172.21.15.31:0/680888522 wait complete. 2024-04-18T10:36:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:36:20.414 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-18T10:36:19.389665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195088,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292272,"statfs":{"total":386547056640,"available":382251286528,"internally_reserved":4294967296,"allocated":770048,"data_stored":217750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002006"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038116+0000","last_change":"2024-04-18T10:36:09.029464+0000","last_active":"2024-04-18T10:36:09.038116+0000","last_peered":"2024-04-18T10:36:09.038116+0000","last_clean":"2024-04-18T10:36:09.038116+0000","last_became_active":"2024-04-18T10:36:09.029119+0000","last_became_peered":"2024-04-18T10:36:09.029119+0000","last_unstale":"2024-04-18T10:36:09.038116+0000","last_undegraded":"2024-04-18T10:36:09.038116+0000","last_fullsized":"2024-04-18T10:36:09.038116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021034+0000","last_change":"2024-04-18T10:36:09.016639+0000","last_active":"2024-04-18T10:36:09.021034+0000","last_peered":"2024-04-18T10:36:09.021034+0000","last_clean":"2024-04-18T10:36:09.021034+0000","last_became_active":"2024-04-18T10:36:09.016298+0000","last_became_peered":"2024-04-18T10:36:09.016298+0000","last_unstale":"2024-04-18T10:36:09.021034+0000","last_undegraded":"2024-04-18T10:36:09.021034+0000","last_fullsized":"2024-04-18T10:36:09.021034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.029214+0000","last_change":"2024-04-18T10:36:09.021729+0000","last_active":"2024-04-18T10:36:09.029214+0000","last_peered":"2024-04-18T10:36:09.029214+0000","last_clean":"2024-04-18T10:36:09.029214+0000","last_became_active":"2024-04-18T10:36:09.021089+0000","last_became_peered":"2024-04-18T10:36:09.021089+0000","last_unstale":"2024-04-18T10:36:09.029214+0000","last_undegraded":"2024-04-18T10:36:09.029214+0000","last_fullsized":"2024-04-18T10:36:09.029214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027739+0000","last_change":"2024-04-18T10:36:09.022509+0000","last_active":"2024-04-18T10:36:09.027739+0000","last_peered":"2024-04-18T10:36:09.027739+0000","last_clean":"2024-04-18T10:36:09.027739+0000","last_became_active":"2024-04-18T10:36:09.019360+0000","last_became_peered":"2024-04-18T10:36:09.019360+0000","last_unstale":"2024-04-18T10:36:09.027739+0000","last_undegraded":"2024-04-18T10:36:09.027739+0000","last_fullsized":"2024-04-18T10:36:09.027739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027607+0000","last_change":"2024-04-18T10:36:09.021300+0000","last_active":"2024-04-18T10:36:09.027607+0000","last_peered":"2024-04-18T10:36:09.027607+0000","last_clean":"2024-04-18T10:36:09.027607+0000","last_became_active":"2024-04-18T10:36:09.018608+0000","last_became_peered":"2024-04-18T10:36:09.018608+0000","last_unstale":"2024-04-18T10:36:09.027607+0000","last_undegraded":"2024-04-18T10:36:09.027607+0000","last_fullsized":"2024-04-18T10:36:09.027607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043852+0000","last_change":"2024-04-18T10:36:09.041400+0000","last_active":"2024-04-18T10:36:09.043852+0000","last_peered":"2024-04-18T10:36:09.043852+0000","last_clean":"2024-04-18T10:36:09.043852+0000","last_became_active":"2024-04-18T10:36:09.038827+0000","last_became_peered":"2024-04-18T10:36:09.038827+0000","last_unstale":"2024-04-18T10:36:09.043852+0000","last_undegraded":"2024-04-18T10:36:09.043852+0000","last_fullsized":"2024-04-18T10:36:09.043852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043983+0000","last_change":"2024-04-18T10:36:09.042033+0000","last_active":"2024-04-18T10:36:09.043983+0000","last_peered":"2024-04-18T10:36:09.043983+0000","last_clean":"2024-04-18T10:36:09.043983+0000","last_became_active":"2024-04-18T10:36:09.039118+0000","last_became_peered":"2024-04-18T10:36:09.039118+0000","last_unstale":"2024-04-18T10:36:09.043983+0000","last_undegraded":"2024-04-18T10:36:09.043983+0000","last_fullsized":"2024-04-18T10:36:09.043983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.035450+0000","last_change":"2024-04-18T10:36:09.032927+0000","last_active":"2024-04-18T10:36:09.035450+0000","last_peered":"2024-04-18T10:36:09.035450+0000","last_clean":"2024-04-18T10:36:09.035450+0000","last_became_active":"2024-04-18T10:36:09.032162+0000","last_became_peered":"2024-04-18T10:36:09.032162+0000","last_unstale":"2024-04-18T10:36:09.035450+0000","last_undegraded":"2024-04-18T10:36:09.035450+0000","last_fullsized":"2024-04-18T10:36:09.035450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028743+0000","last_change":"2024-04-18T10:36:09.022311+0000","last_active":"2024-04-18T10:36:09.028743+0000","last_peered":"2024-04-18T10:36:09.028743+0000","last_clean":"2024-04-18T10:36:09.028743+0000","last_became_active":"2024-04-18T10:36:09.021805+0000","last_became_peered":"2024-04-18T10:36:09.021805+0000","last_unstale":"2024-04-18T10:36:09.028743+0000","last_undegraded":"2024-04-18T10:36:09.028743+0000","last_fullsized":"2024-04-18T10:36:09.028743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038226+0000","last_change":"2024-04-18T10:36:09.034290+0000","last_active":"2024-04-18T10:36:09.038226+0000","last_peered":"2024-04-18T10:36:09.038226+0000","last_clean":"2024-04-18T10:36:09.038226+0000","last_became_active":"2024-04-18T10:36:09.034081+0000","last_became_peered":"2024-04-18T10:36:09.034081+0000","last_unstale":"2024-04-18T10:36:09.038226+0000","last_undegraded":"2024-04-18T10:36:09.038226+0000","last_fullsized":"2024-04-18T10:36:09.038226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023279+0000","last_change":"2024-04-18T10:36:09.016527+0000","last_active":"2024-04-18T10:36:09.023279+0000","last_peered":"2024-04-18T10:36:09.023279+0000","last_clean":"2024-04-18T10:36:09.023279+0000","last_became_active":"2024-04-18T10:36:09.014883+0000","last_became_peered":"2024-04-18T10:36:09.014883+0000","last_unstale":"2024-04-18T10:36:09.023279+0000","last_undegraded":"2024-04-18T10:36:09.023279+0000","last_fullsized":"2024-04-18T10:36:09.023279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.013927+0000","last_change":"2024-04-18T10:36:09.005314+0000","last_active":"2024-04-18T10:36:09.013927+0000","last_peered":"2024-04-18T10:36:09.013927+0000","last_clean":"2024-04-18T10:36:09.013927+0000","last_became_active":"2024-04-18T10:36:09.004979+0000","last_became_peered":"2024-04-18T10:36:09.004979+0000","last_unstale":"2024-04-18T10:36:09.013927+0000","last_undegraded":"2024-04-18T10:36:09.013927+0000","last_fullsized":"2024-04-18T10:36:09.013927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038097+0000","last_change":"2024-04-18T10:36:09.028839+0000","last_active":"2024-04-18T10:36:09.038097+0000","last_peered":"2024-04-18T10:36:09.038097+0000","last_clean":"2024-04-18T10:36:09.038097+0000","last_became_active":"2024-04-18T10:36:09.028502+0000","last_became_peered":"2024-04-18T10:36:09.028502+0000","last_unstale":"2024-04-18T10:36:09.038097+0000","last_undegraded":"2024-04-18T10:36:09.038097+0000","last_fullsized":"2024-04-18T10:36:09.038097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038555+0000","last_change":"2024-04-18T10:36:09.034002+0000","last_active":"2024-04-18T10:36:09.038555+0000","last_peered":"2024-04-18T10:36:09.038555+0000","last_clean":"2024-04-18T10:36:09.038555+0000","last_became_active":"2024-04-18T10:36:09.033512+0000","last_became_peered":"2024-04-18T10:36:09.033512+0000","last_unstale":"2024-04-18T10:36:09.038555+0000","last_undegraded":"2024-04-18T10:36:09.038555+0000","last_fullsized":"2024-04-18T10:36:09.038555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.018733+0000","last_change":"2024-04-18T10:36:09.008596+0000","last_active":"2024-04-18T10:36:09.018733+0000","last_peered":"2024-04-18T10:36:09.018733+0000","last_clean":"2024-04-18T10:36:09.018733+0000","last_became_active":"2024-04-18T10:36:09.008249+0000","last_became_peered":"2024-04-18T10:36:09.008249+0000","last_unstale":"2024-04-18T10:36:09.018733+0000","last_undegraded":"2024-04-18T10:36:09.018733+0000","last_fullsized":"2024-04-18T10:36:09.018733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048341+0000","last_change":"2024-04-18T10:36:09.043650+0000","last_active":"2024-04-18T10:36:09.048341+0000","last_peered":"2024-04-18T10:36:09.048341+0000","last_clean":"2024-04-18T10:36:09.048341+0000","last_became_active":"2024-04-18T10:36:09.039117+0000","last_became_peered":"2024-04-18T10:36:09.039117+0000","last_unstale":"2024-04-18T10:36:09.048341+0000","last_undegraded":"2024-04-18T10:36:09.048341+0000","last_fullsized":"2024-04-18T10:36:09.048341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028720+0000","last_change":"2024-04-18T10:36:09.022106+0000","last_active":"2024-04-18T10:36:09.028720+0000","last_peered":"2024-04-18T10:36:09.028720+0000","last_clean":"2024-04-18T10:36:09.028720+0000","last_became_active":"2024-04-18T10:36:09.021380+0000","last_became_peered":"2024-04-18T10:36:09.021380+0000","last_unstale":"2024-04-18T10:36:09.028720+0000","last_undegraded":"2024-04-18T10:36:09.028720+0000","last_fullsized":"2024-04-18T10:36:09.028720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.018007+0000","last_change":"2024-04-18T10:36:09.007051+0000","last_active":"2024-04-18T10:36:09.018007+0000","last_peered":"2024-04-18T10:36:09.018007+0000","last_clean":"2024-04-18T10:36:09.018007+0000","last_became_active":"2024-04-18T10:36:09.006731+0000","last_became_peered":"2024-04-18T10:36:09.006731+0000","last_unstale":"2024-04-18T10:36:09.018007+0000","last_undegraded":"2024-04-18T10:36:09.018007+0000","last_fullsized":"2024-04-18T10:36:09.018007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.025759+0000","last_change":"2024-04-18T10:36:09.021352+0000","last_active":"2024-04-18T10:36:09.025759+0000","last_peered":"2024-04-18T10:36:09.025759+0000","last_clean":"2024-04-18T10:36:09.025759+0000","last_became_active":"2024-04-18T10:36:09.018400+0000","last_became_peered":"2024-04-18T10:36:09.018400+0000","last_unstale":"2024-04-18T10:36:09.025759+0000","last_undegraded":"2024-04-18T10:36:09.025759+0000","last_fullsized":"2024-04-18T10:36:09.025759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040399+0000","last_change":"2024-04-18T10:36:09.037939+0000","last_active":"2024-04-18T10:36:09.040399+0000","last_peered":"2024-04-18T10:36:09.040399+0000","last_clean":"2024-04-18T10:36:09.040399+0000","last_became_active":"2024-04-18T10:36:09.037611+0000","last_became_peered":"2024-04-18T10:36:09.037611+0000","last_unstale":"2024-04-18T10:36:09.040399+0000","last_undegraded":"2024-04-18T10:36:09.040399+0000","last_fullsized":"2024-04-18T10:36:09.040399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040284+0000","last_change":"2024-04-18T10:36:09.036858+0000","last_active":"2024-04-18T10:36:09.040284+0000","last_peered":"2024-04-18T10:36:09.040284+0000","last_clean":"2024-04-18T10:36:09.040284+0000","last_became_active":"2024-04-18T10:36:09.036508+0000","last_became_peered":"2024-04-18T10:36:09.036508+0000","last_unstale":"2024-04-18T10:36:09.040284+0000","last_undegraded":"2024-04-18T10:36:09.040284+0000","last_fullsized":"2024-04-18T10:36:09.040284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028695+0000","last_change":"2024-04-18T10:36:09.021243+0000","last_active":"2024-04-18T10:36:09.028695+0000","last_peered":"2024-04-18T10:36:09.028695+0000","last_clean":"2024-04-18T10:36:09.028695+0000","last_became_active":"2024-04-18T10:36:09.019277+0000","last_became_peered":"2024-04-18T10:36:09.019277+0000","last_unstale":"2024-04-18T10:36:09.028695+0000","last_undegraded":"2024-04-18T10:36:09.028695+0000","last_fullsized":"2024-04-18T10:36:09.028695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043961+0000","last_change":"2024-04-18T10:36:09.041841+0000","last_active":"2024-04-18T10:36:09.043961+0000","last_peered":"2024-04-18T10:36:09.043961+0000","last_clean":"2024-04-18T10:36:09.043961+0000","last_became_active":"2024-04-18T10:36:09.038958+0000","last_became_peered":"2024-04-18T10:36:09.038958+0000","last_unstale":"2024-04-18T10:36:09.043961+0000","last_undegraded":"2024-04-18T10:36:09.043961+0000","last_fullsized":"2024-04-18T10:36:09.043961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.038748+0000","last_change":"2024-04-18T10:36:09.035656+0000","last_active":"2024-04-18T10:36:09.038748+0000","last_peered":"2024-04-18T10:36:09.038748+0000","last_clean":"2024-04-18T10:36:09.038748+0000","last_became_active":"2024-04-18T10:36:09.035221+0000","last_became_peered":"2024-04-18T10:36:09.035221+0000","last_unstale":"2024-04-18T10:36:09.038748+0000","last_undegraded":"2024-04-18T10:36:09.038748+0000","last_fullsized":"2024-04-18T10:36:09.038748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.037238+0000","last_change":"2024-04-18T10:36:09.031118+0000","last_active":"2024-04-18T10:36:09.037238+0000","last_peered":"2024-04-18T10:36:09.037238+0000","last_clean":"2024-04-18T10:36:09.037238+0000","last_became_active":"2024-04-18T10:36:09.024843+0000","last_became_peered":"2024-04-18T10:36:09.024843+0000","last_unstale":"2024-04-18T10:36:09.037238+0000","last_undegraded":"2024-04-18T10:36:09.037238+0000","last_fullsized":"2024-04-18T10:36:09.037238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.034882+0000","last_change":"2024-04-18T10:36:09.032225+0000","last_active":"2024-04-18T10:36:09.034882+0000","last_peered":"2024-04-18T10:36:09.034882+0000","last_clean":"2024-04-18T10:36:09.034882+0000","last_became_active":"2024-04-18T10:36:09.031895+0000","last_became_peered":"2024-04-18T10:36:09.031895+0000","last_unstale":"2024-04-18T10:36:09.034882+0000","last_undegraded":"2024-04-18T10:36:09.034882+0000","last_fullsized":"2024-04-18T10:36:09.034882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043564+0000","last_change":"2024-04-18T10:36:09.040868+0000","last_active":"2024-04-18T10:36:09.043564+0000","last_peered":"2024-04-18T10:36:09.043564+0000","last_clean":"2024-04-18T10:36:09.043564+0000","last_became_active":"2024-04-18T10:36:09.038946+0000","last_became_peered":"2024-04-18T10:36:09.038946+0000","last_unstale":"2024-04-18T10:36:09.043564+0000","last_undegraded":"2024-04-18T10:36:09.043564+0000","last_fullsized":"2024-04-18T10:36:09.043564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.034159+0000","last_change":"2024-04-18T10:36:08.696988+0000","last_active":"2024-04-18T10:36:09.034159+0000","last_peered":"2024-04-18T10:36:09.034159+0000","last_clean":"2024-04-18T10:36:09.034159+0000","last_became_active":"2024-04-18T10:36:08.696639+0000","last_became_peered":"2024-04-18T10:36:08.696639+0000","last_unstale":"2024-04-18T10:36:09.034159+0000","last_undegraded":"2024-04-18T10:36:09.034159+0000","last_fullsized":"2024-04-18T10:36:09.034159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043580+0000","last_change":"2024-04-18T10:36:09.040997+0000","last_active":"2024-04-18T10:36:09.043580+0000","last_peered":"2024-04-18T10:36:09.043580+0000","last_clean":"2024-04-18T10:36:09.043580+0000","last_became_active":"2024-04-18T10:36:09.039544+0000","last_became_peered":"2024-04-18T10:36:09.039544+0000","last_unstale":"2024-04-18T10:36:09.043580+0000","last_undegraded":"2024-04-18T10:36:09.043580+0000","last_fullsized":"2024-04-18T10:36:09.043580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.002229+0000","last_change":"2024-04-18T10:36:08.706823+0000","last_active":"2024-04-18T10:36:09.002229+0000","last_peered":"2024-04-18T10:36:09.002229+0000","last_clean":"2024-04-18T10:36:09.002229+0000","last_became_active":"2024-04-18T10:36:08.706488+0000","last_became_peered":"2024-04-18T10:36:08.706488+0000","last_unstale":"2024-04-18T10:36:09.002229+0000","last_undegraded":"2024-04-18T10:36:09.002229+0000","last_fullsized":"2024-04-18T10:36:09.002229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028604+0000","last_change":"2024-04-18T10:36:09.020079+0000","last_active":"2024-04-18T10:36:09.028604+0000","last_peered":"2024-04-18T10:36:09.028604+0000","last_clean":"2024-04-18T10:36:09.028604+0000","last_became_active":"2024-04-18T10:36:09.019759+0000","last_became_peered":"2024-04-18T10:36:09.019759+0000","last_unstale":"2024-04-18T10:36:09.028604+0000","last_undegraded":"2024-04-18T10:36:09.028604+0000","last_fullsized":"2024-04-18T10:36:09.028604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.996687+0000","last_change":"2024-04-18T10:36:08.715008+0000","last_active":"2024-04-18T10:36:09.996687+0000","last_peered":"2024-04-18T10:36:09.996687+0000","last_clean":"2024-04-18T10:36:09.996687+0000","last_became_active":"2024-04-18T10:36:08.714642+0000","last_became_peered":"2024-04-18T10:36:08.714642+0000","last_unstale":"2024-04-18T10:36:09.996687+0000","last_undegraded":"2024-04-18T10:36:09.996687+0000","last_fullsized":"2024-04-18T10:36:09.996687+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048447+0000","last_change":"2024-04-18T10:36:09.045728+0000","last_active":"2024-04-18T10:36:09.048447+0000","last_peered":"2024-04-18T10:36:09.048447+0000","last_clean":"2024-04-18T10:36:09.048447+0000","last_became_active":"2024-04-18T10:36:09.045122+0000","last_became_peered":"2024-04-18T10:36:09.045122+0000","last_unstale":"2024-04-18T10:36:09.048447+0000","last_undegraded":"2024-04-18T10:36:09.048447+0000","last_fullsized":"2024-04-18T10:36:09.048447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.013511+0000","last_change":"2024-04-18T10:36:08.706131+0000","last_active":"2024-04-18T10:36:11.013511+0000","last_peered":"2024-04-18T10:36:11.013511+0000","last_clean":"2024-04-18T10:36:11.013511+0000","last_became_active":"2024-04-18T10:36:08.705713+0000","last_became_peered":"2024-04-18T10:36:08.705713+0000","last_unstale":"2024-04-18T10:36:11.013511+0000","last_undegraded":"2024-04-18T10:36:11.013511+0000","last_fullsized":"2024-04-18T10:36:11.013511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048368+0000","last_change":"2024-04-18T10:36:09.043706+0000","last_active":"2024-04-18T10:36:09.048368+0000","last_peered":"2024-04-18T10:36:09.048368+0000","last_clean":"2024-04-18T10:36:09.048368+0000","last_became_active":"2024-04-18T10:36:09.039571+0000","last_became_peered":"2024-04-18T10:36:09.039571+0000","last_unstale":"2024-04-18T10:36:09.048368+0000","last_undegraded":"2024-04-18T10:36:09.048368+0000","last_fullsized":"2024-04-18T10:36:09.048368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.008477+0000","last_change":"2024-04-18T10:36:08.703814+0000","last_active":"2024-04-18T10:36:11.008477+0000","last_peered":"2024-04-18T10:36:11.008477+0000","last_clean":"2024-04-18T10:36:11.008477+0000","last_became_active":"2024-04-18T10:36:08.703206+0000","last_became_peered":"2024-04-18T10:36:08.703206+0000","last_unstale":"2024-04-18T10:36:11.008477+0000","last_undegraded":"2024-04-18T10:36:11.008477+0000","last_fullsized":"2024-04-18T10:36:11.008477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044003+0000","last_change":"2024-04-18T10:36:09.042232+0000","last_active":"2024-04-18T10:36:09.044003+0000","last_peered":"2024-04-18T10:36:09.044003+0000","last_clean":"2024-04-18T10:36:09.044003+0000","last_became_active":"2024-04-18T10:36:09.039432+0000","last_became_peered":"2024-04-18T10:36:09.039432+0000","last_unstale":"2024-04-18T10:36:09.044003+0000","last_undegraded":"2024-04-18T10:36:09.044003+0000","last_fullsized":"2024-04-18T10:36:09.044003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.997268+0000","last_change":"2024-04-18T10:36:08.705414+0000","last_active":"2024-04-18T10:36:09.997268+0000","last_peered":"2024-04-18T10:36:09.997268+0000","last_clean":"2024-04-18T10:36:09.997268+0000","last_became_active":"2024-04-18T10:36:08.705077+0000","last_became_peered":"2024-04-18T10:36:08.705077+0000","last_unstale":"2024-04-18T10:36:09.997268+0000","last_undegraded":"2024-04-18T10:36:09.997268+0000","last_fullsized":"2024-04-18T10:36:09.997268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040352+0000","last_change":"2024-04-18T10:36:09.036998+0000","last_active":"2024-04-18T10:36:09.040352+0000","last_peered":"2024-04-18T10:36:09.040352+0000","last_clean":"2024-04-18T10:36:09.040352+0000","last_became_active":"2024-04-18T10:36:09.036672+0000","last_became_peered":"2024-04-18T10:36:09.036672+0000","last_unstale":"2024-04-18T10:36:09.040352+0000","last_undegraded":"2024-04-18T10:36:09.040352+0000","last_fullsized":"2024-04-18T10:36:09.040352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.011384+0000","last_change":"2024-04-18T10:36:08.711520+0000","last_active":"2024-04-18T10:36:11.011384+0000","last_peered":"2024-04-18T10:36:11.011384+0000","last_clean":"2024-04-18T10:36:11.011384+0000","last_became_active":"2024-04-18T10:36:08.711135+0000","last_became_peered":"2024-04-18T10:36:08.711135+0000","last_unstale":"2024-04-18T10:36:11.011384+0000","last_undegraded":"2024-04-18T10:36:11.011384+0000","last_fullsized":"2024-04-18T10:36:11.011384+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016697+0000","last_change":"2024-04-18T10:36:09.012564+0000","last_active":"2024-04-18T10:36:09.016697+0000","last_peered":"2024-04-18T10:36:09.016697+0000","last_clean":"2024-04-18T10:36:09.016697+0000","last_became_active":"2024-04-18T10:36:09.012232+0000","last_became_peered":"2024-04-18T10:36:09.012232+0000","last_unstale":"2024-04-18T10:36:09.016697+0000","last_undegraded":"2024-04-18T10:36:09.016697+0000","last_fullsized":"2024-04-18T10:36:09.016697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.011129+0000","last_change":"2024-04-18T10:36:08.715596+0000","last_active":"2024-04-18T10:36:11.011129+0000","last_peered":"2024-04-18T10:36:11.011129+0000","last_clean":"2024-04-18T10:36:11.011129+0000","last_became_active":"2024-04-18T10:36:08.715228+0000","last_became_peered":"2024-04-18T10:36:08.715228+0000","last_unstale":"2024-04-18T10:36:11.011129+0000","last_undegraded":"2024-04-18T10:36:11.011129+0000","last_fullsized":"2024-04-18T10:36:11.011129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044093+0000","last_change":"2024-04-18T10:36:09.039566+0000","last_active":"2024-04-18T10:36:09.044093+0000","last_peered":"2024-04-18T10:36:09.044093+0000","last_clean":"2024-04-18T10:36:09.044093+0000","last_became_active":"2024-04-18T10:36:09.039196+0000","last_became_peered":"2024-04-18T10:36:09.039196+0000","last_unstale":"2024-04-18T10:36:09.044093+0000","last_undegraded":"2024-04-18T10:36:09.044093+0000","last_fullsized":"2024-04-18T10:36:09.044093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012770+0000","last_change":"2024-04-18T10:36:08.700155+0000","last_active":"2024-04-18T10:36:11.012770+0000","last_peered":"2024-04-18T10:36:11.012770+0000","last_clean":"2024-04-18T10:36:11.012770+0000","last_became_active":"2024-04-18T10:36:08.699825+0000","last_became_peered":"2024-04-18T10:36:08.699825+0000","last_unstale":"2024-04-18T10:36:11.012770+0000","last_undegraded":"2024-04-18T10:36:11.012770+0000","last_fullsized":"2024-04-18T10:36:11.012770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045311+0000","last_change":"2024-04-18T10:36:09.043704+0000","last_active":"2024-04-18T10:36:09.045311+0000","last_peered":"2024-04-18T10:36:09.045311+0000","last_clean":"2024-04-18T10:36:09.045311+0000","last_became_active":"2024-04-18T10:36:09.043212+0000","last_became_peered":"2024-04-18T10:36:09.043212+0000","last_unstale":"2024-04-18T10:36:09.045311+0000","last_undegraded":"2024-04-18T10:36:09.045311+0000","last_fullsized":"2024-04-18T10:36:09.045311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016667+0000","last_change":"2024-04-18T10:36:08.712894+0000","last_active":"2024-04-18T10:36:09.016667+0000","last_peered":"2024-04-18T10:36:09.016667+0000","last_clean":"2024-04-18T10:36:09.016667+0000","last_became_active":"2024-04-18T10:36:08.712527+0000","last_became_peered":"2024-04-18T10:36:08.712527+0000","last_unstale":"2024-04-18T10:36:09.016667+0000","last_undegraded":"2024-04-18T10:36:09.016667+0000","last_fullsized":"2024-04-18T10:36:09.016667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.036388+0000","last_change":"2024-04-18T10:36:09.028482+0000","last_active":"2024-04-18T10:36:09.036388+0000","last_peered":"2024-04-18T10:36:09.036388+0000","last_clean":"2024-04-18T10:36:09.036388+0000","last_became_active":"2024-04-18T10:36:09.027131+0000","last_became_peered":"2024-04-18T10:36:09.027131+0000","last_unstale":"2024-04-18T10:36:09.036388+0000","last_undegraded":"2024-04-18T10:36:09.036388+0000","last_fullsized":"2024-04-18T10:36:09.036388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.010119+0000","last_change":"2024-04-18T10:36:08.696453+0000","last_active":"2024-04-18T10:36:11.010119+0000","last_peered":"2024-04-18T10:36:11.010119+0000","last_clean":"2024-04-18T10:36:11.010119+0000","last_became_active":"2024-04-18T10:36:08.691479+0000","last_became_peered":"2024-04-18T10:36:08.691479+0000","last_unstale":"2024-04-18T10:36:11.010119+0000","last_undegraded":"2024-04-18T10:36:11.010119+0000","last_fullsized":"2024-04-18T10:36:11.010119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048422+0000","last_change":"2024-04-18T10:36:09.045160+0000","last_active":"2024-04-18T10:36:09.048422+0000","last_peered":"2024-04-18T10:36:09.048422+0000","last_clean":"2024-04-18T10:36:09.048422+0000","last_became_active":"2024-04-18T10:36:09.044693+0000","last_became_peered":"2024-04-18T10:36:09.044693+0000","last_unstale":"2024-04-18T10:36:09.048422+0000","last_undegraded":"2024-04-18T10:36:09.048422+0000","last_fullsized":"2024-04-18T10:36:09.048422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.022802+0000","last_change":"2024-04-18T10:36:08.693031+0000","last_active":"2024-04-18T10:36:09.022802+0000","last_peered":"2024-04-18T10:36:09.022802+0000","last_clean":"2024-04-18T10:36:09.022802+0000","last_became_active":"2024-04-18T10:36:08.692741+0000","last_became_peered":"2024-04-18T10:36:08.692741+0000","last_unstale":"2024-04-18T10:36:09.022802+0000","last_undegraded":"2024-04-18T10:36:09.022802+0000","last_fullsized":"2024-04-18T10:36:09.022802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048417+0000","last_change":"2024-04-18T10:36:09.043925+0000","last_active":"2024-04-18T10:36:09.048417+0000","last_peered":"2024-04-18T10:36:09.048417+0000","last_clean":"2024-04-18T10:36:09.048417+0000","last_became_active":"2024-04-18T10:36:09.043223+0000","last_became_peered":"2024-04-18T10:36:09.043223+0000","last_unstale":"2024-04-18T10:36:09.048417+0000","last_undegraded":"2024-04-18T10:36:09.048417+0000","last_fullsized":"2024-04-18T10:36:09.048417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.005701+0000","last_change":"2024-04-18T10:36:08.693355+0000","last_active":"2024-04-18T10:36:09.005701+0000","last_peered":"2024-04-18T10:36:09.005701+0000","last_clean":"2024-04-18T10:36:09.005701+0000","last_became_active":"2024-04-18T10:36:08.693035+0000","last_became_peered":"2024-04-18T10:36:08.693035+0000","last_unstale":"2024-04-18T10:36:09.005701+0000","last_undegraded":"2024-04-18T10:36:09.005701+0000","last_fullsized":"2024-04-18T10:36:09.005701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016525+0000","last_change":"2024-04-18T10:36:09.013954+0000","last_active":"2024-04-18T10:36:09.016525+0000","last_peered":"2024-04-18T10:36:09.016525+0000","last_clean":"2024-04-18T10:36:09.016525+0000","last_became_active":"2024-04-18T10:36:09.013544+0000","last_became_peered":"2024-04-18T10:36:09.013544+0000","last_unstale":"2024-04-18T10:36:09.016525+0000","last_undegraded":"2024-04-18T10:36:09.016525+0000","last_fullsized":"2024-04-18T10:36:09.016525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045534+0000","last_change":"2024-04-18T10:36:08.710986+0000","last_active":"2024-04-18T10:36:09.045534+0000","last_peered":"2024-04-18T10:36:09.045534+0000","last_clean":"2024-04-18T10:36:09.045534+0000","last_became_active":"2024-04-18T10:36:08.710570+0000","last_became_peered":"2024-04-18T10:36:08.710570+0000","last_unstale":"2024-04-18T10:36:09.045534+0000","last_undegraded":"2024-04-18T10:36:09.045534+0000","last_fullsized":"2024-04-18T10:36:09.045534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017673+0000","last_change":"2024-04-18T10:36:09.013364+0000","last_active":"2024-04-18T10:36:09.017673+0000","last_peered":"2024-04-18T10:36:09.017673+0000","last_clean":"2024-04-18T10:36:09.017673+0000","last_became_active":"2024-04-18T10:36:09.013081+0000","last_became_peered":"2024-04-18T10:36:09.013081+0000","last_unstale":"2024-04-18T10:36:09.017673+0000","last_undegraded":"2024-04-18T10:36:09.017673+0000","last_fullsized":"2024-04-18T10:36:09.017673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:08.998936+0000","last_change":"2024-04-18T10:36:08.697479+0000","last_active":"2024-04-18T10:36:08.998936+0000","last_peered":"2024-04-18T10:36:08.998936+0000","last_clean":"2024-04-18T10:36:08.998936+0000","last_became_active":"2024-04-18T10:36:08.697086+0000","last_became_peered":"2024-04-18T10:36:08.697086+0000","last_unstale":"2024-04-18T10:36:08.998936+0000","last_undegraded":"2024-04-18T10:36:08.998936+0000","last_fullsized":"2024-04-18T10:36:08.998936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.027946+0000","last_change":"2024-04-18T10:36:09.022846+0000","last_active":"2024-04-18T10:36:09.027946+0000","last_peered":"2024-04-18T10:36:09.027946+0000","last_clean":"2024-04-18T10:36:09.027946+0000","last_became_active":"2024-04-18T10:36:09.019048+0000","last_became_peered":"2024-04-18T10:36:09.019048+0000","last_unstale":"2024-04-18T10:36:09.027946+0000","last_undegraded":"2024-04-18T10:36:09.027946+0000","last_fullsized":"2024-04-18T10:36:09.027946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009476+0000","last_change":"2024-04-18T10:36:08.715657+0000","last_active":"2024-04-18T10:36:11.009476+0000","last_peered":"2024-04-18T10:36:11.009476+0000","last_clean":"2024-04-18T10:36:11.009476+0000","last_became_active":"2024-04-18T10:36:08.715283+0000","last_became_peered":"2024-04-18T10:36:08.715283+0000","last_unstale":"2024-04-18T10:36:11.009476+0000","last_undegraded":"2024-04-18T10:36:11.009476+0000","last_fullsized":"2024-04-18T10:36:11.009476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.009252+0000","last_change":"2024-04-18T10:36:09.006046+0000","last_active":"2024-04-18T10:36:09.009252+0000","last_peered":"2024-04-18T10:36:09.009252+0000","last_clean":"2024-04-18T10:36:09.009252+0000","last_became_active":"2024-04-18T10:36:09.005726+0000","last_became_peered":"2024-04-18T10:36:09.005726+0000","last_unstale":"2024-04-18T10:36:09.009252+0000","last_undegraded":"2024-04-18T10:36:09.009252+0000","last_fullsized":"2024-04-18T10:36:09.009252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.998470+0000","last_change":"2024-04-18T10:36:08.710590+0000","last_active":"2024-04-18T10:36:09.998470+0000","last_peered":"2024-04-18T10:36:09.998470+0000","last_clean":"2024-04-18T10:36:09.998470+0000","last_became_active":"2024-04-18T10:36:08.710198+0000","last_became_peered":"2024-04-18T10:36:08.710198+0000","last_unstale":"2024-04-18T10:36:09.998470+0000","last_undegraded":"2024-04-18T10:36:09.998470+0000","last_fullsized":"2024-04-18T10:36:09.998470+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048407+0000","last_change":"2024-04-18T10:36:09.045249+0000","last_active":"2024-04-18T10:36:09.048407+0000","last_peered":"2024-04-18T10:36:09.048407+0000","last_clean":"2024-04-18T10:36:09.048407+0000","last_became_active":"2024-04-18T10:36:09.044573+0000","last_became_peered":"2024-04-18T10:36:09.044573+0000","last_unstale":"2024-04-18T10:36:09.048407+0000","last_undegraded":"2024-04-18T10:36:09.048407+0000","last_fullsized":"2024-04-18T10:36:09.048407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012927+0000","last_change":"2024-04-18T10:36:08.709580+0000","last_active":"2024-04-18T10:36:11.012927+0000","last_peered":"2024-04-18T10:36:11.012927+0000","last_clean":"2024-04-18T10:36:11.012927+0000","last_became_active":"2024-04-18T10:36:08.709283+0000","last_became_peered":"2024-04-18T10:36:08.709283+0000","last_unstale":"2024-04-18T10:36:11.012927+0000","last_undegraded":"2024-04-18T10:36:11.012927+0000","last_fullsized":"2024-04-18T10:36:11.012927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.030365+0000","last_change":"2024-04-18T10:36:09.027970+0000","last_active":"2024-04-18T10:36:09.030365+0000","last_peered":"2024-04-18T10:36:09.030365+0000","last_clean":"2024-04-18T10:36:09.030365+0000","last_became_active":"2024-04-18T10:36:09.027650+0000","last_became_peered":"2024-04-18T10:36:09.027650+0000","last_unstale":"2024-04-18T10:36:09.030365+0000","last_undegraded":"2024-04-18T10:36:09.030365+0000","last_fullsized":"2024-04-18T10:36:09.030365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.012959+0000","last_change":"2024-04-18T10:36:08.710914+0000","last_active":"2024-04-18T10:36:11.012959+0000","last_peered":"2024-04-18T10:36:11.012959+0000","last_clean":"2024-04-18T10:36:11.012959+0000","last_became_active":"2024-04-18T10:36:08.710619+0000","last_became_peered":"2024-04-18T10:36:08.710619+0000","last_unstale":"2024-04-18T10:36:11.012959+0000","last_undegraded":"2024-04-18T10:36:11.012959+0000","last_fullsized":"2024-04-18T10:36:11.012959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.040449+0000","last_change":"2024-04-18T10:36:09.037889+0000","last_active":"2024-04-18T10:36:09.040449+0000","last_peered":"2024-04-18T10:36:09.040449+0000","last_clean":"2024-04-18T10:36:09.040449+0000","last_became_active":"2024-04-18T10:36:09.037533+0000","last_became_peered":"2024-04-18T10:36:09.037533+0000","last_unstale":"2024-04-18T10:36:09.040449+0000","last_undegraded":"2024-04-18T10:36:09.040449+0000","last_fullsized":"2024-04-18T10:36:09.040449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.009182+0000","last_change":"2024-04-18T10:36:00.530860+0000","last_active":"2024-04-18T10:36:09.009182+0000","last_peered":"2024-04-18T10:36:09.009182+0000","last_clean":"2024-04-18T10:36:09.009182+0000","last_became_active":"2024-04-18T10:36:00.530496+0000","last_became_peered":"2024-04-18T10:36:00.530496+0000","last_unstale":"2024-04-18T10:36:09.009182+0000","last_undegraded":"2024-04-18T10:36:09.009182+0000","last_fullsized":"2024-04-18T10:36:09.009182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.999498+0000","last_change":"2024-04-18T10:36:08.703862+0000","last_active":"2024-04-18T10:36:09.999498+0000","last_peered":"2024-04-18T10:36:09.999498+0000","last_clean":"2024-04-18T10:36:09.999498+0000","last_became_active":"2024-04-18T10:36:08.703311+0000","last_became_peered":"2024-04-18T10:36:08.703311+0000","last_unstale":"2024-04-18T10:36:09.999498+0000","last_undegraded":"2024-04-18T10:36:09.999498+0000","last_fullsized":"2024-04-18T10:36:09.999498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.016742+0000","last_change":"2024-04-18T10:36:09.014696+0000","last_active":"2024-04-18T10:36:09.016742+0000","last_peered":"2024-04-18T10:36:09.016742+0000","last_clean":"2024-04-18T10:36:09.016742+0000","last_became_active":"2024-04-18T10:36:09.014208+0000","last_became_peered":"2024-04-18T10:36:09.014208+0000","last_unstale":"2024-04-18T10:36:09.016742+0000","last_undegraded":"2024-04-18T10:36:09.016742+0000","last_fullsized":"2024-04-18T10:36:09.016742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017998+0000","last_change":"2024-04-18T10:36:00.529282+0000","last_active":"2024-04-18T10:36:09.017998+0000","last_peered":"2024-04-18T10:36:09.017998+0000","last_clean":"2024-04-18T10:36:09.017998+0000","last_became_active":"2024-04-18T10:36:00.528895+0000","last_became_peered":"2024-04-18T10:36:00.528895+0000","last_unstale":"2024-04-18T10:36:09.017998+0000","last_undegraded":"2024-04-18T10:36:09.017998+0000","last_fullsized":"2024-04-18T10:36:09.017998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009897+0000","last_change":"2024-04-18T10:36:08.694077+0000","last_active":"2024-04-18T10:36:11.009897+0000","last_peered":"2024-04-18T10:36:11.009897+0000","last_clean":"2024-04-18T10:36:11.009897+0000","last_became_active":"2024-04-18T10:36:08.693727+0000","last_became_peered":"2024-04-18T10:36:08.693727+0000","last_unstale":"2024-04-18T10:36:11.009897+0000","last_undegraded":"2024-04-18T10:36:11.009897+0000","last_fullsized":"2024-04-18T10:36:11.009897+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023410+0000","last_change":"2024-04-18T10:36:09.017243+0000","last_active":"2024-04-18T10:36:09.023410+0000","last_peered":"2024-04-18T10:36:09.023410+0000","last_clean":"2024-04-18T10:36:09.023410+0000","last_became_active":"2024-04-18T10:36:09.016843+0000","last_became_peered":"2024-04-18T10:36:09.016843+0000","last_unstale":"2024-04-18T10:36:09.023410+0000","last_undegraded":"2024-04-18T10:36:09.023410+0000","last_fullsized":"2024-04-18T10:36:09.023410+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:08.995885+0000","last_change":"2024-04-18T10:36:00.529420+0000","last_active":"2024-04-18T10:36:08.995885+0000","last_peered":"2024-04-18T10:36:08.995885+0000","last_clean":"2024-04-18T10:36:08.995885+0000","last_became_active":"2024-04-18T10:36:00.529029+0000","last_became_peered":"2024-04-18T10:36:00.529029+0000","last_unstale":"2024-04-18T10:36:08.995885+0000","last_undegraded":"2024-04-18T10:36:08.995885+0000","last_fullsized":"2024-04-18T10:36:08.995885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:10.642771+0000","last_change":"2024-04-18T10:36:08.697102+0000","last_active":"2024-04-18T10:36:10.642771+0000","last_peered":"2024-04-18T10:36:10.642771+0000","last_clean":"2024-04-18T10:36:10.642771+0000","last_became_active":"2024-04-18T10:36:08.696687+0000","last_became_peered":"2024-04-18T10:36:08.696687+0000","last_unstale":"2024-04-18T10:36:10.642771+0000","last_undegraded":"2024-04-18T10:36:10.642771+0000","last_fullsized":"2024-04-18T10:36:10.642771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.037303+0000","last_change":"2024-04-18T10:36:09.031490+0000","last_active":"2024-04-18T10:36:09.037303+0000","last_peered":"2024-04-18T10:36:09.037303+0000","last_clean":"2024-04-18T10:36:09.037303+0000","last_became_active":"2024-04-18T10:36:09.030866+0000","last_became_peered":"2024-04-18T10:36:09.030866+0000","last_unstale":"2024-04-18T10:36:09.037303+0000","last_undegraded":"2024-04-18T10:36:09.037303+0000","last_fullsized":"2024-04-18T10:36:09.037303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.019884+0000","last_change":"2024-04-18T10:36:00.530056+0000","last_active":"2024-04-18T10:36:09.019884+0000","last_peered":"2024-04-18T10:36:09.019884+0000","last_clean":"2024-04-18T10:36:09.019884+0000","last_became_active":"2024-04-18T10:36:00.529546+0000","last_became_peered":"2024-04-18T10:36:00.529546+0000","last_unstale":"2024-04-18T10:36:09.019884+0000","last_undegraded":"2024-04-18T10:36:09.019884+0000","last_fullsized":"2024-04-18T10:36:09.019884+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.010534+0000","last_change":"2024-04-18T10:35:56.421744+0000","last_active":"2024-04-18T10:36:09.010534+0000","last_peered":"2024-04-18T10:36:09.010534+0000","last_clean":"2024-04-18T10:36:09.010534+0000","last_became_active":"2024-04-18T10:35:56.421316+0000","last_became_peered":"2024-04-18T10:35:56.421316+0000","last_unstale":"2024-04-18T10:36:09.010534+0000","last_undegraded":"2024-04-18T10:36:09.010534+0000","last_fullsized":"2024-04-18T10:36:09.010534+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.017702+0000","last_change":"2024-04-18T10:36:08.711994+0000","last_active":"2024-04-18T10:36:09.017702+0000","last_peered":"2024-04-18T10:36:09.017702+0000","last_clean":"2024-04-18T10:36:09.017702+0000","last_became_active":"2024-04-18T10:36:08.711652+0000","last_became_peered":"2024-04-18T10:36:08.711652+0000","last_unstale":"2024-04-18T10:36:09.017702+0000","last_undegraded":"2024-04-18T10:36:09.017702+0000","last_fullsized":"2024-04-18T10:36:09.017702+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048433+0000","last_change":"2024-04-18T10:36:09.045388+0000","last_active":"2024-04-18T10:36:09.048433+0000","last_peered":"2024-04-18T10:36:09.048433+0000","last_clean":"2024-04-18T10:36:09.048433+0000","last_became_active":"2024-04-18T10:36:09.044909+0000","last_became_peered":"2024-04-18T10:36:09.044909+0000","last_unstale":"2024-04-18T10:36:09.048433+0000","last_undegraded":"2024-04-18T10:36:09.048433+0000","last_fullsized":"2024-04-18T10:36:09.048433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.015086+0000","last_change":"2024-04-18T10:36:00.529398+0000","last_active":"2024-04-18T10:36:09.015086+0000","last_peered":"2024-04-18T10:36:09.015086+0000","last_clean":"2024-04-18T10:36:09.015086+0000","last_became_active":"2024-04-18T10:36:00.528912+0000","last_became_peered":"2024-04-18T10:36:00.528912+0000","last_unstale":"2024-04-18T10:36:09.015086+0000","last_undegraded":"2024-04-18T10:36:09.015086+0000","last_fullsized":"2024-04-18T10:36:09.015086+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.998962+0000","last_change":"2024-04-18T10:36:08.692668+0000","last_active":"2024-04-18T10:36:09.998962+0000","last_peered":"2024-04-18T10:36:09.998962+0000","last_clean":"2024-04-18T10:36:09.998962+0000","last_became_active":"2024-04-18T10:36:08.692317+0000","last_became_peered":"2024-04-18T10:36:08.692317+0000","last_unstale":"2024-04-18T10:36:09.998962+0000","last_undegraded":"2024-04-18T10:36:09.998962+0000","last_fullsized":"2024-04-18T10:36:09.998962+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.028580+0000","last_change":"2024-04-18T10:36:09.019756+0000","last_active":"2024-04-18T10:36:09.028580+0000","last_peered":"2024-04-18T10:36:09.028580+0000","last_clean":"2024-04-18T10:36:09.028580+0000","last_became_active":"2024-04-18T10:36:09.019251+0000","last_became_peered":"2024-04-18T10:36:09.019251+0000","last_unstale":"2024-04-18T10:36:09.028580+0000","last_undegraded":"2024-04-18T10:36:09.028580+0000","last_fullsized":"2024-04-18T10:36:09.028580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.025577+0000","last_change":"2024-04-18T10:36:00.527346+0000","last_active":"2024-04-18T10:36:09.025577+0000","last_peered":"2024-04-18T10:36:09.025577+0000","last_clean":"2024-04-18T10:36:09.025577+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:09.025577+0000","last_undegraded":"2024-04-18T10:36:09.025577+0000","last_fullsized":"2024-04-18T10:36:09.025577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.008891+0000","last_change":"2024-04-18T10:36:08.700410+0000","last_active":"2024-04-18T10:36:09.008891+0000","last_peered":"2024-04-18T10:36:09.008891+0000","last_clean":"2024-04-18T10:36:09.008891+0000","last_became_active":"2024-04-18T10:36:08.700048+0000","last_became_peered":"2024-04-18T10:36:08.700048+0000","last_unstale":"2024-04-18T10:36:09.008891+0000","last_undegraded":"2024-04-18T10:36:09.008891+0000","last_fullsized":"2024-04-18T10:36:09.008891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021403+0000","last_change":"2024-04-18T10:36:09.018239+0000","last_active":"2024-04-18T10:36:09.021403+0000","last_peered":"2024-04-18T10:36:09.021403+0000","last_clean":"2024-04-18T10:36:09.021403+0000","last_became_active":"2024-04-18T10:36:09.010612+0000","last_became_peered":"2024-04-18T10:36:09.010612+0000","last_unstale":"2024-04-18T10:36:09.021403+0000","last_undegraded":"2024-04-18T10:36:09.021403+0000","last_fullsized":"2024-04-18T10:36:09.021403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.009918+0000","last_change":"2024-04-18T10:36:08.710579+0000","last_active":"2024-04-18T10:36:11.009918+0000","last_peered":"2024-04-18T10:36:11.009918+0000","last_clean":"2024-04-18T10:36:11.009918+0000","last_became_active":"2024-04-18T10:36:08.710165+0000","last_became_peered":"2024-04-18T10:36:08.710165+0000","last_unstale":"2024-04-18T10:36:11.009918+0000","last_undegraded":"2024-04-18T10:36:11.009918+0000","last_fullsized":"2024-04-18T10:36:11.009918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.011413+0000","last_change":"2024-04-18T10:36:00.529862+0000","last_active":"2024-04-18T10:36:09.011413+0000","last_peered":"2024-04-18T10:36:09.011413+0000","last_clean":"2024-04-18T10:36:09.011413+0000","last_became_active":"2024-04-18T10:36:00.529451+0000","last_became_peered":"2024-04-18T10:36:00.529451+0000","last_unstale":"2024-04-18T10:36:09.011413+0000","last_undegraded":"2024-04-18T10:36:09.011413+0000","last_fullsized":"2024-04-18T10:36:09.011413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.048393+0000","last_change":"2024-04-18T10:36:09.043858+0000","last_active":"2024-04-18T10:36:09.048393+0000","last_peered":"2024-04-18T10:36:09.048393+0000","last_clean":"2024-04-18T10:36:09.048393+0000","last_became_active":"2024-04-18T10:36:09.042887+0000","last_became_peered":"2024-04-18T10:36:09.042887+0000","last_unstale":"2024-04-18T10:36:09.048393+0000","last_undegraded":"2024-04-18T10:36:09.048393+0000","last_fullsized":"2024-04-18T10:36:09.048393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023855+0000","last_change":"2024-04-18T10:36:00.527385+0000","last_active":"2024-04-18T10:36:09.023855+0000","last_peered":"2024-04-18T10:36:09.023855+0000","last_clean":"2024-04-18T10:36:09.023855+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:09.023855+0000","last_undegraded":"2024-04-18T10:36:09.023855+0000","last_fullsized":"2024-04-18T10:36:09.023855+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.999485+0000","last_change":"2024-04-18T10:36:08.703568+0000","last_active":"2024-04-18T10:36:09.999485+0000","last_peered":"2024-04-18T10:36:09.999485+0000","last_clean":"2024-04-18T10:36:09.999485+0000","last_became_active":"2024-04-18T10:36:08.702770+0000","last_became_peered":"2024-04-18T10:36:08.702770+0000","last_unstale":"2024-04-18T10:36:09.999485+0000","last_undegraded":"2024-04-18T10:36:09.999485+0000","last_fullsized":"2024-04-18T10:36:09.999485+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.013798+0000","last_change":"2024-04-18T10:36:09.005270+0000","last_active":"2024-04-18T10:36:09.013798+0000","last_peered":"2024-04-18T10:36:09.013798+0000","last_clean":"2024-04-18T10:36:09.013798+0000","last_became_active":"2024-04-18T10:36:09.004929+0000","last_became_peered":"2024-04-18T10:36:09.004929+0000","last_unstale":"2024-04-18T10:36:09.013798+0000","last_undegraded":"2024-04-18T10:36:09.013798+0000","last_fullsized":"2024-04-18T10:36:09.013798+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'5","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-18T10:36:11.013436+0000","last_change":"2024-04-18T10:36:08.698046+0000","last_active":"2024-04-18T10:36:11.013436+0000","last_peered":"2024-04-18T10:36:11.013436+0000","last_clean":"2024-04-18T10:36:11.013436+0000","last_became_active":"2024-04-18T10:36:08.697438+0000","last_became_peered":"2024-04-18T10:36:08.697438+0000","last_unstale":"2024-04-18T10:36:11.013436+0000","last_undegraded":"2024-04-18T10:36:11.013436+0000","last_fullsized":"2024-04-18T10:36:11.013436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.021707+0000","last_change":"2024-04-18T10:36:09.016654+0000","last_active":"2024-04-18T10:36:09.021707+0000","last_peered":"2024-04-18T10:36:09.021707+0000","last_clean":"2024-04-18T10:36:09.021707+0000","last_became_active":"2024-04-18T10:36:09.016342+0000","last_became_peered":"2024-04-18T10:36:09.016342+0000","last_unstale":"2024-04-18T10:36:09.021707+0000","last_undegraded":"2024-04-18T10:36:09.021707+0000","last_fullsized":"2024-04-18T10:36:09.021707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.033999+0000","last_change":"2024-04-18T10:36:08.700728+0000","last_active":"2024-04-18T10:36:09.033999+0000","last_peered":"2024-04-18T10:36:09.033999+0000","last_clean":"2024-04-18T10:36:09.033999+0000","last_became_active":"2024-04-18T10:36:08.699603+0000","last_became_peered":"2024-04-18T10:36:08.699603+0000","last_unstale":"2024-04-18T10:36:09.033999+0000","last_undegraded":"2024-04-18T10:36:09.033999+0000","last_fullsized":"2024-04-18T10:36:09.033999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.026432+0000","last_change":"2024-04-18T10:36:09.021888+0000","last_active":"2024-04-18T10:36:09.026432+0000","last_peered":"2024-04-18T10:36:09.026432+0000","last_clean":"2024-04-18T10:36:09.026432+0000","last_became_active":"2024-04-18T10:36:09.018363+0000","last_became_peered":"2024-04-18T10:36:09.018363+0000","last_unstale":"2024-04-18T10:36:09.026432+0000","last_undegraded":"2024-04-18T10:36:09.026432+0000","last_fullsized":"2024-04-18T10:36:09.026432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043521+0000","last_change":"2024-04-18T10:36:08.714829+0000","last_active":"2024-04-18T10:36:09.043521+0000","last_peered":"2024-04-18T10:36:09.043521+0000","last_clean":"2024-04-18T10:36:09.043521+0000","last_became_active":"2024-04-18T10:36:08.714528+0000","last_became_peered":"2024-04-18T10:36:08.714528+0000","last_unstale":"2024-04-18T10:36:09.043521+0000","last_undegraded":"2024-04-18T10:36:09.043521+0000","last_fullsized":"2024-04-18T10:36:09.043521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.026421+0000","last_change":"2024-04-18T10:36:09.022031+0000","last_active":"2024-04-18T10:36:09.026421+0000","last_peered":"2024-04-18T10:36:09.026421+0000","last_clean":"2024-04-18T10:36:09.026421+0000","last_became_active":"2024-04-18T10:36:09.018240+0000","last_became_peered":"2024-04-18T10:36:09.018240+0000","last_unstale":"2024-04-18T10:36:09.026421+0000","last_undegraded":"2024-04-18T10:36:09.026421+0000","last_fullsized":"2024-04-18T10:36:09.026421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.041222+0000","last_change":"2024-04-18T10:36:08.712223+0000","last_active":"2024-04-18T10:36:09.041222+0000","last_peered":"2024-04-18T10:36:09.041222+0000","last_clean":"2024-04-18T10:36:09.041222+0000","last_became_active":"2024-04-18T10:36:08.711192+0000","last_became_peered":"2024-04-18T10:36:08.711192+0000","last_unstale":"2024-04-18T10:36:09.041222+0000","last_undegraded":"2024-04-18T10:36:09.041222+0000","last_fullsized":"2024-04-18T10:36:09.041222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.043087+0000","last_change":"2024-04-18T10:36:09.030946+0000","last_active":"2024-04-18T10:36:09.043087+0000","last_peered":"2024-04-18T10:36:09.043087+0000","last_clean":"2024-04-18T10:36:09.043087+0000","last_became_active":"2024-04-18T10:36:09.030646+0000","last_became_peered":"2024-04-18T10:36:09.030646+0000","last_unstale":"2024-04-18T10:36:09.043087+0000","last_undegraded":"2024-04-18T10:36:09.043087+0000","last_fullsized":"2024-04-18T10:36:09.043087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.022671+0000","last_change":"2024-04-18T10:36:08.706957+0000","last_active":"2024-04-18T10:36:09.022671+0000","last_peered":"2024-04-18T10:36:09.022671+0000","last_clean":"2024-04-18T10:36:09.022671+0000","last_became_active":"2024-04-18T10:36:08.706598+0000","last_became_peered":"2024-04-18T10:36:08.706598+0000","last_unstale":"2024-04-18T10:36:09.022671+0000","last_undegraded":"2024-04-18T10:36:09.022671+0000","last_fullsized":"2024-04-18T10:36:09.022671+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023061+0000","last_change":"2024-04-18T10:36:09.017279+0000","last_active":"2024-04-18T10:36:09.023061+0000","last_peered":"2024-04-18T10:36:09.023061+0000","last_clean":"2024-04-18T10:36:09.023061+0000","last_became_active":"2024-04-18T10:36:09.016931+0000","last_became_peered":"2024-04-18T10:36:09.016931+0000","last_unstale":"2024-04-18T10:36:09.023061+0000","last_undegraded":"2024-04-18T10:36:09.023061+0000","last_fullsized":"2024-04-18T10:36:09.023061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.035473+0000","last_change":"2024-04-18T10:36:09.032926+0000","last_active":"2024-04-18T10:36:09.035473+0000","last_peered":"2024-04-18T10:36:09.035473+0000","last_clean":"2024-04-18T10:36:09.035473+0000","last_became_active":"2024-04-18T10:36:09.032571+0000","last_became_peered":"2024-04-18T10:36:09.032571+0000","last_unstale":"2024-04-18T10:36:09.035473+0000","last_undegraded":"2024-04-18T10:36:09.035473+0000","last_fullsized":"2024-04-18T10:36:09.035473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.044024+0000","last_change":"2024-04-18T10:36:09.042985+0000","last_active":"2024-04-18T10:36:09.044024+0000","last_peered":"2024-04-18T10:36:09.044024+0000","last_clean":"2024-04-18T10:36:09.044024+0000","last_became_active":"2024-04-18T10:36:09.039602+0000","last_became_peered":"2024-04-18T10:36:09.039602+0000","last_unstale":"2024-04-18T10:36:09.044024+0000","last_undegraded":"2024-04-18T10:36:09.044024+0000","last_fullsized":"2024-04-18T10:36:09.044024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.036316+0000","last_change":"2024-04-18T10:36:09.028593+0000","last_active":"2024-04-18T10:36:09.036316+0000","last_peered":"2024-04-18T10:36:09.036316+0000","last_clean":"2024-04-18T10:36:09.036316+0000","last_became_active":"2024-04-18T10:36:09.028237+0000","last_became_peered":"2024-04-18T10:36:09.028237+0000","last_unstale":"2024-04-18T10:36:09.036316+0000","last_undegraded":"2024-04-18T10:36:09.036316+0000","last_fullsized":"2024-04-18T10:36:09.036316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.045647+0000","last_change":"2024-04-18T10:36:09.043613+0000","last_active":"2024-04-18T10:36:09.045647+0000","last_peered":"2024-04-18T10:36:09.045647+0000","last_clean":"2024-04-18T10:36:09.045647+0000","last_became_active":"2024-04-18T10:36:09.042942+0000","last_became_peered":"2024-04-18T10:36:09.042942+0000","last_unstale":"2024-04-18T10:36:09.045647+0000","last_undegraded":"2024-04-18T10:36:09.045647+0000","last_fullsized":"2024-04-18T10:36:09.045647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-18T10:36:09.023383+0000","last_change":"2024-04-18T10:36:09.017151+0000","last_active":"2024-04-18T10:36:09.023383+0000","last_peered":"2024-04-18T10:36:09.023383+0000","last_clean":"2024-04-18T10:36:09.023383+0000","last_became_active":"2024-04-18T10:36:09.016454+0000","last_became_peered":"2024-04-18T10:36:09.016454+0000","last_unstale":"2024-04-18T10:36:09.023383+0000","last_undegraded":"2024-04-18T10:36:09.023383+0000","last_fullsized":"2024-04-18T10:36:09.023383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":55679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]}]},{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":54268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]}]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":54537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1369999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]}]},{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":53266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]}]}]}} 2024-04-18T10:36:20.417 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T10:36:20.417 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-18T10:36:20.417 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-18T10:36:20.417 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T10:36:20.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.559+0000 7f866390d700 1 Processor -- start 2024-04-18T10:36:20.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.559+0000 7f866390d700 1 -- start start 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f866390d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f866390d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f865c0a3f50 0x7f865c13d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f866390d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c05bf10 con 0x7f865c05bb30 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f866390d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c0a0d90 con 0x7f865c0a3f50 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f866390d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0a4410 con 0x7f865c09fdf0 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f8661eaa700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f865c0a3f50 0x7f865c13d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f8660ea8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f8661eaa700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f865c0a3f50 0x7f865c13d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53810/0 (socket says 172.21.15.31:53810) 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f8661eaa700 1 -- 172.21.15.31:0/928301957 learned_addr learned my addr 172.21.15.31:0/928301957 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f8661eaa700 1 -- 172.21.15.31:0/928301957 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 msgr2=0x7f865c0a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f8661eaa700 1 --2- 172.21.15.31:0/928301957 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c0a3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f8661eaa700 1 -- 172.21.15.31:0/928301957 >> v1:172.21.15.31:6789/0 conn(0x7f865c05bb30 legacy=0x7f865c0a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.560+0000 7f8661eaa700 1 -- 172.21.15.31:0/928301957 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0a1ca0 con 0x7f865c0a3f50 2024-04-18T10:36:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f8661eaa700 1 --2- 172.21.15.31:0/928301957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0a3f50 0x7f865c13d430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f865c05cd00 tx=0x7f8654009290).ready entity=mon.0 client_cookie=59ff424ba2b770e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:20.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f864bfff700 1 -- 172.21.15.31:0/928301957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865400b860 con 0x7f865c0a3f50 2024-04-18T10:36:20.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f864bfff700 1 -- 172.21.15.31:0/928301957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400b9c0 con 0x7f865c0a3f50 2024-04-18T10:36:20.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f864bfff700 1 -- 172.21.15.31:0/928301957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f865400bb30 con 0x7f865c0a3f50 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f866390d700 1 -- 172.21.15.31:0/928301957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0a3f50 msgr2=0x7f865c13d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f866390d700 1 --2- 172.21.15.31:0/928301957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0a3f50 0x7f865c13d430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f865c05cd00 tx=0x7f8654009290).stop 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f866390d700 1 -- 172.21.15.31:0/928301957 shutdown_connections 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f866390d700 1 --2- 172.21.15.31:0/928301957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c0a3f50 0x7f865c13d430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f866390d700 1 --2- 172.21.15.31:0/928301957 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c0a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.561+0000 7f866390d700 1 -- 172.21.15.31:0/928301957 >> 172.21.15.31:0/928301957 conn(0x7f865c060ac0 msgr2=0x7f865c0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.562+0000 7f866390d700 1 -- 172.21.15.31:0/928301957 shutdown_connections 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.562+0000 7f866390d700 1 -- 172.21.15.31:0/928301957 wait complete. 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.562+0000 7f866390d700 1 Processor -- start 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.562+0000 7f866390d700 1 -- start start 2024-04-18T10:36:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f866390d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c05bb30 0x7f865c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f866390d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f866390d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f865c0a3f50 0x7f865c146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f866390d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c065300 con 0x7f865c05bb30 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f866390d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c065050 con 0x7f865c0a3f50 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f866390d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0655a0 con 0x7f865c09fdf0 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f8660ea8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f8661eaa700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f865c0a3f50 0x7f865c146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f8660ea8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c064b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60178/0 (socket says 172.21.15.31:60178) 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f8660ea8700 1 -- 172.21.15.31:0/1626099660 learned_addr learned my addr 172.21.15.31:0/1626099660 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f8660ea8700 1 -- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f865c0a3f50 msgr2=0x7f865c146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f8660ea8700 1 --2- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f865c0a3f50 0x7f865c146e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f8660ea8700 1 -- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c05bb30 msgr2=0x7f865c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.563+0000 7f8660ea8700 1 --2- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c05bb30 0x7f865c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.564+0000 7f8660ea8700 1 -- 172.21.15.31:0/1626099660 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654009530 con 0x7f865c09fdf0 2024-04-18T10:36:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.564+0000 7f8660ea8700 1 --2- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c064b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f864c00c000 tx=0x7f864c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.564+0000 7f864a7fc700 1 -- 172.21.15.31:0/1626099660 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864c010780 con 0x7f865c09fdf0 2024-04-18T10:36:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.564+0000 7f864a7fc700 1 -- 172.21.15.31:0/1626099660 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c0108e0 con 0x7f865c09fdf0 2024-04-18T10:36:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.564+0000 7f864a7fc700 1 -- 172.21.15.31:0/1626099660 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864c010c40 con 0x7f865c09fdf0 2024-04-18T10:36:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.564+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c137450 con 0x7f865c09fdf0 2024-04-18T10:36:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.564+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c066760 con 0x7f865c09fdf0 2024-04-18T10:36:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.565+0000 7f864a7fc700 1 -- 172.21.15.31:0/1626099660 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f864c01c460 con 0x7f865c09fdf0 2024-04-18T10:36:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.565+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c0a0590 con 0x7f865c09fdf0 2024-04-18T10:36:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.565+0000 7f864a7fc700 1 -- 172.21.15.31:0/1626099660 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f864c04ad50 con 0x7f865c09fdf0 2024-04-18T10:36:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.568+0000 7f864a7fc700 1 -- 172.21.15.31:0/1626099660 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f864c0335e0 con 0x7f865c09fdf0 2024-04-18T10:36:20.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.722+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f865c05c530 con 0x7f865c09fdf0 2024-04-18T10:36:20.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.722+0000 7f864a7fc700 1 -- 172.21.15.31:0/1626099660 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f865c05c530 con 0x7f865c09fdf0 2024-04-18T10:36:20.722 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 >> v1:172.21.15.31:6816/39551 conn(0x7f863c038f80 legacy=0x7f863c03b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 msgr2=0x7f865c064b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 --2- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c064b60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f864c00c000 tx=0x7f864c006df0).stop 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 shutdown_connections 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 --2- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f865c0a3f50 0x7f865c146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 --2- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f865c05bb30 0x7f865c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 --2- 172.21.15.31:0/1626099660 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f865c09fdf0 0x7f865c064b60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 >> 172.21.15.31:0/1626099660 conn(0x7f865c060ac0 msgr2=0x7f865c0a3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 shutdown_connections 2024-04-18T10:36:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.723+0000 7f866390d700 1 -- 172.21.15.31:0/1626099660 wait complete. 2024-04-18T10:36:20.734 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-18T10:36:20.734 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-18T10:36:20.734 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:20.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.840+0000 7f6024781700 1 Processor -- start 2024-04-18T10:36:20.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6024781700 1 -- start start 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6024781700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c05bb30 0x7f601c063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6024781700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f601c061fe0 0x7f601c139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6024781700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c062400 0x7f601c0a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6024781700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601c062b80 con 0x7f601c061fe0 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6024781700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c062e60 con 0x7f601c062400 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6024781700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f601c139a40 con 0x7f601c05bb30 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6022d1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c062400 0x7f601c0a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6021d1c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f601c061fe0 0x7f601c139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f602251d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c05bb30 0x7f601c063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6022d1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c062400 0x7f601c0a8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54940/0 (socket says 172.21.15.31:54940) 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.841+0000 7f6021d1c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f601c061fe0 0x7f601c139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53822/0 (socket says 172.21.15.31:53822) 2024-04-18T10:36:20.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f6022d1e700 1 -- 172.21.15.31:0/3401352336 learned_addr learned my addr 172.21.15.31:0/3401352336 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f6022d1e700 1 -- 172.21.15.31:0/3401352336 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c05bb30 msgr2=0x7f601c063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f6022d1e700 1 --2- 172.21.15.31:0/3401352336 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c05bb30 0x7f601c063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f6022d1e700 1 -- 172.21.15.31:0/3401352336 >> v2:172.21.15.31:3300/0 conn(0x7f601c061fe0 msgr2=0x7f601c139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f6022d1e700 1 --2- 172.21.15.31:0/3401352336 >> v2:172.21.15.31:3300/0 conn(0x7f601c061fe0 0x7f601c139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f6022d1e700 1 -- 172.21.15.31:0/3401352336 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c139d00 con 0x7f601c062400 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f6022d1e700 1 --2- 172.21.15.31:0/3401352336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c062400 0x7f601c0a8290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f60140032f0 tx=0x7f6014009290).ready entity=mon.1 client_cookie=b70797b9cad8d2b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f602151b700 1 -- 172.21.15.31:0/3401352336 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f601400b6c0 con 0x7f601c062400 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f602151b700 1 -- 172.21.15.31:0/3401352336 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601400b820 con 0x7f601c062400 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.842+0000 7f602151b700 1 -- 172.21.15.31:0/3401352336 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f601400b990 con 0x7f601c062400 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.843+0000 7f6024781700 1 -- 172.21.15.31:0/3401352336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c062400 msgr2=0x7f601c0a8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.843+0000 7f6024781700 1 --2- 172.21.15.31:0/3401352336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c062400 0x7f601c0a8290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f60140032f0 tx=0x7f6014009290).stop 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.843+0000 7f6024781700 1 -- 172.21.15.31:0/3401352336 shutdown_connections 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.843+0000 7f6024781700 1 --2- 172.21.15.31:0/3401352336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c062400 0x7f601c0a8290 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.843+0000 7f6024781700 1 --2- 172.21.15.31:0/3401352336 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c05bb30 0x7f601c063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.843+0000 7f6024781700 1 --2- 172.21.15.31:0/3401352336 >> v2:172.21.15.31:3300/0 conn(0x7f601c061fe0 0x7f601c139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.843+0000 7f6024781700 1 -- 172.21.15.31:0/3401352336 >> 172.21.15.31:0/3401352336 conn(0x7f601c06c0c0 msgr2=0x7f601c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:20.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.843+0000 7f6024781700 1 -- 172.21.15.31:0/3401352336 shutdown_connections 2024-04-18T10:36:20.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.843+0000 7f6024781700 1 -- 172.21.15.31:0/3401352336 wait complete. 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6024781700 1 Processor -- start 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6024781700 1 -- start start 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6024781700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f601c05bb30 0x7f601c095c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6024781700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c061fe0 0x7f601c094c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6024781700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c095140 0x7f601c097f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6024781700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c096100 con 0x7f601c05bb30 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6024781700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c097520 con 0x7f601c061fe0 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6024781700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f601c093a40 con 0x7f601c095140 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f602251d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f601c05bb30 0x7f601c095c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f602251d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f601c05bb30 0x7f601c095c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53832/0 (socket says 172.21.15.31:53832) 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6021d1c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c061fe0 0x7f601c094c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f602251d700 1 -- 172.21.15.31:0/3274139078 learned_addr learned my addr 172.21.15.31:0/3274139078 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.844+0000 7f6022d1e700 1 --2- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c095140 0x7f601c097f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f602251d700 1 -- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c095140 msgr2=0x7f601c097f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f602251d700 1 --2- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c095140 0x7f601c097f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f602251d700 1 -- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c061fe0 msgr2=0x7f601c094c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f602251d700 1 --2- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c061fe0 0x7f601c094c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f602251d700 1 -- 172.21.15.31:0/3274139078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014009530 con 0x7f601c05bb30 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f602251d700 1 --2- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f601c05bb30 0x7f601c095c10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f601000c000 tx=0x7f6010006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f600f7fe700 1 -- 172.21.15.31:0/3274139078 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6010010780 con 0x7f601c05bb30 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f600f7fe700 1 -- 172.21.15.31:0/3274139078 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60100108e0 con 0x7f601c05bb30 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c0947d0 con 0x7f601c05bb30 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f600f7fe700 1 -- 172.21.15.31:0/3274139078 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6010010c40 con 0x7f601c05bb30 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.845+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c096350 con 0x7f601c05bb30 2024-04-18T10:36:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.846+0000 7f600f7fe700 1 -- 172.21.15.31:0/3274139078 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f601001c460 con 0x7f601c05bb30 2024-04-18T10:36:20.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.846+0000 7f600f7fe700 1 -- 172.21.15.31:0/3274139078 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f601004ab60 con 0x7f601c05bb30 2024-04-18T10:36:20.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.846+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601c094aa0 con 0x7f601c05bb30 2024-04-18T10:36:20.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.849+0000 7f600f7fe700 1 -- 172.21.15.31:0/3274139078 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f60100333f0 con 0x7f601c05bb30 2024-04-18T10:36:20.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.968+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f601c05bf10 con 0x7f601c05bb30 2024-04-18T10:36:20.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.968+0000 7f600f7fe700 1 -- 172.21.15.31:0/3274139078 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f601002b090 con 0x7f601c05bb30 2024-04-18T10:36:20.968 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:20.969 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:09.988938+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 >> v1:172.21.15.31:6816/39551 conn(0x7f5ffc038da0 legacy=0x7f5ffc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f601c05bb30 msgr2=0x7f601c095c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 --2- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f601c05bb30 0x7f601c095c10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f601000c000 tx=0x7f6010006df0).stop 2024-04-18T10:36:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 shutdown_connections 2024-04-18T10:36:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 --2- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f601c095140 0x7f601c097f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 --2- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f601c05bb30 0x7f601c095c10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 --2- 172.21.15.31:0/3274139078 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f601c061fe0 0x7f601c094c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 >> 172.21.15.31:0/3274139078 conn(0x7f601c06c0c0 msgr2=0x7f601c1333c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:20.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 shutdown_connections 2024-04-18T10:36:20.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:20.970+0000 7f6024781700 1 -- 172.21.15.31:0/3274139078 wait complete. 2024-04-18T10:36:20.980 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:36:20.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-18T10:36:21.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.089+0000 7f2a98637700 1 Processor -- start 2024-04-18T10:36:21.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.089+0000 7f2a98637700 1 -- start start 2024-04-18T10:36:21.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a98637700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a9005bb30 0x7f2a90063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a98637700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2a90061fe0 0x7f2a90139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a98637700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a90062400 0x7f2a900a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a98637700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a90062b80 con 0x7f2a90061fe0 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a98637700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a90062e60 con 0x7f2a90062400 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a98637700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a90139a40 con 0x7f2a9005bb30 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a963d3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a9005bb30 0x7f2a90063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a95bd2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2a90061fe0 0x7f2a90139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a96bd4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a90062400 0x7f2a900a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a963d3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a9005bb30 0x7f2a90063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60192/0 (socket says 172.21.15.31:60192) 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a95bd2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2a90061fe0 0x7f2a90139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53846/0 (socket says 172.21.15.31:53846) 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a963d3700 1 -- 172.21.15.31:0/3831550752 learned_addr learned my addr 172.21.15.31:0/3831550752 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.090+0000 7f2a96bd4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a90062400 0x7f2a900a8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54962/0 (socket says 172.21.15.31:54962) 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a96bd4700 1 -- 172.21.15.31:0/3831550752 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a9005bb30 msgr2=0x7f2a90063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:21.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a96bd4700 1 --2- 172.21.15.31:0/3831550752 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a9005bb30 0x7f2a90063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a96bd4700 1 -- 172.21.15.31:0/3831550752 >> v2:172.21.15.31:3300/0 conn(0x7f2a90061fe0 msgr2=0x7f2a90139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a96bd4700 1 --2- 172.21.15.31:0/3831550752 >> v2:172.21.15.31:3300/0 conn(0x7f2a90061fe0 0x7f2a90139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a96bd4700 1 -- 172.21.15.31:0/3831550752 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a90139d00 con 0x7f2a90062400 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a963d3700 1 --2- 172.21.15.31:0/3831550752 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a9005bb30 0x7f2a90063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a96bd4700 1 --2- 172.21.15.31:0/3831550752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a90062400 0x7f2a900a8290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2a880032f0 tx=0x7f2a880091d0).ready entity=mon.1 client_cookie=726190a2fd38f5b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a953d1700 1 -- 172.21.15.31:0/3831550752 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a8800b600 con 0x7f2a90062400 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a953d1700 1 -- 172.21.15.31:0/3831550752 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8800b760 con 0x7f2a90062400 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a953d1700 1 -- 172.21.15.31:0/3831550752 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a8800b8d0 con 0x7f2a90062400 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a98637700 1 -- 172.21.15.31:0/3831550752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a90062400 msgr2=0x7f2a900a8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a98637700 1 --2- 172.21.15.31:0/3831550752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a90062400 0x7f2a900a8290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2a880032f0 tx=0x7f2a880091d0).stop 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a98637700 1 -- 172.21.15.31:0/3831550752 shutdown_connections 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a98637700 1 --2- 172.21.15.31:0/3831550752 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a90062400 0x7f2a900a8290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a98637700 1 --2- 172.21.15.31:0/3831550752 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a9005bb30 0x7f2a90063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a98637700 1 --2- 172.21.15.31:0/3831550752 >> v2:172.21.15.31:3300/0 conn(0x7f2a90061fe0 0x7f2a90139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.091+0000 7f2a98637700 1 -- 172.21.15.31:0/3831550752 >> 172.21.15.31:0/3831550752 conn(0x7f2a9006c0c0 msgr2=0x7f2a9006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.092+0000 7f2a98637700 1 -- 172.21.15.31:0/3831550752 shutdown_connections 2024-04-18T10:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.092+0000 7f2a98637700 1 -- 172.21.15.31:0/3831550752 wait complete. 2024-04-18T10:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.092+0000 7f2a98637700 1 Processor -- start 2024-04-18T10:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.092+0000 7f2a98637700 1 -- start start 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a98637700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a9005bb30 0x7f2a90146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a98637700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a90061fe0 0x7f2a9012ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a98637700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a90095ca0 0x7f2a9012ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a98637700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a90094d60 con 0x7f2a90061fe0 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a98637700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a90099070 con 0x7f2a9005bb30 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a98637700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a90147560 con 0x7f2a90095ca0 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a963d3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a9005bb30 0x7f2a90146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a96bd4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a90095ca0 0x7f2a9012ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a963d3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a9005bb30 0x7f2a90146fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54976/0 (socket says 172.21.15.31:54976) 2024-04-18T10:36:21.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a963d3700 1 -- 172.21.15.31:0/898053720 learned_addr learned my addr 172.21.15.31:0/898053720 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a95bd2700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a90061fe0 0x7f2a9012ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a963d3700 1 -- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a90095ca0 msgr2=0x7f2a9012ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a963d3700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a90095ca0 0x7f2a9012ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a963d3700 1 -- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a90061fe0 msgr2=0x7f2a9012ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a963d3700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a90061fe0 0x7f2a9012ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a963d3700 1 -- 172.21.15.31:0/898053720 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8000b1e0 con 0x7f2a9005bb30 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a96bd4700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a90095ca0 0x7f2a9012ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.093+0000 7f2a95bd2700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a90061fe0 0x7f2a9012ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.094+0000 7f2a963d3700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a9005bb30 0x7f2a90146fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2a8000c000 tx=0x7f2a80006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.094+0000 7f2a7f7fe700 1 -- 172.21.15.31:0/898053720 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a80012600 con 0x7f2a9005bb30 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.094+0000 7f2a7f7fe700 1 -- 172.21.15.31:0/898053720 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a80012760 con 0x7f2a9005bb30 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.094+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a88009470 con 0x7f2a9005bb30 2024-04-18T10:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.094+0000 7f2a7f7fe700 1 -- 172.21.15.31:0/898053720 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a80012ac0 con 0x7f2a9005bb30 2024-04-18T10:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.094+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a90138680 con 0x7f2a9005bb30 2024-04-18T10:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.095+0000 7f2a7f7fe700 1 -- 172.21.15.31:0/898053720 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2a80022070 con 0x7f2a9005bb30 2024-04-18T10:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.095+0000 7f2a7f7fe700 1 -- 172.21.15.31:0/898053720 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2a8004ae00 con 0x7f2a9005bb30 2024-04-18T10:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.095+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a901388a0 con 0x7f2a9005bb30 2024-04-18T10:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.098+0000 7f2a7f7fe700 1 -- 172.21.15.31:0/898053720 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2a80033690 con 0x7f2a9005bb30 2024-04-18T10:36:21.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.214+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2a9005bf10 con 0x7f2a9005bb30 2024-04-18T10:36:21.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.214+0000 7f2a7f7fe700 1 -- 172.21.15.31:0/898053720 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2a80029030 con 0x7f2a9005bb30 2024-04-18T10:36:21.215 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:36:21.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 >> v1:172.21.15.31:6816/39551 conn(0x7f2a70038da0 legacy=0x7f2a7003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a9005bb30 msgr2=0x7f2a90146fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a9005bb30 0x7f2a90146fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2a8000c000 tx=0x7f2a80006eb0).stop 2024-04-18T10:36:21.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 shutdown_connections 2024-04-18T10:36:21.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2a90095ca0 0x7f2a9012ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2a9005bb30 0x7f2a90146fb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 --2- 172.21.15.31:0/898053720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a90061fe0 0x7f2a9012ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 >> 172.21.15.31:0/898053720 conn(0x7f2a9006c0c0 msgr2=0x7f2a90133230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:21.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 shutdown_connections 2024-04-18T10:36:21.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.216+0000 7f2a98637700 1 -- 172.21.15.31:0/898053720 wait complete. 2024-04-18T10:36:21.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:36:21.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.335+0000 7f600bb49700 1 Processor -- start 2024-04-18T10:36:21.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.335+0000 7f600bb49700 1 -- start start 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.336+0000 7f600bb49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60041365d0 0x7f60041369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.336+0000 7f600bb49700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6004066d80 0x7f600405b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.336+0000 7f600bb49700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60040660f0 con 0x7f60040a4f80 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.336+0000 7f600bb49700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60040668d0 con 0x7f6004066d80 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.336+0000 7f600bb49700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60040a4590 con 0x7f60041365d0 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.336+0000 7f60098e5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60041365d0 0x7f60041369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.336+0000 7f60090e4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6004066d80 0x7f600405b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.336+0000 7f600a0e6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f60040a4f80 0x7f600405be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45556/0 (socket says 172.21.15.31:45556) 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.336+0000 7f600a0e6700 1 -- 172.21.15.31:0/3802016080 learned_addr learned my addr 172.21.15.31:0/3802016080 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60088e3700 1 -- 172.21.15.31:0/3802016080 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502960716 0 0) 0x7f60040660f0 con 0x7f60040a4f80 2024-04-18T10:36:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60098e5700 1 -- 172.21.15.31:0/3802016080 >> v2:172.21.15.31:3300/0 conn(0x7f6004066d80 msgr2=0x7f600405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60098e5700 1 --2- 172.21.15.31:0/3802016080 >> v2:172.21.15.31:3300/0 conn(0x7f6004066d80 0x7f600405b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60098e5700 1 -- 172.21.15.31:0/3802016080 >> v1:172.21.15.31:6789/0 conn(0x7f60040a4f80 legacy=0x7f600405be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60098e5700 1 -- 172.21.15.31:0/3802016080 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040a4850 con 0x7f60041365d0 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60090e4700 1 --2- 172.21.15.31:0/3802016080 >> v2:172.21.15.31:3300/0 conn(0x7f6004066d80 0x7f600405b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60098e5700 1 --2- 172.21.15.31:0/3802016080 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60041365d0 0x7f60041369b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5ff4002f70 tx=0x7f5ff4006df0).ready entity=mon.2 client_cookie=f7b46a77eca5fee8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60088e3700 1 -- 172.21.15.31:0/3802016080 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff400d570 con 0x7f60041365d0 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60088e3700 1 -- 172.21.15.31:0/3802016080 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff4000e90 con 0x7f60041365d0 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f60088e3700 1 -- 172.21.15.31:0/3802016080 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff400d8c0 con 0x7f60041365d0 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f600bb49700 1 -- 172.21.15.31:0/3802016080 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60041365d0 msgr2=0x7f60041369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f600bb49700 1 --2- 172.21.15.31:0/3802016080 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60041365d0 0x7f60041369b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f5ff4002f70 tx=0x7f5ff4006df0).stop 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f600bb49700 1 -- 172.21.15.31:0/3802016080 shutdown_connections 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f600bb49700 1 --2- 172.21.15.31:0/3802016080 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60041365d0 0x7f60041369b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f600bb49700 1 --2- 172.21.15.31:0/3802016080 >> v2:172.21.15.31:3300/0 conn(0x7f6004066d80 0x7f600405b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f600bb49700 1 -- 172.21.15.31:0/3802016080 >> 172.21.15.31:0/3802016080 conn(0x7f6004060ac0 msgr2=0x7f60040a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f600bb49700 1 -- 172.21.15.31:0/3802016080 shutdown_connections 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.337+0000 7f600bb49700 1 -- 172.21.15.31:0/3802016080 wait complete. 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.338+0000 7f600bb49700 1 Processor -- start 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f600bb49700 1 -- start start 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f600bb49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6004066d80 0x7f6004092520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f600bb49700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60040a4f80 0x7f6004148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f600bb49700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60041365d0 0x7f60041491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f600bb49700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6004094f30 con 0x7f60040a4f80 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f600bb49700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040942c0 con 0x7f60041365d0 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f600bb49700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6004094050 con 0x7f6004066d80 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f60098e5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6004066d80 0x7f6004092520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f60098e5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6004066d80 0x7f6004092520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60222/0 (socket says 172.21.15.31:60222) 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f60090e4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60040a4f80 0x7f6004148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f60098e5700 1 -- 172.21.15.31:0/2210645604 learned_addr learned my addr 172.21.15.31:0/2210645604 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.339+0000 7f600a0e6700 1 --2- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60041365d0 0x7f60041491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f60098e5700 1 -- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60041365d0 msgr2=0x7f60041491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f60098e5700 1 --2- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60041365d0 0x7f60041491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f60098e5700 1 -- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60040a4f80 msgr2=0x7f6004148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f60098e5700 1 --2- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60040a4f80 0x7f6004148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f60098e5700 1 -- 172.21.15.31:0/2210645604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600000b180 con 0x7f6004066d80 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f60090e4700 1 --2- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60040a4f80 0x7f6004148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f60098e5700 1 --2- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6004066d80 0x7f6004092520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f60040a2b60 tx=0x7f5ff4014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f5ff2ffd700 1 -- 172.21.15.31:0/2210645604 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff4013dd0 con 0x7f6004066d80 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f5ff2ffd700 1 -- 172.21.15.31:0/2210645604 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff401e400 con 0x7f6004066d80 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f5ff2ffd700 1 -- 172.21.15.31:0/2210645604 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff401e760 con 0x7f6004066d80 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff400b180 con 0x7f6004066d80 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.340+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60040a24a0 con 0x7f6004066d80 2024-04-18T10:36:21.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.341+0000 7f5ff2ffd700 1 -- 172.21.15.31:0/2210645604 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5ff4025030 con 0x7f6004066d80 2024-04-18T10:36:21.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.341+0000 7f5ff2ffd700 1 -- 172.21.15.31:0/2210645604 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5ff404b700 con 0x7f6004066d80 2024-04-18T10:36:21.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.341+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6004094d80 con 0x7f6004066d80 2024-04-18T10:36:21.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.345+0000 7f5ff2ffd700 1 -- 172.21.15.31:0/2210645604 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5ff40058c0 con 0x7f6004066d80 2024-04-18T10:36:21.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.461+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6004057a60 con 0x7f6004066d80 2024-04-18T10:36:21.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.462+0000 7f5ff2ffd700 1 -- 172.21.15.31:0/2210645604 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ff4012460 con 0x7f6004066d80 2024-04-18T10:36:21.462 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 >> v1:172.21.15.31:6816/39551 conn(0x7f5fe4038dd0 legacy=0x7f5fe403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6004066d80 msgr2=0x7f6004092520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 --2- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6004066d80 0x7f6004092520 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f60040a2b60 tx=0x7f5ff4014000).stop 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 shutdown_connections 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 --2- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6004066d80 0x7f6004092520 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 --2- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60041365d0 0x7f60041491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 --2- 172.21.15.31:0/2210645604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60040a4f80 0x7f6004148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 >> 172.21.15.31:0/2210645604 conn(0x7f6004060ac0 msgr2=0x7f6004137480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 shutdown_connections 2024-04-18T10:36:21.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.463+0000 7f600bb49700 1 -- 172.21.15.31:0/2210645604 wait complete. 2024-04-18T10:36:21.474 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:36:21.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.584+0000 7fd6337e0700 1 Processor -- start 2024-04-18T10:36:21.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.584+0000 7fd6337e0700 1 -- start start 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.584+0000 7fd6337e0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd62c05bb30 0x7fd62c063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd6337e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c062400 0x7fd62c140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd6337e0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c062b80 con 0x7fd62c061fe0 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd6337e0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c062e60 con 0x7fd62c05bb30 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd6337e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c139a40 con 0x7fd62c062400 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd63157c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd62c05bb30 0x7fd62c063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd631d7d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c062400 0x7fd62c140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd630d7b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd62c061fe0 0x7fd62c139fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45558/0 (socket says 172.21.15.31:45558) 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd630d7b700 1 -- 172.21.15.31:0/693093940 learned_addr learned my addr 172.21.15.31:0/693093940 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd63157c700 1 -- 172.21.15.31:0/693093940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c062400 msgr2=0x7fd62c140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:21.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd63157c700 1 --2- 172.21.15.31:0/693093940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c062400 0x7fd62c140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd63157c700 1 -- 172.21.15.31:0/693093940 >> v1:172.21.15.31:6789/0 conn(0x7fd62c061fe0 legacy=0x7fd62c139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd61bfff700 1 -- 172.21.15.31:0/693093940 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852422087 0 0) 0x7fd62c062b80 con 0x7fd62c061fe0 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd63157c700 1 -- 172.21.15.31:0/693093940 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c139d00 con 0x7fd62c05bb30 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd631d7d700 1 --2- 172.21.15.31:0/693093940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c062400 0x7fd62c140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd63157c700 1 --2- 172.21.15.31:0/693093940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c05bb30 0x7fd62c063360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd628002f70 tx=0x7fd628006df0).ready entity=mon.0 client_cookie=91217a1a152af9ed server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd61bfff700 1 -- 172.21.15.31:0/693093940 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62800d570 con 0x7fd62c05bb30 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd61bfff700 1 -- 172.21.15.31:0/693093940 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd628000e90 con 0x7fd62c05bb30 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.585+0000 7fd61bfff700 1 -- 172.21.15.31:0/693093940 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62800d8c0 con 0x7fd62c05bb30 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.586+0000 7fd6337e0700 1 -- 172.21.15.31:0/693093940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c05bb30 msgr2=0x7fd62c063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.586+0000 7fd6337e0700 1 --2- 172.21.15.31:0/693093940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c05bb30 0x7fd62c063360 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd628002f70 tx=0x7fd628006df0).stop 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.586+0000 7fd6337e0700 1 -- 172.21.15.31:0/693093940 shutdown_connections 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.586+0000 7fd6337e0700 1 --2- 172.21.15.31:0/693093940 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c062400 0x7fd62c140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.586+0000 7fd6337e0700 1 --2- 172.21.15.31:0/693093940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c05bb30 0x7fd62c063360 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.586+0000 7fd6337e0700 1 -- 172.21.15.31:0/693093940 >> 172.21.15.31:0/693093940 conn(0x7fd62c06c0c0 msgr2=0x7fd62c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:21.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.586+0000 7fd6337e0700 1 -- 172.21.15.31:0/693093940 shutdown_connections 2024-04-18T10:36:21.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.586+0000 7fd6337e0700 1 -- 172.21.15.31:0/693093940 wait complete. 2024-04-18T10:36:21.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.587+0000 7fd6337e0700 1 Processor -- start 2024-04-18T10:36:21.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.587+0000 7fd6337e0700 1 -- start start 2024-04-18T10:36:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd6337e0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd62c05bb30 0x7fd62c095b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd6337e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c061fe0 0x7fd62c149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd6337e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c093ef0 0x7fd62c094350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd6337e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c095280 con 0x7fd62c093ef0 2024-04-18T10:36:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd6337e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c149830 con 0x7fd62c061fe0 2024-04-18T10:36:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd6337e0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0939b0 con 0x7fd62c05bb30 2024-04-18T10:36:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd63157c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd62c05bb30 0x7fd62c095b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd630d7b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c061fe0 0x7fd62c149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd63157c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd62c05bb30 0x7fd62c095b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60238/0 (socket says 172.21.15.31:60238) 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd630d7b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c061fe0 0x7fd62c149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:55002/0 (socket says 172.21.15.31:55002) 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd63157c700 1 -- 172.21.15.31:0/144092759 learned_addr learned my addr 172.21.15.31:0/144092759 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd631d7d700 1 --2- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c093ef0 0x7fd62c094350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd630d7b700 1 -- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd62c05bb30 msgr2=0x7fd62c095b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd630d7b700 1 --2- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd62c05bb30 0x7fd62c095b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd630d7b700 1 -- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c093ef0 msgr2=0x7fd62c094350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd630d7b700 1 --2- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c093ef0 0x7fd62c094350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd630d7b700 1 -- 172.21.15.31:0/144092759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd624009470 con 0x7fd62c061fe0 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd630d7b700 1 --2- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c061fe0 0x7fd62c149c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd61c000bc0 tx=0x7fd61c0079e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.588+0000 7fd61a7fc700 1 -- 172.21.15.31:0/144092759 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61c0070d0 con 0x7fd62c061fe0 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.589+0000 7fd61a7fc700 1 -- 172.21.15.31:0/144092759 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c007230 con 0x7fd62c061fe0 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.589+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62800b180 con 0x7fd62c061fe0 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.589+0000 7fd61a7fc700 1 -- 172.21.15.31:0/144092759 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd61c005610 con 0x7fd62c061fe0 2024-04-18T10:36:21.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.589+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c093530 con 0x7fd62c061fe0 2024-04-18T10:36:21.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.590+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c099060 con 0x7fd62c061fe0 2024-04-18T10:36:21.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.590+0000 7fd61a7fc700 1 -- 172.21.15.31:0/144092759 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd61c010070 con 0x7fd62c061fe0 2024-04-18T10:36:21.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.590+0000 7fd61a7fc700 1 -- 172.21.15.31:0/144092759 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd61c049ee0 con 0x7fd62c061fe0 2024-04-18T10:36:21.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.593+0000 7fd61a7fc700 1 -- 172.21.15.31:0/144092759 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd61c02ed40 con 0x7fd62c061fe0 2024-04-18T10:36:21.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.711+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd62c05c9c0 con 0x7fd62c061fe0 2024-04-18T10:36:21.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.712+0000 7fd61a7fc700 1 -- 172.21.15.31:0/144092759 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd62c05c9c0 con 0x7fd62c061fe0 2024-04-18T10:36:21.712 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 >> v1:172.21.15.31:6816/39551 conn(0x7fd60c038e30 legacy=0x7fd60c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c061fe0 msgr2=0x7fd62c149c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 --2- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c061fe0 0x7fd62c149c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd61c000bc0 tx=0x7fd61c0079e0).stop 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 shutdown_connections 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 --2- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd62c05bb30 0x7fd62c095b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 --2- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd62c093ef0 0x7fd62c094350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 --2- 172.21.15.31:0/144092759 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd62c061fe0 0x7fd62c149c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 >> 172.21.15.31:0/144092759 conn(0x7fd62c06c0c0 msgr2=0x7fd62c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 shutdown_connections 2024-04-18T10:36:21.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.713+0000 7fd6337e0700 1 -- 172.21.15.31:0/144092759 wait complete. 2024-04-18T10:36:21.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:36:21.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.833+0000 7f32a463c700 1 Processor -- start 2024-04-18T10:36:21.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.833+0000 7f32a463c700 1 -- start start 2024-04-18T10:36:21.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a463c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c064600 0x7f329c133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a463c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f329c062fb0 0x7f329c063680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a463c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c0a92a0 0x7f329c1365f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a463c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c065150 con 0x7f329c062fb0 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a463c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c130bd0 con 0x7f329c0a92a0 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a463c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f329c063b70 con 0x7f329c064600 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a23d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c064600 0x7f329c133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a1bd7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f329c062fb0 0x7f329c063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a2bd9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c0a92a0 0x7f329c1365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a1bd7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f329c062fb0 0x7f329c063680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53874/0 (socket says 172.21.15.31:53874) 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a23d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c064600 0x7f329c133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60242/0 (socket says 172.21.15.31:60242) 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a1bd7700 1 -- 172.21.15.31:0/1179012691 learned_addr learned my addr 172.21.15.31:0/1179012691 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a2bd9700 1 -- 172.21.15.31:0/1179012691 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c064600 msgr2=0x7f329c133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:21.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a2bd9700 1 --2- 172.21.15.31:0/1179012691 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c064600 0x7f329c133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a2bd9700 1 -- 172.21.15.31:0/1179012691 >> v2:172.21.15.31:3300/0 conn(0x7f329c062fb0 msgr2=0x7f329c063680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:21.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a2bd9700 1 --2- 172.21.15.31:0/1179012691 >> v2:172.21.15.31:3300/0 conn(0x7f329c062fb0 0x7f329c063680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a2bd9700 1 -- 172.21.15.31:0/1179012691 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c061ee0 con 0x7f329c0a92a0 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a1bd7700 1 --2- 172.21.15.31:0/1179012691 >> v2:172.21.15.31:3300/0 conn(0x7f329c062fb0 0x7f329c063680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a2bd9700 1 --2- 172.21.15.31:0/1179012691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c0a92a0 0x7f329c1365f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f329c0a9c50 tx=0x7f32940091d0).ready entity=mon.1 client_cookie=91af0c0e2fc70706 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a13d6700 1 -- 172.21.15.31:0/1179012691 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f329400b600 con 0x7f329c0a92a0 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a13d6700 1 -- 172.21.15.31:0/1179012691 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329400b760 con 0x7f329c0a92a0 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.834+0000 7f32a13d6700 1 -- 172.21.15.31:0/1179012691 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f329400b8d0 con 0x7f329c0a92a0 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.835+0000 7f32a463c700 1 -- 172.21.15.31:0/1179012691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c0a92a0 msgr2=0x7f329c1365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.835+0000 7f32a463c700 1 --2- 172.21.15.31:0/1179012691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c0a92a0 0x7f329c1365f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f329c0a9c50 tx=0x7f32940091d0).stop 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.835+0000 7f32a463c700 1 -- 172.21.15.31:0/1179012691 shutdown_connections 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.835+0000 7f32a463c700 1 --2- 172.21.15.31:0/1179012691 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c0a92a0 0x7f329c1365f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.835+0000 7f32a463c700 1 --2- 172.21.15.31:0/1179012691 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c064600 0x7f329c133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.835+0000 7f32a463c700 1 --2- 172.21.15.31:0/1179012691 >> v2:172.21.15.31:3300/0 conn(0x7f329c062fb0 0x7f329c063680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.835+0000 7f32a463c700 1 -- 172.21.15.31:0/1179012691 >> 172.21.15.31:0/1179012691 conn(0x7f329c06c0c0 msgr2=0x7f329c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.835+0000 7f32a463c700 1 -- 172.21.15.31:0/1179012691 shutdown_connections 2024-04-18T10:36:21.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.835+0000 7f32a463c700 1 -- 172.21.15.31:0/1179012691 wait complete. 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.836+0000 7f32a463c700 1 Processor -- start 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.836+0000 7f32a463c700 1 -- start start 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a463c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c064600 0x7f329c131ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a463c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c0a92a0 0x7f329c066c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a463c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f329c12da00 0x7f329c12de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a463c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c067140 con 0x7f329c12da00 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a463c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c092c90 con 0x7f329c064600 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a463c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f329c067380 con 0x7f329c0a92a0 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a23d8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c064600 0x7f329c131ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a2bd9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f329c12da00 0x7f329c12de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a23d8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c064600 0x7f329c131ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:55022/0 (socket says 172.21.15.31:55022) 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a23d8700 1 -- 172.21.15.31:0/1135131611 learned_addr learned my addr 172.21.15.31:0/1135131611 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a1bd7700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c0a92a0 0x7f329c066c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:21.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a23d8700 1 -- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c0a92a0 msgr2=0x7f329c066c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a23d8700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c0a92a0 0x7f329c066c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a23d8700 1 -- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f329c12da00 msgr2=0x7f329c12de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a23d8700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f329c12da00 0x7f329c12de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a23d8700 1 -- 172.21.15.31:0/1135131611 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c00b1e0 con 0x7f329c064600 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a2bd9700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f329c12da00 0x7f329c12de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.837+0000 7f32a1bd7700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c0a92a0 0x7f329c066c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.838+0000 7f32a23d8700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c064600 0x7f329c131ff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f329800e000 tx=0x7f3298006e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.838+0000 7f328b7fe700 1 -- 172.21.15.31:0/1135131611 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f329800ed20 con 0x7f329c064600 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.838+0000 7f328b7fe700 1 -- 172.21.15.31:0/1135131611 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329800ee80 con 0x7f329c064600 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.838+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3294009470 con 0x7f329c064600 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.838+0000 7f328b7fe700 1 -- 172.21.15.31:0/1135131611 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f329801a660 con 0x7f329c064600 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.838+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c132d20 con 0x7f329c064600 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.838+0000 7f328b7fe700 1 -- 172.21.15.31:0/1135131611 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3298021060 con 0x7f329c064600 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.839+0000 7f328b7fe700 1 -- 172.21.15.31:0/1135131611 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f329804d960 con 0x7f329c064600 2024-04-18T10:36:21.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.839+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c067b30 con 0x7f329c064600 2024-04-18T10:36:21.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.842+0000 7f328b7fe700 1 -- 172.21.15.31:0/1135131611 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f329c067b30 con 0x7f329c064600 2024-04-18T10:36:21.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.958+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f329c067b30 con 0x7f329c064600 2024-04-18T10:36:21.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.959+0000 7f328b7fe700 1 -- 172.21.15.31:0/1135131611 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f329c067b30 con 0x7f329c064600 2024-04-18T10:36:21.959 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:36:21.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 >> v1:172.21.15.31:6816/39551 conn(0x7f327c038dd0 legacy=0x7f327c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c064600 msgr2=0x7f329c131ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:21.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c064600 0x7f329c131ff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f329800e000 tx=0x7f3298006e80).stop 2024-04-18T10:36:21.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 shutdown_connections 2024-04-18T10:36:21.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f329c12da00 0x7f329c12de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f329c064600 0x7f329c131ff0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 --2- 172.21.15.31:0/1135131611 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f329c0a92a0 0x7f329c066c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:21.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 >> 172.21.15.31:0/1135131611 conn(0x7f329c06c0c0 msgr2=0x7f329c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:21.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 shutdown_connections 2024-04-18T10:36:21.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:21.960+0000 7f32a463c700 1 -- 172.21.15.31:0/1135131611 wait complete. 2024-04-18T10:36:21.971 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:22.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.076+0000 7fd2ba9bf700 1 Processor -- start 2024-04-18T10:36:22.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.076+0000 7fd2ba9bf700 1 -- start start 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2ba9bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4062fb0 0x7fd2b4133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2ba9bf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2b4063680 0x7fd2b413d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2ba9bf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b4063b30 con 0x7fd2b4064600 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2ba9bf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b4065150 con 0x7fd2b4063680 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2ba9bf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b4130bd0 con 0x7fd2b4062fb0 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2b8f5c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2b4063680 0x7fd2b413d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2b8f5c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2b4063680 0x7fd2b413d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53890/0 (socket says 172.21.15.31:53890) 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2b8f5c700 1 -- 172.21.15.31:0/206599226 learned_addr learned my addr 172.21.15.31:0/206599226 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2b3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd2b4064600 0x7fd2b40a92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45566/0 (socket says 172.21.15.31:45566) 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2b37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4062fb0 0x7fd2b4133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2b8f5c700 1 -- 172.21.15.31:0/206599226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4062fb0 msgr2=0x7fd2b4133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2b8f5c700 1 --2- 172.21.15.31:0/206599226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4062fb0 0x7fd2b4133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2b8f5c700 1 -- 172.21.15.31:0/206599226 >> v1:172.21.15.31:6789/0 conn(0x7fd2b4064600 legacy=0x7fd2b40a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.077+0000 7fd2b2ffd700 1 -- 172.21.15.31:0/206599226 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841500921 0 0) 0x7fd2b4063b30 con 0x7fd2b4064600 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2b8f5c700 1 -- 172.21.15.31:0/206599226 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b4061ee0 con 0x7fd2b4063680 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2b37fe700 1 --2- 172.21.15.31:0/206599226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4062fb0 0x7fd2b4133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2b8f5c700 1 --2- 172.21.15.31:0/206599226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 0x7fd2b413d930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fd2b4063cc0 tx=0x7fd2ac00b530).ready entity=mon.0 client_cookie=f594e846afeb4791 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2b2ffd700 1 -- 172.21.15.31:0/206599226 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac00dde0 con 0x7fd2b4063680 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2b2ffd700 1 -- 172.21.15.31:0/206599226 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac010470 con 0x7fd2b4063680 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2b2ffd700 1 -- 172.21.15.31:0/206599226 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac0107d0 con 0x7fd2b4063680 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/206599226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 msgr2=0x7fd2b413d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2ba9bf700 1 --2- 172.21.15.31:0/206599226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 0x7fd2b413d930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fd2b4063cc0 tx=0x7fd2ac00b530).stop 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/206599226 shutdown_connections 2024-04-18T10:36:22.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2ba9bf700 1 --2- 172.21.15.31:0/206599226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 0x7fd2b413d930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2ba9bf700 1 --2- 172.21.15.31:0/206599226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4062fb0 0x7fd2b4133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/206599226 >> 172.21.15.31:0/206599226 conn(0x7fd2b406c0c0 msgr2=0x7fd2b406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/206599226 shutdown_connections 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.078+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/206599226 wait complete. 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.079+0000 7fd2ba9bf700 1 Processor -- start 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.079+0000 7fd2ba9bf700 1 -- start start 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2ba9bf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 0x7fd2b4148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2ba9bf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2b4064600 0x7fd2b41490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2ba9bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4098dd0 0x7fd2b41495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2ba9bf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b4149a90 con 0x7fd2b4063680 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2ba9bf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b40673c0 con 0x7fd2b4098dd0 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2ba9bf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b4067150 con 0x7fd2b4064600 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 0x7fd2b4148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b8f5c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4098dd0 0x7fd2b41495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 0x7fd2b4148bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53904/0 (socket says 172.21.15.31:53904) 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b3fff700 1 -- 172.21.15.31:0/463349332 learned_addr learned my addr 172.21.15.31:0/463349332 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b37fe700 1 --2- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2b4064600 0x7fd2b41490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b3fff700 1 -- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2b4064600 msgr2=0x7fd2b41490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b3fff700 1 --2- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2b4064600 0x7fd2b41490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b3fff700 1 -- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4098dd0 msgr2=0x7fd2b41495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b3fff700 1 --2- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4098dd0 0x7fd2b41495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b3fff700 1 -- 172.21.15.31:0/463349332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a800b180 con 0x7fd2b4063680 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b8f5c700 1 --2- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4098dd0 0x7fd2b41495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.080+0000 7fd2b3fff700 1 --2- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 0x7fd2b4148bc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd2b409cfc0 tx=0x7fd2a4007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.081+0000 7fd2b17fa700 1 -- 172.21.15.31:0/463349332 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2a40070d0 con 0x7fd2b4063680 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.081+0000 7fd2b17fa700 1 -- 172.21.15.31:0/463349332 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a4007230 con 0x7fd2b4063680 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.081+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac00b7d0 con 0x7fd2b4063680 2024-04-18T10:36:22.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.081+0000 7fd2b17fa700 1 -- 172.21.15.31:0/463349332 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2a4005550 con 0x7fd2b4063680 2024-04-18T10:36:22.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.081+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b4098170 con 0x7fd2b4063680 2024-04-18T10:36:22.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.081+0000 7fd2b17fa700 1 -- 172.21.15.31:0/463349332 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd2a4010070 con 0x7fd2b4063680 2024-04-18T10:36:22.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.082+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b40a6e60 con 0x7fd2b4063680 2024-04-18T10:36:22.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.082+0000 7fd2b17fa700 1 -- 172.21.15.31:0/463349332 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd2a4049e20 con 0x7fd2b4063680 2024-04-18T10:36:22.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.085+0000 7fd2b17fa700 1 -- 172.21.15.31:0/463349332 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd2a402ed20 con 0x7fd2b4063680 2024-04-18T10:36:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.233+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2b41336c0 con 0x7fd2b4063680 2024-04-18T10:36:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.233+0000 7fd2b17fa700 1 -- 172.21.15.31:0/463349332 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2325 (secure 0 0 0) 0x7fd2a4032340 con 0x7fd2b4063680 2024-04-18T10:36:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:22.234 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:11.997545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.234+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 >> v1:172.21.15.31:6816/39551 conn(0x7fd294038ec0 legacy=0x7fd29403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.234+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 msgr2=0x7fd2b4148bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.234+0000 7fd2ba9bf700 1 --2- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 0x7fd2b4148bc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd2b409cfc0 tx=0x7fd2a4007c30).stop 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.235+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 shutdown_connections 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.235+0000 7fd2ba9bf700 1 --2- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2b4098dd0 0x7fd2b41495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.235+0000 7fd2ba9bf700 1 --2- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2b4063680 0x7fd2b4148bc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.235+0000 7fd2ba9bf700 1 --2- 172.21.15.31:0/463349332 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2b4064600 0x7fd2b41490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.235+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 >> 172.21.15.31:0/463349332 conn(0x7fd2b406c0c0 msgr2=0x7fd2b405b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.235+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 shutdown_connections 2024-04-18T10:36:22.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.235+0000 7fd2ba9bf700 1 -- 172.21.15.31:0/463349332 wait complete. 2024-04-18T10:36:22.236 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-18T10:36:22.245 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:22.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.352+0000 7f1a99275700 1 Processor -- start 2024-04-18T10:36:22.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.352+0000 7f1a99275700 1 -- start start 2024-04-18T10:36:22.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.352+0000 7f1a99275700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a940655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.352+0000 7f1a99275700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a94134d70 0x7f1a940646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.352+0000 7f1a99275700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a941343e0 con 0x7f1a94064260 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.352+0000 7f1a99275700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a941341f0 con 0x7f1a94134d70 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.352+0000 7f1a99275700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94064bd0 con 0x7f1a9405b970 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.352+0000 7f1a937fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a94134d70 0x7f1a940646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.352+0000 7f1a927fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1a94064260 0x7f1a94134660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45576/0 (socket says 172.21.15.31:45576) 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a937fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a94134d70 0x7f1a940646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53912/0 (socket says 172.21.15.31:53912) 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a92ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a940655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a937fe700 1 -- 172.21.15.31:0/3390981888 learned_addr learned my addr 172.21.15.31:0/3390981888 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a937fe700 1 -- 172.21.15.31:0/3390981888 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 msgr2=0x7f1a940655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a937fe700 1 --2- 172.21.15.31:0/3390981888 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a940655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a937fe700 1 -- 172.21.15.31:0/3390981888 >> v1:172.21.15.31:6789/0 conn(0x7f1a94064260 legacy=0x7f1a94134660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a937fe700 1 -- 172.21.15.31:0/3390981888 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a94064e50 con 0x7f1a94134d70 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a92ffd700 1 --2- 172.21.15.31:0/3390981888 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a940655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:22.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a91ffb700 1 -- 172.21.15.31:0/3390981888 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712965283 0 0) 0x7f1a941343e0 con 0x7f1a94064260 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a937fe700 1 --2- 172.21.15.31:0/3390981888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94134d70 0x7f1a940646e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1a94064d10 tx=0x7f1a8c009290).ready entity=mon.0 client_cookie=4fa4c4665622916c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a91ffb700 1 -- 172.21.15.31:0/3390981888 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a8c00b860 con 0x7f1a94134d70 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a91ffb700 1 -- 172.21.15.31:0/3390981888 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00b9c0 con 0x7f1a94134d70 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.353+0000 7f1a91ffb700 1 -- 172.21.15.31:0/3390981888 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a8c00bb30 con 0x7f1a94134d70 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.354+0000 7f1a99275700 1 -- 172.21.15.31:0/3390981888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94134d70 msgr2=0x7f1a940646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.354+0000 7f1a99275700 1 --2- 172.21.15.31:0/3390981888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94134d70 0x7f1a940646e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1a94064d10 tx=0x7f1a8c009290).stop 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.354+0000 7f1a99275700 1 -- 172.21.15.31:0/3390981888 shutdown_connections 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.354+0000 7f1a99275700 1 --2- 172.21.15.31:0/3390981888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94134d70 0x7f1a940646e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.354+0000 7f1a99275700 1 --2- 172.21.15.31:0/3390981888 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a940655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.354+0000 7f1a99275700 1 -- 172.21.15.31:0/3390981888 >> 172.21.15.31:0/3390981888 conn(0x7f1a9406c0c0 msgr2=0x7f1a9406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.354+0000 7f1a99275700 1 -- 172.21.15.31:0/3390981888 shutdown_connections 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.354+0000 7f1a99275700 1 -- 172.21.15.31:0/3390981888 wait complete. 2024-04-18T10:36:22.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a99275700 1 Processor -- start 2024-04-18T10:36:22.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a99275700 1 -- start start 2024-04-18T10:36:22.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a99275700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a94136600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a99275700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94064260 0x7f1a941354f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a99275700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a94134d70 0x7f1a941359e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a99275700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a941386b0 con 0x7f1a94064260 2024-04-18T10:36:22.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a99275700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94092d30 con 0x7f1a94134d70 2024-04-18T10:36:22.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a99275700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94136af0 con 0x7f1a9405b970 2024-04-18T10:36:22.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a92ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a94136600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a92ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a94136600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60284/0 (socket says 172.21.15.31:60284) 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a92ffd700 1 -- 172.21.15.31:0/4187758310 learned_addr learned my addr 172.21.15.31:0/4187758310 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a937fe700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a94134d70 0x7f1a941359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.355+0000 7f1a927fc700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94064260 0x7f1a941354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a92ffd700 1 -- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a94134d70 msgr2=0x7f1a941359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a92ffd700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a94134d70 0x7f1a941359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a92ffd700 1 -- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94064260 msgr2=0x7f1a941354f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a92ffd700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94064260 0x7f1a941354f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a92ffd700 1 -- 172.21.15.31:0/4187758310 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8800b180 con 0x7f1a9405b970 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a927fc700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94064260 0x7f1a941354f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a92ffd700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a94136600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1a8800c000 tx=0x7f1a88006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a83fff700 1 -- 172.21.15.31:0/4187758310 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a8800c7e0 con 0x7f1a9405b970 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a83fff700 1 -- 172.21.15.31:0/4187758310 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8800c940 con 0x7f1a9405b970 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c009530 con 0x7f1a9405b970 2024-04-18T10:36:22.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a83fff700 1 -- 172.21.15.31:0/4187758310 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a8800cca0 con 0x7f1a9405b970 2024-04-18T10:36:22.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.356+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a94093a90 con 0x7f1a9405b970 2024-04-18T10:36:22.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.357+0000 7f1a83fff700 1 -- 172.21.15.31:0/4187758310 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1a8801c460 con 0x7f1a9405b970 2024-04-18T10:36:22.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.357+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a94057a60 con 0x7f1a9405b970 2024-04-18T10:36:22.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.357+0000 7f1a83fff700 1 -- 172.21.15.31:0/4187758310 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1a8804ada0 con 0x7f1a9405b970 2024-04-18T10:36:22.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.360+0000 7f1a83fff700 1 -- 172.21.15.31:0/4187758310 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1a880336d0 con 0x7f1a9405b970 2024-04-18T10:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.478+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a94067d50 con 0x7f1a9405b970 2024-04-18T10:36:22.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.479+0000 7f1a83fff700 1 -- 172.21.15.31:0/4187758310 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f1a8800ce00 con 0x7f1a9405b970 2024-04-18T10:36:22.479 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:22.480 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:09.988938+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.480+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 >> v1:172.21.15.31:6816/39551 conn(0x7f1a70038e30 legacy=0x7f1a7003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.480+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 msgr2=0x7f1a94136600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.480+0000 7f1a99275700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a94136600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f1a8800c000 tx=0x7f1a88006df0).stop 2024-04-18T10:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.481+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 shutdown_connections 2024-04-18T10:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.481+0000 7f1a99275700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1a9405b970 0x7f1a94136600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.481+0000 7f1a99275700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1a94134d70 0x7f1a941359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.481+0000 7f1a99275700 1 --2- 172.21.15.31:0/4187758310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a94064260 0x7f1a941354f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.481+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 >> 172.21.15.31:0/4187758310 conn(0x7f1a9406c0c0 msgr2=0x7f1a94138a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:22.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.481+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 shutdown_connections 2024-04-18T10:36:22.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.481+0000 7f1a99275700 1 -- 172.21.15.31:0/4187758310 wait complete. 2024-04-18T10:36:22.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:36:22.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-18T10:36:22.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.601+0000 7f4bd32fb700 1 Processor -- start 2024-04-18T10:36:22.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.601+0000 7f4bd32fb700 1 -- start start 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd32fb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bcc136710 0x7f4bcc0a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd32fb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc0a5000 0x7f4bcc136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd32fb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc066c10 con 0x7f4bcc05b970 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd32fb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc136fe0 con 0x7f4bcc136710 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd32fb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc066eb0 con 0x7f4bcc0a5000 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd0896700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc0a5000 0x7f4bcc136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd1097700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bcc136710 0x7f4bcc0a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd1898700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4bcc05b970 0x7f4bcc05be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45580/0 (socket says 172.21.15.31:45580) 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd1097700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bcc136710 0x7f4bcc0a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53930/0 (socket says 172.21.15.31:53930) 2024-04-18T10:36:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd1898700 1 -- 172.21.15.31:0/4005302177 learned_addr learned my addr 172.21.15.31:0/4005302177 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd0896700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc0a5000 0x7f4bcc136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:55048/0 (socket says 172.21.15.31:55048) 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bbbfff700 1 -- 172.21.15.31:0/4005302177 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912983694 0 0) 0x7f4bcc066c10 con 0x7f4bcc05b970 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd0896700 1 -- 172.21.15.31:0/4005302177 >> v2:172.21.15.31:3300/0 conn(0x7f4bcc136710 msgr2=0x7f4bcc0a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd0896700 1 --2- 172.21.15.31:0/4005302177 >> v2:172.21.15.31:3300/0 conn(0x7f4bcc136710 0x7f4bcc0a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd0896700 1 -- 172.21.15.31:0/4005302177 >> v1:172.21.15.31:6789/0 conn(0x7f4bcc05b970 legacy=0x7f4bcc05be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd0896700 1 -- 172.21.15.31:0/4005302177 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0a3b40 con 0x7f4bcc0a5000 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd1097700 1 --2- 172.21.15.31:0/4005302177 >> v2:172.21.15.31:3300/0 conn(0x7f4bcc136710 0x7f4bcc0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.602+0000 7f4bd0896700 1 --2- 172.21.15.31:0/4005302177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc0a5000 0x7f4bcc136af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4bc8002f70 tx=0x7f4bc8006df0).ready entity=mon.1 client_cookie=bfa4eb874a353d70 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bbbfff700 1 -- 172.21.15.31:0/4005302177 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc800d570 con 0x7f4bcc0a5000 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bbbfff700 1 -- 172.21.15.31:0/4005302177 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc8000e90 con 0x7f4bcc0a5000 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bbbfff700 1 -- 172.21.15.31:0/4005302177 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc800d8c0 con 0x7f4bcc0a5000 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bd32fb700 1 -- 172.21.15.31:0/4005302177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc0a5000 msgr2=0x7f4bcc136af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bd32fb700 1 --2- 172.21.15.31:0/4005302177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc0a5000 0x7f4bcc136af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4bc8002f70 tx=0x7f4bc8006df0).stop 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bd32fb700 1 -- 172.21.15.31:0/4005302177 shutdown_connections 2024-04-18T10:36:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bd32fb700 1 --2- 172.21.15.31:0/4005302177 >> v2:172.21.15.31:3300/0 conn(0x7f4bcc136710 0x7f4bcc0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bd32fb700 1 --2- 172.21.15.31:0/4005302177 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc0a5000 0x7f4bcc136af0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bd32fb700 1 -- 172.21.15.31:0/4005302177 >> 172.21.15.31:0/4005302177 conn(0x7f4bcc060ac0 msgr2=0x7f4bcc0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:22.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bd32fb700 1 -- 172.21.15.31:0/4005302177 shutdown_connections 2024-04-18T10:36:22.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.603+0000 7f4bd32fb700 1 -- 172.21.15.31:0/4005302177 wait complete. 2024-04-18T10:36:22.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.604+0000 7f4bd32fb700 1 Processor -- start 2024-04-18T10:36:22.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.604+0000 7f4bd32fb700 1 -- start start 2024-04-18T10:36:22.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd32fb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4bcc05b970 0x7f4bcc092c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd32fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0a5000 0x7f4bcc145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd32fb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc136710 0x7f4bcc148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd32fb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc148760 con 0x7f4bcc0a5000 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd32fb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc145f60 con 0x7f4bcc136710 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd32fb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc13a2d0 con 0x7f4bcc05b970 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd1097700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4bcc05b970 0x7f4bcc092c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd1097700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4bcc05b970 0x7f4bcc092c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60298/0 (socket says 172.21.15.31:60298) 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd1097700 1 -- 172.21.15.31:0/1102872134 learned_addr learned my addr 172.21.15.31:0/1102872134 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd1898700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc136710 0x7f4bcc148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.605+0000 7f4bd0896700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0a5000 0x7f4bcc145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bd1097700 1 -- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc136710 msgr2=0x7f4bcc148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bd1097700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc136710 0x7f4bcc148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bd1097700 1 -- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0a5000 msgr2=0x7f4bcc145590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bd1097700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0a5000 0x7f4bcc145590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bd1097700 1 -- 172.21.15.31:0/1102872134 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc00b180 con 0x7f4bcc05b970 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bd1898700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc136710 0x7f4bcc148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bd1097700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4bcc05b970 0x7f4bcc092c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4bbc00c000 tx=0x7f4bbc006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bba7fc700 1 -- 172.21.15.31:0/1102872134 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bbc010780 con 0x7f4bcc05b970 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bba7fc700 1 -- 172.21.15.31:0/1102872134 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc0108e0 con 0x7f4bcc05b970 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc800b180 con 0x7f4bcc05b970 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bba7fc700 1 -- 172.21.15.31:0/1102872134 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bbc010c40 con 0x7f4bcc05b970 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.606+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc139ce0 con 0x7f4bcc05b970 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.607+0000 7f4bba7fc700 1 -- 172.21.15.31:0/1102872134 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4bbc01c460 con 0x7f4bcc05b970 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.607+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc057a60 con 0x7f4bcc05b970 2024-04-18T10:36:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.607+0000 7f4bba7fc700 1 -- 172.21.15.31:0/1102872134 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4bbc04ad50 con 0x7f4bcc05b970 2024-04-18T10:36:22.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.610+0000 7f4bba7fc700 1 -- 172.21.15.31:0/1102872134 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4bbc033680 con 0x7f4bcc05b970 2024-04-18T10:36:22.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.726+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4bcc1451b0 con 0x7f4bcc05b970 2024-04-18T10:36:22.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.727+0000 7f4bba7fc700 1 -- 172.21.15.31:0/1102872134 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4bbc033270 con 0x7f4bcc05b970 2024-04-18T10:36:22.727 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:36:22.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 >> v1:172.21.15.31:6816/39551 conn(0x7f4bac038e30 legacy=0x7f4bac03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4bcc05b970 msgr2=0x7f4bcc092c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4bcc05b970 0x7f4bcc092c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4bbc00c000 tx=0x7f4bbc006df0).stop 2024-04-18T10:36:22.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 shutdown_connections 2024-04-18T10:36:22.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4bcc05b970 0x7f4bcc092c50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4bcc136710 0x7f4bcc148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 --2- 172.21.15.31:0/1102872134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bcc0a5000 0x7f4bcc145590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 >> 172.21.15.31:0/1102872134 conn(0x7f4bcc060ac0 msgr2=0x7f4bcc0a77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:22.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 shutdown_connections 2024-04-18T10:36:22.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.728+0000 7f4bd32fb700 1 -- 172.21.15.31:0/1102872134 wait complete. 2024-04-18T10:36:22.739 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:36:22.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.847+0000 7f3f48a71700 1 Processor -- start 2024-04-18T10:36:22.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f48a71700 1 -- start start 2024-04-18T10:36:22.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f48a71700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f440aa5c0 0x7f3f440aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f48a71700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f44134510 0x7f3f4413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f48a71700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f44064490 con 0x7f3f441340e0 2024-04-18T10:36:22.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f48a71700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440aae90 con 0x7f3f440aa5c0 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f48a71700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44064dc0 con 0x7f3f44134510 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f4259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f440aa5c0 0x7f3f440aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f42d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f44134510 0x7f3f4413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f4259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f440aa5c0 0x7f3f440aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53952/0 (socket says 172.21.15.31:53952) 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f41d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3f441340e0 0x7f3f44063d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45584/0 (socket says 172.21.15.31:45584) 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.848+0000 7f3f4259c700 1 -- 172.21.15.31:0/2130710539 learned_addr learned my addr 172.21.15.31:0/2130710539 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.849+0000 7f3f4259c700 1 -- 172.21.15.31:0/2130710539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f44134510 msgr2=0x7f3f4413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.849+0000 7f3f4259c700 1 --2- 172.21.15.31:0/2130710539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f44134510 0x7f3f4413ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.849+0000 7f3f4259c700 1 -- 172.21.15.31:0/2130710539 >> v1:172.21.15.31:6789/0 conn(0x7f3f441340e0 legacy=0x7f3f44063d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.849+0000 7f3f4159a700 1 -- 172.21.15.31:0/2130710539 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172256751 0 0) 0x7f3f2c001110 con 0x7f3f441340e0 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.849+0000 7f3f4259c700 1 -- 172.21.15.31:0/2130710539 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440650a0 con 0x7f3f440aa5c0 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.849+0000 7f3f4259c700 1 --2- 172.21.15.31:0/2130710539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f440aa5c0 0x7f3f440aa9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3f34002f70 tx=0x7f3f34006eb0).ready entity=mon.0 client_cookie=bb563731c52d57ce server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.849+0000 7f3f4159a700 1 -- 172.21.15.31:0/2130710539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3400d570 con 0x7f3f440aa5c0 2024-04-18T10:36:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.849+0000 7f3f4159a700 1 -- 172.21.15.31:0/2130710539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34000e90 con 0x7f3f440aa5c0 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.849+0000 7f3f4159a700 1 -- 172.21.15.31:0/2130710539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3400d8c0 con 0x7f3f440aa5c0 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.850+0000 7f3f48a71700 1 -- 172.21.15.31:0/2130710539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f440aa5c0 msgr2=0x7f3f440aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.850+0000 7f3f48a71700 1 --2- 172.21.15.31:0/2130710539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f440aa5c0 0x7f3f440aa9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3f34002f70 tx=0x7f3f34006eb0).stop 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.850+0000 7f3f48a71700 1 -- 172.21.15.31:0/2130710539 shutdown_connections 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.850+0000 7f3f48a71700 1 --2- 172.21.15.31:0/2130710539 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f44134510 0x7f3f4413ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.850+0000 7f3f48a71700 1 --2- 172.21.15.31:0/2130710539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f440aa5c0 0x7f3f440aa9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.850+0000 7f3f48a71700 1 -- 172.21.15.31:0/2130710539 >> 172.21.15.31:0/2130710539 conn(0x7f3f4406c0c0 msgr2=0x7f3f4406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.850+0000 7f3f48a71700 1 -- 172.21.15.31:0/2130710539 shutdown_connections 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.850+0000 7f3f48a71700 1 -- 172.21.15.31:0/2130710539 wait complete. 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f48a71700 1 Processor -- start 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f48a71700 1 -- start start 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f48a71700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f440aa5c0 0x7f3f441354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f48a71700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f441340e0 0x7f3f44145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f48a71700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f44067d00 0x7f3f44145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f48a71700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44137b50 con 0x7f3f440aa5c0 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f48a71700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f441452a0 con 0x7f3f441340e0 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f48a71700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44135d30 con 0x7f3f44067d00 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f42d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f44067d00 0x7f3f44145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f41d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f441340e0 0x7f3f44145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f42d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f44067d00 0x7f3f44145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60308/0 (socket says 172.21.15.31:60308) 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f42d9d700 1 -- 172.21.15.31:0/2128946738 learned_addr learned my addr 172.21.15.31:0/2128946738 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.851+0000 7f3f4259c700 1 --2- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f440aa5c0 0x7f3f441354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f41d9b700 1 -- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f44067d00 msgr2=0x7f3f44145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f41d9b700 1 --2- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f44067d00 0x7f3f44145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f41d9b700 1 -- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f440aa5c0 msgr2=0x7f3f441354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f41d9b700 1 --2- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f440aa5c0 0x7f3f441354e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f41d9b700 1 -- 172.21.15.31:0/2128946738 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3400b1e0 con 0x7f3f441340e0 2024-04-18T10:36:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f41d9b700 1 --2- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f441340e0 0x7f3f44145700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3f44067500 tx=0x7f3f2c007840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f3b7fe700 1 -- 172.21.15.31:0/2128946738 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f2c00cdf0 con 0x7f3f441340e0 2024-04-18T10:36:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f3b7fe700 1 -- 172.21.15.31:0/2128946738 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c0070d0 con 0x7f3f441340e0 2024-04-18T10:36:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f441460e0 con 0x7f3f441340e0 2024-04-18T10:36:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f3b7fe700 1 -- 172.21.15.31:0/2128946738 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f2c007430 con 0x7f3f441340e0 2024-04-18T10:36:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.852+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f44137fd0 con 0x7f3f441340e0 2024-04-18T10:36:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.853+0000 7f3f3b7fe700 1 -- 172.21.15.31:0/2128946738 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3f2c010070 con 0x7f3f441340e0 2024-04-18T10:36:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.853+0000 7f3f3b7fe700 1 -- 172.21.15.31:0/2128946738 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3f2c049c60 con 0x7f3f441340e0 2024-04-18T10:36:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.853+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f44064490 con 0x7f3f441340e0 2024-04-18T10:36:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.856+0000 7f3f3b7fe700 1 -- 172.21.15.31:0/2128946738 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3f44064490 con 0x7f3f441340e0 2024-04-18T10:36:22.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.972+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3f44064490 con 0x7f3f441340e0 2024-04-18T10:36:22.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.972+0000 7f3f3b7fe700 1 -- 172.21.15.31:0/2128946738 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3f44064490 con 0x7f3f441340e0 2024-04-18T10:36:22.973 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:36:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 >> v1:172.21.15.31:6816/39551 conn(0x7f3f28038dd0 legacy=0x7f3f2803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f441340e0 msgr2=0x7f3f44145700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 --2- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f441340e0 0x7f3f44145700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3f44067500 tx=0x7f3f2c007840).stop 2024-04-18T10:36:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 shutdown_connections 2024-04-18T10:36:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 --2- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f44067d00 0x7f3f44145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 --2- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f440aa5c0 0x7f3f441354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 --2- 172.21.15.31:0/2128946738 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f441340e0 0x7f3f44145700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:22.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 >> 172.21.15.31:0/2128946738 conn(0x7f3f4406c0c0 msgr2=0x7f3f4406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:22.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 shutdown_connections 2024-04-18T10:36:22.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:22.974+0000 7f3f48a71700 1 -- 172.21.15.31:0/2128946738 wait complete. 2024-04-18T10:36:22.984 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:36:23.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.093+0000 7f3f3243f700 1 Processor -- start 2024-04-18T10:36:23.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.093+0000 7f3f3243f700 1 -- start start 2024-04-18T10:36:23.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f3243f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c1365d0 0x7f3f2c1369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f3243f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c066d80 0x7f3f2c05b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f3243f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f2c0a4f80 0x7f3f2c05be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f3243f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c0660f0 con 0x7f3f2c0a4f80 2024-04-18T10:36:23.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f3243f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0668d0 con 0x7f3f2c066d80 2024-04-18T10:36:23.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f3243f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0a4590 con 0x7f3f2c1365d0 2024-04-18T10:36:23.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c066d80 0x7f3f2c05b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f309dc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f2c0a4f80 0x7f3f2c05be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c1365d0 0x7f3f2c1369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f309dc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f2c0a4f80 0x7f3f2c05be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53966/0 (socket says 172.21.15.31:53966) 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c066d80 0x7f3f2c05b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:55078/0 (socket says 172.21.15.31:55078) 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f309dc700 1 -- 172.21.15.31:0/145856226 learned_addr learned my addr 172.21.15.31:0/145856226 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c1365d0 0x7f3f2c1369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60318/0 (socket says 172.21.15.31:60318) 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2b7fe700 1 -- 172.21.15.31:0/145856226 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c1365d0 msgr2=0x7f3f2c1369b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2b7fe700 1 --2- 172.21.15.31:0/145856226 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c1365d0 0x7f3f2c1369b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2b7fe700 1 -- 172.21.15.31:0/145856226 >> v2:172.21.15.31:3300/0 conn(0x7f3f2c0a4f80 msgr2=0x7f3f2c05be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2b7fe700 1 --2- 172.21.15.31:0/145856226 >> v2:172.21.15.31:3300/0 conn(0x7f3f2c0a4f80 0x7f3f2c05be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2b7fe700 1 -- 172.21.15.31:0/145856226 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c0a4850 con 0x7f3f2c066d80 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f309dc700 1 --2- 172.21.15.31:0/145856226 >> v2:172.21.15.31:3300/0 conn(0x7f3f2c0a4f80 0x7f3f2c05be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.094+0000 7f3f2b7fe700 1 --2- 172.21.15.31:0/145856226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c066d80 0x7f3f2c05b970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3f1c002f70 tx=0x7f3f1c006df0).ready entity=mon.1 client_cookie=4ddcaedc6f46b7b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f2affd700 1 -- 172.21.15.31:0/145856226 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f1c00d4a0 con 0x7f3f2c066d80 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f2affd700 1 -- 172.21.15.31:0/145856226 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c000e90 con 0x7f3f2c066d80 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f2affd700 1 -- 172.21.15.31:0/145856226 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f1c00d7f0 con 0x7f3f2c066d80 2024-04-18T10:36:23.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f3243f700 1 -- 172.21.15.31:0/145856226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c066d80 msgr2=0x7f3f2c05b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f3243f700 1 --2- 172.21.15.31:0/145856226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c066d80 0x7f3f2c05b970 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3f1c002f70 tx=0x7f3f1c006df0).stop 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f3243f700 1 -- 172.21.15.31:0/145856226 shutdown_connections 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f3243f700 1 --2- 172.21.15.31:0/145856226 >> v2:172.21.15.31:3300/0 conn(0x7f3f2c0a4f80 0x7f3f2c05be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f3243f700 1 --2- 172.21.15.31:0/145856226 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c1365d0 0x7f3f2c1369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f3243f700 1 --2- 172.21.15.31:0/145856226 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c066d80 0x7f3f2c05b970 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f3243f700 1 -- 172.21.15.31:0/145856226 >> 172.21.15.31:0/145856226 conn(0x7f3f2c060ac0 msgr2=0x7f3f2c0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f3243f700 1 -- 172.21.15.31:0/145856226 shutdown_connections 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.095+0000 7f3f3243f700 1 -- 172.21.15.31:0/145856226 wait complete. 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.096+0000 7f3f3243f700 1 Processor -- start 2024-04-18T10:36:23.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.096+0000 7f3f3243f700 1 -- start start 2024-04-18T10:36:23.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f3243f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c066d80 0x7f3f2c0926f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f3243f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2c0a4f80 0x7f3f2c0943f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f3243f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c1365d0 0x7f3f2c145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f3243f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c093b30 con 0x7f3f2c0a4f80 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f3243f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c093420 con 0x7f3f2c1365d0 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f3243f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c093d60 con 0x7f3f2c066d80 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c066d80 0x7f3f2c0926f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c066d80 0x7f3f2c0926f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60328/0 (socket says 172.21.15.31:60328) 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2c0a4f80 0x7f3f2c0943f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2bfff700 1 -- 172.21.15.31:0/2425949873 learned_addr learned my addr 172.21.15.31:0/2425949873 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f309dc700 1 --2- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c1365d0 0x7f3f2c145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2bfff700 1 -- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c1365d0 msgr2=0x7f3f2c145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2bfff700 1 --2- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c1365d0 0x7f3f2c145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2bfff700 1 -- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2c0a4f80 msgr2=0x7f3f2c0943f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2bfff700 1 --2- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2c0a4f80 0x7f3f2c0943f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2bfff700 1 -- 172.21.15.31:0/2425949873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24009530 con 0x7f3f2c066d80 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2b7fe700 1 --2- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2c0a4f80 0x7f3f2c0943f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.097+0000 7f3f2bfff700 1 --2- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c066d80 0x7f3f2c0926f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3f2c0a3b80 tx=0x7f3f14006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.098+0000 7f3f297fa700 1 -- 172.21.15.31:0/2425949873 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f14010780 con 0x7f3f2c066d80 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.098+0000 7f3f297fa700 1 -- 172.21.15.31:0/2425949873 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f140108e0 con 0x7f3f2c066d80 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.098+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c00b180 con 0x7f3f2c066d80 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.098+0000 7f3f297fa700 1 -- 172.21.15.31:0/2425949873 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f14010c40 con 0x7f3f2c066d80 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.098+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c092be0 con 0x7f3f2c066d80 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.099+0000 7f3f297fa700 1 -- 172.21.15.31:0/2425949873 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3f1401c460 con 0x7f3f2c066d80 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.099+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2c145570 con 0x7f3f2c066d80 2024-04-18T10:36:23.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.099+0000 7f3f297fa700 1 -- 172.21.15.31:0/2425949873 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3f1404aca0 con 0x7f3f2c066d80 2024-04-18T10:36:23.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.102+0000 7f3f297fa700 1 -- 172.21.15.31:0/2425949873 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3f14033530 con 0x7f3f2c066d80 2024-04-18T10:36:23.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.218+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f2c057a60 con 0x7f3f2c066d80 2024-04-18T10:36:23.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.218+0000 7f3f297fa700 1 -- 172.21.15.31:0/2425949873 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f14033120 con 0x7f3f2c066d80 2024-04-18T10:36:23.219 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 >> v1:172.21.15.31:6816/39551 conn(0x7f3f10038da0 legacy=0x7f3f1003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c066d80 msgr2=0x7f3f2c0926f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 --2- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c066d80 0x7f3f2c0926f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3f2c0a3b80 tx=0x7f3f14006df0).stop 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 shutdown_connections 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 --2- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3f2c066d80 0x7f3f2c0926f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 --2- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3f2c1365d0 0x7f3f2c145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 --2- 172.21.15.31:0/2425949873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2c0a4f80 0x7f3f2c0943f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 >> 172.21.15.31:0/2425949873 conn(0x7f3f2c060ac0 msgr2=0x7f3f2c139da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 shutdown_connections 2024-04-18T10:36:23.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.220+0000 7f3f3243f700 1 -- 172.21.15.31:0/2425949873 wait complete. 2024-04-18T10:36:23.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:36:23.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.339+0000 7fb7f6a37700 1 Processor -- start 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.339+0000 7fb7f6a37700 1 -- start start 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.339+0000 7fb7f6a37700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f005bb30 0x7fb7f0063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.339+0000 7fb7f6a37700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f0062400 0x7fb7f0140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.339+0000 7fb7f6a37700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f0062b80 con 0x7fb7f0061fe0 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.339+0000 7fb7f6a37700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0062e60 con 0x7fb7f0062400 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.339+0000 7fb7f6a37700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0139a40 con 0x7fb7f005bb30 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7f4fd4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f0062400 0x7fb7f0140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7effff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f005bb30 0x7fb7f0063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7ef7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb7f0061fe0 0x7fb7f0139fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45596/0 (socket says 172.21.15.31:45596) 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7ef7fe700 1 -- 172.21.15.31:0/3728917724 learned_addr learned my addr 172.21.15.31:0/3728917724 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:23.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7f4fd4700 1 -- 172.21.15.31:0/3728917724 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f005bb30 msgr2=0x7fb7f0063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7f4fd4700 1 --2- 172.21.15.31:0/3728917724 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f005bb30 0x7fb7f0063360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7eeffd700 1 -- 172.21.15.31:0/3728917724 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543878674 0 0) 0x7fb7f0062b80 con 0x7fb7f0061fe0 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7f4fd4700 1 -- 172.21.15.31:0/3728917724 >> v1:172.21.15.31:6789/0 conn(0x7fb7f0061fe0 legacy=0x7fb7f0139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7f4fd4700 1 -- 172.21.15.31:0/3728917724 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0139d00 con 0x7fb7f0062400 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7effff700 1 --2- 172.21.15.31:0/3728917724 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f005bb30 0x7fb7f0063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7f4fd4700 1 --2- 172.21.15.31:0/3728917724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f0062400 0x7fb7f0140c40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb7e80032f0 tx=0x7fb7e80091d0).ready entity=mon.1 client_cookie=378127472273863 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7eeffd700 1 -- 172.21.15.31:0/3728917724 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e800b6c0 con 0x7fb7f0062400 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7eeffd700 1 -- 172.21.15.31:0/3728917724 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e800b820 con 0x7fb7f0062400 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.340+0000 7fb7eeffd700 1 -- 172.21.15.31:0/3728917724 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e800b990 con 0x7fb7f0062400 2024-04-18T10:36:23.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.341+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3728917724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f0062400 msgr2=0x7fb7f0140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.341+0000 7fb7f6a37700 1 --2- 172.21.15.31:0/3728917724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f0062400 0x7fb7f0140c40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb7e80032f0 tx=0x7fb7e80091d0).stop 2024-04-18T10:36:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.341+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3728917724 shutdown_connections 2024-04-18T10:36:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.341+0000 7fb7f6a37700 1 --2- 172.21.15.31:0/3728917724 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f0062400 0x7fb7f0140c40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.341+0000 7fb7f6a37700 1 --2- 172.21.15.31:0/3728917724 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f005bb30 0x7fb7f0063360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.341+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3728917724 >> 172.21.15.31:0/3728917724 conn(0x7fb7f006c0c0 msgr2=0x7fb7f006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.341+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3728917724 shutdown_connections 2024-04-18T10:36:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.341+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3728917724 wait complete. 2024-04-18T10:36:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7f6a37700 1 Processor -- start 2024-04-18T10:36:23.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7f6a37700 1 -- start start 2024-04-18T10:36:23.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7f6a37700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f005bb30 0x7fb7f00a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7f6a37700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f0061fe0 0x7fb7f0095390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7f6a37700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f0093d60 0x7fb7f0145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7f6a37700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0145d50 con 0x7fb7f0093d60 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7f6a37700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0094730 con 0x7fb7f005bb30 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7f6a37700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f0094c20 con 0x7fb7f0061fe0 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7effff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f005bb30 0x7fb7f00a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7f4fd4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f0093d60 0x7fb7f0145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7effff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f005bb30 0x7fb7f00a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:55110/0 (socket says 172.21.15.31:55110) 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7ef7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f0061fe0 0x7fb7f0095390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.342+0000 7fb7effff700 1 -- 172.21.15.31:0/3705991494 learned_addr learned my addr 172.21.15.31:0/3705991494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7effff700 1 -- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f0061fe0 msgr2=0x7fb7f0095390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7effff700 1 --2- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f0061fe0 0x7fb7f0095390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7effff700 1 -- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f0093d60 msgr2=0x7fb7f0145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7effff700 1 --2- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f0093d60 0x7fb7f0145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7effff700 1 -- 172.21.15.31:0/3705991494 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e000b180 con 0x7fb7f005bb30 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7ef7fe700 1 --2- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f0061fe0 0x7fb7f0095390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7f4fd4700 1 --2- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f0093d60 0x7fb7f0145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7effff700 1 --2- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f005bb30 0x7fb7f00a8ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb7f0094db0 tx=0x7fb7e0006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7ed7fa700 1 -- 172.21.15.31:0/3705991494 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e000c5f0 con 0x7fb7f005bb30 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7ed7fa700 1 -- 172.21.15.31:0/3705991494 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e000c750 con 0x7fb7f005bb30 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e8009470 con 0x7fb7f005bb30 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7ed7fa700 1 -- 172.21.15.31:0/3705991494 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7e000cab0 con 0x7fb7f005bb30 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.343+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f0094210 con 0x7fb7f005bb30 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.344+0000 7fb7ed7fa700 1 -- 172.21.15.31:0/3705991494 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb7e000cc10 con 0x7fb7f005bb30 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.344+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f0095ac0 con 0x7fb7f005bb30 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.344+0000 7fb7ed7fa700 1 -- 172.21.15.31:0/3705991494 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb7e004ae20 con 0x7fb7f005bb30 2024-04-18T10:36:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.347+0000 7fb7ed7fa700 1 -- 172.21.15.31:0/3705991494 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb7e00336b0 con 0x7fb7f005bb30 2024-04-18T10:36:23.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.462+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7f005bf10 con 0x7fb7f005bb30 2024-04-18T10:36:23.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.463+0000 7fb7ed7fa700 1 -- 172.21.15.31:0/3705991494 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7e00332a0 con 0x7fb7f005bb30 2024-04-18T10:36:23.463 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:36:23.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 >> v1:172.21.15.31:6816/39551 conn(0x7fb7d0038da0 legacy=0x7fb7d003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f005bb30 msgr2=0x7fb7f00a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 --2- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f005bb30 0x7fb7f00a8ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb7f0094db0 tx=0x7fb7e0006df0).stop 2024-04-18T10:36:23.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 shutdown_connections 2024-04-18T10:36:23.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 --2- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f0093d60 0x7fb7f0145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 --2- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f005bb30 0x7fb7f00a8ad0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 --2- 172.21.15.31:0/3705991494 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f0061fe0 0x7fb7f0095390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 >> 172.21.15.31:0/3705991494 conn(0x7fb7f006c0c0 msgr2=0x7fb7f0134210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:23.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 shutdown_connections 2024-04-18T10:36:23.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.464+0000 7fb7f6a37700 1 -- 172.21.15.31:0/3705991494 wait complete. 2024-04-18T10:36:23.475 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:23.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.582+0000 7f7a1a836700 1 Processor -- start 2024-04-18T10:36:23.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.582+0000 7f7a1a836700 1 -- start start 2024-04-18T10:36:23.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a1a836700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a14061fe0 0x7f7a14139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a1a836700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14062400 0x7f7a14140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a1a836700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a14062b80 con 0x7f7a1405bb30 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a1a836700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a14062e60 con 0x7f7a14061fe0 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a1a836700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14139a40 con 0x7f7a14062400 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a137fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a14061fe0 0x7f7a14139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a18dd3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14062400 0x7f7a14140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a137fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7a14061fe0 0x7f7a14139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53996/0 (socket says 172.21.15.31:53996) 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a18dd3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14062400 0x7f7a14140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60350/0 (socket says 172.21.15.31:60350) 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a13fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7a1405bb30 0x7f7a14063360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45612/0 (socket says 172.21.15.31:45612) 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a137fe700 1 -- 172.21.15.31:0/1096051884 learned_addr learned my addr 172.21.15.31:0/1096051884 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a18dd3700 1 -- 172.21.15.31:0/1096051884 >> v2:172.21.15.31:3300/0 conn(0x7f7a14061fe0 msgr2=0x7f7a14139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a18dd3700 1 --2- 172.21.15.31:0/1096051884 >> v2:172.21.15.31:3300/0 conn(0x7f7a14061fe0 0x7f7a14139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a18dd3700 1 -- 172.21.15.31:0/1096051884 >> v1:172.21.15.31:6789/0 conn(0x7f7a1405bb30 legacy=0x7f7a14063360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a18dd3700 1 -- 172.21.15.31:0/1096051884 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14139d00 con 0x7f7a14062400 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a12ffd700 1 -- 172.21.15.31:0/1096051884 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099915131 0 0) 0x7f7a14062b80 con 0x7f7a1405bb30 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a137fe700 1 --2- 172.21.15.31:0/1096051884 >> v2:172.21.15.31:3300/0 conn(0x7f7a14061fe0 0x7f7a14139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.583+0000 7f7a18dd3700 1 --2- 172.21.15.31:0/1096051884 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14062400 0x7f7a14140c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7a0c0032f0 tx=0x7f7a0c0091d0).ready entity=mon.2 client_cookie=2ffc92341dd51d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a12ffd700 1 -- 172.21.15.31:0/1096051884 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a0c00b6c0 con 0x7f7a14062400 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a12ffd700 1 -- 172.21.15.31:0/1096051884 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c00b820 con 0x7f7a14062400 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a12ffd700 1 -- 172.21.15.31:0/1096051884 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a0c00b990 con 0x7f7a14062400 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a1a836700 1 -- 172.21.15.31:0/1096051884 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14062400 msgr2=0x7f7a14140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a1a836700 1 --2- 172.21.15.31:0/1096051884 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14062400 0x7f7a14140c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7a0c0032f0 tx=0x7f7a0c0091d0).stop 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a1a836700 1 -- 172.21.15.31:0/1096051884 shutdown_connections 2024-04-18T10:36:23.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a1a836700 1 --2- 172.21.15.31:0/1096051884 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14062400 0x7f7a14140c40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a1a836700 1 --2- 172.21.15.31:0/1096051884 >> v2:172.21.15.31:3300/0 conn(0x7f7a14061fe0 0x7f7a14139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a1a836700 1 -- 172.21.15.31:0/1096051884 >> 172.21.15.31:0/1096051884 conn(0x7f7a1406c0c0 msgr2=0x7f7a1406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:23.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a1a836700 1 -- 172.21.15.31:0/1096051884 shutdown_connections 2024-04-18T10:36:23.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.584+0000 7f7a1a836700 1 -- 172.21.15.31:0/1096051884 wait complete. 2024-04-18T10:36:23.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.585+0000 7f7a1a836700 1 Processor -- start 2024-04-18T10:36:23.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.585+0000 7f7a1a836700 1 -- start start 2024-04-18T10:36:23.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a1a836700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a1405bb30 0x7f7a141491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a1a836700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14061fe0 0x7f7a1412ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a1a836700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a14136590 0x7f7a1412ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a1a836700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14095890 con 0x7f7a14136590 2024-04-18T10:36:23.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a1a836700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a141498d0 con 0x7f7a1405bb30 2024-04-18T10:36:23.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a1a836700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14149b90 con 0x7f7a14061fe0 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a18dd3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a14136590 0x7f7a1412ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a137fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14061fe0 0x7f7a1412ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a13fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a1405bb30 0x7f7a141491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a18dd3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a14136590 0x7f7a1412ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54012/0 (socket says 172.21.15.31:54012) 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a137fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14061fe0 0x7f7a1412ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60362/0 (socket says 172.21.15.31:60362) 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a18dd3700 1 -- 172.21.15.31:0/3571385422 learned_addr learned my addr 172.21.15.31:0/3571385422 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a13fff700 1 -- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14061fe0 msgr2=0x7f7a1412ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a13fff700 1 --2- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14061fe0 0x7f7a1412ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a13fff700 1 -- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a14136590 msgr2=0x7f7a1412ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a13fff700 1 --2- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a14136590 0x7f7a1412ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a13fff700 1 -- 172.21.15.31:0/3571385422 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc00b1e0 con 0x7f7a1405bb30 2024-04-18T10:36:23.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a18dd3700 1 --2- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a14136590 0x7f7a1412ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a137fe700 1 --2- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14061fe0 0x7f7a1412ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.586+0000 7f7a13fff700 1 --2- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a1405bb30 0x7f7a141491a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7a04000bc0 tx=0x7f7a040079e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:23.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.587+0000 7f7a117fa700 1 -- 172.21.15.31:0/3571385422 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a0400ce80 con 0x7f7a1405bb30 2024-04-18T10:36:23.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.587+0000 7f7a117fa700 1 -- 172.21.15.31:0/3571385422 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a040070d0 con 0x7f7a1405bb30 2024-04-18T10:36:23.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.587+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0c009470 con 0x7f7a1405bb30 2024-04-18T10:36:23.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.587+0000 7f7a117fa700 1 -- 172.21.15.31:0/3571385422 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a04005550 con 0x7f7a1405bb30 2024-04-18T10:36:23.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.587+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a14136c70 con 0x7f7a1405bb30 2024-04-18T10:36:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.587+0000 7f7a117fa700 1 -- 172.21.15.31:0/3571385422 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7a04010070 con 0x7f7a1405bb30 2024-04-18T10:36:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.588+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1405bf10 con 0x7f7a1405bb30 2024-04-18T10:36:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.588+0000 7f7a117fa700 1 -- 172.21.15.31:0/3571385422 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7a04049e70 con 0x7f7a1405bb30 2024-04-18T10:36:23.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.591+0000 7f7a117fa700 1 -- 172.21.15.31:0/3571385422 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7a0402f140 con 0x7f7a1405bb30 2024-04-18T10:36:23.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.739+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a14057a60 con 0x7f7a1405bb30 2024-04-18T10:36:23.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.740+0000 7f7a117fa700 1 -- 172.21.15.31:0/3571385422 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2325 (secure 0 0 0) 0x7f7a04032390 con 0x7f7a1405bb30 2024-04-18T10:36:23.740 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:23.740 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:11.997545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:23.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 >> v1:172.21.15.31:6816/39551 conn(0x7f79f8038da0 legacy=0x7f79f803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a1405bb30 msgr2=0x7f7a141491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 --2- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a1405bb30 0x7f7a141491a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7a04000bc0 tx=0x7f7a040079e0).stop 2024-04-18T10:36:23.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 shutdown_connections 2024-04-18T10:36:23.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 --2- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a14136590 0x7f7a1412ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 --2- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7a1405bb30 0x7f7a141491a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 --2- 172.21.15.31:0/3571385422 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7a14061fe0 0x7f7a1412ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 >> 172.21.15.31:0/3571385422 conn(0x7f7a1406c0c0 msgr2=0x7f7a14133230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:23.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 shutdown_connections 2024-04-18T10:36:23.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.741+0000 7f7a1a836700 1 -- 172.21.15.31:0/3571385422 wait complete. 2024-04-18T10:36:23.743 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-18T10:36:23.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:23.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.858+0000 7f20522df700 1 Processor -- start 2024-04-18T10:36:23.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.858+0000 7f20522df700 1 -- start start 2024-04-18T10:36:23.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.858+0000 7f20522df700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f204c136710 0x7f204c0a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.858+0000 7f20522df700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c0a5000 0x7f204c136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.858+0000 7f20522df700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c05b970 0x7f204c05be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.858+0000 7f20522df700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c066c10 con 0x7f204c136710 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.858+0000 7f20522df700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c136fe0 con 0x7f204c0a5000 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.858+0000 7f20522df700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f204c066eb0 con 0x7f204c05b970 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c0a5000 0x7f204c136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f204c136710 0x7f204c0a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f205087c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c05b970 0x7f204c05be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c0a5000 0x7f204c136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:55120/0 (socket says 172.21.15.31:55120) 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f204c136710 0x7f204c0a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54022/0 (socket says 172.21.15.31:54022) 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f205087c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c05b970 0x7f204c05be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60378/0 (socket says 172.21.15.31:60378) 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204b7fe700 1 -- 172.21.15.31:0/3754147782 learned_addr learned my addr 172.21.15.31:0/3754147782 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:23.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f205087c700 1 -- 172.21.15.31:0/3754147782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c0a5000 msgr2=0x7f204c136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f205087c700 1 --2- 172.21.15.31:0/3754147782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c0a5000 0x7f204c136af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f205087c700 1 -- 172.21.15.31:0/3754147782 >> v2:172.21.15.31:3300/0 conn(0x7f204c136710 msgr2=0x7f204c0a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f205087c700 1 --2- 172.21.15.31:0/3754147782 >> v2:172.21.15.31:3300/0 conn(0x7f204c136710 0x7f204c0a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f205087c700 1 -- 172.21.15.31:0/3754147782 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0a3b40 con 0x7f204c05b970 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204b7fe700 1 --2- 172.21.15.31:0/3754147782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c0a5000 0x7f204c136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204bfff700 1 --2- 172.21.15.31:0/3754147782 >> v2:172.21.15.31:3300/0 conn(0x7f204c136710 0x7f204c0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f205087c700 1 --2- 172.21.15.31:0/3754147782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c05b970 0x7f204c05be20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f20440032f0 tx=0x7f20440091d0).ready entity=mon.2 client_cookie=9741f58ef9bb8f08 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204affd700 1 -- 172.21.15.31:0/3754147782 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f204400b600 con 0x7f204c05b970 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204affd700 1 -- 172.21.15.31:0/3754147782 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204400b760 con 0x7f204c05b970 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.859+0000 7f204affd700 1 -- 172.21.15.31:0/3754147782 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f204400b8d0 con 0x7f204c05b970 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.860+0000 7f20522df700 1 -- 172.21.15.31:0/3754147782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c05b970 msgr2=0x7f204c05be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.860+0000 7f20522df700 1 --2- 172.21.15.31:0/3754147782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c05b970 0x7f204c05be20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f20440032f0 tx=0x7f20440091d0).stop 2024-04-18T10:36:23.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.860+0000 7f20522df700 1 -- 172.21.15.31:0/3754147782 shutdown_connections 2024-04-18T10:36:23.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.860+0000 7f20522df700 1 --2- 172.21.15.31:0/3754147782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c05b970 0x7f204c05be20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.860+0000 7f20522df700 1 --2- 172.21.15.31:0/3754147782 >> v2:172.21.15.31:3300/0 conn(0x7f204c136710 0x7f204c0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.860+0000 7f20522df700 1 --2- 172.21.15.31:0/3754147782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c0a5000 0x7f204c136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.860+0000 7f20522df700 1 -- 172.21.15.31:0/3754147782 >> 172.21.15.31:0/3754147782 conn(0x7f204c060ac0 msgr2=0x7f204c0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:23.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.860+0000 7f20522df700 1 -- 172.21.15.31:0/3754147782 shutdown_connections 2024-04-18T10:36:23.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.860+0000 7f20522df700 1 -- 172.21.15.31:0/3754147782 wait complete. 2024-04-18T10:36:23.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f20522df700 1 Processor -- start 2024-04-18T10:36:23.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f20522df700 1 -- start start 2024-04-18T10:36:23.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f20522df700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f204c05b970 0x7f204c0940d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f20522df700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c0a5000 0x7f204c092d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f20522df700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c136710 0x7f204c148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f20522df700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0949d0 con 0x7f204c05b970 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f20522df700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0a1750 con 0x7f204c136710 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f20522df700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f204c093720 con 0x7f204c0a5000 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c0a5000 0x7f204c092d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f204b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c0a5000 0x7f204c092d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60388/0 (socket says 172.21.15.31:60388) 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f205087c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c136710 0x7f204c148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.861+0000 7f204b7fe700 1 -- 172.21.15.31:0/636072224 learned_addr learned my addr 172.21.15.31:0/636072224 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f204bfff700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f204c05b970 0x7f204c0940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f205087c700 1 -- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c0a5000 msgr2=0x7f204c092d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f205087c700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c0a5000 0x7f204c092d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f205087c700 1 -- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f204c05b970 msgr2=0x7f204c0940d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f205087c700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f204c05b970 0x7f204c0940d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f205087c700 1 -- 172.21.15.31:0/636072224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204000b1e0 con 0x7f204c136710 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f204bfff700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f204c05b970 0x7f204c0940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f204b7fe700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c0a5000 0x7f204c092d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f205087c700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c136710 0x7f204c148a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f20440032f0 tx=0x7f2044016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f20497fa700 1 -- 172.21.15.31:0/636072224 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f204400b600 con 0x7f204c136710 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f20497fa700 1 -- 172.21.15.31:0/636072224 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2044011b90 con 0x7f204c136710 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c00b180 con 0x7f204c136710 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f20497fa700 1 -- 172.21.15.31:0/636072224 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f204401f3f0 con 0x7f204c136710 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.862+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2044009470 con 0x7f204c136710 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.863+0000 7f20497fa700 1 -- 172.21.15.31:0/636072224 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f204400f070 con 0x7f204c136710 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.863+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c094660 con 0x7f204c136710 2024-04-18T10:36:23.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.863+0000 7f20497fa700 1 -- 172.21.15.31:0/636072224 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f204404af80 con 0x7f204c136710 2024-04-18T10:36:23.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.866+0000 7f20497fa700 1 -- 172.21.15.31:0/636072224 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f204c094660 con 0x7f204c136710 2024-04-18T10:36:23.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.983+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f204c094620 con 0x7f204c136710 2024-04-18T10:36:23.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.983+0000 7f20497fa700 1 -- 172.21.15.31:0/636072224 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f2044024020 con 0x7f204c136710 2024-04-18T10:36:23.984 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:23.984 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:09.988938+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:23.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 >> v1:172.21.15.31:6816/39551 conn(0x7f202c038dd0 legacy=0x7f202c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c136710 msgr2=0x7f204c148a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:23.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c136710 0x7f204c148a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f20440032f0 tx=0x7f2044016000).stop 2024-04-18T10:36:23.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 shutdown_connections 2024-04-18T10:36:23.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f204c136710 0x7f204c148a30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f204c05b970 0x7f204c0940d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 --2- 172.21.15.31:0/636072224 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f204c0a5000 0x7f204c092d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:23.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 >> 172.21.15.31:0/636072224 conn(0x7f204c060ac0 msgr2=0x7f204c0a7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:23.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 shutdown_connections 2024-04-18T10:36:23.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:23.985+0000 7f20522df700 1 -- 172.21.15.31:0/636072224 wait complete. 2024-04-18T10:36:23.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:24.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.102+0000 7f39d1692700 1 Processor -- start 2024-04-18T10:36:24.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.102+0000 7f39d1692700 1 -- start start 2024-04-18T10:36:24.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39d1692700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc0a8fb0 0x7f39cc133360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39d1692700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc133850 0x7f39cc05cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39d1692700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39cc05cfc0 0x7f39cc0ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39d1692700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc05c360 con 0x7f39cc05cfc0 2024-04-18T10:36:24.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39d1692700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc139630 con 0x7f39cc133850 2024-04-18T10:36:24.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39d1692700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc1398f0 con 0x7f39cc0a8fb0 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39cb7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39cc05cfc0 0x7f39cc0ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39caffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc0a8fb0 0x7f39cc133360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39caffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc0a8fb0 0x7f39cc133360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60402/0 (socket says 172.21.15.31:60402) 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39ca7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc133850 0x7f39cc05cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39cb7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f39cc05cfc0 0x7f39cc0ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54040/0 (socket says 172.21.15.31:54040) 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39caffd700 1 -- 172.21.15.31:0/1918211550 learned_addr learned my addr 172.21.15.31:0/1918211550 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39caffd700 1 -- 172.21.15.31:0/1918211550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc133850 msgr2=0x7f39cc05cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39caffd700 1 --2- 172.21.15.31:0/1918211550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc133850 0x7f39cc05cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39caffd700 1 -- 172.21.15.31:0/1918211550 >> v2:172.21.15.31:3300/0 conn(0x7f39cc05cfc0 msgr2=0x7f39cc0ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39caffd700 1 --2- 172.21.15.31:0/1918211550 >> v2:172.21.15.31:3300/0 conn(0x7f39cc05cfc0 0x7f39cc0ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39caffd700 1 -- 172.21.15.31:0/1918211550 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc0a79a0 con 0x7f39cc0a8fb0 2024-04-18T10:36:24.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39ca7fc700 1 --2- 172.21.15.31:0/1918211550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc133850 0x7f39cc05cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39cb7fe700 1 --2- 172.21.15.31:0/1918211550 >> v2:172.21.15.31:3300/0 conn(0x7f39cc05cfc0 0x7f39cc0ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.103+0000 7f39caffd700 1 --2- 172.21.15.31:0/1918211550 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc0a8fb0 0x7f39cc133360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f39cc0a71c0 tx=0x7f39c0006eb0).ready entity=mon.2 client_cookie=b70494053f146303 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39c9ffb700 1 -- 172.21.15.31:0/1918211550 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c000d570 con 0x7f39cc0a8fb0 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39c9ffb700 1 -- 172.21.15.31:0/1918211550 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c0000e90 con 0x7f39cc0a8fb0 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39c9ffb700 1 -- 172.21.15.31:0/1918211550 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c000d900 con 0x7f39cc0a8fb0 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39d1692700 1 -- 172.21.15.31:0/1918211550 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc0a8fb0 msgr2=0x7f39cc133360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39d1692700 1 --2- 172.21.15.31:0/1918211550 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc0a8fb0 0x7f39cc133360 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f39cc0a71c0 tx=0x7f39c0006eb0).stop 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39d1692700 1 -- 172.21.15.31:0/1918211550 shutdown_connections 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39d1692700 1 --2- 172.21.15.31:0/1918211550 >> v2:172.21.15.31:3300/0 conn(0x7f39cc05cfc0 0x7f39cc0ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39d1692700 1 --2- 172.21.15.31:0/1918211550 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc0a8fb0 0x7f39cc133360 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39d1692700 1 --2- 172.21.15.31:0/1918211550 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc133850 0x7f39cc05cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39d1692700 1 -- 172.21.15.31:0/1918211550 >> 172.21.15.31:0/1918211550 conn(0x7f39cc067a50 msgr2=0x7f39cc066a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39d1692700 1 -- 172.21.15.31:0/1918211550 shutdown_connections 2024-04-18T10:36:24.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.104+0000 7f39d1692700 1 -- 172.21.15.31:0/1918211550 wait complete. 2024-04-18T10:36:24.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.105+0000 7f39d1692700 1 Processor -- start 2024-04-18T10:36:24.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.105+0000 7f39d1692700 1 -- start start 2024-04-18T10:36:24.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39d1692700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc05cfc0 0x7f39cc0a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39d1692700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc0a8fb0 0x7f39cc148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39d1692700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39cc133850 0x7f39cc149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39d1692700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0a1dd0 con 0x7f39cc133850 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39d1692700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0a2310 con 0x7f39cc0a8fb0 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39d1692700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc0abfa0 con 0x7f39cc05cfc0 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39caffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc05cfc0 0x7f39cc0a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39cb7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39cc133850 0x7f39cc149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39caffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc05cfc0 0x7f39cc0a1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:60410/0 (socket says 172.21.15.31:60410) 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39caffd700 1 -- 172.21.15.31:0/3741672774 learned_addr learned my addr 172.21.15.31:0/3741672774 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39ca7fc700 1 --2- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc0a8fb0 0x7f39cc148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39cb7fe700 1 -- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc05cfc0 msgr2=0x7f39cc0a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39cb7fe700 1 --2- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc05cfc0 0x7f39cc0a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39cb7fe700 1 -- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc0a8fb0 msgr2=0x7f39cc148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39cb7fe700 1 --2- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc0a8fb0 0x7f39cc148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39cb7fe700 1 -- 172.21.15.31:0/3741672774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4009470 con 0x7f39cc133850 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39ca7fc700 1 --2- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc0a8fb0 0x7f39cc148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39cb7fe700 1 --2- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39cc133850 0x7f39cc149190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f39c400c000 tx=0x7f39c40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39bbfff700 1 -- 172.21.15.31:0/3741672774 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c400c820 con 0x7f39cc133850 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39bbfff700 1 -- 172.21.15.31:0/3741672774 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c400c980 con 0x7f39cc133850 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc00b180 con 0x7f39cc133850 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.106+0000 7f39bbfff700 1 -- 172.21.15.31:0/3741672774 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c400cce0 con 0x7f39cc133850 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.107+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c000b1e0 con 0x7f39cc133850 2024-04-18T10:36:24.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.107+0000 7f39bbfff700 1 -- 172.21.15.31:0/3741672774 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f39c4022070 con 0x7f39cc133850 2024-04-18T10:36:24.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.107+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc0a1120 con 0x7f39cc133850 2024-04-18T10:36:24.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.108+0000 7f39bbfff700 1 -- 172.21.15.31:0/3741672774 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f39c404b000 con 0x7f39cc133850 2024-04-18T10:36:24.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.111+0000 7f39bbfff700 1 -- 172.21.15.31:0/3741672774 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f39cc0a1120 con 0x7f39cc133850 2024-04-18T10:36:24.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.260+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39cc0a1120 con 0x7f39cc133850 2024-04-18T10:36:24.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.260+0000 7f39bbfff700 1 -- 172.21.15.31:0/3741672774 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2325 (secure 0 0 0) 0x7f39cc0a1120 con 0x7f39cc133850 2024-04-18T10:36:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:24.261 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:11.997545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.261+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 >> v1:172.21.15.31:6816/39551 conn(0x7f39a8038da0 legacy=0x7f39a803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.262+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39cc133850 msgr2=0x7f39cc149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.262+0000 7f39d1692700 1 --2- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39cc133850 0x7f39cc149190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f39c400c000 tx=0x7f39c40091d0).stop 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.262+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 shutdown_connections 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.262+0000 7f39d1692700 1 --2- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f39cc05cfc0 0x7f39cc0a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.262+0000 7f39d1692700 1 --2- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f39cc133850 0x7f39cc149190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.262+0000 7f39d1692700 1 --2- 172.21.15.31:0/3741672774 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f39cc0a8fb0 0x7f39cc148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.262+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 >> 172.21.15.31:0/3741672774 conn(0x7f39cc067a50 msgr2=0x7f39cc133000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.262+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 shutdown_connections 2024-04-18T10:36:24.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.262+0000 7f39d1692700 1 -- 172.21.15.31:0/3741672774 wait complete. 2024-04-18T10:36:24.263 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-18T10:36:24.575 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:11.997545+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:24.575 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-04-18T10:36:24.575 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-18T10:36:24.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.684+0000 7f4ed018c700 1 Processor -- start 2024-04-18T10:36:24.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.684+0000 7f4ed018c700 1 -- start start 2024-04-18T10:36:24.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ed018c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ec805bb30 0x7f4ec8063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ed018c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec8061fe0 0x7f4ec8139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ed018c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec8062b80 con 0x7f4ec8062400 2024-04-18T10:36:24.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ed018c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec8062e60 con 0x7f4ec805bb30 2024-04-18T10:36:24.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ed018c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec8139a40 con 0x7f4ec8061fe0 2024-04-18T10:36:24.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecdf28700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ec805bb30 0x7f4ec8063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecd727700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec8061fe0 0x7f4ec8139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecdf28700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ec805bb30 0x7f4ec8063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52252/0 (socket says 172.21.15.31:52252) 2024-04-18T10:36:24.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecd727700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec8061fe0 0x7f4ec8139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59492/0 (socket says 172.21.15.31:59492) 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecdf28700 1 -- 172.21.15.31:0/114498468 learned_addr learned my addr 172.21.15.31:0/114498468 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecdf28700 1 -- 172.21.15.31:0/114498468 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec8061fe0 msgr2=0x7f4ec8139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/114498468 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec8061fe0 0x7f4ec8139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecdf28700 1 -- 172.21.15.31:0/114498468 >> v1:172.21.15.31:6789/0 conn(0x7f4ec8062400 legacy=0x7f4ec80a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecdf28700 1 -- 172.21.15.31:0/114498468 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8139d00 con 0x7f4ec805bb30 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4eccf26700 1 -- 172.21.15.31:0/114498468 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601053070 0 0) 0x7f4ec8062b80 con 0x7f4ec8062400 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecd727700 1 --2- 172.21.15.31:0/114498468 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec8061fe0 0x7f4ec8139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/114498468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec805bb30 0x7f4ec8063360 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4eb8002f70 tx=0x7f4eb8006eb0).ready entity=mon.0 client_cookie=2d564c3e43f675b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.685+0000 7f4eccf26700 1 -- 172.21.15.31:0/114498468 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb800d570 con 0x7f4ec805bb30 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4eccf26700 1 -- 172.21.15.31:0/114498468 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb8000e90 con 0x7f4ec805bb30 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4eccf26700 1 -- 172.21.15.31:0/114498468 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb800d8c0 con 0x7f4ec805bb30 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4ed018c700 1 -- 172.21.15.31:0/114498468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec805bb30 msgr2=0x7f4ec8063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4ed018c700 1 --2- 172.21.15.31:0/114498468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec805bb30 0x7f4ec8063360 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4eb8002f70 tx=0x7f4eb8006eb0).stop 2024-04-18T10:36:24.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4ed018c700 1 -- 172.21.15.31:0/114498468 shutdown_connections 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4ed018c700 1 --2- 172.21.15.31:0/114498468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec805bb30 0x7f4ec8063360 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4ed018c700 1 --2- 172.21.15.31:0/114498468 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec8061fe0 0x7f4ec8139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4ed018c700 1 -- 172.21.15.31:0/114498468 >> 172.21.15.31:0/114498468 conn(0x7f4ec806c0c0 msgr2=0x7f4ec806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4ed018c700 1 -- 172.21.15.31:0/114498468 shutdown_connections 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.686+0000 7f4ed018c700 1 -- 172.21.15.31:0/114498468 wait complete. 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.687+0000 7f4ed018c700 1 Processor -- start 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.687+0000 7f4ed018c700 1 -- start start 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ed018c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec805bb30 0x7f4ec80986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ed018c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec8061fe0 0x7f4ec81490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ed018c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec8130aa0 0x7f4ec8130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ed018c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80973a0 con 0x7f4ec8130aa0 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ed018c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81496d0 con 0x7f4ec8061fe0 2024-04-18T10:36:24.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ed018c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec8149970 con 0x7f4ec805bb30 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ecdf28700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec805bb30 0x7f4ec80986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ecdf28700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec805bb30 0x7f4ec80986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59496/0 (socket says 172.21.15.31:59496) 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ecdf28700 1 -- 172.21.15.31:0/1480433415 learned_addr learned my addr 172.21.15.31:0/1480433415 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ece729700 1 --2- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec8130aa0 0x7f4ec8130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ecdf28700 1 -- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec8061fe0 msgr2=0x7f4ec81490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec8061fe0 0x7f4ec81490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ecdf28700 1 -- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec8130aa0 msgr2=0x7f4ec8130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec8130aa0 0x7f4ec8130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ecdf28700 1 -- 172.21.15.31:0/1480433415 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec400b180 con 0x7f4ec805bb30 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.688+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec805bb30 0x7f4ec80986b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4eb8002f70 tx=0x7f4eb8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.689+0000 7f4eb6ffd700 1 -- 172.21.15.31:0/1480433415 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb8011860 con 0x7f4ec805bb30 2024-04-18T10:36:24.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.689+0000 7f4eb6ffd700 1 -- 172.21.15.31:0/1480433415 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb80119c0 con 0x7f4ec805bb30 2024-04-18T10:36:24.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.689+0000 7f4eb6ffd700 1 -- 172.21.15.31:0/1480433415 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb8011d20 con 0x7f4ec805bb30 2024-04-18T10:36:24.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.689+0000 7f4ed018c700 1 -- 172.21.15.31:0/1480433415 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb800b1e0 con 0x7f4ec805bb30 2024-04-18T10:36:24.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.689+0000 7f4ed018c700 1 -- 172.21.15.31:0/1480433415 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec8097aa0 con 0x7f4ec805bb30 2024-04-18T10:36:24.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.689+0000 7f4eb6ffd700 1 -- 172.21.15.31:0/1480433415 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4eb801a040 con 0x7f4ec805bb30 2024-04-18T10:36:24.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.690+0000 7f4eb6ffd700 1 -- 172.21.15.31:0/1480433415 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4eb804b780 con 0x7f4ec805bb30 2024-04-18T10:36:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.693+0000 7f4ee1c13b80 1 Processor -- start 2024-04-18T10:36:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.693+0000 7f4ee1c13b80 1 -- start start 2024-04-18T10:36:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a83f1d0 0x55643a832a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a83f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a844590 0x55643a844a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55643a7e0a10 con 0x55643a844590 2024-04-18T10:36:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55643a785e10 con 0x55643a83f1d0 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55643a7568b0 con 0x55643a83f5b0 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ece729700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a844590 0x55643a844a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ecd727700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a83f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ece729700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a844590 0x55643a844a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52272/0 (socket says 172.21.15.31:52272) 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ecd727700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a83f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59506/0 (socket says 172.21.15.31:59506) 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ece729700 1 -- 172.21.15.31:0/3629891387 learned_addr learned my addr 172.21.15.31:0/3629891387 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a83f1d0 0x55643a832a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ece729700 1 -- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 msgr2=0x55643a83f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ece729700 1 --2- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a83f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ece729700 1 -- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a83f1d0 msgr2=0x55643a832a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ece729700 1 --2- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a83f1d0 0x55643a832a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ece729700 1 -- 172.21.15.31:0/3629891387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55643a7ece20 con 0x55643a844590 2024-04-18T10:36:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ecd727700 1 --2- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a83f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ece729700 1 --2- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a844590 0x55643a844a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4ec000d000 tx=0x7f4ec0007d30).ready entity=mon.0 client_cookie=905cb6d2ac5ceff8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ed018c700 1 -- 172.21.15.31:0/3629891387 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ec00107e0 con 0x55643a844590 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ed018c700 1 -- 172.21.15.31:0/3629891387 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec0010940 con 0x55643a844590 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.694+0000 7f4ed018c700 1 -- 172.21.15.31:0/3629891387 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ec0010ca0 con 0x55643a844590 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a844590 msgr2=0x55643a844a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a844590 0x55643a844a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4ec000d000 tx=0x7f4ec0007d30).stop 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/3629891387 shutdown_connections 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a844590 0x55643a844a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a83f1d0 0x55643a832a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/3629891387 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a83f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/3629891387 >> 172.21.15.31:0/3629891387 conn(0x55643a7de970 msgr2=0x55643a738690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/3629891387 shutdown_connections 2024-04-18T10:36:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/3629891387 wait complete. 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.695+0000 7f4ee1c13b80 1 -- start start 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ee1c13b80 1 Processor -- start 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a84df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 0x55643a84a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55643a76a180 con 0x55643a83f5b0 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55643a74a7f0 con 0x55643a844590 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55643a73a710 con 0x55643a83f1d0 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ee1c13b80 10 client.0 ll_register_callbacks cb 0x55643a75f570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ecdf28700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a84df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ece729700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ecdf28700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a84df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59516/0 (socket says 172.21.15.31:59516) 2024-04-18T10:36:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.696+0000 7f4ecdf28700 1 -- 172.21.15.31:0/4117640747 learned_addr learned my addr 172.21.15.31:0/4117640747 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ecdf28700 1 -- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 msgr2=0x55643a84ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ecdf28700 1 -- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 msgr2=0x55643a84a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 0x55643a84a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ecdf28700 1 -- 172.21.15.31:0/4117640747 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec400ba00 con 0x55643a83f1d0 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ece729700 1 --2- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a84df10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4eb8001b30 tx=0x7f4eb801e000).ready entity=mon.2 client_cookie=4b96953167e0c8f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ea4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.31:3302/0 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ea4ff9700 1 -- 172.21.15.31:0/4117640747 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb801fe30 con 0x55643a83f1d0 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ea4ff9700 1 -- 172.21.15.31:0/4117640747 <== mon.2 v2:172.21.15.31:3302/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4eb8028040 con 0x55643a83f1d0 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/4117640747 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55643a6e10c0 con 0x55643a83f1d0 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ea4ff9700 1 -- 172.21.15.31:0/4117640747 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4eb8028200 con 0x55643a83f1d0 2024-04-18T10:36:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ee1c13b80 10 client.14444 fetch_fsmap learned FSMap version 8 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/4117640747 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7f4ec000f040 con 0x55643a83f1d0 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ea4ff9700 1 -- 172.21.15.31:0/4117640747 <== mon.2 v2:172.21.15.31:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55643a6e10c0 con 0x55643a83f1d0 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ea4ff9700 1 -- 172.21.15.31:0/4117640747 <== mon.2 v2:172.21.15.31:3302/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f4eb801b030 con 0x55643a83f1d0 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ee1c13b80 10 client.14444 fetch_fsmap finished waiting for FSMap version 8 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ee1c13b80 10 client.14444 resolve_mds: resolved ID 'b' to GID 14138 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ee1c13b80 20 client.14444 populate_metadata read hostname 'smithi031' 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ee1c13b80 4 client.14444 mds_command: new command op to 14138 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.697+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/4117640747 --> v1:172.21.15.31:6817/3448765785 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55643a760230 con 0x55643a837c50 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.698+0000 7f4ea4ff9700 10 client.14444 ms_handle_connect on v1:172.21.15.31:6817/3448765785 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.698+0000 7f4ea4ff9700 1 -- 172.21.15.31:0/4117640747 <== mds.1 v1:172.21.15.31:6817/3448765785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55643a760230 con 0x55643a837c50 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ea4ff9700 10 client.14444 handle_command_reply: tid=0 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 client.14444 shutdown 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 msgr2=0x55643a84df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a84df10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f4eb8001b30 tx=0x7f4eb801e000).stop 2024-04-18T10:36:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/4117640747 shutdown_connections 2024-04-18T10:36:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a84df10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ea4ff9700 0 client.14444 ms_handle_reset on v1:172.21.15.31:6817/3448765785 2024-04-18T10:36:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/4117640747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 0x55643a84a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/4117640747 >> 172.21.15.31:0/4117640747 conn(0x55643a7de970 msgr2=0x55643a733cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/4117640747 shutdown_connections 2024-04-18T10:36:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/4117640747 wait complete. 2024-04-18T10:36:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.699+0000 7f4ee1c13b80 20 client.14444 trim_cache size 0 max 16384 2024-04-18T10:36:24.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.716+0000 7f4ee1c13b80 1 Processor -- start 2024-04-18T10:36:24.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ee1c13b80 1 -- start start 2024-04-18T10:36:24.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a834520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 0x55643a83f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55643a837690 con 0x55643a83f5b0 2024-04-18T10:36:24.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55643a8357c0 con 0x55643a844590 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55643a811d90 con 0x55643a83f1d0 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecd727700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 0x55643a83f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ece729700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecd727700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 0x55643a83f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52280/0 (socket says 172.21.15.31:52280) 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecd727700 1 -- 172.21.15.31:0/114925458 learned_addr learned my addr 172.21.15.31:0/114925458 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ece729700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39330/0 (socket says 172.21.15.31:39330) 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a834520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecd727700 1 -- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 msgr2=0x55643a834520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecd727700 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a834520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecd727700 1 -- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 msgr2=0x55643a84dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecd727700 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecd727700 1 -- 172.21.15.31:0/114925458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55643a759ae0 con 0x55643a83f5b0 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a834520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.717+0000 7f4ece729700 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ecd727700 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 0x55643a83f990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4ec4002f70 tx=0x7f4ec4012610).ready entity=mon.0 client_cookie=563c834264aa57c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ea6ffd700 1 -- 172.21.15.31:0/114925458 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ec4012cb0 con 0x55643a83f5b0 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ea6ffd700 1 -- 172.21.15.31:0/114925458 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec4012e10 con 0x55643a83f5b0 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ea6ffd700 1 -- 172.21.15.31:0/114925458 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ec4016700 con 0x55643a83f5b0 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 msgr2=0x55643a83f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 0x55643a83f990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4ec4002f70 tx=0x7f4ec4012610).stop 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/114925458 shutdown_connections 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f1d0 0x55643a834520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a84dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/114925458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f5b0 0x55643a83f990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/114925458 >> 172.21.15.31:0/114925458 conn(0x55643a7de970 msgr2=0x55643a833a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/114925458 shutdown_connections 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.718+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/114925458 wait complete. 2024-04-18T10:36:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.719+0000 7f4ee1c13b80 1 -- start start 2024-04-18T10:36:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.719+0000 7f4ee1c13b80 1 Processor -- start 2024-04-18T10:36:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f1d0 0x55643a83ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a831f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a832450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55643a836a10 con 0x55643a83f1d0 2024-04-18T10:36:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55643a847750 con 0x55643a844590 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55643a846e70 con 0x55643a83f5b0 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 10 client.0 ll_register_callbacks cb 0x55643a8381e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecd727700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a831f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecdf28700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f1d0 0x55643a83ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ece729700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a832450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ece729700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a832450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39340/0 (socket says 172.21.15.31:39340) 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecdf28700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f1d0 0x55643a83ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52284/0 (socket says 172.21.15.31:52284) 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ece729700 1 -- 172.21.15.31:0/1927651272 learned_addr learned my addr 172.21.15.31:0/1927651272 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecd727700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a831f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59528/0 (socket says 172.21.15.31:59528) 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecd727700 1 -- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 msgr2=0x55643a832450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecd727700 1 --2- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a832450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecd727700 1 -- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f1d0 msgr2=0x55643a83ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecd727700 1 --2- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f1d0 0x55643a83ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecd727700 1 -- 172.21.15.31:0/1927651272 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec000f040 con 0x55643a83f5b0 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecdf28700 1 --2- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f1d0 0x55643a83ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ece729700 1 --2- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a832450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ecd727700 1 --2- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a831f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4ec4002f70 tx=0x7f4ec401d000).ready entity=mon.2 client_cookie=223d5011c5b2bffa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ea5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.31:3302/0 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ea5ffb700 1 -- 172.21.15.31:0/1927651272 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ec4016910 con 0x55643a83f5b0 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ea5ffb700 1 -- 172.21.15.31:0/1927651272 <== mon.2 v2:172.21.15.31:3302/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4ec4016a70 con 0x55643a83f5b0 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/1927651272 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ec0010940 con 0x55643a83f5b0 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ea5ffb700 1 -- 172.21.15.31:0/1927651272 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ec4016c30 con 0x55643a83f5b0 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 10 client.14450 fetch_fsmap learned FSMap version 8 2024-04-18T10:36:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.720+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/1927651272 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55643a7ece20 con 0x55643a83f5b0 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ea5ffb700 1 -- 172.21.15.31:0/1927651272 <== mon.2 v2:172.21.15.31:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec402f070 con 0x55643a83f5b0 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ea5ffb700 1 -- 172.21.15.31:0/1927651272 <== mon.2 v2:172.21.15.31:3302/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f4ec40219c0 con 0x55643a83f5b0 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 10 client.14450 fetch_fsmap finished waiting for FSMap version 8 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 10 client.14450 resolve_mds: resolved ID 'b' to GID 14138 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 20 client.14450 populate_metadata read hostname 'smithi031' 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 4 client.14450 mds_command: new command op to 14138 tid=0[{"prefix": "status"}] 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/1927651272 --> v1:172.21.15.31:6817/3448765785 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55643a758570 con 0x55643a832940 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ea5ffb700 10 client.14450 ms_handle_connect on v1:172.21.15.31:6817/3448765785 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ea5ffb700 1 -- 172.21.15.31:0/1927651272 <== mds.1 v1:172.21.15.31:6817/3448765785 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+300 (unknown 0 0 2395614677) 0x55643a758570 con 0x55643a832940 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ea5ffb700 10 client.14450 handle_command_reply: tid=0 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 1 client.14450 shutdown 2024-04-18T10:36:24.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 msgr2=0x55643a831f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a831f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4ec4002f70 tx=0x7f4ec401d000).stop 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/1927651272 shutdown_connections 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55643a844590 0x55643a832450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55643a83f1d0 0x55643a83ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 1 --2- 172.21.15.31:0/1927651272 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55643a83f5b0 0x55643a831f60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/1927651272 >> 172.21.15.31:0/1927651272 conn(0x55643a7de970 msgr2=0x55643a833800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.721+0000 7f4ea5ffb700 0 client.14450 ms_handle_reset on v1:172.21.15.31:6817/3448765785 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/1927651272 shutdown_connections 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ee1c13b80 1 -- 172.21.15.31:0/1927651272 wait complete. 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ee1c13b80 20 client.14450 trim_cache size 0 max 16384 2024-04-18T10:36:24.729 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "2dc05854-5716-4ea6-add8-fd949f4dd05c", 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 1, 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 14138, 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 13.724925645000001, 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 8, 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 19, 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 19, 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 24.090850521 2024-04-18T10:36:24.730 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:36:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 -- 172.21.15.31:0/1480433415 >> v1:172.21.15.31:6816/39551 conn(0x7f4ea8038e30 legacy=0x7f4ea803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 -- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec805bb30 msgr2=0x7f4ec80986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 --2- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec805bb30 0x7f4ec80986b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f4eb8002f70 tx=0x7f4eb8015000).stop 2024-04-18T10:36:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 -- 172.21.15.31:0/1480433415 shutdown_connections 2024-04-18T10:36:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 --2- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4ec805bb30 0x7f4ec80986b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 --2- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec8130aa0 0x7f4ec8130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 --2- 172.21.15.31:0/1480433415 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4ec8061fe0 0x7f4ec81490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-18T10:36:24.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 -- 172.21.15.31:0/1480433415 >> 172.21.15.31:0/1480433415 conn(0x7f4ec806c0c0 msgr2=0x7f4ec80a7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 -- 172.21.15.31:0/1480433415 shutdown_connections 2024-04-18T10:36:24.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.722+0000 7f4ed018c700 1 -- 172.21.15.31:0/1480433415 wait complete. 2024-04-18T10:36:24.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-18T10:36:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.840+0000 7fe1970c3700 1 Processor -- start 2024-04-18T10:36:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.840+0000 7fe1970c3700 1 -- start start 2024-04-18T10:36:24.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe1970c3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 0x7fe1900a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe1970c3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe19005c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe1970c3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe190066c10 con 0x7fe190136710 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe1970c3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe190066eb0 con 0x7fe1900a5000 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe1970c3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe190136fa0 con 0x7fe190136af0 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 0x7fe1900a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe195660700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe19005c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe194e5f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe190136710 0x7fe19005b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38874/0 (socket says 172.21.15.31:38874) 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe194e5f700 1 -- 172.21.15.31:0/2115552827 learned_addr learned my addr 172.21.15.31:0/2115552827 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe18f7fe700 1 -- 172.21.15.31:0/2115552827 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21244569 0 0) 0x7fe190066c10 con 0x7fe190136710 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe195660700 1 -- 172.21.15.31:0/2115552827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 msgr2=0x7fe1900a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe195660700 1 --2- 172.21.15.31:0/2115552827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 0x7fe1900a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe195660700 1 -- 172.21.15.31:0/2115552827 >> v1:172.21.15.31:6789/0 conn(0x7fe190136710 legacy=0x7fe19005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe195660700 1 -- 172.21.15.31:0/2115552827 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900a3b40 con 0x7fe190136af0 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.841+0000 7fe18ffff700 1 --2- 172.21.15.31:0/2115552827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 0x7fe1900a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe195660700 1 --2- 172.21.15.31:0/2115552827 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe19005c080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe1880032f0 tx=0x7fe1880091d0).ready entity=mon.2 client_cookie=3ae7db6d2c4f35e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe18f7fe700 1 -- 172.21.15.31:0/2115552827 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18800b6c0 con 0x7fe190136af0 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe18f7fe700 1 -- 172.21.15.31:0/2115552827 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18800b820 con 0x7fe190136af0 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe18f7fe700 1 -- 172.21.15.31:0/2115552827 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18800b990 con 0x7fe190136af0 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe1970c3700 1 -- 172.21.15.31:0/2115552827 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 msgr2=0x7fe19005c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe1970c3700 1 --2- 172.21.15.31:0/2115552827 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe19005c080 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe1880032f0 tx=0x7fe1880091d0).stop 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe1970c3700 1 -- 172.21.15.31:0/2115552827 shutdown_connections 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe1970c3700 1 --2- 172.21.15.31:0/2115552827 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe19005c080 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe1970c3700 1 --2- 172.21.15.31:0/2115552827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 0x7fe1900a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe1970c3700 1 -- 172.21.15.31:0/2115552827 >> 172.21.15.31:0/2115552827 conn(0x7fe190060ac0 msgr2=0x7fe1900a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe1970c3700 1 -- 172.21.15.31:0/2115552827 shutdown_connections 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.842+0000 7fe1970c3700 1 -- 172.21.15.31:0/2115552827 wait complete. 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.843+0000 7fe1970c3700 1 Processor -- start 2024-04-18T10:36:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.843+0000 7fe1970c3700 1 -- start start 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe1970c3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 0x7fe190145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe1970c3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe190136710 0x7fe190145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe1970c3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe1901388a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe1970c3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900a2410 con 0x7fe190136710 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe1970c3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1901383b0 con 0x7fe1900a5000 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe1970c3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1901385e0 con 0x7fe190136af0 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe190136710 0x7fe190145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe195660700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe1901388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe190136710 0x7fe190145c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52290/0 (socket says 172.21.15.31:52290) 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe18ffff700 1 -- 172.21.15.31:0/2050283709 learned_addr learned my addr 172.21.15.31:0/2050283709 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.844+0000 7fe194e5f700 1 --2- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 0x7fe190145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe18ffff700 1 -- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 msgr2=0x7fe1901388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe18ffff700 1 --2- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe1901388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe18ffff700 1 -- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 msgr2=0x7fe190145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe18ffff700 1 --2- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 0x7fe190145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe18ffff700 1 -- 172.21.15.31:0/2050283709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c00b180 con 0x7fe190136710 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe195660700 1 --2- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe1901388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe18ffff700 1 --2- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe190136710 0x7fe190145c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fe17c00c000 tx=0x7fe17c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe18dffb700 1 -- 172.21.15.31:0/2050283709 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c00c7e0 con 0x7fe190136710 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe18dffb700 1 -- 172.21.15.31:0/2050283709 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c00c940 con 0x7fe190136710 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe1970c3700 1 -- 172.21.15.31:0/2050283709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe188009470 con 0x7fe190136710 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe18dffb700 1 -- 172.21.15.31:0/2050283709 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17c00cca0 con 0x7fe190136710 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.845+0000 7fe1970c3700 1 -- 172.21.15.31:0/2050283709 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1900a2840 con 0x7fe190136710 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.846+0000 7fe18dffb700 1 -- 172.21.15.31:0/2050283709 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe17c01c460 con 0x7fe190136710 2024-04-18T10:36:24.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.846+0000 7fe18dffb700 1 -- 172.21.15.31:0/2050283709 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe17c04ada0 con 0x7fe190136710 2024-04-18T10:36:24.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.849+0000 7fe1a8b4ab80 1 Processor -- start 2024-04-18T10:36:24.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.849+0000 7fe1a8b4ab80 1 -- start start 2024-04-18T10:36:24.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22f9ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22fa99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22faea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f22f4aa10 con 0x563f22fa91d0 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f22eefe10 con 0x563f22fae590 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x563f22ec08b0 con 0x563f22fa95b0 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe194e5f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22f9ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe194e5f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22f9ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52296/0 (socket says 172.21.15.31:52296) 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe194e5f700 1 -- 172.21.15.31:0/2119021111 learned_addr learned my addr 172.21.15.31:0/2119021111 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe18ffff700 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22fa99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe195660700 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22faea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe194e5f700 1 -- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 msgr2=0x563f22fa99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe194e5f700 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22fa99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe194e5f700 1 -- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 msgr2=0x563f22faea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe194e5f700 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22faea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe194e5f700 1 -- 172.21.15.31:0/2119021111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f22f56e20 con 0x563f22fa91d0 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe195660700 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22faea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe194e5f700 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22f9ca60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe184000bc0 tx=0x7fe1840011a0).ready entity=mon.0 client_cookie=eb47f4e8d523c9d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe1970c3700 1 -- 172.21.15.31:0/2119021111 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe184011c50 con 0x563f22fa91d0 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe1970c3700 1 -- 172.21.15.31:0/2119021111 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184011db0 con 0x563f22fa91d0 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.850+0000 7fe1970c3700 1 -- 172.21.15.31:0/2119021111 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe184015600 con 0x563f22fa91d0 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.851+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 msgr2=0x563f22f9ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.851+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22f9ca60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe184000bc0 tx=0x7fe1840011a0).stop 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.851+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2119021111 shutdown_connections 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.851+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22faea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.851+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22f9ca60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.851+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2119021111 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22fa99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.851+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2119021111 >> 172.21.15.31:0/2119021111 conn(0x563f22f48970 msgr2=0x563f22ea2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.851+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2119021111 shutdown_connections 2024-04-18T10:36:24.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.851+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2119021111 wait complete. 2024-04-18T10:36:24.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.852+0000 7fe1a8b4ab80 1 -- start start 2024-04-18T10:36:24.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.852+0000 7fe1a8b4ab80 1 Processor -- start 2024-04-18T10:36:24.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22fa1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22f9a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22f9ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f22ed4180 con 0x563f22fa91d0 2024-04-18T10:36:24.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f22eb47f0 con 0x563f22fae590 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x563f22ea4710 con 0x563f22fa95b0 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe1a8b4ab80 10 client.0 ll_register_callbacks cb 0x563f22ec9570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe194e5f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22fa1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe195660700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22f9ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe195660700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22f9ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39388/0 (socket says 172.21.15.31:39388) 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe194e5f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22fa1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52308/0 (socket says 172.21.15.31:52308) 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe195660700 1 -- 172.21.15.31:0/2155158171 learned_addr learned my addr 172.21.15.31:0/2155158171 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe18ffff700 1 --2- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22f9a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe195660700 1 -- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 msgr2=0x563f22f9a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe195660700 1 --2- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22f9a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe195660700 1 -- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 msgr2=0x563f22fa1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe195660700 1 --2- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22fa1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe195660700 1 -- 172.21.15.31:0/2155158171 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1900a3b40 con 0x563f22fae590 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe194e5f700 1 --2- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22fa1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe195660700 1 --2- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22f9ac90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x563f22f9ec40 tx=0x7fe188016000).ready entity=mon.1 client_cookie=e80e96b30b58e8e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.853+0000 7fe16f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.31:3301/0 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe16f7fe700 1 -- 172.21.15.31:0/2155158171 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe188006cc0 con 0x563f22fae590 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe16f7fe700 1 -- 172.21.15.31:0/2155158171 <== mon.1 v2:172.21.15.31:3301/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe188023470 con 0x563f22fae590 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2155158171 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f22e4b0c0 con 0x563f22fae590 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe16f7fe700 1 -- 172.21.15.31:0/2155158171 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe188023630 con 0x563f22fae590 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe1a8b4ab80 10 client.4525 fetch_fsmap learned FSMap version 8 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2155158171 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7fe184001760 con 0x563f22fae590 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe16f7fe700 1 -- 172.21.15.31:0/2155158171 <== mon.1 v2:172.21.15.31:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f22e4b0c0 con 0x563f22fae590 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe16f7fe700 1 -- 172.21.15.31:0/2155158171 <== mon.1 v2:172.21.15.31:3301/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7fe18802c400 con 0x563f22fae590 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe1a8b4ab80 10 client.4525 fetch_fsmap finished waiting for FSMap version 8 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe1a8b4ab80 10 client.4525 resolve_mds: resolved ID 'c' to GID 14141 2024-04-18T10:36:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe1a8b4ab80 20 client.4525 populate_metadata read hostname 'smithi031' 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe1a8b4ab80 4 client.4525 mds_command: new command op to 14141 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2155158171 --> v1:172.21.15.31:6819/3321563080 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f22eca230 con 0x563f22facc40 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.854+0000 7fe16f7fe700 10 client.4525 ms_handle_connect on v1:172.21.15.31:6819/3321563080 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe16f7fe700 1 -- 172.21.15.31:0/2155158171 <== mds.0 v1:172.21.15.31:6819/3321563080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x563f22eca230 con 0x563f22facc40 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe16f7fe700 10 client.4525 handle_command_reply: tid=0 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 client.4525 shutdown 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 msgr2=0x563f22f9ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22f9ac90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x563f22f9ec40 tx=0x7fe188016000).stop 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2155158171 shutdown_connections 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fae590 0x563f22f9ac90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fa91d0 0x563f22fa1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe16f7fe700 0 client.4525 ms_handle_reset on v1:172.21.15.31:6819/3321563080 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2155158171 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22f9a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2155158171 >> 172.21.15.31:0/2155158171 conn(0x563f22f48970 msgr2=0x563f22e9dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2155158171 shutdown_connections 2024-04-18T10:36:24.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2155158171 wait complete. 2024-04-18T10:36:24.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.855+0000 7fe1a8b4ab80 20 client.4525 trim_cache size 0 max 16384 2024-04-18T10:36:24.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe1a8b4ab80 1 Processor -- start 2024-04-18T10:36:24.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe1a8b4ab80 1 -- start start 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22fa9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22e9dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f22e9e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f22f7bb60 con 0x563f22fae590 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f22f9bc10 con 0x563f22fa91d0 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x563f22e4b0c0 con 0x563f22fa95b0 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe194e5f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22fa9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe195660700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f22e9e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22e9dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe195660700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f22e9e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52318/0 (socket says 172.21.15.31:52318) 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe194e5f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22fa9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39392/0 (socket says 172.21.15.31:39392) 2024-04-18T10:36:24.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe195660700 1 -- 172.21.15.31:0/1864133858 learned_addr learned my addr 172.21.15.31:0/1864133858 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe194e5f700 1 -- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 msgr2=0x563f22e9dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe194e5f700 1 --2- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22e9dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe194e5f700 1 -- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 msgr2=0x563f22e9e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe194e5f700 1 --2- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f22e9e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe194e5f700 1 -- 172.21.15.31:0/1864133858 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f22ec3ae0 con 0x563f22fa91d0 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.872+0000 7fe18ffff700 1 --2- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22e9dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe195660700 1 --2- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f22e9e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe194e5f700 1 --2- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22fa9990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x563f22fa2080 tx=0x7fe184015000).ready entity=mon.1 client_cookie=4703bdf4f14a9743 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe179ffb700 1 -- 172.21.15.31:0/1864133858 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe184024110 con 0x563f22fa91d0 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe179ffb700 1 -- 172.21.15.31:0/1864133858 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184007030 con 0x563f22fa91d0 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe179ffb700 1 -- 172.21.15.31:0/1864133858 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe184007390 con 0x563f22fa91d0 2024-04-18T10:36:24.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 msgr2=0x563f22fa9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22fa9990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x563f22fa2080 tx=0x7fe184015000).stop 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/1864133858 shutdown_connections 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f22e9e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22fa9990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/1864133858 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f22e9dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/1864133858 >> 172.21.15.31:0/1864133858 conn(0x563f22f48970 msgr2=0x563f22f7b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/1864133858 shutdown_connections 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.873+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/1864133858 wait complete. 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.874+0000 7fe1a8b4ab80 1 -- start start 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.874+0000 7fe1a8b4ab80 1 Processor -- start 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22faee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f23000ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe1a8b4ab80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f23000fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f22fb0210 con 0x563f22fae590 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f22faf820 con 0x563f22fa91d0 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe1a8b4ab80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x563f22fafac0 con 0x563f22fa95b0 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe1a8b4ab80 10 client.0 ll_register_callbacks cb 0x563f22fa2500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe194e5f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22faee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe194e5f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22faee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39398/0 (socket says 172.21.15.31:39398) 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe194e5f700 1 -- 172.21.15.31:0/2409357162 learned_addr learned my addr 172.21.15.31:0/2409357162 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe18ffff700 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f23000ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe195660700 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f23000fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe194e5f700 1 -- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 msgr2=0x563f23000ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe194e5f700 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f23000ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe194e5f700 1 -- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 msgr2=0x563f23000fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe194e5f700 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f23000fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe194e5f700 1 -- 172.21.15.31:0/2409357162 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1900a2840 con 0x563f22fa91d0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe18ffff700 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f23000ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe194e5f700 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22faee90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x563f22fa2080 tx=0x7fe184024000).ready entity=mon.1 client_cookie=30b47913ee20f10a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe178ff9700 10 client.0 ms_handle_connect on v2:172.21.15.31:3301/0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe178ff9700 1 -- 172.21.15.31:0/2409357162 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1840075a0 con 0x563f22fa91d0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe178ff9700 1 -- 172.21.15.31:0/2409357162 <== mon.1 v2:172.21.15.31:3301/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe1840065a0 con 0x563f22fa91d0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2409357162 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe184011db0 con 0x563f22fa91d0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.875+0000 7fe178ff9700 1 -- 172.21.15.31:0/2409357162 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe184000f90 con 0x563f22fa91d0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 10 client.4531 fetch_fsmap learned FSMap version 8 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2409357162 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7fe184001760 con 0x563f22fa91d0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe178ff9700 1 -- 172.21.15.31:0/2409357162 <== mon.1 v2:172.21.15.31:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184011db0 con 0x563f22fa91d0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe178ff9700 1 -- 172.21.15.31:0/2409357162 <== mon.1 v2:172.21.15.31:3301/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7fe184014070 con 0x563f22fa91d0 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 10 client.4531 fetch_fsmap finished waiting for FSMap version 8 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 10 client.4531 resolve_mds: resolved ID 'c' to GID 14141 2024-04-18T10:36:24.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 20 client.4531 populate_metadata read hostname 'smithi031' 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 4 client.4531 mds_command: new command op to 14141 tid=0[{"prefix": "status"}] 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2409357162 --> v1:172.21.15.31:6819/3321563080 -- command(tid 0: {"prefix": "status"}) v1 -- 0x563f22ec2570 con 0x563f22fc5c40 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe178ff9700 10 client.4531 ms_handle_connect on v1:172.21.15.31:6819/3321563080 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe178ff9700 1 -- 172.21.15.31:0/2409357162 <== mds.0 v1:172.21.15.31:6819/3321563080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+299 (unknown 0 0 3619952406) 0x563f22ec2570 con 0x563f22fc5c40 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe178ff9700 10 client.4531 handle_command_reply: tid=0 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 1 client.4531 shutdown 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 msgr2=0x563f22faee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22faee90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x563f22fa2080 tx=0x7fe184024000).stop 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2409357162 shutdown_connections 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563f22fae590 0x563f23000fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x563f22fa91d0 0x563f22faee90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe1a8b4ab80 1 --2- 172.21.15.31:0/2409357162 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x563f22fa95b0 0x563f23000ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.876+0000 7fe178ff9700 0 client.4531 ms_handle_reset on v1:172.21.15.31:6819/3321563080 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2409357162 >> 172.21.15.31:0/2409357162 conn(0x563f22f48970 msgr2=0x563f22f9d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2409357162 shutdown_connections 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1a8b4ab80 1 -- 172.21.15.31:0/2409357162 wait complete. 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1a8b4ab80 20 client.4531 trim_cache size 0 max 16384 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "2dc05854-5716-4ea6-add8-fd949f4dd05c", 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 14141, 2024-04-18T10:36:24.884 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-18T10:36:24.885 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-18T10:36:24.885 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 15.88880868, 2024-04-18T10:36:24.885 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 8, 2024-04-18T10:36:24.885 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 19, 2024-04-18T10:36:24.885 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 19, 2024-04-18T10:36:24.885 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 24.240135608999999 2024-04-18T10:36:24.885 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 -- 172.21.15.31:0/2050283709 >> v1:172.21.15.31:6816/39551 conn(0x7fe170038e60 legacy=0x7fe17003b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 -- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe190136710 msgr2=0x7fe190145c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 --2- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe190136710 0x7fe190145c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fe17c00c000 tx=0x7fe17c006df0).stop 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 -- 172.21.15.31:0/2050283709 shutdown_connections 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 --2- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe190136af0 0x7fe1901388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 --2- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1900a5000 0x7fe190145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 --2- 172.21.15.31:0/2050283709 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe190136710 0x7fe190145c40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 -- 172.21.15.31:0/2050283709 >> 172.21.15.31:0/2050283709 conn(0x7fe190060ac0 msgr2=0x7fe1900a65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 -- 172.21.15.31:0/2050283709 shutdown_connections 2024-04-18T10:36:24.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:24.877+0000 7fe1970c3700 1 -- 172.21.15.31:0/2050283709 wait complete. 2024-04-18T10:36:24.888 INFO:teuthology.run_tasks:Running task exec... 2024-04-18T10:36:24.902 INFO:teuthology.task.exec:Executing custom commands... 2024-04-18T10:36:24.902 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:36:24.903 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client octopus' 2024-04-18T10:36:25.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.007+0000 7fa5b7a52700 1 Processor -- start 2024-04-18T10:36:25.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.007+0000 7fa5b7a52700 1 -- start start 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b7a52700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5b006cb40 0x7fa5b0137b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b7a52700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b0138030 0x7fa5b0134980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b7a52700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b006cf20 con 0x7fa5b0067b70 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b7a52700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b0133fd0 con 0x7fa5b006cb40 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b7a52700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b0066e60 con 0x7fa5b0138030 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b57ee700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5b006cb40 0x7fa5b0137b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b5fef700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b0138030 0x7fa5b0134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b57ee700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5b006cb40 0x7fa5b0137b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52332/0 (socket says 172.21.15.31:52332) 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b57ee700 1 -- 172.21.15.31:0/3799356751 learned_addr learned my addr 172.21.15.31:0/3799356751 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b4fed700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa5b0067b70 0x7fa5b0134270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38882/0 (socket says 172.21.15.31:38882) 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b5fef700 1 -- 172.21.15.31:0/3799356751 >> v2:172.21.15.31:3300/0 conn(0x7fa5b006cb40 msgr2=0x7fa5b0137b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b5fef700 1 --2- 172.21.15.31:0/3799356751 >> v2:172.21.15.31:3300/0 conn(0x7fa5b006cb40 0x7fa5b0137b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b5fef700 1 -- 172.21.15.31:0/3799356751 >> v1:172.21.15.31:6789/0 conn(0x7fa5b0067b70 legacy=0x7fa5b0134270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b5fef700 1 -- 172.21.15.31:0/3799356751 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b01373a0 con 0x7fa5b0138030 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5b5fef700 1 --2- 172.21.15.31:0/3799356751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b0138030 0x7fa5b0134980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa5a80032f0 tx=0x7fa5a80091d0).ready entity=mon.1 client_cookie=474fdb46fa4c0745 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.008+0000 7fa5a7fff700 1 -- 172.21.15.31:0/3799356751 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5a800b6c0 con 0x7fa5b0138030 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5a7fff700 1 -- 172.21.15.31:0/3799356751 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a800b820 con 0x7fa5b0138030 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5a7fff700 1 -- 172.21.15.31:0/3799356751 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5a800b990 con 0x7fa5b0138030 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5b7a52700 1 -- 172.21.15.31:0/3799356751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b0138030 msgr2=0x7fa5b0134980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5b7a52700 1 --2- 172.21.15.31:0/3799356751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b0138030 0x7fa5b0134980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa5a80032f0 tx=0x7fa5a80091d0).stop 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5b7a52700 1 -- 172.21.15.31:0/3799356751 shutdown_connections 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5b7a52700 1 --2- 172.21.15.31:0/3799356751 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b0138030 0x7fa5b0134980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5b7a52700 1 --2- 172.21.15.31:0/3799356751 >> v2:172.21.15.31:3300/0 conn(0x7fa5b006cb40 0x7fa5b0137b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5b7a52700 1 -- 172.21.15.31:0/3799356751 >> 172.21.15.31:0/3799356751 conn(0x7fa5b005cea0 msgr2=0x7fa5b006c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5b7a52700 1 -- 172.21.15.31:0/3799356751 shutdown_connections 2024-04-18T10:36:25.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.009+0000 7fa5b7a52700 1 -- 172.21.15.31:0/3799356751 wait complete. 2024-04-18T10:36:25.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.010+0000 7fa5b7a52700 1 Processor -- start 2024-04-18T10:36:25.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.010+0000 7fa5b7a52700 1 -- start start 2024-04-18T10:36:25.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b7a52700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b006cb40 0x7fa5b0138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b7a52700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5b0132bb0 0x7fa5b0132fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b7a52700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b01334a0 0x7fa5b012a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b7a52700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b013d2e0 con 0x7fa5b006cb40 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b7a52700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b0131620 con 0x7fa5b01334a0 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b7a52700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b012fb30 con 0x7fa5b0132bb0 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b4fed700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5b0132bb0 0x7fa5b0132fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b57ee700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b006cb40 0x7fa5b0138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b4fed700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5b0132bb0 0x7fa5b0132fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59586/0 (socket says 172.21.15.31:59586) 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b4fed700 1 -- 172.21.15.31:0/847730166 learned_addr learned my addr 172.21.15.31:0/847730166 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b5fef700 1 --2- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b01334a0 0x7fa5b012a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b4fed700 1 -- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b01334a0 msgr2=0x7fa5b012a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b4fed700 1 --2- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b01334a0 0x7fa5b012a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b4fed700 1 -- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b006cb40 msgr2=0x7fa5b0138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b4fed700 1 --2- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b006cb40 0x7fa5b0138a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b4fed700 1 -- 172.21.15.31:0/847730166 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a8009470 con 0x7fa5b0132bb0 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b57ee700 1 --2- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b006cb40 0x7fa5b0138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b4fed700 1 --2- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5b0132bb0 0x7fa5b0132fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa5b01317b0 tx=0x7fa5a0007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5a67fc700 1 -- 172.21.15.31:0/847730166 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5a00070d0 con 0x7fa5b0132bb0 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5a67fc700 1 -- 172.21.15.31:0/847730166 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a0007230 con 0x7fa5b0132bb0 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.011+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b012fdd0 con 0x7fa5b0132bb0 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.012+0000 7fa5a67fc700 1 -- 172.21.15.31:0/847730166 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5a0005550 con 0x7fa5b0132bb0 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.012+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b0133950 con 0x7fa5b0132bb0 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.013+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b013d450 con 0x7fa5b0132bb0 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.013+0000 7fa5a67fc700 1 -- 172.21.15.31:0/847730166 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa5a001a070 con 0x7fa5b0132bb0 2024-04-18T10:36:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.013+0000 7fa5a67fc700 1 -- 172.21.15.31:0/847730166 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa5a0049b80 con 0x7fa5b0132bb0 2024-04-18T10:36:25.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.016+0000 7fa5a67fc700 1 -- 172.21.15.31:0/847730166 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa5b013d450 con 0x7fa5b0132bb0 2024-04-18T10:36:25.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.146+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "octopus"} v 0) v1 -- 0x7fa5b013d450 con 0x7fa5b0132bb0 2024-04-18T10:36:25.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.586+0000 7fa5a67fc700 1 -- 172.21.15.31:0/847730166 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "octopus"}]=0 set require_min_compat_client to octopus v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fa5b013d450 con 0x7fa5b0132bb0 2024-04-18T10:36:25.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.588+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 >> v1:172.21.15.31:6816/39551 conn(0x7fa598038dd0 legacy=0x7fa59803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.588+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5b0132bb0 msgr2=0x7fa5b0132fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.588+0000 7fa5b7a52700 1 --2- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5b0132bb0 0x7fa5b0132fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa5b01317b0 tx=0x7fa5a0007c40).stop 2024-04-18T10:36:25.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.589+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 shutdown_connections 2024-04-18T10:36:25.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.589+0000 7fa5b7a52700 1 --2- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa5b01334a0 0x7fa5b012a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.589+0000 7fa5b7a52700 1 --2- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b006cb40 0x7fa5b0138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.589+0000 7fa5b7a52700 1 --2- 172.21.15.31:0/847730166 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa5b0132bb0 0x7fa5b0132fb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.589+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 >> 172.21.15.31:0/847730166 conn(0x7fa5b005cea0 msgr2=0x7fa5b00a8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:25.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.589+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 shutdown_connections 2024-04-18T10:36:25.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.589+0000 7fa5b7a52700 1 -- 172.21.15.31:0/847730166 wait complete. 2024-04-18T10:36:25.590 INFO:teuthology.orchestra.run.smithi031.stderr:set require_min_compat_client to octopus 2024-04-18T10:36:25.601 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:36:25.610 INFO:teuthology.task.print:**** done ceph 2024-04-18T10:36:25.610 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-18T10:36:25.636 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-18T10:36:25.637 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-18T10:36:25.637 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-18T10:36:25.637 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T10:36:25.637 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T10:36:25.637 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-18T10:36:25.637 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-18T10:36:25.637 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-18T10:36:25.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:25.637 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-18T10:36:25.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:25.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-18T10:36:25.734 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-18T10:36:25.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:36:25.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:25.736 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-18T10:36:25.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:25.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-18T10:36:25.837 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-04-18T10:36:25.838 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:36:25.839 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-18T10:36:25.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T10:36:25.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.958+0000 7feda5c20700 1 Processor -- start 2024-04-18T10:36:25.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.958+0000 7feda5c20700 1 -- start start 2024-04-18T10:36:25.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7feda5c20700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feda0067400 0x7feda0136d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7feda5c20700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda013ec70 0x7feda0141060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7feda5c20700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda0060920 con 0x7feda01369a0 2024-04-18T10:36:25.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7feda5c20700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda0061910 con 0x7feda0067400 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7feda5c20700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feda0136310 con 0x7feda013ec70 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feda0067400 0x7feda0136d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda013ec70 0x7feda0141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feda0067400 0x7feda0136d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52350/0 (socket says 172.21.15.31:52350) 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feda01369a0 0x7feda0061200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38888/0 (socket says 172.21.15.31:38888) 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9effd700 1 -- 172.21.15.31:0/3650841900 learned_addr learned my addr 172.21.15.31:0/3650841900 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda013ec70 0x7feda0141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59600/0 (socket says 172.21.15.31:59600) 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9effd700 1 -- 172.21.15.31:0/3650841900 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda013ec70 msgr2=0x7feda0141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9effd700 1 --2- 172.21.15.31:0/3650841900 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda013ec70 0x7feda0141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9effd700 1 -- 172.21.15.31:0/3650841900 >> v1:172.21.15.31:6789/0 conn(0x7feda01369a0 legacy=0x7feda0061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9effd700 1 -- 172.21.15.31:0/3650841900 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda0137270 con 0x7feda0067400 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9e7fc700 1 -- 172.21.15.31:0/3650841900 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726938172 0 0) 0x7feda0060920 con 0x7feda01369a0 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9ffff700 1 --2- 172.21.15.31:0/3650841900 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda013ec70 0x7feda0141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:25.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.959+0000 7fed9effd700 1 --2- 172.21.15.31:0/3650841900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda0067400 0x7feda0136d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fed88002f70 tx=0x7fed88006eb0).ready entity=mon.0 client_cookie=51ede9c26d65745c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7fed9e7fc700 1 -- 172.21.15.31:0/3650841900 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800d570 con 0x7feda0067400 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7fed9e7fc700 1 -- 172.21.15.31:0/3650841900 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88000e90 con 0x7feda0067400 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7fed9e7fc700 1 -- 172.21.15.31:0/3650841900 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800d8c0 con 0x7feda0067400 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7feda5c20700 1 -- 172.21.15.31:0/3650841900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda0067400 msgr2=0x7feda0136d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7feda5c20700 1 --2- 172.21.15.31:0/3650841900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda0067400 0x7feda0136d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fed88002f70 tx=0x7fed88006eb0).stop 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7feda5c20700 1 -- 172.21.15.31:0/3650841900 shutdown_connections 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7feda5c20700 1 --2- 172.21.15.31:0/3650841900 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda013ec70 0x7feda0141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7feda5c20700 1 --2- 172.21.15.31:0/3650841900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda0067400 0x7feda0136d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7feda5c20700 1 -- 172.21.15.31:0/3650841900 >> 172.21.15.31:0/3650841900 conn(0x7feda006c0c0 msgr2=0x7feda006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7feda5c20700 1 -- 172.21.15.31:0/3650841900 shutdown_connections 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.960+0000 7feda5c20700 1 -- 172.21.15.31:0/3650841900 wait complete. 2024-04-18T10:36:25.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.961+0000 7feda5c20700 1 Processor -- start 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.961+0000 7feda5c20700 1 -- start start 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7feda5c20700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feda0067400 0x7feda0139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7feda5c20700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda01369a0 0x7feda013bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7feda5c20700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda013ec70 0x7feda013c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7feda5c20700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda0099db0 con 0x7feda013ec70 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7feda5c20700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda0099f40 con 0x7feda0067400 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7feda5c20700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feda0139030 con 0x7feda01369a0 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feda0067400 0x7feda0139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda013ec70 0x7feda013c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda013ec70 0x7feda013c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52354/0 (socket says 172.21.15.31:52354) 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feda0067400 0x7feda0139f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39432/0 (socket says 172.21.15.31:39432) 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9ffff700 1 -- 172.21.15.31:0/3958649939 learned_addr learned my addr 172.21.15.31:0/3958649939 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9effd700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda01369a0 0x7feda013bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9ffff700 1 -- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda01369a0 msgr2=0x7feda013bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9ffff700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda01369a0 0x7feda013bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9ffff700 1 -- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feda0067400 msgr2=0x7feda0139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9ffff700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feda0067400 0x7feda0139f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9ffff700 1 -- 172.21.15.31:0/3958649939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98009470 con 0x7feda013ec70 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9effd700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda01369a0 0x7feda013bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.962+0000 7fed9f7fe700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feda0067400 0x7feda0139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.963+0000 7fed9ffff700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda013ec70 0x7feda013c0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7feda0138690 tx=0x7fed980091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.963+0000 7fed9cff9700 1 -- 172.21.15.31:0/3958649939 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9800c6a0 con 0x7feda013ec70 2024-04-18T10:36:25.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.963+0000 7fed9cff9700 1 -- 172.21.15.31:0/3958649939 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9800c800 con 0x7feda013ec70 2024-04-18T10:36:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.963+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8800b1e0 con 0x7feda013ec70 2024-04-18T10:36:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.963+0000 7fed9cff9700 1 -- 172.21.15.31:0/3958649939 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed9800cb60 con 0x7feda013ec70 2024-04-18T10:36:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.963+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda013cfb0 con 0x7feda013ec70 2024-04-18T10:36:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.964+0000 7fed9cff9700 1 -- 172.21.15.31:0/3958649939 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fed98022070 con 0x7feda013ec70 2024-04-18T10:36:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.964+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda0057a60 con 0x7feda013ec70 2024-04-18T10:36:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.964+0000 7fed9cff9700 1 -- 172.21.15.31:0/3958649939 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fed9804ae60 con 0x7feda013ec70 2024-04-18T10:36:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:25.967+0000 7fed9cff9700 1 -- 172.21.15.31:0/3958649939 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fed98033790 con 0x7feda013ec70 2024-04-18T10:36:26.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.115+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feda0061af0 con 0x7feda013ec70 2024-04-18T10:36:26.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.115+0000 7fed9cff9700 1 -- 172.21.15.31:0/3958649939 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fed98016030 con 0x7feda013ec70 2024-04-18T10:36:26.115 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-18T10:36:26.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.116+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 >> v1:172.21.15.31:6816/39551 conn(0x7fed84038e30 legacy=0x7fed8403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:26.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.116+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda013ec70 msgr2=0x7feda013c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:26.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.116+0000 7feda5c20700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda013ec70 0x7feda013c0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7feda0138690 tx=0x7fed980091d0).stop 2024-04-18T10:36:26.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.116+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 shutdown_connections 2024-04-18T10:36:26.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.116+0000 7feda5c20700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feda013ec70 0x7feda013c0d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:26.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.116+0000 7feda5c20700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feda0067400 0x7feda0139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:26.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.116+0000 7feda5c20700 1 --2- 172.21.15.31:0/3958649939 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feda01369a0 0x7feda013bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:26.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.116+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 >> 172.21.15.31:0/3958649939 conn(0x7feda006c0c0 msgr2=0x7feda009b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:26.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.117+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 shutdown_connections 2024-04-18T10:36:26.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:26.117+0000 7feda5c20700 1 -- 172.21.15.31:0/3958649939 wait complete. 2024-04-18T10:36:26.130 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T10:36:26.130 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T10:36:26.130 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-04-18T10:36:26.130 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-18T10:36:26.130 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T10:36:26.130 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T10:36:26.130 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T10:36:26.130 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T10:36:26.130 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-18T10:36:26.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:26.131 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-04-18T10:36:26.154 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T10:36:26.154 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T10:36:26.154 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T10:36:26.154 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-18T10:36:26.154 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42583sec preferred_lft 42583sec 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-18T10:36:26.155 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-04-18T10:36:26.156 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-04-18T10:36:26.156 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T10:36:26.156 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:26.156 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:36:26.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-04-18T10:36:26.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-04-18T10:36:26.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-04-18T10:36:26.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T10:36:26.156 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:36:26.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:26.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:26.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:26.378 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T10:36:26.407 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-04-18T10:36:26.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:26.409 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-04-18T10:36:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-04-18T10:36:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T10:36:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-18T10:36:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-18T10:36:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T10:36:26.497 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:26.498 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:36:26.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-18T10:36:26.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-18T10:36:26.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-18T10:36:26.498 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:36:26.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:26.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:26.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:26.763 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-18T10:36:26.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:26.782 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-04-18T10:36:26.840 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:26.840 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:36:26.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:36:26.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-18T10:36:26.841 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:36:26.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:26.976 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-18T10:36:26.976 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:26.976 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:36:26.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-18T10:36:26.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T10:36:26.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-18T10:36:26.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-18T10:36:26.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-18T10:36:26.976 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:36:27.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:27.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:27.219 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:27.219 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:36:27.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-04-18T10:36:27.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T10:36:27.219 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:36:27.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:27.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:27.356 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-18T10:36:27.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T10:36:27.356 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-18T10:36:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-18T10:36:27.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T10:36:27.375 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-18T10:36:27.433 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-04-18T10:36:27.501 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T10:36:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-04-18T10:36:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2024-04-18T10:36:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-04-18T10:36:27.562 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T10:36:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-04-18T10:36:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-04-18T10:36:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-04-18T10:36:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-04-18T10:36:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-04-18T10:36:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-04-18T10:36:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:36:27.563 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:36:27.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:27.563 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-04-18T10:36:27.619 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T10:36:27.619 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-18T10:36:27.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-04-18T10:36:27.690 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T10:36:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-04-18T10:36:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-04-18T10:36:27.749 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2024-04-18T10:36:27.750 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-04-18T10:36:27.751 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-04-18T10:36:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-04-18T10:36:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-04-18T10:36:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-04-18T10:36:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:36:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:36:27.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:27.752 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-04-18T10:36:27.769 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2024-04-18T10:36:27.769+0000 7ff627340200 -1 init, newargv = 0x55aba3264fc0 newargc=9 2024-04-18T10:36:27.769 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[37421]: starting ceph client 2024-04-18T10:36:27.777 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[37421]: starting fuse 2024-04-18T10:36:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:47 2024-04-18T10:36:27.788 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-04-18T10:36:27.789 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2024-04-18T10:36:27.790 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-04-18T10:36:27.914 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.37421.asok 2024-04-18T10:36:27.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:36:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:27.923 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37421.asok 2024-04-18T10:36:27.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:27.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37421.asok status 2024-04-18T10:36:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-18T10:36:28.066 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-04-18T10:36:28.066 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-04-18T10:36:28.066 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-04-18T10:36:28.066 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2024-04-18T10:36:28.066 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "37421", 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4546, 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4546 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-04-18T10:36:28.067 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2980990828 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2980990828 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4546 172.21.15.40:0/2980990828", 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "172.21.15.40:0/2980990828", 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 8, 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 20, 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-04-18T10:36:28.068 INFO:teuthology.orchestra.run.smithi040.stdout: "blacklisted": false, 2024-04-18T10:36:28.069 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2024-04-18T10:36:28.069 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-18T10:36:28.075 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T10:36:28.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.194+0000 7fa9f1d36700 1 Processor -- start 2024-04-18T10:36:28.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.194+0000 7fa9f1d36700 1 -- start start 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9f1d36700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec136710 0x7fa9ec0a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9f1d36700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa9ec0a5000 0x7fa9ec136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9f1d36700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9ec066c10 con 0x7fa9ec05b970 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9f1d36700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9ec136fe0 con 0x7fa9ec0a5000 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9f1d36700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec066eb0 con 0x7fa9ec136710 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec136710 0x7fa9ec0a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec136710 0x7fa9ec0a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39436/0 (socket says 172.21.15.31:39436) 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eb7fe700 1 -- 172.21.15.31:0/814071614 learned_addr learned my addr 172.21.15.31:0/814071614 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eaffd700 1 --2- 172.21.15.31:0/814071614 >> v2:172.21.15.31:3300/0 conn(0x7fa9ec0a5000 0x7fa9ec136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eaffd700 1 -- 172.21.15.31:0/814071614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec136710 msgr2=0x7fa9ec0a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eaffd700 1 --2- 172.21.15.31:0/814071614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec136710 0x7fa9ec0a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eaffd700 1 -- 172.21.15.31:0/814071614 >> v1:172.21.15.31:6789/0 conn(0x7fa9ec05b970 legacy=0x7fa9ec05bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eaffd700 1 -- 172.21.15.31:0/814071614 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ec0a3b40 con 0x7fa9ec0a5000 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eb7fe700 1 --2- 172.21.15.31:0/814071614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec136710 0x7fa9ec0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.195+0000 7fa9eaffd700 1 --2- 172.21.15.31:0/814071614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec0a5000 0x7fa9ec136af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa9d4002f70 tx=0x7fa9d4006df0).ready entity=mon.0 client_cookie=944c84ee0629eff server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9ea7fc700 1 -- 172.21.15.31:0/814071614 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d400d570 con 0x7fa9ec0a5000 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9ea7fc700 1 -- 172.21.15.31:0/814071614 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4000e90 con 0x7fa9ec0a5000 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9ea7fc700 1 -- 172.21.15.31:0/814071614 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d400d8c0 con 0x7fa9ec0a5000 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9f1d36700 1 -- 172.21.15.31:0/814071614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec0a5000 msgr2=0x7fa9ec136af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9f1d36700 1 --2- 172.21.15.31:0/814071614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec0a5000 0x7fa9ec136af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa9d4002f70 tx=0x7fa9d4006df0).stop 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9f1d36700 1 -- 172.21.15.31:0/814071614 shutdown_connections 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9f1d36700 1 --2- 172.21.15.31:0/814071614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec136710 0x7fa9ec0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9f1d36700 1 --2- 172.21.15.31:0/814071614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec0a5000 0x7fa9ec136af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9f1d36700 1 -- 172.21.15.31:0/814071614 >> 172.21.15.31:0/814071614 conn(0x7fa9ec060ac0 msgr2=0x7fa9ec0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:28.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9f1d36700 1 -- 172.21.15.31:0/814071614 shutdown_connections 2024-04-18T10:36:28.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.196+0000 7fa9f1d36700 1 -- 172.21.15.31:0/814071614 wait complete. 2024-04-18T10:36:28.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.197+0000 7fa9f1d36700 1 Processor -- start 2024-04-18T10:36:28.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.197+0000 7fa9f1d36700 1 -- start start 2024-04-18T10:36:28.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9f1d36700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec05b970 0x7fa9ec093010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:28.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9f1d36700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9ec0a5000 0x7fa9ec132500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:28.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9f1d36700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec136710 0x7fa9ec1329f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:28.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9f1d36700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0939e0 con 0x7fa9ec136710 2024-04-18T10:36:28.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9f1d36700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec094f40 con 0x7fa9ec05b970 2024-04-18T10:36:28.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9f1d36700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9ec0946f0 con 0x7fa9ec0a5000 2024-04-18T10:36:28.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec136710 0x7fa9ec1329f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eaffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9ec0a5000 0x7fa9ec132500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eaffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9ec0a5000 0x7fa9ec132500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59618/0 (socket says 172.21.15.31:59618) 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9ebfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec136710 0x7fa9ec1329f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52364/0 (socket says 172.21.15.31:52364) 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eaffd700 1 -- 172.21.15.31:0/251416916 learned_addr learned my addr 172.21.15.31:0/251416916 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eb7fe700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec05b970 0x7fa9ec093010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eaffd700 1 -- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec05b970 msgr2=0x7fa9ec093010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eaffd700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec05b970 0x7fa9ec093010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eaffd700 1 -- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec136710 msgr2=0x7fa9ec1329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eaffd700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec136710 0x7fa9ec1329f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eaffd700 1 -- 172.21.15.31:0/251416916 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc00b1e0 con 0x7fa9ec0a5000 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9ebfff700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec136710 0x7fa9ec1329f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.198+0000 7fa9eb7fe700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec05b970 0x7fa9ec093010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.199+0000 7fa9eaffd700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9ec0a5000 0x7fa9ec132500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa9ec1388b0 tx=0x7fa9d4014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:28.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.199+0000 7fa9e8ff9700 1 -- 172.21.15.31:0/251416916 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d4013e50 con 0x7fa9ec0a5000 2024-04-18T10:36:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.199+0000 7fa9e8ff9700 1 -- 172.21.15.31:0/251416916 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d401e400 con 0x7fa9ec0a5000 2024-04-18T10:36:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.199+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d400b180 con 0x7fa9ec0a5000 2024-04-18T10:36:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.199+0000 7fa9e8ff9700 1 -- 172.21.15.31:0/251416916 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d401e760 con 0x7fa9ec0a5000 2024-04-18T10:36:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.199+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9ec094c60 con 0x7fa9ec0a5000 2024-04-18T10:36:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.200+0000 7fa9e8ff9700 1 -- 172.21.15.31:0/251416916 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa9d4025030 con 0x7fa9ec0a5000 2024-04-18T10:36:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.200+0000 7fa9e8ff9700 1 -- 172.21.15.31:0/251416916 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa9d404b6b0 con 0x7fa9ec0a5000 2024-04-18T10:36:28.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.200+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9ec057a60 con 0x7fa9ec0a5000 2024-04-18T10:36:28.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.203+0000 7fa9e8ff9700 1 -- 172.21.15.31:0/251416916 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa9d4023030 con 0x7fa9ec0a5000 2024-04-18T10:36:28.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.355+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa9ec0a3da0 con 0x7fa9ec0a5000 2024-04-18T10:36:28.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.356+0000 7fa9e8ff9700 1 -- 172.21.15.31:0/251416916 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa9d40058c0 con 0x7fa9ec0a5000 2024-04-18T10:36:28.356 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-18T10:36:28.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 >> v1:172.21.15.31:6816/39551 conn(0x7fa9d0038e30 legacy=0x7fa9d003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:28.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9ec0a5000 msgr2=0x7fa9ec132500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:28.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9ec0a5000 0x7fa9ec132500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fa9ec1388b0 tx=0x7fa9d4014000).stop 2024-04-18T10:36:28.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 shutdown_connections 2024-04-18T10:36:28.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9ec136710 0x7fa9ec1329f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:28.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9ec05b970 0x7fa9ec093010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:28.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 --2- 172.21.15.31:0/251416916 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9ec0a5000 0x7fa9ec132500 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:28.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 >> 172.21.15.31:0/251416916 conn(0x7fa9ec060ac0 msgr2=0x7fa9ec0a7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:28.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 shutdown_connections 2024-04-18T10:36:28.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:28.357+0000 7fa9f1d36700 1 -- 172.21.15.31:0/251416916 wait complete. 2024-04-18T10:36:28.367 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T10:36:28.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T10:36:28.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-18T10:36:28.368 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-18T10:36:28.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-18T10:36:28.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T10:36:28.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T10:36:28.368 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T10:36:28.368 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-18T10:36:28.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:28.368 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-18T10:36:28.390 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-18T10:36:28.391 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-18T10:36:28.392 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-18T10:36:28.392 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T10:36:28.392 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-18T10:36:28.392 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-18T10:36:28.392 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42576sec preferred_lft 42576sec 2024-04-18T10:36:28.392 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::ec4:7aff:fe88:8137/64 scope link 2024-04-18T10:36:28.392 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-18T10:36:28.392 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T10:36:28.392 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:28.392 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-18T10:36:28.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add name ceph-brx type bridge 2024-04-18T10:36:28.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr flush dev ceph-brx 2024-04-18T10:36:28.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set ceph-brx up 2024-04-18T10:36:28.393 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T10:36:28.393 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-18T10:36:28.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:28.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:28.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:28.732 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T10:36:28.759 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-18T10:36:28.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:28.761 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-18T10:36:28.841 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-18T10:36:28.841 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T10:36:28.841 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-18T10:36:28.841 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-18T10:36:28.841 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T10:36:28.842 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:28.842 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-18T10:36:28.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-18T10:36:28.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-18T10:36:28.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-18T10:36:28.842 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-18T10:36:28.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:29.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:29.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:29.112 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-18T10:36:29.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:29.130 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-04-18T10:36:29.188 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:29.188 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-18T10:36:29.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-18T10:36:29.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-18T10:36:29.188 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-18T10:36:29.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:29.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:29.320 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-18T10:36:29.320 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:29.320 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-18T10:36:29.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-18T10:36:29.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T10:36:29.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-18T10:36:29.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-18T10:36:29.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-18T10:36:29.320 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-18T10:36:29.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:29.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:29.554 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:36:29.554 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-18T10:36:29.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-18T10:36:29.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T10:36:29.554 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-18T10:36:29.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:36:29.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:29.689 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-18T10:36:29.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T10:36:29.689 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-18T10:36:29.706 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-18T10:36:29.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T10:36:29.706 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-18T10:36:29.764 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-18T10:36:29.831 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T10:36:29.890 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-18T10:36:29.890 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-18T10:36:29.890 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-18T10:36:29.890 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-18T10:36:29.890 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-18T10:36:29.890 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-18T10:36:29.890 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-18T10:36:29.890 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-18T10:36:29.890 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/systemd 2024-04-18T10:36:29.891 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-18T10:36:29.891 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-18T10:36:29.891 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/memory 2024-04-18T10:36:29.891 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/devices 2024-04-18T10:36:29.891 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/freezer 2024-04-18T10:36:29.891 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/pids 2024-04-18T10:36:29.891 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-18T10:36:29.891 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/cpuset 2024-04-18T10:36:29.891 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/hugetlb 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/perf_event 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/rdma 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/blkio 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/selinux 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-18T10:36:29.892 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/nfs/rpc_pipefs 2024-04-18T10:36:29.893 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-18T10:36:29.893 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-18T10:36:29.893 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-18T10:36:29.893 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-18T10:36:29.893 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-18T10:36:29.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:29.893 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-18T10:36:29.947 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T10:36:29.948 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-18T10:36:29.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo modprobe fuse 2024-04-18T10:36:30.015 DEBUG:teuthology.orchestra.run.smithi137:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T10:36:30.073 INFO:teuthology.orchestra.run.smithi137.stdout:/sys 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/proc 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/dev 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/security 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/shm 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/pts 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/run 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/systemd 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/pstore 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/bpf 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/memory 2024-04-18T10:36:30.074 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/devices 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/freezer 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/pids 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/cpuset 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/hugetlb 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/perf_event 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/rdma 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/blkio 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/tracing 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/config 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/ 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/selinux 2024-04-18T10:36:30.075 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/kernel/debug 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/mqueue 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/dev/hugepages 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/sys/fs/fuse/connections 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/nfs/rpc_pipefs 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/run/user/1000 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/var/lib/ceph 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run.smithi137.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-18T10:36:30.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:30.076 DEBUG:teuthology.orchestra.run.smithi137:> ls /sys/fs/fuse/connections 2024-04-18T10:36:30.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:2024-04-18T10:36:30.086+0000 7fcb7206f200 -1 init, newargv = 0x558356ff80d0 newargc=9 2024-04-18T10:36:30.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:ceph-fuse[37350]: starting ceph client 2024-04-18T10:36:30.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:ceph-fuse[37350]: starting fuse 2024-04-18T10:36:30.103 INFO:teuthology.orchestra.run.smithi137.stdout:46 2024-04-18T10:36:30.103 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-18T10:36:30.104 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.1")) 2024-04-18T10:36:30.105 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-18T10:36:30.225 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.1.37350.asok 2024-04-18T10:36:30.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:36:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:36:30.235 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37350.asok 2024-04-18T10:36:30.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:30.235 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37350.asok status 2024-04-18T10:36:30.372 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-18T10:36:30.372 INFO:teuthology.orchestra.run.smithi137.stdout: "metadata": { 2024-04-18T10:36:30.372 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-04-18T10:36:30.372 INFO:teuthology.orchestra.run.smithi137.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-04-18T10:36:30.372 INFO:teuthology.orchestra.run.smithi137.stdout: "entity_id": "1", 2024-04-18T10:36:30.372 INFO:teuthology.orchestra.run.smithi137.stdout: "hostname": "smithi137", 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "pid": "37350", 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "root": "/" 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_count": 0, 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "dentry_pinned_count": 0, 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 14489, 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 14489 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-18T10:36:30.373 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:0", 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 2414209880 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:0", 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 2414209880 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.14489 172.21.15.137:0/2414209880", 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "172.21.15.137:0/2414209880", 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "inode_count": 1, 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "mds_epoch": 8, 2024-04-18T10:36:30.374 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch": 20, 2024-04-18T10:36:30.375 INFO:teuthology.orchestra.run.smithi137.stdout: "osd_epoch_barrier": 0, 2024-04-18T10:36:30.375 INFO:teuthology.orchestra.run.smithi137.stdout: "blacklisted": false, 2024-04-18T10:36:30.375 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs" 2024-04-18T10:36:30.375 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-18T10:36:30.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:30.381 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-04-18T10:36:30.381 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-18T10:36:30.405 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-04-18T10:36:30.405 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-18T10:36:30.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:30.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-18T10:36:30.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:30.481 DEBUG:teuthology.orchestra.run.smithi137:> stat --file-system '--printf=%T 2024-04-18T10:36:30.481 DEBUG:teuthology.orchestra.run.smithi137:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-18T10:36:30.499 INFO:teuthology.orchestra.run.smithi137.stdout:fuseblk 2024-04-18T10:36:30.499 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-18T10:36:30.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:36:30.499 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-18T10:36:30.644 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:36:30.654 INFO:teuthology.task.print:**** done octopus client 2024-04-18T10:36:30.654 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:36:30.667 INFO:teuthology.task.print:**** done fsstress 2024-04-18T10:36:30.667 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2024-04-18T10:36:30.682 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:30.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.801+0000 7f9143ab9700 1 Processor -- start 2024-04-18T10:36:30.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.801+0000 7f9143ab9700 1 -- start start 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.801+0000 7f9143ab9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c0a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.801+0000 7f9143ab9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f913c136af0 0x7f913c05c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.801+0000 7f9143ab9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c066c10 con 0x7f913c136710 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.801+0000 7f9143ab9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c066eb0 con 0x7f913c136af0 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.801+0000 7f9143ab9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0a3b40 con 0x7f913c0a5000 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9141054700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c0a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9142056700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f913c136af0 0x7f913c05c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9141054700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c0a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59634/0 (socket says 172.21.15.31:59634) 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9141054700 1 -- 172.21.15.31:0/476967474 learned_addr learned my addr 172.21.15.31:0/476967474 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9141855700 1 --1- 172.21.15.31:0/476967474 >> v1:172.21.15.31:6789/0 conn(0x7f913c136710 0x7f913c05b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38900/0 (socket says 172.21.15.31:38900) 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9142056700 1 -- 172.21.15.31:0/476967474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 msgr2=0x7f913c0a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9142056700 1 --2- 172.21.15.31:0/476967474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c0a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9142056700 1 -- 172.21.15.31:0/476967474 >> v1:172.21.15.31:6789/0 conn(0x7f913c136710 legacy=0x7f913c05b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:30.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9142056700 1 -- 172.21.15.31:0/476967474 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c136f80 con 0x7f913c136af0 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9140853700 1 -- 172.21.15.31:0/476967474 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107662287 0 0) 0x7f913c066c10 con 0x7f913c136710 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9141054700 1 --2- 172.21.15.31:0/476967474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9142056700 1 --2- 172.21.15.31:0/476967474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136af0 0x7f913c05c080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f91340032f0 tx=0x7f91340091d0).ready entity=mon.0 client_cookie=dc817ecc01547da4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9140853700 1 -- 172.21.15.31:0/476967474 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913400b6c0 con 0x7f913c136af0 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9140853700 1 -- 172.21.15.31:0/476967474 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913400b820 con 0x7f913c136af0 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.802+0000 7f9140853700 1 -- 172.21.15.31:0/476967474 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f913400b990 con 0x7f913c136af0 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.803+0000 7f9143ab9700 1 -- 172.21.15.31:0/476967474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136af0 msgr2=0x7f913c05c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.803+0000 7f9143ab9700 1 --2- 172.21.15.31:0/476967474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136af0 0x7f913c05c080 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f91340032f0 tx=0x7f91340091d0).stop 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.803+0000 7f9143ab9700 1 -- 172.21.15.31:0/476967474 shutdown_connections 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.803+0000 7f9143ab9700 1 --2- 172.21.15.31:0/476967474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136af0 0x7f913c05c080 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.803+0000 7f9143ab9700 1 --2- 172.21.15.31:0/476967474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.803+0000 7f9143ab9700 1 -- 172.21.15.31:0/476967474 >> 172.21.15.31:0/476967474 conn(0x7f913c060ac0 msgr2=0x7f913c0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.803+0000 7f9143ab9700 1 -- 172.21.15.31:0/476967474 shutdown_connections 2024-04-18T10:36:30.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.803+0000 7f9143ab9700 1 -- 172.21.15.31:0/476967474 wait complete. 2024-04-18T10:36:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9143ab9700 1 Processor -- start 2024-04-18T10:36:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9143ab9700 1 -- start start 2024-04-18T10:36:30.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9143ab9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c092c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:30.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9143ab9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136710 0x7f913c148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:30.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9143ab9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f913c136af0 0x7f913c1335a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:30.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9143ab9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c09fd20 con 0x7f913c136710 2024-04-18T10:36:30.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9143ab9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c1495f0 con 0x7f913c136af0 2024-04-18T10:36:30.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9143ab9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f913c135320 con 0x7f913c0a5000 2024-04-18T10:36:30.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9141054700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136710 0x7f913c148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:30.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9141855700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c092c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:30.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9141054700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136710 0x7f913c148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52376/0 (socket says 172.21.15.31:52376) 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.804+0000 7f9141054700 1 -- 172.21.15.31:0/2991243248 learned_addr learned my addr 172.21.15.31:0/2991243248 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9142056700 1 --2- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f913c136af0 0x7f913c1335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9141855700 1 -- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f913c136af0 msgr2=0x7f913c1335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9141855700 1 --2- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f913c136af0 0x7f913c1335a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9141855700 1 -- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136710 msgr2=0x7f913c148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9141855700 1 --2- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136710 0x7f913c148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9141855700 1 -- 172.21.15.31:0/2991243248 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913800b1e0 con 0x7f913c0a5000 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9141054700 1 --2- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136710 0x7f913c148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9141855700 1 --2- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c092c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f912c000bc0 tx=0x7f912c0079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f912affd700 1 -- 172.21.15.31:0/2991243248 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f912c00cdd0 con 0x7f913c0a5000 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f912affd700 1 -- 172.21.15.31:0/2991243248 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c0070d0 con 0x7f913c0a5000 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f912affd700 1 -- 172.21.15.31:0/2991243248 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f912c005550 con 0x7f913c0a5000 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9134009470 con 0x7f913c0a5000 2024-04-18T10:36:30.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.805+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c0a7d30 con 0x7f913c0a5000 2024-04-18T10:36:30.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.806+0000 7f912affd700 1 -- 172.21.15.31:0/2991243248 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f912c010070 con 0x7f913c0a5000 2024-04-18T10:36:30.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.806+0000 7f912affd700 1 -- 172.21.15.31:0/2991243248 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f912c049df0 con 0x7f913c0a5000 2024-04-18T10:36:30.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.806+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c0a7f80 con 0x7f913c0a5000 2024-04-18T10:36:30.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.810+0000 7f912affd700 1 -- 172.21.15.31:0/2991243248 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f912c02ecf0 con 0x7f913c0a5000 2024-04-18T10:36:30.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.927+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f913c148860 con 0x7f913c0a5000 2024-04-18T10:36:30.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.928+0000 7f912affd700 1 -- 172.21.15.31:0/2991243248 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+10538 (secure 0 0 0) 0x7f912c032310 con 0x7f913c0a5000 2024-04-18T10:36:30.928 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:30.928 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:25.572295+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:30.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 >> v1:172.21.15.31:6816/39551 conn(0x7f911c038da0 legacy=0x7f911c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 msgr2=0x7f913c092c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 --2- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c092c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f912c000bc0 tx=0x7f912c0079e0).stop 2024-04-18T10:36:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 shutdown_connections 2024-04-18T10:36:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 --2- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f913c0a5000 0x7f913c092c50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 --2- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f913c136af0 0x7f913c1335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 --2- 172.21.15.31:0/2991243248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f913c136710 0x7f913c148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 >> 172.21.15.31:0/2991243248 conn(0x7f913c060ac0 msgr2=0x7f913c05c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 shutdown_connections 2024-04-18T10:36:30.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:30.929+0000 7f9143ab9700 1 -- 172.21.15.31:0/2991243248 wait complete. 2024-04-18T10:36:30.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:36:30.940 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-18T10:36:31.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.050+0000 7f7619bb2700 1 Processor -- start 2024-04-18T10:36:31.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.050+0000 7f7619bb2700 1 -- start start 2024-04-18T10:36:31.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f7619bb2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136710 0x7f76140a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f7619bb2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136af0 0x7f761405c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f7619bb2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7614066c10 con 0x7f76140a5000 2024-04-18T10:36:31.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f7619bb2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7614066eb0 con 0x7f7614136af0 2024-04-18T10:36:31.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f7619bb2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76140a3b40 con 0x7f7614136710 2024-04-18T10:36:31.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76137fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136710 0x7f76140a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f7612ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f76140a5000 0x7f761405b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38902/0 (socket says 172.21.15.31:38902) 2024-04-18T10:36:31.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f7612ffd700 1 -- 172.21.15.31:0/3198563590 learned_addr learned my addr 172.21.15.31:0/3198563590 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:31.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f7613fff700 1 --2- 172.21.15.31:0/3198563590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136af0 0x7f761405c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76137fe700 1 -- 172.21.15.31:0/3198563590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136af0 msgr2=0x7f761405c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:31.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76137fe700 1 --2- 172.21.15.31:0/3198563590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136af0 0x7f761405c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76137fe700 1 -- 172.21.15.31:0/3198563590 >> v1:172.21.15.31:6789/0 conn(0x7f76140a5000 legacy=0x7f761405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76137fe700 1 -- 172.21.15.31:0/3198563590 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76140673f0 con 0x7f7614136710 2024-04-18T10:36:31.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76127fc700 1 -- 172.21.15.31:0/3198563590 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793765834 0 0) 0x7f7614066c10 con 0x7f76140a5000 2024-04-18T10:36:31.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f7613fff700 1 --2- 172.21.15.31:0/3198563590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136af0 0x7f761405c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76137fe700 1 --2- 172.21.15.31:0/3198563590 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136710 0x7f76140a3fc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f75fc002f70 tx=0x7f75fc006df0).ready entity=mon.2 client_cookie=dfa325a2216e7e5c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:31.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76127fc700 1 -- 172.21.15.31:0/3198563590 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc00d570 con 0x7f7614136710 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76127fc700 1 -- 172.21.15.31:0/3198563590 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc000e90 con 0x7f7614136710 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.051+0000 7f76127fc700 1 -- 172.21.15.31:0/3198563590 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75fc00d8c0 con 0x7f7614136710 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.052+0000 7f7619bb2700 1 -- 172.21.15.31:0/3198563590 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136710 msgr2=0x7f76140a3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.052+0000 7f7619bb2700 1 --2- 172.21.15.31:0/3198563590 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136710 0x7f76140a3fc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f75fc002f70 tx=0x7f75fc006df0).stop 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.052+0000 7f7619bb2700 1 -- 172.21.15.31:0/3198563590 shutdown_connections 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.052+0000 7f7619bb2700 1 --2- 172.21.15.31:0/3198563590 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136af0 0x7f761405c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.052+0000 7f7619bb2700 1 --2- 172.21.15.31:0/3198563590 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136710 0x7f76140a3fc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.052+0000 7f7619bb2700 1 -- 172.21.15.31:0/3198563590 >> 172.21.15.31:0/3198563590 conn(0x7f7614060ac0 msgr2=0x7f76140a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.052+0000 7f7619bb2700 1 -- 172.21.15.31:0/3198563590 shutdown_connections 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.052+0000 7f7619bb2700 1 -- 172.21.15.31:0/3198563590 wait complete. 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.053+0000 7f7619bb2700 1 Processor -- start 2024-04-18T10:36:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.053+0000 7f7619bb2700 1 -- start start 2024-04-18T10:36:31.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7619bb2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76140a5000 0x7f76141454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7619bb2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136710 0x7f76140a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7619bb2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136af0 0x7f7614145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7619bb2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7614139df0 con 0x7f76140a5000 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7619bb2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76140a11b0 con 0x7f7614136710 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7619bb2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f761413a1a0 con 0x7f7614136af0 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7612ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136710 0x7f76140a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f76137fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76140a5000 0x7f76141454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7613fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136af0 0x7f7614145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7612ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136710 0x7f76140a2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39468/0 (socket says 172.21.15.31:39468) 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f76137fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76140a5000 0x7f76141454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52388/0 (socket says 172.21.15.31:52388) 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7613fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136af0 0x7f7614145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59654/0 (socket says 172.21.15.31:59654) 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7612ffd700 1 -- 172.21.15.31:0/4066404191 learned_addr learned my addr 172.21.15.31:0/4066404191 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7613fff700 1 -- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136710 msgr2=0x7f76140a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7613fff700 1 --2- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136710 0x7f76140a2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7613fff700 1 -- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76140a5000 msgr2=0x7f76141454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7613fff700 1 --2- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76140a5000 0x7f76141454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7613fff700 1 -- 172.21.15.31:0/4066404191 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c009470 con 0x7f7614136af0 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7612ffd700 1 --2- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136710 0x7f76140a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.054+0000 7f7613fff700 1 --2- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136af0 0x7f7614145d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f760c00c000 tx=0x7f760c0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.055+0000 7f7610ff9700 1 -- 172.21.15.31:0/4066404191 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760c00ee60 con 0x7f7614136af0 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.055+0000 7f7610ff9700 1 -- 172.21.15.31:0/4066404191 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c00c850 con 0x7f7614136af0 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.055+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc00b180 con 0x7f7614136af0 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.055+0000 7f7610ff9700 1 -- 172.21.15.31:0/4066404191 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760c00cbb0 con 0x7f7614136af0 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.055+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7614092110 con 0x7f7614136af0 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.055+0000 7f7610ff9700 1 -- 172.21.15.31:0/4066404191 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f760c022070 con 0x7f7614136af0 2024-04-18T10:36:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.056+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7614057a60 con 0x7f7614136af0 2024-04-18T10:36:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.056+0000 7f7610ff9700 1 -- 172.21.15.31:0/4066404191 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f760c04afd0 con 0x7f7614136af0 2024-04-18T10:36:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.059+0000 7f7610ff9700 1 -- 172.21.15.31:0/4066404191 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f760c06c7c0 con 0x7f7614136af0 2024-04-18T10:36:31.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.176+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f76141459e0 con 0x7f7614136af0 2024-04-18T10:36:31.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.176+0000 7f7610ff9700 1 -- 172.21.15.31:0/4066404191 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v20) v1 ==== 110+0+10 (secure 0 0 0) 0x7f760c016020 con 0x7f7614136af0 2024-04-18T10:36:31.176 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.177+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 >> v1:172.21.15.31:6816/39551 conn(0x7f75f8038e30 legacy=0x7f75f803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.177+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136af0 msgr2=0x7f7614145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.177+0000 7f7619bb2700 1 --2- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136af0 0x7f7614145d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f760c00c000 tx=0x7f760c0091d0).stop 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.177+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 shutdown_connections 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.177+0000 7f7619bb2700 1 --2- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7614136af0 0x7f7614145d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.177+0000 7f7619bb2700 1 --2- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76140a5000 0x7f76141454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.177+0000 7f7619bb2700 1 --2- 172.21.15.31:0/4066404191 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7614136710 0x7f76140a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.177+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 >> 172.21.15.31:0/4066404191 conn(0x7f7614060ac0 msgr2=0x7f761405c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.177+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 shutdown_connections 2024-04-18T10:36:31.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.178+0000 7f7619bb2700 1 -- 172.21.15.31:0/4066404191 wait complete. 2024-04-18T10:36:31.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:36:31.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.297+0000 7f6173fad700 1 Processor -- start 2024-04-18T10:36:31.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.297+0000 7f6173fad700 1 -- start start 2024-04-18T10:36:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.297+0000 7f6173fad700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c05bb30 0x7f616c063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.297+0000 7f6173fad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c061fe0 0x7f616c139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.297+0000 7f6173fad700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c062b80 con 0x7f616c062400 2024-04-18T10:36:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.297+0000 7f6173fad700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c062e60 con 0x7f616c061fe0 2024-04-18T10:36:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.297+0000 7f6173fad700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f616c139a40 con 0x7f616c05bb30 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.297+0000 7f6171d49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c05bb30 0x7f616c063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.297+0000 7f6171548700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c061fe0 0x7f616c139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f617254a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f616c062400 0x7f616c0a8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38906/0 (socket says 172.21.15.31:38906) 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f617254a700 1 -- 172.21.15.31:0/3327354820 learned_addr learned my addr 172.21.15.31:0/3327354820 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6171d49700 1 -- 172.21.15.31:0/3327354820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c061fe0 msgr2=0x7f616c139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6171d49700 1 --2- 172.21.15.31:0/3327354820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c061fe0 0x7f616c139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6171d49700 1 -- 172.21.15.31:0/3327354820 >> v1:172.21.15.31:6789/0 conn(0x7f616c062400 legacy=0x7f616c0a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6170d47700 1 -- 172.21.15.31:0/3327354820 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620352655 0 0) 0x7f616c062b80 con 0x7f616c062400 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6171d49700 1 -- 172.21.15.31:0/3327354820 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c139d00 con 0x7f616c05bb30 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6171548700 1 --2- 172.21.15.31:0/3327354820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c061fe0 0x7f616c139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6171d49700 1 --2- 172.21.15.31:0/3327354820 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c05bb30 0x7f616c063360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6160002f70 tx=0x7f6160006df0).ready entity=mon.2 client_cookie=96aed91a07a5759f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6170d47700 1 -- 172.21.15.31:0/3327354820 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616000d570 con 0x7f616c05bb30 2024-04-18T10:36:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6170d47700 1 -- 172.21.15.31:0/3327354820 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160000e90 con 0x7f616c05bb30 2024-04-18T10:36:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.298+0000 7f6170d47700 1 -- 172.21.15.31:0/3327354820 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616000d8c0 con 0x7f616c05bb30 2024-04-18T10:36:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.299+0000 7f6173fad700 1 -- 172.21.15.31:0/3327354820 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c05bb30 msgr2=0x7f616c063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.299+0000 7f6173fad700 1 --2- 172.21.15.31:0/3327354820 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c05bb30 0x7f616c063360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6160002f70 tx=0x7f6160006df0).stop 2024-04-18T10:36:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.299+0000 7f6173fad700 1 -- 172.21.15.31:0/3327354820 shutdown_connections 2024-04-18T10:36:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.299+0000 7f6173fad700 1 --2- 172.21.15.31:0/3327354820 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c05bb30 0x7f616c063360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.299+0000 7f6173fad700 1 --2- 172.21.15.31:0/3327354820 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c061fe0 0x7f616c139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.299+0000 7f6173fad700 1 -- 172.21.15.31:0/3327354820 >> 172.21.15.31:0/3327354820 conn(0x7f616c06c0c0 msgr2=0x7f616c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.299+0000 7f6173fad700 1 -- 172.21.15.31:0/3327354820 shutdown_connections 2024-04-18T10:36:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.299+0000 7f6173fad700 1 -- 172.21.15.31:0/3327354820 wait complete. 2024-04-18T10:36:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.300+0000 7f6173fad700 1 Processor -- start 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.300+0000 7f6173fad700 1 -- start start 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6173fad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f616c05bb30 0x7f616c0951b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6173fad700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c061fe0 0x7f616c1490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6173fad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c097c20 0x7f616c1495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6173fad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c096ec0 con 0x7f616c05bb30 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6173fad700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c098440 con 0x7f616c097c20 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6173fad700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f616c098fc0 con 0x7f616c061fe0 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f617254a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c097c20 0x7f616c1495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171548700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c061fe0 0x7f616c1490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171548700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c061fe0 0x7f616c1490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59668/0 (socket says 172.21.15.31:59668) 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f617254a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c097c20 0x7f616c1495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39488/0 (socket says 172.21.15.31:39488) 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171548700 1 -- 172.21.15.31:0/3342517127 learned_addr learned my addr 172.21.15.31:0/3342517127 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171d49700 1 --2- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f616c05bb30 0x7f616c0951b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171548700 1 -- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c097c20 msgr2=0x7f616c1495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171548700 1 --2- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c097c20 0x7f616c1495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171548700 1 -- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f616c05bb30 msgr2=0x7f616c0951b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171548700 1 --2- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f616c05bb30 0x7f616c0951b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171548700 1 -- 172.21.15.31:0/3342517127 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616800b180 con 0x7f616c061fe0 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f617254a700 1 --2- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c097c20 0x7f616c1495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6171548700 1 --2- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c061fe0 0x7f616c1490b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f616c0985d0 tx=0x7f6168006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f615effd700 1 -- 172.21.15.31:0/3342517127 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616800c860 con 0x7f616c061fe0 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f615effd700 1 -- 172.21.15.31:0/3342517127 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616800c9c0 con 0x7f616c061fe0 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616000b180 con 0x7f616c061fe0 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f615effd700 1 -- 172.21.15.31:0/3342517127 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616800cd20 con 0x7f616c061fe0 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.301+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c094550 con 0x7f616c061fe0 2024-04-18T10:36:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.302+0000 7f615effd700 1 -- 172.21.15.31:0/3342517127 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f616801c460 con 0x7f616c061fe0 2024-04-18T10:36:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.303+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c095860 con 0x7f616c061fe0 2024-04-18T10:36:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.303+0000 7f615effd700 1 -- 172.21.15.31:0/3342517127 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f616804ae60 con 0x7f616c061fe0 2024-04-18T10:36:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.306+0000 7f615effd700 1 -- 172.21.15.31:0/3342517127 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f61680667c0 con 0x7f616c061fe0 2024-04-18T10:36:31.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.423+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f616c05bf10 con 0x7f616c061fe0 2024-04-18T10:36:31.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.423+0000 7f615effd700 1 -- 172.21.15.31:0/3342517127 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6168033790 con 0x7f616c061fe0 2024-04-18T10:36:31.424 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:36:31.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 >> v1:172.21.15.31:6816/39551 conn(0x7f614c038da0 legacy=0x7f614c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c061fe0 msgr2=0x7f616c1490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 --2- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c061fe0 0x7f616c1490b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f616c0985d0 tx=0x7f6168006df0).stop 2024-04-18T10:36:31.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 shutdown_connections 2024-04-18T10:36:31.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 --2- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f616c097c20 0x7f616c1495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 --2- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f616c05bb30 0x7f616c0951b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 --2- 172.21.15.31:0/3342517127 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f616c061fe0 0x7f616c1490b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 >> 172.21.15.31:0/3342517127 conn(0x7f616c06c0c0 msgr2=0x7f616c1323b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:31.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 shutdown_connections 2024-04-18T10:36:31.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.425+0000 7f6173fad700 1 -- 172.21.15.31:0/3342517127 wait complete. 2024-04-18T10:36:31.435 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:36:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.544+0000 7fad8c6ed700 1 Processor -- start 2024-04-18T10:36:31.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.544+0000 7fad8c6ed700 1 -- start start 2024-04-18T10:36:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8c6ed700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad841369a0 0x7fad84067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8c6ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad84136d80 0x7fad84061200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8c6ed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fad841398e0 0x7fad84139d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8c6ed700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad84136310 con 0x7fad841398e0 2024-04-18T10:36:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8c6ed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad84060920 con 0x7fad84136d80 2024-04-18T10:36:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8c6ed700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad84136500 con 0x7fad841369a0 2024-04-18T10:36:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad89c88700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad84136d80 0x7fad84061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8a489700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad841369a0 0x7fad84067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8ac8a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fad841398e0 0x7fad84139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad89c88700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad84136d80 0x7fad84061200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39502/0 (socket says 172.21.15.31:39502) 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8a489700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad841369a0 0x7fad84067400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59670/0 (socket says 172.21.15.31:59670) 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad89c88700 1 -- 172.21.15.31:0/3217627365 learned_addr learned my addr 172.21.15.31:0/3217627365 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8ac8a700 1 -- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad841369a0 msgr2=0x7fad84067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8ac8a700 1 --2- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad841369a0 0x7fad84067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8ac8a700 1 -- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad84136d80 msgr2=0x7fad84061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8ac8a700 1 --2- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad84136d80 0x7fad84061200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8ac8a700 1 -- 172.21.15.31:0/3217627365 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad841367a0 con 0x7fad841398e0 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad89c88700 1 --2- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad84136d80 0x7fad84061200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8a489700 1 --2- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad841369a0 0x7fad84067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad8ac8a700 1 --2- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841398e0 0x7fad84139d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fad7c0032f0 tx=0x7fad7c0091d0).ready entity=mon.0 client_cookie=492e5687ddb100d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad89487700 1 -- 172.21.15.31:0/3217627365 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7c00b600 con 0x7fad841398e0 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad89487700 1 -- 172.21.15.31:0/3217627365 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c00b760 con 0x7fad841398e0 2024-04-18T10:36:31.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.545+0000 7fad89487700 1 -- 172.21.15.31:0/3217627365 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7c00b8d0 con 0x7fad841398e0 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.546+0000 7fad8c6ed700 1 -- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841398e0 msgr2=0x7fad84139d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.546+0000 7fad8c6ed700 1 --2- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841398e0 0x7fad84139d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fad7c0032f0 tx=0x7fad7c0091d0).stop 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.546+0000 7fad8c6ed700 1 -- 172.21.15.31:0/3217627365 shutdown_connections 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.546+0000 7fad8c6ed700 1 --2- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841398e0 0x7fad84139d90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.546+0000 7fad8c6ed700 1 --2- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad841369a0 0x7fad84067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.546+0000 7fad8c6ed700 1 --2- 172.21.15.31:0/3217627365 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad84136d80 0x7fad84061200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.546+0000 7fad8c6ed700 1 -- 172.21.15.31:0/3217627365 >> 172.21.15.31:0/3217627365 conn(0x7fad8406c0c0 msgr2=0x7fad8406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.546+0000 7fad8c6ed700 1 -- 172.21.15.31:0/3217627365 shutdown_connections 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.546+0000 7fad8c6ed700 1 -- 172.21.15.31:0/3217627365 wait complete. 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.547+0000 7fad8c6ed700 1 Processor -- start 2024-04-18T10:36:31.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.547+0000 7fad8c6ed700 1 -- start start 2024-04-18T10:36:31.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.547+0000 7fad8c6ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841369a0 0x7fad84095090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.547+0000 7fad8c6ed700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad84136d80 0x7fad840930a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.547+0000 7fad8c6ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad841398e0 0x7fad84093590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.547+0000 7fad8c6ed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad84097a30 con 0x7fad841369a0 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.547+0000 7fad8c6ed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840972d0 con 0x7fad841398e0 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.547+0000 7fad8c6ed700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad84095580 con 0x7fad84136d80 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8a489700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841369a0 0x7fad84095090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8a489700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841369a0 0x7fad84095090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52420/0 (socket says 172.21.15.31:52420) 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8ac8a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad841398e0 0x7fad84093590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8a489700 1 -- 172.21.15.31:0/1170686805 learned_addr learned my addr 172.21.15.31:0/1170686805 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad89c88700 1 --2- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad84136d80 0x7fad840930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8a489700 1 -- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad84136d80 msgr2=0x7fad840930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8a489700 1 --2- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad84136d80 0x7fad840930a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8a489700 1 -- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad841398e0 msgr2=0x7fad84093590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8a489700 1 --2- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad841398e0 0x7fad84093590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8a489700 1 -- 172.21.15.31:0/1170686805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7400b180 con 0x7fad841369a0 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8ac8a700 1 --2- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad841398e0 0x7fad84093590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8a489700 1 --2- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841369a0 0x7fad84095090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fad7400c000 tx=0x7fad74006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad737fe700 1 -- 172.21.15.31:0/1170686805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7400c890 con 0x7fad841369a0 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad737fe700 1 -- 172.21.15.31:0/1170686805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7400c9f0 con 0x7fad841369a0 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad737fe700 1 -- 172.21.15.31:0/1170686805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad7400cd50 con 0x7fad841369a0 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8000b1e0 con 0x7fad841369a0 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.548+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c009470 con 0x7fad841369a0 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.549+0000 7fad737fe700 1 -- 172.21.15.31:0/1170686805 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fad7401c460 con 0x7fad841369a0 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.550+0000 7fad737fe700 1 -- 172.21.15.31:0/1170686805 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fad7404ae30 con 0x7fad841369a0 2024-04-18T10:36:31.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.550+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad84137160 con 0x7fad841369a0 2024-04-18T10:36:31.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.553+0000 7fad737fe700 1 -- 172.21.15.31:0/1170686805 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fad74033760 con 0x7fad841369a0 2024-04-18T10:36:31.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.670+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad84057a60 con 0x7fad841369a0 2024-04-18T10:36:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.671+0000 7fad737fe700 1 -- 172.21.15.31:0/1170686805 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad74033350 con 0x7fad841369a0 2024-04-18T10:36:31.671 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:36:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 >> v1:172.21.15.31:6816/39551 conn(0x7fad64038dd0 legacy=0x7fad6403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841369a0 msgr2=0x7fad84095090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 --2- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841369a0 0x7fad84095090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fad7400c000 tx=0x7fad74006df0).stop 2024-04-18T10:36:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 shutdown_connections 2024-04-18T10:36:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 --2- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad841398e0 0x7fad84093590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 --2- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad841369a0 0x7fad84095090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 --2- 172.21.15.31:0/1170686805 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad84136d80 0x7fad840930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 >> 172.21.15.31:0/1170686805 conn(0x7fad8406c0c0 msgr2=0x7fad8406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 shutdown_connections 2024-04-18T10:36:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.672+0000 7fad8c6ed700 1 -- 172.21.15.31:0/1170686805 wait complete. 2024-04-18T10:36:31.682 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:36:31.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6d056b700 1 Processor -- start 2024-04-18T10:36:31.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6d056b700 1 -- start start 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6d056b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6c8064600 0x7fe6c8133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6d056b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8062fb0 0x7fe6c8063680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6d056b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c80a92a0 0x7fe6c81365f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6d056b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c8065150 con 0x7fe6c8064600 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6d056b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c8130bd0 con 0x7fe6c8062fb0 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6d056b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c8063b70 con 0x7fe6c80a92a0 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6cdb06700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8062fb0 0x7fe6c8063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.791+0000 7fe6ceb08700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c80a92a0 0x7fe6c81365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cdb06700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8062fb0 0x7fe6c8063680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39524/0 (socket says 172.21.15.31:39524) 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6ceb08700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c80a92a0 0x7fe6c81365f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59700/0 (socket says 172.21.15.31:59700) 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cdb06700 1 -- 172.21.15.31:0/964477437 learned_addr learned my addr 172.21.15.31:0/964477437 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6ce307700 1 --2- 172.21.15.31:0/964477437 >> v2:172.21.15.31:3300/0 conn(0x7fe6c8064600 0x7fe6c8133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cdb06700 1 -- 172.21.15.31:0/964477437 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c80a92a0 msgr2=0x7fe6c81365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cdb06700 1 --2- 172.21.15.31:0/964477437 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c80a92a0 0x7fe6c81365f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cdb06700 1 -- 172.21.15.31:0/964477437 >> v2:172.21.15.31:3300/0 conn(0x7fe6c8064600 msgr2=0x7fe6c8133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cdb06700 1 --2- 172.21.15.31:0/964477437 >> v2:172.21.15.31:3300/0 conn(0x7fe6c8064600 0x7fe6c8133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cdb06700 1 -- 172.21.15.31:0/964477437 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8061ee0 con 0x7fe6c8062fb0 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6ceb08700 1 --2- 172.21.15.31:0/964477437 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c80a92a0 0x7fe6c81365f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6ce307700 1 --2- 172.21.15.31:0/964477437 >> v2:172.21.15.31:3300/0 conn(0x7fe6c8064600 0x7fe6c8133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cdb06700 1 --2- 172.21.15.31:0/964477437 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8062fb0 0x7fe6c8063680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fe6bc002f70 tx=0x7fe6bc006eb0).ready entity=mon.1 client_cookie=251c474a32a822c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cd305700 1 -- 172.21.15.31:0/964477437 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc00d570 con 0x7fe6c8062fb0 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cd305700 1 -- 172.21.15.31:0/964477437 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc000e90 con 0x7fe6c8062fb0 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.792+0000 7fe6cd305700 1 -- 172.21.15.31:0/964477437 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6bc00d900 con 0x7fe6c8062fb0 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.793+0000 7fe6d056b700 1 -- 172.21.15.31:0/964477437 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8062fb0 msgr2=0x7fe6c8063680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.793+0000 7fe6d056b700 1 --2- 172.21.15.31:0/964477437 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8062fb0 0x7fe6c8063680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fe6bc002f70 tx=0x7fe6bc006eb0).stop 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.793+0000 7fe6d056b700 1 -- 172.21.15.31:0/964477437 shutdown_connections 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.793+0000 7fe6d056b700 1 --2- 172.21.15.31:0/964477437 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c80a92a0 0x7fe6c81365f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.793+0000 7fe6d056b700 1 --2- 172.21.15.31:0/964477437 >> v2:172.21.15.31:3300/0 conn(0x7fe6c8064600 0x7fe6c8133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.793+0000 7fe6d056b700 1 --2- 172.21.15.31:0/964477437 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8062fb0 0x7fe6c8063680 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.793+0000 7fe6d056b700 1 -- 172.21.15.31:0/964477437 >> 172.21.15.31:0/964477437 conn(0x7fe6c806c0c0 msgr2=0x7fe6c806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.793+0000 7fe6d056b700 1 -- 172.21.15.31:0/964477437 shutdown_connections 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.793+0000 7fe6d056b700 1 -- 172.21.15.31:0/964477437 wait complete. 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6d056b700 1 Processor -- start 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6d056b700 1 -- start start 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6d056b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8064600 0x7fe6c8067900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6d056b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c80a92a0 0x7fe6c8144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6d056b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c8067df0 0x7fe6c81454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6d056b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c8145990 con 0x7fe6c80a92a0 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6d056b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c80682d0 con 0x7fe6c8064600 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6d056b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c8144b60 con 0x7fe6c8067df0 2024-04-18T10:36:31.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6ce307700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8064600 0x7fe6c8067900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6ce307700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8064600 0x7fe6c8067900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39532/0 (socket says 172.21.15.31:39532) 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6cdb06700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c80a92a0 0x7fe6c8144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6ce307700 1 -- 172.21.15.31:0/4139250729 learned_addr learned my addr 172.21.15.31:0/4139250729 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6ce307700 1 -- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c8067df0 msgr2=0x7fe6c81454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.794+0000 7fe6ceb08700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c8067df0 0x7fe6c81454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6ce307700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c8067df0 0x7fe6c81454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6ce307700 1 -- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c80a92a0 msgr2=0x7fe6c8144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6ce307700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c80a92a0 0x7fe6c8144fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6ce307700 1 -- 172.21.15.31:0/4139250729 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c400b1a0 con 0x7fe6c8064600 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6ceb08700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c8067df0 0x7fe6c81454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6cdb06700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c80a92a0 0x7fe6c8144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6ce307700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8064600 0x7fe6c8067900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe6c8144a80 tx=0x7fe6c400a040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:31.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6bb7fe700 1 -- 172.21.15.31:0/4139250729 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6c400d040 con 0x7fe6c8064600 2024-04-18T10:36:31.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6bb7fe700 1 -- 172.21.15.31:0/4139250729 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c40072e0 con 0x7fe6c8064600 2024-04-18T10:36:31.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c000d910 con 0x7fe6c8064600 2024-04-18T10:36:31.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6bb7fe700 1 -- 172.21.15.31:0/4139250729 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6c40056f0 con 0x7fe6c8064600 2024-04-18T10:36:31.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.795+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc00b1e0 con 0x7fe6c8064600 2024-04-18T10:36:31.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.796+0000 7fe6bb7fe700 1 -- 172.21.15.31:0/4139250729 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe6c4005850 con 0x7fe6c8064600 2024-04-18T10:36:31.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.796+0000 7fe6bb7fe700 1 -- 172.21.15.31:0/4139250729 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe6c404a8b0 con 0x7fe6c8064600 2024-04-18T10:36:31.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.796+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c81336c0 con 0x7fe6c8064600 2024-04-18T10:36:31.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.799+0000 7fe6bb7fe700 1 -- 172.21.15.31:0/4139250729 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe6c402f7b0 con 0x7fe6c8064600 2024-04-18T10:36:31.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.915+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6c8057a60 con 0x7fe6c8064600 2024-04-18T10:36:31.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.915+0000 7fe6bb7fe700 1 -- 172.21.15.31:0/4139250729 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6c402a0a0 con 0x7fe6c8064600 2024-04-18T10:36:31.916 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.916+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 >> v1:172.21.15.31:6816/39551 conn(0x7fe6a8038da0 legacy=0x7fe6a803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.916+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8064600 msgr2=0x7fe6c8067900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.916+0000 7fe6d056b700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8064600 0x7fe6c8067900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe6c8144a80 tx=0x7fe6c400a040).stop 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.917+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 shutdown_connections 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.917+0000 7fe6d056b700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c8067df0 0x7fe6c81454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.917+0000 7fe6d056b700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c8064600 0x7fe6c8067900 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.917+0000 7fe6d056b700 1 --2- 172.21.15.31:0/4139250729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c80a92a0 0x7fe6c8144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.917+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 >> 172.21.15.31:0/4139250729 conn(0x7fe6c806c0c0 msgr2=0x7fe6c8135800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.917+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 shutdown_connections 2024-04-18T10:36:31.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:31.917+0000 7fe6d056b700 1 -- 172.21.15.31:0/4139250729 wait complete. 2024-04-18T10:36:31.927 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.035+0000 7f9d927cf700 1 Processor -- start 2024-04-18T10:36:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.035+0000 7f9d927cf700 1 -- start start 2024-04-18T10:36:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d927cf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d8c05bb30 0x7f9d8c063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d927cf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c062400 0x7f9d8c140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d927cf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c062b80 con 0x7f9d8c061fe0 2024-04-18T10:36:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d927cf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c062e60 con 0x7f9d8c05bb30 2024-04-18T10:36:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d927cf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c139a40 con 0x7f9d8c062400 2024-04-18T10:36:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d8c05bb30 0x7f9d8c063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d90d6c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c062400 0x7f9d8c140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d8c05bb30 0x7f9d8c063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52448/0 (socket says 172.21.15.31:52448) 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d90d6c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c062400 0x7f9d8c140c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39544/0 (socket says 172.21.15.31:39544) 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8bfff700 1 -- 172.21.15.31:0/912185208 learned_addr learned my addr 172.21.15.31:0/912185208 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8b7fe700 1 --1- 172.21.15.31:0/912185208 >> v1:172.21.15.31:6789/0 conn(0x7f9d8c061fe0 0x7f9d8c139fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38912/0 (socket says 172.21.15.31:38912) 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8bfff700 1 -- 172.21.15.31:0/912185208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c062400 msgr2=0x7f9d8c140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8bfff700 1 --2- 172.21.15.31:0/912185208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c062400 0x7f9d8c140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8bfff700 1 -- 172.21.15.31:0/912185208 >> v1:172.21.15.31:6789/0 conn(0x7f9d8c061fe0 legacy=0x7f9d8c139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8bfff700 1 -- 172.21.15.31:0/912185208 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c139d00 con 0x7f9d8c05bb30 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8bfff700 1 --2- 172.21.15.31:0/912185208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c05bb30 0x7f9d8c063360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f9d7c002f70 tx=0x7f9d7c006eb0).ready entity=mon.0 client_cookie=f25e80f26b512858 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.036+0000 7f9d8affd700 1 -- 172.21.15.31:0/912185208 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d7c00d570 con 0x7f9d8c05bb30 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d8affd700 1 -- 172.21.15.31:0/912185208 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c000e90 con 0x7f9d8c05bb30 2024-04-18T10:36:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d8affd700 1 -- 172.21.15.31:0/912185208 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d7c00d900 con 0x7f9d8c05bb30 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d927cf700 1 -- 172.21.15.31:0/912185208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c05bb30 msgr2=0x7f9d8c063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d927cf700 1 --2- 172.21.15.31:0/912185208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c05bb30 0x7f9d8c063360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f9d7c002f70 tx=0x7f9d7c006eb0).stop 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d927cf700 1 -- 172.21.15.31:0/912185208 shutdown_connections 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d927cf700 1 --2- 172.21.15.31:0/912185208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c062400 0x7f9d8c140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d927cf700 1 --2- 172.21.15.31:0/912185208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c05bb30 0x7f9d8c063360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d927cf700 1 -- 172.21.15.31:0/912185208 >> 172.21.15.31:0/912185208 conn(0x7f9d8c06c0c0 msgr2=0x7f9d8c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d927cf700 1 -- 172.21.15.31:0/912185208 shutdown_connections 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.037+0000 7f9d927cf700 1 -- 172.21.15.31:0/912185208 wait complete. 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.038+0000 7f9d927cf700 1 Processor -- start 2024-04-18T10:36:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.038+0000 7f9d927cf700 1 -- start start 2024-04-18T10:36:32.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d927cf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d8c05bb30 0x7f9d8c136320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d927cf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c061fe0 0x7f9d8c092110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d927cf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c0961d0 0x7f9d8c1491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d927cf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c095650 con 0x7f9d8c0961d0 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d927cf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c136810 con 0x7f9d8c061fe0 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d927cf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c092a40 con 0x7f9d8c05bb30 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c061fe0 0x7f9d8c092110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d8c05bb30 0x7f9d8c136320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c061fe0 0x7f9d8c092110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39548/0 (socket says 172.21.15.31:39548) 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8b7fe700 1 -- 172.21.15.31:0/985161281 learned_addr learned my addr 172.21.15.31:0/985161281 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d90d6c700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c0961d0 0x7f9d8c1491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8bfff700 1 -- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c061fe0 msgr2=0x7f9d8c092110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8bfff700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c061fe0 0x7f9d8c092110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8bfff700 1 -- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c0961d0 msgr2=0x7f9d8c1491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8bfff700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c0961d0 0x7f9d8c1491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8bfff700 1 -- 172.21.15.31:0/985161281 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c00b1e0 con 0x7f9d8c05bb30 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8b7fe700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c061fe0 0x7f9d8c092110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d90d6c700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c0961d0 0x7f9d8c1491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d8bfff700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d8c05bb30 0x7f9d8c136320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9d7c002f70 tx=0x7f9d7c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d897fa700 1 -- 172.21.15.31:0/985161281 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d7c0116e0 con 0x7f9d8c05bb30 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c092ce0 con 0x7f9d8c05bb30 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d897fa700 1 -- 172.21.15.31:0/985161281 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c011840 con 0x7f9d8c05bb30 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d897fa700 1 -- 172.21.15.31:0/985161281 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d7c011ba0 con 0x7f9d8c05bb30 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.039+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c094e30 con 0x7f9d8c05bb30 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.040+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c095110 con 0x7f9d8c05bb30 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.040+0000 7f9d897fa700 1 -- 172.21.15.31:0/985161281 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9d7c01a040 con 0x7f9d8c05bb30 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.041+0000 7f9d897fa700 1 -- 172.21.15.31:0/985161281 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9d7c04b750 con 0x7f9d8c05bb30 2024-04-18T10:36:32.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.043+0000 7f9d897fa700 1 -- 172.21.15.31:0/985161281 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9d8c095110 con 0x7f9d8c05bb30 2024-04-18T10:36:32.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.192+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d8c095110 con 0x7f9d8c05bb30 2024-04-18T10:36:32.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.193+0000 7f9d897fa700 1 -- 172.21.15.31:0/985161281 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2325 (secure 0 0 0) 0x7f9d8c095110 con 0x7f9d8c05bb30 2024-04-18T10:36:32.193 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:32.193 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:11.997545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:32.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 >> v1:172.21.15.31:6816/39551 conn(0x7f9d70038e60 legacy=0x7f9d7003b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d8c05bb30 msgr2=0x7f9d8c136320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d8c05bb30 0x7f9d8c136320 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f9d7c002f70 tx=0x7f9d7c015000).stop 2024-04-18T10:36:32.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 shutdown_connections 2024-04-18T10:36:32.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d8c05bb30 0x7f9d8c136320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d8c0961d0 0x7f9d8c1491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 --2- 172.21.15.31:0/985161281 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d8c061fe0 0x7f9d8c092110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 >> 172.21.15.31:0/985161281 conn(0x7f9d8c06c0c0 msgr2=0x7f9d8c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:32.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 shutdown_connections 2024-04-18T10:36:32.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.194+0000 7f9d927cf700 1 -- 172.21.15.31:0/985161281 wait complete. 2024-04-18T10:36:32.196 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-04-18T10:36:32.205 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:36:32.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.310+0000 7fd9ec658700 1 Processor -- start 2024-04-18T10:36:32.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9ec658700 1 -- start start 2024-04-18T10:36:32.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9ec658700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e4133590 0x7fd9e4133970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9ec658700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e40a82c0 0x7fd9e405ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9ec658700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e4139bc0 con 0x7fd9e405d300 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9ec658700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e4139e60 con 0x7fd9e40a82c0 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9ec658700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e41398f0 con 0x7fd9e4133590 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9e9bf3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e40a82c0 0x7fd9e405ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9ea3f4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e4133590 0x7fd9e4133970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9eabf5700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd9e405d300 0x7fd9e40ac480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38924/0 (socket says 172.21.15.31:38924) 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9e9bf3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e40a82c0 0x7fd9e405ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39562/0 (socket says 172.21.15.31:39562) 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.311+0000 7fd9eabf5700 1 -- 172.21.15.31:0/1065009689 learned_addr learned my addr 172.21.15.31:0/1065009689 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.312+0000 7fd9ea3f4700 1 -- 172.21.15.31:0/1065009689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e40a82c0 msgr2=0x7fd9e405ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.312+0000 7fd9ea3f4700 1 --2- 172.21.15.31:0/1065009689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e40a82c0 0x7fd9e405ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.312+0000 7fd9ea3f4700 1 -- 172.21.15.31:0/1065009689 >> v1:172.21.15.31:6789/0 conn(0x7fd9e405d300 legacy=0x7fd9e40ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.312+0000 7fd9ea3f4700 1 -- 172.21.15.31:0/1065009689 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40a86c0 con 0x7fd9e4133590 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.312+0000 7fd9e9bf3700 1 --2- 172.21.15.31:0/1065009689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e40a82c0 0x7fd9e405ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.312+0000 7fd9ea3f4700 1 --2- 172.21.15.31:0/1065009689 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e4133590 0x7fd9e4133970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd9dc0032f0 tx=0x7fd9dc0091d0).ready entity=mon.2 client_cookie=77f4bf9d6acebf51 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.312+0000 7fd9e93f2700 1 -- 172.21.15.31:0/1065009689 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9dc00b6c0 con 0x7fd9e4133590 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.312+0000 7fd9e93f2700 1 -- 172.21.15.31:0/1065009689 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc00b820 con 0x7fd9e4133590 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.312+0000 7fd9e93f2700 1 -- 172.21.15.31:0/1065009689 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9dc00b990 con 0x7fd9e4133590 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.313+0000 7fd9ec658700 1 -- 172.21.15.31:0/1065009689 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e4133590 msgr2=0x7fd9e4133970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.313+0000 7fd9ec658700 1 --2- 172.21.15.31:0/1065009689 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e4133590 0x7fd9e4133970 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd9dc0032f0 tx=0x7fd9dc0091d0).stop 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.313+0000 7fd9ec658700 1 -- 172.21.15.31:0/1065009689 shutdown_connections 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.313+0000 7fd9ec658700 1 --2- 172.21.15.31:0/1065009689 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e4133590 0x7fd9e4133970 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.313+0000 7fd9ec658700 1 --2- 172.21.15.31:0/1065009689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e40a82c0 0x7fd9e405ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.313+0000 7fd9ec658700 1 -- 172.21.15.31:0/1065009689 >> 172.21.15.31:0/1065009689 conn(0x7fd9e4061480 msgr2=0x7fd9e4066a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:32.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.313+0000 7fd9ec658700 1 -- 172.21.15.31:0/1065009689 shutdown_connections 2024-04-18T10:36:32.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.313+0000 7fd9ec658700 1 -- 172.21.15.31:0/1065009689 wait complete. 2024-04-18T10:36:32.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9ec658700 1 Processor -- start 2024-04-18T10:36:32.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9ec658700 1 -- start start 2024-04-18T10:36:32.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9ec658700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e405d300 0x7fd9e4149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9ec658700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e40a82c0 0x7fd9e41498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9ec658700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4133590 0x7fd9e4149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9ec658700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e414a2d0 con 0x7fd9e4133590 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9ec658700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e4138c80 con 0x7fd9e405d300 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9ec658700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e40a6f80 con 0x7fd9e40a82c0 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9e9bf3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e40a82c0 0x7fd9e41498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9eabf5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4133590 0x7fd9e4149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9e9bf3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e40a82c0 0x7fd9e41498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59748/0 (socket says 172.21.15.31:59748) 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9e9bf3700 1 -- 172.21.15.31:0/1950859787 learned_addr learned my addr 172.21.15.31:0/1950859787 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.314+0000 7fd9ea3f4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e405d300 0x7fd9e4149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9e9bf3700 1 -- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e405d300 msgr2=0x7fd9e4149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9e9bf3700 1 --2- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e405d300 0x7fd9e4149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9e9bf3700 1 -- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4133590 msgr2=0x7fd9e4149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9e9bf3700 1 --2- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4133590 0x7fd9e4149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9e9bf3700 1 -- 172.21.15.31:0/1950859787 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d400b180 con 0x7fd9e40a82c0 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9eabf5700 1 --2- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4133590 0x7fd9e4149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9e9bf3700 1 --2- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e40a82c0 0x7fd9e41498f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd9d400c000 tx=0x7fd9d4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9d37fe700 1 -- 172.21.15.31:0/1950859787 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d4010780 con 0x7fd9e40a82c0 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9d37fe700 1 -- 172.21.15.31:0/1950859787 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d40108e0 con 0x7fd9e40a82c0 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9d37fe700 1 -- 172.21.15.31:0/1950859787 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d4010c40 con 0x7fd9e40a82c0 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc009470 con 0x7fd9e40a82c0 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.315+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e40aa460 con 0x7fd9e40a82c0 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.316+0000 7fd9d37fe700 1 -- 172.21.15.31:0/1950859787 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd9d401c460 con 0x7fd9e40a82c0 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.316+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e405da20 con 0x7fd9e40a82c0 2024-04-18T10:36:32.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.316+0000 7fd9d37fe700 1 -- 172.21.15.31:0/1950859787 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd9d404aed0 con 0x7fd9e40a82c0 2024-04-18T10:36:32.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.319+0000 7fd9d37fe700 1 -- 172.21.15.31:0/1950859787 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd9d402fcc0 con 0x7fd9e40a82c0 2024-04-18T10:36:32.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.436+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9e4057a60 con 0x7fd9e40a82c0 2024-04-18T10:36:32.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.436+0000 7fd9d37fe700 1 -- 172.21.15.31:0/1950859787 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+10538 (secure 0 0 0) 0x7fd9d404d070 con 0x7fd9e40a82c0 2024-04-18T10:36:32.437 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:32.437 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:25.572295+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-18T10:36:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 >> v1:172.21.15.31:6816/39551 conn(0x7fd9c4038ec0 legacy=0x7fd9c403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e40a82c0 msgr2=0x7fd9e41498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 --2- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e40a82c0 0x7fd9e41498f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd9d400c000 tx=0x7fd9d4006df0).stop 2024-04-18T10:36:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 shutdown_connections 2024-04-18T10:36:32.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 --2- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd9e4133590 0x7fd9e4149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 --2- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd9e405d300 0x7fd9e4149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 --2- 172.21.15.31:0/1950859787 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd9e40a82c0 0x7fd9e41498f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 >> 172.21.15.31:0/1950859787 conn(0x7fd9e4061480 msgr2=0x7fd9e4135bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 shutdown_connections 2024-04-18T10:36:32.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.438+0000 7fd9ec658700 1 -- 172.21.15.31:0/1950859787 wait complete. 2024-04-18T10:36:32.448 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-18T10:36:32.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.557+0000 7f62c504c700 1 Processor -- start 2024-04-18T10:36:32.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.557+0000 7f62c504c700 1 -- start start 2024-04-18T10:36:32.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62c504c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c00a5050 0x7f62c01348e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62c504c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62c0134dd0 0x7f62c013e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62c504c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c00a4870 con 0x7f62c0134500 2024-04-18T10:36:32.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62c504c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c00a3e30 con 0x7f62c0134dd0 2024-04-18T10:36:32.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62c504c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00a4050 con 0x7f62c00a5050 2024-04-18T10:36:32.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62be59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c00a5050 0x7f62c01348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62bf59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62c0134dd0 0x7f62c013e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62bed9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f62c0134500 0x7f62c00a3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38926/0 (socket says 172.21.15.31:38926) 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62bed9d700 1 -- 172.21.15.31:0/35724162 learned_addr learned my addr 172.21.15.31:0/35724162 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62be59c700 1 -- 172.21.15.31:0/35724162 >> v2:172.21.15.31:3300/0 conn(0x7f62c0134dd0 msgr2=0x7f62c013e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62be59c700 1 --2- 172.21.15.31:0/35724162 >> v2:172.21.15.31:3300/0 conn(0x7f62c0134dd0 0x7f62c013e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62be59c700 1 -- 172.21.15.31:0/35724162 >> v1:172.21.15.31:6789/0 conn(0x7f62c0134500 legacy=0x7f62c00a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62be59c700 1 -- 172.21.15.31:0/35724162 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c00a42f0 con 0x7f62c00a5050 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.558+0000 7f62bf59e700 1 --2- 172.21.15.31:0/35724162 >> v2:172.21.15.31:3300/0 conn(0x7f62c0134dd0 0x7f62c013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62be59c700 1 --2- 172.21.15.31:0/35724162 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c00a5050 0x7f62c01348e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f62b0002f70 tx=0x7f62b0006df0).ready entity=mon.2 client_cookie=b1ebfdcd311a07f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62bdd9b700 1 -- 172.21.15.31:0/35724162 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b000d570 con 0x7f62c00a5050 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62bdd9b700 1 -- 172.21.15.31:0/35724162 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0000e90 con 0x7f62c00a5050 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62bdd9b700 1 -- 172.21.15.31:0/35724162 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b000d8c0 con 0x7f62c00a5050 2024-04-18T10:36:32.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62c504c700 1 -- 172.21.15.31:0/35724162 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c00a5050 msgr2=0x7f62c01348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62c504c700 1 --2- 172.21.15.31:0/35724162 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c00a5050 0x7f62c01348e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f62b0002f70 tx=0x7f62b0006df0).stop 2024-04-18T10:36:32.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62c504c700 1 -- 172.21.15.31:0/35724162 shutdown_connections 2024-04-18T10:36:32.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62c504c700 1 --2- 172.21.15.31:0/35724162 >> v2:172.21.15.31:3300/0 conn(0x7f62c0134dd0 0x7f62c013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62c504c700 1 --2- 172.21.15.31:0/35724162 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c00a5050 0x7f62c01348e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62c504c700 1 -- 172.21.15.31:0/35724162 >> 172.21.15.31:0/35724162 conn(0x7f62c0060ac0 msgr2=0x7f62c00a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:32.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62c504c700 1 -- 172.21.15.31:0/35724162 shutdown_connections 2024-04-18T10:36:32.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.559+0000 7f62c504c700 1 -- 172.21.15.31:0/35724162 wait complete. 2024-04-18T10:36:32.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.560+0000 7f62c504c700 1 Processor -- start 2024-04-18T10:36:32.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.560+0000 7f62c504c700 1 -- start start 2024-04-18T10:36:32.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62c504c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62c00a5050 0x7f62c00665f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62c504c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c0134500 0x7f62c0065880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62c504c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c0134dd0 0x7f62c0148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62c504c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0066da0 con 0x7f62c0134500 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62c504c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00649f0 con 0x7f62c00a5050 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62c504c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c0065380 con 0x7f62c0134dd0 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62bed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62c00a5050 0x7f62c00665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62be59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c0134500 0x7f62c0065880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62bf59e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c0134dd0 0x7f62c0148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62be59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c0134500 0x7f62c0065880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52498/0 (socket says 172.21.15.31:52498) 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62bf59e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c0134dd0 0x7f62c0148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59768/0 (socket says 172.21.15.31:59768) 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62be59c700 1 -- 172.21.15.31:0/2395063556 learned_addr learned my addr 172.21.15.31:0/2395063556 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62bed9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62c00a5050 0x7f62c00665f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39574/0 (socket says 172.21.15.31:39574) 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62be59c700 1 -- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c0134dd0 msgr2=0x7f62c0148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62be59c700 1 --2- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c0134dd0 0x7f62c0148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62be59c700 1 -- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62c00a5050 msgr2=0x7f62c00665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62be59c700 1 --2- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62c00a5050 0x7f62c00665f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62be59c700 1 -- 172.21.15.31:0/2395063556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b8009470 con 0x7f62c0134500 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.561+0000 7f62bed9d700 1 --2- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62c00a5050 0x7f62c00665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.562+0000 7f62be59c700 1 --2- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c0134500 0x7f62c0065880 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f62b0002f70 tx=0x7f62b0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.562+0000 7f62affff700 1 -- 172.21.15.31:0/2395063556 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b0013e90 con 0x7f62c0134500 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.562+0000 7f62affff700 1 -- 172.21.15.31:0/2395063556 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b001e400 con 0x7f62c0134500 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.562+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b000b180 con 0x7f62c0134500 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.562+0000 7f62affff700 1 -- 172.21.15.31:0/2395063556 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b001e760 con 0x7f62c0134500 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.562+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c0097110 con 0x7f62c0134500 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.563+0000 7f62affff700 1 -- 172.21.15.31:0/2395063556 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f62b0025030 con 0x7f62c0134500 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.563+0000 7f62affff700 1 -- 172.21.15.31:0/2395063556 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f62b004b690 con 0x7f62c0134500 2024-04-18T10:36:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.563+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c005bd30 con 0x7f62c0134500 2024-04-18T10:36:32.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.566+0000 7f62affff700 1 -- 172.21.15.31:0/2395063556 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f62b00058c0 con 0x7f62c0134500 2024-04-18T10:36:32.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.717+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f62c0057a60 con 0x7f62c0134500 2024-04-18T10:36:32.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.990+0000 7f62affff700 1 -- 172.21.15.31:0/2395063556 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f62b0012460 con 0x7f62c0134500 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 >> v1:172.21.15.31:6816/39551 conn(0x7f629c038da0 legacy=0x7f629c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c0134500 msgr2=0x7f62c0065880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 --2- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c0134500 0x7f62c0065880 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f62b0002f70 tx=0x7f62b0014000).stop 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 shutdown_connections 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 --2- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f62c0134dd0 0x7f62c0148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 --2- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f62c00a5050 0x7f62c00665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 --2- 172.21.15.31:0/2395063556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62c0134500 0x7f62c0065880 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 >> 172.21.15.31:0/2395063556 conn(0x7f62c0060ac0 msgr2=0x7f62c01353e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 shutdown_connections 2024-04-18T10:36:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:32.991+0000 7f62c504c700 1 -- 172.21.15.31:0/2395063556 wait complete. 2024-04-18T10:36:33.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-04-18T10:36:33.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.114+0000 7f4d76a1f700 1 Processor -- start 2024-04-18T10:36:33.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.114+0000 7f4d76a1f700 1 -- start start 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d76a1f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d701365d0 0x7f4d701369b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d76a1f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 0x7f4d7005b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d76a1f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700660f0 con 0x7f4d700a4f80 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d76a1f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700668d0 con 0x7f4d701365d0 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d76a1f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700a4590 con 0x7f4d70066d80 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d701365d0 0x7f4d701369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 0x7f4d7005b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d74fbc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4d700a4f80 0x7f4d7005be60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38928/0 (socket says 172.21.15.31:38928) 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d74fbc700 1 -- 172.21.15.31:0/3077203274 learned_addr learned my addr 172.21.15.31:0/3077203274 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d701365d0 0x7f4d701369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39588/0 (socket says 172.21.15.31:39588) 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6effd700 1 -- 172.21.15.31:0/3077203274 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598091222 0 0) 0x7f4d700660f0 con 0x7f4d700a4f80 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6f7fe700 1 -- 172.21.15.31:0/3077203274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d701365d0 msgr2=0x7f4d701369b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6f7fe700 1 --2- 172.21.15.31:0/3077203274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d701365d0 0x7f4d701369b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6f7fe700 1 -- 172.21.15.31:0/3077203274 >> v1:172.21.15.31:6789/0 conn(0x7f4d700a4f80 legacy=0x7f4d7005be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6f7fe700 1 -- 172.21.15.31:0/3077203274 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700a4850 con 0x7f4d70066d80 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6ffff700 1 --2- 172.21.15.31:0/3077203274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d701365d0 0x7f4d701369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6f7fe700 1 --2- 172.21.15.31:0/3077203274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 0x7f4d7005b970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4d64002f70 tx=0x7f4d64006df0).ready entity=mon.2 client_cookie=d99fecf73e8095c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6effd700 1 -- 172.21.15.31:0/3077203274 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d6400d570 con 0x7f4d70066d80 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6effd700 1 -- 172.21.15.31:0/3077203274 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64000e90 con 0x7f4d70066d80 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.115+0000 7f4d6effd700 1 -- 172.21.15.31:0/3077203274 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d6400d8c0 con 0x7f4d70066d80 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.116+0000 7f4d76a1f700 1 -- 172.21.15.31:0/3077203274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 msgr2=0x7f4d7005b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.116+0000 7f4d76a1f700 1 --2- 172.21.15.31:0/3077203274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 0x7f4d7005b970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4d64002f70 tx=0x7f4d64006df0).stop 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.116+0000 7f4d76a1f700 1 -- 172.21.15.31:0/3077203274 shutdown_connections 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.116+0000 7f4d76a1f700 1 --2- 172.21.15.31:0/3077203274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d701365d0 0x7f4d701369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.116+0000 7f4d76a1f700 1 --2- 172.21.15.31:0/3077203274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 0x7f4d7005b970 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.116+0000 7f4d76a1f700 1 -- 172.21.15.31:0/3077203274 >> 172.21.15.31:0/3077203274 conn(0x7f4d70060ac0 msgr2=0x7f4d700a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.116+0000 7f4d76a1f700 1 -- 172.21.15.31:0/3077203274 shutdown_connections 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.116+0000 7f4d76a1f700 1 -- 172.21.15.31:0/3077203274 wait complete. 2024-04-18T10:36:33.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.117+0000 7f4d76a1f700 1 Processor -- start 2024-04-18T10:36:33.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.117+0000 7f4d76a1f700 1 -- start start 2024-04-18T10:36:33.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d76a1f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 0x7f4d70145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d76a1f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d700a4f80 0x7f4d70148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d76a1f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d701365d0 0x7f4d70149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d76a1f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701489e0 con 0x7f4d701365d0 2024-04-18T10:36:33.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d76a1f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70093980 con 0x7f4d700a4f80 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d76a1f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701461e0 con 0x7f4d70066d80 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d700a4f80 0x7f4d70148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d700a4f80 0x7f4d70148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39602/0 (socket says 172.21.15.31:39602) 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6f7fe700 1 -- 172.21.15.31:0/1619906825 learned_addr learned my addr 172.21.15.31:0/1619906825 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d74fbc700 1 --2- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d701365d0 0x7f4d70149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 0x7f4d70145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6f7fe700 1 -- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 msgr2=0x7f4d70145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6f7fe700 1 --2- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 0x7f4d70145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6f7fe700 1 -- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d701365d0 msgr2=0x7f4d70149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6f7fe700 1 --2- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d701365d0 0x7f4d70149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6f7fe700 1 -- 172.21.15.31:0/1619906825 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6000b180 con 0x7f4d700a4f80 2024-04-18T10:36:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6f7fe700 1 --2- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d700a4f80 0x7f4d70148da0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f4d64002f70 tx=0x7f4d64014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6d7fa700 1 -- 172.21.15.31:0/1619906825 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d64016070 con 0x7f4d700a4f80 2024-04-18T10:36:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6d7fa700 1 -- 172.21.15.31:0/1619906825 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64013bf0 con 0x7f4d700a4f80 2024-04-18T10:36:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6400b180 con 0x7f4d700a4f80 2024-04-18T10:36:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d6d7fa700 1 -- 172.21.15.31:0/1619906825 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d6401e450 con 0x7f4d700a4f80 2024-04-18T10:36:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.118+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d700a2d70 con 0x7f4d700a4f80 2024-04-18T10:36:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.119+0000 7f4d6d7fa700 1 -- 172.21.15.31:0/1619906825 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4d6400f030 con 0x7f4d700a4f80 2024-04-18T10:36:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.119+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d70057a60 con 0x7f4d700a4f80 2024-04-18T10:36:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.120+0000 7f4d6d7fa700 1 -- 172.21.15.31:0/1619906825 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4d6404b4e0 con 0x7f4d700a4f80 2024-04-18T10:36:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.123+0000 7f4d6d7fa700 1 -- 172.21.15.31:0/1619906825 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4d640275c0 con 0x7f4d700a4f80 2024-04-18T10:36:33.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.275+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f4d700672c0 con 0x7f4d700a4f80 2024-04-18T10:36:33.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.558+0000 7f4d6d7fa700 1 -- 172.21.15.31:0/1619906825 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v10) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4d640201d0 con 0x7f4d700a4f80 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.560+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 >> v1:172.21.15.31:6816/39551 conn(0x7f4d50038da0 legacy=0x7f4d5003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.560+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d700a4f80 msgr2=0x7f4d70148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.560+0000 7f4d76a1f700 1 --2- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d700a4f80 0x7f4d70148da0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f4d64002f70 tx=0x7f4d64014000).stop 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.560+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 shutdown_connections 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.560+0000 7f4d76a1f700 1 --2- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4d70066d80 0x7f4d70145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.560+0000 7f4d76a1f700 1 --2- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d701365d0 0x7f4d70149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.560+0000 7f4d76a1f700 1 --2- 172.21.15.31:0/1619906825 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4d700a4f80 0x7f4d70148da0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.560+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 >> 172.21.15.31:0/1619906825 conn(0x7f4d70060ac0 msgr2=0x7f4d70138490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.560+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 shutdown_connections 2024-04-18T10:36:33.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.561+0000 7f4d76a1f700 1 -- 172.21.15.31:0/1619906825 wait complete. 2024-04-18T10:36:33.572 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.679+0000 7f0070f8e700 1 Processor -- start 2024-04-18T10:36:33.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.679+0000 7f0070f8e700 1 -- start start 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.679+0000 7f0070f8e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c067400 0x7f006c136d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.679+0000 7f0070f8e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f006c13ec70 0x7f006c141060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.679+0000 7f0070f8e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006c060920 con 0x7f006c1369a0 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.679+0000 7f0070f8e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006c061910 con 0x7f006c13ec70 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.679+0000 7f0070f8e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f006c136310 con 0x7f006c067400 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.679+0000 7f0069d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c067400 0x7f006c136d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f0069d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c067400 0x7f006c136d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59796/0 (socket says 172.21.15.31:59796) 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f0069d9b700 1 -- 172.21.15.31:0/1465552652 learned_addr learned my addr 172.21.15.31:0/1465552652 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f006ad9d700 1 --2- 172.21.15.31:0/1465552652 >> v2:172.21.15.31:3300/0 conn(0x7f006c13ec70 0x7f006c141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f006ad9d700 1 -- 172.21.15.31:0/1465552652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c067400 msgr2=0x7f006c136d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f006ad9d700 1 --2- 172.21.15.31:0/1465552652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c067400 0x7f006c136d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f006ad9d700 1 -- 172.21.15.31:0/1465552652 >> v1:172.21.15.31:6789/0 conn(0x7f006c1369a0 legacy=0x7f006c061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f006ad9d700 1 -- 172.21.15.31:0/1465552652 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c137270 con 0x7f006c13ec70 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f0069d9b700 1 --2- 172.21.15.31:0/1465552652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c067400 0x7f006c136d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f006ad9d700 1 --2- 172.21.15.31:0/1465552652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c13ec70 0x7f006c141060 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f00640032f0 tx=0x7f00640091d0).ready entity=mon.0 client_cookie=61664c6180a9a4d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f006959a700 1 -- 172.21.15.31:0/1465552652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006400b6c0 con 0x7f006c13ec70 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f006959a700 1 -- 172.21.15.31:0/1465552652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006400b820 con 0x7f006c13ec70 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.680+0000 7f006959a700 1 -- 172.21.15.31:0/1465552652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f006400b990 con 0x7f006c13ec70 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.681+0000 7f0070f8e700 1 -- 172.21.15.31:0/1465552652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c13ec70 msgr2=0x7f006c141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.681+0000 7f0070f8e700 1 --2- 172.21.15.31:0/1465552652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c13ec70 0x7f006c141060 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f00640032f0 tx=0x7f00640091d0).stop 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.681+0000 7f0070f8e700 1 -- 172.21.15.31:0/1465552652 shutdown_connections 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.681+0000 7f0070f8e700 1 --2- 172.21.15.31:0/1465552652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c13ec70 0x7f006c141060 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.681+0000 7f0070f8e700 1 --2- 172.21.15.31:0/1465552652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c067400 0x7f006c136d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.681+0000 7f0070f8e700 1 -- 172.21.15.31:0/1465552652 >> 172.21.15.31:0/1465552652 conn(0x7f006c06c0c0 msgr2=0x7f006c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.681+0000 7f0070f8e700 1 -- 172.21.15.31:0/1465552652 shutdown_connections 2024-04-18T10:36:33.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.681+0000 7f0070f8e700 1 -- 172.21.15.31:0/1465552652 wait complete. 2024-04-18T10:36:33.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0070f8e700 1 Processor -- start 2024-04-18T10:36:33.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0070f8e700 1 -- start start 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0070f8e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c067400 0x7f006c139550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0070f8e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c1369a0 0x7f006c137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0070f8e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f006c13ec70 0x7f006c137c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0070f8e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c0926d0 con 0x7f006c067400 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0070f8e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c13d910 con 0x7f006c13ec70 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0070f8e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f006c0928b0 con 0x7f006c1369a0 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0069d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c1369a0 0x7f006c137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f006ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f006c13ec70 0x7f006c137c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0069d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c1369a0 0x7f006c137710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:59810/0 (socket says 172.21.15.31:59810) 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f006ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f006c13ec70 0x7f006c137c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39612/0 (socket says 172.21.15.31:39612) 2024-04-18T10:36:33.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f0069d9b700 1 -- 172.21.15.31:0/493429252 learned_addr learned my addr 172.21.15.31:0/493429252 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.682+0000 7f006a59c700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c067400 0x7f006c139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f0069d9b700 1 -- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f006c13ec70 msgr2=0x7f006c137c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f0069d9b700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f006c13ec70 0x7f006c137c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f0069d9b700 1 -- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c067400 msgr2=0x7f006c139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f0069d9b700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c067400 0x7f006c139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f0069d9b700 1 -- 172.21.15.31:0/493429252 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006000b1e0 con 0x7f006c1369a0 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f006ad9d700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f006c13ec70 0x7f006c137c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f006a59c700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c067400 0x7f006c139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f0069d9b700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c1369a0 0x7f006c137710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f006c061470 tx=0x7f0060006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f005b7fe700 1 -- 172.21.15.31:0/493429252 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0060012600 con 0x7f006c1369a0 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f005b7fe700 1 -- 172.21.15.31:0/493429252 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0060012760 con 0x7f006c1369a0 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0064009470 con 0x7f006c1369a0 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f005b7fe700 1 -- 172.21.15.31:0/493429252 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0060012ac0 con 0x7f006c1369a0 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.683+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006c139020 con 0x7f006c1369a0 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.684+0000 7f005b7fe700 1 -- 172.21.15.31:0/493429252 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0060022070 con 0x7f006c1369a0 2024-04-18T10:36:33.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.684+0000 7f005b7fe700 1 -- 172.21.15.31:0/493429252 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f006004ab10 con 0x7f006c1369a0 2024-04-18T10:36:33.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.684+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006c139dc0 con 0x7f006c1369a0 2024-04-18T10:36:33.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.687+0000 7f005b7fe700 1 -- 172.21.15.31:0/493429252 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f006c139dc0 con 0x7f006c1369a0 2024-04-18T10:36:33.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.834+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f006c139020 con 0x7f006c1369a0 2024-04-18T10:36:33.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.835+0000 7f005b7fe700 1 -- 172.21.15.31:0/493429252 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f006c139020 con 0x7f006c1369a0 2024-04-18T10:36:33.835 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:33.835 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 >> v1:172.21.15.31:6816/39551 conn(0x7f0048038da0 legacy=0x7f004803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c1369a0 msgr2=0x7f006c137710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c1369a0 0x7f006c137710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f006c061470 tx=0x7f0060006eb0).stop 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 shutdown_connections 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f006c13ec70 0x7f006c137c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f006c067400 0x7f006c139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 --2- 172.21.15.31:0/493429252 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f006c1369a0 0x7f006c137710 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 >> 172.21.15.31:0/493429252 conn(0x7f006c06c0c0 msgr2=0x7f006c133330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 shutdown_connections 2024-04-18T10:36:33.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:33.836+0000 7f0070f8e700 1 -- 172.21.15.31:0/493429252 wait complete. 2024-04-18T10:36:33.838 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:34.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:34.149 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:35.150 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:35.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.270+0000 7f64f7b28700 1 Processor -- start 2024-04-18T10:36:35.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.270+0000 7f64f7b28700 1 -- start start 2024-04-18T10:36:35.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.270+0000 7f64f7b28700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f00a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:35.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.270+0000 7f64f7b28700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64f0136af0 0x7f64f005c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.270+0000 7f64f7b28700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f0066c10 con 0x7f64f0136710 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.270+0000 7f64f7b28700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f0066eb0 con 0x7f64f0136af0 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.270+0000 7f64f7b28700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f00a3b40 con 0x7f64f00a5000 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f60c5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64f0136af0 0x7f64f005c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f50c3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f00a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f60c5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f64f0136af0 0x7f64f005c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35120/0 (socket says 172.21.15.31:35120) 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f60c5700 1 -- 172.21.15.31:0/3907903398 learned_addr learned my addr 172.21.15.31:0/3907903398 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f58c4700 1 --1- 172.21.15.31:0/3907903398 >> v1:172.21.15.31:6789/0 conn(0x7f64f0136710 0x7f64f005b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48386/0 (socket says 172.21.15.31:48386) 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f60c5700 1 -- 172.21.15.31:0/3907903398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 msgr2=0x7f64f00a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f60c5700 1 --2- 172.21.15.31:0/3907903398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f00a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f60c5700 1 -- 172.21.15.31:0/3907903398 >> v1:172.21.15.31:6789/0 conn(0x7f64f0136710 legacy=0x7f64f005b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f60c5700 1 -- 172.21.15.31:0/3907903398 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f0136f80 con 0x7f64f0136af0 2024-04-18T10:36:35.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f48c2700 1 -- 172.21.15.31:0/3907903398 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667867517 0 0) 0x7f64f0066c10 con 0x7f64f0136710 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f50c3700 1 --2- 172.21.15.31:0/3907903398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f00a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f60c5700 1 --2- 172.21.15.31:0/3907903398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 0x7f64f005c080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f64e80032f0 tx=0x7f64e8009290).ready entity=mon.0 client_cookie=b636d8dabcd58867 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f48c2700 1 -- 172.21.15.31:0/3907903398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e800b8a0 con 0x7f64f0136af0 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f48c2700 1 -- 172.21.15.31:0/3907903398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e800ba00 con 0x7f64f0136af0 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.271+0000 7f64f48c2700 1 -- 172.21.15.31:0/3907903398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e800bb70 con 0x7f64f0136af0 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.272+0000 7f64f7b28700 1 -- 172.21.15.31:0/3907903398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 msgr2=0x7f64f005c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.272+0000 7f64f7b28700 1 --2- 172.21.15.31:0/3907903398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 0x7f64f005c080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f64e80032f0 tx=0x7f64e8009290).stop 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.272+0000 7f64f7b28700 1 -- 172.21.15.31:0/3907903398 shutdown_connections 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.272+0000 7f64f7b28700 1 --2- 172.21.15.31:0/3907903398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 0x7f64f005c080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.272+0000 7f64f7b28700 1 --2- 172.21.15.31:0/3907903398 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f00a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.272+0000 7f64f7b28700 1 -- 172.21.15.31:0/3907903398 >> 172.21.15.31:0/3907903398 conn(0x7f64f0060ac0 msgr2=0x7f64f00a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.272+0000 7f64f7b28700 1 -- 172.21.15.31:0/3907903398 shutdown_connections 2024-04-18T10:36:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.272+0000 7f64f7b28700 1 -- 172.21.15.31:0/3907903398 wait complete. 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.273+0000 7f64f7b28700 1 Processor -- start 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.273+0000 7f64f7b28700 1 -- start start 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.273+0000 7f64f7b28700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f0092c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.273+0000 7f64f7b28700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f64f0136710 0x7f64f0148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.273+0000 7f64f7b28700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 0x7f64f01335a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.273+0000 7f64f7b28700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f009fd20 con 0x7f64f0136af0 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.273+0000 7f64f7b28700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f01495f0 con 0x7f64f00a5000 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.273+0000 7f64f7b28700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0135320 con 0x7f64f0136710 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f58c4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f0092c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f50c3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f64f0136710 0x7f64f0148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f58c4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f0092c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60502/0 (socket says 172.21.15.31:60502) 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f58c4700 1 -- 172.21.15.31:0/352081943 learned_addr learned my addr 172.21.15.31:0/352081943 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f58c4700 1 -- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f64f0136710 msgr2=0x7f64f0148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f60c5700 1 --2- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 0x7f64f01335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:35.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f58c4700 1 --2- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f64f0136710 0x7f64f0148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f58c4700 1 -- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 msgr2=0x7f64f01335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f58c4700 1 --2- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 0x7f64f01335a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f58c4700 1 -- 172.21.15.31:0/352081943 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e000b180 con 0x7f64f00a5000 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f60c5700 1 --2- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 0x7f64f01335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f58c4700 1 --2- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f0092c50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f64ec000bc0 tx=0x7f64ec007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64deffd700 1 -- 172.21.15.31:0/352081943 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec0070d0 con 0x7f64f00a5000 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64deffd700 1 -- 172.21.15.31:0/352081943 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec007230 con 0x7f64f00a5000 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e8009530 con 0x7f64f00a5000 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64deffd700 1 -- 172.21.15.31:0/352081943 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ec005740 con 0x7f64f00a5000 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.274+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f00a7d30 con 0x7f64f00a5000 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.275+0000 7f64deffd700 1 -- 172.21.15.31:0/352081943 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f64ec01a060 con 0x7f64f00a5000 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.275+0000 7f64deffd700 1 -- 172.21.15.31:0/352081943 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f64ec049c60 con 0x7f64f00a5000 2024-04-18T10:36:35.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.275+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f00a7f80 con 0x7f64f00a5000 2024-04-18T10:36:35.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.279+0000 7f64deffd700 1 -- 172.21.15.31:0/352081943 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f64ec018080 con 0x7f64f00a5000 2024-04-18T10:36:35.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.431+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64f0148860 con 0x7f64f00a5000 2024-04-18T10:36:35.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.431+0000 7f64deffd700 1 -- 172.21.15.31:0/352081943 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f64ec02eb60 con 0x7f64f00a5000 2024-04-18T10:36:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:35.431 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:35.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.432+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 >> v1:172.21.15.31:6816/39551 conn(0x7f64d0038da0 legacy=0x7f64d003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:35.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.432+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 msgr2=0x7f64f0092c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:35.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.432+0000 7f64f7b28700 1 --2- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f0092c50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f64ec000bc0 tx=0x7f64ec007a60).stop 2024-04-18T10:36:35.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.433+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 shutdown_connections 2024-04-18T10:36:35.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.433+0000 7f64f7b28700 1 --2- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f0136af0 0x7f64f01335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:35.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.433+0000 7f64f7b28700 1 --2- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f64f00a5000 0x7f64f0092c50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:35.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.433+0000 7f64f7b28700 1 --2- 172.21.15.31:0/352081943 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f64f0136710 0x7f64f0148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:35.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.433+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 >> 172.21.15.31:0/352081943 conn(0x7f64f0060ac0 msgr2=0x7f64f005c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:35.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.433+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 shutdown_connections 2024-04-18T10:36:35.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:35.433+0000 7f64f7b28700 1 -- 172.21.15.31:0/352081943 wait complete. 2024-04-18T10:36:35.434 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:35.745 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:35.745 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:36.747 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.866+0000 7f016cc58700 1 Processor -- start 2024-04-18T10:36:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.866+0000 7f016cc58700 1 -- start start 2024-04-18T10:36:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f016cc58700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f016809f650 0x7f01680a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f016cc58700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0168135c80 0x7f01680a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f016cc58700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0168136110 con 0x7f01681358a0 2024-04-18T10:36:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f016cc58700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01680a1080 con 0x7f0168135c80 2024-04-18T10:36:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f016cc58700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01680a20d0 con 0x7f016809f650 2024-04-18T10:36:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f0165d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f016809f650 0x7f01680a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f0166d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0168135c80 0x7f01680a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f016659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f01681358a0 0x7f01680a3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48392/0 (socket says 172.21.15.31:48392) 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f016659c700 1 -- 172.21.15.31:0/620634581 learned_addr learned my addr 172.21.15.31:0/620634581 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.867+0000 7f016559a700 1 -- 172.21.15.31:0/620634581 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657039951 0 0) 0x7f0168136110 con 0x7f01681358a0 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f016559a700 1 -- 172.21.15.31:0/620634581 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0148003260 con 0x7f01681358a0 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f0165d9b700 1 -- 172.21.15.31:0/620634581 >> v2:172.21.15.31:3300/0 conn(0x7f0168135c80 msgr2=0x7f01680a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f0165d9b700 1 --2- 172.21.15.31:0/620634581 >> v2:172.21.15.31:3300/0 conn(0x7f0168135c80 0x7f01680a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f0165d9b700 1 -- 172.21.15.31:0/620634581 >> v1:172.21.15.31:6789/0 conn(0x7f01681358a0 legacy=0x7f01680a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f0165d9b700 1 -- 172.21.15.31:0/620634581 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680a2370 con 0x7f016809f650 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f0166d9d700 1 --2- 172.21.15.31:0/620634581 >> v2:172.21.15.31:3300/0 conn(0x7f0168135c80 0x7f01680a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f0165d9b700 1 --2- 172.21.15.31:0/620634581 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f016809f650 0x7f01680a2a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0158002f70 tx=0x7f0158006df0).ready entity=mon.2 client_cookie=dc635392087d50c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f016559a700 1 -- 172.21.15.31:0/620634581 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015800d4a0 con 0x7f016809f650 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f016559a700 1 -- 172.21.15.31:0/620634581 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158000e90 con 0x7f016809f650 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f016559a700 1 -- 172.21.15.31:0/620634581 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f015800d7f0 con 0x7f016809f650 2024-04-18T10:36:36.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f016cc58700 1 -- 172.21.15.31:0/620634581 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f016809f650 msgr2=0x7f01680a2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.868+0000 7f016cc58700 1 --2- 172.21.15.31:0/620634581 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f016809f650 0x7f01680a2a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0158002f70 tx=0x7f0158006df0).stop 2024-04-18T10:36:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.869+0000 7f016cc58700 1 -- 172.21.15.31:0/620634581 shutdown_connections 2024-04-18T10:36:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.869+0000 7f016cc58700 1 --2- 172.21.15.31:0/620634581 >> v2:172.21.15.31:3300/0 conn(0x7f0168135c80 0x7f01680a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.869+0000 7f016cc58700 1 --2- 172.21.15.31:0/620634581 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f016809f650 0x7f01680a2a20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.869+0000 7f016cc58700 1 -- 172.21.15.31:0/620634581 >> 172.21.15.31:0/620634581 conn(0x7f0168060ac0 msgr2=0x7f01680a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.869+0000 7f016cc58700 1 -- 172.21.15.31:0/620634581 shutdown_connections 2024-04-18T10:36:36.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.869+0000 7f016cc58700 1 -- 172.21.15.31:0/620634581 wait complete. 2024-04-18T10:36:36.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.869+0000 7f016cc58700 1 Processor -- start 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016cc58700 1 -- start start 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016cc58700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f016809f650 0x7f0168063ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016cc58700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01681358a0 0x7f01680a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016cc58700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0168135c80 0x7f01680a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016cc58700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680635b0 con 0x7f016809f650 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016cc58700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0168061630 con 0x7f01681358a0 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016cc58700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01680618f0 con 0x7f0168135c80 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f016809f650 0x7f0168063ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f0166d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0168135c80 0x7f01680a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f016809f650 0x7f0168063ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35146/0 (socket says 172.21.15.31:35146) 2024-04-18T10:36:36.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.870+0000 7f016659c700 1 -- 172.21.15.31:0/446257024 learned_addr learned my addr 172.21.15.31:0/446257024 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f0165d9b700 1 --2- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01681358a0 0x7f01680a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f0166d9d700 1 -- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01681358a0 msgr2=0x7f01680a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f0166d9d700 1 --2- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01681358a0 0x7f01680a65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f0166d9d700 1 -- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f016809f650 msgr2=0x7f0168063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f0166d9d700 1 --2- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f016809f650 0x7f0168063ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f0166d9d700 1 -- 172.21.15.31:0/446257024 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0160009470 con 0x7f0168135c80 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f0165d9b700 1 --2- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01681358a0 0x7f01680a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f0166d9d700 1 --2- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0168135c80 0x7f01680a6aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f016000c000 tx=0x7f01600091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f015f7fe700 1 -- 172.21.15.31:0/446257024 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f016000ee60 con 0x7f0168135c80 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f015f7fe700 1 -- 172.21.15.31:0/446257024 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016000c850 con 0x7f0168135c80 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f015f7fe700 1 -- 172.21.15.31:0/446257024 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f016000cbb0 con 0x7f0168135c80 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015800b180 con 0x7f0168135c80 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.871+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01680a7b30 con 0x7f0168135c80 2024-04-18T10:36:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.872+0000 7f015f7fe700 1 -- 172.21.15.31:0/446257024 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0160022070 con 0x7f0168135c80 2024-04-18T10:36:36.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.872+0000 7f015f7fe700 1 -- 172.21.15.31:0/446257024 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f016004b0e0 con 0x7f0168135c80 2024-04-18T10:36:36.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.872+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0168133140 con 0x7f0168135c80 2024-04-18T10:36:36.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:36.875+0000 7f015f7fe700 1 -- 172.21.15.31:0/446257024 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0160016020 con 0x7f0168135c80 2024-04-18T10:36:37.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.024+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01680a1e10 con 0x7f0168135c80 2024-04-18T10:36:37.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.025+0000 7f015f7fe700 1 -- 172.21.15.31:0/446257024 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f0160033900 con 0x7f0168135c80 2024-04-18T10:36:37.025 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:37.025 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 >> v1:172.21.15.31:6816/39551 conn(0x7f014c038da0 legacy=0x7f014c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0168135c80 msgr2=0x7f01680a6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 --2- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0168135c80 0x7f01680a6aa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f016000c000 tx=0x7f01600091d0).stop 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 shutdown_connections 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 --2- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0168135c80 0x7f01680a6aa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 --2- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f016809f650 0x7f0168063ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 --2- 172.21.15.31:0/446257024 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01681358a0 0x7f01680a65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 >> 172.21.15.31:0/446257024 conn(0x7f0168060ac0 msgr2=0x7f01680a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 shutdown_connections 2024-04-18T10:36:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:37.026+0000 7f016cc58700 1 -- 172.21.15.31:0/446257024 wait complete. 2024-04-18T10:36:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:37.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:37.340 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:38.341 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:38.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.461+0000 7f2e73121700 1 Processor -- start 2024-04-18T10:36:38.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.461+0000 7f2e73121700 1 -- start start 2024-04-18T10:36:38.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e73121700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e6c064600 0x7f2e6c133110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:38.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e73121700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c062fb0 0x7f2e6c063680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:38.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e73121700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c063b70 con 0x7f2e6c0a92a0 2024-04-18T10:36:38.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e73121700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6c065150 con 0x7f2e6c064600 2024-04-18T10:36:38.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e73121700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c130bd0 con 0x7f2e6c062fb0 2024-04-18T10:36:38.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e70ebd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e6c064600 0x7f2e6c133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:38.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c062fb0 0x7f2e6c063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:38.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e70ebd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2e6c064600 0x7f2e6c133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35148/0 (socket says 172.21.15.31:35148) 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e70ebd700 1 -- 172.21.15.31:0/1015323983 learned_addr learned my addr 172.21.15.31:0/1015323983 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e716be700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2e6c0a92a0 0x7f2e6c1365f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48394/0 (socket says 172.21.15.31:48394) 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e6bfff700 1 -- 172.21.15.31:0/1015323983 >> v2:172.21.15.31:3300/0 conn(0x7f2e6c064600 msgr2=0x7f2e6c133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e6bfff700 1 --2- 172.21.15.31:0/1015323983 >> v2:172.21.15.31:3300/0 conn(0x7f2e6c064600 0x7f2e6c133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e6bfff700 1 -- 172.21.15.31:0/1015323983 >> v1:172.21.15.31:6789/0 conn(0x7f2e6c0a92a0 legacy=0x7f2e6c1365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e6b7fe700 1 -- 172.21.15.31:0/1015323983 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570858216 0 0) 0x7f2e6c063b70 con 0x7f2e6c0a92a0 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e6bfff700 1 -- 172.21.15.31:0/1015323983 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c061ee0 con 0x7f2e6c062fb0 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e70ebd700 1 --2- 172.21.15.31:0/1015323983 >> v2:172.21.15.31:3300/0 conn(0x7f2e6c064600 0x7f2e6c133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.462+0000 7f2e6bfff700 1 --2- 172.21.15.31:0/1015323983 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c062fb0 0x7f2e6c063680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2e6c06b130 tx=0x7f2e58006df0).ready entity=mon.2 client_cookie=902acefc144d2844 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e6b7fe700 1 -- 172.21.15.31:0/1015323983 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5800d570 con 0x7f2e6c062fb0 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e6b7fe700 1 -- 172.21.15.31:0/1015323983 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58000e90 con 0x7f2e6c062fb0 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e6b7fe700 1 -- 172.21.15.31:0/1015323983 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5800d8c0 con 0x7f2e6c062fb0 2024-04-18T10:36:38.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e73121700 1 -- 172.21.15.31:0/1015323983 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c062fb0 msgr2=0x7f2e6c063680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:38.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e73121700 1 --2- 172.21.15.31:0/1015323983 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c062fb0 0x7f2e6c063680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2e6c06b130 tx=0x7f2e58006df0).stop 2024-04-18T10:36:38.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e73121700 1 -- 172.21.15.31:0/1015323983 shutdown_connections 2024-04-18T10:36:38.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e73121700 1 --2- 172.21.15.31:0/1015323983 >> v2:172.21.15.31:3300/0 conn(0x7f2e6c064600 0x7f2e6c133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:38.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e73121700 1 --2- 172.21.15.31:0/1015323983 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c062fb0 0x7f2e6c063680 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:38.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e73121700 1 -- 172.21.15.31:0/1015323983 >> 172.21.15.31:0/1015323983 conn(0x7f2e6c06c0c0 msgr2=0x7f2e6c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:38.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e73121700 1 -- 172.21.15.31:0/1015323983 shutdown_connections 2024-04-18T10:36:38.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.463+0000 7f2e73121700 1 -- 172.21.15.31:0/1015323983 wait complete. 2024-04-18T10:36:38.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.464+0000 7f2e73121700 1 Processor -- start 2024-04-18T10:36:38.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.464+0000 7f2e73121700 1 -- start start 2024-04-18T10:36:38.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e73121700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c064600 0x7f2e6c096520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:38.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e73121700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e6c0a92a0 0x7f2e6c096a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:38.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e73121700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e6c098d70 0x7f2e6c096f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e73121700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c067af0 con 0x7f2e6c098d70 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e73121700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c0973f0 con 0x7f2e6c0a92a0 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e73121700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c065aa0 con 0x7f2e6c064600 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e70ebd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c064600 0x7f2e6c096520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e716be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e6c098d70 0x7f2e6c096f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e70ebd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c064600 0x7f2e6c096520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43102/0 (socket says 172.21.15.31:43102) 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e716be700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e6c098d70 0x7f2e6c096f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35158/0 (socket says 172.21.15.31:35158) 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e70ebd700 1 -- 172.21.15.31:0/1709072275 learned_addr learned my addr 172.21.15.31:0/1709072275 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e6bfff700 1 --2- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e6c0a92a0 0x7f2e6c096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e70ebd700 1 -- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e6c0a92a0 msgr2=0x7f2e6c096a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e70ebd700 1 --2- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e6c0a92a0 0x7f2e6c096a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e70ebd700 1 -- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e6c098d70 msgr2=0x7f2e6c096f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e70ebd700 1 --2- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e6c098d70 0x7f2e6c096f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:38.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e70ebd700 1 -- 172.21.15.31:0/1709072275 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6000b1e0 con 0x7f2e6c064600 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.465+0000 7f2e716be700 1 --2- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e6c098d70 0x7f2e6c096f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.466+0000 7f2e70ebd700 1 --2- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c064600 0x7f2e6c096520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2e6000c000 tx=0x7f2e60006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.466+0000 7f2e69ffb700 1 -- 172.21.15.31:0/1709072275 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e60012600 con 0x7f2e6c064600 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.466+0000 7f2e69ffb700 1 -- 172.21.15.31:0/1709072275 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e60012760 con 0x7f2e6c064600 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.466+0000 7f2e69ffb700 1 -- 172.21.15.31:0/1709072275 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e60012ac0 con 0x7f2e6c064600 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.466+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5800b180 con 0x7f2e6c064600 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.466+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c066a40 con 0x7f2e6c064600 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.467+0000 7f2e69ffb700 1 -- 172.21.15.31:0/1709072275 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2e60022070 con 0x7f2e6c064600 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.467+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c065da0 con 0x7f2e6c064600 2024-04-18T10:36:38.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.467+0000 7f2e69ffb700 1 -- 172.21.15.31:0/1709072275 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2e6004ab40 con 0x7f2e6c064600 2024-04-18T10:36:38.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.470+0000 7f2e69ffb700 1 -- 172.21.15.31:0/1709072275 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2e60033470 con 0x7f2e6c064600 2024-04-18T10:36:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.621+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e6c066a40 con 0x7f2e6c064600 2024-04-18T10:36:38.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.621+0000 7f2e69ffb700 1 -- 172.21.15.31:0/1709072275 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f2e6c066a40 con 0x7f2e6c064600 2024-04-18T10:36:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:38.621 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.622+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 >> v1:172.21.15.31:6816/39551 conn(0x7f2e4c038da0 legacy=0x7f2e4c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.622+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c064600 msgr2=0x7f2e6c096520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.622+0000 7f2e73121700 1 --2- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c064600 0x7f2e6c096520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2e6000c000 tx=0x7f2e60006eb0).stop 2024-04-18T10:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.623+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 shutdown_connections 2024-04-18T10:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.623+0000 7f2e73121700 1 --2- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2e6c064600 0x7f2e6c096520 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.623+0000 7f2e73121700 1 --2- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e6c098d70 0x7f2e6c096f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.623+0000 7f2e73121700 1 --2- 172.21.15.31:0/1709072275 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2e6c0a92a0 0x7f2e6c096a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.623+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 >> 172.21.15.31:0/1709072275 conn(0x7f2e6c06c0c0 msgr2=0x7f2e6c05b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:38.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.623+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 shutdown_connections 2024-04-18T10:36:38.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:38.623+0000 7f2e73121700 1 -- 172.21.15.31:0/1709072275 wait complete. 2024-04-18T10:36:38.625 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:38.936 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:38.936 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:39.937 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:40.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.057+0000 7f28d8ae4700 1 Processor -- start 2024-04-18T10:36:40.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.057+0000 7f28d8ae4700 1 -- start start 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.057+0000 7f28d8ae4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136710 0x7f28d40a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.057+0000 7f28d8ae4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28d4136af0 0x7f28d405c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.057+0000 7f28d8ae4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d4066c10 con 0x7f28d40a5000 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.057+0000 7f28d8ae4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d4066eb0 con 0x7f28d4136af0 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.057+0000 7f28d8ae4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40a3b40 con 0x7f28d4136710 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136710 0x7f28d40a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d2d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28d4136af0 0x7f28d405c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d2d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28d4136af0 0x7f28d405c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35170/0 (socket says 172.21.15.31:35170) 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136710 0x7f28d40a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43114/0 (socket says 172.21.15.31:43114) 2024-04-18T10:36:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d1d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f28d40a5000 0x7f28d405b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48398/0 (socket says 172.21.15.31:48398) 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d2d9d700 1 -- 172.21.15.31:0/2005345323 learned_addr learned my addr 172.21.15.31:0/2005345323 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d2d9d700 1 -- 172.21.15.31:0/2005345323 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136710 msgr2=0x7f28d40a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d2d9d700 1 --2- 172.21.15.31:0/2005345323 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136710 0x7f28d40a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d2d9d700 1 -- 172.21.15.31:0/2005345323 >> v1:172.21.15.31:6789/0 conn(0x7f28d40a5000 legacy=0x7f28d405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d159a700 1 -- 172.21.15.31:0/2005345323 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913945112 0 0) 0x7f28d4066c10 con 0x7f28d40a5000 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d2d9d700 1 -- 172.21.15.31:0/2005345323 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40673f0 con 0x7f28d4136af0 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d259c700 1 --2- 172.21.15.31:0/2005345323 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136710 0x7f28d40a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d2d9d700 1 --2- 172.21.15.31:0/2005345323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d4136af0 0x7f28d405c080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f28cc0032f0 tx=0x7f28cc009290).ready entity=mon.0 client_cookie=526f34c63c283009 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d159a700 1 -- 172.21.15.31:0/2005345323 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28cc00b8a0 con 0x7f28d4136af0 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d159a700 1 -- 172.21.15.31:0/2005345323 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc00ba00 con 0x7f28d4136af0 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.058+0000 7f28d159a700 1 -- 172.21.15.31:0/2005345323 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28cc00bb70 con 0x7f28d4136af0 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.059+0000 7f28d8ae4700 1 -- 172.21.15.31:0/2005345323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d4136af0 msgr2=0x7f28d405c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.059+0000 7f28d8ae4700 1 --2- 172.21.15.31:0/2005345323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d4136af0 0x7f28d405c080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f28cc0032f0 tx=0x7f28cc009290).stop 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.059+0000 7f28d8ae4700 1 -- 172.21.15.31:0/2005345323 shutdown_connections 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.059+0000 7f28d8ae4700 1 --2- 172.21.15.31:0/2005345323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d4136af0 0x7f28d405c080 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.059+0000 7f28d8ae4700 1 --2- 172.21.15.31:0/2005345323 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136710 0x7f28d40a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.059+0000 7f28d8ae4700 1 -- 172.21.15.31:0/2005345323 >> 172.21.15.31:0/2005345323 conn(0x7f28d4060ac0 msgr2=0x7f28d40a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.059+0000 7f28d8ae4700 1 -- 172.21.15.31:0/2005345323 shutdown_connections 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.059+0000 7f28d8ae4700 1 -- 172.21.15.31:0/2005345323 wait complete. 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.060+0000 7f28d8ae4700 1 Processor -- start 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.060+0000 7f28d8ae4700 1 -- start start 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.060+0000 7f28d8ae4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40a5000 0x7f28d4139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.060+0000 7f28d8ae4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28d4136710 0x7f28d41393b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.060+0000 7f28d8ae4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136af0 0x7f28d4145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.060+0000 7f28d8ae4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41451a0 con 0x7f28d40a5000 2024-04-18T10:36:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.060+0000 7f28d8ae4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4135640 con 0x7f28d4136710 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.060+0000 7f28d8ae4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41453e0 con 0x7f28d4136af0 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d1d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28d4136710 0x7f28d41393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d2d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136af0 0x7f28d4145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d259c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40a5000 0x7f28d4139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d2d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136af0 0x7f28d4145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43128/0 (socket says 172.21.15.31:43128) 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d1d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28d4136710 0x7f28d41393b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:60532/0 (socket says 172.21.15.31:60532) 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d2d9d700 1 -- 172.21.15.31:0/830018185 learned_addr learned my addr 172.21.15.31:0/830018185 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d2d9d700 1 -- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28d4136710 msgr2=0x7f28d41393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d2d9d700 1 --2- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28d4136710 0x7f28d41393b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d2d9d700 1 -- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40a5000 msgr2=0x7f28d4139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d2d9d700 1 --2- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40a5000 0x7f28d4139c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d2d9d700 1 -- 172.21.15.31:0/830018185 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c400b180 con 0x7f28d4136af0 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d259c700 1 --2- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40a5000 0x7f28d4139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d2d9d700 1 --2- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136af0 0x7f28d4145a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f28cc0032f0 tx=0x7f28cc016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28cb7fe700 1 -- 172.21.15.31:0/830018185 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28cc00bb70 con 0x7f28d4136af0 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28cb7fe700 1 -- 172.21.15.31:0/830018185 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc021670 con 0x7f28d4136af0 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc009530 con 0x7f28d4136af0 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28cb7fe700 1 -- 172.21.15.31:0/830018185 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28cc00b8a0 con 0x7f28d4136af0 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.061+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d4134fe0 con 0x7f28d4136af0 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.062+0000 7f28cb7fe700 1 -- 172.21.15.31:0/830018185 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f28cc00f070 con 0x7f28d4136af0 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.062+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d41390d0 con 0x7f28d4136af0 2024-04-18T10:36:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.063+0000 7f28cb7fe700 1 -- 172.21.15.31:0/830018185 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f28cc04b980 con 0x7f28d4136af0 2024-04-18T10:36:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.066+0000 7f28cb7fe700 1 -- 172.21.15.31:0/830018185 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f28d41390d0 con 0x7f28d4136af0 2024-04-18T10:36:40.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.214+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28d41390d0 con 0x7f28d4136af0 2024-04-18T10:36:40.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.214+0000 7f28cb7fe700 1 -- 172.21.15.31:0/830018185 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f28cc015930 con 0x7f28d4136af0 2024-04-18T10:36:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:40.214 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:40.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.215+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 >> v1:172.21.15.31:6816/39551 conn(0x7f28b8038e30 legacy=0x7f28b803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:40.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.215+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136af0 msgr2=0x7f28d4145a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:40.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.215+0000 7f28d8ae4700 1 --2- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136af0 0x7f28d4145a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f28cc0032f0 tx=0x7f28cc016000).stop 2024-04-18T10:36:40.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.216+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 shutdown_connections 2024-04-18T10:36:40.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.216+0000 7f28d8ae4700 1 --2- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f28d4136af0 0x7f28d4145a20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:40.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.216+0000 7f28d8ae4700 1 --2- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28d40a5000 0x7f28d4139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:40.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.216+0000 7f28d8ae4700 1 --2- 172.21.15.31:0/830018185 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f28d4136710 0x7f28d41393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:40.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.216+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 >> 172.21.15.31:0/830018185 conn(0x7f28d4060ac0 msgr2=0x7f28d405c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:40.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.216+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 shutdown_connections 2024-04-18T10:36:40.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:40.216+0000 7f28d8ae4700 1 -- 172.21.15.31:0/830018185 wait complete. 2024-04-18T10:36:40.217 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:40.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:40.529 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:41.530 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.650+0000 7f6061c82700 1 Processor -- start 2024-04-18T10:36:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.650+0000 7f6061c82700 1 -- start start 2024-04-18T10:36:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.651+0000 7f6061c82700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.651+0000 7f6061c82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c061200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.651+0000 7f6061c82700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c060920 con 0x7f605c1398e0 2024-04-18T10:36:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.651+0000 7f6061c82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c136310 con 0x7f605c136d80 2024-04-18T10:36:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.651+0000 7f6061c82700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f605c136500 con 0x7f605c1369a0 2024-04-18T10:36:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.651+0000 7f605b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.651+0000 7f605affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.651+0000 7f605bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f605c1398e0 0x7f605c139d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48412/0 (socket says 172.21.15.31:48412) 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.651+0000 7f605bfff700 1 -- 172.21.15.31:0/2448140897 learned_addr learned my addr 172.21.15.31:0/2448140897 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605affd700 1 -- 172.21.15.31:0/2448140897 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 msgr2=0x7f605c067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605affd700 1 --2- 172.21.15.31:0/2448140897 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605affd700 1 -- 172.21.15.31:0/2448140897 >> v1:172.21.15.31:6789/0 conn(0x7f605c1398e0 legacy=0x7f605c139d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605affd700 1 -- 172.21.15.31:0/2448140897 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c1367a0 con 0x7f605c136d80 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605a7fc700 1 -- 172.21.15.31:0/2448140897 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187118107 0 0) 0x7f605c060920 con 0x7f605c1398e0 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605b7fe700 1 --2- 172.21.15.31:0/2448140897 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605affd700 1 --2- 172.21.15.31:0/2448140897 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c061200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6050002f70 tx=0x7f6050006df0).ready entity=mon.1 client_cookie=11111004aa2141f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605a7fc700 1 -- 172.21.15.31:0/2448140897 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605000d570 con 0x7f605c136d80 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605a7fc700 1 -- 172.21.15.31:0/2448140897 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050000e90 con 0x7f605c136d80 2024-04-18T10:36:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f605a7fc700 1 -- 172.21.15.31:0/2448140897 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605000d8c0 con 0x7f605c136d80 2024-04-18T10:36:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f6061c82700 1 -- 172.21.15.31:0/2448140897 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 msgr2=0x7f605c061200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f6061c82700 1 --2- 172.21.15.31:0/2448140897 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c061200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6050002f70 tx=0x7f6050006df0).stop 2024-04-18T10:36:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f6061c82700 1 -- 172.21.15.31:0/2448140897 shutdown_connections 2024-04-18T10:36:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f6061c82700 1 --2- 172.21.15.31:0/2448140897 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f6061c82700 1 --2- 172.21.15.31:0/2448140897 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c061200 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f6061c82700 1 -- 172.21.15.31:0/2448140897 >> 172.21.15.31:0/2448140897 conn(0x7f605c06c0c0 msgr2=0x7f605c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f6061c82700 1 -- 172.21.15.31:0/2448140897 shutdown_connections 2024-04-18T10:36:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.652+0000 7f6061c82700 1 -- 172.21.15.31:0/2448140897 wait complete. 2024-04-18T10:36:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.653+0000 7f6061c82700 1 Processor -- start 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f6061c82700 1 -- start start 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f6061c82700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c093ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f6061c82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c093750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f6061c82700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f605c1398e0 0x7f605c095310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f6061c82700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c094a60 con 0x7f605c1398e0 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f6061c82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c094c60 con 0x7f605c136d80 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f6061c82700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f605c145ba0 con 0x7f605c1369a0 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f605b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c093ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f605affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c093750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f605b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c093ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43138/0 (socket says 172.21.15.31:43138) 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f605b7fe700 1 -- 172.21.15.31:0/3748029015 learned_addr learned my addr 172.21.15.31:0/3748029015 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.654+0000 7f605bfff700 1 --2- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f605c1398e0 0x7f605c095310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f605affd700 1 -- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 msgr2=0x7f605c093ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f605affd700 1 --2- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c093ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f605affd700 1 -- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f605c1398e0 msgr2=0x7f605c095310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f605affd700 1 --2- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f605c1398e0 0x7f605c095310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f605affd700 1 -- 172.21.15.31:0/3748029015 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c00b180 con 0x7f605c136d80 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f605affd700 1 --2- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c093750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f605c0950b0 tx=0x7f6050014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f6058ff9700 1 -- 172.21.15.31:0/3748029015 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6050016070 con 0x7f605c136d80 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f6058ff9700 1 -- 172.21.15.31:0/3748029015 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050013b70 con 0x7f605c136d80 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605000b180 con 0x7f605c136d80 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f6058ff9700 1 -- 172.21.15.31:0/3748029015 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605001e450 con 0x7f605c136d80 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.655+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c093c40 con 0x7f605c136d80 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.656+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c137160 con 0x7f605c136d80 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.656+0000 7f6058ff9700 1 -- 172.21.15.31:0/3748029015 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6050025030 con 0x7f605c136d80 2024-04-18T10:36:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.657+0000 7f6058ff9700 1 -- 172.21.15.31:0/3748029015 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f605004b7c0 con 0x7f605c136d80 2024-04-18T10:36:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.660+0000 7f6058ff9700 1 -- 172.21.15.31:0/3748029015 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6050028610 con 0x7f605c136d80 2024-04-18T10:36:41.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.810+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f605c057a60 con 0x7f605c136d80 2024-04-18T10:36:41.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.811+0000 7f6058ff9700 1 -- 172.21.15.31:0/3748029015 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f6050023020 con 0x7f605c136d80 2024-04-18T10:36:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:41.811 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:41.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 >> v1:172.21.15.31:6816/39551 conn(0x7f603c038da0 legacy=0x7f603c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 msgr2=0x7f605c093750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 --2- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c093750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f605c0950b0 tx=0x7f6050014000).stop 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 shutdown_connections 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 --2- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f605c1369a0 0x7f605c093ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 --2- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f605c1398e0 0x7f605c095310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 --2- 172.21.15.31:0/3748029015 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f605c136d80 0x7f605c093750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 >> 172.21.15.31:0/3748029015 conn(0x7f605c06c0c0 msgr2=0x7f605c060f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 shutdown_connections 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:41.812+0000 7f6061c82700 1 -- 172.21.15.31:0/3748029015 wait complete. 2024-04-18T10:36:41.813 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:42.125 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:42.125 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:43.126 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:43.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.246+0000 7fc7fed60700 1 Processor -- start 2024-04-18T10:36:43.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.246+0000 7fc7fed60700 1 -- start start 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.247+0000 7fc7fed60700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f81369a0 0x7fc7f8067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.247+0000 7fc7fed60700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f813ec70 0x7fc7f8141060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.247+0000 7fc7fed60700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f8060920 con 0x7fc7f8136d80 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.247+0000 7fc7fed60700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8061910 con 0x7fc7f813ec70 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.247+0000 7fc7fed60700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8136310 con 0x7fc7f81369a0 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.247+0000 7fc7fcafc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f81369a0 0x7fc7f8067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.247+0000 7fc7fd2fd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f813ec70 0x7fc7f8141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.247+0000 7fc7f7fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc7f8136d80 0x7fc7f8061200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48424/0 (socket says 172.21.15.31:48424) 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.247+0000 7fc7f7fff700 1 -- 172.21.15.31:0/3480835979 learned_addr learned my addr 172.21.15.31:0/3480835979 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:43.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fd2fd700 1 -- 172.21.15.31:0/3480835979 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f81369a0 msgr2=0x7fc7f8067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:43.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fd2fd700 1 --2- 172.21.15.31:0/3480835979 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f81369a0 0x7fc7f8067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:43.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fd2fd700 1 -- 172.21.15.31:0/3480835979 >> v1:172.21.15.31:6789/0 conn(0x7fc7f8136d80 legacy=0x7fc7f8061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:43.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7f77fe700 1 -- 172.21.15.31:0/3480835979 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424953616 0 0) 0x7fc7f8060920 con 0x7fc7f8136d80 2024-04-18T10:36:43.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fd2fd700 1 -- 172.21.15.31:0/3480835979 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8136500 con 0x7fc7f813ec70 2024-04-18T10:36:43.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fcafc700 1 --2- 172.21.15.31:0/3480835979 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f81369a0 0x7fc7f8067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:43.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fd2fd700 1 --2- 172.21.15.31:0/3480835979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f813ec70 0x7fc7f8141060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc7e8002f70 tx=0x7fc7e8006df0).ready entity=mon.1 client_cookie=87b01fc8592ede89 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:43.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7f77fe700 1 -- 172.21.15.31:0/3480835979 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e800d570 con 0x7fc7f813ec70 2024-04-18T10:36:43.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7f77fe700 1 -- 172.21.15.31:0/3480835979 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e8000e90 con 0x7fc7f813ec70 2024-04-18T10:36:43.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7f77fe700 1 -- 172.21.15.31:0/3480835979 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7e800d8c0 con 0x7fc7f813ec70 2024-04-18T10:36:43.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fed60700 1 -- 172.21.15.31:0/3480835979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f813ec70 msgr2=0x7fc7f8141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:43.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fed60700 1 --2- 172.21.15.31:0/3480835979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f813ec70 0x7fc7f8141060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc7e8002f70 tx=0x7fc7e8006df0).stop 2024-04-18T10:36:43.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fed60700 1 -- 172.21.15.31:0/3480835979 shutdown_connections 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fed60700 1 --2- 172.21.15.31:0/3480835979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f813ec70 0x7fc7f8141060 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fed60700 1 --2- 172.21.15.31:0/3480835979 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f81369a0 0x7fc7f8067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fed60700 1 -- 172.21.15.31:0/3480835979 >> 172.21.15.31:0/3480835979 conn(0x7fc7f806c0c0 msgr2=0x7fc7f806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fed60700 1 -- 172.21.15.31:0/3480835979 shutdown_connections 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.248+0000 7fc7fed60700 1 -- 172.21.15.31:0/3480835979 wait complete. 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.249+0000 7fc7fed60700 1 Processor -- start 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.249+0000 7fc7fed60700 1 -- start start 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fed60700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f81369a0 0x7fc7f81382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fed60700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f8136d80 0x7fc7f813bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fed60700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f813ec70 0x7fc7f813c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fed60700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f81393d0 con 0x7fc7f81369a0 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fed60700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8138bb0 con 0x7fc7f8136d80 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fed60700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8138e50 con 0x7fc7f813ec70 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fcafc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f81369a0 0x7fc7f81382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:43.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7f7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f8136d80 0x7fc7f813bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fcafc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f81369a0 0x7fc7f81382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35196/0 (socket says 172.21.15.31:35196) 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fcafc700 1 -- 172.21.15.31:0/913120609 learned_addr learned my addr 172.21.15.31:0/913120609 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.250+0000 7fc7fd2fd700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f813ec70 0x7fc7f813c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7fcafc700 1 -- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f813ec70 msgr2=0x7fc7f813c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7fcafc700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f813ec70 0x7fc7f813c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7fcafc700 1 -- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f8136d80 msgr2=0x7fc7f813bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7fcafc700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f8136d80 0x7fc7f813bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7fcafc700 1 -- 172.21.15.31:0/913120609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f0009470 con 0x7fc7f81369a0 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7fd2fd700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f813ec70 0x7fc7f813c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7f7fff700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f8136d80 0x7fc7f813bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7fcafc700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f81369a0 0x7fc7f81382f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc7f000c000 tx=0x7fc7f00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7f5ffb700 1 -- 172.21.15.31:0/913120609 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7f000c850 con 0x7fc7f81369a0 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7f5ffb700 1 -- 172.21.15.31:0/913120609 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f000c9b0 con 0x7fc7f81369a0 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e800b180 con 0x7fc7f81369a0 2024-04-18T10:36:43.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7f5ffb700 1 -- 172.21.15.31:0/913120609 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7f000cd10 con 0x7fc7f81369a0 2024-04-18T10:36:43.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.251+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f813ce30 con 0x7fc7f81369a0 2024-04-18T10:36:43.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.252+0000 7fc7f5ffb700 1 -- 172.21.15.31:0/913120609 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc7f0022070 con 0x7fc7f81369a0 2024-04-18T10:36:43.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.252+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8139880 con 0x7fc7f81369a0 2024-04-18T10:36:43.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.252+0000 7fc7f5ffb700 1 -- 172.21.15.31:0/913120609 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc7f004b190 con 0x7fc7f81369a0 2024-04-18T10:36:43.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.255+0000 7fc7f5ffb700 1 -- 172.21.15.31:0/913120609 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc7f8139880 con 0x7fc7f81369a0 2024-04-18T10:36:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.406+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7f8139880 con 0x7fc7f81369a0 2024-04-18T10:36:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.406+0000 7fc7f5ffb700 1 -- 172.21.15.31:0/913120609 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7fc7f8139880 con 0x7fc7f81369a0 2024-04-18T10:36:43.407 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:43.407 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 >> v1:172.21.15.31:6816/39551 conn(0x7fc7d8038da0 legacy=0x7fc7d803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f81369a0 msgr2=0x7fc7f81382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f81369a0 0x7fc7f81382f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fc7f000c000 tx=0x7fc7f00091d0).stop 2024-04-18T10:36:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 shutdown_connections 2024-04-18T10:36:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc7f813ec70 0x7fc7f813c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7f81369a0 0x7fc7f81382f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 --2- 172.21.15.31:0/913120609 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc7f8136d80 0x7fc7f813bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 >> 172.21.15.31:0/913120609 conn(0x7fc7f806c0c0 msgr2=0x7fc7f809b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 shutdown_connections 2024-04-18T10:36:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:43.408+0000 7fc7fed60700 1 -- 172.21.15.31:0/913120609 wait complete. 2024-04-18T10:36:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:43.721 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:43.721 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:44.722 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:44.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.841+0000 7f9529d3f700 1 Processor -- start 2024-04-18T10:36:44.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f9529d3f700 1 -- start start 2024-04-18T10:36:44.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f9529d3f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9524136710 0x7f95240a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:44.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f9529d3f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136af0 0x7f952405c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:44.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f9529d3f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9524066c10 con 0x7f95240a5000 2024-04-18T10:36:44.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f9529d3f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9524066eb0 con 0x7f9524136710 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f9529d3f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95240a3b40 con 0x7f9524136af0 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f95237fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9524136710 0x7f95240a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f9523fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136af0 0x7f952405c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f95237fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9524136710 0x7f95240a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51658/0 (socket says 172.21.15.31:51658) 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f9522ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f95240a5000 0x7f952405b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58522/0 (socket says 172.21.15.31:58522) 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f95237fe700 1 -- 172.21.15.31:0/2316810316 learned_addr learned my addr 172.21.15.31:0/2316810316 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.842+0000 7f9523fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136af0 0x7f952405c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39604/0 (socket says 172.21.15.31:39604) 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f95237fe700 1 -- 172.21.15.31:0/2316810316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136af0 msgr2=0x7f952405c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f95237fe700 1 --2- 172.21.15.31:0/2316810316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136af0 0x7f952405c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f95237fe700 1 -- 172.21.15.31:0/2316810316 >> v1:172.21.15.31:6789/0 conn(0x7f95240a5000 legacy=0x7f952405b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f95237fe700 1 -- 172.21.15.31:0/2316810316 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95240673f0 con 0x7f9524136710 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f95227fc700 1 -- 172.21.15.31:0/2316810316 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768249276 0 0) 0x7f9524066c10 con 0x7f95240a5000 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f9523fff700 1 --2- 172.21.15.31:0/2316810316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136af0 0x7f952405c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f95237fe700 1 --2- 172.21.15.31:0/2316810316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136710 0x7f95240a3fc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9514002f70 tx=0x7f9514006eb0).ready entity=mon.0 client_cookie=38c043c94a447242 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:44.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f95227fc700 1 -- 172.21.15.31:0/2316810316 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951400d570 con 0x7f9524136710 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f95227fc700 1 -- 172.21.15.31:0/2316810316 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9514000e90 con 0x7f9524136710 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.843+0000 7f95227fc700 1 -- 172.21.15.31:0/2316810316 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f951400d8c0 con 0x7f9524136710 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.844+0000 7f9529d3f700 1 -- 172.21.15.31:0/2316810316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136710 msgr2=0x7f95240a3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.844+0000 7f9529d3f700 1 --2- 172.21.15.31:0/2316810316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136710 0x7f95240a3fc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f9514002f70 tx=0x7f9514006eb0).stop 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.844+0000 7f9529d3f700 1 -- 172.21.15.31:0/2316810316 shutdown_connections 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.844+0000 7f9529d3f700 1 --2- 172.21.15.31:0/2316810316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136af0 0x7f952405c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.844+0000 7f9529d3f700 1 --2- 172.21.15.31:0/2316810316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136710 0x7f95240a3fc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.844+0000 7f9529d3f700 1 -- 172.21.15.31:0/2316810316 >> 172.21.15.31:0/2316810316 conn(0x7f9524060ac0 msgr2=0x7f95240a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.844+0000 7f9529d3f700 1 -- 172.21.15.31:0/2316810316 shutdown_connections 2024-04-18T10:36:44.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.844+0000 7f9529d3f700 1 -- 172.21.15.31:0/2316810316 wait complete. 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.844+0000 7f9529d3f700 1 Processor -- start 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f9529d3f700 1 -- start start 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f9529d3f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95240a5000 0x7f9524139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f9529d3f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136710 0x7f9524145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f9529d3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136af0 0x7f9524145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f9529d3f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524092980 con 0x7f9524136af0 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f9529d3f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95241454d0 con 0x7f9524136710 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f9529d3f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9524139110 con 0x7f95240a5000 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f9522ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136710 0x7f9524145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f95237fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95240a5000 0x7f9524139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f95237fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95240a5000 0x7f9524139c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45154/0 (socket says 172.21.15.31:45154) 2024-04-18T10:36:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f9522ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136710 0x7f9524145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39616/0 (socket says 172.21.15.31:39616) 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.845+0000 7f95237fe700 1 -- 172.21.15.31:0/3811238236 learned_addr learned my addr 172.21.15.31:0/3811238236 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f9523fff700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136af0 0x7f9524145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f95237fe700 1 -- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136710 msgr2=0x7f9524145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f95237fe700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136710 0x7f9524145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f95237fe700 1 -- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136af0 msgr2=0x7f9524145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f95237fe700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136af0 0x7f9524145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f95237fe700 1 -- 172.21.15.31:0/3811238236 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c009470 con 0x7f95240a5000 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f9522ffd700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136710 0x7f9524145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f9523fff700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136af0 0x7f9524145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:36:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f95237fe700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95240a5000 0x7f9524139c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9514002f70 tx=0x7f9514015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f9520ff9700 1 -- 172.21.15.31:0/3811238236 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95140117e0 con 0x7f95240a5000 2024-04-18T10:36:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f9520ff9700 1 -- 172.21.15.31:0/3811238236 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9514011940 con 0x7f95240a5000 2024-04-18T10:36:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951400b1e0 con 0x7f95240a5000 2024-04-18T10:36:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f9520ff9700 1 -- 172.21.15.31:0/3811238236 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9514011ca0 con 0x7f95240a5000 2024-04-18T10:36:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.846+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95240a23f0 con 0x7f95240a5000 2024-04-18T10:36:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.847+0000 7f9520ff9700 1 -- 172.21.15.31:0/3811238236 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9514025030 con 0x7f95240a5000 2024-04-18T10:36:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.847+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9524057a60 con 0x7f95240a5000 2024-04-18T10:36:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.847+0000 7f9520ff9700 1 -- 172.21.15.31:0/3811238236 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f951404bb10 con 0x7f95240a5000 2024-04-18T10:36:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:44.850+0000 7f9520ff9700 1 -- 172.21.15.31:0/3811238236 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f951401eb90 con 0x7f95240a5000 2024-04-18T10:36:45.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.002+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95240a3380 con 0x7f95240a5000 2024-04-18T10:36:45.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.003+0000 7f9520ff9700 1 -- 172.21.15.31:0/3811238236 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f9514023070 con 0x7f95240a5000 2024-04-18T10:36:45.003 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:45.003 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:45.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 >> v1:172.21.15.31:6816/39551 conn(0x7f9504038e30 legacy=0x7f950403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95240a5000 msgr2=0x7f9524139c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95240a5000 0x7f9524139c30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9514002f70 tx=0x7f9514015000).stop 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 shutdown_connections 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95240a5000 0x7f9524139c30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9524136af0 0x7f9524145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 --2- 172.21.15.31:0/3811238236 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9524136710 0x7f9524145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 >> 172.21.15.31:0/3811238236 conn(0x7f9524060ac0 msgr2=0x7f952405c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 shutdown_connections 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:45.004+0000 7f9529d3f700 1 -- 172.21.15.31:0/3811238236 wait complete. 2024-04-18T10:36:45.005 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:45.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:45.317 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:46.319 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:46.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.439+0000 7f6351674700 1 Processor -- start 2024-04-18T10:36:46.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.439+0000 7f6351674700 1 -- start start 2024-04-18T10:36:46.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.439+0000 7f6351674700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:46.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.439+0000 7f6351674700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c0646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:46.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.439+0000 7f6351674700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f634c134660 0x7f634c134b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.439+0000 7f6351674700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c1341f0 con 0x7f634c134660 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.439+0000 7f6351674700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c064bd0 con 0x7f634c064260 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.439+0000 7f6351674700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1343e0 con 0x7f634c05b970 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634a7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c0646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f634c134660 0x7f634c134b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634a7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c0646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39630/0 (socket says 172.21.15.31:39630) 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f634c134660 0x7f634c134b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51674/0 (socket says 172.21.15.31:51674) 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634a7fc700 1 -- 172.21.15.31:0/1666783251 learned_addr learned my addr 172.21.15.31:0/1666783251 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634a7fc700 1 -- 172.21.15.31:0/1666783251 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 msgr2=0x7f634c0655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634a7fc700 1 --2- 172.21.15.31:0/1666783251 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634a7fc700 1 -- 172.21.15.31:0/1666783251 >> v2:172.21.15.31:3300/0 conn(0x7f634c134660 msgr2=0x7f634c134b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:46.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634a7fc700 1 --2- 172.21.15.31:0/1666783251 >> v2:172.21.15.31:3300/0 conn(0x7f634c134660 0x7f634c134b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634a7fc700 1 -- 172.21.15.31:0/1666783251 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c064e50 con 0x7f634c064260 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634b7fe700 1 --2- 172.21.15.31:0/1666783251 >> v2:172.21.15.31:3300/0 conn(0x7f634c134660 0x7f634c134b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f634a7fc700 1 --2- 172.21.15.31:0/1666783251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c0646e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f634c064d10 tx=0x7f6334006eb0).ready entity=mon.1 client_cookie=4fcdac4d50a1111 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f6349ffb700 1 -- 172.21.15.31:0/1666783251 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f633400d570 con 0x7f634c064260 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f6349ffb700 1 -- 172.21.15.31:0/1666783251 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6334000e90 con 0x7f634c064260 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.440+0000 7f6349ffb700 1 -- 172.21.15.31:0/1666783251 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f633400d900 con 0x7f634c064260 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.441+0000 7f6351674700 1 -- 172.21.15.31:0/1666783251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 msgr2=0x7f634c0646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.441+0000 7f6351674700 1 --2- 172.21.15.31:0/1666783251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c0646e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f634c064d10 tx=0x7f6334006eb0).stop 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.441+0000 7f6351674700 1 -- 172.21.15.31:0/1666783251 shutdown_connections 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.441+0000 7f6351674700 1 --2- 172.21.15.31:0/1666783251 >> v2:172.21.15.31:3300/0 conn(0x7f634c134660 0x7f634c134b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.441+0000 7f6351674700 1 --2- 172.21.15.31:0/1666783251 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.441+0000 7f6351674700 1 --2- 172.21.15.31:0/1666783251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c0646e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.441+0000 7f6351674700 1 -- 172.21.15.31:0/1666783251 >> 172.21.15.31:0/1666783251 conn(0x7f634c06c0c0 msgr2=0x7f634c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:46.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.441+0000 7f6351674700 1 -- 172.21.15.31:0/1666783251 shutdown_connections 2024-04-18T10:36:46.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.441+0000 7f6351674700 1 -- 172.21.15.31:0/1666783251 wait complete. 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.442+0000 7f6351674700 1 Processor -- start 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.442+0000 7f6351674700 1 -- start start 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.442+0000 7f6351674700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0947f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.442+0000 7f6351674700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c092a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.442+0000 7f6351674700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c134660 0x7f634c143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.442+0000 7f6351674700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c137970 con 0x7f634c134660 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.442+0000 7f6351674700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c093d10 con 0x7f634c064260 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.442+0000 7f6351674700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f634c136ff0 con 0x7f634c05b970 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634a7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c092a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:46.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c134660 0x7f634c143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0947f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45172/0 (socket says 172.21.15.31:45172) 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634affd700 1 -- 172.21.15.31:0/3533758694 learned_addr learned my addr 172.21.15.31:0/3533758694 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c134660 0x7f634c143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51686/0 (socket says 172.21.15.31:51686) 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634a7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c092a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39636/0 (socket says 172.21.15.31:39636) 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634affd700 1 -- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 msgr2=0x7f634c092a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634affd700 1 --2- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c092a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634affd700 1 -- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c134660 msgr2=0x7f634c143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634affd700 1 --2- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c134660 0x7f634c143b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634affd700 1 -- 172.21.15.31:0/3533758694 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344009470 con 0x7f634c05b970 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f634affd700 1 --2- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0947f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f634c095160 tx=0x7f633c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f6343fff700 1 -- 172.21.15.31:0/3533758694 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f633c010780 con 0x7f634c05b970 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f6343fff700 1 -- 172.21.15.31:0/3533758694 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0108e0 con 0x7f634c05b970 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f6343fff700 1 -- 172.21.15.31:0/3533758694 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f633c010c40 con 0x7f634c05b970 2024-04-18T10:36:46.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633400b1e0 con 0x7f634c05b970 2024-04-18T10:36:46.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.443+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c093750 con 0x7f634c05b970 2024-04-18T10:36:46.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.444+0000 7f6343fff700 1 -- 172.21.15.31:0/3533758694 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f633c01c460 con 0x7f634c05b970 2024-04-18T10:36:46.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.444+0000 7f6343fff700 1 -- 172.21.15.31:0/3533758694 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f633c04ace0 con 0x7f634c05b970 2024-04-18T10:36:46.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.444+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c0941b0 con 0x7f634c05b970 2024-04-18T10:36:46.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.447+0000 7f6343fff700 1 -- 172.21.15.31:0/3533758694 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f633c033610 con 0x7f634c05b970 2024-04-18T10:36:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.598+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f634c135000 con 0x7f634c05b970 2024-04-18T10:36:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.599+0000 7f6343fff700 1 -- 172.21.15.31:0/3533758694 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f633c033200 con 0x7f634c05b970 2024-04-18T10:36:46.600 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:46.600 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 >> v1:172.21.15.31:6816/39551 conn(0x7f6330038da0 legacy=0x7f633003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 msgr2=0x7f634c0947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 --2- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0947f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f634c095160 tx=0x7f633c006df0).stop 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 shutdown_connections 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 --2- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f634c05b970 0x7f634c0947f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 --2- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f634c134660 0x7f634c143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 --2- 172.21.15.31:0/3533758694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f634c064260 0x7f634c092a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 >> 172.21.15.31:0/3533758694 conn(0x7f634c06c0c0 msgr2=0x7f634c06c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 shutdown_connections 2024-04-18T10:36:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:46.600+0000 7f6351674700 1 -- 172.21.15.31:0/3533758694 wait complete. 2024-04-18T10:36:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:46.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:46.913 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:47.914 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:48.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.035+0000 7fad933b1700 1 Processor -- start 2024-04-18T10:36:48.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.035+0000 7fad933b1700 1 -- start start 2024-04-18T10:36:48.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.035+0000 7fad933b1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c0a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:48.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.035+0000 7fad933b1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fad8c09f650 0x7fad8c135c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:48.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.035+0000 7fad933b1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c0a0b90 0x7fad8c0a3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:48.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.035+0000 7fad933b1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c136170 con 0x7fad8c09f650 2024-04-18T10:36:48.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.035+0000 7fad933b1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0a20d0 con 0x7fad8c1358a0 2024-04-18T10:36:48.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.035+0000 7fad933b1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0a2370 con 0x7fad8c0a0b90 2024-04-18T10:36:48.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9094c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fad8c09f650 0x7fad8c135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:48.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9194e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c0a0b90 0x7fad8c0a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9114d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c0a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9094c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fad8c09f650 0x7fad8c135c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51696/0 (socket says 172.21.15.31:51696) 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9114d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c0a2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39648/0 (socket says 172.21.15.31:39648) 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9194e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c0a0b90 0x7fad8c0a3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45176/0 (socket says 172.21.15.31:45176) 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9114d700 1 -- 172.21.15.31:0/2466930157 learned_addr learned my addr 172.21.15.31:0/2466930157 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9114d700 1 -- 172.21.15.31:0/2466930157 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c0a0b90 msgr2=0x7fad8c0a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9114d700 1 --2- 172.21.15.31:0/2466930157 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c0a0b90 0x7fad8c0a3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9114d700 1 -- 172.21.15.31:0/2466930157 >> v2:172.21.15.31:3300/0 conn(0x7fad8c09f650 msgr2=0x7fad8c135c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9114d700 1 --2- 172.21.15.31:0/2466930157 >> v2:172.21.15.31:3300/0 conn(0x7fad8c09f650 0x7fad8c135c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9114d700 1 -- 172.21.15.31:0/2466930157 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c0a1e10 con 0x7fad8c1358a0 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9094c700 1 --2- 172.21.15.31:0/2466930157 >> v2:172.21.15.31:3300/0 conn(0x7fad8c09f650 0x7fad8c135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9194e700 1 --2- 172.21.15.31:0/2466930157 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c0a0b90 0x7fad8c0a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad9114d700 1 --2- 172.21.15.31:0/2466930157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c0a2a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fad88002f70 tx=0x7fad88006f40).ready entity=mon.1 client_cookie=b79b9934b26331d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:48.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad7bfff700 1 -- 172.21.15.31:0/2466930157 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad88013070 con 0x7fad8c1358a0 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad7bfff700 1 -- 172.21.15.31:0/2466930157 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88000e90 con 0x7fad8c1358a0 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.036+0000 7fad7bfff700 1 -- 172.21.15.31:0/2466930157 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad8800eb90 con 0x7fad8c1358a0 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.037+0000 7fad933b1700 1 -- 172.21.15.31:0/2466930157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 msgr2=0x7fad8c0a2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.037+0000 7fad933b1700 1 --2- 172.21.15.31:0/2466930157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c0a2a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fad88002f70 tx=0x7fad88006f40).stop 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.037+0000 7fad933b1700 1 -- 172.21.15.31:0/2466930157 shutdown_connections 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.037+0000 7fad933b1700 1 --2- 172.21.15.31:0/2466930157 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c0a0b90 0x7fad8c0a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.037+0000 7fad933b1700 1 --2- 172.21.15.31:0/2466930157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c0a2a20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.037+0000 7fad933b1700 1 --2- 172.21.15.31:0/2466930157 >> v2:172.21.15.31:3300/0 conn(0x7fad8c09f650 0x7fad8c135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.037+0000 7fad933b1700 1 -- 172.21.15.31:0/2466930157 >> 172.21.15.31:0/2466930157 conn(0x7fad8c060ac0 msgr2=0x7fad8c0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.037+0000 7fad933b1700 1 -- 172.21.15.31:0/2466930157 shutdown_connections 2024-04-18T10:36:48.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.037+0000 7fad933b1700 1 -- 172.21.15.31:0/2466930157 wait complete. 2024-04-18T10:36:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.038+0000 7fad933b1700 1 Processor -- start 2024-04-18T10:36:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.038+0000 7fad933b1700 1 -- start start 2024-04-18T10:36:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad933b1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c09f650 0x7fad8c0657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad933b1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8c0a0b90 0x7fad8c144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:48.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad933b1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad933b1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0926c0 con 0x7fad8c0a0b90 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad933b1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0676d0 con 0x7fad8c1358a0 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad933b1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0924a0 con 0x7fad8c09f650 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9114d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c09f650 0x7fad8c0657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9094c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8c0a0b90 0x7fad8c144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9114d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c09f650 0x7fad8c0657e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45184/0 (socket says 172.21.15.31:45184) 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9114d700 1 -- 172.21.15.31:0/3915703753 learned_addr learned my addr 172.21.15.31:0/3915703753 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9194e700 1 --2- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9114d700 1 -- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 msgr2=0x7fad8c144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9114d700 1 --2- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9114d700 1 -- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8c0a0b90 msgr2=0x7fad8c144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9114d700 1 --2- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8c0a0b90 0x7fad8c144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9114d700 1 -- 172.21.15.31:0/3915703753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c00d590 con 0x7fad8c09f650 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9194e700 1 --2- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:48.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.039+0000 7fad9114d700 1 --2- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c09f650 0x7fad8c0657e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fad88002f70 tx=0x7fad88015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.040+0000 7fad7a7fc700 1 -- 172.21.15.31:0/3915703753 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad8800fe60 con 0x7fad8c09f650 2024-04-18T10:36:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.040+0000 7fad7a7fc700 1 -- 172.21.15.31:0/3915703753 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad880068b0 con 0x7fad8c09f650 2024-04-18T10:36:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.040+0000 7fad7a7fc700 1 -- 172.21.15.31:0/3915703753 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad8801c640 con 0x7fad8c09f650 2024-04-18T10:36:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.040+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad84009470 con 0x7fad8c09f650 2024-04-18T10:36:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.040+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8800c2e0 con 0x7fad8c09f650 2024-04-18T10:36:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.041+0000 7fad7a7fc700 1 -- 172.21.15.31:0/3915703753 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fad8802c070 con 0x7fad8c09f650 2024-04-18T10:36:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.041+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c0a1020 con 0x7fad8c09f650 2024-04-18T10:36:48.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.041+0000 7fad7a7fc700 1 -- 172.21.15.31:0/3915703753 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fad8804ce70 con 0x7fad8c09f650 2024-04-18T10:36:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.044+0000 7fad7a7fc700 1 -- 172.21.15.31:0/3915703753 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fad88008990 con 0x7fad8c09f650 2024-04-18T10:36:48.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.198+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad8c057a60 con 0x7fad8c09f650 2024-04-18T10:36:48.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.198+0000 7fad7a7fc700 1 -- 172.21.15.31:0/3915703753 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7fad88002c50 con 0x7fad8c09f650 2024-04-18T10:36:48.199 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 >> v1:172.21.15.31:6816/39551 conn(0x7fad6c038da0 legacy=0x7fad6c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c09f650 msgr2=0x7fad8c0657e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 --2- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c09f650 0x7fad8c0657e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fad88002f70 tx=0x7fad88015000).stop 2024-04-18T10:36:48.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 shutdown_connections 2024-04-18T10:36:48.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 --2- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fad8c09f650 0x7fad8c0657e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 --2- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fad8c1358a0 0x7fad8c144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 --2- 172.21.15.31:0/3915703753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad8c0a0b90 0x7fad8c144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:48.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 >> 172.21.15.31:0/3915703753 conn(0x7fad8c060ac0 msgr2=0x7fad8c132b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:48.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 shutdown_connections 2024-04-18T10:36:48.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:48.200+0000 7fad933b1700 1 -- 172.21.15.31:0/3915703753 wait complete. 2024-04-18T10:36:48.201 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:48.512 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:48.513 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:49.515 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:49.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.634+0000 7f422804d700 1 Processor -- start 2024-04-18T10:36:49.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.634+0000 7f422804d700 1 -- start start 2024-04-18T10:36:49.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f422804d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f42200646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:49.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f422804d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4220134660 0x7f4220134af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:49.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f422804d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42201343e0 con 0x7f422005b970 2024-04-18T10:36:49.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f422804d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42201341f0 con 0x7f4220064260 2024-04-18T10:36:49.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f422804d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4220065cd0 con 0x7f4220134660 2024-04-18T10:36:49.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f42255e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f42200646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:49.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f4225de9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f422005b970 0x7f42200655c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58532/0 (socket says 172.21.15.31:58532) 2024-04-18T10:36:49.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f4225de9700 1 -- 172.21.15.31:0/3587952004 learned_addr learned my addr 172.21.15.31:0/3587952004 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:49.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f42265ea700 1 --2- 172.21.15.31:0/3587952004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4220134660 0x7f4220134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:49.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f42255e8700 1 -- 172.21.15.31:0/3587952004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4220134660 msgr2=0x7f4220134af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:49.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f42255e8700 1 --2- 172.21.15.31:0/3587952004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4220134660 0x7f4220134af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:49.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f42255e8700 1 -- 172.21.15.31:0/3587952004 >> v1:172.21.15.31:6789/0 conn(0x7f422005b970 legacy=0x7f42200655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:49.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.635+0000 7f4224de7700 1 -- 172.21.15.31:0/3587952004 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490050697 0 0) 0x7f42201343e0 con 0x7f422005b970 2024-04-18T10:36:49.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f42255e8700 1 -- 172.21.15.31:0/3587952004 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4220064e50 con 0x7f4220064260 2024-04-18T10:36:49.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f42255e8700 1 --2- 172.21.15.31:0/3587952004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f42200646e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f421c002f70 tx=0x7f421c006df0).ready entity=mon.1 client_cookie=446b63c6bb1a761 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:49.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f4224de7700 1 -- 172.21.15.31:0/3587952004 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f421c00d570 con 0x7f4220064260 2024-04-18T10:36:49.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f4224de7700 1 -- 172.21.15.31:0/3587952004 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c000e90 con 0x7f4220064260 2024-04-18T10:36:49.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f4224de7700 1 -- 172.21.15.31:0/3587952004 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f421c00d8c0 con 0x7f4220064260 2024-04-18T10:36:49.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f422804d700 1 -- 172.21.15.31:0/3587952004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 msgr2=0x7f42200646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:49.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f422804d700 1 --2- 172.21.15.31:0/3587952004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f42200646e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f421c002f70 tx=0x7f421c006df0).stop 2024-04-18T10:36:49.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f422804d700 1 -- 172.21.15.31:0/3587952004 shutdown_connections 2024-04-18T10:36:49.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f422804d700 1 --2- 172.21.15.31:0/3587952004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4220134660 0x7f4220134af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:49.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f422804d700 1 --2- 172.21.15.31:0/3587952004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f42200646e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:49.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.636+0000 7f422804d700 1 -- 172.21.15.31:0/3587952004 >> 172.21.15.31:0/3587952004 conn(0x7f422006c0c0 msgr2=0x7f422006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:49.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.637+0000 7f422804d700 1 -- 172.21.15.31:0/3587952004 shutdown_connections 2024-04-18T10:36:49.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.637+0000 7f422804d700 1 -- 172.21.15.31:0/3587952004 wait complete. 2024-04-18T10:36:49.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.637+0000 7f422804d700 1 Processor -- start 2024-04-18T10:36:49.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.637+0000 7f422804d700 1 -- start start 2024-04-18T10:36:49.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f422804d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f422005b970 0x7f4220137730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:49.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f422804d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f422012fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:49.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f422804d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4220134660 0x7f42201303d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:49.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f422804d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201308c0 con 0x7f4220134660 2024-04-18T10:36:49.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f422804d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4220136e00 con 0x7f4220064260 2024-04-18T10:36:49.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f422804d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4220093380 con 0x7f422005b970 2024-04-18T10:36:49.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f42255e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f422012fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:49.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f4225de9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f422005b970 0x7f4220137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:49.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f42255e8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f422012fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39676/0 (socket says 172.21.15.31:39676) 2024-04-18T10:36:49.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f42255e8700 1 -- 172.21.15.31:0/3466598098 learned_addr learned my addr 172.21.15.31:0/3466598098 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:49.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f4225de9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f422005b970 0x7f4220137730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45202/0 (socket says 172.21.15.31:45202) 2024-04-18T10:36:49.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f42265ea700 1 --2- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4220134660 0x7f42201303d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:49.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f42255e8700 1 -- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f422005b970 msgr2=0x7f4220137730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:49.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f42255e8700 1 --2- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f422005b970 0x7f4220137730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:49.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f42255e8700 1 -- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4220134660 msgr2=0x7f42201303d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:49.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f42255e8700 1 --2- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4220134660 0x7f42201303d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:49.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.638+0000 7f42255e8700 1 -- 172.21.15.31:0/3466598098 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c00b180 con 0x7f4220064260 2024-04-18T10:36:49.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.639+0000 7f4225de9700 1 --2- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f422005b970 0x7f4220137730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.639+0000 7f42255e8700 1 --2- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f422012fee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f421c002f70 tx=0x7f421c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.639+0000 7f420effd700 1 -- 172.21.15.31:0/3466598098 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f421c013de0 con 0x7f4220064260 2024-04-18T10:36:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.639+0000 7f420effd700 1 -- 172.21.15.31:0/3466598098 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c00de80 con 0x7f4220064260 2024-04-18T10:36:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.639+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4220093640 con 0x7f4220064260 2024-04-18T10:36:49.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.639+0000 7f420effd700 1 -- 172.21.15.31:0/3466598098 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f421c01e5f0 con 0x7f4220064260 2024-04-18T10:36:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.639+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220092f60 con 0x7f4220064260 2024-04-18T10:36:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.640+0000 7f420effd700 1 -- 172.21.15.31:0/3466598098 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f421c025030 con 0x7f4220064260 2024-04-18T10:36:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.640+0000 7f420effd700 1 -- 172.21.15.31:0/3466598098 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f421c04b630 con 0x7f4220064260 2024-04-18T10:36:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.640+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4220093150 con 0x7f4220064260 2024-04-18T10:36:49.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.643+0000 7f420effd700 1 -- 172.21.15.31:0/3466598098 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f421c028850 con 0x7f4220064260 2024-04-18T10:36:49.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.792+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4220134fe0 con 0x7f4220064260 2024-04-18T10:36:49.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.792+0000 7f420effd700 1 -- 172.21.15.31:0/3466598098 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f421c023930 con 0x7f4220064260 2024-04-18T10:36:49.793 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:49.793 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:49.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 >> v1:172.21.15.31:6816/39551 conn(0x7f4200038e30 legacy=0x7f420003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:49.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 msgr2=0x7f422012fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:49.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 --2- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f422012fee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f421c002f70 tx=0x7f421c014000).stop 2024-04-18T10:36:49.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 shutdown_connections 2024-04-18T10:36:49.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 --2- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f422005b970 0x7f4220137730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:49.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 --2- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4220134660 0x7f42201303d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:49.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 --2- 172.21.15.31:0/3466598098 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4220064260 0x7f422012fee0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:49.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 >> 172.21.15.31:0/3466598098 conn(0x7f422006c0c0 msgr2=0x7f422006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:49.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 shutdown_connections 2024-04-18T10:36:49.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:49.794+0000 7f422804d700 1 -- 172.21.15.31:0/3466598098 wait complete. 2024-04-18T10:36:49.795 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:50.107 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:50.108 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:51.109 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:51.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.228+0000 7f9e881bf700 1 Processor -- start 2024-04-18T10:36:51.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.228+0000 7f9e881bf700 1 -- start start 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e881bf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9e8009fdf0 0x7f9e800a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e881bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e8013d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e881bf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8005bf10 con 0x7f9e8005bb30 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e881bf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e800a0d90 con 0x7f9e8009fdf0 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e881bf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800a4410 con 0x7f9e800a3f50 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8575a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9e8009fdf0 0x7f9e800a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8675c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e8013d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8575a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9e8009fdf0 0x7f9e800a3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51714/0 (socket says 172.21.15.31:51714) 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8575a700 1 -- 172.21.15.31:0/3651123312 learned_addr learned my addr 172.21.15.31:0/3651123312 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8675c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e8013d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39680/0 (socket says 172.21.15.31:39680) 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e85f5b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9e8005bb30 0x7f9e800a3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58534/0 (socket says 172.21.15.31:58534) 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8575a700 1 -- 172.21.15.31:0/3651123312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 msgr2=0x7f9e8013d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8575a700 1 --2- 172.21.15.31:0/3651123312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e8013d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:51.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8575a700 1 -- 172.21.15.31:0/3651123312 >> v1:172.21.15.31:6789/0 conn(0x7f9e8005bb30 legacy=0x7f9e800a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e84f59700 1 -- 172.21.15.31:0/3651123312 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28652497 0 0) 0x7f9e8005bf10 con 0x7f9e8005bb30 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8575a700 1 -- 172.21.15.31:0/3651123312 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800a1ca0 con 0x7f9e8009fdf0 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.229+0000 7f9e8675c700 1 --2- 172.21.15.31:0/3651123312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e8013d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e8575a700 1 --2- 172.21.15.31:0/3651123312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 0x7f9e800a3a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9e7c002f70 tx=0x7f9e7c006eb0).ready entity=mon.0 client_cookie=89075d34e0d5686c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e84f59700 1 -- 172.21.15.31:0/3651123312 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7c00d570 con 0x7f9e8009fdf0 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e84f59700 1 -- 172.21.15.31:0/3651123312 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c000e90 con 0x7f9e8009fdf0 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e84f59700 1 -- 172.21.15.31:0/3651123312 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7c00d8c0 con 0x7f9e8009fdf0 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e881bf700 1 -- 172.21.15.31:0/3651123312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 msgr2=0x7f9e800a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e881bf700 1 --2- 172.21.15.31:0/3651123312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 0x7f9e800a3a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9e7c002f70 tx=0x7f9e7c006eb0).stop 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e881bf700 1 -- 172.21.15.31:0/3651123312 shutdown_connections 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e881bf700 1 --2- 172.21.15.31:0/3651123312 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e8013d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e881bf700 1 --2- 172.21.15.31:0/3651123312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 0x7f9e800a3a60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e881bf700 1 -- 172.21.15.31:0/3651123312 >> 172.21.15.31:0/3651123312 conn(0x7f9e80060ac0 msgr2=0x7f9e800a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:51.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e881bf700 1 -- 172.21.15.31:0/3651123312 shutdown_connections 2024-04-18T10:36:51.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.230+0000 7f9e881bf700 1 -- 172.21.15.31:0/3651123312 wait complete. 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.231+0000 7f9e881bf700 1 Processor -- start 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.231+0000 7f9e881bf700 1 -- start start 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e881bf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e8005bb30 0x7f9e80066460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e881bf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 0x7f9e80148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e881bf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e80149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e881bf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800978c0 con 0x7f9e8009fdf0 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e881bf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80097030 con 0x7f9e800a3f50 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e881bf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80066a10 con 0x7f9e8005bb30 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8575a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 0x7f9e80148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:51.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8675c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e80149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8575a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 0x7f9e80148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51718/0 (socket says 172.21.15.31:51718) 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8575a700 1 -- 172.21.15.31:0/686926600 learned_addr learned my addr 172.21.15.31:0/686926600 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e85f5b700 1 --2- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e8005bb30 0x7f9e80066460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8675c700 1 -- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e8005bb30 msgr2=0x7f9e80066460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8675c700 1 --2- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e8005bb30 0x7f9e80066460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8675c700 1 -- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 msgr2=0x7f9e80148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8675c700 1 --2- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 0x7f9e80148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8675c700 1 -- 172.21.15.31:0/686926600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7800a610 con 0x7f9e800a3f50 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.232+0000 7f9e8675c700 1 --2- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e80149450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f9e7800d000 tx=0x7f9e7800a370).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:51.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.233+0000 7f9e6effd700 1 -- 172.21.15.31:0/686926600 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7800c6f0 con 0x7f9e800a3f50 2024-04-18T10:36:51.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.233+0000 7f9e6effd700 1 -- 172.21.15.31:0/686926600 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7800c850 con 0x7f9e800a3f50 2024-04-18T10:36:51.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.233+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c00b1e0 con 0x7f9e800a3f50 2024-04-18T10:36:51.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.233+0000 7f9e6effd700 1 -- 172.21.15.31:0/686926600 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7800cbb0 con 0x7f9e800a3f50 2024-04-18T10:36:51.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.233+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e80063e50 con 0x7f9e800a3f50 2024-04-18T10:36:51.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.234+0000 7f9e6effd700 1 -- 172.21.15.31:0/686926600 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9e78021070 con 0x7f9e800a3f50 2024-04-18T10:36:51.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.234+0000 7f9e6effd700 1 -- 172.21.15.31:0/686926600 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9e7804ac40 con 0x7f9e800a3f50 2024-04-18T10:36:51.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.234+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e80097a30 con 0x7f9e800a3f50 2024-04-18T10:36:51.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.237+0000 7f9e6effd700 1 -- 172.21.15.31:0/686926600 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9e80097a30 con 0x7f9e800a3f50 2024-04-18T10:36:51.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.387+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e80097a30 con 0x7f9e800a3f50 2024-04-18T10:36:51.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.387+0000 7f9e6effd700 1 -- 172.21.15.31:0/686926600 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f9e80097a30 con 0x7f9e800a3f50 2024-04-18T10:36:51.388 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:51.388 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:51.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 >> v1:172.21.15.31:6816/39551 conn(0x7f9e60038f50 legacy=0x7f9e6003b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 msgr2=0x7f9e80149450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 --2- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e80149450 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f9e7800d000 tx=0x7f9e7800a370).stop 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 shutdown_connections 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 --2- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e8005bb30 0x7f9e80066460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 --2- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e800a3f50 0x7f9e80149450 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 --2- 172.21.15.31:0/686926600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8009fdf0 0x7f9e80148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 >> 172.21.15.31:0/686926600 conn(0x7f9e80060ac0 msgr2=0x7f9e8005dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 shutdown_connections 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:51.389+0000 7f9e881bf700 1 -- 172.21.15.31:0/686926600 wait complete. 2024-04-18T10:36:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:51.702 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:51.702 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:52.704 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.823+0000 7f6fb2205700 1 Processor -- start 2024-04-18T10:36:52.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.823+0000 7f6fb2205700 1 -- start start 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fb2205700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6fac0a5000 0x7f6fac0a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fb2205700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136af0 0x7f6fac05c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fb2205700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac066c10 con 0x7f6fac136710 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fb2205700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac066eb0 con 0x7f6fac0a5000 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fb2205700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0a3b40 con 0x7f6fac136af0 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6faaffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6fac0a5000 0x7f6fac0a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fabfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136af0 0x7f6fac05c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fab7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6fac136710 0x7f6fac05b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58546/0 (socket says 172.21.15.31:58546) 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fab7fe700 1 -- 172.21.15.31:0/3312787946 learned_addr learned my addr 172.21.15.31:0/3312787946 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fabfff700 1 -- 172.21.15.31:0/3312787946 >> v2:172.21.15.31:3300/0 conn(0x7f6fac0a5000 msgr2=0x7f6fac0a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fabfff700 1 --2- 172.21.15.31:0/3312787946 >> v2:172.21.15.31:3300/0 conn(0x7f6fac0a5000 0x7f6fac0a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fabfff700 1 -- 172.21.15.31:0/3312787946 >> v1:172.21.15.31:6789/0 conn(0x7f6fac136710 legacy=0x7f6fac05b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:52.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6fabfff700 1 -- 172.21.15.31:0/3312787946 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac0673f0 con 0x7f6fac136af0 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6faa7fc700 1 -- 172.21.15.31:0/3312787946 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033617403 0 0) 0x7f6fac066c10 con 0x7f6fac136710 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.824+0000 7f6faaffd700 1 --2- 172.21.15.31:0/3312787946 >> v2:172.21.15.31:3300/0 conn(0x7f6fac0a5000 0x7f6fac0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6fabfff700 1 --2- 172.21.15.31:0/3312787946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136af0 0x7f6fac05c080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6fa40032f0 tx=0x7f6fa40091d0).ready entity=mon.1 client_cookie=99b0615f2ed26d4c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6faa7fc700 1 -- 172.21.15.31:0/3312787946 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fa400b6c0 con 0x7f6fac136af0 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6faa7fc700 1 -- 172.21.15.31:0/3312787946 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa400b820 con 0x7f6fac136af0 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6faa7fc700 1 -- 172.21.15.31:0/3312787946 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fa400b990 con 0x7f6fac136af0 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6fb2205700 1 -- 172.21.15.31:0/3312787946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136af0 msgr2=0x7f6fac05c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6fb2205700 1 --2- 172.21.15.31:0/3312787946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136af0 0x7f6fac05c080 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f6fa40032f0 tx=0x7f6fa40091d0).stop 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6fb2205700 1 -- 172.21.15.31:0/3312787946 shutdown_connections 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6fb2205700 1 --2- 172.21.15.31:0/3312787946 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136af0 0x7f6fac05c080 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6fb2205700 1 --2- 172.21.15.31:0/3312787946 >> v2:172.21.15.31:3300/0 conn(0x7f6fac0a5000 0x7f6fac0a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6fb2205700 1 -- 172.21.15.31:0/3312787946 >> 172.21.15.31:0/3312787946 conn(0x7f6fac060ac0 msgr2=0x7f6fac0a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6fb2205700 1 -- 172.21.15.31:0/3312787946 shutdown_connections 2024-04-18T10:36:52.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.825+0000 7f6fb2205700 1 -- 172.21.15.31:0/3312787946 wait complete. 2024-04-18T10:36:52.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.826+0000 7f6fb2205700 1 Processor -- start 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.826+0000 7f6fb2205700 1 -- start start 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6fb2205700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fac0a5000 0x7f6fac0a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6fb2205700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136710 0x7f6fac148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6fb2205700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6fac136af0 0x7f6fac149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6fb2205700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac092750 con 0x7f6fac0a5000 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6fb2205700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0a2cb0 con 0x7f6fac136710 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6fb2205700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0933a0 con 0x7f6fac136af0 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6fab7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fac0a5000 0x7f6fac0a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6faaffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136710 0x7f6fac148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6fabfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6fac136af0 0x7f6fac149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6faaffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136710 0x7f6fac148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:39704/0 (socket says 172.21.15.31:39704) 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6fab7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fac0a5000 0x7f6fac0a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51748/0 (socket says 172.21.15.31:51748) 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6faaffd700 1 -- 172.21.15.31:0/3795721169 learned_addr learned my addr 172.21.15.31:0/3795721169 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6faaffd700 1 -- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6fac136af0 msgr2=0x7f6fac149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:52.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6faaffd700 1 --2- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6fac136af0 0x7f6fac149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6faaffd700 1 -- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fac0a5000 msgr2=0x7f6fac0a22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6faaffd700 1 --2- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fac0a5000 0x7f6fac0a22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.827+0000 7f6faaffd700 1 -- 172.21.15.31:0/3795721169 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c00b180 con 0x7f6fac136710 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.828+0000 7f6fabfff700 1 --2- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6fac136af0 0x7f6fac149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.828+0000 7f6faaffd700 1 --2- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136710 0x7f6fac148d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6f9c00c000 tx=0x7f6f9c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.828+0000 7f6fa8ff9700 1 -- 172.21.15.31:0/3795721169 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c00c7e0 con 0x7f6fac136710 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.828+0000 7f6fa8ff9700 1 -- 172.21.15.31:0/3795721169 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c00c940 con 0x7f6fac136710 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.828+0000 7f6fa8ff9700 1 -- 172.21.15.31:0/3795721169 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c00cca0 con 0x7f6fac136710 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.828+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa4009470 con 0x7f6fac136710 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.828+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac13a360 con 0x7f6fac136710 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.829+0000 7f6fa8ff9700 1 -- 172.21.15.31:0/3795721169 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6f9c01c460 con 0x7f6fac136710 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.829+0000 7f6fa8ff9700 1 -- 172.21.15.31:0/3795721169 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6f9c04ada0 con 0x7f6fac136710 2024-04-18T10:36:52.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.829+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fac0935f0 con 0x7f6fac136710 2024-04-18T10:36:52.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.832+0000 7f6fa8ff9700 1 -- 172.21.15.31:0/3795721169 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6f9c0336d0 con 0x7f6fac136710 2024-04-18T10:36:52.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.983+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fac05cc00 con 0x7f6fac136710 2024-04-18T10:36:52.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.983+0000 7f6fa8ff9700 1 -- 172.21.15.31:0/3795721169 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7f6fac05cc00 con 0x7f6fac136710 2024-04-18T10:36:52.983 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:52.983 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.984+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 >> v1:172.21.15.31:6816/39551 conn(0x7f6f90038dd0 legacy=0x7f6f9003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.984+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136710 msgr2=0x7f6fac148d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.984+0000 7f6fb2205700 1 --2- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136710 0x7f6fac148d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6f9c00c000 tx=0x7f6f9c006df0).stop 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.984+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 shutdown_connections 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.984+0000 7f6fb2205700 1 --2- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6fac136af0 0x7f6fac149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.985+0000 7f6fb2205700 1 --2- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fac0a5000 0x7f6fac0a22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.985+0000 7f6fb2205700 1 --2- 172.21.15.31:0/3795721169 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6fac136710 0x7f6fac148d90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.985+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 >> 172.21.15.31:0/3795721169 conn(0x7f6fac060ac0 msgr2=0x7f6fac0a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.985+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 shutdown_connections 2024-04-18T10:36:52.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:52.985+0000 7f6fb2205700 1 -- 172.21.15.31:0/3795721169 wait complete. 2024-04-18T10:36:52.986 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:53.297 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:53.298 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:54.299 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:54.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.418+0000 7fcc6d263700 1 Processor -- start 2024-04-18T10:36:54.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.418+0000 7fcc6d263700 1 -- start start 2024-04-18T10:36:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc6d263700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc68133970 0x7fcc680a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc6d263700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc68141070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc6d263700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6805d520 con 0x7fcc68133590 2024-04-18T10:36:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc6d263700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc68139bc0 con 0x7fcc68133970 2024-04-18T10:36:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc6d263700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68139e60 con 0x7fcc6813ec80 2024-04-18T10:36:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc667fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc68133970 0x7fcc680a82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc677fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc68141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc667fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc68133970 0x7fcc680a82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52704/0 (socket says 172.21.15.31:52704) 2024-04-18T10:36:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc667fc700 1 -- 172.21.15.31:0/4067861068 learned_addr learned my addr 172.21.15.31:0/4067861068 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc677fe700 1 --2- 172.21.15.31:0/4067861068 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc68141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34802/0 (socket says 172.21.15.31:34802) 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.419+0000 7fcc66ffd700 1 --1- 172.21.15.31:0/4067861068 >> v1:172.21.15.31:6789/0 conn(0x7fcc68133590 0x7fcc6805ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41666/0 (socket says 172.21.15.31:41666) 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc677fe700 1 -- 172.21.15.31:0/4067861068 >> v2:172.21.15.31:3300/0 conn(0x7fcc68133970 msgr2=0x7fcc680a82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc677fe700 1 --2- 172.21.15.31:0/4067861068 >> v2:172.21.15.31:3300/0 conn(0x7fcc68133970 0x7fcc680a82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc677fe700 1 -- 172.21.15.31:0/4067861068 >> v1:172.21.15.31:6789/0 conn(0x7fcc68133590 legacy=0x7fcc6805ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc677fe700 1 -- 172.21.15.31:0/4067861068 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc680a87b0 con 0x7fcc6813ec80 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc667fc700 1 --2- 172.21.15.31:0/4067861068 >> v2:172.21.15.31:3300/0 conn(0x7fcc68133970 0x7fcc680a82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc677fe700 1 --2- 172.21.15.31:0/4067861068 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc68141070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcc600032f0 tx=0x7fcc600091d0).ready entity=mon.2 client_cookie=867051ca5655a02 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc65ffb700 1 -- 172.21.15.31:0/4067861068 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc6000b6c0 con 0x7fcc6813ec80 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc65ffb700 1 -- 172.21.15.31:0/4067861068 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6000b820 con 0x7fcc6813ec80 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc65ffb700 1 -- 172.21.15.31:0/4067861068 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc6000b990 con 0x7fcc6813ec80 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc6d263700 1 -- 172.21.15.31:0/4067861068 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 msgr2=0x7fcc68141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.420+0000 7fcc6d263700 1 --2- 172.21.15.31:0/4067861068 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc68141070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcc600032f0 tx=0x7fcc600091d0).stop 2024-04-18T10:36:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.421+0000 7fcc6d263700 1 -- 172.21.15.31:0/4067861068 shutdown_connections 2024-04-18T10:36:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.421+0000 7fcc6d263700 1 --2- 172.21.15.31:0/4067861068 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc68141070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.421+0000 7fcc6d263700 1 --2- 172.21.15.31:0/4067861068 >> v2:172.21.15.31:3300/0 conn(0x7fcc68133970 0x7fcc680a82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.421+0000 7fcc6d263700 1 -- 172.21.15.31:0/4067861068 >> 172.21.15.31:0/4067861068 conn(0x7fcc68061480 msgr2=0x7fcc68066a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.421+0000 7fcc6d263700 1 -- 172.21.15.31:0/4067861068 shutdown_connections 2024-04-18T10:36:54.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.421+0000 7fcc6d263700 1 -- 172.21.15.31:0/4067861068 wait complete. 2024-04-18T10:36:54.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc6d263700 1 Processor -- start 2024-04-18T10:36:54.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc6d263700 1 -- start start 2024-04-18T10:36:54.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc6d263700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc68133590 0x7fcc680acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:54.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc6d263700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc68133970 0x7fcc6813bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:54.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc6d263700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc6813c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:54.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc6d263700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680ac440 con 0x7fcc68133970 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc6d263700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680ac640 con 0x7fcc68133590 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc6d263700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680aa900 con 0x7fcc6813ec80 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc677fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc6813c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc667fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc68133970 0x7fcc6813bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc66ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc68133590 0x7fcc680acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc677fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc6813c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34818/0 (socket says 172.21.15.31:34818) 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.422+0000 7fcc677fe700 1 -- 172.21.15.31:0/1902518893 learned_addr learned my addr 172.21.15.31:0/1902518893 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc677fe700 1 -- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc68133590 msgr2=0x7fcc680acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc677fe700 1 --2- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc68133590 0x7fcc680acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc677fe700 1 -- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc68133970 msgr2=0x7fcc6813bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc677fe700 1 --2- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc68133970 0x7fcc6813bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc677fe700 1 -- 172.21.15.31:0/1902518893 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5800b1e0 con 0x7fcc6813ec80 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc66ffd700 1 --2- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc68133590 0x7fcc680acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc667fc700 1 --2- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc68133970 0x7fcc6813bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:54.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc677fe700 1 --2- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc6813c0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcc600032f0 tx=0x7fcc60016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc57fff700 1 -- 172.21.15.31:0/1902518893 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc60011d30 con 0x7fcc6813ec80 2024-04-18T10:36:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc57fff700 1 -- 172.21.15.31:0/1902518893 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc60011e90 con 0x7fcc6813ec80 2024-04-18T10:36:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc60009470 con 0x7fcc6813ec80 2024-04-18T10:36:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc57fff700 1 -- 172.21.15.31:0/1902518893 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc600205f0 con 0x7fcc6813ec80 2024-04-18T10:36:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.423+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc680abd30 con 0x7fcc6813ec80 2024-04-18T10:36:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.424+0000 7fcc57fff700 1 -- 172.21.15.31:0/1902518893 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fcc6001e070 con 0x7fcc6813ec80 2024-04-18T10:36:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.424+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc68133d70 con 0x7fcc6813ec80 2024-04-18T10:36:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.424+0000 7fcc57fff700 1 -- 172.21.15.31:0/1902518893 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcc6004b630 con 0x7fcc6813ec80 2024-04-18T10:36:54.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.427+0000 7fcc57fff700 1 -- 172.21.15.31:0/1902518893 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fcc60021350 con 0x7fcc6813ec80 2024-04-18T10:36:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.578+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc68057a60 con 0x7fcc6813ec80 2024-04-18T10:36:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.578+0000 7fcc57fff700 1 -- 172.21.15.31:0/1902518893 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2329 (secure 0 0 0) 0x7fcc60015030 con 0x7fcc6813ec80 2024-04-18T10:36:54.578 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:54.579 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:33.557062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14141,"mds_1":14138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14138":{"gid":14138,"name":"b","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.31:6817/3448765785","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3448765785}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 >> v1:172.21.15.31:6816/39551 conn(0x7fcc44038dd0 legacy=0x7fcc4403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 msgr2=0x7fcc6813c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 --2- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc6813c0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcc600032f0 tx=0x7fcc60016000).stop 2024-04-18T10:36:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 shutdown_connections 2024-04-18T10:36:54.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 --2- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc6813ec80 0x7fcc6813c0e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:54.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 --2- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc68133590 0x7fcc680acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:54.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 --2- 172.21.15.31:0/1902518893 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc68133970 0x7fcc6813bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:54.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 >> 172.21.15.31:0/1902518893 conn(0x7fcc68061480 msgr2=0x7fcc68134df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:54.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 shutdown_connections 2024-04-18T10:36:54.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:54.580+0000 7fcc6d263700 1 -- 172.21.15.31:0/1902518893 wait complete. 2024-04-18T10:36:54.581 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 10 2024-04-18T10:36:54.893 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:33.557062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 14141, 'mds_1': 14138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14138': {'gid': 14138, 'name': 'b', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.31:6817/3448765785', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6817', 'nonce': 3448765785}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:54.893 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_14138:up:stopping 2024-04-18T10:36:55.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:36:56.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.014+0000 7fbe15dd2700 1 Processor -- start 2024-04-18T10:36:56.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.014+0000 7fbe15dd2700 1 -- start start 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.014+0000 7fbe15dd2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101369a0 0x7fbe10067400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.014+0000 7fbe15dd2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe10136d80 0x7fbe10061200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe15dd2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe101398e0 0x7fbe10139d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe15dd2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe10136310 con 0x7fbe101398e0 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe15dd2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10060920 con 0x7fbe10136d80 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe15dd2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10136500 con 0x7fbe101369a0 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe101398e0 0x7fbe10139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101369a0 0x7fbe10067400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe10136d80 0x7fbe10061200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbe101398e0 0x7fbe10139d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52720/0 (socket says 172.21.15.31:52720) 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101369a0 0x7fbe10067400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34820/0 (socket says 172.21.15.31:34820) 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe10136d80 0x7fbe10061200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42054/0 (socket says 172.21.15.31:42054) 2024-04-18T10:36:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0ffff700 1 -- 172.21.15.31:0/4122973258 learned_addr learned my addr 172.21.15.31:0/4122973258 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0ffff700 1 -- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101369a0 msgr2=0x7fbe10067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0ffff700 1 --2- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101369a0 0x7fbe10067400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0ffff700 1 -- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe10136d80 msgr2=0x7fbe10061200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0ffff700 1 --2- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe10136d80 0x7fbe10061200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0ffff700 1 -- 172.21.15.31:0/4122973258 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe101367a0 con 0x7fbe101398e0 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0effd700 1 --2- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe10136d80 0x7fbe10061200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0ffff700 1 --2- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe101398e0 0x7fbe10139d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fbe080032f0 tx=0x7fbe08009290).ready entity=mon.0 client_cookie=d315ce6facf423bd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0e7fc700 1 -- 172.21.15.31:0/4122973258 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0800b6c0 con 0x7fbe101398e0 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0e7fc700 1 -- 172.21.15.31:0/4122973258 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0800b820 con 0x7fbe101398e0 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.015+0000 7fbe0e7fc700 1 -- 172.21.15.31:0/4122973258 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0800b990 con 0x7fbe101398e0 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.016+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe101398e0 msgr2=0x7fbe10139d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.016+0000 7fbe15dd2700 1 --2- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe101398e0 0x7fbe10139d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fbe080032f0 tx=0x7fbe08009290).stop 2024-04-18T10:36:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.016+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4122973258 shutdown_connections 2024-04-18T10:36:56.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.016+0000 7fbe15dd2700 1 --2- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe101398e0 0x7fbe10139d90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.016+0000 7fbe15dd2700 1 --2- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101369a0 0x7fbe10067400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.016+0000 7fbe15dd2700 1 --2- 172.21.15.31:0/4122973258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe10136d80 0x7fbe10061200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.016+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4122973258 >> 172.21.15.31:0/4122973258 conn(0x7fbe1006c0c0 msgr2=0x7fbe1006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:56.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.016+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4122973258 shutdown_connections 2024-04-18T10:36:56.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.016+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4122973258 wait complete. 2024-04-18T10:36:56.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.017+0000 7fbe15dd2700 1 Processor -- start 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.017+0000 7fbe15dd2700 1 -- start start 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe15dd2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe101369a0 0x7fbe10093a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe15dd2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe10136d80 0x7fbe101492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe15dd2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101398e0 0x7fbe101497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe15dd2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10092900 con 0x7fbe10136d80 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe15dd2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10094e60 con 0x7fbe101369a0 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe15dd2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe10094bf0 con 0x7fbe101398e0 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe10136d80 0x7fbe101492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe10136d80 0x7fbe101492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52728/0 (socket says 172.21.15.31:52728) 2024-04-18T10:36:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101398e0 0x7fbe101497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0effd700 1 -- 172.21.15.31:0/4129419289 learned_addr learned my addr 172.21.15.31:0/4129419289 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0f7fe700 1 --2- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe101369a0 0x7fbe10093a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0f7fe700 1 -- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101398e0 msgr2=0x7fbe101497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0f7fe700 1 --2- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101398e0 0x7fbe101497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0f7fe700 1 -- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe10136d80 msgr2=0x7fbe101492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0f7fe700 1 --2- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe10136d80 0x7fbe101492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0f7fe700 1 -- 172.21.15.31:0/4129419289 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0000b180 con 0x7fbe101369a0 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0ffff700 1 --2- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101398e0 0x7fbe101497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0f7fe700 1 --2- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe101369a0 0x7fbe10093a70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fbe10094d80 tx=0x7fbe04006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0cff9700 1 -- 172.21.15.31:0/4129419289 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe04010780 con 0x7fbe101369a0 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe0cff9700 1 -- 172.21.15.31:0/4129419289 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe040108e0 con 0x7fbe101369a0 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.018+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe08009530 con 0x7fbe101369a0 2024-04-18T10:36:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.019+0000 7fbe0cff9700 1 -- 172.21.15.31:0/4129419289 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe04010c40 con 0x7fbe101369a0 2024-04-18T10:36:56.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.019+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe10149cb0 con 0x7fbe101369a0 2024-04-18T10:36:56.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.019+0000 7fbe0cff9700 1 -- 172.21.15.31:0/4129419289 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbe0401c460 con 0x7fbe101369a0 2024-04-18T10:36:56.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.020+0000 7fbe0cff9700 1 -- 172.21.15.31:0/4129419289 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbe0404ab80 con 0x7fbe101369a0 2024-04-18T10:36:56.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.020+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe10137160 con 0x7fbe101369a0 2024-04-18T10:36:56.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.023+0000 7fbe0cff9700 1 -- 172.21.15.31:0/4129419289 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbe0402f870 con 0x7fbe101369a0 2024-04-18T10:36:56.071 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2024-04-18T10:36:56.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.177+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe10137e70 con 0x7fbe101369a0 2024-04-18T10:36:56.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.177+0000 7fbe0cff9700 1 -- 172.21.15.31:0/4129419289 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2019 (secure 0 0 0) 0x7fbe04033000 con 0x7fbe101369a0 2024-04-18T10:36:56.178 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:36:56.178 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:56.046578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14141},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:36:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 >> v1:172.21.15.31:6816/39551 conn(0x7fbdf0038da0 legacy=0x7fbdf003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe101369a0 msgr2=0x7fbe10093a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 --2- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe101369a0 0x7fbe10093a70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fbe10094d80 tx=0x7fbe04006df0).stop 2024-04-18T10:36:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 shutdown_connections 2024-04-18T10:36:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 --2- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbe101398e0 0x7fbe101497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 --2- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbe101369a0 0x7fbe10093a70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 --2- 172.21.15.31:0/4129419289 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe10136d80 0x7fbe101492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 >> 172.21.15.31:0/4129419289 conn(0x7fbe1006c0c0 msgr2=0x7fbe1005fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 shutdown_connections 2024-04-18T10:36:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.178+0000 7fbe15dd2700 1 -- 172.21.15.31:0/4129419289 wait complete. 2024-04-18T10:36:56.180 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 11 2024-04-18T10:36:56.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:56.046578+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14141}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:36:56.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-18T10:36:56.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-18T10:36:56.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa7dedd700 1 Processor -- start 2024-04-18T10:36:56.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa7dedd700 1 -- start start 2024-04-18T10:36:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa7dedd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa7805bb30 0x7faa78063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa7dedd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa78062400 0x7faa78140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa7dedd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa78062b80 con 0x7faa78061fe0 2024-04-18T10:36:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa7dedd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa78062e60 con 0x7faa78062400 2024-04-18T10:36:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa7dedd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa78139a40 con 0x7faa7805bb30 2024-04-18T10:36:56.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa7805bb30 0x7faa78063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa77fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faa78062400 0x7faa78140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa7805bb30 0x7faa78063360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34838/0 (socket says 172.21.15.31:34838) 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa777fe700 1 -- 172.21.15.31:0/4205637403 learned_addr learned my addr 172.21.15.31:0/4205637403 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.603+0000 7faa76ffd700 1 --1- 172.21.15.31:0/4205637403 >> v1:172.21.15.31:6789/0 conn(0x7faa78061fe0 0x7faa78139fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41700/0 (socket says 172.21.15.31:41700) 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa777fe700 1 -- 172.21.15.31:0/4205637403 >> v2:172.21.15.31:3300/0 conn(0x7faa78062400 msgr2=0x7faa78140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa777fe700 1 --2- 172.21.15.31:0/4205637403 >> v2:172.21.15.31:3300/0 conn(0x7faa78062400 0x7faa78140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa777fe700 1 -- 172.21.15.31:0/4205637403 >> v1:172.21.15.31:6789/0 conn(0x7faa78061fe0 legacy=0x7faa78139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa777fe700 1 -- 172.21.15.31:0/4205637403 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78139d00 con 0x7faa7805bb30 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa77fff700 1 --2- 172.21.15.31:0/4205637403 >> v2:172.21.15.31:3300/0 conn(0x7faa78062400 0x7faa78140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa777fe700 1 --2- 172.21.15.31:0/4205637403 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa7805bb30 0x7faa78063360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7faa68002f70 tx=0x7faa68006eb0).ready entity=mon.2 client_cookie=a58fbef46a470731 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa767fc700 1 -- 172.21.15.31:0/4205637403 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6800d570 con 0x7faa7805bb30 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa767fc700 1 -- 172.21.15.31:0/4205637403 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa68000e90 con 0x7faa7805bb30 2024-04-18T10:36:56.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa767fc700 1 -- 172.21.15.31:0/4205637403 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6800d900 con 0x7faa7805bb30 2024-04-18T10:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa7dedd700 1 -- 172.21.15.31:0/4205637403 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa7805bb30 msgr2=0x7faa78063360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa7dedd700 1 --2- 172.21.15.31:0/4205637403 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa7805bb30 0x7faa78063360 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7faa68002f70 tx=0x7faa68006eb0).stop 2024-04-18T10:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.604+0000 7faa7dedd700 1 -- 172.21.15.31:0/4205637403 shutdown_connections 2024-04-18T10:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.605+0000 7faa7dedd700 1 --2- 172.21.15.31:0/4205637403 >> v2:172.21.15.31:3300/0 conn(0x7faa78062400 0x7faa78140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.605+0000 7faa7dedd700 1 --2- 172.21.15.31:0/4205637403 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa7805bb30 0x7faa78063360 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.605+0000 7faa7dedd700 1 -- 172.21.15.31:0/4205637403 >> 172.21.15.31:0/4205637403 conn(0x7faa7806c0c0 msgr2=0x7faa7806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.605+0000 7faa7dedd700 1 -- 172.21.15.31:0/4205637403 shutdown_connections 2024-04-18T10:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.605+0000 7faa7dedd700 1 -- 172.21.15.31:0/4205637403 wait complete. 2024-04-18T10:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.605+0000 7faa7dedd700 1 Processor -- start 2024-04-18T10:36:56.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa7dedd700 1 -- start start 2024-04-18T10:36:56.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa7dedd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7805bb30 0x7faa78146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa7dedd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa78061fe0 0x7faa780983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa7dedd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa78146a00 0x7faa780988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa7dedd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa78096660 con 0x7faa7805bb30 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa7dedd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780936f0 con 0x7faa78061fe0 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa7dedd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa78096ba0 con 0x7faa78146a00 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7805bb30 0x7faa78146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa76ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa78061fe0 0x7faa780983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7805bb30 0x7faa78146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52754/0 (socket says 172.21.15.31:52754) 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa76ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa78061fe0 0x7faa780983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42078/0 (socket says 172.21.15.31:42078) 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa777fe700 1 -- 172.21.15.31:0/1422668916 learned_addr learned my addr 172.21.15.31:0/1422668916 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.606+0000 7faa77fff700 1 --2- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa78146a00 0x7faa780988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa76ffd700 1 -- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa78146a00 msgr2=0x7faa780988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa76ffd700 1 --2- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa78146a00 0x7faa780988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa76ffd700 1 -- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7805bb30 msgr2=0x7faa78146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa76ffd700 1 --2- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7805bb30 0x7faa78146510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa76ffd700 1 -- 172.21.15.31:0/1422668916 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70009470 con 0x7faa78061fe0 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa777fe700 1 --2- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7805bb30 0x7faa78146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa76ffd700 1 --2- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa78061fe0 0x7faa780983c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7faa78145dc0 tx=0x7faa6c007b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa74ff9700 1 -- 172.21.15.31:0/1422668916 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c0070d0 con 0x7faa78061fe0 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa74ff9700 1 -- 172.21.15.31:0/1422668916 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c007230 con 0x7faa78061fe0 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa7dedd700 1 -- 172.21.15.31:0/1422668916 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6800b1e0 con 0x7faa78061fe0 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa74ff9700 1 -- 172.21.15.31:0/1422668916 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c005550 con 0x7faa78061fe0 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.607+0000 7faa7dedd700 1 -- 172.21.15.31:0/1422668916 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa78093cf0 con 0x7faa78061fe0 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.608+0000 7faa74ff9700 1 -- 172.21.15.31:0/1422668916 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7faa6c01a070 con 0x7faa78061fe0 2024-04-18T10:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.608+0000 7faa74ff9700 1 -- 172.21.15.31:0/1422668916 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7faa6c049a80 con 0x7faa78061fe0 2024-04-18T10:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.611+0000 7faa8f964b80 1 Processor -- start 2024-04-18T10:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.611+0000 7faa8f964b80 1 -- start start 2024-04-18T10:36:56.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34f9da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa5b0 0x55cd34faa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faf590 0x55cd34fafa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd34f4ba10 con 0x55cd34faf590 2024-04-18T10:36:56.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd34ef0e10 con 0x55cd34faa5b0 2024-04-18T10:36:56.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55cd34ec18b0 con 0x55cd34faa1d0 2024-04-18T10:36:56.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34f9da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34f9da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34856/0 (socket says 172.21.15.31:34856) 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa77fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faf590 0x55cd34fafa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa777fe700 1 -- 172.21.15.31:0/760939478 learned_addr learned my addr 172.21.15.31:0/760939478 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.612+0000 7faa76ffd700 1 --2- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa5b0 0x55cd34faa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa77fff700 1 -- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 msgr2=0x55cd34f9da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa77fff700 1 --2- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34f9da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa77fff700 1 -- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa5b0 msgr2=0x55cd34faa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa77fff700 1 --2- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa5b0 0x55cd34faa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa77fff700 1 -- 172.21.15.31:0/760939478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd34f57e20 con 0x55cd34faf590 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa777fe700 1 --2- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34f9da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa77fff700 1 --2- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faf590 0x55cd34fafa10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7faa7000b000 tx=0x7faa700091d0).ready entity=mon.0 client_cookie=bc5c8e49cf93cdcb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa7dedd700 1 -- 172.21.15.31:0/760939478 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa70011c70 con 0x55cd34faf590 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa7dedd700 1 -- 172.21.15.31:0/760939478 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa70011dd0 con 0x55cd34faf590 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa7dedd700 1 -- 172.21.15.31:0/760939478 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa70014630 con 0x55cd34faf590 2024-04-18T10:36:56.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa8f964b80 1 -- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faf590 msgr2=0x55cd34fafa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.613+0000 7faa8f964b80 1 --2- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faf590 0x55cd34fafa10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7faa7000b000 tx=0x7faa700091d0).stop 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.614+0000 7faa8f964b80 1 -- 172.21.15.31:0/760939478 shutdown_connections 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.614+0000 7faa8f964b80 1 --2- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34f9da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.614+0000 7faa8f964b80 1 --2- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faf590 0x55cd34fafa10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.614+0000 7faa8f964b80 1 --2- 172.21.15.31:0/760939478 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa5b0 0x55cd34faa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.614+0000 7faa8f964b80 1 -- 172.21.15.31:0/760939478 >> 172.21.15.31:0/760939478 conn(0x55cd34f49970 msgr2=0x55cd34ea3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.614+0000 7faa8f964b80 1 -- 172.21.15.31:0/760939478 shutdown_connections 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.614+0000 7faa8f964b80 1 -- 172.21.15.31:0/760939478 wait complete. 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.614+0000 7faa8f964b80 1 -- start start 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.614+0000 7faa8f964b80 1 Processor -- start 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34fa29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34fb5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd34ed5180 con 0x55cd34faa5b0 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd34eb57f0 con 0x55cd34faa1d0 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55cd34ea5710 con 0x55cd34faf590 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa8f964b80 10 client.0 ll_register_callbacks cb 0x55cd34eca570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa76ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa77fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34fb5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa76ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52774/0 (socket says 172.21.15.31:52774) 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa76ffd700 1 -- 172.21.15.31:0/4008570055 learned_addr learned my addr 172.21.15.31:0/4008570055 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa77fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34fb5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34860/0 (socket says 172.21.15.31:34860) 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa777fe700 1 --2- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34fa29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa76ffd700 1 -- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 msgr2=0x55cd34fb5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa76ffd700 1 --2- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34fb5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa76ffd700 1 -- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 msgr2=0x55cd34fa29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa76ffd700 1 --2- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34fa29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa76ffd700 1 -- 172.21.15.31:0/4008570055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa78139d00 con 0x55cd34faa5b0 2024-04-18T10:36:56.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa777fe700 1 --2- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34fa29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa76ffd700 1 --2- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb5530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x55cd34f9f9c0 tx=0x7faa6c013000).ready entity=mon.0 client_cookie=9f23d16d54877db server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa567fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa567fc700 1 -- 172.21.15.31:0/4008570055 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c02cb60 con 0x55cd34faa5b0 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa567fc700 1 -- 172.21.15.31:0/4008570055 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7faa6c02ccc0 con 0x55cd34faa5b0 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.615+0000 7faa8f964b80 1 -- 172.21.15.31:0/4008570055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd34e4c0c0 con 0x55cd34faa5b0 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa567fc700 1 -- 172.21.15.31:0/4008570055 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa6c02ce80 con 0x55cd34faa5b0 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa8f964b80 10 client.4926 fetch_fsmap learned FSMap version 11 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa8f964b80 1 -- 172.21.15.31:0/4008570055 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x7faa70009b30 con 0x55cd34faa5b0 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa567fc700 1 -- 172.21.15.31:0/4008570055 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd34e4c0c0 con 0x55cd34faa5b0 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa567fc700 1 -- 172.21.15.31:0/4008570055 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 11) v1 ==== 1181+0+0 (secure 0 0 0) 0x7faa6c0280d0 con 0x55cd34faa5b0 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa8f964b80 10 client.4926 fetch_fsmap finished waiting for FSMap version 11 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa8f964b80 10 client.4926 resolve_mds: resolved ID 'c' to GID 14141 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa8f964b80 20 client.4926 populate_metadata read hostname 'smithi031' 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa8f964b80 4 client.4926 mds_command: new command op to 14141 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-18T10:36:56.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa8f964b80 1 -- 172.21.15.31:0/4008570055 --> v1:172.21.15.31:6819/3321563080 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd34ecb230 con 0x55cd34fa0e50 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.616+0000 7faa567fc700 10 client.4926 ms_handle_connect on v1:172.21.15.31:6819/3321563080 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa567fc700 1 -- 172.21.15.31:0/4008570055 <== mds.0 v1:172.21.15.31:6819/3321563080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55cd34ecb230 con 0x55cd34fa0e50 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa567fc700 10 client.4926 handle_command_reply: tid=0 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 client.4926 shutdown 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 -- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 msgr2=0x55cd34fb5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 --2- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb5530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x55cd34f9f9c0 tx=0x7faa6c013000).stop 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 -- 172.21.15.31:0/4008570055 shutdown_connections 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 --2- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34fb5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 --2- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34fa29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 --2- 172.21.15.31:0/4008570055 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb5530 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa567fc700 0 client.4926 ms_handle_reset on v1:172.21.15.31:6819/3321563080 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 -- 172.21.15.31:0/4008570055 >> 172.21.15.31:0/4008570055 conn(0x55cd34f49970 msgr2=0x55cd34e9ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 -- 172.21.15.31:0/4008570055 shutdown_connections 2024-04-18T10:36:56.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 1 -- 172.21.15.31:0/4008570055 wait complete. 2024-04-18T10:36:56.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.617+0000 7faa8f964b80 20 client.4926 trim_cache size 0 max 16384 2024-04-18T10:36:56.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.633+0000 7faa8f964b80 1 Processor -- start 2024-04-18T10:36:56.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa8f964b80 1 -- start start 2024-04-18T10:36:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34f7dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34f7c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34e9ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd34f7e1d0 con 0x55cd34faa5b0 2024-04-18T10:36:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd34fb2ec0 con 0x55cd34faa1d0 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55cd34f9cda0 con 0x55cd34faf590 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34f7dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa76ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34f7c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34f7dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42108/0 (socket says 172.21.15.31:42108) 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa777fe700 1 -- 172.21.15.31:0/4042365675 learned_addr learned my addr 172.21.15.31:0/4042365675 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa77fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34e9ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa777fe700 1 -- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 msgr2=0x55cd34e9ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa777fe700 1 --2- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34e9ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa777fe700 1 -- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 msgr2=0x55cd34f7c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa777fe700 1 --2- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34f7c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa777fe700 1 -- 172.21.15.31:0/4042365675 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd34e9a600 con 0x55cd34faa1d0 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa76ffd700 1 --2- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34f7c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.634+0000 7faa77fff700 1 --2- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34e9ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa777fe700 1 --2- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34f7dce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7faa68022000 tx=0x7faa68027280).ready entity=mon.1 client_cookie=1b168818dc287faa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa5cff9700 1 -- 172.21.15.31:0/4042365675 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa68027070 con 0x55cd34faa1d0 2024-04-18T10:36:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa5cff9700 1 -- 172.21.15.31:0/4042365675 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa68006a20 con 0x55cd34faa1d0 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa5cff9700 1 -- 172.21.15.31:0/4042365675 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6802a630 con 0x55cd34faa1d0 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa8f964b80 1 -- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 msgr2=0x55cd34f7dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa8f964b80 1 --2- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34f7dce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7faa68022000 tx=0x7faa68027280).stop 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa8f964b80 1 -- 172.21.15.31:0/4042365675 shutdown_connections 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa8f964b80 1 --2- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faf590 0x55cd34e9ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa8f964b80 1 --2- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faa1d0 0x55cd34f7dce0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa8f964b80 1 --2- 172.21.15.31:0/4042365675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34f7c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa8f964b80 1 -- 172.21.15.31:0/4042365675 >> 172.21.15.31:0/4042365675 conn(0x55cd34f49970 msgr2=0x55cd34fa9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa8f964b80 1 -- 172.21.15.31:0/4042365675 shutdown_connections 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.635+0000 7faa8f964b80 1 -- 172.21.15.31:0/4042365675 wait complete. 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.636+0000 7faa8f964b80 1 -- start start 2024-04-18T10:36:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.636+0000 7faa8f964b80 1 Processor -- start 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34fa5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faf590 0x55cd34fb1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd34fa6c60 con 0x55cd34faa5b0 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd34f9ff40 con 0x55cd34faf590 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55cd34fb9440 con 0x55cd34faa1d0 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 10 client.0 ll_register_callbacks cb 0x55cd34fa3240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34fa5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa76ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa777fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34fa5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:34876/0 (socket says 172.21.15.31:34876) 2024-04-18T10:36:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa777fe700 1 -- 172.21.15.31:0/618518512 learned_addr learned my addr 172.21.15.31:0/618518512 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa77fff700 1 --2- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faf590 0x55cd34fb1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa76ffd700 1 -- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 msgr2=0x55cd34fa5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa76ffd700 1 --2- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34fa5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa76ffd700 1 -- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faf590 msgr2=0x55cd34fb1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa76ffd700 1 --2- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faf590 0x55cd34fb1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa76ffd700 1 -- 172.21.15.31:0/618518512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa70009b30 con 0x55cd34faa5b0 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa777fe700 1 --2- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34fa5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa76ffd700 1 --2- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb1980 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x55cd34fa67e0 tx=0x7faa6c01f070).ready entity=mon.0 client_cookie=1133dc9c02e1ec64 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa577fe700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa577fe700 1 -- 172.21.15.31:0/618518512 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6c037070 con 0x55cd34faa5b0 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa577fe700 1 -- 172.21.15.31:0/618518512 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7faa6c0280d0 con 0x55cd34faa5b0 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 1 -- 172.21.15.31:0/618518512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd34fa1c40 con 0x55cd34faa5b0 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa577fe700 1 -- 172.21.15.31:0/618518512 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa6c0315a0 con 0x55cd34faa5b0 2024-04-18T10:36:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 10 client.4932 fetch_fsmap learned FSMap version 11 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.637+0000 7faa8f964b80 1 -- 172.21.15.31:0/618518512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0x55cd34f57e20 con 0x55cd34faa5b0 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa577fe700 1 -- 172.21.15.31:0/618518512 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd34fa1c40 con 0x55cd34faa5b0 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa577fe700 1 -- 172.21.15.31:0/618518512 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 11) v1 ==== 1181+0+0 (secure 0 0 0) 0x7faa6c02c630 con 0x55cd34faa5b0 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa8f964b80 10 client.4932 fetch_fsmap finished waiting for FSMap version 11 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa8f964b80 10 client.4932 resolve_mds: resolved ID 'c' to GID 14141 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa8f964b80 20 client.4932 populate_metadata read hostname 'smithi031' 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa8f964b80 4 client.4932 mds_command: new command op to 14141 tid=0[{"prefix": "status"}] 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa8f964b80 1 -- 172.21.15.31:0/618518512 --> v1:172.21.15.31:6819/3321563080 -- command(tid 0: {"prefix": "status"}) v1 -- 0x7faa70011dd0 con 0x55cd34ea3b30 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa577fe700 10 client.4932 ms_handle_connect on v1:172.21.15.31:6819/3321563080 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa577fe700 1 -- 172.21.15.31:0/618518512 <== mds.0 v1:172.21.15.31:6819/3321563080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+307 (unknown 0 0 511295495) 0x7faa70011dd0 con 0x55cd34ea3b30 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa577fe700 10 client.4932 handle_command_reply: tid=0 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa8f964b80 1 client.4932 shutdown 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa8f964b80 1 -- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 msgr2=0x55cd34fb1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.638+0000 7faa8f964b80 1 --2- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb1980 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x55cd34fa67e0 tx=0x7faa6c01f070).stop 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa8f964b80 1 -- 172.21.15.31:0/618518512 shutdown_connections 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa8f964b80 1 --2- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55cd34faa1d0 0x55cd34fa5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa8f964b80 1 --2- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55cd34faf590 0x55cd34fb1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa8f964b80 1 --2- 172.21.15.31:0/618518512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cd34faa5b0 0x55cd34fb1980 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa577fe700 0 client.4932 ms_handle_reset on v1:172.21.15.31:6819/3321563080 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa8f964b80 1 -- 172.21.15.31:0/618518512 >> 172.21.15.31:0/618518512 conn(0x55cd34f49970 msgr2=0x55cd34f9d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa8f964b80 1 -- 172.21.15.31:0/618518512 shutdown_connections 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa8f964b80 1 -- 172.21.15.31:0/618518512 wait complete. 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa8f964b80 20 client.4932 trim_cache size 0 max 16384 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:36:56.645 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "2dc05854-5716-4ea6-add8-fd949f4dd05c", 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 14141, 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 47.650793448000002, 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 11, 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 20, 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 20, 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 56.002120546999997 2024-04-18T10:36:56.646 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:36:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 -- 172.21.15.31:0/1422668916 >> v1:172.21.15.31:6816/39551 conn(0x7faa58038ec0 legacy=0x7faa5803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 -- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa78061fe0 msgr2=0x7faa780983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:36:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 --2- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa78061fe0 0x7faa780983c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7faa78145dc0 tx=0x7faa6c007b80).stop 2024-04-18T10:36:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 -- 172.21.15.31:0/1422668916 shutdown_connections 2024-04-18T10:36:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 --2- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faa78146a00 0x7faa780988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 --2- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa7805bb30 0x7faa78146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 --2- 172.21.15.31:0/1422668916 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faa78061fe0 0x7faa780983c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-18T10:36:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 -- 172.21.15.31:0/1422668916 >> 172.21.15.31:0/1422668916 conn(0x7faa7806c0c0 msgr2=0x7faa780a7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:36:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 -- 172.21.15.31:0/1422668916 shutdown_connections 2024-04-18T10:36:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:36:56.639+0000 7faa7dedd700 1 -- 172.21.15.31:0/1422668916 wait complete. 2024-04-18T10:36:56.650 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:36:56.660 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2024-04-18T10:36:56.660 INFO:teuthology.run_tasks:Running task install.upgrade... 2024-04-18T10:36:56.671 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'quincy'}} overrides {'flavor': 'default', 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf'} 2024-04-18T10:36:56.671 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2024-04-18T10:36:56.671 INFO:teuthology.task.install:remote ubuntu@smithi031.front.sepia.ceph.com config {'branch': 'quincy', 'flavor': 'default'} 2024-04-18T10:36:56.671 INFO:teuthology.task.install:extra packages: [] 2024-04-18T10:36:56.677 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-18T10:36:56.677 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2024-04-18T10:36:56.677 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2024-04-18T10:36:56.700 INFO:teuthology.orchestra.run.smithi031.stdout:15.2.17-0.el8 2024-04-18T10:36:56.701 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.17-0.el8 2024-04-18T10:36:56.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-18T10:36:57.011 INFO:teuthology.task.install:Ceph rpm upgrade from 15.2.17-0.el8 to 17.2.7-872.ge85153d5 2024-04-18T10:36:57.011 INFO:teuthology.task.install.rpm:Host smithi031 is: centos 8 x86_64 2024-04-18T10:36:57.011 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-18T10:36:57.318 INFO:teuthology.task.install.rpm:Repo base URL: https://4.chacra.ceph.com/r/ceph/quincy/e85153d553ddc8420b6b154a57813a504f51c01a/centos/8/flavors/default/ 2024-04-18T10:36:57.318 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-04-18T10:36:57.457 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/e85153d553ddc8420b6b154a57813a504f51c01a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/e85153d553ddc8420b6b154a57813a504f51c01a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/e85153d553ddc8420b6b154a57813a504f51c01a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-18T10:36:57.457 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-04-18T10:36:57.457 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-18T10:36:57.488 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-18T10:36:57.557 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-18T10:36:57.630 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-18T10:36:57.689 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2024-04-18T10:36:57.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2024-04-18T10:36:57.972 INFO:teuthology.orchestra.run.smithi031.stdout:71 files removed 2024-04-18T10:36:58.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2024-04-18T10:37:00.143 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 46 kB/s | 78 kB 00:01 2024-04-18T10:37:00.494 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-04-18T10:37:00.886 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 4.0 kB/s | 1.4 kB 00:00 2024-04-18T10:37:01.940 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - AppStream 27 MB/s | 28 MB 00:01 2024-04-18T10:37:07.978 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 10 MB 00:00 2024-04-18T10:37:09.862 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras 92 kB/s | 18 kB 00:00 2024-04-18T10:37:10.347 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 7.7 kB 00:00 2024-04-18T10:37:11.073 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 8 - PowerTools 7.9 MB/s | 5.0 MB 00:00 2024-04-18T10:37:12.216 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-18T10:37:13.203 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-04-18T10:37:17.434 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 136 kB/s | 24 kB 00:00 2024-04-18T10:37:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:Package cephadm available, but not installed. 2024-04-18T10:37:21.411 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: cephadm 2024-04-18T10:37:21.416 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-mgr-dashboard available, but not installed. 2024-04-18T10:37:21.416 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-mgr-dashboard 2024-04-18T10:37:21.417 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2024-04-18T10:37:21.417 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-04-18T10:37:21.417 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-mgr-rook available, but not installed. 2024-04-18T10:37:21.418 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-mgr-rook 2024-04-18T10:37:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-mgr-cephadm available, but not installed. 2024-04-18T10:37:21.418 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-mgr-cephadm 2024-04-18T10:37:21.421 INFO:teuthology.orchestra.run.smithi031.stderr:Package ceph-volume available, but not installed. 2024-04-18T10:37:21.421 INFO:teuthology.orchestra.run.smithi031.stdout:No match for argument: ceph-volume 2024-04-18T10:37:21.533 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:17.2.7-872.ge85153d5.el8 ceph 6.4 k 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:17.2.7-872.ge85153d5.el8 ceph 5.3 M 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:17.2.7-872.ge85153d5.el8 ceph 24 M 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:17.2.7-872.ge85153d5.el8 ceph 876 k 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout: x86_64 2:17.2.7-872.ge85153d5.el8 ceph 162 k 2024-04-18T10:37:21.538 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:17.2.7-872.ge85153d5.el8 ceph 2.3 M 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:17.2.7-872.ge85153d5.el8 ceph 1.6 M 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:17.2.7-872.ge85153d5.el8 ceph-noarch 240 k 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:17.2.7-872.ge85153d5.el8 ceph 4.0 M 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:17.2.7-872.ge85153d5.el8 ceph 17 M 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:17.2.7-872.ge85153d5.el8 ceph 17 M 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:17.2.7-872.ge85153d5.el8 ceph 24 k 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:17.2.7-872.ge85153d5.el8 ceph 53 M 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:17.2.7-872.ge85153d5.el8 ceph 25 k 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 798 k 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:17.2.7-872.ge85153d5.el8 ceph 130 k 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 3.5 M 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 505 k 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 3.6 M 2024-04-18T10:37:21.539 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 5.6 M 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:17.2.7-872.ge85153d5.el8 ceph 45 k 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:17.2.7-872.ge85153d5.el8 ceph 117 k 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:17.2.7-872.ge85153d5.el8 ceph 190 k 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:17.2.7-872.ge85153d5.el8 ceph 370 k 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:17.2.7-872.ge85153d5.el8 ceph 358 k 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:17.2.7-872.ge85153d5.el8 ceph 106 k 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:17.2.7-872.ge85153d5.el8 ceph 90 k 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:17.2.7-872.ge85153d5.el8 ceph 3.5 M 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:17.2.7-872.ge85153d5.el8 ceph 175 k 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:17.2.7-872.ge85153d5.el8 ceph 179 k 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-18T10:37:21.540 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:37:21.541 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-04-18T10:37:21.541 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-04-18T10:37:21.541 INFO:teuthology.orchestra.run.smithi031.stdout:Install 2 Packages 2024-04-18T10:37:21.541 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 29 Packages 2024-04-18T10:37:21.541 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:37:21.541 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 145 M 2024-04-18T10:37:21.541 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-04-18T10:37:22.044 INFO:teuthology.orchestra.run.smithi031.stdout:(1/31): ceph-17.2.7-872.ge85153d5.el8.x86_64.rp 30 kB/s | 6.4 kB 00:00 2024-04-18T10:37:22.303 INFO:teuthology.orchestra.run.smithi031.stdout:(2/31): thrift-0.13.0-2.el8.x86_64.rpm 3.7 MB/s | 1.7 MB 00:00 2024-04-18T10:37:22.403 INFO:teuthology.orchestra.run.smithi031.stdout:(3/31): libcephsqlite-17.2.7-872.ge85153d5.el8. 311 kB/s | 179 kB 00:00 2024-04-18T10:37:23.153 INFO:teuthology.orchestra.run.smithi031.stdout:(4/31): ceph-fuse-17.2.7-872.ge85153d5.el8.x86_ 1.1 MB/s | 876 kB 00:00 2024-04-18T10:37:23.270 INFO:teuthology.orchestra.run.smithi031.stdout:(5/31): ceph-immutable-object-cache-17.2.7-872. 1.4 MB/s | 162 kB 00:00 2024-04-18T10:37:24.137 INFO:teuthology.orchestra.run.smithi031.stdout:(6/31): ceph-base-17.2.7-872.ge85153d5.el8.x86_ 2.5 MB/s | 5.3 MB 00:02 2024-04-18T10:37:24.204 INFO:teuthology.orchestra.run.smithi031.stdout:(7/31): ceph-mds-17.2.7-872.ge85153d5.el8.x86_6 2.5 MB/s | 2.3 MB 00:00 2024-04-18T10:37:24.513 INFO:teuthology.orchestra.run.smithi031.stdout:(8/31): ceph-mgr-17.2.7-872.ge85153d5.el8.x86_6 4.2 MB/s | 1.6 MB 00:00 2024-04-18T10:37:25.271 INFO:teuthology.orchestra.run.smithi031.stdout:(9/31): ceph-mon-17.2.7-872.ge85153d5.el8.x86_6 3.8 MB/s | 4.0 MB 00:01 2024-04-18T10:37:26.346 INFO:teuthology.orchestra.run.smithi031.stdout:(10/31): ceph-osd-17.2.7-872.ge85153d5.el8.x86_ 9.4 MB/s | 17 MB 00:01 2024-04-18T10:37:26.430 INFO:teuthology.orchestra.run.smithi031.stdout:(11/31): ceph-selinux-17.2.7-872.ge85153d5.el8. 292 kB/s | 24 kB 00:00 2024-04-18T10:37:26.672 INFO:teuthology.orchestra.run.smithi031.stdout:(12/31): ceph-common-17.2.7-872.ge85153d5.el8.x 5.4 MB/s | 24 MB 00:04 2024-04-18T10:37:26.739 INFO:teuthology.orchestra.run.smithi031.stdout:(13/31): libcephfs-devel-17.2.7-872.ge85153d5.e 374 kB/s | 25 kB 00:00 2024-04-18T10:37:26.973 INFO:teuthology.orchestra.run.smithi031.stdout:(14/31): libcephfs2-17.2.7-872.ge85153d5.el8.x8 3.3 MB/s | 798 kB 00:00 2024-04-18T10:37:27.073 INFO:teuthology.orchestra.run.smithi031.stdout:(15/31): librados-devel-17.2.7-872.ge85153d5.el 1.3 MB/s | 130 kB 00:00 2024-04-18T10:37:28.223 INFO:teuthology.orchestra.run.smithi031.stdout:(16/31): librados2-17.2.7-872.ge85153d5.el8.x86 3.0 MB/s | 3.5 MB 00:01 2024-04-18T10:37:28.340 INFO:teuthology.orchestra.run.smithi031.stdout:(17/31): libradosstriper1-17.2.7-872.ge85153d5. 4.2 MB/s | 505 kB 00:00 2024-04-18T10:37:29.049 INFO:teuthology.orchestra.run.smithi031.stdout:(18/31): librbd1-17.2.7-872.ge85153d5.el8.x86_6 5.1 MB/s | 3.6 MB 00:00 2024-04-18T10:37:29.674 INFO:teuthology.orchestra.run.smithi031.stdout:(19/31): ceph-test-17.2.7-872.ge85153d5.el8.x86 16 MB/s | 53 MB 00:03 2024-04-18T10:37:29.733 INFO:teuthology.orchestra.run.smithi031.stdout:(20/31): python3-ceph-argparse-17.2.7-872.ge851 771 kB/s | 45 kB 00:00 2024-04-18T10:37:29.791 INFO:teuthology.orchestra.run.smithi031.stdout:(21/31): python3-ceph-common-17.2.7-872.ge85153 2.0 MB/s | 117 kB 00:00 2024-04-18T10:37:29.867 INFO:teuthology.orchestra.run.smithi031.stdout:(22/31): python3-cephfs-17.2.7-872.ge85153d5.el 2.5 MB/s | 190 kB 00:00 2024-04-18T10:37:29.942 INFO:teuthology.orchestra.run.smithi031.stdout:(23/31): python3-rados-17.2.7-872.ge85153d5.el8 4.8 MB/s | 370 kB 00:00 2024-04-18T10:37:30.232 INFO:teuthology.orchestra.run.smithi031.stdout:(24/31): librgw2-17.2.7-872.ge85153d5.el8.x86_6 4.7 MB/s | 5.6 MB 00:01 2024-04-18T10:37:30.393 INFO:teuthology.orchestra.run.smithi031.stdout:(25/31): ceph-radosgw-17.2.7-872.ge85153d5.el8. 3.3 MB/s | 17 MB 00:05 2024-04-18T10:37:30.418 INFO:teuthology.orchestra.run.smithi031.stdout:(26/31): python3-rgw-17.2.7-872.ge85153d5.el8.x 574 kB/s | 106 kB 00:00 2024-04-18T10:37:30.443 INFO:teuthology.orchestra.run.smithi031.stdout:(27/31): python3-rbd-17.2.7-872.ge85153d5.el8.x 715 kB/s | 358 kB 00:00 2024-04-18T10:37:30.493 INFO:teuthology.orchestra.run.smithi031.stdout:(28/31): rbd-fuse-17.2.7-872.ge85153d5.el8.x86_ 904 kB/s | 90 kB 00:00 2024-04-18T10:37:30.519 INFO:teuthology.orchestra.run.smithi031.stdout:(29/31): rbd-nbd-17.2.7-872.ge85153d5.el8.x86_6 2.3 MB/s | 175 kB 00:00 2024-04-18T10:37:30.602 INFO:teuthology.orchestra.run.smithi031.stdout:(30/31): ceph-mgr-modules-core-17.2.7-872.ge851 2.2 MB/s | 240 kB 00:00 2024-04-18T10:37:30.961 INFO:teuthology.orchestra.run.smithi031.stdout:(31/31): rbd-mirror-17.2.7-872.ge85153d5.el8.x8 6.4 MB/s | 3.5 MB 00:00 2024-04-18T10:37:30.964 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:37:30.964 INFO:teuthology.orchestra.run.smithi031.stdout:Total 15 MB/s | 145 MB 00:09 2024-04-18T10:37:30.965 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-04-18T10:37:31.031 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-04-18T10:37:31.031 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-04-18T10:37:31.733 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-04-18T10:37:31.736 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-04-18T10:37:33.844 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-04-18T10:37:34.202 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:17.2.7-872.ge85153d5.el8.x86_64 1/1 2024-04-18T10:37:34.489 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:17.2.7-872.ge85153d5.el8.x86_64 1/60 2024-04-18T10:37:34.917 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:17.2.7-872.ge85153d5.el8.x86_64 1/60 2024-04-18T10:37:35.097 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:17.2.7-872.ge85153d5.el8.x86_64 2/60 2024-04-18T10:37:35.228 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:17.2.7-872.ge85153d5.el8.x86_64 2/60 2024-04-18T10:37:35.431 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libcephfs2-2:17.2.7-872.ge85153d5.el8.x86_64 3/60 2024-04-18T10:37:35.513 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:17.2.7-872.ge85153d5.el8.x86_64 3/60 2024-04-18T10:37:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : python3-rados-2:17.2.7-872.ge85153d5.el8.x86_64 4/60 2024-04-18T10:37:36.831 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/60 2024-04-18T10:37:37.072 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librgw2-2:17.2.7-872.ge85153d5.el8.x86_64 6/60 2024-04-18T10:37:37.179 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:17.2.7-872.ge85153d5.el8.x86_64 6/60 2024-04-18T10:37:37.347 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:17.2.7-872.ge85153d5.el8.x86_64 7/60 2024-04-18T10:37:37.463 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:17.2.7-872.ge85153d5.el8.x86_64 7/60 2024-04-18T10:37:37.605 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libradosstriper1-2:17.2.7-872.ge85153d5.el8.x86_64 8/60 2024-04-18T10:37:37.663 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:17.2.7-872.ge85153d5.el8.x86_64 8/60 2024-04-18T10:37:37.853 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : python3-ceph-argparse-2:17.2.7-872.ge85153d5.el8.x 9/60 2024-04-18T10:37:38.060 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : python3-cephfs-2:17.2.7-872.ge85153d5.el8.x86_64 10/60 2024-04-18T10:37:38.294 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : python3-rgw-2:17.2.7-872.ge85153d5.el8.x86_64 11/60 2024-04-18T10:37:38.512 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : python3-rbd-2:17.2.7-872.ge85153d5.el8.x86_64 12/60 2024-04-18T10:37:38.795 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados-devel-2:17.2.7-872.ge85153d5.el8.x86_64 13/60 2024-04-18T10:37:39.084 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-mgr-modules-core-2:17.2.7-872.ge85153d5.el8.n 14/60 2024-04-18T10:37:39.222 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : python3-ceph-common-2:17.2.7-872.ge85153d5.el8.x86 15/60 2024-04-18T10:37:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 16/60 2024-04-18T10:37:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 16/60 2024-04-18T10:37:42.686 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 16/60 2024-04-18T10:37:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-base-2:17.2.7-872.ge85153d5.el8.x86_64 17/60 2024-04-18T10:37:43.040 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:17.2.7-872.ge85153d5.el8.x86_64 17/60 2024-04-18T10:37:43.196 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-selinux-2:17.2.7-872.ge85153d5.el8.x86_64 18/60 2024-04-18T10:38:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:17.2.7-872.ge85153d5.el8.x86_64 18/60 2024-04-18T10:38:02.868 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-mds-2:17.2.7-872.ge85153d5.el8.x86_64 19/60 2024-04-18T10:38:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:17.2.7-872.ge85153d5.el8.x86_64 19/60 2024-04-18T10:38:03.287 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-mgr-2:17.2.7-872.ge85153d5.el8.x86_64 20/60 2024-04-18T10:38:03.742 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:17.2.7-872.ge85153d5.el8.x86_64 20/60 2024-04-18T10:38:03.951 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-mon-2:17.2.7-872.ge85153d5.el8.x86_64 21/60 2024-04-18T10:38:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:17.2.7-872.ge85153d5.el8.x86_64 21/60 2024-04-18T10:38:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-osd-2:17.2.7-872.ge85153d5.el8.x86_64 22/60 2024-04-18T10:38:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:17.2.7-872.ge85153d5.el8.x86_64 22/60 2024-04-18T10:38:08.082 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-2:17.2.7-872.ge85153d5.el8.x86_64 23/60 2024-04-18T10:38:08.362 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-radosgw-2:17.2.7-872.ge85153d5.el8.x86_64 24/60 2024-04-18T10:38:08.431 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-872.ge85153d5.el8.x86_64 24/60 2024-04-18T10:38:08.634 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-immutable-object-cache-2:17.2.7-872.ge85153d5 25/60 2024-04-18T10:38:09.062 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-872.ge85153d5 25/60 2024-04-18T10:38:09.259 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : rbd-mirror-2:17.2.7-872.ge85153d5.el8.x86_64 26/60 2024-04-18T10:38:15.125 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:17.2.7-872.ge85153d5.el8.x86_64 26/60 2024-04-18T10:38:15.420 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-test-2:17.2.7-872.ge85153d5.el8.x86_64 27/60 2024-04-18T10:38:15.635 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libcephfs-devel-2:17.2.7-872.ge85153d5.el8.x86_64 28/60 2024-04-18T10:38:15.858 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : rbd-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 29/60 2024-04-18T10:38:16.152 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : rbd-nbd-2:17.2.7-872.ge85153d5.el8.x86_64 30/60 2024-04-18T10:38:16.343 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : ceph-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 31/60 2024-04-18T10:38:16.474 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-2:15.2.17-0.el8.x86_64 32/60 2024-04-18T10:38:16.665 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-test-2:15.2.17-0.el8.x86_64 33/60 2024-04-18T10:38:16.672 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-18T10:38:16.673 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-18T10:38:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-18T10:38:17.059 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : rbd-nbd-2:15.2.17-0.el8.x86_64 35/60 2024-04-18T10:38:17.064 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-18T10:38:17.065 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-18T10:38:17.201 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-18T10:38:17.350 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : rbd-fuse-2:15.2.17-0.el8.x86_64 37/60 2024-04-18T10:38:17.356 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-18T10:38:17.357 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-18T10:38:17.542 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-18T10:38:17.683 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libcephfs-devel-2:15.2.17-0.el8.x86_64 39/60 2024-04-18T10:38:17.833 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados-devel-2:15.2.17-0.el8.x86_64 40/60 2024-04-18T10:38:17.840 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-18T10:38:17.841 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-18T10:38:18.004 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-18T10:38:18.011 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-18T10:38:18.011 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-18T10:38:18.301 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-18T10:38:18.306 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-18T10:38:18.306 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-18T10:38:18.442 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-18T10:38:18.447 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-18T10:38:18.448 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-18T10:38:18.592 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-18T10:38:18.592 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-04-18T10:38:18.743 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-04-18T10:38:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-18T10:38:18.769 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-18T10:38:19.056 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-18T10:38:19.057 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-04-18T10:38:19.276 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-04-18T10:38:19.276 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-04-18T10:38:19.482 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-04-18T10:38:19.631 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : python3-cephfs-2:15.2.17-0.el8.x86_64 49/60 2024-04-18T10:38:19.792 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-04-18T10:38:19.792 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-04-18T10:38:20.034 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-04-18T10:38:20.183 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-04-18T10:38:20.184 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-04-18T10:38:20.417 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-04-18T10:38:20.583 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : python3-rados-2:15.2.17-0.el8.x86_64 54/60 2024-04-18T10:38:20.583 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-04-18T10:38:20.801 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-04-18T10:38:20.924 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-fuse-2:15.2.17-0.el8.x86_64 56/60 2024-04-18T10:38:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 57/60 2024-04-18T10:38:21.203 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : python3-ceph-common-2:15.2.17-0.el8.x86_64 58/60 2024-04-18T10:38:21.377 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 59/60 2024-04-18T10:38:21.377 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-2:15.2.17-0.el8.x86_64 60/60 2024-04-18T10:38:22.172 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 60/60 2024-04-18T10:38:22.172 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:17.2.7-872.ge85153d5.el8.x86_64 1/60 2024-04-18T10:38:22.172 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 2/60 2024-04-18T10:38:22.172 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:17.2.7-872.ge85153d5.el8.x86_64 3/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 4/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:17.2.7-872.ge85153d5.el8.x86_64 5/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 6/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 7/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 8/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 9/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 10/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-872.ge85153d5 11/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 12/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:17.2.7-872.ge85153d5.el8.x86_64 13/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 14/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:17.2.7-872.ge85153d5.el8.x86_64 15/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 16/60 2024-04-18T10:38:22.173 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:17.2.7-872.ge85153d5.el8.x86_64 17/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 18/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:17.2.7-872.ge85153d5.el8.x86_64 19/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 20/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:17.2.7-872.ge85153d5.el8.x86_64 21/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 22/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:17.2.7-872.ge85153d5.el8.x86_64 23/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 24/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:17.2.7-872.ge85153d5.el8.x86_64 25/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 26/60 2024-04-18T10:38:22.174 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:17.2.7-872.ge85153d5.el8.x86_64 27/60 2024-04-18T10:38:22.177 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 28/60 2024-04-18T10:38:22.177 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:17.2.7-872.ge85153d5.el8.x86_64 29/60 2024-04-18T10:38:22.177 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 30/60 2024-04-18T10:38:22.177 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:17.2.7-872.ge85153d5.el8.x86_64 31/60 2024-04-18T10:38:22.177 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 32/60 2024-04-18T10:38:22.177 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:17.2.7-872.ge85153d5.el8.x86_64 33/60 2024-04-18T10:38:22.177 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 34/60 2024-04-18T10:38:22.177 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:17.2.7-872.ge85153d5.el8.x86_64 35/60 2024-04-18T10:38:22.177 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 36/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:17.2.7-872.ge85153d5.el8.x86_64 37/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 38/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:17.2.7-872.ge85153d5.el8.x86_64 39/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 40/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:17.2.7-872.ge85153d5.el8.x 41/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 42/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:17.2.7-872.ge85153d5.el8.x86 43/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 44/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:17.2.7-872.ge85153d5.el8.x86_64 45/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 46/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:17.2.7-872.ge85153d5.el8.x86_64 47/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 48/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:17.2.7-872.ge85153d5.el8.x86_64 49/60 2024-04-18T10:38:22.178 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-04-18T10:38:22.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:17.2.7-872.ge85153d5.el8.x86_64 51/60 2024-04-18T10:38:22.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-04-18T10:38:22.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 53/60 2024-04-18T10:38:22.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 54/60 2024-04-18T10:38:22.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:17.2.7-872.ge85153d5.el8.x86_64 55/60 2024-04-18T10:38:22.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 56/60 2024-04-18T10:38:22.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:17.2.7-872.ge85153d5.el8.x86_64 57/60 2024-04-18T10:38:22.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 58/60 2024-04-18T10:38:22.179 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-872.ge85153d5.el8.n 59/60 2024-04-18T10:38:23.542 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 60/60 2024-04-18T10:38:23.542 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:23.542 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2024-04-18T10:38:23.542 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.542 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.542 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.542 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.543 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.543 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.543 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.543 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:17.2.7-872.ge85153d5.el8.noarch 2024-04-18T10:38:23.543 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.543 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.543 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.544 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.544 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.544 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.544 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.544 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.544 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.544 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.545 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.545 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.545 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.545 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.545 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.545 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.545 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.546 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.546 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.546 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.546 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:38:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-04-18T10:38:23.546 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite-2:17.2.7-872.ge85153d5.el8.x86_64 thrift-0.13.0-2.el8.x86_64 2024-04-18T10:38:23.546 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:23.546 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-04-18T10:38:23.704 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-18T10:38:24.061 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-18T10:38:24.088 INFO:teuthology.orchestra.run.smithi031.stdout:17.2.7-872.ge85153d5.el8 2024-04-18T10:38:24.088 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-872.ge85153d5.el8 2024-04-18T10:38:24.088 INFO:teuthology.task.install:The correct ceph version 17.2.7-872.ge85153d5 is installed. 2024-04-18T10:38:24.090 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:38:24.100 INFO:teuthology.task.print:**** done install.upgrade the host 2024-04-18T10:38:24.100 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-04-18T10:38:24.111 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-18T10:38:24.111 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:24.141 INFO:tasks.ceph.mon.a:Stopped 2024-04-18T10:38:24.141 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-18T10:38:24.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-18T10:38:24.184 INFO:tasks.ceph.mon.a:Started 2024-04-18T10:38:24.184 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T10:38:24.184 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:24.196 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T10:38:24.196 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-18T10:38:24.197 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-18T10:38:24.239 INFO:tasks.ceph.mon.b:Started 2024-04-18T10:38:24.240 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T10:38:24.240 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:24.252 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T10:38:24.252 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-18T10:38:24.252 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-18T10:38:24.294 INFO:tasks.ceph.mon.c:Started 2024-04-18T10:38:24.295 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-18T10:38:24.295 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:24.312 INFO:tasks.ceph.mgr.x:Stopped 2024-04-18T10:38:24.312 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-18T10:38:24.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-18T10:38:24.355 INFO:tasks.ceph.mgr.x:Started 2024-04-18T10:38:24.355 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-18T10:38:24.356 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:24.372 INFO:tasks.ceph.mgr.y:Stopped 2024-04-18T10:38:24.372 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-18T10:38:24.373 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-18T10:38:24.415 INFO:tasks.ceph.mgr.y:Started 2024-04-18T10:38:24.415 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-04-18T10:38:24.425 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-18T10:38:24.425 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-18T10:38:24.425 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-18T10:38:24.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.563+0000 7fc18e8a2700 1 Processor -- start 2024-04-18T10:38:24.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.563+0000 7fc18e8a2700 1 -- start start 2024-04-18T10:38:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.564+0000 7fc18e8a2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc188063d20 0x7fc18806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.564+0000 7fc18e8a2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188069ba0 0x7fc18806f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.564+0000 7fc18e8a2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880a35f0 con 0x7fc1880a4300 2024-04-18T10:38:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.564+0000 7fc18e8a2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18806aa70 con 0x7fc188063d20 2024-04-18T10:38:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.564+0000 7fc18e8a2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc18806a150 con 0x7fc188069ba0 2024-04-18T10:38:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.564+0000 7fc187fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc188063d20 0x7fc18806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.564+0000 7fc1877fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc1880a4300 0x7fc18806f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48092/0 (socket says 172.21.15.31:48092) 2024-04-18T10:38:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.564+0000 7fc1877fe700 1 -- 172.21.15.31:0/2805030310 learned_addr learned my addr 172.21.15.31:0/2805030310 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:24.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.564+0000 7fc18ce3f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188069ba0 0x7fc18806f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:24.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc186ffd700 1 -- 172.21.15.31:0/2805030310 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877092615 0 0) 0x7fc1880a35f0 con 0x7fc1880a4300 2024-04-18T10:38:24.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc186ffd700 1 -- 172.21.15.31:0/2805030310 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc170003570 con 0x7fc1880a4300 2024-04-18T10:38:24.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc18ce3f700 1 -- 172.21.15.31:0/2805030310 >> v2:172.21.15.31:3300/0 conn(0x7fc188063d20 msgr2=0x7fc18806eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:24.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc18ce3f700 1 --2- 172.21.15.31:0/2805030310 >> v2:172.21.15.31:3300/0 conn(0x7fc188063d20 0x7fc18806eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc18ce3f700 1 -- 172.21.15.31:0/2805030310 >> v1:172.21.15.31:6789/0 conn(0x7fc1880a4300 legacy=0x7fc18806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:24.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc18ce3f700 1 -- 172.21.15.31:0/2805030310 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18806a3f0 con 0x7fc188069ba0 2024-04-18T10:38:24.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc18ce3f700 1 --2- 172.21.15.31:0/2805030310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188069ba0 0x7fc18806f750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc180009e60 tx=0x7fc180009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f713d3d9912758f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:24.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc186ffd700 1 -- 172.21.15.31:0/2805030310 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000e070 con 0x7fc188069ba0 2024-04-18T10:38:24.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc186ffd700 1 -- 172.21.15.31:0/2805030310 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18000bb40 con 0x7fc188069ba0 2024-04-18T10:38:24.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.565+0000 7fc186ffd700 1 -- 172.21.15.31:0/2805030310 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc180012430 con 0x7fc188069ba0 2024-04-18T10:38:24.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.566+0000 7fc18e8a2700 1 -- 172.21.15.31:0/2805030310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188069ba0 msgr2=0x7fc18806f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:24.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.566+0000 7fc18e8a2700 1 --2- 172.21.15.31:0/2805030310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188069ba0 0x7fc18806f750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc180009e60 tx=0x7fc180009780 comp rx=0 tx=0).stop 2024-04-18T10:38:24.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.566+0000 7fc18e8a2700 1 -- 172.21.15.31:0/2805030310 shutdown_connections 2024-04-18T10:38:24.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.566+0000 7fc18e8a2700 1 --2- 172.21.15.31:0/2805030310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188069ba0 0x7fc18806f750 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.566+0000 7fc18e8a2700 1 --2- 172.21.15.31:0/2805030310 >> v2:172.21.15.31:3300/0 conn(0x7fc188063d20 0x7fc18806eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.566+0000 7fc18e8a2700 1 -- 172.21.15.31:0/2805030310 >> 172.21.15.31:0/2805030310 conn(0x7fc18806c090 msgr2=0x7fc188063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:24.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.567+0000 7fc18e8a2700 1 -- 172.21.15.31:0/2805030310 shutdown_connections 2024-04-18T10:38:24.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.567+0000 7fc18e8a2700 1 -- 172.21.15.31:0/2805030310 wait complete. 2024-04-18T10:38:24.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.568+0000 7fc18e8a2700 1 Processor -- start 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.568+0000 7fc18e8a2700 1 -- start start 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc18e8a2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188063d20 0x7fc1881410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc18e8a2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188069ba0 0x7fc18815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc18e8a2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1880a4300 0x7fc18815e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc18e8a2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880ade40 con 0x7fc188069ba0 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc18e8a2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880aeb80 con 0x7fc1880a4300 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc18e8a2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880af520 con 0x7fc188063d20 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc1877fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188069ba0 0x7fc18815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc1877fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188069ba0 0x7fc18815dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38758/0 (socket says 172.21.15.31:38758) 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc1877fe700 1 -- 172.21.15.31:0/4005371995 learned_addr learned my addr 172.21.15.31:0/4005371995 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc187fff700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188063d20 0x7fc1881410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:24.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.569+0000 7fc18ce3f700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1880a4300 0x7fc18815e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc187fff700 1 -- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1880a4300 msgr2=0x7fc18815e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc187fff700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1880a4300 0x7fc18815e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc187fff700 1 -- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188069ba0 msgr2=0x7fc18815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc187fff700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188069ba0 0x7fc18815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc187fff700 1 -- 172.21.15.31:0/4005371995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009a20 con 0x7fc188063d20 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc1877fe700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188069ba0 0x7fc18815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc187fff700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188063d20 0x7fc1881410b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc17800ea50 tx=0x7fc1780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc16ffff700 1 -- 172.21.15.31:0/4005371995 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800ee90 con 0x7fc188063d20 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc16ffff700 1 -- 172.21.15.31:0/4005371995 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17800c7f0 con 0x7fc188063d20 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1880af240 con 0x7fc188063d20 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc16ffff700 1 -- 172.21.15.31:0/4005371995 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800cb90 con 0x7fc188063d20 2024-04-18T10:38:24.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.570+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1880ad2e0 con 0x7fc188063d20 2024-04-18T10:38:24.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.571+0000 7fc16ffff700 1 -- 172.21.15.31:0/4005371995 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7fc178013470 con 0x7fc188063d20 2024-04-18T10:38:24.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.571+0000 7fc16ffff700 1 -- 172.21.15.31:0/4005371995 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc17804b910 con 0x7fc188063d20 2024-04-18T10:38:24.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.571+0000 7fc1877fe700 1 -- 172.21.15.31:0/4005371995 >> v1:172.21.15.31:6816/39551 conn(0x7fc1740394d0 legacy=0x7fc17403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:24.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.572+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc188064920 con 0x7fc188063d20 2024-04-18T10:38:24.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.577+0000 7fc16ffff700 1 -- 172.21.15.31:0/4005371995 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7fc178033d50 con 0x7fc188063d20 2024-04-18T10:38:24.677 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:24.676+0000 7fb6d16791c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T10:38:24.699 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:24.699+0000 7fcb1d97f1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-18T10:38:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.772+0000 7fc1877fe700 1 -- 172.21.15.31:0/4005371995 >> v1:172.21.15.31:6816/39551 conn(0x7fc1740394d0 legacy=0x7fc17403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:24.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.772+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc1880a47c0 con 0x7fc188063d20 2024-04-18T10:38:24.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.774+0000 7fc16ffff700 1 -- 172.21.15.31:0/4005371995 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+85074 (secure 0 0 0) 0x7fc178033960 con 0x7fc188063d20 2024-04-18T10:38:24.776 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.775+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 >> v1:172.21.15.31:6816/39551 conn(0x7fc1740394d0 legacy=0x7fc17403b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.776+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188063d20 msgr2=0x7fc1881410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.776+0000 7fc18e8a2700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188063d20 0x7fc1881410b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc17800ea50 tx=0x7fc1780091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.776+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 shutdown_connections 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.776+0000 7fc18e8a2700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc188063d20 0x7fc1881410b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.776+0000 7fc18e8a2700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1880a4300 0x7fc18815e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.776+0000 7fc18e8a2700 1 --2- 172.21.15.31:0/4005371995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc188069ba0 0x7fc18815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.776+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 >> 172.21.15.31:0/4005371995 conn(0x7fc18806c090 msgr2=0x7fc18806f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.776+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 shutdown_connections 2024-04-18T10:38:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.776+0000 7fc18e8a2700 1 -- 172.21.15.31:0/4005371995 wait complete. 2024-04-18T10:38:24.789 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6816","nonce":39551}]},"active_addr":"172.21.15.31:6816/39551","active_change":"2024-04-18T10:35:51.380919+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3252462560}]},{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2767636595}]},{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":2921291208}]}]} 2024-04-18T10:38:24.791 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-18T10:38:24.791 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T10:38:24.791 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:24.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.915+0000 7f6d541b2700 1 Processor -- start 2024-04-18T10:38:24.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.915+0000 7f6d541b2700 1 -- start start 2024-04-18T10:38:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.916+0000 7f6d541b2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a4650 0x7f6d4c13eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.916+0000 7f6d541b2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c143750 0x7f6d4c145b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.916+0000 7f6d541b2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c06d870 con 0x7f6d4c0a5e00 2024-04-18T10:38:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.916+0000 7f6d541b2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c06e2e0 con 0x7f6d4c143750 2024-04-18T10:38:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.916+0000 7f6d541b2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0a4d10 con 0x7f6d4c0a4650 2024-04-18T10:38:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d51f4e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6d4c0a5e00 0x7f6d4c13e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48108/0 (socket says 172.21.15.31:48108) 2024-04-18T10:38:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d51f4e700 1 -- 172.21.15.31:0/2457754944 learned_addr learned my addr 172.21.15.31:0/2457754944 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d5174d700 1 --2- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a4650 0x7f6d4c13eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d5274f700 1 --2- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c143750 0x7f6d4c145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d50f4c700 1 -- 172.21.15.31:0/2457754944 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891538298 0 0) 0x7f6d4c06d870 con 0x7f6d4c0a5e00 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d5174d700 1 -- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c143750 msgr2=0x7f6d4c145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d5174d700 1 --2- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c143750 0x7f6d4c145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d5174d700 1 -- 172.21.15.31:0/2457754944 >> v1:172.21.15.31:6789/0 conn(0x7f6d4c0a5e00 legacy=0x7f6d4c13e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d5174d700 1 -- 172.21.15.31:0/2457754944 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c06e980 con 0x7f6d4c0a4650 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d5274f700 1 --2- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c143750 0x7f6d4c145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d5174d700 1 --2- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a4650 0x7f6d4c13eba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009910 tx=0x7f6d3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=191e1ec3ac738c13 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d50f4c700 1 -- 172.21.15.31:0/2457754944 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00c690 con 0x7f6d4c0a4650 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d50f4c700 1 -- 172.21.15.31:0/2457754944 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00c7f0 con 0x7f6d4c0a4650 2024-04-18T10:38:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.917+0000 7f6d50f4c700 1 -- 172.21.15.31:0/2457754944 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00cbb0 con 0x7f6d4c0a4650 2024-04-18T10:38:24.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.918+0000 7f6d541b2700 1 -- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a4650 msgr2=0x7f6d4c13eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:24.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.918+0000 7f6d541b2700 1 --2- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a4650 0x7f6d4c13eba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009910 tx=0x7f6d3c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.918+0000 7f6d541b2700 1 -- 172.21.15.31:0/2457754944 shutdown_connections 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.918+0000 7f6d541b2700 1 --2- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c143750 0x7f6d4c145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.918+0000 7f6d541b2700 1 --2- 172.21.15.31:0/2457754944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a4650 0x7f6d4c13eba0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.918+0000 7f6d541b2700 1 -- 172.21.15.31:0/2457754944 >> 172.21.15.31:0/2457754944 conn(0x7f6d4c069a10 msgr2=0x7f6d4c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.918+0000 7f6d541b2700 1 -- 172.21.15.31:0/2457754944 shutdown_connections 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.918+0000 7f6d541b2700 1 -- 172.21.15.31:0/2457754944 wait complete. 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.919+0000 7f6d541b2700 1 Processor -- start 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.919+0000 7f6d541b2700 1 -- start start 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d541b2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c0a4650 0x7f6d4c0aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d541b2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a5e00 0x7f6d4c142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d541b2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4c143750 0x7f6d4c13a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d541b2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c143490 con 0x7f6d4c143750 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d541b2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c097d60 con 0x7f6d4c0a4650 2024-04-18T10:38:24.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d541b2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c098670 con 0x7f6d4c0a5e00 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d51f4e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c0a4650 0x7f6d4c0aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d51f4e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c0a4650 0x7f6d4c0aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49586/0 (socket says 172.21.15.31:49586) 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d51f4e700 1 -- 172.21.15.31:0/151912748 learned_addr learned my addr 172.21.15.31:0/151912748 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d5274f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4c143750 0x7f6d4c13a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d51f4e700 1 -- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a5e00 msgr2=0x7f6d4c142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d51f4e700 1 --2- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a5e00 0x7f6d4c142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d51f4e700 1 -- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4c143750 msgr2=0x7f6d4c13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d51f4e700 1 --2- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4c143750 0x7f6d4c13a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d51f4e700 1 -- 172.21.15.31:0/151912748 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44009a20 con 0x7f6d4c0a4650 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d5274f700 1 --2- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4c143750 0x7f6d4c13a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d51f4e700 1 --2- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c0a4650 0x7f6d4c0aca00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800c840 tx=0x7f6d48007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.920+0000 7f6d41ffb700 1 -- 172.21.15.31:0/151912748 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48005c00 con 0x7f6d4c0a4650 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.921+0000 7f6d41ffb700 1 -- 172.21.15.31:0/151912748 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d48005d60 con 0x7f6d4c0a4650 2024-04-18T10:38:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.921+0000 7f6d41ffb700 1 -- 172.21.15.31:0/151912748 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48007320 con 0x7f6d4c0a4650 2024-04-18T10:38:24.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.921+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c009420 con 0x7f6d4c0a4650 2024-04-18T10:38:24.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.921+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c096df0 con 0x7f6d4c0a4650 2024-04-18T10:38:24.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.922+0000 7f6d41ffb700 1 -- 172.21.15.31:0/151912748 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f6d4801b3b0 con 0x7f6d4c0a4650 2024-04-18T10:38:24.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.922+0000 7f6d5174d700 1 -- 172.21.15.31:0/151912748 >> v1:172.21.15.31:6816/39551 conn(0x7f6d300394d0 legacy=0x7f6d3003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:24.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.922+0000 7f6d41ffb700 1 -- 172.21.15.31:0/151912748 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6d4804acc0 con 0x7f6d4c0a4650 2024-04-18T10:38:24.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.922+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c064920 con 0x7f6d4c0a4650 2024-04-18T10:38:24.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:24.925+0000 7f6d41ffb700 1 -- 172.21.15.31:0/151912748 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f6d4802f6d0 con 0x7f6d4c0a4650 2024-04-18T10:38:24.965 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:24.965+0000 7fb6d16791c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T10:38:24.990 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:24.990+0000 7fcb1d97f1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-18T10:38:25.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.056+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d4c06a1f0 con 0x7f6d4c0a4650 2024-04-18T10:38:25.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.057+0000 7f6d41ffb700 1 -- 172.21.15.31:0/151912748 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11296 (secure 0 0 0) 0x7f6d48032cf0 con 0x7f6d4c0a4650 2024-04-18T10:38:25.057 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:25.058 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:25.572295+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:25.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.058+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 >> v1:172.21.15.31:6816/39551 conn(0x7f6d300394d0 legacy=0x7f6d3003b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.058+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c0a4650 msgr2=0x7f6d4c0aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.058+0000 7f6d541b2700 1 --2- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c0a4650 0x7f6d4c0aca00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800c840 tx=0x7f6d48007d90 comp rx=0 tx=0).stop 2024-04-18T10:38:25.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.058+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 shutdown_connections 2024-04-18T10:38:25.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.058+0000 7f6d541b2700 1 --2- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d4c143750 0x7f6d4c13a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.058+0000 7f6d541b2700 1 --2- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d4c0a4650 0x7f6d4c0aca00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.058+0000 7f6d541b2700 1 --2- 172.21.15.31:0/151912748 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d4c0a5e00 0x7f6d4c142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.058+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 >> 172.21.15.31:0/151912748 conn(0x7f6d4c069a10 msgr2=0x7f6d4c0b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.059+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 shutdown_connections 2024-04-18T10:38:25.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.059+0000 7f6d541b2700 1 -- 172.21.15.31:0/151912748 wait complete. 2024-04-18T10:38:25.072 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T10:38:25.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:25.135 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:25.134+0000 7fb6d16791c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-18T10:38:25.140 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:25.140+0000 7fcb1d97f1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-18T10:38:25.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.203+0000 7fd0df5fd700 1 Processor -- start 2024-04-18T10:38:25.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.203+0000 7fd0df5fd700 1 -- start start 2024-04-18T10:38:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0df5fd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0d80ab270 0x7fd0d813b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0df5fd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d813b5e0 0x7fd0d813ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0df5fd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d80abda0 con 0x7fd0d8063b80 2024-04-18T10:38:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0df5fd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d80aae70 con 0x7fd0d80ab270 2024-04-18T10:38:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0df5fd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d80acc30 con 0x7fd0d813b5e0 2024-04-18T10:38:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0ddb9a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d813b5e0 0x7fd0d813ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0dcb98700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0d80ab270 0x7fd0d813b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0dcb98700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd0d80ab270 0x7fd0d813b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38778/0 (socket says 172.21.15.31:38778) 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0ddb9a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d813b5e0 0x7fd0d813ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49598/0 (socket says 172.21.15.31:49598) 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0dd399700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd0d8063b80 0x7fd0d80aa760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48114/0 (socket says 172.21.15.31:48114) 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0dcb98700 1 -- 172.21.15.31:0/2965470271 learned_addr learned my addr 172.21.15.31:0/2965470271 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0cffff700 1 -- 172.21.15.31:0/2965470271 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371424200 0 0) 0x7fd0d80abda0 con 0x7fd0d8063b80 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0ddb9a700 1 -- 172.21.15.31:0/2965470271 >> v2:172.21.15.31:3300/0 conn(0x7fd0d80ab270 msgr2=0x7fd0d813b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0ddb9a700 1 --2- 172.21.15.31:0/2965470271 >> v2:172.21.15.31:3300/0 conn(0x7fd0d80ab270 0x7fd0d813b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0ddb9a700 1 -- 172.21.15.31:0/2965470271 >> v1:172.21.15.31:6789/0 conn(0x7fd0d8063b80 legacy=0x7fd0d80aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0ddb9a700 1 -- 172.21.15.31:0/2965470271 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d80aced0 con 0x7fd0d813b5e0 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0dcb98700 1 --2- 172.21.15.31:0/2965470271 >> v2:172.21.15.31:3300/0 conn(0x7fd0d80ab270 0x7fd0d813b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0ddb9a700 1 --2- 172.21.15.31:0/2965470271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d813b5e0 0x7fd0d813ba40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009e60 tx=0x7fd0d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3ca26a7ca4c508 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.204+0000 7fd0cffff700 1 -- 172.21.15.31:0/2965470271 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d000e070 con 0x7fd0d813b5e0 2024-04-18T10:38:25.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0cffff700 1 -- 172.21.15.31:0/2965470271 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d000bb60 con 0x7fd0d813b5e0 2024-04-18T10:38:25.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0cffff700 1 -- 172.21.15.31:0/2965470271 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0012430 con 0x7fd0d813b5e0 2024-04-18T10:38:25.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0df5fd700 1 -- 172.21.15.31:0/2965470271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d813b5e0 msgr2=0x7fd0d813ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0df5fd700 1 --2- 172.21.15.31:0/2965470271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d813b5e0 0x7fd0d813ba40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009e60 tx=0x7fd0d0009780 comp rx=0 tx=0).stop 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0df5fd700 1 -- 172.21.15.31:0/2965470271 shutdown_connections 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0df5fd700 1 --2- 172.21.15.31:0/2965470271 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d813b5e0 0x7fd0d813ba40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0df5fd700 1 --2- 172.21.15.31:0/2965470271 >> v2:172.21.15.31:3300/0 conn(0x7fd0d80ab270 0x7fd0d813b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0df5fd700 1 -- 172.21.15.31:0/2965470271 >> 172.21.15.31:0/2965470271 conn(0x7fd0d80b1290 msgr2=0x7fd0d80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0df5fd700 1 -- 172.21.15.31:0/2965470271 shutdown_connections 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.205+0000 7fd0df5fd700 1 -- 172.21.15.31:0/2965470271 wait complete. 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.206+0000 7fd0df5fd700 1 Processor -- start 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.206+0000 7fd0df5fd700 1 -- start start 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0df5fd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d8063b80 0x7fd0d81387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0df5fd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d80ab270 0x7fd0d8138d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0df5fd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd0d813b5e0 0x7fd0d813f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0df5fd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d811ad20 con 0x7fd0d8063b80 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0df5fd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8139a90 con 0x7fd0d80ab270 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0df5fd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d81193f0 con 0x7fd0d813b5e0 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0dd399700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d8063b80 0x7fd0d81387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0dcb98700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d80ab270 0x7fd0d8138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0dcb98700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d80ab270 0x7fd0d8138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49610/0 (socket says 172.21.15.31:49610) 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0dd399700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d8063b80 0x7fd0d81387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38794/0 (socket says 172.21.15.31:38794) 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0dcb98700 1 -- 172.21.15.31:0/494195640 learned_addr learned my addr 172.21.15.31:0/494195640 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.207+0000 7fd0ddb9a700 1 --2- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd0d813b5e0 0x7fd0d813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0dd399700 1 -- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd0d813b5e0 msgr2=0x7fd0d813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0dd399700 1 --2- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd0d813b5e0 0x7fd0d813f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0dd399700 1 -- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d80ab270 msgr2=0x7fd0d8138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0dd399700 1 --2- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d80ab270 0x7fd0d8138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0dd399700 1 -- 172.21.15.31:0/494195640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80094f0 con 0x7fd0d8063b80 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0dd399700 1 --2- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d8063b80 0x7fd0d81387f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40011e0 tx=0x7fd0d4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0cd7fa700 1 -- 172.21.15.31:0/494195640 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4005a70 con 0x7fd0d8063b80 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0cd7fa700 1 -- 172.21.15.31:0/494195640 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d4005bf0 con 0x7fd0d8063b80 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0cd7fa700 1 -- 172.21.15.31:0/494195640 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40070d0 con 0x7fd0d8063b80 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d0009a20 con 0x7fd0d8063b80 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.208+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d8119710 con 0x7fd0d8063b80 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.209+0000 7fd0cd7fa700 1 -- 172.21.15.31:0/494195640 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7fd0d4007440 con 0x7fd0d8063b80 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.209+0000 7fd0dcb98700 1 -- 172.21.15.31:0/494195640 >> v1:172.21.15.31:6816/39551 conn(0x7fd0bc0394d0 legacy=0x7fd0bc03b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.209+0000 7fd0cd7fa700 1 -- 172.21.15.31:0/494195640 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd0d404ac60 con 0x7fd0d8063b80 2024-04-18T10:38:25.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.209+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d80651b0 con 0x7fd0d8063b80 2024-04-18T10:38:25.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.213+0000 7fd0cd7fa700 1 -- 172.21.15.31:0/494195640 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7fd0d4017080 con 0x7fd0d8063b80 2024-04-18T10:38:25.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.339+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0d806ef10 con 0x7fd0d8063b80 2024-04-18T10:38:25.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.340+0000 7fd0cd7fa700 1 -- 172.21.15.31:0/494195640 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+11296 (secure 0 0 0) 0x7fd0d402f650 con 0x7fd0d8063b80 2024-04-18T10:38:25.340 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:25.341 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:36:25.572295+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:25.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.341+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 >> v1:172.21.15.31:6816/39551 conn(0x7fd0bc0394d0 legacy=0x7fd0bc03b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.341+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d8063b80 msgr2=0x7fd0d81387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.341+0000 7fd0df5fd700 1 --2- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d8063b80 0x7fd0d81387f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40011e0 tx=0x7fd0d4007d30 comp rx=0 tx=0).stop 2024-04-18T10:38:25.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.342+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 shutdown_connections 2024-04-18T10:38:25.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.342+0000 7fd0df5fd700 1 --2- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd0d813b5e0 0x7fd0d813f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.342+0000 7fd0df5fd700 1 --2- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd0d8063b80 0x7fd0d81387f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.342+0000 7fd0df5fd700 1 --2- 172.21.15.31:0/494195640 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd0d80ab270 0x7fd0d8138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.342+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 >> 172.21.15.31:0/494195640 conn(0x7fd0d80b1290 msgr2=0x7fd0d80b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.342+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 shutdown_connections 2024-04-18T10:38:25.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.342+0000 7fd0df5fd700 1 -- 172.21.15.31:0/494195640 wait complete. 2024-04-18T10:38:25.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T10:38:25.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T10:38:25.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T10:38:25.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-18T10:38:25.477 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:25.477+0000 7fcb1d97f1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T10:38:25.488 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:25.487+0000 7fb6d16791c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-18T10:38:25.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.510+0000 7feabc6fb700 1 Processor -- start 2024-04-18T10:38:25.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.510+0000 7feabc6fb700 1 -- start start 2024-04-18T10:38:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.511+0000 7feabc6fb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feab406e380 0x7feab40ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.511+0000 7feabc6fb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feab4142f90 0x7feab4145370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.511+0000 7feabc6fb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab40ac680 con 0x7feab40ad6f0 2024-04-18T10:38:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.511+0000 7feabc6fb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab40adb80 con 0x7feab406e380 2024-04-18T10:38:25.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.511+0000 7feabc6fb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feab4069f00 con 0x7feab4142f90 2024-04-18T10:38:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.511+0000 7feab9c96700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feab40ad6f0 0x7feab413ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48130/0 (socket says 172.21.15.31:48130) 2024-04-18T10:38:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.511+0000 7feab9c96700 1 -- 172.21.15.31:0/1526242107 learned_addr learned my addr 172.21.15.31:0/1526242107 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.511+0000 7feaba497700 1 --2- 172.21.15.31:0/1526242107 >> v2:172.21.15.31:3300/0 conn(0x7feab406e380 0x7feab40ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.512+0000 7feaba497700 1 -- 172.21.15.31:0/1526242107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feab4142f90 msgr2=0x7feab4145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.512+0000 7feaba497700 1 --2- 172.21.15.31:0/1526242107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feab4142f90 0x7feab4145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.512+0000 7feaba497700 1 -- 172.21.15.31:0/1526242107 >> v1:172.21.15.31:6789/0 conn(0x7feab40ad6f0 legacy=0x7feab413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.512+0000 7feaba497700 1 -- 172.21.15.31:0/1526242107 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab406d930 con 0x7feab406e380 2024-04-18T10:38:25.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.512+0000 7feaba497700 1 --2- 172.21.15.31:0/1526242107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 0x7feab40ad1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feaa800bb90 tx=0x7feaa800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437be703e908dd54 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.512+0000 7feab9495700 1 -- 172.21.15.31:0/1526242107 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800da90 con 0x7feab406e380 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.512+0000 7feab9495700 1 -- 172.21.15.31:0/1526242107 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa800dbf0 con 0x7feab406e380 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.512+0000 7feab9495700 1 -- 172.21.15.31:0/1526242107 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8017410 con 0x7feab406e380 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.513+0000 7feabc6fb700 1 -- 172.21.15.31:0/1526242107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 msgr2=0x7feab40ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.513+0000 7feabc6fb700 1 --2- 172.21.15.31:0/1526242107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 0x7feab40ad1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feaa800bb90 tx=0x7feaa800b430 comp rx=0 tx=0).stop 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.513+0000 7feabc6fb700 1 -- 172.21.15.31:0/1526242107 shutdown_connections 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.513+0000 7feabc6fb700 1 --2- 172.21.15.31:0/1526242107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feab4142f90 0x7feab4145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.513+0000 7feabc6fb700 1 --2- 172.21.15.31:0/1526242107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 0x7feab40ad1b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.513+0000 7feabc6fb700 1 -- 172.21.15.31:0/1526242107 >> 172.21.15.31:0/1526242107 conn(0x7feab40b1390 msgr2=0x7feab40b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.513+0000 7feabc6fb700 1 -- 172.21.15.31:0/1526242107 shutdown_connections 2024-04-18T10:38:25.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.513+0000 7feabc6fb700 1 -- 172.21.15.31:0/1526242107 wait complete. 2024-04-18T10:38:25.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.514+0000 7feabc6fb700 1 Processor -- start 2024-04-18T10:38:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.515+0000 7feabc6fb700 1 -- start start 2024-04-18T10:38:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.515+0000 7feabc6fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 0x7feab41418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.515+0000 7feabc6fb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feab40ad6f0 0x7feab413b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.515+0000 7feabc6fb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feab4142f90 0x7feab413bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.515+0000 7feabc6fb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab413e320 con 0x7feab406e380 2024-04-18T10:38:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.515+0000 7feabc6fb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab40a5f50 con 0x7feab40ad6f0 2024-04-18T10:38:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.515+0000 7feabc6fb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feab413e490 con 0x7feab4142f90 2024-04-18T10:38:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.515+0000 7feaba497700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 0x7feab41418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.516+0000 7feaba497700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 0x7feab41418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38806/0 (socket says 172.21.15.31:38806) 2024-04-18T10:38:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.516+0000 7feaba497700 1 -- 172.21.15.31:0/4086626821 learned_addr learned my addr 172.21.15.31:0/4086626821 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.516+0000 7feab9c96700 1 --2- 172.21.15.31:0/4086626821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feab40ad6f0 0x7feab413b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.516+0000 7feaba497700 1 -- 172.21.15.31:0/4086626821 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feab4142f90 msgr2=0x7feab413bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.516+0000 7feaba497700 1 --2- 172.21.15.31:0/4086626821 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feab4142f90 0x7feab413bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.516+0000 7feaba497700 1 -- 172.21.15.31:0/4086626821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feab40ad6f0 msgr2=0x7feab413b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.516+0000 7feaba497700 1 --2- 172.21.15.31:0/4086626821 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feab40ad6f0 0x7feab413b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.516+0000 7feaba497700 1 -- 172.21.15.31:0/4086626821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa800b6d0 con 0x7feab406e380 2024-04-18T10:38:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.516+0000 7feaba497700 1 --2- 172.21.15.31:0/4086626821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 0x7feab41418d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feaa8017fd0 tx=0x7feaa8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.517+0000 7feaa67fc700 1 -- 172.21.15.31:0/4086626821 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa801f6b0 con 0x7feab406e380 2024-04-18T10:38:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.517+0000 7feaa67fc700 1 -- 172.21.15.31:0/4086626821 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa801f810 con 0x7feab406e380 2024-04-18T10:38:25.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.517+0000 7feaa67fc700 1 -- 172.21.15.31:0/4086626821 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa801fbd0 con 0x7feab406e380 2024-04-18T10:38:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.517+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab413d2a0 con 0x7feab406e380 2024-04-18T10:38:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.517+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab40a7100 con 0x7feab406e380 2024-04-18T10:38:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.518+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feab40a62c0 con 0x7feab406e380 2024-04-18T10:38:25.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.519+0000 7feaa67fc700 1 -- 172.21.15.31:0/4086626821 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7feaa8015070 con 0x7feab406e380 2024-04-18T10:38:25.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.519+0000 7feaa67fc700 1 -- 172.21.15.31:0/4086626821 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7feaa804dd80 con 0x7feab406e380 2024-04-18T10:38:25.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.519+0000 7feab9c96700 1 -- 172.21.15.31:0/4086626821 >> v1:172.21.15.31:6816/39551 conn(0x7fea980394d0 legacy=0x7fea9803b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:25.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.519+0000 7feaa67fc700 1 -- 172.21.15.31:0/4086626821 --> v1:172.21.15.31:6800/40171 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea98045dd0 con 0x7fea980420f0 2024-04-18T10:38:25.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.519+0000 7feaa67fc700 1 -- 172.21.15.31:0/4086626821 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaa804e0d0 con 0x7feab406e380 2024-04-18T10:38:25.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.522+0000 7feaa67fc700 1 -- 172.21.15.31:0/4086626821 <== osd.0 v1:172.21.15.31:6800/40171 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fea98045dd0 con 0x7fea980420f0 2024-04-18T10:38:25.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.549+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 --> v1:172.21.15.31:6800/40171 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feab40a7100 con 0x7fea980420f0 2024-04-18T10:38:25.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.551+0000 7feaa67fc700 1 -- 172.21.15.31:0/4086626821 <== osd.0 v1:172.21.15.31:6800/40171 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3460635026) 0x7feab40a7100 con 0x7fea980420f0 2024-04-18T10:38:25.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.551+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 >> v1:172.21.15.31:6800/40171 conn(0x7fea980420f0 legacy=0x7fea98044560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.551+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 >> v1:172.21.15.31:6816/39551 conn(0x7fea980394d0 legacy=0x7fea9803b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.551+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 msgr2=0x7feab41418d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.551+0000 7feabc6fb700 1 --2- 172.21.15.31:0/4086626821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab406e380 0x7feab41418d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feaa8017fd0 tx=0x7feaa8019000 comp rx=0 tx=0).stop 2024-04-18T10:38:25.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.551+0000 7feabac98700 1 -- 172.21.15.31:0/4086626821 reap_dead start 2024-04-18T10:38:25.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.552+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 shutdown_connections 2024-04-18T10:38:25.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.552+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 >> 172.21.15.31:0/4086626821 conn(0x7feab40b1390 msgr2=0x7feab4067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.552+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 shutdown_connections 2024-04-18T10:38:25.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.552+0000 7feabc6fb700 1 -- 172.21.15.31:0/4086626821 wait complete. 2024-04-18T10:38:25.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.553+0000 7fa32a73c700 1 Processor -- start 2024-04-18T10:38:25.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.553+0000 7fa32a73c700 1 -- start start 2024-04-18T10:38:25.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.554+0000 7fa32a73c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa32406cd80 0x7fa32413b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.554+0000 7fa32a73c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa32406f580 0x7fa324145080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.554+0000 7fa32a73c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3240b1cf0 con 0x7fa3240b1920 2024-04-18T10:38:25.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.554+0000 7fa32a73c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32406e470 con 0x7fa32406cd80 2024-04-18T10:38:25.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.554+0000 7fa32a73c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa32406ea10 con 0x7fa32406f580 2024-04-18T10:38:25.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.555+0000 7fa323fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa3240b1920 0x7fa32413ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48140/0 (socket says 172.21.15.31:48140) 2024-04-18T10:38:25.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.555+0000 7fa323fff700 1 -- 172.21.15.31:0/458126704 learned_addr learned my addr 172.21.15.31:0/458126704 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:25.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.555+0000 7fa3237fe700 1 --2- 172.21.15.31:0/458126704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa32406cd80 0x7fa32413b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.555+0000 7fa322ffd700 1 -- 172.21.15.31:0/458126704 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557601457 0 0) 0x7fa3240b1cf0 con 0x7fa3240b1920 2024-04-18T10:38:25.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.555+0000 7fa322ffd700 1 -- 172.21.15.31:0/458126704 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa30c003570 con 0x7fa3240b1920 2024-04-18T10:38:25.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.555+0000 7fa3237fe700 1 -- 172.21.15.31:0/458126704 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa32406f580 msgr2=0x7fa324145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.555+0000 7fa3237fe700 1 --2- 172.21.15.31:0/458126704 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa32406f580 0x7fa324145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.555+0000 7fa3237fe700 1 -- 172.21.15.31:0/458126704 >> v1:172.21.15.31:6789/0 conn(0x7fa3240b1920 legacy=0x7fa32413ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.555+0000 7fa3237fe700 1 -- 172.21.15.31:0/458126704 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3240a3520 con 0x7fa32406cd80 2024-04-18T10:38:25.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.556+0000 7fa3237fe700 1 --2- 172.21.15.31:0/458126704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa32406cd80 0x7fa32413b250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa318009910 tx=0x7fa3180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6923cb72b5761ab0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.556+0000 7fa322ffd700 1 -- 172.21.15.31:0/458126704 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800b680 con 0x7fa32406cd80 2024-04-18T10:38:25.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.556+0000 7fa322ffd700 1 -- 172.21.15.31:0/458126704 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800b7e0 con 0x7fa32406cd80 2024-04-18T10:38:25.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.556+0000 7fa322ffd700 1 -- 172.21.15.31:0/458126704 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800bba0 con 0x7fa32406cd80 2024-04-18T10:38:25.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.557+0000 7fa32a73c700 1 -- 172.21.15.31:0/458126704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa32406cd80 msgr2=0x7fa32413b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.557+0000 7fa32a73c700 1 --2- 172.21.15.31:0/458126704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa32406cd80 0x7fa32413b250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa318009910 tx=0x7fa3180091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.557+0000 7fc09693d700 1 Processor -- start 2024-04-18T10:38:25.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.557+0000 7fa32a73c700 1 -- 172.21.15.31:0/458126704 shutdown_connections 2024-04-18T10:38:25.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.557+0000 7fa32a73c700 1 --2- 172.21.15.31:0/458126704 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa32406f580 0x7fa324145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.557+0000 7fa32a73c700 1 --2- 172.21.15.31:0/458126704 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa32406cd80 0x7fa32413b250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.558+0000 7fa32a73c700 1 -- 172.21.15.31:0/458126704 >> 172.21.15.31:0/458126704 conn(0x7fa32406a920 msgr2=0x7fa3240b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fa32a73c700 1 -- 172.21.15.31:0/458126704 shutdown_connections 2024-04-18T10:38:25.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.558+0000 7fc09693d700 1 -- start start 2024-04-18T10:38:25.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fc09693d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0900b1340 0x7fc0900a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fc09693d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc090142c70 0x7fc090145050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fc09693d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0900a5b80 con 0x7fc0900a5700 2024-04-18T10:38:25.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fc09693d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0900a5200 con 0x7fc0900b1340 2024-04-18T10:38:25.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fc09693d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900a5dc0 con 0x7fc090142c70 2024-04-18T10:38:25.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7f97e6ab9700 1 Processor -- start 2024-04-18T10:38:25.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fc08ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0900b1340 0x7fc0900a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fc08ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0900b1340 0x7fc0900a45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38812/0 (socket says 172.21.15.31:38812) 2024-04-18T10:38:25.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fc08ffff700 1 -- 172.21.15.31:0/3916551384 learned_addr learned my addr 172.21.15.31:0/3916551384 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7fa32a73c700 1 -- 172.21.15.31:0/458126704 wait complete. 2024-04-18T10:38:25.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.560+0000 7fa32a73c700 1 Processor -- start 2024-04-18T10:38:25.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fc08ffff700 1 -- 172.21.15.31:0/3916551384 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc090142c70 msgr2=0x7fc090145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fc08ffff700 1 --2- 172.21.15.31:0/3916551384 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc090142c70 0x7fc090145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fc08ffff700 1 -- 172.21.15.31:0/3916551384 >> v1:172.21.15.31:6789/0 conn(0x7fc0900a5700 legacy=0x7fc09013df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fc08ffff700 1 -- 172.21.15.31:0/3916551384 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09013d980 con 0x7fc0900b1340 2024-04-18T10:38:25.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.561+0000 7fa32a73c700 1 -- start start 2024-04-18T10:38:25.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.561+0000 7fa32a73c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa32406cd80 0x7fa3240a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.561+0000 7fa32a73c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa32406f580 0x7fa3240a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa32a73c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3240b1920 0x7fa32415b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa32a73c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240aa7d0 con 0x7fa3240b1920 2024-04-18T10:38:25.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa32a73c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240a9460 con 0x7fa32406cd80 2024-04-18T10:38:25.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa32a73c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240a9720 con 0x7fa32406f580 2024-04-18T10:38:25.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.559+0000 7f97e6ab9700 1 -- start start 2024-04-18T10:38:25.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.560+0000 7f97e6ab9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 0x7f97e0146200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.560+0000 7f97e6ab9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 0x7f97e014d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.560+0000 7f97e6ab9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e009f590 con 0x7f97e0146740 2024-04-18T10:38:25.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.560+0000 7f97e6ab9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e006da70 con 0x7f97e0068340 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.560+0000 7f97e6ab9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e006eb20 con 0x7f97e00a04a0 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.560+0000 7f97e4855700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 0x7f97e0146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.560+0000 7f97e4855700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 0x7f97e0146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49646/0 (socket says 172.21.15.31:49646) 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.560+0000 7f97e4855700 1 -- 172.21.15.31:0/4125221869 learned_addr learned my addr 172.21.15.31:0/4125221869 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.561+0000 7f97e4855700 1 -- 172.21.15.31:0/4125221869 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 msgr2=0x7f97e014d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.561+0000 7f97e4855700 1 --2- 172.21.15.31:0/4125221869 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 0x7f97e014d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.561+0000 7f97e4855700 1 -- 172.21.15.31:0/4125221869 >> v1:172.21.15.31:6789/0 conn(0x7f97e0146740 legacy=0x7f97e006ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.561+0000 7f97e4855700 1 -- 172.21.15.31:0/4125221869 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e009f7e0 con 0x7f97e0068340 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.561+0000 7f97e4855700 1 --2- 172.21.15.31:0/4125221869 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 0x7f97e0146200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f97d40099e0 tx=0x7f97d4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7fcfb8183d83b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.561+0000 7f97df7fe700 1 -- 172.21.15.31:0/4125221869 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d400b820 con 0x7f97e0068340 2024-04-18T10:38:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7f97df7fe700 1 -- 172.21.15.31:0/4125221869 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d400b980 con 0x7f97e0068340 2024-04-18T10:38:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7f97df7fe700 1 -- 172.21.15.31:0/4125221869 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d400bd20 con 0x7f97e0068340 2024-04-18T10:38:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa328cd9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3240b1920 0x7fa32415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa328cd9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3240b1920 0x7fa32415b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38824/0 (socket says 172.21.15.31:38824) 2024-04-18T10:38:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa328cd9700 1 -- 172.21.15.31:0/1058347301 learned_addr learned my addr 172.21.15.31:0/1058347301 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa328cd9700 1 -- 172.21.15.31:0/1058347301 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa32406f580 msgr2=0x7fa3240a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa328cd9700 1 --2- 172.21.15.31:0/1058347301 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa32406f580 0x7fa3240a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa328cd9700 1 -- 172.21.15.31:0/1058347301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa32406cd80 msgr2=0x7fa3240a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa328cd9700 1 --2- 172.21.15.31:0/1058347301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa32406cd80 0x7fa3240a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fa328cd9700 1 -- 172.21.15.31:0/1058347301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318009420 con 0x7fa3240b1920 2024-04-18T10:38:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.562+0000 7fc08ffff700 1 --2- 172.21.15.31:0/3916551384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900b1340 0x7fc0900a45a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c830 tx=0x7fc088009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88f3122ff8bd735 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7f97e6ab9700 1 -- 172.21.15.31:0/4125221869 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 msgr2=0x7f97e0146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7f97e6ab9700 1 --2- 172.21.15.31:0/4125221869 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 0x7f97e0146200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f97d40099e0 tx=0x7f97d4009250 comp rx=0 tx=0).stop 2024-04-18T10:38:25.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7fa328cd9700 1 --2- 172.21.15.31:0/1058347301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3240b1920 0x7fa32415b550 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b810 tx=0x7fa3140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7f97e6ab9700 1 -- 172.21.15.31:0/4125221869 shutdown_connections 2024-04-18T10:38:25.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7f97e6ab9700 1 --2- 172.21.15.31:0/4125221869 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 0x7f97e014d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7f97e6ab9700 1 --2- 172.21.15.31:0/4125221869 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 0x7f97e0146200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7f97e6ab9700 1 -- 172.21.15.31:0/4125221869 >> 172.21.15.31:0/4125221869 conn(0x7f97e0069a10 msgr2=0x7f97e00679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7f97e6ab9700 1 -- 172.21.15.31:0/4125221869 shutdown_connections 2024-04-18T10:38:25.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7f97e6ab9700 1 -- 172.21.15.31:0/4125221869 wait complete. 2024-04-18T10:38:25.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7fc08effd700 1 -- 172.21.15.31:0/3916551384 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880092e0 con 0x7fc0900b1340 2024-04-18T10:38:25.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7fc08effd700 1 -- 172.21.15.31:0/3916551384 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc088010450 con 0x7fc0900b1340 2024-04-18T10:38:25.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7fc08effd700 1 -- 172.21.15.31:0/3916551384 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc088010810 con 0x7fc0900b1340 2024-04-18T10:38:25.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7fa30bfff700 1 -- 172.21.15.31:0/1058347301 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31400f570 con 0x7fa3240b1920 2024-04-18T10:38:25.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7fa30bfff700 1 -- 172.21.15.31:0/1058347301 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31400f6f0 con 0x7fa3240b1920 2024-04-18T10:38:25.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.563+0000 7fa30bfff700 1 -- 172.21.15.31:0/1058347301 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31400fab0 con 0x7fa3240b1920 2024-04-18T10:38:25.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.564+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3240a7c80 con 0x7fa3240b1920 2024-04-18T10:38:25.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.564+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3240ad7e0 con 0x7fa3240b1920 2024-04-18T10:38:25.571 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:25.564+0000 7fcb1d97f1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T10:38:25.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.564+0000 7fc09693d700 1 -- 172.21.15.31:0/3916551384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900b1340 msgr2=0x7fc0900a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.564+0000 7fc09693d700 1 --2- 172.21.15.31:0/3916551384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900b1340 0x7fc0900a45a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c830 tx=0x7fc088009f90 comp rx=0 tx=0).stop 2024-04-18T10:38:25.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.565+0000 7fc09693d700 1 -- 172.21.15.31:0/3916551384 shutdown_connections 2024-04-18T10:38:25.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.565+0000 7fc09693d700 1 --2- 172.21.15.31:0/3916551384 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc090142c70 0x7fc090145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.565+0000 7fc09693d700 1 --2- 172.21.15.31:0/3916551384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900b1340 0x7fc0900a45a0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc08800c830 tx=0x7fc088009f90 comp rx=0 tx=0).stop 2024-04-18T10:38:25.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.565+0000 7fc09693d700 1 -- 172.21.15.31:0/3916551384 >> 172.21.15.31:0/3916551384 conn(0x7fc09006bbd0 msgr2=0x7fc090069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.564+0000 7f97e6ab9700 1 Processor -- start 2024-04-18T10:38:25.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.565+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3240ab660 con 0x7fa3240b1920 2024-04-18T10:38:25.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.565+0000 7f97e6ab9700 1 -- start start 2024-04-18T10:38:25.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.566+0000 7f97e6ab9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 0x7f97e0099f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.566+0000 7f97e6ab9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 0x7f97e0142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.566+0000 7f97e6ab9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97e0146740 0x7f97e01430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.566+0000 7f97e6ab9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e0097be0 con 0x7f97e0146740 2024-04-18T10:38:25.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.566+0000 7f97e6ab9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e0097e80 con 0x7f97e0068340 2024-04-18T10:38:25.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.566+0000 7f97e6ab9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97e0143610 con 0x7f97e00a04a0 2024-04-18T10:38:25.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7f97dffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 0x7f97e0142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7f97dffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 0x7f97e0142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41156/0 (socket says 172.21.15.31:41156) 2024-04-18T10:38:25.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7f97dffff700 1 -- 172.21.15.31:0/2867147594 learned_addr learned my addr 172.21.15.31:0/2867147594 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.566+0000 7fa30bfff700 1 -- 172.21.15.31:0/1058347301 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7fa31401a460 con 0x7fa3240b1920 2024-04-18T10:38:25.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7fa323fff700 1 -- 172.21.15.31:0/1058347301 >> v1:172.21.15.31:6816/39551 conn(0x7fa3100394d0 legacy=0x7fa31003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:25.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7fa30bfff700 1 -- 172.21.15.31:0/1058347301 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa31404c000 con 0x7fa3240b1920 2024-04-18T10:38:25.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7fa30bfff700 1 -- 172.21.15.31:0/1058347301 --> v1:172.21.15.31:6808/40174 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa310045dd0 con 0x7fa3100420f0 2024-04-18T10:38:25.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7f97dffff700 1 -- 172.21.15.31:0/2867147594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 msgr2=0x7f97e0099f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7f97dffff700 1 --2- 172.21.15.31:0/2867147594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97e0068340 0x7f97e0099f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7f97dffff700 1 -- 172.21.15.31:0/2867147594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97e0146740 msgr2=0x7f97e01430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7f97dffff700 1 --2- 172.21.15.31:0/2867147594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97e0146740 0x7f97e01430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7f97dffff700 1 -- 172.21.15.31:0/2867147594 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40094f0 con 0x7f97e00a04a0 2024-04-18T10:38:25.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7f97dffff700 1 --2- 172.21.15.31:0/2867147594 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 0x7f97e0142b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00b5e0 tx=0x7f97cc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.566+0000 7fc09693d700 1 -- 172.21.15.31:0/3916551384 shutdown_connections 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.567+0000 7fc09693d700 1 -- 172.21.15.31:0/3916551384 wait complete. 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.568+0000 7fc09693d700 1 Processor -- start 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.568+0000 7fc09693d700 1 -- start start 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fc09693d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0900a5700 0x7fc0900a7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fc09693d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc090142c70 0x7fc0901558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fc09693d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900a6540 0x7fc090155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fc09693d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900a7ed0 con 0x7fc0900a6540 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fc09693d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900a8780 con 0x7fc0900a5700 2024-04-18T10:38:25.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fc09693d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900a0250 con 0x7fc090142c70 2024-04-18T10:38:25.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fa30bfff700 1 -- 172.21.15.31:0/1058347301 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa314034340 con 0x7fa3240b1920 2024-04-18T10:38:25.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fa30bfff700 1 -- 172.21.15.31:0/1058347301 <== osd.2 v1:172.21.15.31:6808/40174 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fa310045dd0 con 0x7fa3100420f0 2024-04-18T10:38:25.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fc094eda700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900a6540 0x7fc090155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fc094eda700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900a6540 0x7fc090155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38838/0 (socket says 172.21.15.31:38838) 2024-04-18T10:38:25.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.569+0000 7fc094eda700 1 -- 172.21.15.31:0/143115765 learned_addr learned my addr 172.21.15.31:0/143115765 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7f97dcff9700 1 -- 172.21.15.31:0/2867147594 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00f510 con 0x7f97e00a04a0 2024-04-18T10:38:25.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7f97dcff9700 1 -- 172.21.15.31:0/2867147594 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc00f690 con 0x7f97e00a04a0 2024-04-18T10:38:25.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7f97dcff9700 1 -- 172.21.15.31:0/2867147594 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc00fa50 con 0x7f97e00a04a0 2024-04-18T10:38:25.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e0096ef0 con 0x7f97e00a04a0 2024-04-18T10:38:25.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e0096cc0 con 0x7f97e00a04a0 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc094eda700 1 -- 172.21.15.31:0/143115765 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc090142c70 msgr2=0x7fc0901558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc094eda700 1 --2- 172.21.15.31:0/143115765 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc090142c70 0x7fc0901558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc094eda700 1 -- 172.21.15.31:0/143115765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0900a5700 msgr2=0x7fc0900a7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc094eda700 1 --2- 172.21.15.31:0/143115765 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc0900a5700 0x7fc0900a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc094eda700 1 -- 172.21.15.31:0/143115765 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08800c370 con 0x7fc0900a6540 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc094eda700 1 --2- 172.21.15.31:0/143115765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900a6540 0x7fc090155df0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc08000b530 tx=0x7fc0800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc077fff700 1 -- 172.21.15.31:0/143115765 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000f510 con 0x7fc0900a6540 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc077fff700 1 -- 172.21.15.31:0/143115765 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08000f690 con 0x7fc0900a6540 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc077fff700 1 -- 172.21.15.31:0/143115765 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000fa50 con 0x7fc0900a6540 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.570+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0900a0510 con 0x7fc0900a6540 2024-04-18T10:38:25.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.571+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0900a8140 con 0x7fc0900a6540 2024-04-18T10:38:25.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.572+0000 7f97dcff9700 1 -- 172.21.15.31:0/2867147594 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f97cc01a400 con 0x7f97e00a04a0 2024-04-18T10:38:25.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.572+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97e0064920 con 0x7f97e00a04a0 2024-04-18T10:38:25.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.572+0000 7fc077fff700 1 -- 172.21.15.31:0/143115765 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7fc08001a400 con 0x7fc0900a6540 2024-04-18T10:38:25.581 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:25.581 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T10:38:25.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.572+0000 7f97e4855700 1 -- 172.21.15.31:0/2867147594 >> v1:172.21.15.31:6816/39551 conn(0x7f97c4039520 legacy=0x7f97c403b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:25.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.572+0000 7fc077fff700 1 -- 172.21.15.31:0/143115765 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc08004b200 con 0x7fc0900a6540 2024-04-18T10:38:25.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.572+0000 7fc08ffff700 1 -- 172.21.15.31:0/143115765 >> v1:172.21.15.31:6816/39551 conn(0x7fc07c039520 legacy=0x7fc07c03b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:25.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.572+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 --> v1:172.21.15.31:6804/40172 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc09006e720 con 0x7fc0900a8ed0 2024-04-18T10:38:25.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.573+0000 7f97dcff9700 1 -- 172.21.15.31:0/2867147594 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f97cc00fe00 con 0x7f97e00a04a0 2024-04-18T10:38:25.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.573+0000 7f97dcff9700 1 -- 172.21.15.31:0/2867147594 --> v1:172.21.15.31:6809/40173 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97c4045e20 con 0x7f97c4042140 2024-04-18T10:38:25.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.573+0000 7f97dcff9700 1 -- 172.21.15.31:0/2867147594 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97cc02fca0 con 0x7f97e00a04a0 2024-04-18T10:38:25.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.574+0000 7f97dcff9700 1 -- 172.21.15.31:0/2867147594 <== osd.3 v1:172.21.15.31:6809/40173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f97c4045e20 con 0x7f97c4042140 2024-04-18T10:38:25.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.574+0000 7fc077fff700 1 -- 172.21.15.31:0/143115765 <== osd.1 v1:172.21.15.31:6804/40172 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fc09006e720 con 0x7fc0900a8ed0 2024-04-18T10:38:25.599 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:25.599+0000 7fb6d16791c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-18T10:38:25.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.600+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 --> v1:172.21.15.31:6808/40174 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3240a9210 con 0x7fa3100420f0 2024-04-18T10:38:25.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.600+0000 7fa30bfff700 1 -- 172.21.15.31:0/1058347301 <== osd.2 v1:172.21.15.31:6808/40174 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1009687185) 0x7fa3240a9210 con 0x7fa3100420f0 2024-04-18T10:38:25.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.601+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 >> v1:172.21.15.31:6808/40174 conn(0x7fa3100420f0 legacy=0x7fa310044560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.601+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 >> v1:172.21.15.31:6816/39551 conn(0x7fa3100394d0 legacy=0x7fa31003b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.601+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3240b1920 msgr2=0x7fa32415b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.601+0000 7fa32a73c700 1 --2- 172.21.15.31:0/1058347301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3240b1920 0x7fa32415b550 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa31400b810 tx=0x7fa3140091d0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.601+0000 7fa328cd9700 1 -- 172.21.15.31:0/1058347301 reap_dead start 2024-04-18T10:38:25.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.601+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 shutdown_connections 2024-04-18T10:38:25.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.601+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 >> 172.21.15.31:0/1058347301 conn(0x7fa32406a920 msgr2=0x7fa3240a1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.601+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 shutdown_connections 2024-04-18T10:38:25.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.601+0000 7fa32a73c700 1 -- 172.21.15.31:0/1058347301 wait complete. 2024-04-18T10:38:25.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.606+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 --> v1:172.21.15.31:6809/40173 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97e009e940 con 0x7f97c4042140 2024-04-18T10:38:25.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.604+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 --> v1:172.21.15.31:6804/40172 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc09005e400 con 0x7fc0900a8ed0 2024-04-18T10:38:25.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.605+0000 7fc077fff700 1 -- 172.21.15.31:0/143115765 <== osd.1 v1:172.21.15.31:6804/40172 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1009687185) 0x7fc09005e400 con 0x7fc0900a8ed0 2024-04-18T10:38:25.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.606+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 >> v1:172.21.15.31:6804/40172 conn(0x7fc0900a8ed0 legacy=0x7fc090142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.606+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 >> v1:172.21.15.31:6816/39551 conn(0x7fc07c039520 legacy=0x7fc07c03b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.606+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900a6540 msgr2=0x7fc090155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.606+0000 7fc09693d700 1 --2- 172.21.15.31:0/143115765 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0900a6540 0x7fc090155df0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc08000b530 tx=0x7fc0800090f0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.606+0000 7fc094eda700 1 -- 172.21.15.31:0/143115765 reap_dead start 2024-04-18T10:38:25.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.606+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 shutdown_connections 2024-04-18T10:38:25.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.606+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 >> 172.21.15.31:0/143115765 conn(0x7fc09006bbd0 msgr2=0x7fc09013bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.607+0000 7f97dcff9700 1 -- 172.21.15.31:0/2867147594 <== osd.3 v1:172.21.15.31:6809/40173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3460635026) 0x7f97e009e940 con 0x7f97c4042140 2024-04-18T10:38:25.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.607+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 shutdown_connections 2024-04-18T10:38:25.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.607+0000 7fc09693d700 1 -- 172.21.15.31:0/143115765 wait complete. 2024-04-18T10:38:25.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.610+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 >> v1:172.21.15.31:6809/40173 conn(0x7f97c4042140 legacy=0x7f97c40445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.610+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 >> v1:172.21.15.31:6816/39551 conn(0x7f97c4039520 legacy=0x7f97c403b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.610+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 msgr2=0x7f97e0142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.610+0000 7f97e6ab9700 1 --2- 172.21.15.31:0/2867147594 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97e00a04a0 0x7f97e0142b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00b5e0 tx=0x7f97cc0090f0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.610+0000 7f97e5056700 1 -- 172.21.15.31:0/2867147594 reap_dead start 2024-04-18T10:38:25.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.610+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 shutdown_connections 2024-04-18T10:38:25.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.610+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 >> 172.21.15.31:0/2867147594 conn(0x7f97e0069a10 msgr2=0x7f97e006ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.614+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 shutdown_connections 2024-04-18T10:38:25.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.614+0000 7f97e6ab9700 1 -- 172.21.15.31:0/2867147594 wait complete. 2024-04-18T10:38:25.624 INFO:teuthology.orchestra.run.smithi031.stdout:42949672993 2024-04-18T10:38:25.624 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T10:38:25.628 INFO:teuthology.orchestra.run.smithi031.stdout:42949672993 2024-04-18T10:38:25.628 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T10:38:25.641 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:25.641 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T10:38:25.713 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:25.712+0000 7fcb1d97f1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T10:38:25.740 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:25.740+0000 7fb6d16791c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-18T10:38:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.742+0000 7fc51416f700 1 Processor -- start 2024-04-18T10:38:25.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.742+0000 7fc51416f700 1 -- start start 2024-04-18T10:38:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51416f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc50c0a24f0 0x7fc50c0a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51416f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a49a0 0x7fc50c141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51416f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc50c0a31e0 0x7fc50c144010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51416f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50c0a3c80 con 0x7fc50c0a31e0 2024-04-18T10:38:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51416f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c06da50 con 0x7fc50c0a49a0 2024-04-18T10:38:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51416f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c06dd10 con 0x7fc50c0a24f0 2024-04-18T10:38:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51170a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a49a0 0x7fc50c141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51270c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc50c0a31e0 0x7fc50c144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51170a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a49a0 0x7fc50c141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49694/0 (socket says 172.21.15.31:49694) 2024-04-18T10:38:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51170a700 1 -- 172.21.15.31:0/1221998184 learned_addr learned my addr 172.21.15.31:0/1221998184 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51170a700 1 -- 172.21.15.31:0/1221998184 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc50c0a24f0 msgr2=0x7fc50c0a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.743+0000 7fc51170a700 1 --2- 172.21.15.31:0/1221998184 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc50c0a24f0 0x7fc50c0a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.744+0000 7fc51170a700 1 -- 172.21.15.31:0/1221998184 >> v2:172.21.15.31:3300/0 conn(0x7fc50c0a31e0 msgr2=0x7fc50c144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.744+0000 7fc51170a700 1 --2- 172.21.15.31:0/1221998184 >> v2:172.21.15.31:3300/0 conn(0x7fc50c0a31e0 0x7fc50c144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.744+0000 7fc51170a700 1 -- 172.21.15.31:0/1221998184 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0a3920 con 0x7fc50c0a49a0 2024-04-18T10:38:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.744+0000 7fc51270c700 1 --2- 172.21.15.31:0/1221998184 >> v2:172.21.15.31:3300/0 conn(0x7fc50c0a31e0 0x7fc50c144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:38:25.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.744+0000 7fc51170a700 1 --2- 172.21.15.31:0/1221998184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a49a0 0x7fc50c141ac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0099b0 tx=0x7fc4fc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee1660cd4604a89c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.746+0000 7fc510f09700 1 -- 172.21.15.31:0/1221998184 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00b8f0 con 0x7fc50c0a49a0 2024-04-18T10:38:25.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.746+0000 7fc510f09700 1 -- 172.21.15.31:0/1221998184 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc00ba50 con 0x7fc50c0a49a0 2024-04-18T10:38:25.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.746+0000 7fc510f09700 1 -- 172.21.15.31:0/1221998184 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00bdf0 con 0x7fc50c0a49a0 2024-04-18T10:38:25.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.747+0000 7fc51416f700 1 -- 172.21.15.31:0/1221998184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a49a0 msgr2=0x7fc50c141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.747+0000 7fc51416f700 1 --2- 172.21.15.31:0/1221998184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a49a0 0x7fc50c141ac0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc0099b0 tx=0x7fc4fc009250 comp rx=0 tx=0).stop 2024-04-18T10:38:25.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.747+0000 7fc51416f700 1 -- 172.21.15.31:0/1221998184 shutdown_connections 2024-04-18T10:38:25.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.747+0000 7fc51416f700 1 --2- 172.21.15.31:0/1221998184 >> v2:172.21.15.31:3300/0 conn(0x7fc50c0a31e0 0x7fc50c144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.747+0000 7fc51416f700 1 --2- 172.21.15.31:0/1221998184 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc50c0a24f0 0x7fc50c0a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.747+0000 7fc51416f700 1 --2- 172.21.15.31:0/1221998184 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a49a0 0x7fc50c141ac0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.747+0000 7fc51416f700 1 -- 172.21.15.31:0/1221998184 >> 172.21.15.31:0/1221998184 conn(0x7fc50c068af0 msgr2=0x7fc50c068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.747+0000 7fc51416f700 1 -- 172.21.15.31:0/1221998184 shutdown_connections 2024-04-18T10:38:25.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.747+0000 7fc51416f700 1 -- 172.21.15.31:0/1221998184 wait complete. 2024-04-18T10:38:25.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.749+0000 7fc51416f700 1 Processor -- start 2024-04-18T10:38:25.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.749+0000 7fc51416f700 1 -- start start 2024-04-18T10:38:25.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.749+0000 7fc51416f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a24f0 0x7fc50c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.749+0000 7fc51416f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc50c0a31e0 0x7fc50c13b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc51416f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50c0a49a0 0x7fc50c0a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc51416f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0a16c0 con 0x7fc50c0a49a0 2024-04-18T10:38:25.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc51416f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c13c580 con 0x7fc50c0a24f0 2024-04-18T10:38:25.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc51416f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c0a5d70 con 0x7fc50c0a31e0 2024-04-18T10:38:25.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc511f0b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a24f0 0x7fc50c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc511f0b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a24f0 0x7fc50c0a5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49700/0 (socket says 172.21.15.31:49700) 2024-04-18T10:38:25.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc511f0b700 1 -- 172.21.15.31:0/2692575657 learned_addr learned my addr 172.21.15.31:0/2692575657 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc511f0b700 1 -- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc50c0a31e0 msgr2=0x7fc50c13b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc511f0b700 1 --2- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc50c0a31e0 0x7fc50c13b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc511f0b700 1 -- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50c0a49a0 msgr2=0x7fc50c0a0a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc511f0b700 1 --2- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50c0a49a0 0x7fc50c0a0a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.750+0000 7fc511f0b700 1 -- 172.21.15.31:0/2692575657 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0094f0 con 0x7fc50c0a24f0 2024-04-18T10:38:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.751+0000 7fc511f0b700 1 --2- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a24f0 0x7fc50c0a5830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc50400bc30 tx=0x7fc504009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.751+0000 7fc501ffb700 1 -- 172.21.15.31:0/2692575657 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5040092e0 con 0x7fc50c0a24f0 2024-04-18T10:38:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.751+0000 7fc501ffb700 1 -- 172.21.15.31:0/2692575657 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50400c7a0 con 0x7fc50c0a24f0 2024-04-18T10:38:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.751+0000 7fc501ffb700 1 -- 172.21.15.31:0/2692575657 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400cb80 con 0x7fc50c0a24f0 2024-04-18T10:38:25.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.751+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c155960 con 0x7fc50c0a24f0 2024-04-18T10:38:25.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.752+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50c13bfc0 con 0x7fc50c0a24f0 2024-04-18T10:38:25.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.753+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50c0651b0 con 0x7fc50c0a24f0 2024-04-18T10:38:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.759+0000 7fc501ffb700 1 -- 172.21.15.31:0/2692575657 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7fc504012070 con 0x7fc50c0a24f0 2024-04-18T10:38:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.759+0000 7fc501ffb700 1 -- 172.21.15.31:0/2692575657 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc50404b890 con 0x7fc50c0a24f0 2024-04-18T10:38:25.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.759+0000 7fc51170a700 1 -- 172.21.15.31:0/2692575657 >> v1:172.21.15.31:6816/39551 conn(0x7fc4f0039520 legacy=0x7fc4f003b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:25.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.759+0000 7fc501ffb700 1 -- 172.21.15.31:0/2692575657 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7fc504030200 con 0x7fc50c0a24f0 2024-04-18T10:38:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.786+0000 7ff9e0dbb700 1 Processor -- start 2024-04-18T10:38:25.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.786+0000 7ff9e0dbb700 1 -- start start 2024-04-18T10:38:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9e0dbb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff9dc069200 0x7ff9dc0a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9e0dbb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc146af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9e0dbb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9dc0a2bc0 con 0x7ff9dc0a4100 2024-04-18T10:38:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9e0dbb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9dc0a4590 con 0x7ff9dc069200 2024-04-18T10:38:25.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9e0dbb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0a6160 con 0x7ff9dc13ffd0 2024-04-18T10:38:25.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9dad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9dad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49710/0 (socket says 172.21.15.31:49710) 2024-04-18T10:38:25.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9d9d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff9dc0a4100 0x7ff9dc13f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48168/0 (socket says 172.21.15.31:48168) 2024-04-18T10:38:25.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9dad9d700 1 -- 172.21.15.31:0/733624894 learned_addr learned my addr 172.21.15.31:0/733624894 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9da59c700 1 --2- 172.21.15.31:0/733624894 >> v2:172.21.15.31:3300/0 conn(0x7ff9dc069200 0x7ff9dc0a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9dad9d700 1 -- 172.21.15.31:0/733624894 >> v2:172.21.15.31:3300/0 conn(0x7ff9dc069200 msgr2=0x7ff9dc0a3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9dad9d700 1 --2- 172.21.15.31:0/733624894 >> v2:172.21.15.31:3300/0 conn(0x7ff9dc069200 0x7ff9dc0a3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9dad9d700 1 -- 172.21.15.31:0/733624894 >> v1:172.21.15.31:6789/0 conn(0x7ff9dc0a4100 legacy=0x7ff9dc13f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.787+0000 7ff9dad9d700 1 -- 172.21.15.31:0/733624894 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc0a2540 con 0x7ff9dc13ffd0 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.788+0000 7ff9da59c700 1 --2- 172.21.15.31:0/733624894 >> v2:172.21.15.31:3300/0 conn(0x7ff9dc069200 0x7ff9dc0a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.788+0000 7ff9dad9d700 1 --2- 172.21.15.31:0/733624894 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc146af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00099b0 tx=0x7ff9d0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61b2728d0e34f037 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.788+0000 7ff9d959a700 1 -- 172.21.15.31:0/733624894 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000b860 con 0x7ff9dc13ffd0 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.788+0000 7ff9d959a700 1 -- 172.21.15.31:0/733624894 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000b9c0 con 0x7ff9dc13ffd0 2024-04-18T10:38:25.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.788+0000 7ff9d959a700 1 -- 172.21.15.31:0/733624894 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000bd40 con 0x7ff9dc13ffd0 2024-04-18T10:38:25.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.789+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/733624894 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 msgr2=0x7ff9dc146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.789+0000 7ff9e0dbb700 1 --2- 172.21.15.31:0/733624894 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc146af0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00099b0 tx=0x7ff9d0009250 comp rx=0 tx=0).stop 2024-04-18T10:38:25.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.789+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/733624894 shutdown_connections 2024-04-18T10:38:25.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.789+0000 7ff9e0dbb700 1 --2- 172.21.15.31:0/733624894 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc146af0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.789+0000 7ff9e0dbb700 1 --2- 172.21.15.31:0/733624894 >> v2:172.21.15.31:3300/0 conn(0x7ff9dc069200 0x7ff9dc0a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.789+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/733624894 >> 172.21.15.31:0/733624894 conn(0x7ff9dc06ae80 msgr2=0x7ff9dc068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.789+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/733624894 shutdown_connections 2024-04-18T10:38:25.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.789+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/733624894 wait complete. 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.790+0000 7ff9e0dbb700 1 Processor -- start 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.790+0000 7ff9e0dbb700 1 -- start start 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.791+0000 7ff9e0dbb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9dc069200 0x7ff9dc0ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.791+0000 7ff9e0dbb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9dc0a4100 0x7ff9dc0ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.791+0000 7ff9e0dbb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.791+0000 7ff9e0dbb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc06f000 con 0x7ff9dc0a4100 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.791+0000 7ff9e0dbb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc096df0 con 0x7ff9dc13ffd0 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.791+0000 7ff9e0dbb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc0acbb0 con 0x7ff9dc069200 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.791+0000 7ff9d9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9dc0a4100 0x7ff9dc0ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.791+0000 7ff9d9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9dc0a4100 0x7ff9dc0ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38876/0 (socket says 172.21.15.31:38876) 2024-04-18T10:38:25.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.791+0000 7ff9d9d9b700 1 -- 172.21.15.31:0/1863017591 learned_addr learned my addr 172.21.15.31:0/1863017591 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.792+0000 7ff9dad9d700 1 --2- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.792+0000 7ff9d9d9b700 1 -- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9dc069200 msgr2=0x7ff9dc0ac130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.792+0000 7ff9d9d9b700 1 --2- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9dc069200 0x7ff9dc0ac130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.792+0000 7ff9d9d9b700 1 -- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 msgr2=0x7ff9dc150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.792+0000 7ff9d9d9b700 1 --2- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.792+0000 7ff9d9d9b700 1 -- 172.21.15.31:0/1863017591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00094f0 con 0x7ff9dc0a4100 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.792+0000 7ff9dad9d700 1 --2- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.792+0000 7ff9d9d9b700 1 --2- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9dc0a4100 0x7ff9dc0ac670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400cdb0 tx=0x7ff9d4001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.792+0000 7ff9ca7fc700 1 -- 172.21.15.31:0/1863017591 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4005df0 con 0x7ff9dc0a4100 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.793+0000 7ff9ca7fc700 1 -- 172.21.15.31:0/1863017591 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d400a920 con 0x7ff9dc0a4100 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.793+0000 7ff9ca7fc700 1 -- 172.21.15.31:0/1863017591 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400acc0 con 0x7ff9dc0a4100 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.793+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9dc0ade60 con 0x7ff9dc0a4100 2024-04-18T10:38:25.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.793+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9dc0ad730 con 0x7ff9dc0a4100 2024-04-18T10:38:25.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.794+0000 7ff9ca7fc700 1 -- 172.21.15.31:0/1863017591 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7ff9d4007300 con 0x7ff9dc0a4100 2024-04-18T10:38:25.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.795+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9dc096b00 con 0x7ff9dc0a4100 2024-04-18T10:38:25.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.795+0000 7ff9ca7fc700 1 -- 172.21.15.31:0/1863017591 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff9d404b9b0 con 0x7ff9dc0a4100 2024-04-18T10:38:25.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.796+0000 7ff9da59c700 1 -- 172.21.15.31:0/1863017591 >> v1:172.21.15.31:6816/39551 conn(0x7ff9bc0394d0 legacy=0x7ff9bc03b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:25.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.798+0000 7ff9ca7fc700 1 -- 172.21.15.31:0/1863017591 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7ff9d40302c0 con 0x7ff9dc0a4100 2024-04-18T10:38:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.881+0000 7f6ae14ca700 1 Processor -- start 2024-04-18T10:38:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.881+0000 7f6ae14ca700 1 -- start start 2024-04-18T10:38:25.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6ae14ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc069450 0x7f6adc0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6ae14ca700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc13f130 0x7f6adc145900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6ae14ca700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc0a59e0 con 0x7f6adc0a30c0 2024-04-18T10:38:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6ae14ca700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0a3ad0 con 0x7f6adc069450 2024-04-18T10:38:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6ae14ca700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0a57c0 con 0x7f6adc13f130 2024-04-18T10:38:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6adaffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc069450 0x7f6adc0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6adaffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc069450 0x7f6adc0a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49730/0 (socket says 172.21.15.31:49730) 2024-04-18T10:38:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6adaffd700 1 -- 172.21.15.31:0/2705212913 learned_addr learned my addr 172.21.15.31:0/2705212913 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6adb7fe700 1 --2- 172.21.15.31:0/2705212913 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc13f130 0x7f6adc145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6adaffd700 1 -- 172.21.15.31:0/2705212913 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc13f130 msgr2=0x7f6adc145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6adaffd700 1 --2- 172.21.15.31:0/2705212913 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc13f130 0x7f6adc145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6adaffd700 1 -- 172.21.15.31:0/2705212913 >> v1:172.21.15.31:6789/0 conn(0x7f6adc0a30c0 legacy=0x7f6adc13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.882+0000 7f6adaffd700 1 -- 172.21.15.31:0/2705212913 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0a4bc0 con 0x7f6adc069450 2024-04-18T10:38:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.883+0000 7f6adb7fe700 1 --2- 172.21.15.31:0/2705212913 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc13f130 0x7f6adc145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.883+0000 7f6adaffd700 1 --2- 172.21.15.31:0/2705212913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc069450 0x7f6adc0a2b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009f80 tx=0x7f6ad4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1e2cb9359bdc4bc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.883+0000 7f6ad9ffb700 1 -- 172.21.15.31:0/2705212913 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400e070 con 0x7f6adc069450 2024-04-18T10:38:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.883+0000 7f6ad9ffb700 1 -- 172.21.15.31:0/2705212913 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400ba00 con 0x7f6adc069450 2024-04-18T10:38:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.883+0000 7f6ad9ffb700 1 -- 172.21.15.31:0/2705212913 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40092e0 con 0x7f6adc069450 2024-04-18T10:38:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.884+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2705212913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc069450 msgr2=0x7f6adc0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.884+0000 7f6ae14ca700 1 --2- 172.21.15.31:0/2705212913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc069450 0x7f6adc0a2b80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009f80 tx=0x7f6ad4009840 comp rx=0 tx=0).stop 2024-04-18T10:38:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.884+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2705212913 shutdown_connections 2024-04-18T10:38:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.884+0000 7f6ae14ca700 1 --2- 172.21.15.31:0/2705212913 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc13f130 0x7f6adc145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.884+0000 7f6ae14ca700 1 --2- 172.21.15.31:0/2705212913 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc069450 0x7f6adc0a2b80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.884+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2705212913 >> 172.21.15.31:0/2705212913 conn(0x7f6adc06ae80 msgr2=0x7f6adc068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.884+0000 7f95ff4a5700 1 Processor -- start 2024-04-18T10:38:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.884+0000 7f95ff4a5700 1 -- start start 2024-04-18T10:38:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2705212913 shutdown_connections 2024-04-18T10:38:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2705212913 wait complete. 2024-04-18T10:38:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f6ae14ca700 1 Processor -- start 2024-04-18T10:38:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f95ff4a5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f806aa10 0x7f95f806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f95ff4a5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95f8137e20 0x7f95f813ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f95ff4a5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f80686a0 con 0x7f95f80682b0 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f95ff4a5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f806f4f0 con 0x7f95f8137e20 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f95ff4a5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95f806deb0 con 0x7f95f806aa10 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f95fd241700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f806aa10 0x7f95f806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f95fd241700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f806aa10 0x7f95f806ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41188/0 (socket says 172.21.15.31:41188) 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.885+0000 7f95fd241700 1 -- 172.21.15.31:0/990199260 learned_addr learned my addr 172.21.15.31:0/990199260 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f95fd241700 1 -- 172.21.15.31:0/990199260 >> v2:172.21.15.31:3300/0 conn(0x7f95f8137e20 msgr2=0x7f95f813ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f95fd241700 1 --2- 172.21.15.31:0/990199260 >> v2:172.21.15.31:3300/0 conn(0x7f95f8137e20 0x7f95f813ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f95fd241700 1 -- 172.21.15.31:0/990199260 >> v1:172.21.15.31:6789/0 conn(0x7f95f80682b0 legacy=0x7f95f8137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f95fd241700 1 -- 172.21.15.31:0/990199260 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f806f230 con 0x7f95f806aa10 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f95fd241700 1 --2- 172.21.15.31:0/990199260 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f806aa10 0x7f95f806ec10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f95f400ffd0 tx=0x7f95f400fa80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fadd8dd7e3a5a43 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f95effff700 1 -- 172.21.15.31:0/990199260 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400f0c0 con 0x7f95f806aa10 2024-04-18T10:38:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f95effff700 1 -- 172.21.15.31:0/990199260 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4005ce0 con 0x7f95f806aa10 2024-04-18T10:38:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f95effff700 1 -- 172.21.15.31:0/990199260 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4026640 con 0x7f95f806aa10 2024-04-18T10:38:25.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.886+0000 7f6ae14ca700 1 -- start start 2024-04-18T10:38:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f95ff4a5700 1 -- 172.21.15.31:0/990199260 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f806aa10 msgr2=0x7f95f806ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f95ff4a5700 1 --2- 172.21.15.31:0/990199260 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f806aa10 0x7f95f806ec10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f95f400ffd0 tx=0x7f95f400fa80 comp rx=0 tx=0).stop 2024-04-18T10:38:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f95ff4a5700 1 -- 172.21.15.31:0/990199260 shutdown_connections 2024-04-18T10:38:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f95ff4a5700 1 --2- 172.21.15.31:0/990199260 >> v2:172.21.15.31:3300/0 conn(0x7f95f8137e20 0x7f95f813ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f95ff4a5700 1 --2- 172.21.15.31:0/990199260 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f806aa10 0x7f95f806ec10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f95ff4a5700 1 -- 172.21.15.31:0/990199260 >> 172.21.15.31:0/990199260 conn(0x7f95f8069a10 msgr2=0x7f95f80679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f95ff4a5700 1 -- 172.21.15.31:0/990199260 shutdown_connections 2024-04-18T10:38:25.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f95ff4a5700 1 -- 172.21.15.31:0/990199260 wait complete. 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f6ae14ca700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc069450 0x7f6adc0a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f6ae14ca700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc0a30c0 0x7f6adc152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f6ae14ca700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc13f130 0x7f6adc0aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f6ae14ca700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1526a0 con 0x7f6adc0a30c0 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f6ae14ca700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1528c0 con 0x7f6adc13f130 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.887+0000 7f6ae14ca700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc152b80 con 0x7f6adc069450 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f6adaffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc069450 0x7f6adc0a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f6adaffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc069450 0x7f6adc0a93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41200/0 (socket says 172.21.15.31:41200) 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f6adaffd700 1 -- 172.21.15.31:0/2624909525 learned_addr learned my addr 172.21.15.31:0/2624909525 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f6adaffd700 1 -- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc13f130 msgr2=0x7f6adc0aa9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f6adaffd700 1 --2- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc13f130 0x7f6adc0aa9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f6adaffd700 1 -- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc0a30c0 msgr2=0x7f6adc152160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f6adaffd700 1 --2- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc0a30c0 0x7f6adc152160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.888+0000 7f6adaffd700 1 -- 172.21.15.31:0/2624909525 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0009420 con 0x7f6adc069450 2024-04-18T10:38:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.889+0000 7f6adaffd700 1 --2- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc069450 0x7f6adc0a93b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4012740 tx=0x7f6ad4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.889+0000 7f95ff4a5700 1 Processor -- start 2024-04-18T10:38:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.889+0000 7f6ac2ffd700 1 -- 172.21.15.31:0/2624909525 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40092e0 con 0x7f6adc069450 2024-04-18T10:38:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.889+0000 7f6ac2ffd700 1 -- 172.21.15.31:0/2624909525 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4012cd0 con 0x7f6adc069450 2024-04-18T10:38:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.889+0000 7f6ac2ffd700 1 -- 172.21.15.31:0/2624909525 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad401d670 con 0x7f6adc069450 2024-04-18T10:38:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.889+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad4009ae0 con 0x7f6adc069450 2024-04-18T10:38:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.889+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc0a85a0 con 0x7f6adc069450 2024-04-18T10:38:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.891+0000 7f6ac2ffd700 1 -- 172.21.15.31:0/2624909525 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f6ad401daa0 con 0x7f6adc069450 2024-04-18T10:38:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.889+0000 7f95ff4a5700 1 -- start start 2024-04-18T10:38:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.890+0000 7f95ff4a5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f80682b0 0x7f95f80a7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.890+0000 7f95ff4a5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95f806aa10 0x7f95f8136790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.890+0000 7f95ff4a5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f8137e20 0x7f95f8136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.890+0000 7f95ff4a5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80ae3e0 con 0x7f95f8137e20 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.890+0000 7f95ff4a5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8137210 con 0x7f95f806aa10 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.890+0000 7f95ff4a5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80a91a0 con 0x7f95f80682b0 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.891+0000 7f95fd241700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f80682b0 0x7f95f80a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.891+0000 7f95fd241700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f80682b0 0x7f95f80a7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41202/0 (socket says 172.21.15.31:41202) 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.891+0000 7f95fd241700 1 -- 172.21.15.31:0/143267854 learned_addr learned my addr 172.21.15.31:0/143267854 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.891+0000 7f95fca40700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95f806aa10 0x7f95f8136790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.891+0000 7f6ac2ffd700 1 -- 172.21.15.31:0/2624909525 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6ad404cff0 con 0x7f6adc069450 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f6ada7fc700 1 -- 172.21.15.31:0/2624909525 >> v1:172.21.15.31:6816/39551 conn(0x7f6ac80394d0 legacy=0x7f6ac803b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:25.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc0052b0 con 0x7f6adc069450 2024-04-18T10:38:25.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f95fda42700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f8137e20 0x7f95f8136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:25.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f95fca40700 1 -- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f80682b0 msgr2=0x7f95f80a7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f95fca40700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f80682b0 0x7f95f80a7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f95fca40700 1 -- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f8137e20 msgr2=0x7f95f8136cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f95fca40700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f8137e20 0x7f95f8136cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f95fca40700 1 -- 172.21.15.31:0/143267854 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f400fd20 con 0x7f95f806aa10 2024-04-18T10:38:25.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f95fd241700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f80682b0 0x7f95f80a7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:25.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.892+0000 7f95fca40700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95f806aa10 0x7f95f8136790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f95e800b4c0 tx=0x7f95e8009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:25.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.893+0000 7f95ed7fa700 1 -- 172.21.15.31:0/143267854 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800be30 con 0x7f95f806aa10 2024-04-18T10:38:25.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.893+0000 7f95ed7fa700 1 -- 172.21.15.31:0/143267854 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800f510 con 0x7f95f806aa10 2024-04-18T10:38:25.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.893+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f80a7bb0 con 0x7f95f806aa10 2024-04-18T10:38:25.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.893+0000 7f95ed7fa700 1 -- 172.21.15.31:0/143267854 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800f8d0 con 0x7f95f806aa10 2024-04-18T10:38:25.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.893+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f80a8ec0 con 0x7f95f806aa10 2024-04-18T10:38:25.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.895+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f8064920 con 0x7f95f806aa10 2024-04-18T10:38:25.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.896+0000 7f95ed7fa700 1 -- 172.21.15.31:0/143267854 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f95e800fc80 con 0x7f95f806aa10 2024-04-18T10:38:25.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.897+0000 7f95ed7fa700 1 -- 172.21.15.31:0/143267854 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f95e804b140 con 0x7f95f806aa10 2024-04-18T10:38:25.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.897+0000 7f95fd241700 1 -- 172.21.15.31:0/143267854 >> v1:172.21.15.31:6816/39551 conn(0x7f95dc039520 legacy=0x7f95dc03b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:25.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.899+0000 7f6ac2ffd700 1 -- 172.21.15.31:0/2624909525 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f6ad4008e60 con 0x7f6adc069450 2024-04-18T10:38:25.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.902+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc50c0a14a0 con 0x7fc50c0a24f0 2024-04-18T10:38:25.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.903+0000 7f95ed7fa700 1 -- 172.21.15.31:0/143267854 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f95e802fab0 con 0x7f95f806aa10 2024-04-18T10:38:25.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.903+0000 7fc501ffb700 1 -- 172.21.15.31:0/2692575657 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc504033820 con 0x7fc50c0a24f0 2024-04-18T10:38:25.903 INFO:teuthology.orchestra.run.smithi031.stdout:42949672991 2024-04-18T10:38:25.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.909+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 >> v1:172.21.15.31:6816/39551 conn(0x7fc4f0039520 legacy=0x7fc4f003b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.909+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a24f0 msgr2=0x7fc50c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.909+0000 7fc51416f700 1 --2- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a24f0 0x7fc50c0a5830 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc50400bc30 tx=0x7fc504009840 comp rx=0 tx=0).stop 2024-04-18T10:38:25.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.909+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 shutdown_connections 2024-04-18T10:38:25.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.909+0000 7fc51416f700 1 --2- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc50c0a49a0 0x7fc50c0a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.909+0000 7fc51416f700 1 --2- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc50c0a24f0 0x7fc50c0a5830 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.909+0000 7fc51416f700 1 --2- 172.21.15.31:0/2692575657 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc50c0a31e0 0x7fc50c13b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.909+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 >> 172.21.15.31:0/2692575657 conn(0x7fc50c068af0 msgr2=0x7fc50c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.911+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 shutdown_connections 2024-04-18T10:38:25.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.911+0000 7fc51416f700 1 -- 172.21.15.31:0/2692575657 wait complete. 2024-04-18T10:38:25.928 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:25.926+0000 7fcb1d97f1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T10:38:25.931 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:25.930+0000 7fb6d16791c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-18T10:38:25.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.0 2024-04-18T10:38:25.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.993+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9dc0651b0 con 0x7ff9dc0a4100 2024-04-18T10:38:25.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.993+0000 7ff9ca7fc700 1 -- 172.21.15.31:0/1863017591 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9d40338e0 con 0x7ff9dc0a4100 2024-04-18T10:38:25.994 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.995+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 >> v1:172.21.15.31:6816/39551 conn(0x7ff9bc0394d0 legacy=0x7ff9bc03b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.995+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9dc0a4100 msgr2=0x7ff9dc0ac670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.995+0000 7ff9e0dbb700 1 --2- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9dc0a4100 0x7ff9dc0ac670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400cdb0 tx=0x7ff9d4001b90 comp rx=0 tx=0).stop 2024-04-18T10:38:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.995+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 shutdown_connections 2024-04-18T10:38:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.995+0000 7ff9e0dbb700 1 --2- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff9dc069200 0x7ff9dc0ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.995+0000 7ff9e0dbb700 1 --2- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff9dc13ffd0 0x7ff9dc150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.995+0000 7ff9e0dbb700 1 --2- 172.21.15.31:0/1863017591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9dc0a4100 0x7ff9dc0ac670 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.996+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 >> 172.21.15.31:0/1863017591 conn(0x7ff9dc06ae80 msgr2=0x7ff9dc0b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:25.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.996+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 shutdown_connections 2024-04-18T10:38:25.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:25.997+0000 7ff9e0dbb700 1 -- 172.21.15.31:0/1863017591 wait complete. 2024-04-18T10:38:26.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672992 for osd.2 2024-04-18T10:38:26.010 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:26.009+0000 7fcb1d97f1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T10:38:26.015 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:26.015+0000 7fb6d16791c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-18T10:38:26.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.043+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f95f80a6140 con 0x7f95f806aa10 2024-04-18T10:38:26.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.043+0000 7f95ed7fa700 1 -- 172.21.15.31:0/143267854 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95e80330d0 con 0x7f95f806aa10 2024-04-18T10:38:26.043 INFO:teuthology.orchestra.run.smithi031.stdout:42949672991 2024-04-18T10:38:26.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.044+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 >> v1:172.21.15.31:6816/39551 conn(0x7f95dc039520 legacy=0x7f95dc03b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:26.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.044+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95f806aa10 msgr2=0x7f95f8136790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:26.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.044+0000 7f95ff4a5700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95f806aa10 0x7f95f8136790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f95e800b4c0 tx=0x7f95e8009060 comp rx=0 tx=0).stop 2024-04-18T10:38:26.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.046+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 shutdown_connections 2024-04-18T10:38:26.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.046+0000 7f95ff4a5700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f95f80682b0 0x7f95f80a7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:26.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.046+0000 7f95ff4a5700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f8137e20 0x7f95f8136cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:26.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.046+0000 7f95ff4a5700 1 --2- 172.21.15.31:0/143267854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f95f806aa10 0x7f95f8136790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:26.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.046+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 >> 172.21.15.31:0/143267854 conn(0x7f95f8069a10 msgr2=0x7f95f806d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:26.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.046+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 shutdown_connections 2024-04-18T10:38:26.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.046+0000 7f95ff4a5700 1 -- 172.21.15.31:0/143267854 wait complete. 2024-04-18T10:38:26.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.3 2024-04-18T10:38:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.077+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6abc005560 con 0x7f6adc069450 2024-04-18T10:38:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.077+0000 7f6ac2ffd700 1 -- 172.21.15.31:0/2624909525 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ad4001250 con 0x7f6adc069450 2024-04-18T10:38:26.078 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:26.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.078+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 >> v1:172.21.15.31:6816/39551 conn(0x7f6ac80394d0 legacy=0x7f6ac803b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:26.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.078+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc069450 msgr2=0x7f6adc0a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:26.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.078+0000 7f6ae14ca700 1 --2- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc069450 0x7f6adc0a93b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4012740 tx=0x7f6ad4017000 comp rx=0 tx=0).stop 2024-04-18T10:38:26.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.078+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 shutdown_connections 2024-04-18T10:38:26.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.078+0000 7f6ae14ca700 1 --2- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6adc069450 0x7f6adc0a93b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:26.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.078+0000 7f6ae14ca700 1 --2- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6adc13f130 0x7f6adc0aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:26.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.079+0000 7f6ae14ca700 1 --2- 172.21.15.31:0/2624909525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6adc0a30c0 0x7f6adc152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:26.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.079+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 >> 172.21.15.31:0/2624909525 conn(0x7f6adc06ae80 msgr2=0x7f6adc06e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:26.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.079+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 shutdown_connections 2024-04-18T10:38:26.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:26.079+0000 7f6ae14ca700 1 -- 172.21.15.31:0/2624909525 wait complete. 2024-04-18T10:38:26.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672992 for osd.1 2024-04-18T10:38:26.173 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:26.172+0000 7fcb1d97f1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T10:38:26.175 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:26.175+0000 7fb6d16791c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-18T10:38:26.266 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:26.266+0000 7fcb1d97f1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T10:38:26.267 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:26.267+0000 7fb6d16791c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-18T10:38:26.344 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:26.344+0000 7fcb1d97f1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T10:38:26.345 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:26.344+0000 7fb6d16791c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-18T10:38:26.524 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:26.523+0000 7fcb1d97f1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T10:38:26.524 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:26.523+0000 7fb6d16791c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-18T10:38:26.685 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:26.685+0000 7fb6d16791c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T10:38:26.686 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:26.685+0000 7fcb1d97f1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-18T10:38:26.768 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:26.767+0000 7fcb1d97f1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T10:38:26.768 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:26.767+0000 7fb6d16791c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-18T10:38:26.926 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:26.925+0000 7fcb1d97f1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T10:38:26.926 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:26.925+0000 7fb6d16791c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-18T10:38:26.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T10:38:27.011 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T10:38:27.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T10:38:27.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.065+0000 7f6187cc5700 1 Processor -- start 2024-04-18T10:38:27.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.065+0000 7f6187cc5700 1 -- start start 2024-04-18T10:38:27.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6187cc5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f618006d8f0 0x7f61801429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6187cc5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 0x7f6180143340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6187cc5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6180063f20 con 0x7f6180063b50 2024-04-18T10:38:27.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6187cc5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800ad620 con 0x7f618006d8f0 2024-04-18T10:38:27.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6187cc5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61800ac090 con 0x7f6180142ee0 2024-04-18T10:38:27.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6185a61700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6180063b50 0x7f61800acf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48208/0 (socket says 172.21.15.31:48208) 2024-04-18T10:38:27.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6185a61700 1 -- 172.21.15.31:0/3537158199 learned_addr learned my addr 172.21.15.31:0/3537158199 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:27.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6186262700 1 --2- 172.21.15.31:0/3537158199 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 0x7f6180143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6184a5f700 1 -- 172.21.15.31:0/3537158199 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022643261 0 0) 0x7f6180063f20 con 0x7f6180063b50 2024-04-18T10:38:27.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6184a5f700 1 -- 172.21.15.31:0/3537158199 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f616c003570 con 0x7f6180063b50 2024-04-18T10:38:27.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6186262700 1 -- 172.21.15.31:0/3537158199 >> v2:172.21.15.31:3300/0 conn(0x7f618006d8f0 msgr2=0x7f61801429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:27.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6186262700 1 --2- 172.21.15.31:0/3537158199 >> v2:172.21.15.31:3300/0 conn(0x7f618006d8f0 0x7f61801429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6186262700 1 -- 172.21.15.31:0/3537158199 >> v1:172.21.15.31:6789/0 conn(0x7f6180063b50 legacy=0x7f61800acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.066+0000 7f6186262700 1 -- 172.21.15.31:0/3537158199 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61800ac350 con 0x7f6180142ee0 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.067+0000 7f6186262700 1 --2- 172.21.15.31:0/3537158199 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 0x7f6180143340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6178009e60 tx=0x7f6178009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16c07b8b92dc71d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.067+0000 7f6184a5f700 1 -- 172.21.15.31:0/3537158199 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800e070 con 0x7f6180142ee0 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.067+0000 7f6184a5f700 1 -- 172.21.15.31:0/3537158199 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617800bb60 con 0x7f6180142ee0 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.067+0000 7f6184a5f700 1 -- 172.21.15.31:0/3537158199 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6178012430 con 0x7f6180142ee0 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.067+0000 7f6187cc5700 1 -- 172.21.15.31:0/3537158199 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 msgr2=0x7f6180143340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.067+0000 7f6187cc5700 1 --2- 172.21.15.31:0/3537158199 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 0x7f6180143340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6178009e60 tx=0x7f6178009780 comp rx=0 tx=0).stop 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.068+0000 7f6187cc5700 1 -- 172.21.15.31:0/3537158199 shutdown_connections 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.068+0000 7f6187cc5700 1 --2- 172.21.15.31:0/3537158199 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 0x7f6180143340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.068+0000 7f6187cc5700 1 --2- 172.21.15.31:0/3537158199 >> v2:172.21.15.31:3300/0 conn(0x7f618006d8f0 0x7f61801429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.068+0000 7f6187cc5700 1 -- 172.21.15.31:0/3537158199 >> 172.21.15.31:0/3537158199 conn(0x7f61800b1390 msgr2=0x7f61800b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.068+0000 7f6187cc5700 1 -- 172.21.15.31:0/3537158199 shutdown_connections 2024-04-18T10:38:27.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.068+0000 7f6187cc5700 1 -- 172.21.15.31:0/3537158199 wait complete. 2024-04-18T10:38:27.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.069+0000 7f6187cc5700 1 Processor -- start 2024-04-18T10:38:27.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.069+0000 7f6187cc5700 1 -- start start 2024-04-18T10:38:27.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.070+0000 7f6187cc5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6180063b50 0x7f61800aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.070+0000 7f6187cc5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f618006d8f0 0x7f6180121790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.070+0000 7f6187cc5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 0x7f61800a7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.070+0000 7f6187cc5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61800aae30 con 0x7f6180063b50 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.070+0000 7f6187cc5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6180121cd0 con 0x7f618006d8f0 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.070+0000 7f6187cc5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61801556a0 con 0x7f6180142ee0 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185a61700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6180063b50 0x7f61800aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185260700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f618006d8f0 0x7f6180121790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185a61700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6180063b50 0x7f61800aa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38916/0 (socket says 172.21.15.31:38916) 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185a61700 1 -- 172.21.15.31:0/3265277461 learned_addr learned my addr 172.21.15.31:0/3265277461 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6186262700 1 --2- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 0x7f61800a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185a61700 1 -- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 msgr2=0x7f61800a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185a61700 1 --2- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 0x7f61800a7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185a61700 1 -- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f618006d8f0 msgr2=0x7f6180121790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185a61700 1 --2- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f618006d8f0 0x7f6180121790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185a61700 1 -- 172.21.15.31:0/3265277461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6178009a20 con 0x7f6180063b50 2024-04-18T10:38:27.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185260700 1 --2- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f618006d8f0 0x7f6180121790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:27.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.071+0000 7f6185a61700 1 --2- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6180063b50 0x7f61800aa520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c7c0 tx=0x7f617c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:27.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.072+0000 7f6175ffb700 1 -- 172.21.15.31:0/3265277461 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c005b30 con 0x7f6180063b50 2024-04-18T10:38:27.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.072+0000 7f6175ffb700 1 -- 172.21.15.31:0/3265277461 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c005c90 con 0x7f6180063b50 2024-04-18T10:38:27.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.072+0000 7f6175ffb700 1 -- 172.21.15.31:0/3265277461 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0072e0 con 0x7f6180063b50 2024-04-18T10:38:27.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.072+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6180155960 con 0x7f6180063b50 2024-04-18T10:38:27.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.072+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6180156090 con 0x7f6180063b50 2024-04-18T10:38:27.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.073+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61800651b0 con 0x7f6180063b50 2024-04-18T10:38:27.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.073+0000 7f6175ffb700 1 -- 172.21.15.31:0/3265277461 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f617c01b3b0 con 0x7f6180063b50 2024-04-18T10:38:27.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.074+0000 7f6175ffb700 1 -- 172.21.15.31:0/3265277461 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f617c04ad40 con 0x7f6180063b50 2024-04-18T10:38:27.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.074+0000 7f6185260700 1 -- 172.21.15.31:0/3265277461 >> v1:172.21.15.31:6816/39551 conn(0x7f61640394d0 legacy=0x7f616403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:27.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.079+0000 7f6175ffb700 1 -- 172.21.15.31:0/3265277461 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f617c02f690 con 0x7f6180063b50 2024-04-18T10:38:27.094 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T10:38:27.119 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:27.118+0000 7fcb1d97f1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T10:38:27.123 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:27.123+0000 7fb6d16791c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-18T10:38:27.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.156+0000 7f76a4152700 1 Processor -- start 2024-04-18T10:38:27.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.156+0000 7f76a4152700 1 -- start start 2024-04-18T10:38:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.157+0000 7f76a4152700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 0x7f769c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.157+0000 7f76a4152700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f769c13f130 0x7f769c145900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.157+0000 7f76a4152700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0a59e0 con 0x7f769c0a30c0 2024-04-18T10:38:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.157+0000 7f76a4152700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c0a3ad0 con 0x7f769c13f130 2024-04-18T10:38:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.157+0000 7f76a4152700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0a57c0 con 0x7f769c069450 2024-04-18T10:38:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a26ef700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f769c13f130 0x7f769c145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a16ed700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f769c0a30c0 0x7f769c13ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48218/0 (socket says 172.21.15.31:48218) 2024-04-18T10:38:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a16ed700 1 -- 172.21.15.31:0/298132854 learned_addr learned my addr 172.21.15.31:0/298132854 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a26ef700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f769c13f130 0x7f769c145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38922/0 (socket says 172.21.15.31:38922) 2024-04-18T10:38:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a1eee700 1 --2- 172.21.15.31:0/298132854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 0x7f769c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a26ef700 1 -- 172.21.15.31:0/298132854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 msgr2=0x7f769c0a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a26ef700 1 --2- 172.21.15.31:0/298132854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 0x7f769c0a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a26ef700 1 -- 172.21.15.31:0/298132854 >> v1:172.21.15.31:6789/0 conn(0x7f769c0a30c0 legacy=0x7f769c13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a26ef700 1 -- 172.21.15.31:0/298132854 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c0a4bc0 con 0x7f769c13f130 2024-04-18T10:38:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.158+0000 7f76a26ef700 1 --2- 172.21.15.31:0/298132854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c13f130 0x7f769c145900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7694009e60 tx=0x7f7694009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09a018dfb533173 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.159+0000 7f76a0eec700 1 -- 172.21.15.31:0/298132854 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400e070 con 0x7f769c13f130 2024-04-18T10:38:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.159+0000 7f76a0eec700 1 -- 172.21.15.31:0/298132854 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769400bb60 con 0x7f769c13f130 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.159+0000 7f76a0eec700 1 -- 172.21.15.31:0/298132854 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694012430 con 0x7f769c13f130 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.159+0000 7f76a4152700 1 -- 172.21.15.31:0/298132854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c13f130 msgr2=0x7f769c145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.159+0000 7f76a4152700 1 --2- 172.21.15.31:0/298132854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c13f130 0x7f769c145900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7694009e60 tx=0x7f7694009780 comp rx=0 tx=0).stop 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.160+0000 7f76a4152700 1 -- 172.21.15.31:0/298132854 shutdown_connections 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.160+0000 7f76a4152700 1 --2- 172.21.15.31:0/298132854 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c13f130 0x7f769c145900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.160+0000 7f76a4152700 1 --2- 172.21.15.31:0/298132854 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 0x7f769c0a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.160+0000 7f76a4152700 1 -- 172.21.15.31:0/298132854 >> 172.21.15.31:0/298132854 conn(0x7f769c06ae80 msgr2=0x7f769c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.160+0000 7f76a4152700 1 -- 172.21.15.31:0/298132854 shutdown_connections 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.160+0000 7f76a4152700 1 -- 172.21.15.31:0/298132854 wait complete. 2024-04-18T10:38:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.161+0000 7f76a4152700 1 Processor -- start 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.161+0000 7f76a4152700 1 -- start start 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.162+0000 7f76a4152700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 0x7f769c0a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.162+0000 7f76a4152700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c0a30c0 0x7f769c0a8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.162+0000 7f76a4152700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f769c13f130 0x7f769c0a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.162+0000 7f76a4152700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0a7ae0 con 0x7f769c0a30c0 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.162+0000 7f76a4152700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c149dd0 con 0x7f769c069450 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.162+0000 7f76a4152700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769c149f40 con 0x7f769c13f130 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.162+0000 7f76a16ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c0a30c0 0x7f769c0a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.162+0000 7f76a16ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c0a30c0 0x7f769c0a8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38934/0 (socket says 172.21.15.31:38934) 2024-04-18T10:38:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f76a16ed700 1 -- 172.21.15.31:0/3061384379 learned_addr learned my addr 172.21.15.31:0/3061384379 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f76a1eee700 1 --2- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 0x7f769c0a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f76a16ed700 1 -- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f769c13f130 msgr2=0x7f769c0a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f76a16ed700 1 --2- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f769c13f130 0x7f769c0a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f76a16ed700 1 -- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 msgr2=0x7f769c0a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f76a16ed700 1 --2- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 0x7f769c0a75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f76a16ed700 1 -- 172.21.15.31:0/3061384379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7694009a20 con 0x7f769c0a30c0 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f76a16ed700 1 --2- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c0a30c0 0x7f769c0a8870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c7c0 tx=0x7f768c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f7691ffb700 1 -- 172.21.15.31:0/3061384379 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c005b30 con 0x7f769c0a30c0 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.163+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769c13e1d0 con 0x7f769c0a30c0 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.164+0000 7f7691ffb700 1 -- 172.21.15.31:0/3061384379 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c005cb0 con 0x7f769c0a30c0 2024-04-18T10:38:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.164+0000 7f7691ffb700 1 -- 172.21.15.31:0/3061384379 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c004a80 con 0x7f769c0a30c0 2024-04-18T10:38:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.164+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c0a7080 con 0x7f769c0a30c0 2024-04-18T10:38:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.165+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c0b1b50 con 0x7f769c0a30c0 2024-04-18T10:38:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.165+0000 7f7691ffb700 1 -- 172.21.15.31:0/3061384379 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f768c0070f0 con 0x7f769c0a30c0 2024-04-18T10:38:27.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.165+0000 7f7691ffb700 1 -- 172.21.15.31:0/3061384379 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f768c053350 con 0x7f769c0a30c0 2024-04-18T10:38:27.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.171+0000 7f76a1eee700 1 -- 172.21.15.31:0/3061384379 >> v1:172.21.15.31:6816/39551 conn(0x7f76800394d0 legacy=0x7f768003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:27.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.171+0000 7f7691ffb700 1 -- 172.21.15.31:0/3061384379 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f768c050060 con 0x7f769c0a30c0 2024-04-18T10:38:27.237 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:27.237+0000 7fcb1d97f1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T10:38:27.238 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:27.238+0000 7fb6d16791c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-18T10:38:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.241+0000 7f87fa3ad700 1 Processor -- start 2024-04-18T10:38:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.242+0000 7f87fa3ad700 1 -- start start 2024-04-18T10:38:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87fa3ad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 0x7f87f40679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87fa3ad700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f406ea20 0x7f87f4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87fa3ad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87f40a14b0 0x7f87f4068460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87fa3ad700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f40a19f0 con 0x7f87f40a14b0 2024-04-18T10:38:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87fa3ad700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40a1c90 con 0x7f87f4069200 2024-04-18T10:38:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87fa3ad700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87f406f140 con 0x7f87f406ea20 2024-04-18T10:38:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f894a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87f40a14b0 0x7f87f4068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f406ea20 0x7f87f4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f894a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87f40a14b0 0x7f87f4068460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38942/0 (socket says 172.21.15.31:38942) 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f406ea20 0x7f87f4067f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41226/0 (socket says 172.21.15.31:41226) 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f894a700 1 -- 172.21.15.31:0/1283815941 learned_addr learned my addr 172.21.15.31:0/1283815941 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f37fe700 1 -- 172.21.15.31:0/1283815941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 msgr2=0x7f87f40679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f37fe700 1 --2- 172.21.15.31:0/1283815941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 0x7f87f40679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f37fe700 1 -- 172.21.15.31:0/1283815941 >> v2:172.21.15.31:3300/0 conn(0x7f87f40a14b0 msgr2=0x7f87f4068460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f37fe700 1 --2- 172.21.15.31:0/1283815941 >> v2:172.21.15.31:3300/0 conn(0x7f87f40a14b0 0x7f87f4068460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.243+0000 7f87f37fe700 1 -- 172.21.15.31:0/1283815941 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40695d0 con 0x7f87f406ea20 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.244+0000 7f87f37fe700 1 --2- 172.21.15.31:0/1283815941 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f406ea20 0x7f87f4067f20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f87e40098e0 tx=0x7f87e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f9df8a259f8523 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.244+0000 7f87f2ffd700 1 -- 172.21.15.31:0/1283815941 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e400b640 con 0x7f87f406ea20 2024-04-18T10:38:27.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.244+0000 7f87f2ffd700 1 -- 172.21.15.31:0/1283815941 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e400b7a0 con 0x7f87f406ea20 2024-04-18T10:38:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.244+0000 7f87f2ffd700 1 -- 172.21.15.31:0/1283815941 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e400bb40 con 0x7f87f406ea20 2024-04-18T10:38:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.245+0000 7f87fa3ad700 1 -- 172.21.15.31:0/1283815941 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f406ea20 msgr2=0x7f87f4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.245+0000 7f87fa3ad700 1 --2- 172.21.15.31:0/1283815941 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f406ea20 0x7f87f4067f20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f87e40098e0 tx=0x7f87e40091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.245+0000 7f87fa3ad700 1 -- 172.21.15.31:0/1283815941 shutdown_connections 2024-04-18T10:38:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.245+0000 7f87fa3ad700 1 --2- 172.21.15.31:0/1283815941 >> v2:172.21.15.31:3300/0 conn(0x7f87f40a14b0 0x7f87f4068460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.245+0000 7f87fa3ad700 1 --2- 172.21.15.31:0/1283815941 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 0x7f87f40679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.245+0000 7f87fa3ad700 1 --2- 172.21.15.31:0/1283815941 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f406ea20 0x7f87f4067f20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.245+0000 7f87fa3ad700 1 -- 172.21.15.31:0/1283815941 >> 172.21.15.31:0/1283815941 conn(0x7f87f406cd60 msgr2=0x7f87f4068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.245+0000 7f87fa3ad700 1 -- 172.21.15.31:0/1283815941 shutdown_connections 2024-04-18T10:38:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.245+0000 7f87fa3ad700 1 -- 172.21.15.31:0/1283815941 wait complete. 2024-04-18T10:38:27.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.247+0000 7f87fa3ad700 1 Processor -- start 2024-04-18T10:38:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.247+0000 7f87fa3ad700 1 -- start start 2024-04-18T10:38:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87fa3ad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 0x7f87f40aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87fa3ad700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87f406ea20 0x7f87f4156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87fa3ad700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f40a14b0 0x7f87f40a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87fa3ad700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4156dd0 con 0x7f87f406ea20 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87fa3ad700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40aaef0 con 0x7f87f4069200 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87fa3ad700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40a90b0 con 0x7f87f40a14b0 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87f3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 0x7f87f40aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87f3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 0x7f87f40aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49764/0 (socket says 172.21.15.31:49764) 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87f3fff700 1 -- 172.21.15.31:0/2539123567 learned_addr learned my addr 172.21.15.31:0/2539123567 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.248+0000 7f87f37fe700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87f406ea20 0x7f87f4156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.249+0000 7f87f894a700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f40a14b0 0x7f87f40a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.249+0000 7f87f3fff700 1 -- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f40a14b0 msgr2=0x7f87f40a9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.249+0000 7f87f3fff700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f40a14b0 0x7f87f40a9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.249+0000 7f87f3fff700 1 -- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87f406ea20 msgr2=0x7f87f4156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.249+0000 7f87f3fff700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87f406ea20 0x7f87f4156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.249+0000 7f87f3fff700 1 -- 172.21.15.31:0/2539123567 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e4009420 con 0x7f87f4069200 2024-04-18T10:38:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.249+0000 7f87f894a700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f40a14b0 0x7f87f40a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:38:27.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.249+0000 7f87f3fff700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 0x7f87f40aa330 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00b840 tx=0x7f87dc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:27.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.253+0000 7f87ebfff700 1 -- 172.21.15.31:0/2539123567 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00f510 con 0x7f87f4069200 2024-04-18T10:38:27.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.253+0000 7f87ebfff700 1 -- 172.21.15.31:0/2539123567 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc00f670 con 0x7f87f4069200 2024-04-18T10:38:27.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.253+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f40a8050 con 0x7f87f4069200 2024-04-18T10:38:27.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.253+0000 7f87ebfff700 1 -- 172.21.15.31:0/2539123567 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00f9f0 con 0x7f87f4069200 2024-04-18T10:38:27.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.253+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f4156940 con 0x7f87f4069200 2024-04-18T10:38:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.254+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f40651b0 con 0x7f87f4069200 2024-04-18T10:38:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.255+0000 7f87ebfff700 1 -- 172.21.15.31:0/2539123567 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f87dc01a400 con 0x7f87f4069200 2024-04-18T10:38:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.255+0000 7f87ebfff700 1 -- 172.21.15.31:0/2539123567 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f87dc04b2d0 con 0x7f87f4069200 2024-04-18T10:38:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.260+0000 7f87f37fe700 1 -- 172.21.15.31:0/2539123567 >> v1:172.21.15.31:6816/39551 conn(0x7f87d40394d0 legacy=0x7f87d403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.261+0000 7f87ebfff700 1 -- 172.21.15.31:0/2539123567 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f87dc02fce0 con 0x7f87f4069200 2024-04-18T10:38:27.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.275+0000 7f6185260700 1 -- 172.21.15.31:0/3265277461 >> v1:172.21.15.31:6816/39551 conn(0x7f61640394d0 legacy=0x7f616403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.297+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f618006e0a0 con 0x7f6180063b50 2024-04-18T10:38:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.298+0000 7f6175ffb700 1 -- 172.21.15.31:0/3265277461 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f617c017030 con 0x7f6180063b50 2024-04-18T10:38:27.299 INFO:teuthology.orchestra.run.smithi031.stdout:42949672991 2024-04-18T10:38:27.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.299+0000 7f212da57700 1 Processor -- start 2024-04-18T10:38:27.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.299+0000 7f212da57700 1 -- start start 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 >> v1:172.21.15.31:6816/39551 conn(0x7f61640394d0 legacy=0x7f616403b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6180063b50 msgr2=0x7f61800aa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 --2- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6180063b50 0x7f61800aa520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f617c00c7c0 tx=0x7f617c007e00 comp rx=0 tx=0).stop 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 shutdown_connections 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 --2- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6180142ee0 0x7f61800a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 --2- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6180063b50 0x7f61800aa520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 --2- 172.21.15.31:0/3265277461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f618006d8f0 0x7f6180121790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 >> 172.21.15.31:0/3265277461 conn(0x7f61800b1390 msgr2=0x7f61800afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 shutdown_connections 2024-04-18T10:38:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f6187cc5700 1 -- 172.21.15.31:0/3265277461 wait complete. 2024-04-18T10:38:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f212da57700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 0x7f21280a6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f212da57700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f21280b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f212da57700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280a7850 con 0x7f212813f9f0 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f212da57700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21281402a0 con 0x7f212806fa70 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f212da57700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21280a6720 con 0x7f212813fe20 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f21267fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f212813f9f0 0x7f21280b0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48232/0 (socket says 172.21.15.31:48232) 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f21267fc700 1 -- 172.21.15.31:0/2301736675 learned_addr learned my addr 172.21.15.31:0/2301736675 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.300+0000 7f21277fe700 1 --2- 172.21.15.31:0/2301736675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f21280b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.301+0000 7f2126ffd700 1 --2- 172.21.15.31:0/2301736675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 0x7f21280a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.301+0000 7f2125ffb700 1 -- 172.21.15.31:0/2301736675 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068829554 0 0) 0x7f21280a7850 con 0x7f212813f9f0 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.301+0000 7f2125ffb700 1 -- 172.21.15.31:0/2301736675 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2110003570 con 0x7f212813f9f0 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.301+0000 7f2126ffd700 1 -- 172.21.15.31:0/2301736675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 msgr2=0x7f21280b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.301+0000 7f2126ffd700 1 --2- 172.21.15.31:0/2301736675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f21280b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.301+0000 7f2126ffd700 1 -- 172.21.15.31:0/2301736675 >> v1:172.21.15.31:6789/0 conn(0x7f212813f9f0 legacy=0x7f21280b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.301+0000 7f2125ffb700 1 -- 172.21.15.31:0/2301736675 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2824638758 0 0) 0x7f2110003570 con 0x7f212813f9f0 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.301+0000 7f2126ffd700 1 -- 172.21.15.31:0/2301736675 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280a69e0 con 0x7f212806fa70 2024-04-18T10:38:27.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.301+0000 7f2126ffd700 1 --2- 172.21.15.31:0/2301736675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 0x7f21280a6060 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2118009910 tx=0x7f21180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5934d423d20d8b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:27.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.302+0000 7f2125ffb700 1 -- 172.21.15.31:0/2301736675 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c001470 con 0x7f212806fa70 2024-04-18T10:38:27.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.302+0000 7f2125ffb700 1 -- 172.21.15.31:0/2301736675 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118011420 con 0x7f212806fa70 2024-04-18T10:38:27.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.302+0000 7f2125ffb700 1 -- 172.21.15.31:0/2301736675 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180117c0 con 0x7f212806fa70 2024-04-18T10:38:27.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.303+0000 7f212da57700 1 -- 172.21.15.31:0/2301736675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 msgr2=0x7f21280a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.303+0000 7f212da57700 1 --2- 172.21.15.31:0/2301736675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 0x7f21280a6060 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2118009910 tx=0x7f21180091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.303+0000 7f212da57700 1 -- 172.21.15.31:0/2301736675 shutdown_connections 2024-04-18T10:38:27.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.303+0000 7f212da57700 1 --2- 172.21.15.31:0/2301736675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f21280b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.303+0000 7f212da57700 1 --2- 172.21.15.31:0/2301736675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 0x7f21280a6060 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.303+0000 7f212da57700 1 -- 172.21.15.31:0/2301736675 >> 172.21.15.31:0/2301736675 conn(0x7f21280638f0 msgr2=0x7f212806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:27.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.305+0000 7f212da57700 1 -- 172.21.15.31:0/2301736675 shutdown_connections 2024-04-18T10:38:27.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.305+0000 7f212da57700 1 -- 172.21.15.31:0/2301736675 wait complete. 2024-04-18T10:38:27.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.306+0000 7f212da57700 1 Processor -- start 2024-04-18T10:38:27.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.307+0000 7f212da57700 1 -- start start 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.307+0000 7f212da57700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 0x7f2128142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.307+0000 7f212da57700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f212813f9f0 0x7f212813b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.307+0000 7f212da57700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f212813bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.307+0000 7f212da57700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2128097ec0 con 0x7f212813f9f0 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.307+0000 7f212da57700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21281435c0 con 0x7f212806fa70 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.307+0000 7f212da57700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f212813c2c0 con 0x7f212813fe20 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.308+0000 7f21277fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f212813bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.308+0000 7f21277fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f212813bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41258/0 (socket says 172.21.15.31:41258) 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.308+0000 7f21277fe700 1 -- 172.21.15.31:0/3553405797 learned_addr learned my addr 172.21.15.31:0/3553405797 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:27.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.308+0000 7f21277fe700 1 -- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 msgr2=0x7f2128142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.308+0000 7f21277fe700 1 --2- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 0x7f2128142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.308+0000 7f21277fe700 1 -- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f212813f9f0 msgr2=0x7f212813b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.308+0000 7f21277fe700 1 --2- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f212813f9f0 0x7f212813b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.308+0000 7f21277fe700 1 -- 172.21.15.31:0/3553405797 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118009420 con 0x7f212813fe20 2024-04-18T10:38:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.309+0000 7f21277fe700 1 --2- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f212813bd80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2120009e20 tx=0x7f212000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.309+0000 7f210effd700 1 -- 172.21.15.31:0/3553405797 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212000cc20 con 0x7f212813fe20 2024-04-18T10:38:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.309+0000 7f210effd700 1 -- 172.21.15.31:0/3553405797 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212000f040 con 0x7f212813fe20 2024-04-18T10:38:27.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.309+0000 7f210effd700 1 -- 172.21.15.31:0/3553405797 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200243f0 con 0x7f212813fe20 2024-04-18T10:38:27.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.310+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2128143300 con 0x7f212813fe20 2024-04-18T10:38:27.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.0 2024-04-18T10:38:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.310+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2128098640 con 0x7f212813fe20 2024-04-18T10:38:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.312+0000 7f210effd700 1 -- 172.21.15.31:0/3553405797 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f21200247a0 con 0x7f212813fe20 2024-04-18T10:38:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.312+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21280651b0 con 0x7f212813fe20 2024-04-18T10:38:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.312+0000 7f2126ffd700 1 -- 172.21.15.31:0/3553405797 >> v1:172.21.15.31:6816/39551 conn(0x7f2114039500 legacy=0x7f211403b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.31:6816/39551 2024-04-18T10:38:27.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.312+0000 7f210effd700 1 -- 172.21.15.31:0/3553405797 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2120042bc0 con 0x7f212813fe20 2024-04-18T10:38:27.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.318+0000 7f210effd700 1 -- 172.21.15.31:0/3553405797 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f2120062060 con 0x7f212813fe20 2024-04-18T10:38:27.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.342+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f769c0a72d0 con 0x7f769c0a30c0 2024-04-18T10:38:27.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.342+0000 7f7691ffb700 1 -- 172.21.15.31:0/3061384379 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f768c050070 con 0x7f769c0a30c0 2024-04-18T10:38:27.343 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:27.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 >> v1:172.21.15.31:6816/39551 conn(0x7f76800394d0 legacy=0x7f768003b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:27.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c0a30c0 msgr2=0x7f769c0a8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 --2- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c0a30c0 0x7f769c0a8870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c7c0 tx=0x7f768c007f70 comp rx=0 tx=0).stop 2024-04-18T10:38:27.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 shutdown_connections 2024-04-18T10:38:27.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 --2- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f769c13f130 0x7f769c0a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 --2- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f769c069450 0x7f769c0a75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 --2- 172.21.15.31:0/3061384379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f769c0a30c0 0x7f769c0a8870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 >> 172.21.15.31:0/3061384379 conn(0x7f769c06ae80 msgr2=0x7f769c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:27.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 shutdown_connections 2024-04-18T10:38:27.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.344+0000 7f76a4152700 1 -- 172.21.15.31:0/3061384379 wait complete. 2024-04-18T10:38:27.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672992 for osd.2 2024-04-18T10:38:27.385 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:27.385+0000 7fcb1d97f1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T10:38:27.423 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:27.422+0000 7fb6d16791c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-18T10:38:27.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.446+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21280a6380 con 0x7f212813fe20 2024-04-18T10:38:27.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.446+0000 7f210effd700 1 -- 172.21.15.31:0/3553405797 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2120040bf0 con 0x7f212813fe20 2024-04-18T10:38:27.446 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:27.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 >> v1:172.21.15.31:6816/39551 conn(0x7f2114039500 legacy=0x7f211403b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:27.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 msgr2=0x7f212813bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 --2- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f212813bd80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2120009e20 tx=0x7f212000b040 comp rx=0 tx=0).stop 2024-04-18T10:38:27.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 shutdown_connections 2024-04-18T10:38:27.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 --2- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f212813fe20 0x7f212813bd80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 --2- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f212806fa70 0x7f2128142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 --2- 172.21.15.31:0/3553405797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f212813f9f0 0x7f212813b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 >> 172.21.15.31:0/3553405797 conn(0x7f21280638f0 msgr2=0x7f212806ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:27.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 shutdown_connections 2024-04-18T10:38:27.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.448+0000 7f212da57700 1 -- 172.21.15.31:0/3553405797 wait complete. 2024-04-18T10:38:27.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.454+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f87f40a01a0 con 0x7f87f4069200 2024-04-18T10:38:27.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.455+0000 7f87ebfff700 1 -- 172.21.15.31:0/2539123567 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87dc033300 con 0x7f87f4069200 2024-04-18T10:38:27.456 INFO:teuthology.orchestra.run.smithi031.stdout:42949672991 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.456+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 >> v1:172.21.15.31:6816/39551 conn(0x7f87d40394d0 legacy=0x7f87d403b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.456+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 msgr2=0x7f87f40aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.456+0000 7f87fa3ad700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 0x7f87f40aa330 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00b840 tx=0x7f87dc009250 comp rx=0 tx=0).stop 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.456+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 shutdown_connections 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.456+0000 7f87fa3ad700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f87f40a14b0 0x7f87f40a9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.456+0000 7f87fa3ad700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f87f4069200 0x7f87f40aa330 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.456+0000 7f87fa3ad700 1 --2- 172.21.15.31:0/2539123567 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87f406ea20 0x7f87f4156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.456+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 >> 172.21.15.31:0/2539123567 conn(0x7f87f406cd60 msgr2=0x7f87f4064920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.457+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 shutdown_connections 2024-04-18T10:38:27.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:27.457+0000 7f87fa3ad700 1 -- 172.21.15.31:0/2539123567 wait complete. 2024-04-18T10:38:27.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672992 for osd.1 2024-04-18T10:38:27.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.3 2024-04-18T10:38:27.504 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:27.504+0000 7fcb1d97f1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T10:38:27.542 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:27.542+0000 7fb6d16791c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-18T10:38:27.993 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:27.993+0000 7fcb1d97f1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T10:38:28.007 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:28.007+0000 7fb6d16791c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-18T10:38:28.113 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.113+0000 7fcb1d97f1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T10:38:28.124 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:28.124+0000 7fb6d16791c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-18T10:38:28.266 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.266+0000 7fcb1d97f1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T10:38:28.272 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:28.271+0000 7fb6d16791c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-18T10:38:28.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T10:38:28.357 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T10:38:28.375 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.375+0000 7fcb1d97f1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T10:38:28.377 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-04-18T10:38:28.376+0000 7fb6d16791c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-18T10:38:28.462 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcae205b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.462 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcae205b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.463 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcae205b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.463 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcae205b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.462+0000 7ff7d099f700 1 Processor -- start 2024-04-18T10:38:28.464 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcae205b700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.464 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcadf055700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.464 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcadf055700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.465 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcadf055700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.465 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcadf055700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.465 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:28.459+0000 7fcadf055700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.462+0000 7ff7d099f700 1 -- start start 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.462+0000 7ff7d099f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7cc0693c0 0x7ff7cc06ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.462+0000 7ff7d099f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc06f220 0x7ff7cc146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.462+0000 7ff7d099f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc145b30 con 0x7ff7cc0a06d0 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.462+0000 7ff7d099f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0a0d60 con 0x7ff7cc0693c0 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.462+0000 7ff7d099f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc069790 con 0x7ff7cc06f220 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.462+0000 7ff7cb7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7cc0693c0 0x7ff7cc06ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.462+0000 7ff7cb7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7cc0693c0 0x7ff7cc06ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39058/0 (socket says 172.21.15.31:39058) 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.463+0000 7ff7cb7fe700 1 -- 172.21.15.31:0/1957832510 learned_addr learned my addr 172.21.15.31:0/1957832510 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.463+0000 7ff7caffd700 1 --2- 172.21.15.31:0/1957832510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc06f220 0x7ff7cc146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.463+0000 7ff7cb7fe700 1 -- 172.21.15.31:0/1957832510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc06f220 msgr2=0x7ff7cc146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.463+0000 7ff7cb7fe700 1 --2- 172.21.15.31:0/1957832510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc06f220 0x7ff7cc146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.463+0000 7ff7cb7fe700 1 -- 172.21.15.31:0/1957832510 >> v1:172.21.15.31:6789/0 conn(0x7ff7cc0a06d0 legacy=0x7ff7cc0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.463+0000 7ff7cb7fe700 1 -- 172.21.15.31:0/1957832510 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc09fa10 con 0x7ff7cc0693c0 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.463+0000 7ff7caffd700 1 --2- 172.21.15.31:0/1957832510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc06f220 0x7ff7cc146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.463+0000 7ff7cb7fe700 1 --2- 172.21.15.31:0/1957832510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7cc0693c0 0x7ff7cc06ece0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0099b0 tx=0x7ff7bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ded2a2da3562d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.465+0000 7ff7ca7fc700 1 -- 172.21.15.31:0/1957832510 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00b820 con 0x7ff7cc0693c0 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.465+0000 7ff7ca7fc700 1 -- 172.21.15.31:0/1957832510 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00b980 con 0x7ff7cc0693c0 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.465+0000 7ff7ca7fc700 1 -- 172.21.15.31:0/1957832510 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00bd20 con 0x7ff7cc0693c0 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.466+0000 7ff7d099f700 1 -- 172.21.15.31:0/1957832510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7cc0693c0 msgr2=0x7ff7cc06ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.466+0000 7ff7d099f700 1 --2- 172.21.15.31:0/1957832510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7cc0693c0 0x7ff7cc06ece0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0099b0 tx=0x7ff7bc009250 comp rx=0 tx=0).stop 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.466+0000 7ff7d099f700 1 -- 172.21.15.31:0/1957832510 shutdown_connections 2024-04-18T10:38:28.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.466+0000 7ff7d099f700 1 --2- 172.21.15.31:0/1957832510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7cc0693c0 0x7ff7cc06ece0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.466+0000 7ff7d099f700 1 --2- 172.21.15.31:0/1957832510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc06f220 0x7ff7cc146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.466+0000 7ff7d099f700 1 -- 172.21.15.31:0/1957832510 >> 172.21.15.31:0/1957832510 conn(0x7ff7cc06cae0 msgr2=0x7ff7cc068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:28.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.466+0000 7ff7d099f700 1 -- 172.21.15.31:0/1957832510 shutdown_connections 2024-04-18T10:38:28.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.466+0000 7ff7d099f700 1 -- 172.21.15.31:0/1957832510 wait complete. 2024-04-18T10:38:28.470 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T10:38:28.470 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T10:38:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.468+0000 7ff7d099f700 1 Processor -- start 2024-04-18T10:38:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.468+0000 7ff7d099f700 1 -- start start 2024-04-18T10:38:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.468+0000 7ff7d099f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7cc0693c0 0x7ff7cc13fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.468+0000 7ff7d099f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7cc06f220 0x7ff7cc149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.468+0000 7ff7d099f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc0a06d0 0x7ff7cc149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.468+0000 7ff7d099f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc148450 con 0x7ff7cc0693c0 2024-04-18T10:38:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.468+0000 7ff7d099f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1495b0 con 0x7ff7cc06f220 2024-04-18T10:38:28.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.468+0000 7ff7d099f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc14b220 con 0x7ff7cc0a06d0 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.469+0000 7ff7caffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7cc06f220 0x7ff7cc149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.469+0000 7ff7caffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7cc06f220 0x7ff7cc149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49876/0 (socket says 172.21.15.31:49876) 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.469+0000 7ff7caffd700 1 -- 172.21.15.31:0/2648326995 learned_addr learned my addr 172.21.15.31:0/2648326995 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.469+0000 7ff7cbfff700 1 --2- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc0a06d0 0x7ff7cc149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.469+0000 7ff7caffd700 1 -- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc0a06d0 msgr2=0x7ff7cc149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.469+0000 7ff7caffd700 1 --2- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc0a06d0 0x7ff7cc149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.469+0000 7ff7caffd700 1 -- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7cc0693c0 msgr2=0x7ff7cc13fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.469+0000 7ff7caffd700 1 --2- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7cc0693c0 0x7ff7cc13fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.469+0000 7ff7caffd700 1 -- 172.21.15.31:0/2648326995 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0094f0 con 0x7ff7cc06f220 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.470+0000 7ff7caffd700 1 --2- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7cc06f220 0x7ff7cc149930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000e8d0 tx=0x7ff7c0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.470+0000 7ff7b37fe700 1 -- 172.21.15.31:0/2648326995 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000ee70 con 0x7ff7cc06f220 2024-04-18T10:38:28.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.470+0000 7ff7b37fe700 1 -- 172.21.15.31:0/2648326995 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000c5e0 con 0x7ff7cc06f220 2024-04-18T10:38:28.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.470+0000 7ff7b37fe700 1 -- 172.21.15.31:0/2648326995 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000c9a0 con 0x7ff7cc06f220 2024-04-18T10:38:28.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.470+0000 7ff7cbfff700 1 --2- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc0a06d0 0x7ff7cc149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-18T10:38:28.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.471+0000 7ff7d099f700 1 -- 172.21.15.31:0/2648326995 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc14bee0 con 0x7ff7cc06f220 2024-04-18T10:38:28.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.471+0000 7ff7d099f700 1 -- 172.21.15.31:0/2648326995 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc148c90 con 0x7ff7cc06f220 2024-04-18T10:38:28.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.472+0000 7ff7b37fe700 1 -- 172.21.15.31:0/2648326995 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 7) v1 ==== 47597+0+0 (secure 0 0 0) 0x7ff7c0013410 con 0x7ff7cc06f220 2024-04-18T10:38:28.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.472+0000 7ff7d099f700 1 -- 172.21.15.31:0/2648326995 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc09f020 con 0x7ff7cc06f220 2024-04-18T10:38:28.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.472+0000 7ff7b37fe700 1 -- 172.21.15.31:0/2648326995 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7ff7c0053130 con 0x7ff7cc06f220 2024-04-18T10:38:28.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.478+0000 7ff7b37fe700 1 -- 172.21.15.31:0/2648326995 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7ff7c0035350 con 0x7ff7cc06f220 2024-04-18T10:38:28.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.510+0000 7f9809f69700 1 Processor -- start 2024-04-18T10:38:28.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.510+0000 7f9809f69700 1 -- start start 2024-04-18T10:38:28.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9809f69700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9804063b80 0x7f980406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9809f69700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f98040ad790 0x7f9804142c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9809f69700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040abd30 con 0x7f98041431b0 2024-04-18T10:38:28.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9809f69700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98040ac9b0 con 0x7f98040ad790 2024-04-18T10:38:28.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9809f69700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98040acc50 con 0x7f9804063b80 2024-04-18T10:38:28.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f98037fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9804063b80 0x7f980406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9802ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f98040ad790 0x7f9804142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9802ffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f98040ad790 0x7f9804142c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39078/0 (socket says 172.21.15.31:39078) 2024-04-18T10:38:28.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9802ffd700 1 -- 172.21.15.31:0/1413695363 learned_addr learned my addr 172.21.15.31:0/1413695363 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:28.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f98037fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9804063b80 0x7f980406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41376/0 (socket says 172.21.15.31:41376) 2024-04-18T10:38:28.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9802ffd700 1 -- 172.21.15.31:0/1413695363 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9804063b80 msgr2=0x7f980406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:28.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9802ffd700 1 --2- 172.21.15.31:0/1413695363 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9804063b80 0x7f980406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9802ffd700 1 -- 172.21.15.31:0/1413695363 >> v1:172.21.15.31:6789/0 conn(0x7f98041431b0 legacy=0x7f98040679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.511+0000 7f9802ffd700 1 -- 172.21.15.31:0/1413695363 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980406f720 con 0x7f98040ad790 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f9802ffd700 1 --2- 172.21.15.31:0/1413695363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 0x7f9804142c70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f97f80099b0 tx=0x7f97f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca56ba4d5e6ae2f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f98027fc700 1 -- 172.21.15.31:0/1413695363 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800b860 con 0x7f98040ad790 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f98027fc700 1 -- 172.21.15.31:0/1413695363 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f800b9c0 con 0x7f98040ad790 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f98027fc700 1 -- 172.21.15.31:0/1413695363 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800bd60 con 0x7f98040ad790 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f9809f69700 1 -- 172.21.15.31:0/1413695363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 msgr2=0x7f9804142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f9809f69700 1 --2- 172.21.15.31:0/1413695363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 0x7f9804142c70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f97f80099b0 tx=0x7f97f8009250 comp rx=0 tx=0).stop 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f9809f69700 1 -- 172.21.15.31:0/1413695363 shutdown_connections 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f9809f69700 1 --2- 172.21.15.31:0/1413695363 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9804063b80 0x7f980406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f9809f69700 1 --2- 172.21.15.31:0/1413695363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 0x7f9804142c70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.512+0000 7f9809f69700 1 -- 172.21.15.31:0/1413695363 >> 172.21.15.31:0/1413695363 conn(0x7f98040b1290 msgr2=0x7f98040b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.513+0000 7f9809f69700 1 -- 172.21.15.31:0/1413695363 shutdown_connections 2024-04-18T10:38:28.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.513+0000 7f9809f69700 1 -- 172.21.15.31:0/1413695363 wait complete. 2024-04-18T10:38:28.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9809f69700 1 Processor -- start 2024-04-18T10:38:28.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9809f69700 1 -- start start 2024-04-18T10:38:28.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9809f69700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9804063b80 0x7f98040aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9809f69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 0x7f9804121950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9809f69700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98041431b0 0x7f9804153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9809f69700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98040aabe0 con 0x7f98040ad790 2024-04-18T10:38:28.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9809f69700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98040a7fb0 con 0x7f9804063b80 2024-04-18T10:38:28.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9809f69700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9804122340 con 0x7f98041431b0 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9802ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 0x7f9804121950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.514+0000 7f9803fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98041431b0 0x7f9804153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9803fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98041431b0 0x7f9804153040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41382/0 (socket says 172.21.15.31:41382) 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9802ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 0x7f9804121950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39084/0 (socket says 172.21.15.31:39084) 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9803fff700 1 -- 172.21.15.31:0/910678152 learned_addr learned my addr 172.21.15.31:0/910678152 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9802ffd700 1 -- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98041431b0 msgr2=0x7f9804153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9802ffd700 1 --2- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98041431b0 0x7f9804153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9802ffd700 1 -- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9804063b80 msgr2=0x7f98040aa6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9802ffd700 1 --2- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9804063b80 0x7f98040aa6a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9802ffd700 1 -- 172.21.15.31:0/910678152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80094f0 con 0x7f98040ad790 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9803fff700 1 --2- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98041431b0 0x7f9804153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9802ffd700 1 --2- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 0x7f9804121950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98040b1260 tx=0x7f97f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:28.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f97eb7fe700 1 -- 172.21.15.31:0/910678152 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800b860 con 0x7f98040ad790 2024-04-18T10:38:28.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f97eb7fe700 1 -- 172.21.15.31:0/910678152 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f800bd40 con 0x7f98040ad790 2024-04-18T10:38:28.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f97eb7fe700 1 -- 172.21.15.31:0/910678152 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8024690 con 0x7f98040ad790 2024-04-18T10:38:28.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9809f69700 1 -- 172.21.15.31:0/910678152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9804152da0 con 0x7f98040ad790 2024-04-18T10:38:28.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.515+0000 7f9809f69700 1 -- 172.21.15.31:0/910678152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98040aadc0 con 0x7f98040ad790 2024-04-18T10:38:28.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.516+0000 7f9809f69700 1 -- 172.21.15.31:0/910678152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98040aa510 con 0x7f98040ad790 2024-04-18T10:38:28.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.517+0000 7f97eb7fe700 1 -- 172.21.15.31:0/910678152 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) v1 ==== 47597+0+0 (secure 0 0 0) 0x7f97f802d440 con 0x7f98040ad790 2024-04-18T10:38:28.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.518+0000 7f97eb7fe700 1 -- 172.21.15.31:0/910678152 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f97f8054d70 con 0x7f98040ad790 2024-04-18T10:38:28.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.523+0000 7f97eb7fe700 1 -- 172.21.15.31:0/910678152 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f97f80080a0 con 0x7f98040ad790 2024-04-18T10:38:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.608+0000 7fd3a05a6700 1 Processor -- start 2024-04-18T10:38:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.608+0000 7fd3a05a6700 1 -- start start 2024-04-18T10:38:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7f7f32642700 1 Processor -- start 2024-04-18T10:38:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7f7f32642700 1 -- start start 2024-04-18T10:38:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd3a05a6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd398069450 0x7fd3980a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd3a05a6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd3980a30c0 0x7fd39813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd3a05a6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd39813ef60 0x7fd39806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd3a05a6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980a3ad0 con 0x7fd3980a30c0 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd3a05a6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980a57c0 con 0x7fd39813ef60 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd3a05a6700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980a59e0 con 0x7fd398069450 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39db41700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd3980a30c0 0x7fd39813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39db41700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd3980a30c0 0x7fd39813ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39094/0 (socket says 172.21.15.31:39094) 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39db41700 1 -- 172.21.15.31:0/2489174195 learned_addr learned my addr 172.21.15.31:0/2489174195 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39e342700 1 --2- 172.21.15.31:0/2489174195 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd398069450 0x7fd3980a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39eb43700 1 --2- 172.21.15.31:0/2489174195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd39813ef60 0x7fd39806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39e342700 1 -- 172.21.15.31:0/2489174195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd39813ef60 msgr2=0x7fd39806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39e342700 1 --2- 172.21.15.31:0/2489174195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd39813ef60 0x7fd39806d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39e342700 1 -- 172.21.15.31:0/2489174195 >> v2:172.21.15.31:3300/0 conn(0x7fd3980a30c0 msgr2=0x7fd39813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39e342700 1 --2- 172.21.15.31:0/2489174195 >> v2:172.21.15.31:3300/0 conn(0x7fd3980a30c0 0x7fd39813ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.609+0000 7fd39e342700 1 -- 172.21.15.31:0/2489174195 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980a4bc0 con 0x7fd398069450 2024-04-18T10:38:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f32642700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f32642700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f2c13f130 0x7f7f2c145900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f32642700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c0a59e0 con 0x7f7f2c0a30c0 2024-04-18T10:38:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f32642700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c0a3ad0 con 0x7f7f2c13f130 2024-04-18T10:38:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f32642700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0a57c0 con 0x7f7f2c069450 2024-04-18T10:38:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7fd39e342700 1 --2- 172.21.15.31:0/2489174195 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd398069450 0x7fd3980a2b80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd394009940 tx=0x7fd3940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=898aca71c7ba7be server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f30bdf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f2c13f130 0x7f7f2c145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f30bdf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f2c13f130 0x7f7f2c145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39098/0 (socket says 172.21.15.31:39098) 2024-04-18T10:38:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f30bdf700 1 -- 172.21.15.31:0/2880886744 learned_addr learned my addr 172.21.15.31:0/2880886744 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7fd39d340700 1 -- 172.21.15.31:0/2489174195 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011630 con 0x7fd398069450 2024-04-18T10:38:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f2bfff700 1 --2- 172.21.15.31:0/2880886744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7fd39d340700 1 -- 172.21.15.31:0/2489174195 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394011790 con 0x7fd398069450 2024-04-18T10:38:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7fd39d340700 1 -- 172.21.15.31:0/2489174195 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394011b50 con 0x7fd398069450 2024-04-18T10:38:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f30bdf700 1 -- 172.21.15.31:0/2880886744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 msgr2=0x7f7f2c0a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f30bdf700 1 --2- 172.21.15.31:0/2880886744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c0a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f30bdf700 1 -- 172.21.15.31:0/2880886744 >> v1:172.21.15.31:6789/0 conn(0x7f7f2c0a30c0 legacy=0x7f7f2c13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f30bdf700 1 -- 172.21.15.31:0/2880886744 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0a4bc0 con 0x7f7f2c13f130 2024-04-18T10:38:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.610+0000 7f7f30bdf700 1 --2- 172.21.15.31:0/2880886744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f2c13f130 0x7f7f2c145900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009f20 tx=0x7f7f24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375e85035f63f99b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7f7f2affd700 1 -- 172.21.15.31:0/2880886744 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2400e070 con 0x7f7f2c13f130 2024-04-18T10:38:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7f7f2affd700 1 -- 172.21.15.31:0/2880886744 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2400b9d0 con 0x7f7f2c13f130 2024-04-18T10:38:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7f7f2affd700 1 -- 172.21.15.31:0/2880886744 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240092e0 con 0x7f7f2c13f130 2024-04-18T10:38:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2489174195 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd398069450 msgr2=0x7fd3980a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7fd3a05a6700 1 --2- 172.21.15.31:0/2489174195 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd398069450 0x7fd3980a2b80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd394009940 tx=0x7fd3940091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2489174195 shutdown_connections 2024-04-18T10:38:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7fd3a05a6700 1 --2- 172.21.15.31:0/2489174195 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd39813ef60 0x7fd39806d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7fd3a05a6700 1 --2- 172.21.15.31:0/2489174195 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd398069450 0x7fd3980a2b80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7fd3a05a6700 1 --2- 172.21.15.31:0/2489174195 >> v2:172.21.15.31:3300/0 conn(0x7fd3980a30c0 0x7fd39813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2489174195 >> 172.21.15.31:0/2489174195 conn(0x7fd39806ae80 msgr2=0x7fd398068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2489174195 shutdown_connections 2024-04-18T10:38:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2489174195 wait complete. 2024-04-18T10:38:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7f7f32642700 1 -- 172.21.15.31:0/2880886744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f2c13f130 msgr2=0x7f7f2c145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.611+0000 7f7f32642700 1 --2- 172.21.15.31:0/2880886744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f2c13f130 0x7f7f2c145900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7f24009f20 tx=0x7f7f24009840 comp rx=0 tx=0).stop 2024-04-18T10:38:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.612+0000 7f7f32642700 1 -- 172.21.15.31:0/2880886744 shutdown_connections 2024-04-18T10:38:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.612+0000 7f7f32642700 1 --2- 172.21.15.31:0/2880886744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f2c13f130 0x7f7f2c145900 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.612+0000 7f7f32642700 1 --2- 172.21.15.31:0/2880886744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c0a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.612+0000 7f7f32642700 1 -- 172.21.15.31:0/2880886744 >> 172.21.15.31:0/2880886744 conn(0x7f7f2c06ae80 msgr2=0x7f7f2c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.612+0000 7f7f32642700 1 -- 172.21.15.31:0/2880886744 shutdown_connections 2024-04-18T10:38:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.612+0000 7f7f32642700 1 -- 172.21.15.31:0/2880886744 wait complete. 2024-04-18T10:38:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.612+0000 7fd3a05a6700 1 Processor -- start 2024-04-18T10:38:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7fd3a05a6700 1 -- start start 2024-04-18T10:38:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7f7f32642700 1 Processor -- start 2024-04-18T10:38:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7f7f32642700 1 -- start start 2024-04-18T10:38:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7f7f32642700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c096eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7f7f32642700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f2c0a30c0 0x7f7f2c13b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7f7f32642700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f2c13f130 0x7f7f2c13be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7f7f32642700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c097a30 con 0x7f7f2c13f130 2024-04-18T10:38:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7f7f32642700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0a9e00 con 0x7f7f2c0a30c0 2024-04-18T10:38:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7f7f32642700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c097770 con 0x7f7f2c069450 2024-04-18T10:38:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7fd3a05a6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd398069450 0x7fd3980aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7fd3a05a6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd3980a30c0 0x7fd39814d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7fd3a05a6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd39813ef60 0x7fd39814d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7fd3a05a6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ae360 con 0x7fd39813ef60 2024-04-18T10:38:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7fd3a05a6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ad3e0 con 0x7fd398069450 2024-04-18T10:38:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7fd3a05a6700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980a9b20 con 0x7fd3980a30c0 2024-04-18T10:38:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7fd39db41700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd3980a30c0 0x7fd39814d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7fd39db41700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd3980a30c0 0x7fd39814d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41416/0 (socket says 172.21.15.31:41416) 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7fd39db41700 1 -- 172.21.15.31:0/2745466873 learned_addr learned my addr 172.21.15.31:0/2745466873 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.613+0000 7f7f2bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c096eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f2bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c096eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41406/0 (socket says 172.21.15.31:41406) 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f2bfff700 1 -- 172.21.15.31:0/3927845730 learned_addr learned my addr 172.21.15.31:0/3927845730 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f2b7fe700 1 --2- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f2c0a30c0 0x7f7f2c13b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f2bfff700 1 -- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f2c0a30c0 msgr2=0x7f7f2c13b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f2bfff700 1 --2- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f2c0a30c0 0x7f7f2c13b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f2bfff700 1 -- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f2c13f130 msgr2=0x7f7f2c13be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f2bfff700 1 --2- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f2c13f130 0x7f7f2c13be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f2bfff700 1 -- 172.21.15.31:0/3927845730 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f24009ae0 con 0x7f7f2c069450 2024-04-18T10:38:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7fd39db41700 1 -- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd398069450 msgr2=0x7fd3980aca10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7fd39db41700 1 --2- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd398069450 0x7fd3980aca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7fd39db41700 1 -- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd39813ef60 msgr2=0x7fd39814d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7fd39db41700 1 --2- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd39813ef60 0x7fd39814d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7fd39db41700 1 -- 172.21.15.31:0/2745466873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd394009420 con 0x7fd3980a30c0 2024-04-18T10:38:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f2bfff700 1 --2- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c096eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00ec80 tx=0x7f7f1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f13fff700 1 -- 172.21.15.31:0/3927845730 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c00c8e0 con 0x7f7f2c069450 2024-04-18T10:38:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7fd39db41700 1 --2- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd3980a30c0 0x7fd39814d0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd38800ec00 tx=0x7fd38800b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f13fff700 1 -- 172.21.15.31:0/3927845730 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c00ca40 con 0x7f7f2c069450 2024-04-18T10:38:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f13fff700 1 -- 172.21.15.31:0/3927845730 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c00cde0 con 0x7f7f2c069450 2024-04-18T10:38:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.614+0000 7f7f32642700 1 -- 172.21.15.31:0/3927845730 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c0aebb0 con 0x7f7f2c069450 2024-04-18T10:38:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.615+0000 7f7f32642700 1 -- 172.21.15.31:0/3927845730 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c068500 con 0x7f7f2c069450 2024-04-18T10:38:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.615+0000 7fd38e7fc700 1 -- 172.21.15.31:0/2745466873 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800dcc0 con 0x7fd3980a30c0 2024-04-18T10:38:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.615+0000 7fd38e7fc700 1 -- 172.21.15.31:0/2745466873 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800de20 con 0x7fd3980a30c0 2024-04-18T10:38:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.615+0000 7fd38e7fc700 1 -- 172.21.15.31:0/2745466873 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388010650 con 0x7fd3980a30c0 2024-04-18T10:38:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.615+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2745466873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39813c8b0 con 0x7fd3980a30c0 2024-04-18T10:38:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.615+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2745466873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3980ab7a0 con 0x7fd3980a30c0 2024-04-18T10:38:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.616+0000 7f7f32642700 1 -- 172.21.15.31:0/3927845730 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c0b15c0 con 0x7f7f2c069450 2024-04-18T10:38:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.616+0000 7fd38e7fc700 1 -- 172.21.15.31:0/2745466873 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 7) v1 ==== 47597+0+0 (secure 0 0 0) 0x7fd3880109c0 con 0x7fd3980a30c0 2024-04-18T10:38:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.616+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2745466873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3800052b0 con 0x7fd3980a30c0 2024-04-18T10:38:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.617+0000 7fd38e7fc700 1 -- 172.21.15.31:0/2745466873 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fd3880535a0 con 0x7fd3980a30c0 2024-04-18T10:38:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.616+0000 7f7f13fff700 1 -- 172.21.15.31:0/3927845730 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 7) v1 ==== 47597+0+0 (secure 0 0 0) 0x7f7f1c013680 con 0x7f7f2c069450 2024-04-18T10:38:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.617+0000 7f7f13fff700 1 -- 172.21.15.31:0/3927845730 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f7f1c053b70 con 0x7f7f2c069450 2024-04-18T10:38:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.619+0000 7f7f13fff700 1 -- 172.21.15.31:0/3927845730 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f7f1c013930 con 0x7f7f2c069450 2024-04-18T10:38:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.622+0000 7fd38e7fc700 1 -- 172.21.15.31:0/2745466873 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7fd388031e90 con 0x7fd3980a30c0 2024-04-18T10:38:28.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.701+0000 7ff7d099f700 1 -- 172.21.15.31:0/2648326995 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff7cc0651e0 con 0x7ff7cc06f220 2024-04-18T10:38:28.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.701+0000 7ff7b37fe700 1 -- 172.21.15.31:0/2648326995 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7c00136c0 con 0x7ff7cc06f220 2024-04-18T10:38:28.702 INFO:teuthology.orchestra.run.smithi031.stdout:42949672991 2024-04-18T10:38:28.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.703+0000 7ff7d099f700 1 -- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7cc06f220 msgr2=0x7ff7cc149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.703+0000 7ff7d099f700 1 --2- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7cc06f220 0x7ff7cc149930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000e8d0 tx=0x7ff7c0008040 comp rx=0 tx=0).stop 2024-04-18T10:38:28.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.703+0000 7ff7d099f700 1 -- 172.21.15.31:0/2648326995 shutdown_connections 2024-04-18T10:38:28.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.703+0000 7ff7d099f700 1 --2- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7cc0a06d0 0x7ff7cc149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.703+0000 7ff7d099f700 1 --2- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7cc0693c0 0x7ff7cc13fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.703+0000 7ff7d099f700 1 --2- 172.21.15.31:0/2648326995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7cc06f220 0x7ff7cc149930 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.703+0000 7ff7d099f700 1 -- 172.21.15.31:0/2648326995 >> 172.21.15.31:0/2648326995 conn(0x7ff7cc06cae0 msgr2=0x7ff7cc068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:28.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.703+0000 7ff7d099f700 1 -- 172.21.15.31:0/2648326995 shutdown_connections 2024-04-18T10:38:28.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.703+0000 7ff7d099f700 1 -- 172.21.15.31:0/2648326995 wait complete. 2024-04-18T10:38:28.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.0 2024-04-18T10:38:28.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.738+0000 7f9809f69700 1 -- 172.21.15.31:0/910678152 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f98040ad030 con 0x7f98040ad790 2024-04-18T10:38:28.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.739+0000 7f97eb7fe700 1 -- 172.21.15.31:0/910678152 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97f8015070 con 0x7f98040ad790 2024-04-18T10:38:28.739 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:28.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.740+0000 7f9809f69700 1 -- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 msgr2=0x7f9804121950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.740+0000 7f9809f69700 1 --2- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 0x7f9804121950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98040b1260 tx=0x7f97f8017000 comp rx=0 tx=0).stop 2024-04-18T10:38:28.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.740+0000 7f9809f69700 1 -- 172.21.15.31:0/910678152 shutdown_connections 2024-04-18T10:38:28.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.740+0000 7f9809f69700 1 --2- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f98041431b0 0x7f9804153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.740+0000 7f9809f69700 1 --2- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9804063b80 0x7f98040aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.740+0000 7f9809f69700 1 --2- 172.21.15.31:0/910678152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98040ad790 0x7f9804121950 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.740+0000 7f9809f69700 1 -- 172.21.15.31:0/910678152 >> 172.21.15.31:0/910678152 conn(0x7f98040b1290 msgr2=0x7f98040afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:28.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.740+0000 7f9809f69700 1 -- 172.21.15.31:0/910678152 shutdown_connections 2024-04-18T10:38:28.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.740+0000 7f9809f69700 1 -- 172.21.15.31:0/910678152 wait complete. 2024-04-18T10:38:28.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.747+0000 7f7f32642700 1 -- 172.21.15.31:0/3927845730 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7f2c0980e0 con 0x7f7f2c069450 2024-04-18T10:38:28.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.748+0000 7f7f13fff700 1 -- 172.21.15.31:0/3927845730 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f1c013930 con 0x7f7f2c069450 2024-04-18T10:38:28.748 INFO:teuthology.orchestra.run.smithi031.stdout:42949672991 2024-04-18T10:38:28.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.749+0000 7f7f32642700 1 -- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 msgr2=0x7f7f2c096eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.749+0000 7f7f32642700 1 --2- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c096eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00ec80 tx=0x7f7f1c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.749+0000 7f7f32642700 1 -- 172.21.15.31:0/3927845730 shutdown_connections 2024-04-18T10:38:28.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.749+0000 7f7f32642700 1 --2- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7f2c069450 0x7f7f2c096eb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.749+0000 7f7f32642700 1 --2- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f2c13f130 0x7f7f2c13be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.749+0000 7f7f32642700 1 --2- 172.21.15.31:0/3927845730 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7f2c0a30c0 0x7f7f2c13b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.749+0000 7f7f32642700 1 -- 172.21.15.31:0/3927845730 >> 172.21.15.31:0/3927845730 conn(0x7f7f2c06ae80 msgr2=0x7f7f2c13ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:28.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.749+0000 7f7f32642700 1 -- 172.21.15.31:0/3927845730 shutdown_connections 2024-04-18T10:38:28.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.749+0000 7f7f32642700 1 -- 172.21.15.31:0/3927845730 wait complete. 2024-04-18T10:38:28.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.751+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2745466873 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd380005560 con 0x7fd3980a30c0 2024-04-18T10:38:28.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.752+0000 7fd38e7fc700 1 -- 172.21.15.31:0/2745466873 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd388035680 con 0x7fd3980a30c0 2024-04-18T10:38:28.752 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:28.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672992 for osd.2 2024-04-18T10:38:28.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.754+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd3980a30c0 msgr2=0x7fd39814d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:28.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.754+0000 7fd3a05a6700 1 --2- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd3980a30c0 0x7fd39814d0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd38800ec00 tx=0x7fd38800b4f0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.754+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2745466873 shutdown_connections 2024-04-18T10:38:28.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.754+0000 7fd3a05a6700 1 --2- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd39813ef60 0x7fd39814d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.754+0000 7fd3a05a6700 1 --2- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd398069450 0x7fd3980aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.754+0000 7fd3a05a6700 1 --2- 172.21.15.31:0/2745466873 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd3980a30c0 0x7fd39814d0a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:28.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.754+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2745466873 >> 172.21.15.31:0/2745466873 conn(0x7fd39806ae80 msgr2=0x7fd39806e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:28.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.754+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2745466873 shutdown_connections 2024-04-18T10:38:28.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:28.754+0000 7fd3a05a6700 1 -- 172.21.15.31:0/2745466873 wait complete. 2024-04-18T10:38:28.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.3 2024-04-18T10:38:28.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672992 for osd.1 2024-04-18T10:38:29.400 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:29.399+0000 7fcafc890700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-18T10:38:29.401 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:29.400+0000 7fcafc890700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-18T10:38:29.401 INFO:tasks.ceph.mgr.x.smithi031.stderr:2024-04-18T10:38:29.401+0000 7fcafc890700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-18T10:38:29.717 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T10:38:29.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T10:38:29.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T10:38:29.767 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T10:38:29.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.856+0000 7f1cd085d700 1 Processor -- start 2024-04-18T10:38:29.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.856+0000 7f1cd085d700 1 -- start start 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.857+0000 7f1cd085d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ccc06eb90 0x7f1ccc0680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.857+0000 7f1cd085d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc14da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.857+0000 7f1cd085d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc0a27f0 con 0x7f1ccc069200 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.857+0000 7f1cd085d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc06e070 con 0x7f1ccc06eb90 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.857+0000 7f1cd085d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0a3090 con 0x7f1ccc14b670 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.857+0000 7f1ccad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.857+0000 7f1cca59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1ccc069200 0x7f1ccc0679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48254/0 (socket says 172.21.15.31:48254) 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.857+0000 7f1cca59c700 1 -- 172.21.15.31:0/107866420 learned_addr learned my addr 172.21.15.31:0/107866420 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.857+0000 7f1cc9d9b700 1 --2- 172.21.15.31:0/107866420 >> v2:172.21.15.31:3300/0 conn(0x7f1ccc06eb90 0x7f1ccc0680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.858+0000 7f1ccad9d700 1 -- 172.21.15.31:0/107866420 >> v2:172.21.15.31:3300/0 conn(0x7f1ccc06eb90 msgr2=0x7f1ccc0680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:29.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.858+0000 7f1ccad9d700 1 --2- 172.21.15.31:0/107866420 >> v2:172.21.15.31:3300/0 conn(0x7f1ccc06eb90 0x7f1ccc0680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.858+0000 7f1ccad9d700 1 -- 172.21.15.31:0/107866420 >> v1:172.21.15.31:6789/0 conn(0x7f1ccc069200 legacy=0x7f1ccc0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.858+0000 7f1cc959a700 1 -- 172.21.15.31:0/107866420 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703460416 0 0) 0x7f1ccc0a27f0 con 0x7f1ccc069200 2024-04-18T10:38:29.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.858+0000 7f1ccad9d700 1 -- 172.21.15.31:0/107866420 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc0a3330 con 0x7f1ccc14b670 2024-04-18T10:38:29.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.858+0000 7f1ccad9d700 1 --2- 172.21.15.31:0/107866420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc14da50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009e60 tx=0x7f1cc4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8633ece6dd3ec354 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:29.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.858+0000 7f1cc959a700 1 -- 172.21.15.31:0/107866420 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400e070 con 0x7f1ccc14b670 2024-04-18T10:38:29.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.858+0000 7f1cc959a700 1 -- 172.21.15.31:0/107866420 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400bb60 con 0x7f1ccc14b670 2024-04-18T10:38:29.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.858+0000 7f1cc959a700 1 -- 172.21.15.31:0/107866420 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4012430 con 0x7f1ccc14b670 2024-04-18T10:38:29.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.859+0000 7f1cd085d700 1 -- 172.21.15.31:0/107866420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 msgr2=0x7f1ccc14da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.859+0000 7f1cd085d700 1 --2- 172.21.15.31:0/107866420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc14da50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009e60 tx=0x7f1cc4009780 comp rx=0 tx=0).stop 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.859+0000 7f1cd085d700 1 -- 172.21.15.31:0/107866420 shutdown_connections 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.859+0000 7f1cd085d700 1 --2- 172.21.15.31:0/107866420 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc14da50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.859+0000 7f1cd085d700 1 --2- 172.21.15.31:0/107866420 >> v2:172.21.15.31:3300/0 conn(0x7f1ccc06eb90 0x7f1ccc0680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.859+0000 7f1cd085d700 1 -- 172.21.15.31:0/107866420 >> 172.21.15.31:0/107866420 conn(0x7f1ccc06ae80 msgr2=0x7f1ccc068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.859+0000 7f1cd085d700 1 -- 172.21.15.31:0/107866420 shutdown_connections 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.859+0000 7f1cd085d700 1 -- 172.21.15.31:0/107866420 wait complete. 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.860+0000 7f1cd085d700 1 Processor -- start 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.860+0000 7f1cd085d700 1 -- start start 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1cd085d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ccc069200 0x7f1ccc0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1cd085d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ccc06eb90 0x7f1ccc136750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1cd085d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1cd085d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0a74b0 con 0x7f1ccc069200 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1cd085d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0a8140 con 0x7f1ccc14b670 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1cd085d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0a83e0 con 0x7f1ccc06eb90 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1cc9d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ccc06eb90 0x7f1ccc136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1ccad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc136c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1cc9d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ccc06eb90 0x7f1ccc136750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41418/0 (socket says 172.21.15.31:41418) 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1cc9d9b700 1 -- 172.21.15.31:0/510407211 learned_addr learned my addr 172.21.15.31:0/510407211 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1ccad9d700 1 -- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ccc06eb90 msgr2=0x7f1ccc136750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1ccad9d700 1 --2- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ccc06eb90 0x7f1ccc136750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1ccad9d700 1 -- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ccc069200 msgr2=0x7f1ccc0a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1ccad9d700 1 --2- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ccc069200 0x7f1ccc0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1ccad9d700 1 -- 172.21.15.31:0/510407211 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4009a20 con 0x7f1ccc14b670 2024-04-18T10:38:29.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.861+0000 7f1ccad9d700 1 --2- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc136c90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4016000 tx=0x7f1cc4019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:29.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.862+0000 7f1cba7fc700 1 -- 172.21.15.31:0/510407211 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4025440 con 0x7f1ccc14b670 2024-04-18T10:38:29.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.862+0000 7f1cba7fc700 1 -- 172.21.15.31:0/510407211 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc40255a0 con 0x7f1ccc14b670 2024-04-18T10:38:29.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.862+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc0a5d00 con 0x7f1ccc14b670 2024-04-18T10:38:29.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.862+0000 7f1cba7fc700 1 -- 172.21.15.31:0/510407211 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4025920 con 0x7f1ccc14b670 2024-04-18T10:38:29.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.862+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc14d0a0 con 0x7f1ccc14b670 2024-04-18T10:38:29.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.863+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc0af030 con 0x7f1ccc14b670 2024-04-18T10:38:29.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.863+0000 7f1cba7fc700 1 -- 172.21.15.31:0/510407211 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f1cc4003050 con 0x7f1ccc14b670 2024-04-18T10:38:29.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.864+0000 7f1cba7fc700 1 -- 172.21.15.31:0/510407211 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f1cc405d4c0 con 0x7f1ccc14b670 2024-04-18T10:38:29.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.871+0000 7f1cba7fc700 1 -- 172.21.15.31:0/510407211 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f1cc4006bd0 con 0x7f1ccc14b670 2024-04-18T10:38:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.906+0000 7f8730fb9700 1 Processor -- start 2024-04-18T10:38:29.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.906+0000 7f8730fb9700 1 -- start start 2024-04-18T10:38:29.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f8730fb9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c140300 0x7f872c0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f8730fb9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f8730fb9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f872c06ea80 0x7f872c06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f8730fb9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872c0b0100 con 0x7f872c06ea80 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f8730fb9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0a57d0 con 0x7f872c0a7140 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f8730fb9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f872c13f740 con 0x7f872c140300 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f8729d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f8729d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0b3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49932/0 (socket says 172.21.15.31:49932) 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f8729d9b700 1 -- 172.21.15.31:0/2279312852 learned_addr learned my addr 172.21.15.31:0/2279312852 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f872ad9d700 1 --2- 172.21.15.31:0/2279312852 >> v2:172.21.15.31:3300/0 conn(0x7f872c06ea80 0x7f872c06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.907+0000 7f872a59c700 1 --2- 172.21.15.31:0/2279312852 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c140300 0x7f872c0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f8729d9b700 1 -- 172.21.15.31:0/2279312852 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c140300 msgr2=0x7f872c0a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f8729d9b700 1 --2- 172.21.15.31:0/2279312852 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c140300 0x7f872c0a5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f8729d9b700 1 -- 172.21.15.31:0/2279312852 >> v2:172.21.15.31:3300/0 conn(0x7f872c06ea80 msgr2=0x7f872c06ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f8729d9b700 1 --2- 172.21.15.31:0/2279312852 >> v2:172.21.15.31:3300/0 conn(0x7f872c06ea80 0x7f872c06ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f8729d9b700 1 -- 172.21.15.31:0/2279312852 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c13f9e0 con 0x7f872c0a7140 2024-04-18T10:38:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f872a59c700 1 --2- 172.21.15.31:0/2279312852 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c140300 0x7f872c0a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f8729d9b700 1 --2- 172.21.15.31:0/2279312852 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0b3380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87200099b0 tx=0x7f8720009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad8f6ac68f1b3019 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f872959a700 1 -- 172.21.15.31:0/2279312852 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000b680 con 0x7f872c0a7140 2024-04-18T10:38:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f872959a700 1 -- 172.21.15.31:0/2279312852 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872000b7e0 con 0x7f872c0a7140 2024-04-18T10:38:29.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.908+0000 7f872959a700 1 -- 172.21.15.31:0/2279312852 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000bb80 con 0x7f872c0a7140 2024-04-18T10:38:29.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.909+0000 7f8730fb9700 1 -- 172.21.15.31:0/2279312852 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 msgr2=0x7f872c0b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.909+0000 7f8730fb9700 1 --2- 172.21.15.31:0/2279312852 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0b3380 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87200099b0 tx=0x7f8720009250 comp rx=0 tx=0).stop 2024-04-18T10:38:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.909+0000 7f8730fb9700 1 -- 172.21.15.31:0/2279312852 shutdown_connections 2024-04-18T10:38:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.909+0000 7f8730fb9700 1 --2- 172.21.15.31:0/2279312852 >> v2:172.21.15.31:3300/0 conn(0x7f872c06ea80 0x7f872c06ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.909+0000 7f8730fb9700 1 --2- 172.21.15.31:0/2279312852 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c140300 0x7f872c0a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.909+0000 7f8730fb9700 1 --2- 172.21.15.31:0/2279312852 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0b3380 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.909+0000 7f8730fb9700 1 -- 172.21.15.31:0/2279312852 >> 172.21.15.31:0/2279312852 conn(0x7f872c06e1d0 msgr2=0x7f872c06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.909+0000 7f8730fb9700 1 -- 172.21.15.31:0/2279312852 shutdown_connections 2024-04-18T10:38:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.909+0000 7f8730fb9700 1 -- 172.21.15.31:0/2279312852 wait complete. 2024-04-18T10:38:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.911+0000 7f8730fb9700 1 Processor -- start 2024-04-18T10:38:29.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.911+0000 7f8730fb9700 1 -- start start 2024-04-18T10:38:29.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f8730fb9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c06ea80 0x7f872c1443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f8730fb9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f8730fb9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872c140300 0x7f872c151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f8730fb9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0aa6f0 con 0x7f872c140300 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f8730fb9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0a8830 con 0x7f872c0a7140 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f8730fb9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f872c0a8ad0 con 0x7f872c06ea80 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872a59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c06ea80 0x7f872c1443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872a59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c06ea80 0x7f872c1443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41434/0 (socket says 172.21.15.31:41434) 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872a59c700 1 -- 172.21.15.31:0/778864118 learned_addr learned my addr 172.21.15.31:0/778864118 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f8729d9b700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872ad9d700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872c140300 0x7f872c151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872a59c700 1 -- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 msgr2=0x7f872c0a9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872a59c700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0a9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872a59c700 1 -- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872c140300 msgr2=0x7f872c151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872a59c700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872c140300 0x7f872c151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872a59c700 1 -- 172.21.15.31:0/778864118 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c009420 con 0x7f872c06ea80 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872ad9d700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872c140300 0x7f872c151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f872a59c700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c06ea80 0x7f872c1443c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f871c00ec80 tx=0x7f871c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.912+0000 7f871a7fc700 1 -- 172.21.15.31:0/778864118 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00c9d0 con 0x7f872c06ea80 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.913+0000 7f871a7fc700 1 -- 172.21.15.31:0/778864118 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871c00cb30 con 0x7f872c06ea80 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.913+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87200094f0 con 0x7f872c06ea80 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.913+0000 7f871a7fc700 1 -- 172.21.15.31:0/778864118 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c00ceb0 con 0x7f872c06ea80 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.913+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c144f20 con 0x7f872c06ea80 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.914+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c0651b0 con 0x7f872c06ea80 2024-04-18T10:38:29.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.914+0000 7f871a7fc700 1 -- 172.21.15.31:0/778864118 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f871c013680 con 0x7f872c06ea80 2024-04-18T10:38:29.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.915+0000 7f871a7fc700 1 -- 172.21.15.31:0/778864118 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f871c05b160 con 0x7f872c06ea80 2024-04-18T10:38:29.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.922+0000 7f871a7fc700 1 -- 172.21.15.31:0/778864118 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f871c039630 con 0x7f872c06ea80 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.943+0000 7f3de123d700 1 Processor -- start 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.943+0000 7f3de123d700 1 -- start start 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.943+0000 7f3de123d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc063f70 0x7f3ddc0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.943+0000 7f3de123d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3ddc0a42a0 0x7f3ddc06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.943+0000 7f3de123d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc0a47c0 con 0x7f3ddc06f040 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.943+0000 7f3de123d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc06a330 con 0x7f3ddc063f70 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.943+0000 7f3de123d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc06a5f0 con 0x7f3ddc0a42a0 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.943+0000 7f3ddad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc063f70 0x7f3ddc0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3ddb59e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3ddc06f040 0x7f3ddc06f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48270/0 (socket says 172.21.15.31:48270) 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3ddb59e700 1 -- 172.21.15.31:0/193397430 learned_addr learned my addr 172.21.15.31:0/193397430 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:29.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3dda59c700 1 --2- 172.21.15.31:0/193397430 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3ddc0a42a0 0x7f3ddc06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3dd9d9b700 1 -- 172.21.15.31:0/193397430 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366286670 0 0) 0x7f3ddc0a47c0 con 0x7f3ddc06f040 2024-04-18T10:38:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3ddad9d700 1 -- 172.21.15.31:0/193397430 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3ddc0a42a0 msgr2=0x7f3ddc06eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3ddad9d700 1 --2- 172.21.15.31:0/193397430 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3ddc0a42a0 0x7f3ddc06eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3ddad9d700 1 -- 172.21.15.31:0/193397430 >> v1:172.21.15.31:6789/0 conn(0x7f3ddc06f040 legacy=0x7f3ddc06f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3ddad9d700 1 -- 172.21.15.31:0/193397430 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc06fea0 con 0x7f3ddc063f70 2024-04-18T10:38:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3ddad9d700 1 --2- 172.21.15.31:0/193397430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc063f70 0x7f3ddc0a4d20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009910 tx=0x7f3dcc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1618ebe8a3ec8306 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3dd9d9b700 1 -- 172.21.15.31:0/193397430 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00b860 con 0x7f3ddc063f70 2024-04-18T10:38:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3dd9d9b700 1 -- 172.21.15.31:0/193397430 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc00b9c0 con 0x7f3ddc063f70 2024-04-18T10:38:29.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.944+0000 7f3dd9d9b700 1 -- 172.21.15.31:0/193397430 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00bd60 con 0x7f3ddc063f70 2024-04-18T10:38:29.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.945+0000 7f3de123d700 1 -- 172.21.15.31:0/193397430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc063f70 msgr2=0x7f3ddc0a4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.945+0000 7f3de123d700 1 --2- 172.21.15.31:0/193397430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc063f70 0x7f3ddc0a4d20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009910 tx=0x7f3dcc0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.945+0000 7f3de123d700 1 -- 172.21.15.31:0/193397430 shutdown_connections 2024-04-18T10:38:29.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.945+0000 7f3de123d700 1 --2- 172.21.15.31:0/193397430 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc063f70 0x7f3ddc0a4d20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.945+0000 7f3de123d700 1 --2- 172.21.15.31:0/193397430 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3ddc0a42a0 0x7f3ddc06eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.945+0000 7f3de123d700 1 -- 172.21.15.31:0/193397430 >> 172.21.15.31:0/193397430 conn(0x7f3ddc06c090 msgr2=0x7f3ddc063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:29.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.945+0000 7f3de123d700 1 -- 172.21.15.31:0/193397430 shutdown_connections 2024-04-18T10:38:29.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.945+0000 7f3de123d700 1 -- 172.21.15.31:0/193397430 wait complete. 2024-04-18T10:38:29.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.947+0000 7f3de123d700 1 Processor -- start 2024-04-18T10:38:29.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.947+0000 7f3de123d700 1 -- start start 2024-04-18T10:38:29.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3de123d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ddc063f70 0x7f3ddc0a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3de123d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc06f040 0x7f3ddc1419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3de123d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3ddc0a42a0 0x7f3ddc141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3de123d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc0a8780 con 0x7f3ddc063f70 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3de123d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc0a76f0 con 0x7f3ddc06f040 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3de123d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc1467b0 con 0x7f3ddc0a42a0 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3ddad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ddc063f70 0x7f3ddc0a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3ddad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ddc063f70 0x7f3ddc0a6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39162/0 (socket says 172.21.15.31:39162) 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3ddad9d700 1 -- 172.21.15.31:0/4070836018 learned_addr learned my addr 172.21.15.31:0/4070836018 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3dda59c700 1 --2- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc06f040 0x7f3ddc1419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3ddad9d700 1 -- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3ddc0a42a0 msgr2=0x7f3ddc141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3ddad9d700 1 --2- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3ddc0a42a0 0x7f3ddc141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3ddad9d700 1 -- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc06f040 msgr2=0x7f3ddc1419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3ddad9d700 1 --2- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc06f040 0x7f3ddc1419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3ddad9d700 1 -- 172.21.15.31:0/4070836018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc009420 con 0x7f3ddc063f70 2024-04-18T10:38:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3ddad9d700 1 --2- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ddc063f70 0x7f3ddc0a6d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0a4950 tx=0x7f3dcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3dc2ffd700 1 -- 172.21.15.31:0/4070836018 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00b860 con 0x7f3ddc063f70 2024-04-18T10:38:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3dc2ffd700 1 -- 172.21.15.31:0/4070836018 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc011e20 con 0x7f3ddc063f70 2024-04-18T10:38:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.948+0000 7f3dc2ffd700 1 -- 172.21.15.31:0/4070836018 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0246b0 con 0x7f3ddc063f70 2024-04-18T10:38:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.949+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc148a40 con 0x7f3ddc063f70 2024-04-18T10:38:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.949+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc0a9450 con 0x7f3ddc063f70 2024-04-18T10:38:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.950+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc064920 con 0x7f3ddc063f70 2024-04-18T10:38:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.950+0000 7f3dc2ffd700 1 -- 172.21.15.31:0/4070836018 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f3dcc024ae0 con 0x7f3ddc063f70 2024-04-18T10:38:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.950+0000 7f3dc2ffd700 1 -- 172.21.15.31:0/4070836018 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f3dcc05c6c0 con 0x7f3ddc063f70 2024-04-18T10:38:29.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.952+0000 7f3626be2700 1 Processor -- start 2024-04-18T10:38:29.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.952+0000 7f3626be2700 1 -- start start 2024-04-18T10:38:29.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f3626be2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3620063930 0x7f362006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f3626be2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 0x7f3620145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f3626be2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362006ea50 con 0x7f362006e040 2024-04-18T10:38:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f3626be2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362013e560 con 0x7f3620063930 2024-04-18T10:38:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f3626be2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f362006e7e0 con 0x7f36201438d0 2024-04-18T10:38:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f361ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f362006e040 0x7f3620131000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48278/0 (socket says 172.21.15.31:48278) 2024-04-18T10:38:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f361ffff700 1 -- 172.21.15.31:0/1306090621 learned_addr learned my addr 172.21.15.31:0/1306090621 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f362497e700 1 --2- 172.21.15.31:0/1306090621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3620063930 0x7f362006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f362517f700 1 --2- 172.21.15.31:0/1306090621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 0x7f3620145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f362517f700 1 -- 172.21.15.31:0/1306090621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3620063930 msgr2=0x7f362006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.953+0000 7f362517f700 1 --2- 172.21.15.31:0/1306090621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3620063930 0x7f362006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.954+0000 7f362517f700 1 -- 172.21.15.31:0/1306090621 >> v1:172.21.15.31:6789/0 conn(0x7f362006e040 legacy=0x7f3620131000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.954+0000 7f362517f700 1 -- 172.21.15.31:0/1306090621 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620131710 con 0x7f36201438d0 2024-04-18T10:38:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.954+0000 7f362517f700 1 --2- 172.21.15.31:0/1306090621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 0x7f3620145cb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3618009e90 tx=0x7f3618009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72a532442c7b117f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.954+0000 7f361f7fe700 1 -- 172.21.15.31:0/1306090621 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361800e070 con 0x7f36201438d0 2024-04-18T10:38:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.954+0000 7f361f7fe700 1 -- 172.21.15.31:0/1306090621 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361800bc30 con 0x7f36201438d0 2024-04-18T10:38:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.954+0000 7f361f7fe700 1 -- 172.21.15.31:0/1306090621 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618012430 con 0x7f36201438d0 2024-04-18T10:38:29.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.955+0000 7f3626be2700 1 -- 172.21.15.31:0/1306090621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 msgr2=0x7f3620145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.955+0000 7f3626be2700 1 --2- 172.21.15.31:0/1306090621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 0x7f3620145cb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3618009e90 tx=0x7f3618009780 comp rx=0 tx=0).stop 2024-04-18T10:38:29.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.955+0000 7f3626be2700 1 -- 172.21.15.31:0/1306090621 shutdown_connections 2024-04-18T10:38:29.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.955+0000 7f3626be2700 1 --2- 172.21.15.31:0/1306090621 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 0x7f3620145cb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.955+0000 7f3626be2700 1 --2- 172.21.15.31:0/1306090621 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3620063930 0x7f362006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.955+0000 7f3626be2700 1 -- 172.21.15.31:0/1306090621 >> 172.21.15.31:0/1306090621 conn(0x7f36200b1290 msgr2=0x7f36200b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.955+0000 7f3626be2700 1 -- 172.21.15.31:0/1306090621 shutdown_connections 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.955+0000 7f3626be2700 1 -- 172.21.15.31:0/1306090621 wait complete. 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.956+0000 7f3626be2700 1 Processor -- start 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.956+0000 7f3626be2700 1 -- start start 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.956+0000 7f3626be2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3620063930 0x7f362014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.956+0000 7f3626be2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f362006e040 0x7f36200a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.956+0000 7f3626be2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 0x7f36200a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f3626be2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36200a7920 con 0x7f3620063930 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f3626be2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362014ed70 con 0x7f362006e040 2024-04-18T10:38:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f3626be2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3620141fb0 con 0x7f36201438d0 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362497e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3620063930 0x7f362014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362497e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3620063930 0x7f362014e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39168/0 (socket says 172.21.15.31:39168) 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362497e700 1 -- 172.21.15.31:0/2640975541 learned_addr learned my addr 172.21.15.31:0/2640975541 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362517f700 1 --2- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 0x7f36200a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f361ffff700 1 --2- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f362006e040 0x7f36200a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362497e700 1 -- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 msgr2=0x7f36200a5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362497e700 1 --2- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 0x7f36200a5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362497e700 1 -- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f362006e040 msgr2=0x7f36200a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362497e700 1 --2- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f362006e040 0x7f36200a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362497e700 1 -- 172.21.15.31:0/2640975541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3618009a20 con 0x7f3620063930 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f362497e700 1 --2- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3620063930 0x7f362014e3a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3614010e90 tx=0x7f36140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f361cff9700 1 -- 172.21.15.31:0/2640975541 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361400edf0 con 0x7f3620063930 2024-04-18T10:38:29.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f361cff9700 1 -- 172.21.15.31:0/2640975541 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3614011450 con 0x7f3620063930 2024-04-18T10:38:29.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.957+0000 7f3626be2700 1 -- 172.21.15.31:0/2640975541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36200ab780 con 0x7f3620063930 2024-04-18T10:38:29.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.958+0000 7f361cff9700 1 -- 172.21.15.31:0/2640975541 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140117f0 con 0x7f3620063930 2024-04-18T10:38:29.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.958+0000 7f3626be2700 1 -- 172.21.15.31:0/2640975541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362014eaa0 con 0x7f3620063930 2024-04-18T10:38:29.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.958+0000 7f3dc2ffd700 1 -- 172.21.15.31:0/4070836018 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3dcc0064a0 con 0x7f3ddc063f70 2024-04-18T10:38:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.959+0000 7f360a7fc700 1 -- 172.21.15.31:0/2640975541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36200651b0 con 0x7f3620063930 2024-04-18T10:38:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.961+0000 7f361cff9700 1 -- 172.21.15.31:0/2640975541 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f3614011b60 con 0x7f3620063930 2024-04-18T10:38:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.961+0000 7f361cff9700 1 -- 172.21.15.31:0/2640975541 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f361405d6d0 con 0x7f3620063930 2024-04-18T10:38:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:29.967+0000 7f361cff9700 1 -- 172.21.15.31:0/2640975541 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f361403bc80 con 0x7f3620063930 2024-04-18T10:38:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.052+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ccc0651b0 con 0x7f1ccc14b670 2024-04-18T10:38:30.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.052+0000 7f1cba7fc700 1 -- 172.21.15.31:0/510407211 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cc402f500 con 0x7f1ccc14b670 2024-04-18T10:38:30.053 INFO:teuthology.orchestra.run.smithi031.stdout:42949672991 2024-04-18T10:38:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 >> v1:172.21.15.31:6816/46601 conn(0x7f1cac045d40 legacy=0x7f1cac0481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 msgr2=0x7f1ccc136c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 --2- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc136c90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4016000 tx=0x7f1cc4019000 comp rx=0 tx=0).stop 2024-04-18T10:38:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 shutdown_connections 2024-04-18T10:38:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 --2- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ccc14b670 0x7f1ccc136c90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 --2- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ccc069200 0x7f1ccc0a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 --2- 172.21.15.31:0/510407211 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ccc06eb90 0x7f1ccc136750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 >> 172.21.15.31:0/510407211 conn(0x7f1ccc06ae80 msgr2=0x7f1ccc14e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:30.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 shutdown_connections 2024-04-18T10:38:30.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.054+0000 7f1cd085d700 1 -- 172.21.15.31:0/510407211 wait complete. 2024-04-18T10:38:30.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.0 2024-04-18T10:38:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.103+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f872c13de50 con 0x7f872c06ea80 2024-04-18T10:38:30.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.103+0000 7f871a7fc700 1 -- 172.21.15.31:0/778864118 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f871c03ce20 con 0x7f872c06ea80 2024-04-18T10:38:30.104 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 >> v1:172.21.15.31:6816/46601 conn(0x7f870c045d40 legacy=0x7f870c0481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c06ea80 msgr2=0x7f872c1443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c06ea80 0x7f872c1443c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f871c00ec80 tx=0x7f871c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 shutdown_connections 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f872c06ea80 0x7f872c1443c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872c140300 0x7f872c151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 --2- 172.21.15.31:0/778864118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f872c0a7140 0x7f872c0a9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 >> 172.21.15.31:0/778864118 conn(0x7f872c06e1d0 msgr2=0x7f872c13e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 shutdown_connections 2024-04-18T10:38:30.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.105+0000 7f8730fb9700 1 -- 172.21.15.31:0/778864118 wait complete. 2024-04-18T10:38:30.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672992 for osd.2 2024-04-18T10:38:30.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.124+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3ddc0a6940 con 0x7f3ddc063f70 2024-04-18T10:38:30.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.124+0000 7f3dc2ffd700 1 -- 172.21.15.31:0/4070836018 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3dcc0064a0 con 0x7f3ddc063f70 2024-04-18T10:38:30.125 INFO:teuthology.orchestra.run.smithi031.stdout:42949672992 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 >> v1:172.21.15.31:6816/46601 conn(0x7f3dc8045d40 legacy=0x7f3dc80481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ddc063f70 msgr2=0x7f3ddc0a6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 --2- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ddc063f70 0x7f3ddc0a6d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0a4950 tx=0x7f3dcc017000 comp rx=0 tx=0).stop 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 shutdown_connections 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 --2- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3ddc0a42a0 0x7f3ddc141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 --2- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ddc063f70 0x7f3ddc0a6d20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 --2- 172.21.15.31:0/4070836018 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3ddc06f040 0x7f3ddc1419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 >> 172.21.15.31:0/4070836018 conn(0x7f3ddc06c090 msgr2=0x7f3ddc0b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 shutdown_connections 2024-04-18T10:38:30.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.126+0000 7f3de123d700 1 -- 172.21.15.31:0/4070836018 wait complete. 2024-04-18T10:38:30.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.136+0000 7f360a7fc700 1 -- 172.21.15.31:0/2640975541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f362006b970 con 0x7f3620063930 2024-04-18T10:38:30.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.136+0000 7f361cff9700 1 -- 172.21.15.31:0/2640975541 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f361401e030 con 0x7f3620063930 2024-04-18T10:38:30.136 INFO:teuthology.orchestra.run.smithi031.stdout:42949672991 2024-04-18T10:38:30.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672992 for osd.1 2024-04-18T10:38:30.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 -- 172.21.15.31:0/2640975541 >> v1:172.21.15.31:6816/46601 conn(0x7f3604045d70 legacy=0x7f3604048220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:30.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 -- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3620063930 msgr2=0x7f362014e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:30.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 --2- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3620063930 0x7f362014e3a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3614010e90 tx=0x7f36140091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 -- 172.21.15.31:0/2640975541 shutdown_connections 2024-04-18T10:38:30.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 --2- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f36201438d0 0x7f36200a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 --2- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3620063930 0x7f362014e3a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 --2- 172.21.15.31:0/2640975541 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f362006e040 0x7f36200a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:30.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 -- 172.21.15.31:0/2640975541 >> 172.21.15.31:0/2640975541 conn(0x7f36200b1290 msgr2=0x7f3620142e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:30.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 -- 172.21.15.31:0/2640975541 shutdown_connections 2024-04-18T10:38:30.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:30.138+0000 7f360a7fc700 1 -- 172.21.15.31:0/2640975541 wait complete. 2024-04-18T10:38:30.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672991 for osd.3 2024-04-18T10:38:31.067 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T10:38:31.118 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T10:38:31.139 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T10:38:31.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T10:38:31.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.209+0000 7f8a31e1f700 1 Processor -- start 2024-04-18T10:38:31.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.209+0000 7f8a31e1f700 1 -- start start 2024-04-18T10:38:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a31e1f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a2c063b10 0x7f8a2c0ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a31e1f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a31e1f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c143320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a31e1f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0ada50 con 0x7f8a2c063b10 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a31e1f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c063ee0 con 0x7f8a2c06dbc0 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a31e1f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0ac2d0 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a2affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a2affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41464/0 (socket says 172.21.15.31:41464) 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a2affd700 1 -- 172.21.15.31:0/3925956411 learned_addr learned my addr 172.21.15.31:0/3925956411 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a2bfff700 1 --2- 172.21.15.31:0/3925956411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.210+0000 7f8a2b7fe700 1 --2- 172.21.15.31:0/3925956411 >> v2:172.21.15.31:3300/0 conn(0x7f8a2c063b10 0x7f8a2c0ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2affd700 1 -- 172.21.15.31:0/3925956411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 msgr2=0x7f8a2c143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2affd700 1 --2- 172.21.15.31:0/3925956411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2affd700 1 -- 172.21.15.31:0/3925956411 >> v2:172.21.15.31:3300/0 conn(0x7f8a2c063b10 msgr2=0x7f8a2c0ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2affd700 1 --2- 172.21.15.31:0/3925956411 >> v2:172.21.15.31:3300/0 conn(0x7f8a2c063b10 0x7f8a2c0ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2affd700 1 -- 172.21.15.31:0/3925956411 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c143860 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2bfff700 1 --2- 172.21.15.31:0/3925956411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2b7fe700 1 --2- 172.21.15.31:0/3925956411 >> v2:172.21.15.31:3300/0 conn(0x7f8a2c063b10 0x7f8a2c0ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:38:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2affd700 1 --2- 172.21.15.31:0/3925956411 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c142de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a200099e0 tx=0x7f8a20009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=797bea7e86d248ec server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2a7fc700 1 -- 172.21.15.31:0/3925956411 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000b820 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2a7fc700 1 -- 172.21.15.31:0/3925956411 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2000b980 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.211+0000 7f8a2a7fc700 1 -- 172.21.15.31:0/3925956411 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000bd20 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.212+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3925956411 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 msgr2=0x7f8a2c142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.212+0000 7f8a31e1f700 1 --2- 172.21.15.31:0/3925956411 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c142de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a200099e0 tx=0x7f8a20009250 comp rx=0 tx=0).stop 2024-04-18T10:38:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.212+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3925956411 shutdown_connections 2024-04-18T10:38:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.212+0000 7f8a31e1f700 1 --2- 172.21.15.31:0/3925956411 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.212+0000 7f8a31e1f700 1 --2- 172.21.15.31:0/3925956411 >> v2:172.21.15.31:3300/0 conn(0x7f8a2c063b10 0x7f8a2c0ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.212+0000 7f8a31e1f700 1 --2- 172.21.15.31:0/3925956411 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c142de0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.212+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3925956411 >> 172.21.15.31:0/3925956411 conn(0x7f8a2c0b1400 msgr2=0x7f8a2c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.212+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3925956411 shutdown_connections 2024-04-18T10:38:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.212+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3925956411 wait complete. 2024-04-18T10:38:31.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.214+0000 7f8a31e1f700 1 Processor -- start 2024-04-18T10:38:31.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.214+0000 7f8a31e1f700 1 -- start start 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a31e1f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a2c063b10 0x7f8a2c121ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a31e1f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c0aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a31e1f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a31e1f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c142350 con 0x7f8a2c063b10 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a31e1f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0a8c90 con 0x7f8a2c06dbc0 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a31e1f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0a6c80 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a2c063b10 0x7f8a2c121ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a2affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c0aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a2affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c0aa7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41476/0 (socket says 172.21.15.31:41476) 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a2b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a2c063b10 0x7f8a2c121ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39184/0 (socket says 172.21.15.31:39184) 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a2affd700 1 -- 172.21.15.31:0/3844097582 learned_addr learned my addr 172.21.15.31:0/3844097582 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.215+0000 7f8a2bfff700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a2affd700 1 -- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 msgr2=0x7f8a2c155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a2affd700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a2affd700 1 -- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a2c063b10 msgr2=0x7f8a2c121ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a2affd700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a2c063b10 0x7f8a2c121ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a2affd700 1 -- 172.21.15.31:0/3844097582 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24009a20 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a2b7fe700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a2c063b10 0x7f8a2c121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a2bfff700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a2affd700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c0aa7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a200090b0 tx=0x7f8a20017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a137fe700 1 -- 172.21.15.31:0/3844097582 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20011de0 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a137fe700 1 -- 172.21.15.31:0/3844097582 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2001f070 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a200094f0 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a137fe700 1 -- 172.21.15.31:0/3844097582 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a200266d0 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.216+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c0ab2a0 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.217+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c0651b0 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.218+0000 7f8a137fe700 1 -- 172.21.15.31:0/3844097582 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f8a20026a80 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.218+0000 7f8a137fe700 1 -- 172.21.15.31:0/3844097582 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f8a20021070 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.222+0000 7f8a137fe700 1 -- 172.21.15.31:0/3844097582 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8a20006300 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1496505700 1 Processor -- start 2024-04-18T10:38:31.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1496505700 1 -- start start 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1496505700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1490063b80 0x7f14900ab350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1496505700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f14900aa7f0 0x7f149013b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1496505700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f149013bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1496505700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14900a9fd0 con 0x7f14900aa7f0 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1496505700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900acba0 con 0x7f1490063b80 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1496505700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14900ace40 con 0x7f14900aabe0 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1494aa2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f149013bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.257+0000 7f1494aa2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f149013bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41484/0 (socket says 172.21.15.31:41484) 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f1494aa2700 1 -- 172.21.15.31:0/3745260950 learned_addr learned my addr 172.21.15.31:0/3745260950 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f148ffff700 1 --2- 172.21.15.31:0/3745260950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1490063b80 0x7f14900ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f1494aa2700 1 -- 172.21.15.31:0/3745260950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1490063b80 msgr2=0x7f14900ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:31.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f1494aa2700 1 --2- 172.21.15.31:0/3745260950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1490063b80 0x7f14900ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f1494aa2700 1 -- 172.21.15.31:0/3745260950 >> v2:172.21.15.31:3300/0 conn(0x7f14900aa7f0 msgr2=0x7f149013b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:31.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f1494aa2700 1 --2- 172.21.15.31:0/3745260950 >> v2:172.21.15.31:3300/0 conn(0x7f14900aa7f0 0x7f149013b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f1494aa2700 1 -- 172.21.15.31:0/3745260950 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14900ac390 con 0x7f14900aabe0 2024-04-18T10:38:31.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f148ffff700 1 --2- 172.21.15.31:0/3745260950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1490063b80 0x7f14900ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:31.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f1494aa2700 1 --2- 172.21.15.31:0/3745260950 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f149013bab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1488009f20 tx=0x7f1488009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6850279fab73c5d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f148effd700 1 -- 172.21.15.31:0/3745260950 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800e070 con 0x7f14900aabe0 2024-04-18T10:38:31.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f148effd700 1 -- 172.21.15.31:0/3745260950 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800b9d0 con 0x7f14900aabe0 2024-04-18T10:38:31.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.258+0000 7f148effd700 1 -- 172.21.15.31:0/3745260950 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880092e0 con 0x7f14900aabe0 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.259+0000 7f1496505700 1 -- 172.21.15.31:0/3745260950 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 msgr2=0x7f149013bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.259+0000 7f1496505700 1 --2- 172.21.15.31:0/3745260950 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f149013bab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1488009f20 tx=0x7f1488009840 comp rx=0 tx=0).stop 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.259+0000 7f1496505700 1 -- 172.21.15.31:0/3745260950 shutdown_connections 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.259+0000 7f1496505700 1 --2- 172.21.15.31:0/3745260950 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f149013bab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.259+0000 7f1496505700 1 --2- 172.21.15.31:0/3745260950 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1490063b80 0x7f14900ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.259+0000 7f1496505700 1 --2- 172.21.15.31:0/3745260950 >> v2:172.21.15.31:3300/0 conn(0x7f14900aa7f0 0x7f149013b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.259+0000 7f1496505700 1 -- 172.21.15.31:0/3745260950 >> 172.21.15.31:0/3745260950 conn(0x7f14900b1290 msgr2=0x7f14900b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.259+0000 7f1496505700 1 -- 172.21.15.31:0/3745260950 shutdown_connections 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.259+0000 7f1496505700 1 -- 172.21.15.31:0/3745260950 wait complete. 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.260+0000 7f1496505700 1 Processor -- start 2024-04-18T10:38:31.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f1496505700 1 -- start start 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f1496505700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1490063b80 0x7f1490141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f1496505700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14900aa7f0 0x7f1490137060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f1496505700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f14901375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f1496505700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1490141f60 con 0x7f1490063b80 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f1496505700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1490141c70 con 0x7f14900aa7f0 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f1496505700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14900b0d20 con 0x7f14900aabe0 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f148f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14900aa7f0 0x7f1490137060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f148ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1490063b80 0x7f1490141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f148f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14900aa7f0 0x7f1490137060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:49996/0 (socket says 172.21.15.31:49996) 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f148f7fe700 1 -- 172.21.15.31:0/1732600431 learned_addr learned my addr 172.21.15.31:0/1732600431 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f148ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1490063b80 0x7f1490141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39204/0 (socket says 172.21.15.31:39204) 2024-04-18T10:38:31.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.261+0000 7f1494aa2700 1 --2- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f14901375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f148ffff700 1 -- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 msgr2=0x7f14901375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f148ffff700 1 --2- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f14901375a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f148ffff700 1 -- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14900aa7f0 msgr2=0x7f1490137060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f148ffff700 1 --2- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14900aa7f0 0x7f1490137060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f148ffff700 1 -- 172.21.15.31:0/1732600431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1480009420 con 0x7f1490063b80 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f148ffff700 1 --2- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1490063b80 0x7f1490141080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f148000ec80 tx=0x7f14800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f1477fff700 1 -- 172.21.15.31:0/1732600431 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148000c850 con 0x7f1490063b80 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f1477fff700 1 -- 172.21.15.31:0/1732600431 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148000c9b0 con 0x7f1490063b80 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1488009ae0 con 0x7f1490063b80 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f1477fff700 1 -- 172.21.15.31:0/1732600431 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148000cd70 con 0x7f1490063b80 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.262+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1490140190 con 0x7f1490063b80 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.263+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1490140410 con 0x7f1490063b80 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.264+0000 7f1477fff700 1 -- 172.21.15.31:0/1732600431 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f1480013680 con 0x7f1490063b80 2024-04-18T10:38:31.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.264+0000 7f1477fff700 1 -- 172.21.15.31:0/1732600431 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f148005af90 con 0x7f1490063b80 2024-04-18T10:38:31.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.271+0000 7f1477fff700 1 -- 172.21.15.31:0/1732600431 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f1480084260 con 0x7f1490063b80 2024-04-18T10:38:31.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.296+0000 7f4c9359d700 1 Processor -- start 2024-04-18T10:38:31.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.296+0000 7f4c9359d700 1 -- start start 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c9359d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4c8c06fca0 0x7f4c8c06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c9359d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06d5b0 0x7f4c8c063610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c9359d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c0a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c9359d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8c06e8d0 con 0x7f4c8c06fca0 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c9359d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c070070 con 0x7f4c8c0a17a0 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c9359d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0a4050 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c91d9a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06d5b0 0x7f4c8c063610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c91d9a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06d5b0 0x7f4c8c063610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41498/0 (socket says 172.21.15.31:41498) 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c91d9a700 1 -- 172.21.15.31:0/3786126775 learned_addr learned my addr 172.21.15.31:0/3786126775 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.297+0000 7f4c9259b700 1 --2- 172.21.15.31:0/3786126775 >> v2:172.21.15.31:3300/0 conn(0x7f4c8c06fca0 0x7f4c8c06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c92d9c700 1 --2- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c0a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c9259b700 1 -- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06d5b0 msgr2=0x7f4c8c063610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c9259b700 1 --2- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06d5b0 0x7f4c8c063610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c9259b700 1 -- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 msgr2=0x7f4c8c0a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c9259b700 1 --2- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c0a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c9259b700 1 -- 172.21.15.31:0/3786126775 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c06eae0 con 0x7f4c8c06fca0 2024-04-18T10:38:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c9259b700 1 --2- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06fca0 0x7f4c8c06e390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009910 tx=0x7f4c880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172d8d6582862944 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c91599700 1 -- 172.21.15.31:0/3786126775 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8800b640 con 0x7f4c8c06fca0 2024-04-18T10:38:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c91599700 1 -- 172.21.15.31:0/3786126775 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8800b7a0 con 0x7f4c8c06fca0 2024-04-18T10:38:31.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.298+0000 7f4c91599700 1 -- 172.21.15.31:0/3786126775 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8800bb60 con 0x7f4c8c06fca0 2024-04-18T10:38:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f4c9359d700 1 -- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06fca0 msgr2=0x7f4c8c06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f4c9359d700 1 --2- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06fca0 0x7f4c8c06e390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009910 tx=0x7f4c880091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f4c9359d700 1 -- 172.21.15.31:0/3786126775 shutdown_connections 2024-04-18T10:38:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f4c9359d700 1 --2- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c0a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f4c9359d700 1 --2- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06fca0 0x7f4c8c06e390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f4c9359d700 1 --2- 172.21.15.31:0/3786126775 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06d5b0 0x7f4c8c063610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f4c9359d700 1 -- 172.21.15.31:0/3786126775 >> 172.21.15.31:0/3786126775 conn(0x7f4c8c06c280 msgr2=0x7f4c8c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f4c9359d700 1 -- 172.21.15.31:0/3786126775 shutdown_connections 2024-04-18T10:38:31.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f4c9359d700 1 -- 172.21.15.31:0/3786126775 wait complete. 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f788573a700 1 Processor -- start 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.299+0000 7f788573a700 1 -- start start 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.300+0000 7f788573a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f788006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.300+0000 7f788573a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788014d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.300+0000 7f788573a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78800a27f0 con 0x7f78800679e0 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.300+0000 7f788573a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788006f0d0 con 0x7f78800684c0 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.300+0000 7f788573a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f788006e070 con 0x7f7880069200 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.300+0000 7f787effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f788006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.300+0000 7f787effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f788006eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41502/0 (socket says 172.21.15.31:41502) 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.300+0000 7f787effd700 1 -- 172.21.15.31:0/1605929524 learned_addr learned my addr 172.21.15.31:0/1605929524 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:31.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.300+0000 7f787f7fe700 1 --2- 172.21.15.31:0/1605929524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f787effd700 1 -- 172.21.15.31:0/1605929524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 msgr2=0x7f788014d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f787effd700 1 --2- 172.21.15.31:0/1605929524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788014d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f787effd700 1 -- 172.21.15.31:0/1605929524 >> v1:172.21.15.31:6789/0 conn(0x7f78800679e0 legacy=0x7f7880067db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:31.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f4c9359d700 1 Processor -- start 2024-04-18T10:38:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f787effd700 1 -- 172.21.15.31:0/1605929524 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78800a3090 con 0x7f7880069200 2024-04-18T10:38:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f787effd700 1 --2- 172.21.15.31:0/1605929524 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f788006eb90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78700099e0 tx=0x7f7870009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f19a2ea7c015d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f4c9359d700 1 -- start start 2024-04-18T10:38:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f787dffb700 1 -- 172.21.15.31:0/1605929524 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000b820 con 0x7f7880069200 2024-04-18T10:38:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f787dffb700 1 -- 172.21.15.31:0/1605929524 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787000b980 con 0x7f7880069200 2024-04-18T10:38:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.301+0000 7f787dffb700 1 -- 172.21.15.31:0/1605929524 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787000bd40 con 0x7f7880069200 2024-04-18T10:38:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f788573a700 1 -- 172.21.15.31:0/1605929524 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 msgr2=0x7f788006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f788573a700 1 --2- 172.21.15.31:0/1605929524 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f788006eb90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78700099e0 tx=0x7f7870009250 comp rx=0 tx=0).stop 2024-04-18T10:38:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f788573a700 1 -- 172.21.15.31:0/1605929524 shutdown_connections 2024-04-18T10:38:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f788573a700 1 --2- 172.21.15.31:0/1605929524 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788014d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f788573a700 1 --2- 172.21.15.31:0/1605929524 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f788006eb90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f788573a700 1 -- 172.21.15.31:0/1605929524 >> 172.21.15.31:0/1605929524 conn(0x7f788006ae80 msgr2=0x7f7880068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9359d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06d5b0 0x7f4c8c098a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9359d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06fca0 0x7f4c8c099c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9359d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c14b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9359d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c098fd0 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9359d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c0991e0 con 0x7f4c8c0a17a0 2024-04-18T10:38:31.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9359d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c096ea0 con 0x7f4c8c06fca0 2024-04-18T10:38:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c92d9c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c14b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c92d9c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c14b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:50024/0 (socket says 172.21.15.31:50024) 2024-04-18T10:38:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c92d9c700 1 -- 172.21.15.31:0/2922805223 learned_addr learned my addr 172.21.15.31:0/2922805223 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9259b700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06d5b0 0x7f4c8c098a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c91d9a700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06fca0 0x7f4c8c099c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f788573a700 1 -- 172.21.15.31:0/1605929524 shutdown_connections 2024-04-18T10:38:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f788573a700 1 -- 172.21.15.31:0/1605929524 wait complete. 2024-04-18T10:38:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9259b700 1 -- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06fca0 msgr2=0x7f4c8c099c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9259b700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06fca0 0x7f4c8c099c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9259b700 1 -- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 msgr2=0x7f4c8c14b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9259b700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c14b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c9259b700 1 -- 172.21.15.31:0/2922805223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c88009420 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.302+0000 7f4c92d9c700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c14b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.303+0000 7f4c9259b700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06d5b0 0x7f4c8c098a90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c88016000 tx=0x7f4c88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.303+0000 7f4c827fc700 1 -- 172.21.15.31:0/2922805223 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8801f070 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.303+0000 7f4c827fc700 1 -- 172.21.15.31:0/2922805223 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8800b910 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.303+0000 7f4c827fc700 1 -- 172.21.15.31:0/2922805223 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88011420 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.303+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c14e0b0 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.303+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c09a1d0 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.303+0000 7f788573a700 1 Processor -- start 2024-04-18T10:38:31.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c099550 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f788573a700 1 -- start start 2024-04-18T10:38:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f788573a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800679e0 0x7f78800ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f788573a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788013cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f788573a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f78800ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f788573a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788013d420 con 0x7f78800679e0 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f788573a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78800ad7e0 con 0x7f78800684c0 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f788573a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78800ab9a0 con 0x7f7880069200 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f787e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788013cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f787e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788013cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:50038/0 (socket says 172.21.15.31:50038) 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f787e7fc700 1 -- 172.21.15.31:0/2443235924 learned_addr learned my addr 172.21.15.31:0/2443235924 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.304+0000 7f787f7fe700 1 --2- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f78800ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.305+0000 7f787e7fc700 1 -- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 msgr2=0x7f78800ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.305+0000 7f787e7fc700 1 --2- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f78800ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.305+0000 7f787e7fc700 1 -- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800679e0 msgr2=0x7f78800ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.305+0000 7f787e7fc700 1 --2- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800679e0 0x7f78800ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.305+0000 7f787e7fc700 1 -- 172.21.15.31:0/2443235924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78700094f0 con 0x7f78800684c0 2024-04-18T10:38:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.305+0000 7f787f7fe700 1 --2- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f78800ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.305+0000 7f4c827fc700 1 -- 172.21.15.31:0/2922805223 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f4c88011790 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.305+0000 7f4c827fc700 1 -- 172.21.15.31:0/2922805223 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f4c8805bb10 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.306+0000 7f787e7fc700 1 --2- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788013cc80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f787400b610 tx=0x7f78740090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.306+0000 7f7866ffd700 1 -- 172.21.15.31:0/2443235924 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787400f510 con 0x7f78800684c0 2024-04-18T10:38:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.306+0000 7f7866ffd700 1 -- 172.21.15.31:0/2443235924 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787400f690 con 0x7f78800684c0 2024-04-18T10:38:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.306+0000 7f7866ffd700 1 -- 172.21.15.31:0/2443235924 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787400fa50 con 0x7f78800684c0 2024-04-18T10:38:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.309+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788013d1c0 con 0x7f78800684c0 2024-04-18T10:38:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.309+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78800aac20 con 0x7f78800684c0 2024-04-18T10:38:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.309+0000 7f4c827fc700 1 -- 172.21.15.31:0/2922805223 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4c8802ddc0 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.310+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78800651b0 con 0x7f78800684c0 2024-04-18T10:38:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.310+0000 7f7866ffd700 1 -- 172.21.15.31:0/2443235924 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f787401a400 con 0x7f78800684c0 2024-04-18T10:38:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.311+0000 7f7866ffd700 1 -- 172.21.15.31:0/2443235924 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f787405a8d0 con 0x7f78800684c0 2024-04-18T10:38:31.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.314+0000 7f7866ffd700 1 -- 172.21.15.31:0/2443235924 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7874038f70 con 0x7f78800684c0 2024-04-18T10:38:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.399+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8a2c06b9e0 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.403+0000 7f1477fff700 1 -- 172.21.15.31:0/1732600431 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f14800391b0 con 0x7f1490063b80 2024-04-18T10:38:31.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.403+0000 7f4c827fc700 1 -- 172.21.15.31:0/2922805223 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f4c88025a00 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.409+0000 7f8a137fe700 1 -- 172.21.15.31:0/3844097582 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f8a20026d30 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.410+0000 7f7866ffd700 1 -- 172.21.15.31:0/2443235924 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f7874038a20 con 0x7f78800684c0 2024-04-18T10:38:31.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.413+0000 7f8a137fe700 1 -- 172.21.15.31:0/3844097582 <== mon.2 v2:172.21.15.31:3302/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a200077d0 con 0x7f8a2c06d7d0 2024-04-18T10:38:31.414 INFO:teuthology.orchestra.run.smithi031.stdout:42949672993 2024-04-18T10:38:31.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 >> v1:172.21.15.31:6816/46601 conn(0x7f8a18045da0 legacy=0x7f8a18048250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 msgr2=0x7f8a2c0aa7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c0aa7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a200090b0 tx=0x7f8a20017000 comp rx=0 tx=0).stop 2024-04-18T10:38:31.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 shutdown_connections 2024-04-18T10:38:31.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8a2c06dbc0 0x7f8a2c155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a2c063b10 0x7f8a2c121ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 --2- 172.21.15.31:0/3844097582 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8a2c06d7d0 0x7f8a2c0aa7c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 >> 172.21.15.31:0/3844097582 conn(0x7f8a2c0b1400 msgr2=0x7f8a2c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 shutdown_connections 2024-04-18T10:38:31.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.416+0000 7f8a31e1f700 1 -- 172.21.15.31:0/3844097582 wait complete. 2024-04-18T10:38:31.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672993 for osd.0 2024-04-18T10:38:31.429 DEBUG:teuthology.parallel:result is None 2024-04-18T10:38:31.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.450+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14900651b0 con 0x7f1490063b80 2024-04-18T10:38:31.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.451+0000 7f1477fff700 1 -- 172.21.15.31:0/1732600431 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1480057820 con 0x7f1490063b80 2024-04-18T10:38:31.451 INFO:teuthology.orchestra.run.smithi031.stdout:42949672994 2024-04-18T10:38:31.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.452+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 >> v1:172.21.15.31:6816/46601 conn(0x7f147c045d40 legacy=0x7f147c0481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.452+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1490063b80 msgr2=0x7f1490141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.452+0000 7f1496505700 1 --2- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1490063b80 0x7f1490141080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f148000ec80 tx=0x7f14800091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.453+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 shutdown_connections 2024-04-18T10:38:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.453+0000 7f1496505700 1 --2- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f14900aabe0 0x7f14901375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.453+0000 7f1496505700 1 --2- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1490063b80 0x7f1490141080 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.453+0000 7f1496505700 1 --2- 172.21.15.31:0/1732600431 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f14900aa7f0 0x7f1490137060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.453+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 >> 172.21.15.31:0/1732600431 conn(0x7f14900b1290 msgr2=0x7f14900b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.453+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 shutdown_connections 2024-04-18T10:38:31.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.453+0000 7f1496505700 1 -- 172.21.15.31:0/1732600431 wait complete. 2024-04-18T10:38:31.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672994 for osd.2 2024-04-18T10:38:31.465 DEBUG:teuthology.parallel:result is None 2024-04-18T10:38:31.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.488+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4c8c0651b0 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.488+0000 7f4c827fc700 1 -- 172.21.15.31:0/2922805223 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c880282e0 con 0x7f4c8c06d5b0 2024-04-18T10:38:31.488 INFO:teuthology.orchestra.run.smithi031.stdout:42949672993 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 >> v1:172.21.15.31:6816/46601 conn(0x7f4c70045dc0 legacy=0x7f4c70048270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06d5b0 msgr2=0x7f4c8c098a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06d5b0 0x7f4c8c098a90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4c88016000 tx=0x7f4c88017000 comp rx=0 tx=0).stop 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 shutdown_connections 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4c8c0a17a0 0x7f4c8c14b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4c8c06d5b0 0x7f4c8c098a90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 --2- 172.21.15.31:0/2922805223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4c8c06fca0 0x7f4c8c099c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 >> 172.21.15.31:0/2922805223 conn(0x7f4c8c06c280 msgr2=0x7f4c8c144510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 shutdown_connections 2024-04-18T10:38:31.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.490+0000 7f4c9359d700 1 -- 172.21.15.31:0/2922805223 wait complete. 2024-04-18T10:38:31.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.493+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f788006e970 con 0x7f78800684c0 2024-04-18T10:38:31.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.493+0000 7f7866ffd700 1 -- 172.21.15.31:0/2443235924 <== mon.1 v2:172.21.15.31:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f787403ff50 con 0x7f78800684c0 2024-04-18T10:38:31.494 INFO:teuthology.orchestra.run.smithi031.stdout:42949672994 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 >> v1:172.21.15.31:6816/46601 conn(0x7f786c045d40 legacy=0x7f786c0481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 msgr2=0x7f788013cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 --2- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788013cc80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f787400b610 tx=0x7f78740090f0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 shutdown_connections 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 --2- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7880069200 0x7f78800ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 --2- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78800679e0 0x7f78800ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 --2- 172.21.15.31:0/2443235924 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78800684c0 0x7f788013cc80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 >> 172.21.15.31:0/2443235924 conn(0x7f788006ae80 msgr2=0x7f7880067db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 shutdown_connections 2024-04-18T10:38:31.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.495+0000 7f788573a700 1 -- 172.21.15.31:0/2443235924 wait complete. 2024-04-18T10:38:31.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672992 got 42949672993 for osd.3 2024-04-18T10:38:31.503 DEBUG:teuthology.parallel:result is None 2024-04-18T10:38:31.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672993 got 42949672994 for osd.1 2024-04-18T10:38:31.508 DEBUG:teuthology.parallel:result is None 2024-04-18T10:38:31.508 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T10:38:31.509 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:38:31.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.668+0000 7feead236700 1 Processor -- start 2024-04-18T10:38:31.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.668+0000 7feead236700 1 -- start start 2024-04-18T10:38:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feead236700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea806da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feead236700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feea806d0f0 0x7feea8145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feead236700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea80aecf0 con 0x7feea806f020 2024-04-18T10:38:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feead236700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea8063ed0 con 0x7feea806d0f0 2024-04-18T10:38:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feead236700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea80ae1c0 con 0x7feea8063b00 2024-04-18T10:38:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea759e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feea806d0f0 0x7feea8145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea6d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feea806f020 0x7feea8131330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48296/0 (socket says 172.21.15.31:48296) 2024-04-18T10:38:31.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea659c700 1 -- 172.21.15.31:0/179151551 learned_addr learned my addr 172.21.15.31:0/179151551 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea6d9d700 1 -- 172.21.15.31:0/179151551 >> v2:172.21.15.31:3300/0 conn(0x7feea806d0f0 msgr2=0x7feea8145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea6d9d700 1 --2- 172.21.15.31:0/179151551 >> v2:172.21.15.31:3300/0 conn(0x7feea806d0f0 0x7feea8145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea6d9d700 1 -- 172.21.15.31:0/179151551 >> v1:172.21.15.31:6789/0 conn(0x7feea806f020 legacy=0x7feea8131330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea6d9d700 1 -- 172.21.15.31:0/179151551 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80ae460 con 0x7feea8063b00 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea5d9b700 1 -- 172.21.15.31:0/179151551 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081298915 0 0) 0x7fee98001110 con 0x7feea806f020 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea759e700 1 --2- 172.21.15.31:0/179151551 >> v2:172.21.15.31:3300/0 conn(0x7feea806d0f0 0x7feea8145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea6d9d700 1 --2- 172.21.15.31:0/179151551 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea806da70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0098e0 tx=0x7fee9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb9d3ad530910fda server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea5d9b700 1 -- 172.21.15.31:0/179151551 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00b640 con 0x7feea8063b00 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea5d9b700 1 -- 172.21.15.31:0/179151551 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c00b7a0 con 0x7feea8063b00 2024-04-18T10:38:31.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.669+0000 7feea5d9b700 1 -- 172.21.15.31:0/179151551 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00bb40 con 0x7feea8063b00 2024-04-18T10:38:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.670+0000 7feead236700 1 -- 172.21.15.31:0/179151551 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 msgr2=0x7feea806da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.670+0000 7feead236700 1 --2- 172.21.15.31:0/179151551 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea806da70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0098e0 tx=0x7fee9c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.670+0000 7feead236700 1 -- 172.21.15.31:0/179151551 shutdown_connections 2024-04-18T10:38:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.670+0000 7feead236700 1 --2- 172.21.15.31:0/179151551 >> v2:172.21.15.31:3300/0 conn(0x7feea806d0f0 0x7feea8145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.670+0000 7feead236700 1 --2- 172.21.15.31:0/179151551 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea806da70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.670+0000 7feead236700 1 -- 172.21.15.31:0/179151551 >> 172.21.15.31:0/179151551 conn(0x7feea806a390 msgr2=0x7feea806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.670+0000 7feead236700 1 -- 172.21.15.31:0/179151551 shutdown_connections 2024-04-18T10:38:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.670+0000 7feead236700 1 -- 172.21.15.31:0/179151551 wait complete. 2024-04-18T10:38:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.671+0000 7feead236700 1 Processor -- start 2024-04-18T10:38:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.671+0000 7feead236700 1 -- start start 2024-04-18T10:38:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feead236700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea8133b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feead236700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea806d0f0 0x7feea81327c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feead236700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea806f020 0x7feea80abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feead236700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea8133990 con 0x7feea806f020 2024-04-18T10:38:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feead236700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea8132d00 con 0x7feea806d0f0 2024-04-18T10:38:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feead236700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea8138500 con 0x7feea8063b00 2024-04-18T10:38:31.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea6d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea8133b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea759e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea806f020 0x7feea80abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea806d0f0 0x7feea81327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea6d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea8133b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41530/0 (socket says 172.21.15.31:41530) 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea6d9d700 1 -- 172.21.15.31:0/1844778029 learned_addr learned my addr 172.21.15.31:0/1844778029 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea6d9d700 1 -- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea806d0f0 msgr2=0x7feea81327c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea6d9d700 1 --2- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea806d0f0 0x7feea81327c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea6d9d700 1 -- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea806f020 msgr2=0x7feea80abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea6d9d700 1 --2- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea806f020 0x7feea80abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea6d9d700 1 -- 172.21.15.31:0/1844778029 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0009a20 con 0x7feea8063b00 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea759e700 1 --2- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea806f020 0x7feea80abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea659c700 1 --2- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea806d0f0 0x7feea81327c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feea6d9d700 1 --2- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea8133b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009f80 tx=0x7fee9c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7fee8effd700 1 -- 172.21.15.31:0/1844778029 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c00bb20 con 0x7feea8063b00 2024-04-18T10:38:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7fee8effd700 1 -- 172.21.15.31:0/1844778029 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c000c90 con 0x7feea8063b00 2024-04-18T10:38:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c009420 con 0x7feea8063b00 2024-04-18T10:38:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.672+0000 7fee8effd700 1 -- 172.21.15.31:0/1844778029 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c011630 con 0x7feea8063b00 2024-04-18T10:38:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.673+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea814bf40 con 0x7feea8063b00 2024-04-18T10:38:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.673+0000 7fee8effd700 1 -- 172.21.15.31:0/1844778029 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7fee9c0119a0 con 0x7feea8063b00 2024-04-18T10:38:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.673+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea80651b0 con 0x7feea8063b00 2024-04-18T10:38:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.674+0000 7fee8effd700 1 -- 172.21.15.31:0/1844778029 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3829+0+0 (secure 0 0 0) 0x7fee9c05c360 con 0x7feea8063b00 2024-04-18T10:38:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.677+0000 7fee8effd700 1 -- 172.21.15.31:0/1844778029 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fee9c02ddc0 con 0x7feea8063b00 2024-04-18T10:38:31.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.836+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feea813d8c0 con 0x7fee94045fb0 2024-04-18T10:38:31.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.844+0000 7fee8effd700 1 -- 172.21.15.31:0/1844778029 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270449 (unknown 2965378022 0 3893676055) 0x7feea813d8c0 con 0x7fee94045fb0 2024-04-18T10:38:31.848 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:31.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.846+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 >> v1:172.21.15.31:6816/46601 conn(0x7fee94045fb0 legacy=0x7fee94048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.846+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 msgr2=0x7feea8133b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.846+0000 7feead236700 1 --2- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea8133b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009f80 tx=0x7fee9c017000 comp rx=0 tx=0).stop 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.846+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 shutdown_connections 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.847+0000 7feead236700 1 --2- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7feea8063b00 0x7feea8133b40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.847+0000 7feead236700 1 --2- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feea806f020 0x7feea80abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.847+0000 7feead236700 1 --2- 172.21.15.31:0/1844778029 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7feea806d0f0 0x7feea81327c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.847+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 >> 172.21.15.31:0/1844778029 conn(0x7feea806a390 msgr2=0x7feea806a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.847+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 shutdown_connections 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:31.847+0000 7feead236700 1 -- 172.21.15.31:0/1844778029 wait complete. 2024-04-18T10:38:31.851 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:38:31.859 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-18T10:38:31.407179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8511,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195152,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292208,"statfs":{"total":386547056640,"available":382251220992,"internally_reserved":4294967296,"allocated":835584,"data_stored":255600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004055"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590417+0000","last_change":"2024-04-18T10:36:09.029464+0000","last_active":"2024-04-18T10:36:25.590417+0000","last_peered":"2024-04-18T10:36:25.590417+0000","last_clean":"2024-04-18T10:36:25.590417+0000","last_became_active":"2024-04-18T10:36:09.029119+0000","last_became_peered":"2024-04-18T10:36:09.029119+0000","last_unstale":"2024-04-18T10:36:25.590417+0000","last_undegraded":"2024-04-18T10:36:25.590417+0000","last_fullsized":"2024-04-18T10:36:25.590417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590640+0000","last_change":"2024-04-18T10:36:09.016639+0000","last_active":"2024-04-18T10:36:25.590640+0000","last_peered":"2024-04-18T10:36:25.590640+0000","last_clean":"2024-04-18T10:36:25.590640+0000","last_became_active":"2024-04-18T10:36:09.016298+0000","last_became_peered":"2024-04-18T10:36:09.016298+0000","last_unstale":"2024-04-18T10:36:25.590640+0000","last_undegraded":"2024-04-18T10:36:25.590640+0000","last_fullsized":"2024-04-18T10:36:25.590640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588068+0000","last_change":"2024-04-18T10:36:09.021729+0000","last_active":"2024-04-18T10:36:25.588068+0000","last_peered":"2024-04-18T10:36:25.588068+0000","last_clean":"2024-04-18T10:36:25.588068+0000","last_became_active":"2024-04-18T10:36:09.021089+0000","last_became_peered":"2024-04-18T10:36:09.021089+0000","last_unstale":"2024-04-18T10:36:25.588068+0000","last_undegraded":"2024-04-18T10:36:25.588068+0000","last_fullsized":"2024-04-18T10:36:25.588068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587566+0000","last_change":"2024-04-18T10:36:09.022509+0000","last_active":"2024-04-18T10:36:25.587566+0000","last_peered":"2024-04-18T10:36:25.587566+0000","last_clean":"2024-04-18T10:36:25.587566+0000","last_became_active":"2024-04-18T10:36:09.019360+0000","last_became_peered":"2024-04-18T10:36:09.019360+0000","last_unstale":"2024-04-18T10:36:25.587566+0000","last_undegraded":"2024-04-18T10:36:25.587566+0000","last_fullsized":"2024-04-18T10:36:25.587566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588091+0000","last_change":"2024-04-18T10:36:09.021300+0000","last_active":"2024-04-18T10:36:25.588091+0000","last_peered":"2024-04-18T10:36:25.588091+0000","last_clean":"2024-04-18T10:36:25.588091+0000","last_became_active":"2024-04-18T10:36:09.018608+0000","last_became_peered":"2024-04-18T10:36:09.018608+0000","last_unstale":"2024-04-18T10:36:25.588091+0000","last_undegraded":"2024-04-18T10:36:25.588091+0000","last_fullsized":"2024-04-18T10:36:25.588091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587840+0000","last_change":"2024-04-18T10:36:09.041400+0000","last_active":"2024-04-18T10:36:25.587840+0000","last_peered":"2024-04-18T10:36:25.587840+0000","last_clean":"2024-04-18T10:36:25.587840+0000","last_became_active":"2024-04-18T10:36:09.038827+0000","last_became_peered":"2024-04-18T10:36:09.038827+0000","last_unstale":"2024-04-18T10:36:25.587840+0000","last_undegraded":"2024-04-18T10:36:25.587840+0000","last_fullsized":"2024-04-18T10:36:25.587840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586877+0000","last_change":"2024-04-18T10:36:09.042033+0000","last_active":"2024-04-18T10:36:25.586877+0000","last_peered":"2024-04-18T10:36:25.586877+0000","last_clean":"2024-04-18T10:36:25.586877+0000","last_became_active":"2024-04-18T10:36:09.039118+0000","last_became_peered":"2024-04-18T10:36:09.039118+0000","last_unstale":"2024-04-18T10:36:25.586877+0000","last_undegraded":"2024-04-18T10:36:25.586877+0000","last_fullsized":"2024-04-18T10:36:25.586877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468541+0000","last_change":"2024-04-18T10:36:09.032927+0000","last_active":"2024-04-18T10:36:27.468541+0000","last_peered":"2024-04-18T10:36:27.468541+0000","last_clean":"2024-04-18T10:36:27.468541+0000","last_became_active":"2024-04-18T10:36:09.032162+0000","last_became_peered":"2024-04-18T10:36:09.032162+0000","last_unstale":"2024-04-18T10:36:27.468541+0000","last_undegraded":"2024-04-18T10:36:27.468541+0000","last_fullsized":"2024-04-18T10:36:27.468541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588966+0000","last_change":"2024-04-18T10:36:09.022311+0000","last_active":"2024-04-18T10:36:25.588966+0000","last_peered":"2024-04-18T10:36:25.588966+0000","last_clean":"2024-04-18T10:36:25.588966+0000","last_became_active":"2024-04-18T10:36:09.021805+0000","last_became_peered":"2024-04-18T10:36:09.021805+0000","last_unstale":"2024-04-18T10:36:25.588966+0000","last_undegraded":"2024-04-18T10:36:25.588966+0000","last_fullsized":"2024-04-18T10:36:25.588966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469100+0000","last_change":"2024-04-18T10:36:09.034290+0000","last_active":"2024-04-18T10:36:27.469100+0000","last_peered":"2024-04-18T10:36:27.469100+0000","last_clean":"2024-04-18T10:36:27.469100+0000","last_became_active":"2024-04-18T10:36:09.034081+0000","last_became_peered":"2024-04-18T10:36:09.034081+0000","last_unstale":"2024-04-18T10:36:27.469100+0000","last_undegraded":"2024-04-18T10:36:27.469100+0000","last_fullsized":"2024-04-18T10:36:27.469100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469047+0000","last_change":"2024-04-18T10:36:09.016527+0000","last_active":"2024-04-18T10:36:27.469047+0000","last_peered":"2024-04-18T10:36:27.469047+0000","last_clean":"2024-04-18T10:36:27.469047+0000","last_became_active":"2024-04-18T10:36:09.014883+0000","last_became_peered":"2024-04-18T10:36:09.014883+0000","last_unstale":"2024-04-18T10:36:27.469047+0000","last_undegraded":"2024-04-18T10:36:27.469047+0000","last_fullsized":"2024-04-18T10:36:27.469047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590356+0000","last_change":"2024-04-18T10:36:09.005314+0000","last_active":"2024-04-18T10:36:25.590356+0000","last_peered":"2024-04-18T10:36:25.590356+0000","last_clean":"2024-04-18T10:36:25.590356+0000","last_became_active":"2024-04-18T10:36:09.004979+0000","last_became_peered":"2024-04-18T10:36:09.004979+0000","last_unstale":"2024-04-18T10:36:25.590356+0000","last_undegraded":"2024-04-18T10:36:25.590356+0000","last_fullsized":"2024-04-18T10:36:25.590356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590107+0000","last_change":"2024-04-18T10:36:09.028839+0000","last_active":"2024-04-18T10:36:25.590107+0000","last_peered":"2024-04-18T10:36:25.590107+0000","last_clean":"2024-04-18T10:36:25.590107+0000","last_became_active":"2024-04-18T10:36:09.028502+0000","last_became_peered":"2024-04-18T10:36:09.028502+0000","last_unstale":"2024-04-18T10:36:25.590107+0000","last_undegraded":"2024-04-18T10:36:25.590107+0000","last_fullsized":"2024-04-18T10:36:25.590107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469266+0000","last_change":"2024-04-18T10:36:09.034002+0000","last_active":"2024-04-18T10:36:27.469266+0000","last_peered":"2024-04-18T10:36:27.469266+0000","last_clean":"2024-04-18T10:36:27.469266+0000","last_became_active":"2024-04-18T10:36:09.033512+0000","last_became_peered":"2024-04-18T10:36:09.033512+0000","last_unstale":"2024-04-18T10:36:27.469266+0000","last_undegraded":"2024-04-18T10:36:27.469266+0000","last_fullsized":"2024-04-18T10:36:27.469266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587052+0000","last_change":"2024-04-18T10:36:09.008596+0000","last_active":"2024-04-18T10:36:25.587052+0000","last_peered":"2024-04-18T10:36:25.587052+0000","last_clean":"2024-04-18T10:36:25.587052+0000","last_became_active":"2024-04-18T10:36:09.008249+0000","last_became_peered":"2024-04-18T10:36:09.008249+0000","last_unstale":"2024-04-18T10:36:25.587052+0000","last_undegraded":"2024-04-18T10:36:25.587052+0000","last_fullsized":"2024-04-18T10:36:25.587052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586617+0000","last_change":"2024-04-18T10:36:09.043650+0000","last_active":"2024-04-18T10:36:25.586617+0000","last_peered":"2024-04-18T10:36:25.586617+0000","last_clean":"2024-04-18T10:36:25.586617+0000","last_became_active":"2024-04-18T10:36:09.039117+0000","last_became_peered":"2024-04-18T10:36:09.039117+0000","last_unstale":"2024-04-18T10:36:25.586617+0000","last_undegraded":"2024-04-18T10:36:25.586617+0000","last_fullsized":"2024-04-18T10:36:25.586617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589422+0000","last_change":"2024-04-18T10:36:09.022106+0000","last_active":"2024-04-18T10:36:25.589422+0000","last_peered":"2024-04-18T10:36:25.589422+0000","last_clean":"2024-04-18T10:36:25.589422+0000","last_became_active":"2024-04-18T10:36:09.021380+0000","last_became_peered":"2024-04-18T10:36:09.021380+0000","last_unstale":"2024-04-18T10:36:25.589422+0000","last_undegraded":"2024-04-18T10:36:25.589422+0000","last_fullsized":"2024-04-18T10:36:25.589422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588343+0000","last_change":"2024-04-18T10:36:09.007051+0000","last_active":"2024-04-18T10:36:25.588343+0000","last_peered":"2024-04-18T10:36:25.588343+0000","last_clean":"2024-04-18T10:36:25.588343+0000","last_became_active":"2024-04-18T10:36:09.006731+0000","last_became_peered":"2024-04-18T10:36:09.006731+0000","last_unstale":"2024-04-18T10:36:25.588343+0000","last_undegraded":"2024-04-18T10:36:25.588343+0000","last_fullsized":"2024-04-18T10:36:25.588343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590356+0000","last_change":"2024-04-18T10:36:09.021352+0000","last_active":"2024-04-18T10:36:25.590356+0000","last_peered":"2024-04-18T10:36:25.590356+0000","last_clean":"2024-04-18T10:36:25.590356+0000","last_became_active":"2024-04-18T10:36:09.018400+0000","last_became_peered":"2024-04-18T10:36:09.018400+0000","last_unstale":"2024-04-18T10:36:25.590356+0000","last_undegraded":"2024-04-18T10:36:25.590356+0000","last_fullsized":"2024-04-18T10:36:25.590356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469464+0000","last_change":"2024-04-18T10:36:09.037939+0000","last_active":"2024-04-18T10:36:27.469464+0000","last_peered":"2024-04-18T10:36:27.469464+0000","last_clean":"2024-04-18T10:36:27.469464+0000","last_became_active":"2024-04-18T10:36:09.037611+0000","last_became_peered":"2024-04-18T10:36:09.037611+0000","last_unstale":"2024-04-18T10:36:27.469464+0000","last_undegraded":"2024-04-18T10:36:27.469464+0000","last_fullsized":"2024-04-18T10:36:27.469464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468870+0000","last_change":"2024-04-18T10:36:09.036858+0000","last_active":"2024-04-18T10:36:27.468870+0000","last_peered":"2024-04-18T10:36:27.468870+0000","last_clean":"2024-04-18T10:36:27.468870+0000","last_became_active":"2024-04-18T10:36:09.036508+0000","last_became_peered":"2024-04-18T10:36:09.036508+0000","last_unstale":"2024-04-18T10:36:27.468870+0000","last_undegraded":"2024-04-18T10:36:27.468870+0000","last_fullsized":"2024-04-18T10:36:27.468870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586787+0000","last_change":"2024-04-18T10:36:09.021243+0000","last_active":"2024-04-18T10:36:25.586787+0000","last_peered":"2024-04-18T10:36:25.586787+0000","last_clean":"2024-04-18T10:36:25.586787+0000","last_became_active":"2024-04-18T10:36:09.019277+0000","last_became_peered":"2024-04-18T10:36:09.019277+0000","last_unstale":"2024-04-18T10:36:25.586787+0000","last_undegraded":"2024-04-18T10:36:25.586787+0000","last_fullsized":"2024-04-18T10:36:25.586787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586819+0000","last_change":"2024-04-18T10:36:09.041841+0000","last_active":"2024-04-18T10:36:25.586819+0000","last_peered":"2024-04-18T10:36:25.586819+0000","last_clean":"2024-04-18T10:36:25.586819+0000","last_became_active":"2024-04-18T10:36:09.038958+0000","last_became_peered":"2024-04-18T10:36:09.038958+0000","last_unstale":"2024-04-18T10:36:25.586819+0000","last_undegraded":"2024-04-18T10:36:25.586819+0000","last_fullsized":"2024-04-18T10:36:25.586819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468543+0000","last_change":"2024-04-18T10:36:09.035656+0000","last_active":"2024-04-18T10:36:27.468543+0000","last_peered":"2024-04-18T10:36:27.468543+0000","last_clean":"2024-04-18T10:36:27.468543+0000","last_became_active":"2024-04-18T10:36:09.035221+0000","last_became_peered":"2024-04-18T10:36:09.035221+0000","last_unstale":"2024-04-18T10:36:27.468543+0000","last_undegraded":"2024-04-18T10:36:27.468543+0000","last_fullsized":"2024-04-18T10:36:27.468543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469556+0000","last_change":"2024-04-18T10:36:09.031118+0000","last_active":"2024-04-18T10:36:27.469556+0000","last_peered":"2024-04-18T10:36:27.469556+0000","last_clean":"2024-04-18T10:36:27.469556+0000","last_became_active":"2024-04-18T10:36:09.024843+0000","last_became_peered":"2024-04-18T10:36:09.024843+0000","last_unstale":"2024-04-18T10:36:27.469556+0000","last_undegraded":"2024-04-18T10:36:27.469556+0000","last_fullsized":"2024-04-18T10:36:27.469556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469212+0000","last_change":"2024-04-18T10:36:09.032225+0000","last_active":"2024-04-18T10:36:27.469212+0000","last_peered":"2024-04-18T10:36:27.469212+0000","last_clean":"2024-04-18T10:36:27.469212+0000","last_became_active":"2024-04-18T10:36:09.031895+0000","last_became_peered":"2024-04-18T10:36:09.031895+0000","last_unstale":"2024-04-18T10:36:27.469212+0000","last_undegraded":"2024-04-18T10:36:27.469212+0000","last_fullsized":"2024-04-18T10:36:27.469212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587387+0000","last_change":"2024-04-18T10:36:09.040868+0000","last_active":"2024-04-18T10:36:25.587387+0000","last_peered":"2024-04-18T10:36:25.587387+0000","last_clean":"2024-04-18T10:36:25.587387+0000","last_became_active":"2024-04-18T10:36:09.038946+0000","last_became_peered":"2024-04-18T10:36:09.038946+0000","last_unstale":"2024-04-18T10:36:25.587387+0000","last_undegraded":"2024-04-18T10:36:25.587387+0000","last_fullsized":"2024-04-18T10:36:25.587387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469305+0000","last_change":"2024-04-18T10:36:08.696988+0000","last_active":"2024-04-18T10:36:27.469305+0000","last_peered":"2024-04-18T10:36:27.469305+0000","last_clean":"2024-04-18T10:36:27.469305+0000","last_became_active":"2024-04-18T10:36:08.696639+0000","last_became_peered":"2024-04-18T10:36:08.696639+0000","last_unstale":"2024-04-18T10:36:27.469305+0000","last_undegraded":"2024-04-18T10:36:27.469305+0000","last_fullsized":"2024-04-18T10:36:27.469305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587496+0000","last_change":"2024-04-18T10:36:09.040997+0000","last_active":"2024-04-18T10:36:25.587496+0000","last_peered":"2024-04-18T10:36:25.587496+0000","last_clean":"2024-04-18T10:36:25.587496+0000","last_became_active":"2024-04-18T10:36:09.039544+0000","last_became_peered":"2024-04-18T10:36:09.039544+0000","last_unstale":"2024-04-18T10:36:25.587496+0000","last_undegraded":"2024-04-18T10:36:25.587496+0000","last_fullsized":"2024-04-18T10:36:25.587496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468544+0000","last_change":"2024-04-18T10:36:08.706823+0000","last_active":"2024-04-18T10:36:27.468544+0000","last_peered":"2024-04-18T10:36:27.468544+0000","last_clean":"2024-04-18T10:36:27.468544+0000","last_became_active":"2024-04-18T10:36:08.706488+0000","last_became_peered":"2024-04-18T10:36:08.706488+0000","last_unstale":"2024-04-18T10:36:27.468544+0000","last_undegraded":"2024-04-18T10:36:27.468544+0000","last_fullsized":"2024-04-18T10:36:27.468544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588552+0000","last_change":"2024-04-18T10:36:09.020079+0000","last_active":"2024-04-18T10:36:25.588552+0000","last_peered":"2024-04-18T10:36:25.588552+0000","last_clean":"2024-04-18T10:36:25.588552+0000","last_became_active":"2024-04-18T10:36:09.019759+0000","last_became_peered":"2024-04-18T10:36:09.019759+0000","last_unstale":"2024-04-18T10:36:25.588552+0000","last_undegraded":"2024-04-18T10:36:25.588552+0000","last_fullsized":"2024-04-18T10:36:25.588552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587251+0000","last_change":"2024-04-18T10:36:08.715008+0000","last_active":"2024-04-18T10:36:25.587251+0000","last_peered":"2024-04-18T10:36:25.587251+0000","last_clean":"2024-04-18T10:36:25.587251+0000","last_became_active":"2024-04-18T10:36:08.714642+0000","last_became_peered":"2024-04-18T10:36:08.714642+0000","last_unstale":"2024-04-18T10:36:25.587251+0000","last_undegraded":"2024-04-18T10:36:25.587251+0000","last_fullsized":"2024-04-18T10:36:25.587251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589065+0000","last_change":"2024-04-18T10:36:09.045728+0000","last_active":"2024-04-18T10:36:25.589065+0000","last_peered":"2024-04-18T10:36:25.589065+0000","last_clean":"2024-04-18T10:36:25.589065+0000","last_became_active":"2024-04-18T10:36:09.045122+0000","last_became_peered":"2024-04-18T10:36:09.045122+0000","last_unstale":"2024-04-18T10:36:25.589065+0000","last_undegraded":"2024-04-18T10:36:25.589065+0000","last_fullsized":"2024-04-18T10:36:25.589065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"20'7","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:50.641160+0000","last_change":"2024-04-18T10:36:08.706131+0000","last_active":"2024-04-18T10:36:50.641160+0000","last_peered":"2024-04-18T10:36:50.641160+0000","last_clean":"2024-04-18T10:36:50.641160+0000","last_became_active":"2024-04-18T10:36:08.705713+0000","last_became_peered":"2024-04-18T10:36:08.705713+0000","last_unstale":"2024-04-18T10:36:50.641160+0000","last_undegraded":"2024-04-18T10:36:50.641160+0000","last_fullsized":"2024-04-18T10:36:50.641160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587390+0000","last_change":"2024-04-18T10:36:09.043706+0000","last_active":"2024-04-18T10:36:25.587390+0000","last_peered":"2024-04-18T10:36:25.587390+0000","last_clean":"2024-04-18T10:36:25.587390+0000","last_became_active":"2024-04-18T10:36:09.039571+0000","last_became_peered":"2024-04-18T10:36:09.039571+0000","last_unstale":"2024-04-18T10:36:25.587390+0000","last_undegraded":"2024-04-18T10:36:25.587390+0000","last_fullsized":"2024-04-18T10:36:25.587390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590572+0000","last_change":"2024-04-18T10:36:08.703814+0000","last_active":"2024-04-18T10:36:25.590572+0000","last_peered":"2024-04-18T10:36:25.590572+0000","last_clean":"2024-04-18T10:36:25.590572+0000","last_became_active":"2024-04-18T10:36:08.703206+0000","last_became_peered":"2024-04-18T10:36:08.703206+0000","last_unstale":"2024-04-18T10:36:25.590572+0000","last_undegraded":"2024-04-18T10:36:25.590572+0000","last_fullsized":"2024-04-18T10:36:25.590572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587144+0000","last_change":"2024-04-18T10:36:09.042232+0000","last_active":"2024-04-18T10:36:25.587144+0000","last_peered":"2024-04-18T10:36:25.587144+0000","last_clean":"2024-04-18T10:36:25.587144+0000","last_became_active":"2024-04-18T10:36:09.039432+0000","last_became_peered":"2024-04-18T10:36:09.039432+0000","last_unstale":"2024-04-18T10:36:25.587144+0000","last_undegraded":"2024-04-18T10:36:25.587144+0000","last_fullsized":"2024-04-18T10:36:25.587144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587975+0000","last_change":"2024-04-18T10:36:08.705414+0000","last_active":"2024-04-18T10:36:25.587975+0000","last_peered":"2024-04-18T10:36:25.587975+0000","last_clean":"2024-04-18T10:36:25.587975+0000","last_became_active":"2024-04-18T10:36:08.705077+0000","last_became_peered":"2024-04-18T10:36:08.705077+0000","last_unstale":"2024-04-18T10:36:25.587975+0000","last_undegraded":"2024-04-18T10:36:25.587975+0000","last_fullsized":"2024-04-18T10:36:25.587975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469120+0000","last_change":"2024-04-18T10:36:09.036998+0000","last_active":"2024-04-18T10:36:27.469120+0000","last_peered":"2024-04-18T10:36:27.469120+0000","last_clean":"2024-04-18T10:36:27.469120+0000","last_became_active":"2024-04-18T10:36:09.036672+0000","last_became_peered":"2024-04-18T10:36:09.036672+0000","last_unstale":"2024-04-18T10:36:27.469120+0000","last_undegraded":"2024-04-18T10:36:27.469120+0000","last_fullsized":"2024-04-18T10:36:27.469120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'16","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T10:38:28.468726+0000","last_change":"2024-04-18T10:36:08.711520+0000","last_active":"2024-04-18T10:38:28.468726+0000","last_peered":"2024-04-18T10:38:28.468726+0000","last_clean":"2024-04-18T10:38:28.468726+0000","last_became_active":"2024-04-18T10:36:08.711135+0000","last_became_peered":"2024-04-18T10:36:08.711135+0000","last_unstale":"2024-04-18T10:38:28.468726+0000","last_undegraded":"2024-04-18T10:38:28.468726+0000","last_fullsized":"2024-04-18T10:38:28.468726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4743,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590194+0000","last_change":"2024-04-18T10:36:09.012564+0000","last_active":"2024-04-18T10:36:25.590194+0000","last_peered":"2024-04-18T10:36:25.590194+0000","last_clean":"2024-04-18T10:36:25.590194+0000","last_became_active":"2024-04-18T10:36:09.012232+0000","last_became_peered":"2024-04-18T10:36:09.012232+0000","last_unstale":"2024-04-18T10:36:25.590194+0000","last_undegraded":"2024-04-18T10:36:25.590194+0000","last_fullsized":"2024-04-18T10:36:25.590194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588499+0000","last_change":"2024-04-18T10:36:08.715596+0000","last_active":"2024-04-18T10:36:25.588499+0000","last_peered":"2024-04-18T10:36:25.588499+0000","last_clean":"2024-04-18T10:36:25.588499+0000","last_became_active":"2024-04-18T10:36:08.715228+0000","last_became_peered":"2024-04-18T10:36:08.715228+0000","last_unstale":"2024-04-18T10:36:25.588499+0000","last_undegraded":"2024-04-18T10:36:25.588499+0000","last_fullsized":"2024-04-18T10:36:25.588499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588235+0000","last_change":"2024-04-18T10:36:09.039566+0000","last_active":"2024-04-18T10:36:25.588235+0000","last_peered":"2024-04-18T10:36:25.588235+0000","last_clean":"2024-04-18T10:36:25.588235+0000","last_became_active":"2024-04-18T10:36:09.039196+0000","last_became_peered":"2024-04-18T10:36:09.039196+0000","last_unstale":"2024-04-18T10:36:25.588235+0000","last_undegraded":"2024-04-18T10:36:25.588235+0000","last_fullsized":"2024-04-18T10:36:25.588235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587271+0000","last_change":"2024-04-18T10:36:08.700155+0000","last_active":"2024-04-18T10:36:25.587271+0000","last_peered":"2024-04-18T10:36:25.587271+0000","last_clean":"2024-04-18T10:36:25.587271+0000","last_became_active":"2024-04-18T10:36:08.699825+0000","last_became_peered":"2024-04-18T10:36:08.699825+0000","last_unstale":"2024-04-18T10:36:25.587271+0000","last_undegraded":"2024-04-18T10:36:25.587271+0000","last_fullsized":"2024-04-18T10:36:25.587271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587595+0000","last_change":"2024-04-18T10:36:09.043704+0000","last_active":"2024-04-18T10:36:25.587595+0000","last_peered":"2024-04-18T10:36:25.587595+0000","last_clean":"2024-04-18T10:36:25.587595+0000","last_became_active":"2024-04-18T10:36:09.043212+0000","last_became_peered":"2024-04-18T10:36:09.043212+0000","last_unstale":"2024-04-18T10:36:25.587595+0000","last_undegraded":"2024-04-18T10:36:25.587595+0000","last_fullsized":"2024-04-18T10:36:25.587595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587128+0000","last_change":"2024-04-18T10:36:08.712894+0000","last_active":"2024-04-18T10:36:25.587128+0000","last_peered":"2024-04-18T10:36:25.587128+0000","last_clean":"2024-04-18T10:36:25.587128+0000","last_became_active":"2024-04-18T10:36:08.712527+0000","last_became_peered":"2024-04-18T10:36:08.712527+0000","last_unstale":"2024-04-18T10:36:25.587128+0000","last_undegraded":"2024-04-18T10:36:25.587128+0000","last_fullsized":"2024-04-18T10:36:25.587128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588716+0000","last_change":"2024-04-18T10:36:09.028482+0000","last_active":"2024-04-18T10:36:25.588716+0000","last_peered":"2024-04-18T10:36:25.588716+0000","last_clean":"2024-04-18T10:36:25.588716+0000","last_became_active":"2024-04-18T10:36:09.027131+0000","last_became_peered":"2024-04-18T10:36:09.027131+0000","last_unstale":"2024-04-18T10:36:25.588716+0000","last_undegraded":"2024-04-18T10:36:25.588716+0000","last_fullsized":"2024-04-18T10:36:25.588716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469069+0000","last_change":"2024-04-18T10:36:08.696453+0000","last_active":"2024-04-18T10:36:27.469069+0000","last_peered":"2024-04-18T10:36:27.469069+0000","last_clean":"2024-04-18T10:36:27.469069+0000","last_became_active":"2024-04-18T10:36:08.691479+0000","last_became_peered":"2024-04-18T10:36:08.691479+0000","last_unstale":"2024-04-18T10:36:27.469069+0000","last_undegraded":"2024-04-18T10:36:27.469069+0000","last_fullsized":"2024-04-18T10:36:27.469069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589063+0000","last_change":"2024-04-18T10:36:09.045160+0000","last_active":"2024-04-18T10:36:25.589063+0000","last_peered":"2024-04-18T10:36:25.589063+0000","last_clean":"2024-04-18T10:36:25.589063+0000","last_became_active":"2024-04-18T10:36:09.044693+0000","last_became_peered":"2024-04-18T10:36:09.044693+0000","last_unstale":"2024-04-18T10:36:25.589063+0000","last_undegraded":"2024-04-18T10:36:25.589063+0000","last_fullsized":"2024-04-18T10:36:25.589063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589074+0000","last_change":"2024-04-18T10:36:08.693031+0000","last_active":"2024-04-18T10:36:25.589074+0000","last_peered":"2024-04-18T10:36:25.589074+0000","last_clean":"2024-04-18T10:36:25.589074+0000","last_became_active":"2024-04-18T10:36:08.692741+0000","last_became_peered":"2024-04-18T10:36:08.692741+0000","last_unstale":"2024-04-18T10:36:25.589074+0000","last_undegraded":"2024-04-18T10:36:25.589074+0000","last_fullsized":"2024-04-18T10:36:25.589074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587494+0000","last_change":"2024-04-18T10:36:09.043925+0000","last_active":"2024-04-18T10:36:25.587494+0000","last_peered":"2024-04-18T10:36:25.587494+0000","last_clean":"2024-04-18T10:36:25.587494+0000","last_became_active":"2024-04-18T10:36:09.043223+0000","last_became_peered":"2024-04-18T10:36:09.043223+0000","last_unstale":"2024-04-18T10:36:25.587494+0000","last_undegraded":"2024-04-18T10:36:25.587494+0000","last_fullsized":"2024-04-18T10:36:25.587494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590575+0000","last_change":"2024-04-18T10:36:08.693355+0000","last_active":"2024-04-18T10:36:25.590575+0000","last_peered":"2024-04-18T10:36:25.590575+0000","last_clean":"2024-04-18T10:36:25.590575+0000","last_became_active":"2024-04-18T10:36:08.693035+0000","last_became_peered":"2024-04-18T10:36:08.693035+0000","last_unstale":"2024-04-18T10:36:25.590575+0000","last_undegraded":"2024-04-18T10:36:25.590575+0000","last_fullsized":"2024-04-18T10:36:25.590575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468564+0000","last_change":"2024-04-18T10:36:09.013954+0000","last_active":"2024-04-18T10:36:27.468564+0000","last_peered":"2024-04-18T10:36:27.468564+0000","last_clean":"2024-04-18T10:36:27.468564+0000","last_became_active":"2024-04-18T10:36:09.013544+0000","last_became_peered":"2024-04-18T10:36:09.013544+0000","last_unstale":"2024-04-18T10:36:27.468564+0000","last_undegraded":"2024-04-18T10:36:27.468564+0000","last_fullsized":"2024-04-18T10:36:27.468564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587809+0000","last_change":"2024-04-18T10:36:08.710986+0000","last_active":"2024-04-18T10:36:25.587809+0000","last_peered":"2024-04-18T10:36:25.587809+0000","last_clean":"2024-04-18T10:36:25.587809+0000","last_became_active":"2024-04-18T10:36:08.710570+0000","last_became_peered":"2024-04-18T10:36:08.710570+0000","last_unstale":"2024-04-18T10:36:25.587809+0000","last_undegraded":"2024-04-18T10:36:25.587809+0000","last_fullsized":"2024-04-18T10:36:25.587809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590045+0000","last_change":"2024-04-18T10:36:09.013364+0000","last_active":"2024-04-18T10:36:25.590045+0000","last_peered":"2024-04-18T10:36:25.590045+0000","last_clean":"2024-04-18T10:36:25.590045+0000","last_became_active":"2024-04-18T10:36:09.013081+0000","last_became_peered":"2024-04-18T10:36:09.013081+0000","last_unstale":"2024-04-18T10:36:25.590045+0000","last_undegraded":"2024-04-18T10:36:25.590045+0000","last_fullsized":"2024-04-18T10:36:25.590045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587770+0000","last_change":"2024-04-18T10:36:08.697479+0000","last_active":"2024-04-18T10:36:25.587770+0000","last_peered":"2024-04-18T10:36:25.587770+0000","last_clean":"2024-04-18T10:36:25.587770+0000","last_became_active":"2024-04-18T10:36:08.697086+0000","last_became_peered":"2024-04-18T10:36:08.697086+0000","last_unstale":"2024-04-18T10:36:25.587770+0000","last_undegraded":"2024-04-18T10:36:25.587770+0000","last_fullsized":"2024-04-18T10:36:25.587770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588151+0000","last_change":"2024-04-18T10:36:09.022846+0000","last_active":"2024-04-18T10:36:25.588151+0000","last_peered":"2024-04-18T10:36:25.588151+0000","last_clean":"2024-04-18T10:36:25.588151+0000","last_became_active":"2024-04-18T10:36:09.019048+0000","last_became_peered":"2024-04-18T10:36:09.019048+0000","last_unstale":"2024-04-18T10:36:25.588151+0000","last_undegraded":"2024-04-18T10:36:25.588151+0000","last_fullsized":"2024-04-18T10:36:25.588151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588385+0000","last_change":"2024-04-18T10:36:08.715657+0000","last_active":"2024-04-18T10:36:25.588385+0000","last_peered":"2024-04-18T10:36:25.588385+0000","last_clean":"2024-04-18T10:36:25.588385+0000","last_became_active":"2024-04-18T10:36:08.715283+0000","last_became_peered":"2024-04-18T10:36:08.715283+0000","last_unstale":"2024-04-18T10:36:25.588385+0000","last_undegraded":"2024-04-18T10:36:25.588385+0000","last_fullsized":"2024-04-18T10:36:25.588385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587720+0000","last_change":"2024-04-18T10:36:09.006046+0000","last_active":"2024-04-18T10:36:25.587720+0000","last_peered":"2024-04-18T10:36:25.587720+0000","last_clean":"2024-04-18T10:36:25.587720+0000","last_became_active":"2024-04-18T10:36:09.005726+0000","last_became_peered":"2024-04-18T10:36:09.005726+0000","last_unstale":"2024-04-18T10:36:25.587720+0000","last_undegraded":"2024-04-18T10:36:25.587720+0000","last_fullsized":"2024-04-18T10:36:25.587720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:40.637690+0000","last_change":"2024-04-18T10:36:08.710590+0000","last_active":"2024-04-18T10:36:40.637690+0000","last_peered":"2024-04-18T10:36:40.637690+0000","last_clean":"2024-04-18T10:36:40.637690+0000","last_became_active":"2024-04-18T10:36:08.710198+0000","last_became_peered":"2024-04-18T10:36:08.710198+0000","last_unstale":"2024-04-18T10:36:40.637690+0000","last_undegraded":"2024-04-18T10:36:40.637690+0000","last_fullsized":"2024-04-18T10:36:40.637690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587701+0000","last_change":"2024-04-18T10:36:09.045249+0000","last_active":"2024-04-18T10:36:25.587701+0000","last_peered":"2024-04-18T10:36:25.587701+0000","last_clean":"2024-04-18T10:36:25.587701+0000","last_became_active":"2024-04-18T10:36:09.044573+0000","last_became_peered":"2024-04-18T10:36:09.044573+0000","last_unstale":"2024-04-18T10:36:25.587701+0000","last_undegraded":"2024-04-18T10:36:25.587701+0000","last_fullsized":"2024-04-18T10:36:25.587701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586948+0000","last_change":"2024-04-18T10:36:08.709580+0000","last_active":"2024-04-18T10:36:25.586948+0000","last_peered":"2024-04-18T10:36:25.586948+0000","last_clean":"2024-04-18T10:36:25.586948+0000","last_became_active":"2024-04-18T10:36:08.709283+0000","last_became_peered":"2024-04-18T10:36:08.709283+0000","last_unstale":"2024-04-18T10:36:25.586948+0000","last_undegraded":"2024-04-18T10:36:25.586948+0000","last_fullsized":"2024-04-18T10:36:25.586948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590646+0000","last_change":"2024-04-18T10:36:09.027970+0000","last_active":"2024-04-18T10:36:25.590646+0000","last_peered":"2024-04-18T10:36:25.590646+0000","last_clean":"2024-04-18T10:36:25.590646+0000","last_became_active":"2024-04-18T10:36:09.027650+0000","last_became_peered":"2024-04-18T10:36:09.027650+0000","last_unstale":"2024-04-18T10:36:25.590646+0000","last_undegraded":"2024-04-18T10:36:25.590646+0000","last_fullsized":"2024-04-18T10:36:25.590646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586760+0000","last_change":"2024-04-18T10:36:08.710914+0000","last_active":"2024-04-18T10:36:25.586760+0000","last_peered":"2024-04-18T10:36:25.586760+0000","last_clean":"2024-04-18T10:36:25.586760+0000","last_became_active":"2024-04-18T10:36:08.710619+0000","last_became_peered":"2024-04-18T10:36:08.710619+0000","last_unstale":"2024-04-18T10:36:25.586760+0000","last_undegraded":"2024-04-18T10:36:25.586760+0000","last_fullsized":"2024-04-18T10:36:25.586760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469657+0000","last_change":"2024-04-18T10:36:09.037889+0000","last_active":"2024-04-18T10:36:27.469657+0000","last_peered":"2024-04-18T10:36:27.469657+0000","last_clean":"2024-04-18T10:36:27.469657+0000","last_became_active":"2024-04-18T10:36:09.037533+0000","last_became_peered":"2024-04-18T10:36:09.037533+0000","last_unstale":"2024-04-18T10:36:27.469657+0000","last_undegraded":"2024-04-18T10:36:27.469657+0000","last_fullsized":"2024-04-18T10:36:27.469657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469397+0000","last_change":"2024-04-18T10:36:00.530860+0000","last_active":"2024-04-18T10:36:27.469397+0000","last_peered":"2024-04-18T10:36:27.469397+0000","last_clean":"2024-04-18T10:36:27.469397+0000","last_became_active":"2024-04-18T10:36:00.530496+0000","last_became_peered":"2024-04-18T10:36:00.530496+0000","last_unstale":"2024-04-18T10:36:27.469397+0000","last_undegraded":"2024-04-18T10:36:27.469397+0000","last_fullsized":"2024-04-18T10:36:27.469397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590450+0000","last_change":"2024-04-18T10:36:08.703862+0000","last_active":"2024-04-18T10:36:25.590450+0000","last_peered":"2024-04-18T10:36:25.590450+0000","last_clean":"2024-04-18T10:36:25.590450+0000","last_became_active":"2024-04-18T10:36:08.703311+0000","last_became_peered":"2024-04-18T10:36:08.703311+0000","last_unstale":"2024-04-18T10:36:25.590450+0000","last_undegraded":"2024-04-18T10:36:25.590450+0000","last_fullsized":"2024-04-18T10:36:25.590450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468960+0000","last_change":"2024-04-18T10:36:09.014696+0000","last_active":"2024-04-18T10:36:27.468960+0000","last_peered":"2024-04-18T10:36:27.468960+0000","last_clean":"2024-04-18T10:36:27.468960+0000","last_became_active":"2024-04-18T10:36:09.014208+0000","last_became_peered":"2024-04-18T10:36:09.014208+0000","last_unstale":"2024-04-18T10:36:27.468960+0000","last_undegraded":"2024-04-18T10:36:27.468960+0000","last_fullsized":"2024-04-18T10:36:27.468960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587729+0000","last_change":"2024-04-18T10:36:00.529282+0000","last_active":"2024-04-18T10:36:25.587729+0000","last_peered":"2024-04-18T10:36:25.587729+0000","last_clean":"2024-04-18T10:36:25.587729+0000","last_became_active":"2024-04-18T10:36:00.528895+0000","last_became_peered":"2024-04-18T10:36:00.528895+0000","last_unstale":"2024-04-18T10:36:25.587729+0000","last_undegraded":"2024-04-18T10:36:25.587729+0000","last_fullsized":"2024-04-18T10:36:25.587729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:45.637747+0000","last_change":"2024-04-18T10:36:08.694077+0000","last_active":"2024-04-18T10:36:45.637747+0000","last_peered":"2024-04-18T10:36:45.637747+0000","last_clean":"2024-04-18T10:36:45.637747+0000","last_became_active":"2024-04-18T10:36:08.693727+0000","last_became_peered":"2024-04-18T10:36:08.693727+0000","last_unstale":"2024-04-18T10:36:45.637747+0000","last_undegraded":"2024-04-18T10:36:45.637747+0000","last_fullsized":"2024-04-18T10:36:45.637747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469149+0000","last_change":"2024-04-18T10:36:09.017243+0000","last_active":"2024-04-18T10:36:27.469149+0000","last_peered":"2024-04-18T10:36:27.469149+0000","last_clean":"2024-04-18T10:36:27.469149+0000","last_became_active":"2024-04-18T10:36:09.016843+0000","last_became_peered":"2024-04-18T10:36:09.016843+0000","last_unstale":"2024-04-18T10:36:27.469149+0000","last_undegraded":"2024-04-18T10:36:27.469149+0000","last_fullsized":"2024-04-18T10:36:27.469149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589992+0000","last_change":"2024-04-18T10:36:00.529420+0000","last_active":"2024-04-18T10:36:25.589992+0000","last_peered":"2024-04-18T10:36:25.589992+0000","last_clean":"2024-04-18T10:36:25.589992+0000","last_became_active":"2024-04-18T10:36:00.529029+0000","last_became_peered":"2024-04-18T10:36:00.529029+0000","last_unstale":"2024-04-18T10:36:25.589992+0000","last_undegraded":"2024-04-18T10:36:25.589992+0000","last_fullsized":"2024-04-18T10:36:25.589992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468863+0000","last_change":"2024-04-18T10:36:08.697102+0000","last_active":"2024-04-18T10:36:27.468863+0000","last_peered":"2024-04-18T10:36:27.468863+0000","last_clean":"2024-04-18T10:36:27.468863+0000","last_became_active":"2024-04-18T10:36:08.696687+0000","last_became_peered":"2024-04-18T10:36:08.696687+0000","last_unstale":"2024-04-18T10:36:27.468863+0000","last_undegraded":"2024-04-18T10:36:27.468863+0000","last_fullsized":"2024-04-18T10:36:27.468863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469706+0000","last_change":"2024-04-18T10:36:09.031490+0000","last_active":"2024-04-18T10:36:27.469706+0000","last_peered":"2024-04-18T10:36:27.469706+0000","last_clean":"2024-04-18T10:36:27.469706+0000","last_became_active":"2024-04-18T10:36:09.030866+0000","last_became_peered":"2024-04-18T10:36:09.030866+0000","last_unstale":"2024-04-18T10:36:27.469706+0000","last_undegraded":"2024-04-18T10:36:27.469706+0000","last_fullsized":"2024-04-18T10:36:27.469706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588419+0000","last_change":"2024-04-18T10:36:00.530056+0000","last_active":"2024-04-18T10:36:25.588419+0000","last_peered":"2024-04-18T10:36:25.588419+0000","last_clean":"2024-04-18T10:36:25.588419+0000","last_became_active":"2024-04-18T10:36:00.529546+0000","last_became_peered":"2024-04-18T10:36:00.529546+0000","last_unstale":"2024-04-18T10:36:25.588419+0000","last_undegraded":"2024-04-18T10:36:25.588419+0000","last_fullsized":"2024-04-18T10:36:25.588419+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'1","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468720+0000","last_change":"2024-04-18T10:35:56.421744+0000","last_active":"2024-04-18T10:36:27.468720+0000","last_peered":"2024-04-18T10:36:27.468720+0000","last_clean":"2024-04-18T10:36:27.468720+0000","last_became_active":"2024-04-18T10:35:56.421316+0000","last_became_peered":"2024-04-18T10:35:56.421316+0000","last_unstale":"2024-04-18T10:36:27.468720+0000","last_undegraded":"2024-04-18T10:36:27.468720+0000","last_fullsized":"2024-04-18T10:36:27.468720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587622+0000","last_change":"2024-04-18T10:36:08.711994+0000","last_active":"2024-04-18T10:36:25.587622+0000","last_peered":"2024-04-18T10:36:25.587622+0000","last_clean":"2024-04-18T10:36:25.587622+0000","last_became_active":"2024-04-18T10:36:08.711652+0000","last_became_peered":"2024-04-18T10:36:08.711652+0000","last_unstale":"2024-04-18T10:36:25.587622+0000","last_undegraded":"2024-04-18T10:36:25.587622+0000","last_fullsized":"2024-04-18T10:36:25.587622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588129+0000","last_change":"2024-04-18T10:36:09.045388+0000","last_active":"2024-04-18T10:36:25.588129+0000","last_peered":"2024-04-18T10:36:25.588129+0000","last_clean":"2024-04-18T10:36:25.588129+0000","last_became_active":"2024-04-18T10:36:09.044909+0000","last_became_peered":"2024-04-18T10:36:09.044909+0000","last_unstale":"2024-04-18T10:36:25.588129+0000","last_undegraded":"2024-04-18T10:36:25.588129+0000","last_fullsized":"2024-04-18T10:36:25.588129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587023+0000","last_change":"2024-04-18T10:36:00.529398+0000","last_active":"2024-04-18T10:36:25.587023+0000","last_peered":"2024-04-18T10:36:25.587023+0000","last_clean":"2024-04-18T10:36:25.587023+0000","last_became_active":"2024-04-18T10:36:00.528912+0000","last_became_peered":"2024-04-18T10:36:00.528912+0000","last_unstale":"2024-04-18T10:36:25.587023+0000","last_undegraded":"2024-04-18T10:36:25.587023+0000","last_fullsized":"2024-04-18T10:36:25.587023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586966+0000","last_change":"2024-04-18T10:36:08.692668+0000","last_active":"2024-04-18T10:36:25.586966+0000","last_peered":"2024-04-18T10:36:25.586966+0000","last_clean":"2024-04-18T10:36:25.586966+0000","last_became_active":"2024-04-18T10:36:08.692317+0000","last_became_peered":"2024-04-18T10:36:08.692317+0000","last_unstale":"2024-04-18T10:36:25.586966+0000","last_undegraded":"2024-04-18T10:36:25.586966+0000","last_fullsized":"2024-04-18T10:36:25.586966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588816+0000","last_change":"2024-04-18T10:36:09.019756+0000","last_active":"2024-04-18T10:36:25.588816+0000","last_peered":"2024-04-18T10:36:25.588816+0000","last_clean":"2024-04-18T10:36:25.588816+0000","last_became_active":"2024-04-18T10:36:09.019251+0000","last_became_peered":"2024-04-18T10:36:09.019251+0000","last_unstale":"2024-04-18T10:36:25.588816+0000","last_undegraded":"2024-04-18T10:36:25.588816+0000","last_fullsized":"2024-04-18T10:36:25.588816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587932+0000","last_change":"2024-04-18T10:36:00.527346+0000","last_active":"2024-04-18T10:36:25.587932+0000","last_peered":"2024-04-18T10:36:25.587932+0000","last_clean":"2024-04-18T10:36:25.587932+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:25.587932+0000","last_undegraded":"2024-04-18T10:36:25.587932+0000","last_fullsized":"2024-04-18T10:36:25.587932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468929+0000","last_change":"2024-04-18T10:36:08.700410+0000","last_active":"2024-04-18T10:36:27.468929+0000","last_peered":"2024-04-18T10:36:27.468929+0000","last_clean":"2024-04-18T10:36:27.468929+0000","last_became_active":"2024-04-18T10:36:08.700048+0000","last_became_peered":"2024-04-18T10:36:08.700048+0000","last_unstale":"2024-04-18T10:36:27.468929+0000","last_undegraded":"2024-04-18T10:36:27.468929+0000","last_fullsized":"2024-04-18T10:36:27.468929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587981+0000","last_change":"2024-04-18T10:36:09.018239+0000","last_active":"2024-04-18T10:36:25.587981+0000","last_peered":"2024-04-18T10:36:25.587981+0000","last_clean":"2024-04-18T10:36:25.587981+0000","last_became_active":"2024-04-18T10:36:09.010612+0000","last_became_peered":"2024-04-18T10:36:09.010612+0000","last_unstale":"2024-04-18T10:36:25.587981+0000","last_undegraded":"2024-04-18T10:36:25.587981+0000","last_fullsized":"2024-04-18T10:36:25.587981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588961+0000","last_change":"2024-04-18T10:36:08.710579+0000","last_active":"2024-04-18T10:36:25.588961+0000","last_peered":"2024-04-18T10:36:25.588961+0000","last_clean":"2024-04-18T10:36:25.588961+0000","last_became_active":"2024-04-18T10:36:08.710165+0000","last_became_peered":"2024-04-18T10:36:08.710165+0000","last_unstale":"2024-04-18T10:36:25.588961+0000","last_undegraded":"2024-04-18T10:36:25.588961+0000","last_fullsized":"2024-04-18T10:36:25.588961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468922+0000","last_change":"2024-04-18T10:36:00.529862+0000","last_active":"2024-04-18T10:36:27.468922+0000","last_peered":"2024-04-18T10:36:27.468922+0000","last_clean":"2024-04-18T10:36:27.468922+0000","last_became_active":"2024-04-18T10:36:00.529451+0000","last_became_peered":"2024-04-18T10:36:00.529451+0000","last_unstale":"2024-04-18T10:36:27.468922+0000","last_undegraded":"2024-04-18T10:36:27.468922+0000","last_fullsized":"2024-04-18T10:36:27.468922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586901+0000","last_change":"2024-04-18T10:36:09.043858+0000","last_active":"2024-04-18T10:36:25.586901+0000","last_peered":"2024-04-18T10:36:25.586901+0000","last_clean":"2024-04-18T10:36:25.586901+0000","last_became_active":"2024-04-18T10:36:09.042887+0000","last_became_peered":"2024-04-18T10:36:09.042887+0000","last_unstale":"2024-04-18T10:36:25.586901+0000","last_undegraded":"2024-04-18T10:36:25.586901+0000","last_fullsized":"2024-04-18T10:36:25.586901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588955+0000","last_change":"2024-04-18T10:36:00.527385+0000","last_active":"2024-04-18T10:36:25.588955+0000","last_peered":"2024-04-18T10:36:25.588955+0000","last_clean":"2024-04-18T10:36:25.588955+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:25.588955+0000","last_undegraded":"2024-04-18T10:36:25.588955+0000","last_fullsized":"2024-04-18T10:36:25.588955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:35.641458+0000","last_change":"2024-04-18T10:36:08.703568+0000","last_active":"2024-04-18T10:36:35.641458+0000","last_peered":"2024-04-18T10:36:35.641458+0000","last_clean":"2024-04-18T10:36:35.641458+0000","last_became_active":"2024-04-18T10:36:08.702770+0000","last_became_peered":"2024-04-18T10:36:08.702770+0000","last_unstale":"2024-04-18T10:36:35.641458+0000","last_undegraded":"2024-04-18T10:36:35.641458+0000","last_fullsized":"2024-04-18T10:36:35.641458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589882+0000","last_change":"2024-04-18T10:36:09.005270+0000","last_active":"2024-04-18T10:36:25.589882+0000","last_peered":"2024-04-18T10:36:25.589882+0000","last_clean":"2024-04-18T10:36:25.589882+0000","last_became_active":"2024-04-18T10:36:09.004929+0000","last_became_peered":"2024-04-18T10:36:09.004929+0000","last_unstale":"2024-04-18T10:36:25.589882+0000","last_undegraded":"2024-04-18T10:36:25.589882+0000","last_fullsized":"2024-04-18T10:36:25.589882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"20'10","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:40.638460+0000","last_change":"2024-04-18T10:36:08.698046+0000","last_active":"2024-04-18T10:36:40.638460+0000","last_peered":"2024-04-18T10:36:40.638460+0000","last_clean":"2024-04-18T10:36:40.638460+0000","last_became_active":"2024-04-18T10:36:08.697438+0000","last_became_peered":"2024-04-18T10:36:08.697438+0000","last_unstale":"2024-04-18T10:36:40.638460+0000","last_undegraded":"2024-04-18T10:36:40.638460+0000","last_fullsized":"2024-04-18T10:36:40.638460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590402+0000","last_change":"2024-04-18T10:36:09.016654+0000","last_active":"2024-04-18T10:36:25.590402+0000","last_peered":"2024-04-18T10:36:25.590402+0000","last_clean":"2024-04-18T10:36:25.590402+0000","last_became_active":"2024-04-18T10:36:09.016342+0000","last_became_peered":"2024-04-18T10:36:09.016342+0000","last_unstale":"2024-04-18T10:36:25.590402+0000","last_undegraded":"2024-04-18T10:36:25.590402+0000","last_fullsized":"2024-04-18T10:36:25.590402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469290+0000","last_change":"2024-04-18T10:36:08.700728+0000","last_active":"2024-04-18T10:36:27.469290+0000","last_peered":"2024-04-18T10:36:27.469290+0000","last_clean":"2024-04-18T10:36:27.469290+0000","last_became_active":"2024-04-18T10:36:08.699603+0000","last_became_peered":"2024-04-18T10:36:08.699603+0000","last_unstale":"2024-04-18T10:36:27.469290+0000","last_undegraded":"2024-04-18T10:36:27.469290+0000","last_fullsized":"2024-04-18T10:36:27.469290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590119+0000","last_change":"2024-04-18T10:36:09.021888+0000","last_active":"2024-04-18T10:36:25.590119+0000","last_peered":"2024-04-18T10:36:25.590119+0000","last_clean":"2024-04-18T10:36:25.590119+0000","last_became_active":"2024-04-18T10:36:09.018363+0000","last_became_peered":"2024-04-18T10:36:09.018363+0000","last_unstale":"2024-04-18T10:36:25.590119+0000","last_undegraded":"2024-04-18T10:36:25.590119+0000","last_fullsized":"2024-04-18T10:36:25.590119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588032+0000","last_change":"2024-04-18T10:36:08.714829+0000","last_active":"2024-04-18T10:36:25.588032+0000","last_peered":"2024-04-18T10:36:25.588032+0000","last_clean":"2024-04-18T10:36:25.588032+0000","last_became_active":"2024-04-18T10:36:08.714528+0000","last_became_peered":"2024-04-18T10:36:08.714528+0000","last_unstale":"2024-04-18T10:36:25.588032+0000","last_undegraded":"2024-04-18T10:36:25.588032+0000","last_fullsized":"2024-04-18T10:36:25.588032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589970+0000","last_change":"2024-04-18T10:36:09.022031+0000","last_active":"2024-04-18T10:36:25.589970+0000","last_peered":"2024-04-18T10:36:25.589970+0000","last_clean":"2024-04-18T10:36:25.589970+0000","last_became_active":"2024-04-18T10:36:09.018240+0000","last_became_peered":"2024-04-18T10:36:09.018240+0000","last_unstale":"2024-04-18T10:36:25.589970+0000","last_undegraded":"2024-04-18T10:36:25.589970+0000","last_fullsized":"2024-04-18T10:36:25.589970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588818+0000","last_change":"2024-04-18T10:36:08.712223+0000","last_active":"2024-04-18T10:36:25.588818+0000","last_peered":"2024-04-18T10:36:25.588818+0000","last_clean":"2024-04-18T10:36:25.588818+0000","last_became_active":"2024-04-18T10:36:08.711192+0000","last_became_peered":"2024-04-18T10:36:08.711192+0000","last_unstale":"2024-04-18T10:36:25.588818+0000","last_undegraded":"2024-04-18T10:36:25.588818+0000","last_fullsized":"2024-04-18T10:36:25.588818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587253+0000","last_change":"2024-04-18T10:36:09.030946+0000","last_active":"2024-04-18T10:36:25.587253+0000","last_peered":"2024-04-18T10:36:25.587253+0000","last_clean":"2024-04-18T10:36:25.587253+0000","last_became_active":"2024-04-18T10:36:09.030646+0000","last_became_peered":"2024-04-18T10:36:09.030646+0000","last_unstale":"2024-04-18T10:36:25.587253+0000","last_undegraded":"2024-04-18T10:36:25.587253+0000","last_fullsized":"2024-04-18T10:36:25.587253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589247+0000","last_change":"2024-04-18T10:36:08.706957+0000","last_active":"2024-04-18T10:36:25.589247+0000","last_peered":"2024-04-18T10:36:25.589247+0000","last_clean":"2024-04-18T10:36:25.589247+0000","last_became_active":"2024-04-18T10:36:08.706598+0000","last_became_peered":"2024-04-18T10:36:08.706598+0000","last_unstale":"2024-04-18T10:36:25.589247+0000","last_undegraded":"2024-04-18T10:36:25.589247+0000","last_fullsized":"2024-04-18T10:36:25.589247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589782+0000","last_change":"2024-04-18T10:36:09.017279+0000","last_active":"2024-04-18T10:36:25.589782+0000","last_peered":"2024-04-18T10:36:25.589782+0000","last_clean":"2024-04-18T10:36:25.589782+0000","last_became_active":"2024-04-18T10:36:09.016931+0000","last_became_peered":"2024-04-18T10:36:09.016931+0000","last_unstale":"2024-04-18T10:36:25.589782+0000","last_undegraded":"2024-04-18T10:36:25.589782+0000","last_fullsized":"2024-04-18T10:36:25.589782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469048+0000","last_change":"2024-04-18T10:36:09.032926+0000","last_active":"2024-04-18T10:36:27.469048+0000","last_peered":"2024-04-18T10:36:27.469048+0000","last_clean":"2024-04-18T10:36:27.469048+0000","last_became_active":"2024-04-18T10:36:09.032571+0000","last_became_peered":"2024-04-18T10:36:09.032571+0000","last_unstale":"2024-04-18T10:36:27.469048+0000","last_undegraded":"2024-04-18T10:36:27.469048+0000","last_fullsized":"2024-04-18T10:36:27.469048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586998+0000","last_change":"2024-04-18T10:36:09.042985+0000","last_active":"2024-04-18T10:36:25.586998+0000","last_peered":"2024-04-18T10:36:25.586998+0000","last_clean":"2024-04-18T10:36:25.586998+0000","last_became_active":"2024-04-18T10:36:09.039602+0000","last_became_peered":"2024-04-18T10:36:09.039602+0000","last_unstale":"2024-04-18T10:36:25.586998+0000","last_undegraded":"2024-04-18T10:36:25.586998+0000","last_fullsized":"2024-04-18T10:36:25.586998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587389+0000","last_change":"2024-04-18T10:36:09.028593+0000","last_active":"2024-04-18T10:36:25.587389+0000","last_peered":"2024-04-18T10:36:25.587389+0000","last_clean":"2024-04-18T10:36:25.587389+0000","last_became_active":"2024-04-18T10:36:09.028237+0000","last_became_peered":"2024-04-18T10:36:09.028237+0000","last_unstale":"2024-04-18T10:36:25.587389+0000","last_undegraded":"2024-04-18T10:36:25.587389+0000","last_fullsized":"2024-04-18T10:36:25.587389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588514+0000","last_change":"2024-04-18T10:36:09.043613+0000","last_active":"2024-04-18T10:36:25.588514+0000","last_peered":"2024-04-18T10:36:25.588514+0000","last_clean":"2024-04-18T10:36:25.588514+0000","last_became_active":"2024-04-18T10:36:09.042942+0000","last_became_peered":"2024-04-18T10:36:09.042942+0000","last_unstale":"2024-04-18T10:36:25.588514+0000","last_undegraded":"2024-04-18T10:36:25.588514+0000","last_fullsized":"2024-04-18T10:36:25.588514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469325+0000","last_change":"2024-04-18T10:36:09.017151+0000","last_active":"2024-04-18T10:36:27.469325+0000","last_peered":"2024-04-18T10:36:27.469325+0000","last_clean":"2024-04-18T10:36:27.469325+0000","last_became_active":"2024-04-18T10:36:09.016454+0000","last_became_peered":"2024-04-18T10:36:09.016454+0000","last_unstale":"2024-04-18T10:36:27.469325+0000","last_undegraded":"2024-04-18T10:36:27.469325+0000","last_fullsized":"2024-04-18T10:36:27.469325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8511,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672993,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":68633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.312,"15min":0.316},"min":{"1min":0.17100000000000001,"5min":0.158,"15min":0.158},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.32800000000000001,"15min":0.33400000000000002},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.33300000000000002,"15min":0.33800000000000002},"min":{"1min":0.22600000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.32700000000000001,"15min":0.33500000000000002},"min":{"1min":0.217,"5min":0.184,"15min":0.184},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.249,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.34000000000000002,"15min":0.34699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.36599999999999999}]}]},{"osd":2,"up_from":10,"seq":42949672994,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":65552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.28499999999999998,"15min":0.29099999999999998},"min":{"1min":0.183,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.35099999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.247},{"interface":"front","average":{"1min":0.251,"5min":0.30499999999999999,"15min":0.314},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.35699999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.255,"5min":0.308,"15min":0.317},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.33700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.314},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.34300000000000003,"15min":0.35099999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.39000000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.32600000000000001,"15min":0.33400000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.36899999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.35499999999999998,"15min":0.36399999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.38300000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.34499999999999997}]}]},{"osd":0,"up_from":10,"seq":42949672993,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":60073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27900000000000003,"15min":0.28000000000000003},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Apr 18 10:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.51800000000000002,"15min":0.55600000000000005},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.48699999999999999,"5min":5.1369999999999996,"15min":5.1369999999999996},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.307,"5min":0.32800000000000001,"15min":0.33200000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46999999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.316}]},{"osd":3,"last update":"Thu Apr 18 10:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.33900000000000002,"15min":0.34499999999999997},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.33000000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672994,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.314,"15min":0.318},"min":{"1min":0.23100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.42599999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.27700000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45400000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Apr 18 10:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.27600000000000002,"5min":0.309,"15min":0.315},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.40500000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.23999999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46600000000000003,"5min":0.498,"15min":0.498},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Apr 18 10:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.32900000000000001,"15min":0.33500000000000002},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.42599999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.252},{"interface":"front","average":{"1min":0.311,"5min":0.35099999999999998,"15min":0.35699999999999998},"min":{"1min":0.22900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.44600000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.313}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:38:31.863 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:38:32.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.019+0000 7fae5fd10700 1 Processor -- start 2024-04-18T10:38:32.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.019+0000 7fae5fd10700 1 -- start start 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5fd10700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5806fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5fd10700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae58149530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5fd10700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae580a26d0 con 0x7fae580679e0 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5fd10700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae580a2a10 con 0x7fae5806e0c0 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5fd10700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae580a37d0 con 0x7fae580a22a0 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5d2ab700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5806fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5e2ad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae58149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5daac700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fae580679e0 0x7fae5806d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48300/0 (socket says 172.21.15.31:48300) 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5daac700 1 -- 172.21.15.31:0/1002576421 learned_addr learned my addr 172.21.15.31:0/1002576421 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:32.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5caaa700 1 -- 172.21.15.31:0/1002576421 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085710564 0 0) 0x7fae580a26d0 con 0x7fae580679e0 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5e2ad700 1 -- 172.21.15.31:0/1002576421 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 msgr2=0x7fae5806fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5e2ad700 1 --2- 172.21.15.31:0/1002576421 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5806fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5e2ad700 1 -- 172.21.15.31:0/1002576421 >> v1:172.21.15.31:6789/0 conn(0x7fae580679e0 legacy=0x7fae5806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5e2ad700 1 -- 172.21.15.31:0/1002576421 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae580a3a70 con 0x7fae5806e0c0 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5d2ab700 1 --2- 172.21.15.31:0/1002576421 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5806fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5e2ad700 1 --2- 172.21.15.31:0/1002576421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae58149530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae50009e90 tx=0x7fae50009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c97d3c31541b700 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5caaa700 1 -- 172.21.15.31:0/1002576421 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5000e070 con 0x7fae5806e0c0 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5caaa700 1 -- 172.21.15.31:0/1002576421 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5000bc30 con 0x7fae5806e0c0 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.020+0000 7fae5caaa700 1 -- 172.21.15.31:0/1002576421 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50012430 con 0x7fae5806e0c0 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.021+0000 7fae5fd10700 1 -- 172.21.15.31:0/1002576421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 msgr2=0x7fae58149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.021+0000 7fae5fd10700 1 --2- 172.21.15.31:0/1002576421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae58149530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae50009e90 tx=0x7fae50009780 comp rx=0 tx=0).stop 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.021+0000 7fae5fd10700 1 -- 172.21.15.31:0/1002576421 shutdown_connections 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.021+0000 7fae5fd10700 1 --2- 172.21.15.31:0/1002576421 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae58149530 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.021+0000 7fae5fd10700 1 --2- 172.21.15.31:0/1002576421 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5806fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.021+0000 7fae5fd10700 1 -- 172.21.15.31:0/1002576421 >> 172.21.15.31:0/1002576421 conn(0x7fae58068af0 msgr2=0x7fae58068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:32.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.021+0000 7fae5fd10700 1 -- 172.21.15.31:0/1002576421 shutdown_connections 2024-04-18T10:38:32.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.021+0000 7fae5fd10700 1 -- 172.21.15.31:0/1002576421 wait complete. 2024-04-18T10:38:32.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.022+0000 7fae5fd10700 1 Processor -- start 2024-04-18T10:38:32.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.022+0000 7fae5fd10700 1 -- start start 2024-04-18T10:38:32.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.022+0000 7fae5fd10700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580679e0 0x7fae58096b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.022+0000 7fae5fd10700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae5813f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.022+0000 7fae5fd10700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5fd10700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae58098510 con 0x7fae580679e0 2024-04-18T10:38:32.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5fd10700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae580ae8b0 con 0x7fae5806e0c0 2024-04-18T10:38:32.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5fd10700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fae580973e0 con 0x7fae580a22a0 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5daac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580679e0 0x7fae58096b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5daac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580679e0 0x7fae58096b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39250/0 (socket says 172.21.15.31:39250) 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5d2ab700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae5813f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5daac700 1 -- 172.21.15.31:0/3547661446 learned_addr learned my addr 172.21.15.31:0/3547661446 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5e2ad700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5daac700 1 -- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 msgr2=0x7fae5813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5daac700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5813fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5daac700 1 -- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 msgr2=0x7fae5813f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5daac700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae5813f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5daac700 1 -- 172.21.15.31:0/3547661446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009420 con 0x7fae580679e0 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5d2ab700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae5813f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5e2ad700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5daac700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580679e0 0x7fae58096b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c560 tx=0x7fae54000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae4dffb700 1 -- 172.21.15.31:0/3547661446 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54005b30 con 0x7fae580679e0 2024-04-18T10:38:32.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae4dffb700 1 -- 172.21.15.31:0/3547661446 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae54005c90 con 0x7fae580679e0 2024-04-18T10:38:32.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae4dffb700 1 -- 172.21.15.31:0/3547661446 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54007320 con 0x7fae580679e0 2024-04-18T10:38:32.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.023+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae50009a20 con 0x7fae580679e0 2024-04-18T10:38:32.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.024+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae581402a0 con 0x7fae580679e0 2024-04-18T10:38:32.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.024+0000 7fae4dffb700 1 -- 172.21.15.31:0/3547661446 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7fae5401b3b0 con 0x7fae580679e0 2024-04-18T10:38:32.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.024+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae58099430 con 0x7fae580679e0 2024-04-18T10:38:32.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.025+0000 7fae4dffb700 1 -- 172.21.15.31:0/3547661446 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3829+0+0 (secure 0 0 0) 0x7fae5405a550 con 0x7fae580679e0 2024-04-18T10:38:32.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.028+0000 7fae4dffb700 1 -- 172.21.15.31:0/3547661446 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fae54038860 con 0x7fae580679e0 2024-04-18T10:38:32.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.186+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae580651b0 con 0x7fae3c045f80 2024-04-18T10:38:32.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.193+0000 7fae4dffb700 1 -- 172.21.15.31:0/3547661446 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270449 (unknown 2965378022 0 3893676055) 0x7fae580651b0 con 0x7fae3c045f80 2024-04-18T10:38:32.197 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 >> v1:172.21.15.31:6816/46601 conn(0x7fae3c045f80 legacy=0x7fae3c048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580679e0 msgr2=0x7fae58096b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580679e0 0x7fae58096b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c560 tx=0x7fae54000fe0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 shutdown_connections 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fae580a22a0 0x7fae5813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580679e0 0x7fae58096b20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 --2- 172.21.15.31:0/3547661446 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fae5806e0c0 0x7fae5813f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 >> 172.21.15.31:0/3547661446 conn(0x7fae58068af0 msgr2=0x7fae580a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 shutdown_connections 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.196+0000 7fae5fd10700 1 -- 172.21.15.31:0/3547661446 wait complete. 2024-04-18T10:38:32.199 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:38:32.208 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-18T10:38:31.407179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8511,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195152,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292208,"statfs":{"total":386547056640,"available":382251220992,"internally_reserved":4294967296,"allocated":835584,"data_stored":255600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004055"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590417+0000","last_change":"2024-04-18T10:36:09.029464+0000","last_active":"2024-04-18T10:36:25.590417+0000","last_peered":"2024-04-18T10:36:25.590417+0000","last_clean":"2024-04-18T10:36:25.590417+0000","last_became_active":"2024-04-18T10:36:09.029119+0000","last_became_peered":"2024-04-18T10:36:09.029119+0000","last_unstale":"2024-04-18T10:36:25.590417+0000","last_undegraded":"2024-04-18T10:36:25.590417+0000","last_fullsized":"2024-04-18T10:36:25.590417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590640+0000","last_change":"2024-04-18T10:36:09.016639+0000","last_active":"2024-04-18T10:36:25.590640+0000","last_peered":"2024-04-18T10:36:25.590640+0000","last_clean":"2024-04-18T10:36:25.590640+0000","last_became_active":"2024-04-18T10:36:09.016298+0000","last_became_peered":"2024-04-18T10:36:09.016298+0000","last_unstale":"2024-04-18T10:36:25.590640+0000","last_undegraded":"2024-04-18T10:36:25.590640+0000","last_fullsized":"2024-04-18T10:36:25.590640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588068+0000","last_change":"2024-04-18T10:36:09.021729+0000","last_active":"2024-04-18T10:36:25.588068+0000","last_peered":"2024-04-18T10:36:25.588068+0000","last_clean":"2024-04-18T10:36:25.588068+0000","last_became_active":"2024-04-18T10:36:09.021089+0000","last_became_peered":"2024-04-18T10:36:09.021089+0000","last_unstale":"2024-04-18T10:36:25.588068+0000","last_undegraded":"2024-04-18T10:36:25.588068+0000","last_fullsized":"2024-04-18T10:36:25.588068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587566+0000","last_change":"2024-04-18T10:36:09.022509+0000","last_active":"2024-04-18T10:36:25.587566+0000","last_peered":"2024-04-18T10:36:25.587566+0000","last_clean":"2024-04-18T10:36:25.587566+0000","last_became_active":"2024-04-18T10:36:09.019360+0000","last_became_peered":"2024-04-18T10:36:09.019360+0000","last_unstale":"2024-04-18T10:36:25.587566+0000","last_undegraded":"2024-04-18T10:36:25.587566+0000","last_fullsized":"2024-04-18T10:36:25.587566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588091+0000","last_change":"2024-04-18T10:36:09.021300+0000","last_active":"2024-04-18T10:36:25.588091+0000","last_peered":"2024-04-18T10:36:25.588091+0000","last_clean":"2024-04-18T10:36:25.588091+0000","last_became_active":"2024-04-18T10:36:09.018608+0000","last_became_peered":"2024-04-18T10:36:09.018608+0000","last_unstale":"2024-04-18T10:36:25.588091+0000","last_undegraded":"2024-04-18T10:36:25.588091+0000","last_fullsized":"2024-04-18T10:36:25.588091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587840+0000","last_change":"2024-04-18T10:36:09.041400+0000","last_active":"2024-04-18T10:36:25.587840+0000","last_peered":"2024-04-18T10:36:25.587840+0000","last_clean":"2024-04-18T10:36:25.587840+0000","last_became_active":"2024-04-18T10:36:09.038827+0000","last_became_peered":"2024-04-18T10:36:09.038827+0000","last_unstale":"2024-04-18T10:36:25.587840+0000","last_undegraded":"2024-04-18T10:36:25.587840+0000","last_fullsized":"2024-04-18T10:36:25.587840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586877+0000","last_change":"2024-04-18T10:36:09.042033+0000","last_active":"2024-04-18T10:36:25.586877+0000","last_peered":"2024-04-18T10:36:25.586877+0000","last_clean":"2024-04-18T10:36:25.586877+0000","last_became_active":"2024-04-18T10:36:09.039118+0000","last_became_peered":"2024-04-18T10:36:09.039118+0000","last_unstale":"2024-04-18T10:36:25.586877+0000","last_undegraded":"2024-04-18T10:36:25.586877+0000","last_fullsized":"2024-04-18T10:36:25.586877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468541+0000","last_change":"2024-04-18T10:36:09.032927+0000","last_active":"2024-04-18T10:36:27.468541+0000","last_peered":"2024-04-18T10:36:27.468541+0000","last_clean":"2024-04-18T10:36:27.468541+0000","last_became_active":"2024-04-18T10:36:09.032162+0000","last_became_peered":"2024-04-18T10:36:09.032162+0000","last_unstale":"2024-04-18T10:36:27.468541+0000","last_undegraded":"2024-04-18T10:36:27.468541+0000","last_fullsized":"2024-04-18T10:36:27.468541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588966+0000","last_change":"2024-04-18T10:36:09.022311+0000","last_active":"2024-04-18T10:36:25.588966+0000","last_peered":"2024-04-18T10:36:25.588966+0000","last_clean":"2024-04-18T10:36:25.588966+0000","last_became_active":"2024-04-18T10:36:09.021805+0000","last_became_peered":"2024-04-18T10:36:09.021805+0000","last_unstale":"2024-04-18T10:36:25.588966+0000","last_undegraded":"2024-04-18T10:36:25.588966+0000","last_fullsized":"2024-04-18T10:36:25.588966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469100+0000","last_change":"2024-04-18T10:36:09.034290+0000","last_active":"2024-04-18T10:36:27.469100+0000","last_peered":"2024-04-18T10:36:27.469100+0000","last_clean":"2024-04-18T10:36:27.469100+0000","last_became_active":"2024-04-18T10:36:09.034081+0000","last_became_peered":"2024-04-18T10:36:09.034081+0000","last_unstale":"2024-04-18T10:36:27.469100+0000","last_undegraded":"2024-04-18T10:36:27.469100+0000","last_fullsized":"2024-04-18T10:36:27.469100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469047+0000","last_change":"2024-04-18T10:36:09.016527+0000","last_active":"2024-04-18T10:36:27.469047+0000","last_peered":"2024-04-18T10:36:27.469047+0000","last_clean":"2024-04-18T10:36:27.469047+0000","last_became_active":"2024-04-18T10:36:09.014883+0000","last_became_peered":"2024-04-18T10:36:09.014883+0000","last_unstale":"2024-04-18T10:36:27.469047+0000","last_undegraded":"2024-04-18T10:36:27.469047+0000","last_fullsized":"2024-04-18T10:36:27.469047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590356+0000","last_change":"2024-04-18T10:36:09.005314+0000","last_active":"2024-04-18T10:36:25.590356+0000","last_peered":"2024-04-18T10:36:25.590356+0000","last_clean":"2024-04-18T10:36:25.590356+0000","last_became_active":"2024-04-18T10:36:09.004979+0000","last_became_peered":"2024-04-18T10:36:09.004979+0000","last_unstale":"2024-04-18T10:36:25.590356+0000","last_undegraded":"2024-04-18T10:36:25.590356+0000","last_fullsized":"2024-04-18T10:36:25.590356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590107+0000","last_change":"2024-04-18T10:36:09.028839+0000","last_active":"2024-04-18T10:36:25.590107+0000","last_peered":"2024-04-18T10:36:25.590107+0000","last_clean":"2024-04-18T10:36:25.590107+0000","last_became_active":"2024-04-18T10:36:09.028502+0000","last_became_peered":"2024-04-18T10:36:09.028502+0000","last_unstale":"2024-04-18T10:36:25.590107+0000","last_undegraded":"2024-04-18T10:36:25.590107+0000","last_fullsized":"2024-04-18T10:36:25.590107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469266+0000","last_change":"2024-04-18T10:36:09.034002+0000","last_active":"2024-04-18T10:36:27.469266+0000","last_peered":"2024-04-18T10:36:27.469266+0000","last_clean":"2024-04-18T10:36:27.469266+0000","last_became_active":"2024-04-18T10:36:09.033512+0000","last_became_peered":"2024-04-18T10:36:09.033512+0000","last_unstale":"2024-04-18T10:36:27.469266+0000","last_undegraded":"2024-04-18T10:36:27.469266+0000","last_fullsized":"2024-04-18T10:36:27.469266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587052+0000","last_change":"2024-04-18T10:36:09.008596+0000","last_active":"2024-04-18T10:36:25.587052+0000","last_peered":"2024-04-18T10:36:25.587052+0000","last_clean":"2024-04-18T10:36:25.587052+0000","last_became_active":"2024-04-18T10:36:09.008249+0000","last_became_peered":"2024-04-18T10:36:09.008249+0000","last_unstale":"2024-04-18T10:36:25.587052+0000","last_undegraded":"2024-04-18T10:36:25.587052+0000","last_fullsized":"2024-04-18T10:36:25.587052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586617+0000","last_change":"2024-04-18T10:36:09.043650+0000","last_active":"2024-04-18T10:36:25.586617+0000","last_peered":"2024-04-18T10:36:25.586617+0000","last_clean":"2024-04-18T10:36:25.586617+0000","last_became_active":"2024-04-18T10:36:09.039117+0000","last_became_peered":"2024-04-18T10:36:09.039117+0000","last_unstale":"2024-04-18T10:36:25.586617+0000","last_undegraded":"2024-04-18T10:36:25.586617+0000","last_fullsized":"2024-04-18T10:36:25.586617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589422+0000","last_change":"2024-04-18T10:36:09.022106+0000","last_active":"2024-04-18T10:36:25.589422+0000","last_peered":"2024-04-18T10:36:25.589422+0000","last_clean":"2024-04-18T10:36:25.589422+0000","last_became_active":"2024-04-18T10:36:09.021380+0000","last_became_peered":"2024-04-18T10:36:09.021380+0000","last_unstale":"2024-04-18T10:36:25.589422+0000","last_undegraded":"2024-04-18T10:36:25.589422+0000","last_fullsized":"2024-04-18T10:36:25.589422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588343+0000","last_change":"2024-04-18T10:36:09.007051+0000","last_active":"2024-04-18T10:36:25.588343+0000","last_peered":"2024-04-18T10:36:25.588343+0000","last_clean":"2024-04-18T10:36:25.588343+0000","last_became_active":"2024-04-18T10:36:09.006731+0000","last_became_peered":"2024-04-18T10:36:09.006731+0000","last_unstale":"2024-04-18T10:36:25.588343+0000","last_undegraded":"2024-04-18T10:36:25.588343+0000","last_fullsized":"2024-04-18T10:36:25.588343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590356+0000","last_change":"2024-04-18T10:36:09.021352+0000","last_active":"2024-04-18T10:36:25.590356+0000","last_peered":"2024-04-18T10:36:25.590356+0000","last_clean":"2024-04-18T10:36:25.590356+0000","last_became_active":"2024-04-18T10:36:09.018400+0000","last_became_peered":"2024-04-18T10:36:09.018400+0000","last_unstale":"2024-04-18T10:36:25.590356+0000","last_undegraded":"2024-04-18T10:36:25.590356+0000","last_fullsized":"2024-04-18T10:36:25.590356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469464+0000","last_change":"2024-04-18T10:36:09.037939+0000","last_active":"2024-04-18T10:36:27.469464+0000","last_peered":"2024-04-18T10:36:27.469464+0000","last_clean":"2024-04-18T10:36:27.469464+0000","last_became_active":"2024-04-18T10:36:09.037611+0000","last_became_peered":"2024-04-18T10:36:09.037611+0000","last_unstale":"2024-04-18T10:36:27.469464+0000","last_undegraded":"2024-04-18T10:36:27.469464+0000","last_fullsized":"2024-04-18T10:36:27.469464+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468870+0000","last_change":"2024-04-18T10:36:09.036858+0000","last_active":"2024-04-18T10:36:27.468870+0000","last_peered":"2024-04-18T10:36:27.468870+0000","last_clean":"2024-04-18T10:36:27.468870+0000","last_became_active":"2024-04-18T10:36:09.036508+0000","last_became_peered":"2024-04-18T10:36:09.036508+0000","last_unstale":"2024-04-18T10:36:27.468870+0000","last_undegraded":"2024-04-18T10:36:27.468870+0000","last_fullsized":"2024-04-18T10:36:27.468870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586787+0000","last_change":"2024-04-18T10:36:09.021243+0000","last_active":"2024-04-18T10:36:25.586787+0000","last_peered":"2024-04-18T10:36:25.586787+0000","last_clean":"2024-04-18T10:36:25.586787+0000","last_became_active":"2024-04-18T10:36:09.019277+0000","last_became_peered":"2024-04-18T10:36:09.019277+0000","last_unstale":"2024-04-18T10:36:25.586787+0000","last_undegraded":"2024-04-18T10:36:25.586787+0000","last_fullsized":"2024-04-18T10:36:25.586787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586819+0000","last_change":"2024-04-18T10:36:09.041841+0000","last_active":"2024-04-18T10:36:25.586819+0000","last_peered":"2024-04-18T10:36:25.586819+0000","last_clean":"2024-04-18T10:36:25.586819+0000","last_became_active":"2024-04-18T10:36:09.038958+0000","last_became_peered":"2024-04-18T10:36:09.038958+0000","last_unstale":"2024-04-18T10:36:25.586819+0000","last_undegraded":"2024-04-18T10:36:25.586819+0000","last_fullsized":"2024-04-18T10:36:25.586819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468543+0000","last_change":"2024-04-18T10:36:09.035656+0000","last_active":"2024-04-18T10:36:27.468543+0000","last_peered":"2024-04-18T10:36:27.468543+0000","last_clean":"2024-04-18T10:36:27.468543+0000","last_became_active":"2024-04-18T10:36:09.035221+0000","last_became_peered":"2024-04-18T10:36:09.035221+0000","last_unstale":"2024-04-18T10:36:27.468543+0000","last_undegraded":"2024-04-18T10:36:27.468543+0000","last_fullsized":"2024-04-18T10:36:27.468543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469556+0000","last_change":"2024-04-18T10:36:09.031118+0000","last_active":"2024-04-18T10:36:27.469556+0000","last_peered":"2024-04-18T10:36:27.469556+0000","last_clean":"2024-04-18T10:36:27.469556+0000","last_became_active":"2024-04-18T10:36:09.024843+0000","last_became_peered":"2024-04-18T10:36:09.024843+0000","last_unstale":"2024-04-18T10:36:27.469556+0000","last_undegraded":"2024-04-18T10:36:27.469556+0000","last_fullsized":"2024-04-18T10:36:27.469556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469212+0000","last_change":"2024-04-18T10:36:09.032225+0000","last_active":"2024-04-18T10:36:27.469212+0000","last_peered":"2024-04-18T10:36:27.469212+0000","last_clean":"2024-04-18T10:36:27.469212+0000","last_became_active":"2024-04-18T10:36:09.031895+0000","last_became_peered":"2024-04-18T10:36:09.031895+0000","last_unstale":"2024-04-18T10:36:27.469212+0000","last_undegraded":"2024-04-18T10:36:27.469212+0000","last_fullsized":"2024-04-18T10:36:27.469212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587387+0000","last_change":"2024-04-18T10:36:09.040868+0000","last_active":"2024-04-18T10:36:25.587387+0000","last_peered":"2024-04-18T10:36:25.587387+0000","last_clean":"2024-04-18T10:36:25.587387+0000","last_became_active":"2024-04-18T10:36:09.038946+0000","last_became_peered":"2024-04-18T10:36:09.038946+0000","last_unstale":"2024-04-18T10:36:25.587387+0000","last_undegraded":"2024-04-18T10:36:25.587387+0000","last_fullsized":"2024-04-18T10:36:25.587387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469305+0000","last_change":"2024-04-18T10:36:08.696988+0000","last_active":"2024-04-18T10:36:27.469305+0000","last_peered":"2024-04-18T10:36:27.469305+0000","last_clean":"2024-04-18T10:36:27.469305+0000","last_became_active":"2024-04-18T10:36:08.696639+0000","last_became_peered":"2024-04-18T10:36:08.696639+0000","last_unstale":"2024-04-18T10:36:27.469305+0000","last_undegraded":"2024-04-18T10:36:27.469305+0000","last_fullsized":"2024-04-18T10:36:27.469305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587496+0000","last_change":"2024-04-18T10:36:09.040997+0000","last_active":"2024-04-18T10:36:25.587496+0000","last_peered":"2024-04-18T10:36:25.587496+0000","last_clean":"2024-04-18T10:36:25.587496+0000","last_became_active":"2024-04-18T10:36:09.039544+0000","last_became_peered":"2024-04-18T10:36:09.039544+0000","last_unstale":"2024-04-18T10:36:25.587496+0000","last_undegraded":"2024-04-18T10:36:25.587496+0000","last_fullsized":"2024-04-18T10:36:25.587496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468544+0000","last_change":"2024-04-18T10:36:08.706823+0000","last_active":"2024-04-18T10:36:27.468544+0000","last_peered":"2024-04-18T10:36:27.468544+0000","last_clean":"2024-04-18T10:36:27.468544+0000","last_became_active":"2024-04-18T10:36:08.706488+0000","last_became_peered":"2024-04-18T10:36:08.706488+0000","last_unstale":"2024-04-18T10:36:27.468544+0000","last_undegraded":"2024-04-18T10:36:27.468544+0000","last_fullsized":"2024-04-18T10:36:27.468544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588552+0000","last_change":"2024-04-18T10:36:09.020079+0000","last_active":"2024-04-18T10:36:25.588552+0000","last_peered":"2024-04-18T10:36:25.588552+0000","last_clean":"2024-04-18T10:36:25.588552+0000","last_became_active":"2024-04-18T10:36:09.019759+0000","last_became_peered":"2024-04-18T10:36:09.019759+0000","last_unstale":"2024-04-18T10:36:25.588552+0000","last_undegraded":"2024-04-18T10:36:25.588552+0000","last_fullsized":"2024-04-18T10:36:25.588552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587251+0000","last_change":"2024-04-18T10:36:08.715008+0000","last_active":"2024-04-18T10:36:25.587251+0000","last_peered":"2024-04-18T10:36:25.587251+0000","last_clean":"2024-04-18T10:36:25.587251+0000","last_became_active":"2024-04-18T10:36:08.714642+0000","last_became_peered":"2024-04-18T10:36:08.714642+0000","last_unstale":"2024-04-18T10:36:25.587251+0000","last_undegraded":"2024-04-18T10:36:25.587251+0000","last_fullsized":"2024-04-18T10:36:25.587251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589065+0000","last_change":"2024-04-18T10:36:09.045728+0000","last_active":"2024-04-18T10:36:25.589065+0000","last_peered":"2024-04-18T10:36:25.589065+0000","last_clean":"2024-04-18T10:36:25.589065+0000","last_became_active":"2024-04-18T10:36:09.045122+0000","last_became_peered":"2024-04-18T10:36:09.045122+0000","last_unstale":"2024-04-18T10:36:25.589065+0000","last_undegraded":"2024-04-18T10:36:25.589065+0000","last_fullsized":"2024-04-18T10:36:25.589065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"20'7","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:50.641160+0000","last_change":"2024-04-18T10:36:08.706131+0000","last_active":"2024-04-18T10:36:50.641160+0000","last_peered":"2024-04-18T10:36:50.641160+0000","last_clean":"2024-04-18T10:36:50.641160+0000","last_became_active":"2024-04-18T10:36:08.705713+0000","last_became_peered":"2024-04-18T10:36:08.705713+0000","last_unstale":"2024-04-18T10:36:50.641160+0000","last_undegraded":"2024-04-18T10:36:50.641160+0000","last_fullsized":"2024-04-18T10:36:50.641160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587390+0000","last_change":"2024-04-18T10:36:09.043706+0000","last_active":"2024-04-18T10:36:25.587390+0000","last_peered":"2024-04-18T10:36:25.587390+0000","last_clean":"2024-04-18T10:36:25.587390+0000","last_became_active":"2024-04-18T10:36:09.039571+0000","last_became_peered":"2024-04-18T10:36:09.039571+0000","last_unstale":"2024-04-18T10:36:25.587390+0000","last_undegraded":"2024-04-18T10:36:25.587390+0000","last_fullsized":"2024-04-18T10:36:25.587390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590572+0000","last_change":"2024-04-18T10:36:08.703814+0000","last_active":"2024-04-18T10:36:25.590572+0000","last_peered":"2024-04-18T10:36:25.590572+0000","last_clean":"2024-04-18T10:36:25.590572+0000","last_became_active":"2024-04-18T10:36:08.703206+0000","last_became_peered":"2024-04-18T10:36:08.703206+0000","last_unstale":"2024-04-18T10:36:25.590572+0000","last_undegraded":"2024-04-18T10:36:25.590572+0000","last_fullsized":"2024-04-18T10:36:25.590572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587144+0000","last_change":"2024-04-18T10:36:09.042232+0000","last_active":"2024-04-18T10:36:25.587144+0000","last_peered":"2024-04-18T10:36:25.587144+0000","last_clean":"2024-04-18T10:36:25.587144+0000","last_became_active":"2024-04-18T10:36:09.039432+0000","last_became_peered":"2024-04-18T10:36:09.039432+0000","last_unstale":"2024-04-18T10:36:25.587144+0000","last_undegraded":"2024-04-18T10:36:25.587144+0000","last_fullsized":"2024-04-18T10:36:25.587144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587975+0000","last_change":"2024-04-18T10:36:08.705414+0000","last_active":"2024-04-18T10:36:25.587975+0000","last_peered":"2024-04-18T10:36:25.587975+0000","last_clean":"2024-04-18T10:36:25.587975+0000","last_became_active":"2024-04-18T10:36:08.705077+0000","last_became_peered":"2024-04-18T10:36:08.705077+0000","last_unstale":"2024-04-18T10:36:25.587975+0000","last_undegraded":"2024-04-18T10:36:25.587975+0000","last_fullsized":"2024-04-18T10:36:25.587975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469120+0000","last_change":"2024-04-18T10:36:09.036998+0000","last_active":"2024-04-18T10:36:27.469120+0000","last_peered":"2024-04-18T10:36:27.469120+0000","last_clean":"2024-04-18T10:36:27.469120+0000","last_became_active":"2024-04-18T10:36:09.036672+0000","last_became_peered":"2024-04-18T10:36:09.036672+0000","last_unstale":"2024-04-18T10:36:27.469120+0000","last_undegraded":"2024-04-18T10:36:27.469120+0000","last_fullsized":"2024-04-18T10:36:27.469120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'16","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-18T10:38:28.468726+0000","last_change":"2024-04-18T10:36:08.711520+0000","last_active":"2024-04-18T10:38:28.468726+0000","last_peered":"2024-04-18T10:38:28.468726+0000","last_clean":"2024-04-18T10:38:28.468726+0000","last_became_active":"2024-04-18T10:36:08.711135+0000","last_became_peered":"2024-04-18T10:36:08.711135+0000","last_unstale":"2024-04-18T10:38:28.468726+0000","last_undegraded":"2024-04-18T10:38:28.468726+0000","last_fullsized":"2024-04-18T10:38:28.468726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4743,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590194+0000","last_change":"2024-04-18T10:36:09.012564+0000","last_active":"2024-04-18T10:36:25.590194+0000","last_peered":"2024-04-18T10:36:25.590194+0000","last_clean":"2024-04-18T10:36:25.590194+0000","last_became_active":"2024-04-18T10:36:09.012232+0000","last_became_peered":"2024-04-18T10:36:09.012232+0000","last_unstale":"2024-04-18T10:36:25.590194+0000","last_undegraded":"2024-04-18T10:36:25.590194+0000","last_fullsized":"2024-04-18T10:36:25.590194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588499+0000","last_change":"2024-04-18T10:36:08.715596+0000","last_active":"2024-04-18T10:36:25.588499+0000","last_peered":"2024-04-18T10:36:25.588499+0000","last_clean":"2024-04-18T10:36:25.588499+0000","last_became_active":"2024-04-18T10:36:08.715228+0000","last_became_peered":"2024-04-18T10:36:08.715228+0000","last_unstale":"2024-04-18T10:36:25.588499+0000","last_undegraded":"2024-04-18T10:36:25.588499+0000","last_fullsized":"2024-04-18T10:36:25.588499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588235+0000","last_change":"2024-04-18T10:36:09.039566+0000","last_active":"2024-04-18T10:36:25.588235+0000","last_peered":"2024-04-18T10:36:25.588235+0000","last_clean":"2024-04-18T10:36:25.588235+0000","last_became_active":"2024-04-18T10:36:09.039196+0000","last_became_peered":"2024-04-18T10:36:09.039196+0000","last_unstale":"2024-04-18T10:36:25.588235+0000","last_undegraded":"2024-04-18T10:36:25.588235+0000","last_fullsized":"2024-04-18T10:36:25.588235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587271+0000","last_change":"2024-04-18T10:36:08.700155+0000","last_active":"2024-04-18T10:36:25.587271+0000","last_peered":"2024-04-18T10:36:25.587271+0000","last_clean":"2024-04-18T10:36:25.587271+0000","last_became_active":"2024-04-18T10:36:08.699825+0000","last_became_peered":"2024-04-18T10:36:08.699825+0000","last_unstale":"2024-04-18T10:36:25.587271+0000","last_undegraded":"2024-04-18T10:36:25.587271+0000","last_fullsized":"2024-04-18T10:36:25.587271+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587595+0000","last_change":"2024-04-18T10:36:09.043704+0000","last_active":"2024-04-18T10:36:25.587595+0000","last_peered":"2024-04-18T10:36:25.587595+0000","last_clean":"2024-04-18T10:36:25.587595+0000","last_became_active":"2024-04-18T10:36:09.043212+0000","last_became_peered":"2024-04-18T10:36:09.043212+0000","last_unstale":"2024-04-18T10:36:25.587595+0000","last_undegraded":"2024-04-18T10:36:25.587595+0000","last_fullsized":"2024-04-18T10:36:25.587595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587128+0000","last_change":"2024-04-18T10:36:08.712894+0000","last_active":"2024-04-18T10:36:25.587128+0000","last_peered":"2024-04-18T10:36:25.587128+0000","last_clean":"2024-04-18T10:36:25.587128+0000","last_became_active":"2024-04-18T10:36:08.712527+0000","last_became_peered":"2024-04-18T10:36:08.712527+0000","last_unstale":"2024-04-18T10:36:25.587128+0000","last_undegraded":"2024-04-18T10:36:25.587128+0000","last_fullsized":"2024-04-18T10:36:25.587128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588716+0000","last_change":"2024-04-18T10:36:09.028482+0000","last_active":"2024-04-18T10:36:25.588716+0000","last_peered":"2024-04-18T10:36:25.588716+0000","last_clean":"2024-04-18T10:36:25.588716+0000","last_became_active":"2024-04-18T10:36:09.027131+0000","last_became_peered":"2024-04-18T10:36:09.027131+0000","last_unstale":"2024-04-18T10:36:25.588716+0000","last_undegraded":"2024-04-18T10:36:25.588716+0000","last_fullsized":"2024-04-18T10:36:25.588716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469069+0000","last_change":"2024-04-18T10:36:08.696453+0000","last_active":"2024-04-18T10:36:27.469069+0000","last_peered":"2024-04-18T10:36:27.469069+0000","last_clean":"2024-04-18T10:36:27.469069+0000","last_became_active":"2024-04-18T10:36:08.691479+0000","last_became_peered":"2024-04-18T10:36:08.691479+0000","last_unstale":"2024-04-18T10:36:27.469069+0000","last_undegraded":"2024-04-18T10:36:27.469069+0000","last_fullsized":"2024-04-18T10:36:27.469069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589063+0000","last_change":"2024-04-18T10:36:09.045160+0000","last_active":"2024-04-18T10:36:25.589063+0000","last_peered":"2024-04-18T10:36:25.589063+0000","last_clean":"2024-04-18T10:36:25.589063+0000","last_became_active":"2024-04-18T10:36:09.044693+0000","last_became_peered":"2024-04-18T10:36:09.044693+0000","last_unstale":"2024-04-18T10:36:25.589063+0000","last_undegraded":"2024-04-18T10:36:25.589063+0000","last_fullsized":"2024-04-18T10:36:25.589063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589074+0000","last_change":"2024-04-18T10:36:08.693031+0000","last_active":"2024-04-18T10:36:25.589074+0000","last_peered":"2024-04-18T10:36:25.589074+0000","last_clean":"2024-04-18T10:36:25.589074+0000","last_became_active":"2024-04-18T10:36:08.692741+0000","last_became_peered":"2024-04-18T10:36:08.692741+0000","last_unstale":"2024-04-18T10:36:25.589074+0000","last_undegraded":"2024-04-18T10:36:25.589074+0000","last_fullsized":"2024-04-18T10:36:25.589074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587494+0000","last_change":"2024-04-18T10:36:09.043925+0000","last_active":"2024-04-18T10:36:25.587494+0000","last_peered":"2024-04-18T10:36:25.587494+0000","last_clean":"2024-04-18T10:36:25.587494+0000","last_became_active":"2024-04-18T10:36:09.043223+0000","last_became_peered":"2024-04-18T10:36:09.043223+0000","last_unstale":"2024-04-18T10:36:25.587494+0000","last_undegraded":"2024-04-18T10:36:25.587494+0000","last_fullsized":"2024-04-18T10:36:25.587494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590575+0000","last_change":"2024-04-18T10:36:08.693355+0000","last_active":"2024-04-18T10:36:25.590575+0000","last_peered":"2024-04-18T10:36:25.590575+0000","last_clean":"2024-04-18T10:36:25.590575+0000","last_became_active":"2024-04-18T10:36:08.693035+0000","last_became_peered":"2024-04-18T10:36:08.693035+0000","last_unstale":"2024-04-18T10:36:25.590575+0000","last_undegraded":"2024-04-18T10:36:25.590575+0000","last_fullsized":"2024-04-18T10:36:25.590575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468564+0000","last_change":"2024-04-18T10:36:09.013954+0000","last_active":"2024-04-18T10:36:27.468564+0000","last_peered":"2024-04-18T10:36:27.468564+0000","last_clean":"2024-04-18T10:36:27.468564+0000","last_became_active":"2024-04-18T10:36:09.013544+0000","last_became_peered":"2024-04-18T10:36:09.013544+0000","last_unstale":"2024-04-18T10:36:27.468564+0000","last_undegraded":"2024-04-18T10:36:27.468564+0000","last_fullsized":"2024-04-18T10:36:27.468564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587809+0000","last_change":"2024-04-18T10:36:08.710986+0000","last_active":"2024-04-18T10:36:25.587809+0000","last_peered":"2024-04-18T10:36:25.587809+0000","last_clean":"2024-04-18T10:36:25.587809+0000","last_became_active":"2024-04-18T10:36:08.710570+0000","last_became_peered":"2024-04-18T10:36:08.710570+0000","last_unstale":"2024-04-18T10:36:25.587809+0000","last_undegraded":"2024-04-18T10:36:25.587809+0000","last_fullsized":"2024-04-18T10:36:25.587809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590045+0000","last_change":"2024-04-18T10:36:09.013364+0000","last_active":"2024-04-18T10:36:25.590045+0000","last_peered":"2024-04-18T10:36:25.590045+0000","last_clean":"2024-04-18T10:36:25.590045+0000","last_became_active":"2024-04-18T10:36:09.013081+0000","last_became_peered":"2024-04-18T10:36:09.013081+0000","last_unstale":"2024-04-18T10:36:25.590045+0000","last_undegraded":"2024-04-18T10:36:25.590045+0000","last_fullsized":"2024-04-18T10:36:25.590045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587770+0000","last_change":"2024-04-18T10:36:08.697479+0000","last_active":"2024-04-18T10:36:25.587770+0000","last_peered":"2024-04-18T10:36:25.587770+0000","last_clean":"2024-04-18T10:36:25.587770+0000","last_became_active":"2024-04-18T10:36:08.697086+0000","last_became_peered":"2024-04-18T10:36:08.697086+0000","last_unstale":"2024-04-18T10:36:25.587770+0000","last_undegraded":"2024-04-18T10:36:25.587770+0000","last_fullsized":"2024-04-18T10:36:25.587770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588151+0000","last_change":"2024-04-18T10:36:09.022846+0000","last_active":"2024-04-18T10:36:25.588151+0000","last_peered":"2024-04-18T10:36:25.588151+0000","last_clean":"2024-04-18T10:36:25.588151+0000","last_became_active":"2024-04-18T10:36:09.019048+0000","last_became_peered":"2024-04-18T10:36:09.019048+0000","last_unstale":"2024-04-18T10:36:25.588151+0000","last_undegraded":"2024-04-18T10:36:25.588151+0000","last_fullsized":"2024-04-18T10:36:25.588151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588385+0000","last_change":"2024-04-18T10:36:08.715657+0000","last_active":"2024-04-18T10:36:25.588385+0000","last_peered":"2024-04-18T10:36:25.588385+0000","last_clean":"2024-04-18T10:36:25.588385+0000","last_became_active":"2024-04-18T10:36:08.715283+0000","last_became_peered":"2024-04-18T10:36:08.715283+0000","last_unstale":"2024-04-18T10:36:25.588385+0000","last_undegraded":"2024-04-18T10:36:25.588385+0000","last_fullsized":"2024-04-18T10:36:25.588385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587720+0000","last_change":"2024-04-18T10:36:09.006046+0000","last_active":"2024-04-18T10:36:25.587720+0000","last_peered":"2024-04-18T10:36:25.587720+0000","last_clean":"2024-04-18T10:36:25.587720+0000","last_became_active":"2024-04-18T10:36:09.005726+0000","last_became_peered":"2024-04-18T10:36:09.005726+0000","last_unstale":"2024-04-18T10:36:25.587720+0000","last_undegraded":"2024-04-18T10:36:25.587720+0000","last_fullsized":"2024-04-18T10:36:25.587720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:40.637690+0000","last_change":"2024-04-18T10:36:08.710590+0000","last_active":"2024-04-18T10:36:40.637690+0000","last_peered":"2024-04-18T10:36:40.637690+0000","last_clean":"2024-04-18T10:36:40.637690+0000","last_became_active":"2024-04-18T10:36:08.710198+0000","last_became_peered":"2024-04-18T10:36:08.710198+0000","last_unstale":"2024-04-18T10:36:40.637690+0000","last_undegraded":"2024-04-18T10:36:40.637690+0000","last_fullsized":"2024-04-18T10:36:40.637690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587701+0000","last_change":"2024-04-18T10:36:09.045249+0000","last_active":"2024-04-18T10:36:25.587701+0000","last_peered":"2024-04-18T10:36:25.587701+0000","last_clean":"2024-04-18T10:36:25.587701+0000","last_became_active":"2024-04-18T10:36:09.044573+0000","last_became_peered":"2024-04-18T10:36:09.044573+0000","last_unstale":"2024-04-18T10:36:25.587701+0000","last_undegraded":"2024-04-18T10:36:25.587701+0000","last_fullsized":"2024-04-18T10:36:25.587701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586948+0000","last_change":"2024-04-18T10:36:08.709580+0000","last_active":"2024-04-18T10:36:25.586948+0000","last_peered":"2024-04-18T10:36:25.586948+0000","last_clean":"2024-04-18T10:36:25.586948+0000","last_became_active":"2024-04-18T10:36:08.709283+0000","last_became_peered":"2024-04-18T10:36:08.709283+0000","last_unstale":"2024-04-18T10:36:25.586948+0000","last_undegraded":"2024-04-18T10:36:25.586948+0000","last_fullsized":"2024-04-18T10:36:25.586948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590646+0000","last_change":"2024-04-18T10:36:09.027970+0000","last_active":"2024-04-18T10:36:25.590646+0000","last_peered":"2024-04-18T10:36:25.590646+0000","last_clean":"2024-04-18T10:36:25.590646+0000","last_became_active":"2024-04-18T10:36:09.027650+0000","last_became_peered":"2024-04-18T10:36:09.027650+0000","last_unstale":"2024-04-18T10:36:25.590646+0000","last_undegraded":"2024-04-18T10:36:25.590646+0000","last_fullsized":"2024-04-18T10:36:25.590646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586760+0000","last_change":"2024-04-18T10:36:08.710914+0000","last_active":"2024-04-18T10:36:25.586760+0000","last_peered":"2024-04-18T10:36:25.586760+0000","last_clean":"2024-04-18T10:36:25.586760+0000","last_became_active":"2024-04-18T10:36:08.710619+0000","last_became_peered":"2024-04-18T10:36:08.710619+0000","last_unstale":"2024-04-18T10:36:25.586760+0000","last_undegraded":"2024-04-18T10:36:25.586760+0000","last_fullsized":"2024-04-18T10:36:25.586760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469657+0000","last_change":"2024-04-18T10:36:09.037889+0000","last_active":"2024-04-18T10:36:27.469657+0000","last_peered":"2024-04-18T10:36:27.469657+0000","last_clean":"2024-04-18T10:36:27.469657+0000","last_became_active":"2024-04-18T10:36:09.037533+0000","last_became_peered":"2024-04-18T10:36:09.037533+0000","last_unstale":"2024-04-18T10:36:27.469657+0000","last_undegraded":"2024-04-18T10:36:27.469657+0000","last_fullsized":"2024-04-18T10:36:27.469657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469397+0000","last_change":"2024-04-18T10:36:00.530860+0000","last_active":"2024-04-18T10:36:27.469397+0000","last_peered":"2024-04-18T10:36:27.469397+0000","last_clean":"2024-04-18T10:36:27.469397+0000","last_became_active":"2024-04-18T10:36:00.530496+0000","last_became_peered":"2024-04-18T10:36:00.530496+0000","last_unstale":"2024-04-18T10:36:27.469397+0000","last_undegraded":"2024-04-18T10:36:27.469397+0000","last_fullsized":"2024-04-18T10:36:27.469397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590450+0000","last_change":"2024-04-18T10:36:08.703862+0000","last_active":"2024-04-18T10:36:25.590450+0000","last_peered":"2024-04-18T10:36:25.590450+0000","last_clean":"2024-04-18T10:36:25.590450+0000","last_became_active":"2024-04-18T10:36:08.703311+0000","last_became_peered":"2024-04-18T10:36:08.703311+0000","last_unstale":"2024-04-18T10:36:25.590450+0000","last_undegraded":"2024-04-18T10:36:25.590450+0000","last_fullsized":"2024-04-18T10:36:25.590450+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468960+0000","last_change":"2024-04-18T10:36:09.014696+0000","last_active":"2024-04-18T10:36:27.468960+0000","last_peered":"2024-04-18T10:36:27.468960+0000","last_clean":"2024-04-18T10:36:27.468960+0000","last_became_active":"2024-04-18T10:36:09.014208+0000","last_became_peered":"2024-04-18T10:36:09.014208+0000","last_unstale":"2024-04-18T10:36:27.468960+0000","last_undegraded":"2024-04-18T10:36:27.468960+0000","last_fullsized":"2024-04-18T10:36:27.468960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587729+0000","last_change":"2024-04-18T10:36:00.529282+0000","last_active":"2024-04-18T10:36:25.587729+0000","last_peered":"2024-04-18T10:36:25.587729+0000","last_clean":"2024-04-18T10:36:25.587729+0000","last_became_active":"2024-04-18T10:36:00.528895+0000","last_became_peered":"2024-04-18T10:36:00.528895+0000","last_unstale":"2024-04-18T10:36:25.587729+0000","last_undegraded":"2024-04-18T10:36:25.587729+0000","last_fullsized":"2024-04-18T10:36:25.587729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:45.637747+0000","last_change":"2024-04-18T10:36:08.694077+0000","last_active":"2024-04-18T10:36:45.637747+0000","last_peered":"2024-04-18T10:36:45.637747+0000","last_clean":"2024-04-18T10:36:45.637747+0000","last_became_active":"2024-04-18T10:36:08.693727+0000","last_became_peered":"2024-04-18T10:36:08.693727+0000","last_unstale":"2024-04-18T10:36:45.637747+0000","last_undegraded":"2024-04-18T10:36:45.637747+0000","last_fullsized":"2024-04-18T10:36:45.637747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469149+0000","last_change":"2024-04-18T10:36:09.017243+0000","last_active":"2024-04-18T10:36:27.469149+0000","last_peered":"2024-04-18T10:36:27.469149+0000","last_clean":"2024-04-18T10:36:27.469149+0000","last_became_active":"2024-04-18T10:36:09.016843+0000","last_became_peered":"2024-04-18T10:36:09.016843+0000","last_unstale":"2024-04-18T10:36:27.469149+0000","last_undegraded":"2024-04-18T10:36:27.469149+0000","last_fullsized":"2024-04-18T10:36:27.469149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589992+0000","last_change":"2024-04-18T10:36:00.529420+0000","last_active":"2024-04-18T10:36:25.589992+0000","last_peered":"2024-04-18T10:36:25.589992+0000","last_clean":"2024-04-18T10:36:25.589992+0000","last_became_active":"2024-04-18T10:36:00.529029+0000","last_became_peered":"2024-04-18T10:36:00.529029+0000","last_unstale":"2024-04-18T10:36:25.589992+0000","last_undegraded":"2024-04-18T10:36:25.589992+0000","last_fullsized":"2024-04-18T10:36:25.589992+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468863+0000","last_change":"2024-04-18T10:36:08.697102+0000","last_active":"2024-04-18T10:36:27.468863+0000","last_peered":"2024-04-18T10:36:27.468863+0000","last_clean":"2024-04-18T10:36:27.468863+0000","last_became_active":"2024-04-18T10:36:08.696687+0000","last_became_peered":"2024-04-18T10:36:08.696687+0000","last_unstale":"2024-04-18T10:36:27.468863+0000","last_undegraded":"2024-04-18T10:36:27.468863+0000","last_fullsized":"2024-04-18T10:36:27.468863+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469706+0000","last_change":"2024-04-18T10:36:09.031490+0000","last_active":"2024-04-18T10:36:27.469706+0000","last_peered":"2024-04-18T10:36:27.469706+0000","last_clean":"2024-04-18T10:36:27.469706+0000","last_became_active":"2024-04-18T10:36:09.030866+0000","last_became_peered":"2024-04-18T10:36:09.030866+0000","last_unstale":"2024-04-18T10:36:27.469706+0000","last_undegraded":"2024-04-18T10:36:27.469706+0000","last_fullsized":"2024-04-18T10:36:27.469706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588419+0000","last_change":"2024-04-18T10:36:00.530056+0000","last_active":"2024-04-18T10:36:25.588419+0000","last_peered":"2024-04-18T10:36:25.588419+0000","last_clean":"2024-04-18T10:36:25.588419+0000","last_became_active":"2024-04-18T10:36:00.529546+0000","last_became_peered":"2024-04-18T10:36:00.529546+0000","last_unstale":"2024-04-18T10:36:25.588419+0000","last_undegraded":"2024-04-18T10:36:25.588419+0000","last_fullsized":"2024-04-18T10:36:25.588419+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'1","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468720+0000","last_change":"2024-04-18T10:35:56.421744+0000","last_active":"2024-04-18T10:36:27.468720+0000","last_peered":"2024-04-18T10:36:27.468720+0000","last_clean":"2024-04-18T10:36:27.468720+0000","last_became_active":"2024-04-18T10:35:56.421316+0000","last_became_peered":"2024-04-18T10:35:56.421316+0000","last_unstale":"2024-04-18T10:36:27.468720+0000","last_undegraded":"2024-04-18T10:36:27.468720+0000","last_fullsized":"2024-04-18T10:36:27.468720+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587622+0000","last_change":"2024-04-18T10:36:08.711994+0000","last_active":"2024-04-18T10:36:25.587622+0000","last_peered":"2024-04-18T10:36:25.587622+0000","last_clean":"2024-04-18T10:36:25.587622+0000","last_became_active":"2024-04-18T10:36:08.711652+0000","last_became_peered":"2024-04-18T10:36:08.711652+0000","last_unstale":"2024-04-18T10:36:25.587622+0000","last_undegraded":"2024-04-18T10:36:25.587622+0000","last_fullsized":"2024-04-18T10:36:25.587622+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588129+0000","last_change":"2024-04-18T10:36:09.045388+0000","last_active":"2024-04-18T10:36:25.588129+0000","last_peered":"2024-04-18T10:36:25.588129+0000","last_clean":"2024-04-18T10:36:25.588129+0000","last_became_active":"2024-04-18T10:36:09.044909+0000","last_became_peered":"2024-04-18T10:36:09.044909+0000","last_unstale":"2024-04-18T10:36:25.588129+0000","last_undegraded":"2024-04-18T10:36:25.588129+0000","last_fullsized":"2024-04-18T10:36:25.588129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587023+0000","last_change":"2024-04-18T10:36:00.529398+0000","last_active":"2024-04-18T10:36:25.587023+0000","last_peered":"2024-04-18T10:36:25.587023+0000","last_clean":"2024-04-18T10:36:25.587023+0000","last_became_active":"2024-04-18T10:36:00.528912+0000","last_became_peered":"2024-04-18T10:36:00.528912+0000","last_unstale":"2024-04-18T10:36:25.587023+0000","last_undegraded":"2024-04-18T10:36:25.587023+0000","last_fullsized":"2024-04-18T10:36:25.587023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586966+0000","last_change":"2024-04-18T10:36:08.692668+0000","last_active":"2024-04-18T10:36:25.586966+0000","last_peered":"2024-04-18T10:36:25.586966+0000","last_clean":"2024-04-18T10:36:25.586966+0000","last_became_active":"2024-04-18T10:36:08.692317+0000","last_became_peered":"2024-04-18T10:36:08.692317+0000","last_unstale":"2024-04-18T10:36:25.586966+0000","last_undegraded":"2024-04-18T10:36:25.586966+0000","last_fullsized":"2024-04-18T10:36:25.586966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588816+0000","last_change":"2024-04-18T10:36:09.019756+0000","last_active":"2024-04-18T10:36:25.588816+0000","last_peered":"2024-04-18T10:36:25.588816+0000","last_clean":"2024-04-18T10:36:25.588816+0000","last_became_active":"2024-04-18T10:36:09.019251+0000","last_became_peered":"2024-04-18T10:36:09.019251+0000","last_unstale":"2024-04-18T10:36:25.588816+0000","last_undegraded":"2024-04-18T10:36:25.588816+0000","last_fullsized":"2024-04-18T10:36:25.588816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587932+0000","last_change":"2024-04-18T10:36:00.527346+0000","last_active":"2024-04-18T10:36:25.587932+0000","last_peered":"2024-04-18T10:36:25.587932+0000","last_clean":"2024-04-18T10:36:25.587932+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:25.587932+0000","last_undegraded":"2024-04-18T10:36:25.587932+0000","last_fullsized":"2024-04-18T10:36:25.587932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468929+0000","last_change":"2024-04-18T10:36:08.700410+0000","last_active":"2024-04-18T10:36:27.468929+0000","last_peered":"2024-04-18T10:36:27.468929+0000","last_clean":"2024-04-18T10:36:27.468929+0000","last_became_active":"2024-04-18T10:36:08.700048+0000","last_became_peered":"2024-04-18T10:36:08.700048+0000","last_unstale":"2024-04-18T10:36:27.468929+0000","last_undegraded":"2024-04-18T10:36:27.468929+0000","last_fullsized":"2024-04-18T10:36:27.468929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587981+0000","last_change":"2024-04-18T10:36:09.018239+0000","last_active":"2024-04-18T10:36:25.587981+0000","last_peered":"2024-04-18T10:36:25.587981+0000","last_clean":"2024-04-18T10:36:25.587981+0000","last_became_active":"2024-04-18T10:36:09.010612+0000","last_became_peered":"2024-04-18T10:36:09.010612+0000","last_unstale":"2024-04-18T10:36:25.587981+0000","last_undegraded":"2024-04-18T10:36:25.587981+0000","last_fullsized":"2024-04-18T10:36:25.587981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588961+0000","last_change":"2024-04-18T10:36:08.710579+0000","last_active":"2024-04-18T10:36:25.588961+0000","last_peered":"2024-04-18T10:36:25.588961+0000","last_clean":"2024-04-18T10:36:25.588961+0000","last_became_active":"2024-04-18T10:36:08.710165+0000","last_became_peered":"2024-04-18T10:36:08.710165+0000","last_unstale":"2024-04-18T10:36:25.588961+0000","last_undegraded":"2024-04-18T10:36:25.588961+0000","last_fullsized":"2024-04-18T10:36:25.588961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.468922+0000","last_change":"2024-04-18T10:36:00.529862+0000","last_active":"2024-04-18T10:36:27.468922+0000","last_peered":"2024-04-18T10:36:27.468922+0000","last_clean":"2024-04-18T10:36:27.468922+0000","last_became_active":"2024-04-18T10:36:00.529451+0000","last_became_peered":"2024-04-18T10:36:00.529451+0000","last_unstale":"2024-04-18T10:36:27.468922+0000","last_undegraded":"2024-04-18T10:36:27.468922+0000","last_fullsized":"2024-04-18T10:36:27.468922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586901+0000","last_change":"2024-04-18T10:36:09.043858+0000","last_active":"2024-04-18T10:36:25.586901+0000","last_peered":"2024-04-18T10:36:25.586901+0000","last_clean":"2024-04-18T10:36:25.586901+0000","last_became_active":"2024-04-18T10:36:09.042887+0000","last_became_peered":"2024-04-18T10:36:09.042887+0000","last_unstale":"2024-04-18T10:36:25.586901+0000","last_undegraded":"2024-04-18T10:36:25.586901+0000","last_fullsized":"2024-04-18T10:36:25.586901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588955+0000","last_change":"2024-04-18T10:36:00.527385+0000","last_active":"2024-04-18T10:36:25.588955+0000","last_peered":"2024-04-18T10:36:25.588955+0000","last_clean":"2024-04-18T10:36:25.588955+0000","last_became_active":"2024-04-18T10:36:00.526888+0000","last_became_peered":"2024-04-18T10:36:00.526888+0000","last_unstale":"2024-04-18T10:36:25.588955+0000","last_undegraded":"2024-04-18T10:36:25.588955+0000","last_fullsized":"2024-04-18T10:36:25.588955+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:35.641458+0000","last_change":"2024-04-18T10:36:08.703568+0000","last_active":"2024-04-18T10:36:35.641458+0000","last_peered":"2024-04-18T10:36:35.641458+0000","last_clean":"2024-04-18T10:36:35.641458+0000","last_became_active":"2024-04-18T10:36:08.702770+0000","last_became_peered":"2024-04-18T10:36:08.702770+0000","last_unstale":"2024-04-18T10:36:35.641458+0000","last_undegraded":"2024-04-18T10:36:35.641458+0000","last_fullsized":"2024-04-18T10:36:35.641458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589882+0000","last_change":"2024-04-18T10:36:09.005270+0000","last_active":"2024-04-18T10:36:25.589882+0000","last_peered":"2024-04-18T10:36:25.589882+0000","last_clean":"2024-04-18T10:36:25.589882+0000","last_became_active":"2024-04-18T10:36:09.004929+0000","last_became_peered":"2024-04-18T10:36:09.004929+0000","last_unstale":"2024-04-18T10:36:25.589882+0000","last_undegraded":"2024-04-18T10:36:25.589882+0000","last_fullsized":"2024-04-18T10:36:25.589882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"20'10","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:40.638460+0000","last_change":"2024-04-18T10:36:08.698046+0000","last_active":"2024-04-18T10:36:40.638460+0000","last_peered":"2024-04-18T10:36:40.638460+0000","last_clean":"2024-04-18T10:36:40.638460+0000","last_became_active":"2024-04-18T10:36:08.697438+0000","last_became_peered":"2024-04-18T10:36:08.697438+0000","last_unstale":"2024-04-18T10:36:40.638460+0000","last_undegraded":"2024-04-18T10:36:40.638460+0000","last_fullsized":"2024-04-18T10:36:40.638460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590402+0000","last_change":"2024-04-18T10:36:09.016654+0000","last_active":"2024-04-18T10:36:25.590402+0000","last_peered":"2024-04-18T10:36:25.590402+0000","last_clean":"2024-04-18T10:36:25.590402+0000","last_became_active":"2024-04-18T10:36:09.016342+0000","last_became_peered":"2024-04-18T10:36:09.016342+0000","last_unstale":"2024-04-18T10:36:25.590402+0000","last_undegraded":"2024-04-18T10:36:25.590402+0000","last_fullsized":"2024-04-18T10:36:25.590402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469290+0000","last_change":"2024-04-18T10:36:08.700728+0000","last_active":"2024-04-18T10:36:27.469290+0000","last_peered":"2024-04-18T10:36:27.469290+0000","last_clean":"2024-04-18T10:36:27.469290+0000","last_became_active":"2024-04-18T10:36:08.699603+0000","last_became_peered":"2024-04-18T10:36:08.699603+0000","last_unstale":"2024-04-18T10:36:27.469290+0000","last_undegraded":"2024-04-18T10:36:27.469290+0000","last_fullsized":"2024-04-18T10:36:27.469290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.590119+0000","last_change":"2024-04-18T10:36:09.021888+0000","last_active":"2024-04-18T10:36:25.590119+0000","last_peered":"2024-04-18T10:36:25.590119+0000","last_clean":"2024-04-18T10:36:25.590119+0000","last_became_active":"2024-04-18T10:36:09.018363+0000","last_became_peered":"2024-04-18T10:36:09.018363+0000","last_unstale":"2024-04-18T10:36:25.590119+0000","last_undegraded":"2024-04-18T10:36:25.590119+0000","last_fullsized":"2024-04-18T10:36:25.590119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588032+0000","last_change":"2024-04-18T10:36:08.714829+0000","last_active":"2024-04-18T10:36:25.588032+0000","last_peered":"2024-04-18T10:36:25.588032+0000","last_clean":"2024-04-18T10:36:25.588032+0000","last_became_active":"2024-04-18T10:36:08.714528+0000","last_became_peered":"2024-04-18T10:36:08.714528+0000","last_unstale":"2024-04-18T10:36:25.588032+0000","last_undegraded":"2024-04-18T10:36:25.588032+0000","last_fullsized":"2024-04-18T10:36:25.588032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589970+0000","last_change":"2024-04-18T10:36:09.022031+0000","last_active":"2024-04-18T10:36:25.589970+0000","last_peered":"2024-04-18T10:36:25.589970+0000","last_clean":"2024-04-18T10:36:25.589970+0000","last_became_active":"2024-04-18T10:36:09.018240+0000","last_became_peered":"2024-04-18T10:36:09.018240+0000","last_unstale":"2024-04-18T10:36:25.589970+0000","last_undegraded":"2024-04-18T10:36:25.589970+0000","last_fullsized":"2024-04-18T10:36:25.589970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588818+0000","last_change":"2024-04-18T10:36:08.712223+0000","last_active":"2024-04-18T10:36:25.588818+0000","last_peered":"2024-04-18T10:36:25.588818+0000","last_clean":"2024-04-18T10:36:25.588818+0000","last_became_active":"2024-04-18T10:36:08.711192+0000","last_became_peered":"2024-04-18T10:36:08.711192+0000","last_unstale":"2024-04-18T10:36:25.588818+0000","last_undegraded":"2024-04-18T10:36:25.588818+0000","last_fullsized":"2024-04-18T10:36:25.588818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587253+0000","last_change":"2024-04-18T10:36:09.030946+0000","last_active":"2024-04-18T10:36:25.587253+0000","last_peered":"2024-04-18T10:36:25.587253+0000","last_clean":"2024-04-18T10:36:25.587253+0000","last_became_active":"2024-04-18T10:36:09.030646+0000","last_became_peered":"2024-04-18T10:36:09.030646+0000","last_unstale":"2024-04-18T10:36:25.587253+0000","last_undegraded":"2024-04-18T10:36:25.587253+0000","last_fullsized":"2024-04-18T10:36:25.587253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589247+0000","last_change":"2024-04-18T10:36:08.706957+0000","last_active":"2024-04-18T10:36:25.589247+0000","last_peered":"2024-04-18T10:36:25.589247+0000","last_clean":"2024-04-18T10:36:25.589247+0000","last_became_active":"2024-04-18T10:36:08.706598+0000","last_became_peered":"2024-04-18T10:36:08.706598+0000","last_unstale":"2024-04-18T10:36:25.589247+0000","last_undegraded":"2024-04-18T10:36:25.589247+0000","last_fullsized":"2024-04-18T10:36:25.589247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.589782+0000","last_change":"2024-04-18T10:36:09.017279+0000","last_active":"2024-04-18T10:36:25.589782+0000","last_peered":"2024-04-18T10:36:25.589782+0000","last_clean":"2024-04-18T10:36:25.589782+0000","last_became_active":"2024-04-18T10:36:09.016931+0000","last_became_peered":"2024-04-18T10:36:09.016931+0000","last_unstale":"2024-04-18T10:36:25.589782+0000","last_undegraded":"2024-04-18T10:36:25.589782+0000","last_fullsized":"2024-04-18T10:36:25.589782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469048+0000","last_change":"2024-04-18T10:36:09.032926+0000","last_active":"2024-04-18T10:36:27.469048+0000","last_peered":"2024-04-18T10:36:27.469048+0000","last_clean":"2024-04-18T10:36:27.469048+0000","last_became_active":"2024-04-18T10:36:09.032571+0000","last_became_peered":"2024-04-18T10:36:09.032571+0000","last_unstale":"2024-04-18T10:36:27.469048+0000","last_undegraded":"2024-04-18T10:36:27.469048+0000","last_fullsized":"2024-04-18T10:36:27.469048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.586998+0000","last_change":"2024-04-18T10:36:09.042985+0000","last_active":"2024-04-18T10:36:25.586998+0000","last_peered":"2024-04-18T10:36:25.586998+0000","last_clean":"2024-04-18T10:36:25.586998+0000","last_became_active":"2024-04-18T10:36:09.039602+0000","last_became_peered":"2024-04-18T10:36:09.039602+0000","last_unstale":"2024-04-18T10:36:25.586998+0000","last_undegraded":"2024-04-18T10:36:25.586998+0000","last_fullsized":"2024-04-18T10:36:25.586998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.587389+0000","last_change":"2024-04-18T10:36:09.028593+0000","last_active":"2024-04-18T10:36:25.587389+0000","last_peered":"2024-04-18T10:36:25.587389+0000","last_clean":"2024-04-18T10:36:25.587389+0000","last_became_active":"2024-04-18T10:36:09.028237+0000","last_became_peered":"2024-04-18T10:36:09.028237+0000","last_unstale":"2024-04-18T10:36:25.587389+0000","last_undegraded":"2024-04-18T10:36:25.587389+0000","last_fullsized":"2024-04-18T10:36:25.587389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:25.588514+0000","last_change":"2024-04-18T10:36:09.043613+0000","last_active":"2024-04-18T10:36:25.588514+0000","last_peered":"2024-04-18T10:36:25.588514+0000","last_clean":"2024-04-18T10:36:25.588514+0000","last_became_active":"2024-04-18T10:36:09.042942+0000","last_became_peered":"2024-04-18T10:36:09.042942+0000","last_unstale":"2024-04-18T10:36:25.588514+0000","last_undegraded":"2024-04-18T10:36:25.588514+0000","last_fullsized":"2024-04-18T10:36:25.588514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-18T10:36:27.469325+0000","last_change":"2024-04-18T10:36:09.017151+0000","last_active":"2024-04-18T10:36:27.469325+0000","last_peered":"2024-04-18T10:36:27.469325+0000","last_clean":"2024-04-18T10:36:27.469325+0000","last_became_active":"2024-04-18T10:36:09.016454+0000","last_became_peered":"2024-04-18T10:36:09.016454+0000","last_unstale":"2024-04-18T10:36:27.469325+0000","last_undegraded":"2024-04-18T10:36:27.469325+0000","last_fullsized":"2024-04-18T10:36:27.469325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8511,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672993,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":68633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.312,"15min":0.316},"min":{"1min":0.17100000000000001,"5min":0.158,"15min":0.158},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.32800000000000001,"15min":0.33400000000000002},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.33300000000000002,"15min":0.33800000000000002},"min":{"1min":0.22600000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.32700000000000001,"15min":0.33500000000000002},"min":{"1min":0.217,"5min":0.184,"15min":0.184},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35399999999999998,"15min":0.35799999999999998},"min":{"1min":0.249,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.34000000000000002,"15min":0.34699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.36599999999999999}]}]},{"osd":2,"up_from":10,"seq":42949672994,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":65552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.28499999999999998,"15min":0.29099999999999998},"min":{"1min":0.183,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.35099999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.247},{"interface":"front","average":{"1min":0.251,"5min":0.30499999999999999,"15min":0.314},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.35699999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.255,"5min":0.308,"15min":0.317},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.33700000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.314},{"interface":"front","average":{"1min":0.29599999999999999,"5min":0.34300000000000003,"15min":0.35099999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.39000000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Apr 18 10:38:00 2024","interfaces":[{"interface":"back","average":{"1min":0.27500000000000002,"5min":0.32600000000000001,"15min":0.33400000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.36899999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.35499999999999998,"15min":0.36399999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.38300000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.34499999999999997}]}]},{"osd":0,"up_from":10,"seq":42949672993,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":60073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27900000000000003,"15min":0.28000000000000003},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":0.432,"5min":0.432,"15min":0.432},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Apr 18 10:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.51800000000000002,"15min":0.55600000000000005},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.48699999999999999,"5min":5.1369999999999996,"15min":5.1369999999999996},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.307,"5min":0.32800000000000001,"15min":0.33200000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46999999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.316}]},{"osd":3,"last update":"Thu Apr 18 10:38:01 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.33900000000000002,"15min":0.34499999999999997},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.33000000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672994,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.314,"15min":0.318},"min":{"1min":0.23100000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.42599999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.27700000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45400000000000001,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Apr 18 10:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.27600000000000002,"5min":0.309,"15min":0.315},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.40500000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.23999999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46600000000000003,"5min":0.498,"15min":0.498},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Apr 18 10:37:59 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.32900000000000001,"15min":0.33500000000000002},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.42599999999999999,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.252},{"interface":"front","average":{"1min":0.311,"5min":0.35099999999999998,"15min":0.35699999999999998},"min":{"1min":0.22900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.44600000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.313}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:38:32.212 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T10:38:32.212 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-18T10:38:32.212 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-18T10:38:32.212 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T10:38:32.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.367+0000 7ffbea5cf700 1 Processor -- start 2024-04-18T10:38:32.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.367+0000 7ffbea5cf700 1 -- start start 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbea5cf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe40a3680 0x7ffbe40680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbea5cf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffbe4147630 0x7ffbe4149a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbea5cf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40a3db0 con 0x7ffbe4069200 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbea5cf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe406e2f0 con 0x7ffbe4147630 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbea5cf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe406fb40 con 0x7ffbe40a3680 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe8b6c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffbe4147630 0x7ffbe4149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffbe4069200 0x7ffbe40679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48306/0 (socket says 172.21.15.31:48306) 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe40a3680 0x7ffbe40680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe3fff700 1 -- 172.21.15.31:0/2697141251 learned_addr learned my addr 172.21.15.31:0/2697141251 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe8b6c700 1 -- 172.21.15.31:0/2697141251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe40a3680 msgr2=0x7ffbe40680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:32.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe8b6c700 1 --2- 172.21.15.31:0/2697141251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe40a3680 0x7ffbe40680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe8b6c700 1 -- 172.21.15.31:0/2697141251 >> v1:172.21.15.31:6789/0 conn(0x7ffbe4069200 legacy=0x7ffbe40679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe8b6c700 1 -- 172.21.15.31:0/2697141251 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe406fde0 con 0x7ffbe4147630 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe37fe700 1 --2- 172.21.15.31:0/2697141251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe40a3680 0x7ffbe40680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe8b6c700 1 --2- 172.21.15.31:0/2697141251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 0x7ffbe4149a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009e60 tx=0x7ffbdc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ad8b82f090c505 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe2ffd700 1 -- 172.21.15.31:0/2697141251 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00e070 con 0x7ffbe4147630 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe2ffd700 1 -- 172.21.15.31:0/2697141251 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc00bb60 con 0x7ffbe4147630 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.368+0000 7ffbe2ffd700 1 -- 172.21.15.31:0/2697141251 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc012430 con 0x7ffbe4147630 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.369+0000 7ffbea5cf700 1 -- 172.21.15.31:0/2697141251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 msgr2=0x7ffbe4149a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.369+0000 7ffbea5cf700 1 --2- 172.21.15.31:0/2697141251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 0x7ffbe4149a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc009e60 tx=0x7ffbdc009780 comp rx=0 tx=0).stop 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.369+0000 7ffbea5cf700 1 -- 172.21.15.31:0/2697141251 shutdown_connections 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.369+0000 7ffbea5cf700 1 --2- 172.21.15.31:0/2697141251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 0x7ffbe4149a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.369+0000 7ffbea5cf700 1 --2- 172.21.15.31:0/2697141251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe40a3680 0x7ffbe40680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.369+0000 7ffbea5cf700 1 -- 172.21.15.31:0/2697141251 >> 172.21.15.31:0/2697141251 conn(0x7ffbe406af40 msgr2=0x7ffbe4068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:32.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.369+0000 7ffbea5cf700 1 -- 172.21.15.31:0/2697141251 shutdown_connections 2024-04-18T10:38:32.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.369+0000 7ffbea5cf700 1 -- 172.21.15.31:0/2697141251 wait complete. 2024-04-18T10:38:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.370+0000 7ffbea5cf700 1 Processor -- start 2024-04-18T10:38:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.370+0000 7ffbea5cf700 1 -- start start 2024-04-18T10:38:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbea5cf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4069200 0x7ffbe40989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbea5cf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ffbe40a3680 0x7ffbe40975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbea5cf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 0x7ffbe414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbea5cf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4098200 con 0x7ffbe4147630 2024-04-18T10:38:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbea5cf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe414e410 con 0x7ffbe4069200 2024-04-18T10:38:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbea5cf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4098f20 con 0x7ffbe40a3680 2024-04-18T10:38:32.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4069200 0x7ffbe40989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe8b6c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 0x7ffbe414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ffbe40a3680 0x7ffbe40975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4069200 0x7ffbe40989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:50080/0 (socket says 172.21.15.31:50080) 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe8b6c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 0x7ffbe414e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39276/0 (socket says 172.21.15.31:39276) 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe3fff700 1 -- 172.21.15.31:0/19474830 learned_addr learned my addr 172.21.15.31:0/19474830 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe37fe700 1 -- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4069200 msgr2=0x7ffbe40989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe37fe700 1 --2- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4069200 0x7ffbe40989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe37fe700 1 -- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 msgr2=0x7ffbe414e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe37fe700 1 --2- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 0x7ffbe414e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe37fe700 1 -- 172.21.15.31:0/19474830 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4009420 con 0x7ffbe40a3680 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe8b6c700 1 --2- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 0x7ffbe414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbe37fe700 1 --2- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ffbe40a3680 0x7ffbe40975e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400ec80 tx=0x7ffbd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbdbfff700 1 -- 172.21.15.31:0/19474830 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd400c850 con 0x7ffbe40a3680 2024-04-18T10:38:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbdbfff700 1 -- 172.21.15.31:0/19474830 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd400c9b0 con 0x7ffbe40a3680 2024-04-18T10:38:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc009a20 con 0x7ffbe40a3680 2024-04-18T10:38:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbdbfff700 1 -- 172.21.15.31:0/19474830 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd400cd70 con 0x7ffbe40a3680 2024-04-18T10:38:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.371+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe40ad660 con 0x7ffbe40a3680 2024-04-18T10:38:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.372+0000 7ffbdbfff700 1 -- 172.21.15.31:0/19474830 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7ffbd4013680 con 0x7ffbe40a3680 2024-04-18T10:38:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.372+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe40695d0 con 0x7ffbe40a3680 2024-04-18T10:38:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.373+0000 7ffbdbfff700 1 -- 172.21.15.31:0/19474830 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3829+0+0 (secure 0 0 0) 0x7ffbd405b280 con 0x7ffbe40a3680 2024-04-18T10:38:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.376+0000 7ffbdbfff700 1 -- 172.21.15.31:0/19474830 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ffbd40395f0 con 0x7ffbe40a3680 2024-04-18T10:38:32.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.603+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffbe40b14b0 con 0x7ffbe40a3680 2024-04-18T10:38:32.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.603+0000 7ffbdbfff700 1 -- 172.21.15.31:0/19474830 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ffbd403cde0 con 0x7ffbe40a3680 2024-04-18T10:38:32.604 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:32.605 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-18T10:38:32.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 >> v1:172.21.15.31:6816/46601 conn(0x7ffbc4045f80 legacy=0x7ffbc4048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ffbe40a3680 msgr2=0x7ffbe40975e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 --2- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ffbe40a3680 0x7ffbe40975e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffbd400ec80 tx=0x7ffbd40091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 shutdown_connections 2024-04-18T10:38:32.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 --2- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe4147630 0x7ffbe414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 --2- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ffbe4069200 0x7ffbe40989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 --2- 172.21.15.31:0/19474830 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ffbe40a3680 0x7ffbe40975e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 >> 172.21.15.31:0/19474830 conn(0x7ffbe406af40 msgr2=0x7ffbe40b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:32.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 shutdown_connections 2024-04-18T10:38:32.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.605+0000 7ffbea5cf700 1 -- 172.21.15.31:0/19474830 wait complete. 2024-04-18T10:38:32.618 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-18T10:38:32.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:32.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.748+0000 7f772daa7700 1 Processor -- start 2024-04-18T10:38:32.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.748+0000 7f772daa7700 1 -- start start 2024-04-18T10:38:32.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f772daa7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f772daa7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 0x7f772813fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f772daa7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7728140360 0x7f772806ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f772daa7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280a55e0 con 0x7f7728140360 2024-04-18T10:38:32.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f772daa7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77280a73b0 con 0x7f7728068340 2024-04-18T10:38:32.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f772daa7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77280a7130 con 0x7f77280b0560 2024-04-18T10:38:32.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f77277fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f7727fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7728140360 0x7f772806ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f77277fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:50112/0 (socket says 172.21.15.31:50112) 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f7727fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7728140360 0x7f772806ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39300/0 (socket says 172.21.15.31:39300) 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f77277fe700 1 -- 172.21.15.31:0/3629995369 learned_addr learned my addr 172.21.15.31:0/3629995369 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f7726ffd700 1 --2- 172.21.15.31:0/3629995369 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 0x7f772813fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f77277fe700 1 -- 172.21.15.31:0/3629995369 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 msgr2=0x7f772813fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f77277fe700 1 --2- 172.21.15.31:0/3629995369 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 0x7f772813fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f77277fe700 1 -- 172.21.15.31:0/3629995369 >> v2:172.21.15.31:3300/0 conn(0x7f7728140360 msgr2=0x7f772806ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f77277fe700 1 --2- 172.21.15.31:0/3629995369 >> v2:172.21.15.31:3300/0 conn(0x7f7728140360 0x7f772806ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f77277fe700 1 -- 172.21.15.31:0/3629995369 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77280a41a0 con 0x7f7728068340 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.749+0000 7f7727fff700 1 --2- 172.21.15.31:0/3629995369 >> v2:172.21.15.31:3300/0 conn(0x7f7728140360 0x7f772806ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f77277fe700 1 --2- 172.21.15.31:0/3629995369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280a6bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77200099e0 tx=0x7f7720009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7762f275a4ae3ad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f77267fc700 1 -- 172.21.15.31:0/3629995369 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000b640 con 0x7f7728068340 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f77267fc700 1 -- 172.21.15.31:0/3629995369 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772000b7a0 con 0x7f7728068340 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f77267fc700 1 -- 172.21.15.31:0/3629995369 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000bb40 con 0x7f7728068340 2024-04-18T10:38:32.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f772daa7700 1 -- 172.21.15.31:0/3629995369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 msgr2=0x7f77280a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f772daa7700 1 --2- 172.21.15.31:0/3629995369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280a6bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77200099e0 tx=0x7f7720009250 comp rx=0 tx=0).stop 2024-04-18T10:38:32.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f772daa7700 1 -- 172.21.15.31:0/3629995369 shutdown_connections 2024-04-18T10:38:32.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f772daa7700 1 --2- 172.21.15.31:0/3629995369 >> v2:172.21.15.31:3300/0 conn(0x7f7728140360 0x7f772806ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f772daa7700 1 --2- 172.21.15.31:0/3629995369 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280a6bf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f772daa7700 1 --2- 172.21.15.31:0/3629995369 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 0x7f772813fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f772daa7700 1 -- 172.21.15.31:0/3629995369 >> 172.21.15.31:0/3629995369 conn(0x7f772806dd70 msgr2=0x7f77280679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:32.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f772daa7700 1 -- 172.21.15.31:0/3629995369 shutdown_connections 2024-04-18T10:38:32.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.750+0000 7f772daa7700 1 -- 172.21.15.31:0/3629995369 wait complete. 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.752+0000 7f772daa7700 1 Processor -- start 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.752+0000 7f772daa7700 1 -- start start 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f772daa7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f772daa7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 0x7f77280ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f772daa7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7728140360 0x7f772814d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f772daa7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77280ab9e0 con 0x7f7728140360 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f772daa7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77280abbd0 con 0x7f7728068340 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f772daa7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77280abe70 con 0x7f77280b0560 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7727fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7728140360 0x7f772814d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7727fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7728140360 0x7f772814d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39316/0 (socket says 172.21.15.31:39316) 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7727fff700 1 -- 172.21.15.31:0/579903004 learned_addr learned my addr 172.21.15.31:0/579903004 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f77277fe700 1 --2- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7726ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 0x7f77280ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7727fff700 1 -- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 msgr2=0x7f77280ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7727fff700 1 --2- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 0x7f77280ab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7727fff700 1 -- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 msgr2=0x7f77280ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7727fff700 1 --2- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7727fff700 1 -- 172.21.15.31:0/579903004 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7718009a20 con 0x7f7728140360 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f7727fff700 1 --2- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7728140360 0x7f772814d0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7718012470 tx=0x7f7718011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f770f7fe700 1 -- 172.21.15.31:0/579903004 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718014040 con 0x7f7728140360 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f770f7fe700 1 -- 172.21.15.31:0/579903004 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7718018400 con 0x7f7728140360 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77200094f0 con 0x7f7728140360 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f770f7fe700 1 -- 172.21.15.31:0/579903004 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180187c0 con 0x7f7728140360 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.753+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77280adbe0 con 0x7f7728140360 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.754+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77280651b0 con 0x7f7728140360 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.755+0000 7f770f7fe700 1 -- 172.21.15.31:0/579903004 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f7718003020 con 0x7f7728140360 2024-04-18T10:38:32.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.755+0000 7f770f7fe700 1 -- 172.21.15.31:0/579903004 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f771805fa00 con 0x7f7728140360 2024-04-18T10:38:32.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.759+0000 7f770f7fe700 1 -- 172.21.15.31:0/579903004 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f771803db80 con 0x7f7728140360 2024-04-18T10:38:32.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.928+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7728069450 con 0x7f7728140360 2024-04-18T10:38:32.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.929+0000 7f770f7fe700 1 -- 172.21.15.31:0/579903004 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11533 (secure 0 0 0) 0x7f771801c030 con 0x7f7728140360 2024-04-18T10:38:32.929 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:32.929 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:32.400116+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:32.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 >> v1:172.21.15.31:6816/46601 conn(0x7f7714046030 legacy=0x7f77140484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7728140360 msgr2=0x7f772814d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 --2- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7728140360 0x7f772814d0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7718012470 tx=0x7f7718011040 comp rx=0 tx=0).stop 2024-04-18T10:38:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 shutdown_connections 2024-04-18T10:38:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 --2- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7728140360 0x7f772814d0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 --2- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7728068340 0x7f77280ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 --2- 172.21.15.31:0/579903004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f77280b0560 0x7f77280ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 >> 172.21.15.31:0/579903004 conn(0x7f772806dd70 msgr2=0x7f772806ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 shutdown_connections 2024-04-18T10:38:32.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:32.931+0000 7f772daa7700 1 -- 172.21.15.31:0/579903004 wait complete. 2024-04-18T10:38:32.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:38:32.944 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:38:33.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.073+0000 7fda1014a700 1 Processor -- start 2024-04-18T10:38:33.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.074+0000 7fda1014a700 1 -- start start 2024-04-18T10:38:33.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.074+0000 7fda1014a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda1014a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda0813f130 0x7fda08145900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda1014a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda080a59e0 con 0x7fda080a30c0 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda1014a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda080a3ad0 con 0x7fda0813f130 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda1014a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda080a57c0 con 0x7fda08069450 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0dee6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0dee6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41594/0 (socket says 172.21.15.31:41594) 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0dee6700 1 -- 172.21.15.31:0/3974616841 learned_addr learned my addr 172.21.15.31:0/3974616841 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0dee6700 1 -- 172.21.15.31:0/3974616841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda0813f130 msgr2=0x7fda08145900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0dee6700 1 --2- 172.21.15.31:0/3974616841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda0813f130 0x7fda08145900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0dee6700 1 -- 172.21.15.31:0/3974616841 >> v1:172.21.15.31:6789/0 conn(0x7fda080a30c0 legacy=0x7fda0813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0dee6700 1 -- 172.21.15.31:0/3974616841 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080a4bc0 con 0x7fda08069450 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0dee6700 1 --2- 172.21.15.31:0/3974616841 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080a2b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda0400bcb0 tx=0x7fda0400b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37bfb940b9388c46 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:33.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0cee4700 1 -- 172.21.15.31:0/3974616841 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400dd80 con 0x7fda08069450 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0cee4700 1 -- 172.21.15.31:0/3974616841 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda04010470 con 0x7fda08069450 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.075+0000 7fda0cee4700 1 -- 172.21.15.31:0/3974616841 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04010830 con 0x7fda08069450 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.076+0000 7fda1014a700 1 -- 172.21.15.31:0/3974616841 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 msgr2=0x7fda080a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.076+0000 7fda1014a700 1 --2- 172.21.15.31:0/3974616841 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080a2b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda0400bcb0 tx=0x7fda0400b4f0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.076+0000 7fda1014a700 1 -- 172.21.15.31:0/3974616841 shutdown_connections 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.076+0000 7fda1014a700 1 --2- 172.21.15.31:0/3974616841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda0813f130 0x7fda08145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.076+0000 7fda1014a700 1 --2- 172.21.15.31:0/3974616841 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080a2b80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.076+0000 7fda1014a700 1 -- 172.21.15.31:0/3974616841 >> 172.21.15.31:0/3974616841 conn(0x7fda0806ae80 msgr2=0x7fda08068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.076+0000 7fda1014a700 1 -- 172.21.15.31:0/3974616841 shutdown_connections 2024-04-18T10:38:33.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.076+0000 7fda1014a700 1 -- 172.21.15.31:0/3974616841 wait complete. 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.077+0000 7fda1014a700 1 Processor -- start 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda1014a700 1 -- start start 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda1014a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda1014a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda080a30c0 0x7fda080ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda1014a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda0813f130 0x7fda080adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda1014a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda080ad560 con 0x7fda0813f130 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda1014a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda080ac310 con 0x7fda080a30c0 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda1014a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda080a94e0 con 0x7fda08069450 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda0dee6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda0e6e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda0813f130 0x7fda080adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda0dee6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080aa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41598/0 (socket says 172.21.15.31:41598) 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda0e6e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda0813f130 0x7fda080adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39334/0 (socket says 172.21.15.31:39334) 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda0dee6700 1 -- 172.21.15.31:0/1553036258 learned_addr learned my addr 172.21.15.31:0/1553036258 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.078+0000 7fda0d6e5700 1 --2- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda080a30c0 0x7fda080ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fda0e6e7700 1 -- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 msgr2=0x7fda080aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fda0e6e7700 1 --2- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fda0e6e7700 1 -- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda080a30c0 msgr2=0x7fda080ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fda0e6e7700 1 --2- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda080a30c0 0x7fda080ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fda0e6e7700 1 -- 172.21.15.31:0/1553036258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0400b790 con 0x7fda0813f130 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fda0dee6700 1 --2- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fda0e6e7700 1 --2- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda0813f130 0x7fda080adcf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b730 tx=0x7fda00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fd9fdffb700 1 -- 172.21.15.31:0/1553036258 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0000e070 con 0x7fda0813f130 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda080ac030 con 0x7fda0813f130 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fd9fdffb700 1 -- 172.21.15.31:0/1553036258 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda00007550 con 0x7fda0813f130 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.079+0000 7fd9fdffb700 1 -- 172.21.15.31:0/1553036258 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00007910 con 0x7fda0813f130 2024-04-18T10:38:33.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.080+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda080aba50 con 0x7fda0813f130 2024-04-18T10:38:33.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.080+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda080651b0 con 0x7fda0813f130 2024-04-18T10:38:33.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.081+0000 7fd9fdffb700 1 -- 172.21.15.31:0/1553036258 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7fda00007d00 con 0x7fda0813f130 2024-04-18T10:38:33.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.081+0000 7fd9fdffb700 1 -- 172.21.15.31:0/1553036258 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fda0005bb20 con 0x7fda0813f130 2024-04-18T10:38:33.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.091+0000 7fd9fdffb700 1 -- 172.21.15.31:0/1553036258 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fda00039da0 con 0x7fda0813f130 2024-04-18T10:38:33.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.254+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda0806f8f0 con 0x7fda0813f130 2024-04-18T10:38:33.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.254+0000 7fd9fdffb700 1 -- 172.21.15.31:0/1553036258 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda0003d590 con 0x7fda0813f130 2024-04-18T10:38:33.255 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:38:33.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 >> v1:172.21.15.31:6816/46601 conn(0x7fd9ec045f80 legacy=0x7fd9ec048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda0813f130 msgr2=0x7fda080adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 --2- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda0813f130 0x7fda080adcf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda0000b730 tx=0x7fda00009780 comp rx=0 tx=0).stop 2024-04-18T10:38:33.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 shutdown_connections 2024-04-18T10:38:33.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 --2- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fda08069450 0x7fda080aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 --2- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda0813f130 0x7fda080adcf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 --2- 172.21.15.31:0/1553036258 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fda080a30c0 0x7fda080ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 >> 172.21.15.31:0/1553036258 conn(0x7fda0806ae80 msgr2=0x7fda0806e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:33.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 shutdown_connections 2024-04-18T10:38:33.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.256+0000 7fda1014a700 1 -- 172.21.15.31:0/1553036258 wait complete. 2024-04-18T10:38:33.270 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:38:33.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.393+0000 7f3b7ea62700 1 Processor -- start 2024-04-18T10:38:33.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b7ea62700 1 -- start start 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b7ea62700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b78069200 0x7f3b780a3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b7ea62700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3b780679e0 0x7f3b78067db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b7ea62700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780682f0 0x7f3b781484b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b7ea62700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7806db90 con 0x7f3b780679e0 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b7ea62700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780a3e80 con 0x7f3b780682f0 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b7ea62700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780af2f0 con 0x7f3b78069200 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b7cfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780682f0 0x7f3b781484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b77fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b78069200 0x7f3b780a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b777fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3b780679e0 0x7f3b78067db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b77fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b78069200 0x7f3b780a3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41614/0 (socket says 172.21.15.31:41614) 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b7cfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780682f0 0x7f3b781484b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:50156/0 (socket says 172.21.15.31:50156) 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b77fff700 1 -- 172.21.15.31:0/930920115 learned_addr learned my addr 172.21.15.31:0/930920115 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.394+0000 7f3b777fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3b780679e0 0x7f3b78067db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39348/0 (socket says 172.21.15.31:39348) 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b777fe700 1 -- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b78069200 msgr2=0x7f3b780a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b777fe700 1 --2- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b78069200 0x7f3b780a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b777fe700 1 -- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780682f0 msgr2=0x7f3b781484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b777fe700 1 --2- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780682f0 0x7f3b781484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b777fe700 1 -- 172.21.15.31:0/930920115 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780a25c0 con 0x7f3b780679e0 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b77fff700 1 --2- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b78069200 0x7f3b780a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b7cfff700 1 --2- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780682f0 0x7f3b781484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b777fe700 1 --2- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b780679e0 0x7f3b78067db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b680098e0 tx=0x7f3b680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55d7878a1ad3325 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b76ffd700 1 -- 172.21.15.31:0/930920115 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68011630 con 0x7f3b780679e0 2024-04-18T10:38:33.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b76ffd700 1 -- 172.21.15.31:0/930920115 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68011790 con 0x7f3b780679e0 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.395+0000 7f3b76ffd700 1 -- 172.21.15.31:0/930920115 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68011b30 con 0x7f3b780679e0 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.396+0000 7f3b7ea62700 1 -- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b780679e0 msgr2=0x7f3b78067db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.396+0000 7f3b7ea62700 1 --2- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b780679e0 0x7f3b78067db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b680098e0 tx=0x7f3b680091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.396+0000 7f3b7ea62700 1 -- 172.21.15.31:0/930920115 shutdown_connections 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.396+0000 7f3b7ea62700 1 --2- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780682f0 0x7f3b781484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.396+0000 7f3b7ea62700 1 --2- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b78069200 0x7f3b780a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.396+0000 7f3b7ea62700 1 --2- 172.21.15.31:0/930920115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b780679e0 0x7f3b78067db0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.396+0000 7f3b7ea62700 1 -- 172.21.15.31:0/930920115 >> 172.21.15.31:0/930920115 conn(0x7f3b7806cd10 msgr2=0x7f3b78068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.396+0000 7f3b7ea62700 1 -- 172.21.15.31:0/930920115 shutdown_connections 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.396+0000 7f3b7ea62700 1 -- 172.21.15.31:0/930920115 wait complete. 2024-04-18T10:38:33.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.397+0000 7f3b7ea62700 1 Processor -- start 2024-04-18T10:38:33.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.397+0000 7f3b7ea62700 1 -- start start 2024-04-18T10:38:33.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.397+0000 7f3b7ea62700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780679e0 0x7f3b78096e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.397+0000 7f3b7ea62700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b780682f0 0x7f3b780aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.397+0000 7f3b7ea62700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b78069200 0x7f3b780aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.397+0000 7f3b7ea62700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780ae770 con 0x7f3b78069200 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.397+0000 7f3b7ea62700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780acae0 con 0x7f3b780679e0 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.397+0000 7f3b7ea62700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780acda0 con 0x7f3b780682f0 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.397+0000 7f3b77fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780679e0 0x7f3b78096e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b77fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780679e0 0x7f3b78096e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:50168/0 (socket says 172.21.15.31:50168) 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b77fff700 1 -- 172.21.15.31:0/3981301274 learned_addr learned my addr 172.21.15.31:0/3981301274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b7cfff700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b78069200 0x7f3b780aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b777fe700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b780682f0 0x7f3b780aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b77fff700 1 -- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b780682f0 msgr2=0x7f3b780aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b77fff700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b780682f0 0x7f3b780aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b77fff700 1 -- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b78069200 msgr2=0x7f3b780aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b77fff700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b78069200 0x7f3b780aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b77fff700 1 -- 172.21.15.31:0/3981301274 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b70009a20 con 0x7f3b780679e0 2024-04-18T10:38:33.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b7cfff700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b78069200 0x7f3b780aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:33.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b77fff700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780679e0 0x7f3b78096e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00ec50 tx=0x7f3b6c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:33.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b5ffff700 1 -- 172.21.15.31:0/3981301274 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00c850 con 0x7f3b780679e0 2024-04-18T10:38:33.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b5ffff700 1 -- 172.21.15.31:0/3981301274 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c00c9b0 con 0x7f3b780679e0 2024-04-18T10:38:33.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c0094f0 con 0x7f3b780679e0 2024-04-18T10:38:33.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b5ffff700 1 -- 172.21.15.31:0/3981301274 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00cd30 con 0x7f3b780679e0 2024-04-18T10:38:33.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.398+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b68009420 con 0x7f3b780679e0 2024-04-18T10:38:33.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.399+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b780a19c0 con 0x7f3b780679e0 2024-04-18T10:38:33.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.399+0000 7f3b5ffff700 1 -- 172.21.15.31:0/3981301274 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f3b6c013680 con 0x7f3b780679e0 2024-04-18T10:38:33.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.400+0000 7f3b5ffff700 1 -- 172.21.15.31:0/3981301274 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f3b6c05b2b0 con 0x7f3b780679e0 2024-04-18T10:38:33.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.404+0000 7f3b5ffff700 1 -- 172.21.15.31:0/3981301274 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3b6c039700 con 0x7f3b780679e0 2024-04-18T10:38:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.569+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b780651b0 con 0x7f3b780679e0 2024-04-18T10:38:33.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.570+0000 7f3b5ffff700 1 -- 172.21.15.31:0/3981301274 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b6c03cef0 con 0x7f3b780679e0 2024-04-18T10:38:33.570 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:38:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.571+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 >> v1:172.21.15.31:6816/46601 conn(0x7f3b64045fb0 legacy=0x7f3b64048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.571+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780679e0 msgr2=0x7f3b78096e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.571+0000 7f3b7ea62700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780679e0 0x7f3b78096e70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00ec50 tx=0x7f3b6c009250 comp rx=0 tx=0).stop 2024-04-18T10:38:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.571+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 shutdown_connections 2024-04-18T10:38:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.571+0000 7f3b7ea62700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b78069200 0x7f3b780aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.571+0000 7f3b7ea62700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3b780679e0 0x7f3b78096e70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.571+0000 7f3b7ea62700 1 --2- 172.21.15.31:0/3981301274 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3b780682f0 0x7f3b780aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.571+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 >> 172.21.15.31:0/3981301274 conn(0x7f3b7806cd10 msgr2=0x7f3b78064920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:33.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.572+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 shutdown_connections 2024-04-18T10:38:33.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.572+0000 7f3b7ea62700 1 -- 172.21.15.31:0/3981301274 wait complete. 2024-04-18T10:38:33.584 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:38:33.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.706+0000 7f0ae5246700 1 Processor -- start 2024-04-18T10:38:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.706+0000 7f0ae5246700 1 -- start start 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ae5246700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae0063b00 0x7f0ae00ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ae5246700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae00aa470 0x7f0ae013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ae5246700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae00a9d70 con 0x7f0ae013bce0 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ae5246700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00ad970 con 0x7f0ae0063b00 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ae5246700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00ac770 con 0x7f0ae00aa470 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ade59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae00aa470 0x7f0ae013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0aded9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae0063b00 0x7f0ae00ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0adf59e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0ae013bce0 0x7f0ae00adde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48314/0 (socket says 172.21.15.31:48314) 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0adf59e700 1 -- 172.21.15.31:0/868680235 learned_addr learned my addr 172.21.15.31:0/868680235 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ade59c700 1 -- 172.21.15.31:0/868680235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae0063b00 msgr2=0x7f0ae00ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:33.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0addd9b700 1 -- 172.21.15.31:0/868680235 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424246758 0 0) 0x7f0ae00a9d70 con 0x7f0ae013bce0 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ade59c700 1 --2- 172.21.15.31:0/868680235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae0063b00 0x7f0ae00ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ade59c700 1 -- 172.21.15.31:0/868680235 >> v1:172.21.15.31:6789/0 conn(0x7f0ae013bce0 legacy=0x7f0ae00adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ade59c700 1 -- 172.21.15.31:0/868680235 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae00aca10 con 0x7f0ae00aa470 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0aded9d700 1 --2- 172.21.15.31:0/868680235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae0063b00 0x7f0ae00ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.707+0000 7f0ade59c700 1 --2- 172.21.15.31:0/868680235 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae00aa470 0x7f0ae013b7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009910 tx=0x7f0ad00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c042015159d59a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0addd9b700 1 -- 172.21.15.31:0/868680235 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000b680 con 0x7f0ae00aa470 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0addd9b700 1 -- 172.21.15.31:0/868680235 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad000b7e0 con 0x7f0ae00aa470 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0addd9b700 1 -- 172.21.15.31:0/868680235 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000bba0 con 0x7f0ae00aa470 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0ae5246700 1 -- 172.21.15.31:0/868680235 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae00aa470 msgr2=0x7f0ae013b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0ae5246700 1 --2- 172.21.15.31:0/868680235 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae00aa470 0x7f0ae013b7a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009910 tx=0x7f0ad00091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0ae5246700 1 -- 172.21.15.31:0/868680235 shutdown_connections 2024-04-18T10:38:33.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0ae5246700 1 --2- 172.21.15.31:0/868680235 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae0063b00 0x7f0ae00ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0ae5246700 1 --2- 172.21.15.31:0/868680235 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae00aa470 0x7f0ae013b7a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0ae5246700 1 -- 172.21.15.31:0/868680235 >> 172.21.15.31:0/868680235 conn(0x7f0ae006a390 msgr2=0x7f0ae006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:33.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0ae5246700 1 -- 172.21.15.31:0/868680235 shutdown_connections 2024-04-18T10:38:33.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.708+0000 7f0ae5246700 1 -- 172.21.15.31:0/868680235 wait complete. 2024-04-18T10:38:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.709+0000 7f0ae5246700 1 Processor -- start 2024-04-18T10:38:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.709+0000 7f0ae5246700 1 -- start start 2024-04-18T10:38:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ae5246700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae0063b00 0x7f0ae01417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ae5246700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae00aa470 0x7f0ae014e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ae5246700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae013bce0 0x7f0ae014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ae5246700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae014ddc0 con 0x7f0ae0063b00 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ae5246700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae0141360 con 0x7f0ae00aa470 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ae5246700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae013ee50 con 0x7f0ae013bce0 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ade59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae00aa470 0x7f0ae014e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0aded9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae0063b00 0x7f0ae01417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0adf59e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae013bce0 0x7f0ae014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ade59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae00aa470 0x7f0ae014e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:50180/0 (socket says 172.21.15.31:50180) 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0aded9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae0063b00 0x7f0ae01417d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39374/0 (socket says 172.21.15.31:39374) 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ade59c700 1 -- 172.21.15.31:0/2782234633 learned_addr learned my addr 172.21.15.31:0/2782234633 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0adf59e700 1 -- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae00aa470 msgr2=0x7f0ae014e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0adf59e700 1 --2- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae00aa470 0x7f0ae014e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0adf59e700 1 -- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae0063b00 msgr2=0x7f0ae01417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0adf59e700 1 --2- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae0063b00 0x7f0ae01417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0adf59e700 1 -- 172.21.15.31:0/2782234633 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4009420 con 0x7f0ae013bce0 2024-04-18T10:38:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0aded9d700 1 --2- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae0063b00 0x7f0ae01417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0adf59e700 1 --2- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae013bce0 0x7f0ae014e7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ae013c180 tx=0x7f0ad80019a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.710+0000 7f0ac6ffd700 1 -- 172.21.15.31:0/2782234633 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800a940 con 0x7f0ae013bce0 2024-04-18T10:38:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.711+0000 7f0ac6ffd700 1 -- 172.21.15.31:0/2782234633 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad800aac0 con 0x7f0ae013bce0 2024-04-18T10:38:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.711+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad0009420 con 0x7f0ae013bce0 2024-04-18T10:38:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.711+0000 7f0ac6ffd700 1 -- 172.21.15.31:0/2782234633 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800ae80 con 0x7f0ae013bce0 2024-04-18T10:38:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.711+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae0142680 con 0x7f0ae013bce0 2024-04-18T10:38:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.712+0000 7f0ac6ffd700 1 -- 172.21.15.31:0/2782234633 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f0ad8007300 con 0x7f0ae013bce0 2024-04-18T10:38:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.712+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae00651b0 con 0x7f0ae013bce0 2024-04-18T10:38:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.712+0000 7f0ac6ffd700 1 -- 172.21.15.31:0/2782234633 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f0ad805b380 con 0x7f0ae013bce0 2024-04-18T10:38:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.716+0000 7f0ac6ffd700 1 -- 172.21.15.31:0/2782234633 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f0ad8039790 con 0x7f0ae013bce0 2024-04-18T10:38:33.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.879+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ae00ac2d0 con 0x7f0ae013bce0 2024-04-18T10:38:33.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.879+0000 7f0ac6ffd700 1 -- 172.21.15.31:0/2782234633 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ad803cf80 con 0x7f0ae013bce0 2024-04-18T10:38:33.880 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:38:33.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 >> v1:172.21.15.31:6816/46601 conn(0x7f0acc045f80 legacy=0x7f0acc048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae013bce0 msgr2=0x7f0ae014e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:33.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 --2- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae013bce0 0x7f0ae014e7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ae013c180 tx=0x7f0ad80019a0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 shutdown_connections 2024-04-18T10:38:33.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 --2- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0ae013bce0 0x7f0ae014e7b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 --2- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae0063b00 0x7f0ae01417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 --2- 172.21.15.31:0/2782234633 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0ae00aa470 0x7f0ae014e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:33.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 >> 172.21.15.31:0/2782234633 conn(0x7f0ae006a390 msgr2=0x7f0ae00b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:33.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 shutdown_connections 2024-04-18T10:38:33.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:33.881+0000 7f0ae5246700 1 -- 172.21.15.31:0/2782234633 wait complete. 2024-04-18T10:38:33.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:38:34.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.015+0000 7f769507a700 1 Processor -- start 2024-04-18T10:38:34.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.015+0000 7f769507a700 1 -- start start 2024-04-18T10:38:34.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.015+0000 7f769507a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7690068340 0x7f76900a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.015+0000 7f769507a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900a3a90 0x7f7690146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.015+0000 7f769507a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76900a73b0 con 0x7f76900b0560 2024-04-18T10:38:34.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.015+0000 7f769507a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76900a55e0 con 0x7f7690068340 2024-04-18T10:38:34.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.015+0000 7f769507a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76900a7130 con 0x7f76900a3a90 2024-04-18T10:38:34.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.015+0000 7f768f59e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900a3a90 0x7f7690146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.015+0000 7f768ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7690068340 0x7f76900a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768ed9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7690068340 0x7f76900a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39388/0 (socket says 172.21.15.31:39388) 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768e59c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f76900b0560 0x7f769013fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48320/0 (socket says 172.21.15.31:48320) 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768f59e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900a3a90 0x7f7690146a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41658/0 (socket says 172.21.15.31:41658) 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768ed9d700 1 -- 172.21.15.31:0/3948312110 learned_addr learned my addr 172.21.15.31:0/3948312110 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768f59e700 1 -- 172.21.15.31:0/3948312110 >> v2:172.21.15.31:3300/0 conn(0x7f7690068340 msgr2=0x7f76900a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768f59e700 1 --2- 172.21.15.31:0/3948312110 >> v2:172.21.15.31:3300/0 conn(0x7f7690068340 0x7f76900a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768f59e700 1 -- 172.21.15.31:0/3948312110 >> v1:172.21.15.31:6789/0 conn(0x7f76900b0560 legacy=0x7f769013fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768f59e700 1 -- 172.21.15.31:0/3948312110 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76900a41a0 con 0x7f76900a3a90 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768ed9d700 1 --2- 172.21.15.31:0/3948312110 >> v2:172.21.15.31:3300/0 conn(0x7f7690068340 0x7f76900a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768dd9b700 1 -- 172.21.15.31:0/3948312110 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163668430 0 0) 0x7f76900a73b0 con 0x7f76900b0560 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768f59e700 1 --2- 172.21.15.31:0/3948312110 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900a3a90 0x7f7690146a80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7688009e60 tx=0x7f7688009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbe10c94b881541a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768dd9b700 1 -- 172.21.15.31:0/3948312110 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768800e070 con 0x7f76900a3a90 2024-04-18T10:38:34.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768dd9b700 1 -- 172.21.15.31:0/3948312110 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768800bb60 con 0x7f76900a3a90 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.016+0000 7f768dd9b700 1 -- 172.21.15.31:0/3948312110 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7688012430 con 0x7f76900a3a90 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.017+0000 7f769507a700 1 -- 172.21.15.31:0/3948312110 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900a3a90 msgr2=0x7f7690146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.017+0000 7f769507a700 1 --2- 172.21.15.31:0/3948312110 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900a3a90 0x7f7690146a80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7688009e60 tx=0x7f7688009780 comp rx=0 tx=0).stop 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.017+0000 7f769507a700 1 -- 172.21.15.31:0/3948312110 shutdown_connections 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.017+0000 7f769507a700 1 --2- 172.21.15.31:0/3948312110 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900a3a90 0x7f7690146a80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.017+0000 7f769507a700 1 --2- 172.21.15.31:0/3948312110 >> v2:172.21.15.31:3300/0 conn(0x7f7690068340 0x7f76900a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.017+0000 7f769507a700 1 -- 172.21.15.31:0/3948312110 >> 172.21.15.31:0/3948312110 conn(0x7f769006dd70 msgr2=0x7f76900679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.017+0000 7f769507a700 1 -- 172.21.15.31:0/3948312110 shutdown_connections 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.017+0000 7f769507a700 1 -- 172.21.15.31:0/3948312110 wait complete. 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f769507a700 1 Processor -- start 2024-04-18T10:38:34.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f769507a700 1 -- start start 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f769507a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7690068340 0x7f7690099120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f769507a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76900a3a90 0x7f7690096cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f769507a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900b0560 0x7f769013e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f769507a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76900aca10 con 0x7f76900a3a90 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f769507a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7690098760 con 0x7f7690068340 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f769507a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7690097200 con 0x7f76900b0560 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f768e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76900a3a90 0x7f7690096cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f768f59e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900b0560 0x7f769013e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f768e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76900a3a90 0x7f7690096cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39392/0 (socket says 172.21.15.31:39392) 2024-04-18T10:38:34.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.018+0000 7f768e59c700 1 -- 172.21.15.31:0/1436713032 learned_addr learned my addr 172.21.15.31:0/1436713032 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f768ed9d700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7690068340 0x7f7690099120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f768e59c700 1 -- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900b0560 msgr2=0x7f769013e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f768e59c700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900b0560 0x7f769013e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f768e59c700 1 -- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7690068340 msgr2=0x7f7690099120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f768e59c700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7690068340 0x7f7690099120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f768e59c700 1 -- 172.21.15.31:0/1436713032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76800094f0 con 0x7f76900a3a90 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f768f59e700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900b0560 0x7f769013e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f768ed9d700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7690068340 0x7f7690099120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f768e59c700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76900a3a90 0x7f7690096cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f768400c560 tx=0x7f7684007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f7676ffd700 1 -- 172.21.15.31:0/1436713032 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684005a70 con 0x7f76900a3a90 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f7676ffd700 1 -- 172.21.15.31:0/1436713032 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7684005bd0 con 0x7f76900a3a90 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7688009a20 con 0x7f76900a3a90 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f7676ffd700 1 -- 172.21.15.31:0/1436713032 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76840070d0 con 0x7f76900a3a90 2024-04-18T10:38:34.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.019+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7690097460 con 0x7f76900a3a90 2024-04-18T10:38:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.020+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76900651b0 con 0x7f76900a3a90 2024-04-18T10:38:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.021+0000 7f7676ffd700 1 -- 172.21.15.31:0/1436713032 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f76840074c0 con 0x7f76900a3a90 2024-04-18T10:38:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.021+0000 7f7676ffd700 1 -- 172.21.15.31:0/1436713032 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f768405a7e0 con 0x7f76900a3a90 2024-04-18T10:38:34.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.024+0000 7f7676ffd700 1 -- 172.21.15.31:0/1436713032 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7684038bf0 con 0x7f76900a3a90 2024-04-18T10:38:34.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.189+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76900af560 con 0x7f76900a3a90 2024-04-18T10:38:34.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.189+0000 7f7676ffd700 1 -- 172.21.15.31:0/1436713032 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f768403c3e0 con 0x7f76900a3a90 2024-04-18T10:38:34.190 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:38:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 >> v1:172.21.15.31:6816/46601 conn(0x7f767c045fb0 legacy=0x7f767c048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76900a3a90 msgr2=0x7f7690096cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76900a3a90 0x7f7690096cc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f768400c560 tx=0x7f7684007f60 comp rx=0 tx=0).stop 2024-04-18T10:38:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 shutdown_connections 2024-04-18T10:38:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f76900b0560 0x7f769013e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7690068340 0x7f7690099120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 --2- 172.21.15.31:0/1436713032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76900a3a90 0x7f7690096cc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 >> 172.21.15.31:0/1436713032 conn(0x7f769006dd70 msgr2=0x7f76900b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:34.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 shutdown_connections 2024-04-18T10:38:34.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.191+0000 7f769507a700 1 -- 172.21.15.31:0/1436713032 wait complete. 2024-04-18T10:38:34.203 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:38:34.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.323+0000 7ff827287700 1 Processor -- start 2024-04-18T10:38:34.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.323+0000 7ff827287700 1 -- start start 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff827287700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 0x7ff8200680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff827287700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff820147520 0x7ff820149900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff827287700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8200a2550 con 0x7ff820069200 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff827287700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82006db40 con 0x7ff820147520 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff827287700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200a3bd0 con 0x7ff8200a37c0 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff825824700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff820147520 0x7ff820149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff824822700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 0x7ff8200680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff825023700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff820069200 0x7ff8200679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48322/0 (socket says 172.21.15.31:48322) 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff825023700 1 -- 172.21.15.31:0/2177794461 learned_addr learned my addr 172.21.15.31:0/2177794461 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:34.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff824822700 1 -- 172.21.15.31:0/2177794461 >> v2:172.21.15.31:3300/0 conn(0x7ff820147520 msgr2=0x7ff820149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff824822700 1 --2- 172.21.15.31:0/2177794461 >> v2:172.21.15.31:3300/0 conn(0x7ff820147520 0x7ff820149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff824822700 1 -- 172.21.15.31:0/2177794461 >> v1:172.21.15.31:6789/0 conn(0x7ff820069200 legacy=0x7ff8200679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff824822700 1 -- 172.21.15.31:0/2177794461 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8200a3de0 con 0x7ff8200a37c0 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff825824700 1 --2- 172.21.15.31:0/2177794461 >> v2:172.21.15.31:3300/0 conn(0x7ff820147520 0x7ff820149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.324+0000 7ff824822700 1 --2- 172.21.15.31:0/2177794461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 0x7ff8200680f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0098e0 tx=0x7ff81c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b921ce8fd095d59 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff817fff700 1 -- 172.21.15.31:0/2177794461 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00b640 con 0x7ff8200a37c0 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff817fff700 1 -- 172.21.15.31:0/2177794461 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c00b7a0 con 0x7ff8200a37c0 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff817fff700 1 -- 172.21.15.31:0/2177794461 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c00bb40 con 0x7ff8200a37c0 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff827287700 1 -- 172.21.15.31:0/2177794461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 msgr2=0x7ff8200680f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff827287700 1 --2- 172.21.15.31:0/2177794461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 0x7ff8200680f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0098e0 tx=0x7ff81c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff827287700 1 -- 172.21.15.31:0/2177794461 shutdown_connections 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff827287700 1 --2- 172.21.15.31:0/2177794461 >> v2:172.21.15.31:3300/0 conn(0x7ff820147520 0x7ff820149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff827287700 1 --2- 172.21.15.31:0/2177794461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 0x7ff8200680f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff827287700 1 -- 172.21.15.31:0/2177794461 >> 172.21.15.31:0/2177794461 conn(0x7ff82006cd60 msgr2=0x7ff820068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:34.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff827287700 1 -- 172.21.15.31:0/2177794461 shutdown_connections 2024-04-18T10:38:34.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.325+0000 7ff827287700 1 -- 172.21.15.31:0/2177794461 wait complete. 2024-04-18T10:38:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.326+0000 7ff827287700 1 Processor -- start 2024-04-18T10:38:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.326+0000 7ff827287700 1 -- start start 2024-04-18T10:38:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff827287700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff820069200 0x7ff820098640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff827287700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 0x7ff820151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff827287700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff820147520 0x7ff82014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff827287700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82014dea0 con 0x7ff820069200 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff827287700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200ad040 con 0x7ff8200a37c0 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff827287700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff82014e090 con 0x7ff820147520 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825023700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff820069200 0x7ff820098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825824700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff820147520 0x7ff82014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825023700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff820069200 0x7ff820098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39412/0 (socket says 172.21.15.31:39412) 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825023700 1 -- 172.21.15.31:0/239761739 learned_addr learned my addr 172.21.15.31:0/239761739 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825824700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff820147520 0x7ff82014e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:41680/0 (socket says 172.21.15.31:41680) 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff824822700 1 --2- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 0x7ff820151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825023700 1 -- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff820147520 msgr2=0x7ff82014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825023700 1 --2- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff820147520 0x7ff82014e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825023700 1 -- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 msgr2=0x7ff820151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825023700 1 --2- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 0x7ff820151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825023700 1 -- 172.21.15.31:0/239761739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff818009a20 con 0x7ff820069200 2024-04-18T10:38:34.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.327+0000 7ff825023700 1 --2- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff820069200 0x7ff820098640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c7c0 tx=0x7ff810007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:34.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.328+0000 7ff8157fa700 1 -- 172.21.15.31:0/239761739 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810005b30 con 0x7ff820069200 2024-04-18T10:38:34.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.328+0000 7ff8157fa700 1 -- 172.21.15.31:0/239761739 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff810005c90 con 0x7ff820069200 2024-04-18T10:38:34.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.328+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff81c009420 con 0x7ff820069200 2024-04-18T10:38:34.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.328+0000 7ff8157fa700 1 -- 172.21.15.31:0/239761739 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810004a80 con 0x7ff820069200 2024-04-18T10:38:34.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.328+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff820098c00 con 0x7ff820069200 2024-04-18T10:38:34.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.329+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8200a9e70 con 0x7ff820069200 2024-04-18T10:38:34.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.329+0000 7ff8157fa700 1 -- 172.21.15.31:0/239761739 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7ff8100070d0 con 0x7ff820069200 2024-04-18T10:38:34.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.329+0000 7ff8157fa700 1 -- 172.21.15.31:0/239761739 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7ff81005a360 con 0x7ff820069200 2024-04-18T10:38:34.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.333+0000 7ff8157fa700 1 -- 172.21.15.31:0/239761739 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ff8100386f0 con 0x7ff820069200 2024-04-18T10:38:34.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.527+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8200a2e50 con 0x7ff820069200 2024-04-18T10:38:34.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.527+0000 7ff8157fa700 1 -- 172.21.15.31:0/239761739 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+3663 (secure 0 0 0) 0x7ff810005e00 con 0x7ff820069200 2024-04-18T10:38:34.528 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:34.528 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3984682861","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3984682861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:56.046578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14141},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:38:34.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 >> v1:172.21.15.31:6816/46601 conn(0x7ff804045f80 legacy=0x7ff804048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff820069200 msgr2=0x7ff820098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 --2- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff820069200 0x7ff820098640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff81000c7c0 tx=0x7ff810007f70 comp rx=0 tx=0).stop 2024-04-18T10:38:34.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 shutdown_connections 2024-04-18T10:38:34.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 --2- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff820147520 0x7ff82014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 --2- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff820069200 0x7ff820098640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 --2- 172.21.15.31:0/239761739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff8200a37c0 0x7ff820151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 >> 172.21.15.31:0/239761739 conn(0x7ff82006cd60 msgr2=0x7ff820146de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:34.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 shutdown_connections 2024-04-18T10:38:34.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.529+0000 7ff827287700 1 -- 172.21.15.31:0/239761739 wait complete. 2024-04-18T10:38:34.531 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-18T10:38:34.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:34.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.661+0000 7fe60cccd700 1 Processor -- start 2024-04-18T10:38:34.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.661+0000 7fe60cccd700 1 -- start start 2024-04-18T10:38:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60cccd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6080aa8e0 0x7fe6080a8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60cccd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe60813efd0 0x7fe608141be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60cccd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6080ab140 con 0x7fe608142120 2024-04-18T10:38:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60cccd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080a8e60 con 0x7fe6080aa8e0 2024-04-18T10:38:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60cccd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60813e660 con 0x7fe60813efd0 2024-04-18T10:38:34.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6080aa8e0 0x7fe6080a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe606d9d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe608142120 0x7fe608148f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45190/0 (socket says 172.21.15.31:45190) 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6080aa8e0 0x7fe6080a8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40214/0 (socket says 172.21.15.31:40214) 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe606d9d700 1 -- 172.21.15.31:0/882304153 learned_addr learned my addr 172.21.15.31:0/882304153 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe605d9b700 1 --2- 172.21.15.31:0/882304153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe60813efd0 0x7fe608141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60659c700 1 -- 172.21.15.31:0/882304153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe60813efd0 msgr2=0x7fe608141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60659c700 1 --2- 172.21.15.31:0/882304153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe60813efd0 0x7fe608141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60659c700 1 -- 172.21.15.31:0/882304153 >> v1:172.21.15.31:6789/0 conn(0x7fe608142120 legacy=0x7fe608148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60659c700 1 -- 172.21.15.31:0/882304153 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6080a7160 con 0x7fe6080aa8e0 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe60559a700 1 -- 172.21.15.31:0/882304153 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019694694 0 0) 0x7fe6080ab140 con 0x7fe608142120 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.662+0000 7fe605d9b700 1 --2- 172.21.15.31:0/882304153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe60813efd0 0x7fe608141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60659c700 1 --2- 172.21.15.31:0/882304153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 0x7fe6080a8920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe600009e60 tx=0x7fe600009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424e6e494d1c86b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60559a700 1 -- 172.21.15.31:0/882304153 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000e070 con 0x7fe6080aa8e0 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60559a700 1 -- 172.21.15.31:0/882304153 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000bb60 con 0x7fe6080aa8e0 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60559a700 1 -- 172.21.15.31:0/882304153 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600012430 con 0x7fe6080aa8e0 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60cccd700 1 -- 172.21.15.31:0/882304153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 msgr2=0x7fe6080a8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60cccd700 1 --2- 172.21.15.31:0/882304153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 0x7fe6080a8920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe600009e60 tx=0x7fe600009780 comp rx=0 tx=0).stop 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60cccd700 1 -- 172.21.15.31:0/882304153 shutdown_connections 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60cccd700 1 --2- 172.21.15.31:0/882304153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 0x7fe6080a8920 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60cccd700 1 --2- 172.21.15.31:0/882304153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe60813efd0 0x7fe608141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60cccd700 1 -- 172.21.15.31:0/882304153 >> 172.21.15.31:0/882304153 conn(0x7fe608069450 msgr2=0x7fe608063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60cccd700 1 -- 172.21.15.31:0/882304153 shutdown_connections 2024-04-18T10:38:34.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.663+0000 7fe60cccd700 1 -- 172.21.15.31:0/882304153 wait complete. 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.665+0000 7fe60cccd700 1 Processor -- start 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.665+0000 7fe60cccd700 1 -- start start 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.665+0000 7fe60cccd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 0x7fe6080ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.665+0000 7fe60cccd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe60813efd0 0x7fe608151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.665+0000 7fe60cccd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe608142120 0x7fe608151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60cccd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080b1a50 con 0x7fe6080aa8e0 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60cccd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080adf10 con 0x7fe608142120 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60cccd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080aee70 con 0x7fe60813efd0 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 0x7fe6080ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 0x7fe6080ae5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40228/0 (socket says 172.21.15.31:40228) 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe605d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe60813efd0 0x7fe608151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60659c700 1 -- 172.21.15.31:0/361299125 learned_addr learned my addr 172.21.15.31:0/361299125 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe606d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe608142120 0x7fe608151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60659c700 1 -- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe60813efd0 msgr2=0x7fe608151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60659c700 1 --2- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe60813efd0 0x7fe608151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60659c700 1 -- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe608142120 msgr2=0x7fe608151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60659c700 1 --2- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe608142120 0x7fe608151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60659c700 1 -- 172.21.15.31:0/361299125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc009420 con 0x7fe6080aa8e0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60659c700 1 --2- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 0x7fe6080ae5b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe60000b6c0 tx=0x7fe600019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe5f67fc700 1 -- 172.21.15.31:0/361299125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600012be0 con 0x7fe6080aa8e0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe5f67fc700 1 -- 172.21.15.31:0/361299125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe600012d80 con 0x7fe6080aa8e0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe600009a20 con 0x7fe6080aa8e0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe5f67fc700 1 -- 172.21.15.31:0/361299125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000276c0 con 0x7fe6080aa8e0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.666+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6080b0590 con 0x7fe6080aa8e0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.667+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe608064920 con 0x7fe6080aa8e0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.667+0000 7fe5f67fc700 1 -- 172.21.15.31:0/361299125 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7fe600024070 con 0x7fe6080aa8e0 2024-04-18T10:38:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.668+0000 7fe5f67fc700 1 -- 172.21.15.31:0/361299125 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fe60005d4f0 con 0x7fe6080aa8e0 2024-04-18T10:38:34.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.671+0000 7fe5f67fc700 1 -- 172.21.15.31:0/361299125 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe600006820 con 0x7fe6080aa8e0 2024-04-18T10:38:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.838+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe608068710 con 0x7fe6080aa8e0 2024-04-18T10:38:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.839+0000 7fe5f67fc700 1 -- 172.21.15.31:0/361299125 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11533 (secure 0 0 0) 0x7fe600006820 con 0x7fe6080aa8e0 2024-04-18T10:38:34.840 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:34.840 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:32.400116+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 >> v1:172.21.15.31:6816/46601 conn(0x7fe5e8045fb0 legacy=0x7fe5e8048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 msgr2=0x7fe6080ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 --2- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 0x7fe6080ae5b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe60000b6c0 tx=0x7fe600019000 comp rx=0 tx=0).stop 2024-04-18T10:38:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 shutdown_connections 2024-04-18T10:38:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 --2- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe608142120 0x7fe608151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 --2- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6080aa8e0 0x7fe6080ae5b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 --2- 172.21.15.31:0/361299125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe60813efd0 0x7fe608151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 >> 172.21.15.31:0/361299125 conn(0x7fe608069450 msgr2=0x7fe6080b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 shutdown_connections 2024-04-18T10:38:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.841+0000 7fe60cccd700 1 -- 172.21.15.31:0/361299125 wait complete. 2024-04-18T10:38:34.853 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:38:34.854 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:38:34.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.976+0000 7f5d6c99b700 1 Processor -- start 2024-04-18T10:38:34.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.976+0000 7f5d6c99b700 1 -- start start 2024-04-18T10:38:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d6c99b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d680a5b80 0x7f5d68139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d6c99b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d68146b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d6c99b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d680ada50 con 0x7f5d68063b00 2024-04-18T10:38:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d6c99b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680a5fd0 con 0x7f5d680a5b80 2024-04-18T10:38:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d6c99b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680ad5e0 con 0x7f5d68139cc0 2024-04-18T10:38:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d65d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d680a5b80 0x7f5d68139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d66d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d68146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d6659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5d68063b00 0x7f5d680aced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45194/0 (socket says 172.21.15.31:45194) 2024-04-18T10:38:34.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d65d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d680a5b80 0x7f5d68139780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34882/0 (socket says 172.21.15.31:34882) 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d66d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d68146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54248/0 (socket says 172.21.15.31:54248) 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d6659c700 1 -- 172.21.15.31:0/1927966051 learned_addr learned my addr 172.21.15.31:0/1927966051 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d6559a700 1 -- 172.21.15.31:0/1927966051 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003808886 0 0) 0x7f5d680ada50 con 0x7f5d68063b00 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d66d9d700 1 -- 172.21.15.31:0/1927966051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d680a5b80 msgr2=0x7f5d68139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d66d9d700 1 --2- 172.21.15.31:0/1927966051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d680a5b80 0x7f5d68139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d66d9d700 1 -- 172.21.15.31:0/1927966051 >> v1:172.21.15.31:6789/0 conn(0x7f5d68063b00 legacy=0x7f5d680aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d66d9d700 1 -- 172.21.15.31:0/1927966051 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680ad800 con 0x7f5d68139cc0 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.977+0000 7f5d65d9b700 1 --2- 172.21.15.31:0/1927966051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d680a5b80 0x7f5d68139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d66d9d700 1 --2- 172.21.15.31:0/1927966051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d68146b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009e90 tx=0x7f5d60009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2522fb69a2c45263 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6559a700 1 -- 172.21.15.31:0/1927966051 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6000e070 con 0x7f5d68139cc0 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6559a700 1 -- 172.21.15.31:0/1927966051 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6000bc30 con 0x7f5d68139cc0 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6559a700 1 -- 172.21.15.31:0/1927966051 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60012430 con 0x7f5d68139cc0 2024-04-18T10:38:34.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6c99b700 1 -- 172.21.15.31:0/1927966051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 msgr2=0x7f5d68146b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6c99b700 1 --2- 172.21.15.31:0/1927966051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d68146b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009e90 tx=0x7f5d60009780 comp rx=0 tx=0).stop 2024-04-18T10:38:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6c99b700 1 -- 172.21.15.31:0/1927966051 shutdown_connections 2024-04-18T10:38:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6c99b700 1 --2- 172.21.15.31:0/1927966051 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d68146b90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6c99b700 1 --2- 172.21.15.31:0/1927966051 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d680a5b80 0x7f5d68139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6c99b700 1 -- 172.21.15.31:0/1927966051 >> 172.21.15.31:0/1927966051 conn(0x7f5d6806a390 msgr2=0x7f5d6806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6c99b700 1 -- 172.21.15.31:0/1927966051 shutdown_connections 2024-04-18T10:38:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.978+0000 7f5d6c99b700 1 -- 172.21.15.31:0/1927966051 wait complete. 2024-04-18T10:38:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.979+0000 7f5d6c99b700 1 Processor -- start 2024-04-18T10:38:34.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.979+0000 7f5d6c99b700 1 -- start start 2024-04-18T10:38:34.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6c99b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d68063b00 0x7f5d680a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6c99b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d680a5b80 0x7f5d68151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6c99b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d681517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:34.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6c99b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680a6de0 con 0x7f5d680a5b80 2024-04-18T10:38:34.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6c99b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d680a7d20 con 0x7f5d68063b00 2024-04-18T10:38:34.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6c99b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6813b350 con 0x7f5d68139cc0 2024-04-18T10:38:34.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d68063b00 0x7f5d680a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d66d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d681517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d68063b00 0x7f5d680a77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34898/0 (socket says 172.21.15.31:34898) 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6659c700 1 -- 172.21.15.31:0/3512703906 learned_addr learned my addr 172.21.15.31:0/3512703906 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d65d9b700 1 --2- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d680a5b80 0x7f5d68151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6659c700 1 -- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 msgr2=0x7f5d681517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6659c700 1 --2- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d681517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6659c700 1 -- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d680a5b80 msgr2=0x7f5d68151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6659c700 1 --2- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d680a5b80 0x7f5d68151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6659c700 1 -- 172.21.15.31:0/3512703906 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d58009420 con 0x7f5d68063b00 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.980+0000 7f5d6659c700 1 --2- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d68063b00 0x7f5d680a77e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00c810 tx=0x7f5d5c007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.981+0000 7f5d567fc700 1 -- 172.21.15.31:0/3512703906 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c005c00 con 0x7f5d68063b00 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.981+0000 7f5d567fc700 1 -- 172.21.15.31:0/3512703906 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c005d60 con 0x7f5d68063b00 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.981+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d60009a20 con 0x7f5d68063b00 2024-04-18T10:38:34.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.981+0000 7f5d567fc700 1 -- 172.21.15.31:0/3512703906 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c007320 con 0x7f5d68063b00 2024-04-18T10:38:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.981+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6813cfc0 con 0x7f5d68063b00 2024-04-18T10:38:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.982+0000 7f5d567fc700 1 -- 172.21.15.31:0/3512703906 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f5d5c01b3b0 con 0x7f5d68063b00 2024-04-18T10:38:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.982+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6813b5f0 con 0x7f5d68063b00 2024-04-18T10:38:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.982+0000 7f5d567fc700 1 -- 172.21.15.31:0/3512703906 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f5d5c05a500 con 0x7f5d68063b00 2024-04-18T10:38:34.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:34.986+0000 7f5d567fc700 1 -- 172.21.15.31:0/3512703906 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5d5c017080 con 0x7f5d68063b00 2024-04-18T10:38:35.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.149+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d680651b0 con 0x7f5d68063b00 2024-04-18T10:38:35.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.149+0000 7f5d567fc700 1 -- 172.21.15.31:0/3512703906 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d5c038a00 con 0x7f5d68063b00 2024-04-18T10:38:35.150 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:38:35.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.150+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 >> v1:172.21.15.31:6816/46601 conn(0x7f5d48045f80 legacy=0x7f5d48048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.151+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d68063b00 msgr2=0x7f5d680a77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.151+0000 7f5d6c99b700 1 --2- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d68063b00 0x7f5d680a77e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00c810 tx=0x7f5d5c007d90 comp rx=0 tx=0).stop 2024-04-18T10:38:35.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.151+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 shutdown_connections 2024-04-18T10:38:35.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.151+0000 7f5d6c99b700 1 --2- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5d68139cc0 0x7f5d681517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.151+0000 7f5d6c99b700 1 --2- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5d68063b00 0x7f5d680a77e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.151+0000 7f5d6c99b700 1 --2- 172.21.15.31:0/3512703906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d680a5b80 0x7f5d68151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.151+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 >> 172.21.15.31:0/3512703906 conn(0x7f5d6806a390 msgr2=0x7f5d6813f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:35.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.151+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 shutdown_connections 2024-04-18T10:38:35.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.151+0000 7f5d6c99b700 1 -- 172.21.15.31:0/3512703906 wait complete. 2024-04-18T10:38:35.163 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:38:35.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.285+0000 7f4a5b110700 1 Processor -- start 2024-04-18T10:38:35.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.285+0000 7f4a5b110700 1 -- start start 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a5b110700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a54063b80 0x7f4a540ac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a5b110700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4a540a5b10 0x7f4a540ad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a5b110700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a540a5680 con 0x7f4a54131700 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a5b110700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a54132290 con 0x7f4a540a5b10 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a5b110700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540a5f80 con 0x7f4a54063b80 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a58eac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a54063b80 0x7f4a540ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a53fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4a540a5b10 0x7f4a540ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a596ad700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4a54131700 0x7f4a54131b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45198/0 (socket says 172.21.15.31:45198) 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a596ad700 1 -- 172.21.15.31:0/2556740687 learned_addr learned my addr 172.21.15.31:0/2556740687 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a58eac700 1 -- 172.21.15.31:0/2556740687 >> v2:172.21.15.31:3300/0 conn(0x7f4a540a5b10 msgr2=0x7f4a540ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:35.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a58eac700 1 --2- 172.21.15.31:0/2556740687 >> v2:172.21.15.31:3300/0 conn(0x7f4a540a5b10 0x7f4a540ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a58eac700 1 -- 172.21.15.31:0/2556740687 >> v1:172.21.15.31:6789/0 conn(0x7f4a54131700 legacy=0x7f4a54131b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a58eac700 1 -- 172.21.15.31:0/2556740687 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540a6220 con 0x7f4a54063b80 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a537fe700 1 -- 172.21.15.31:0/2556740687 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604123788 0 0) 0x7f4a540a5680 con 0x7f4a54131700 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a53fff700 1 --2- 172.21.15.31:0/2556740687 >> v2:172.21.15.31:3300/0 conn(0x7f4a540a5b10 0x7f4a540ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a58eac700 1 --2- 172.21.15.31:0/2556740687 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a54063b80 0x7f4a540ac390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009910 tx=0x7f4a480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daf7da352051e510 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a537fe700 1 -- 172.21.15.31:0/2556740687 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800b640 con 0x7f4a54063b80 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a537fe700 1 -- 172.21.15.31:0/2556740687 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800b7a0 con 0x7f4a54063b80 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.286+0000 7f4a537fe700 1 -- 172.21.15.31:0/2556740687 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800bb60 con 0x7f4a54063b80 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.287+0000 7f4a5b110700 1 -- 172.21.15.31:0/2556740687 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a54063b80 msgr2=0x7f4a540ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.287+0000 7f4a5b110700 1 --2- 172.21.15.31:0/2556740687 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a54063b80 0x7f4a540ac390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009910 tx=0x7f4a480091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.287+0000 7f4a5b110700 1 -- 172.21.15.31:0/2556740687 shutdown_connections 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.287+0000 7f4a5b110700 1 --2- 172.21.15.31:0/2556740687 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a54063b80 0x7f4a540ac390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.287+0000 7f4a5b110700 1 --2- 172.21.15.31:0/2556740687 >> v2:172.21.15.31:3300/0 conn(0x7f4a540a5b10 0x7f4a540ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.287+0000 7f4a5b110700 1 -- 172.21.15.31:0/2556740687 >> 172.21.15.31:0/2556740687 conn(0x7f4a540b1290 msgr2=0x7f4a540b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:35.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.287+0000 7f4a5b110700 1 -- 172.21.15.31:0/2556740687 shutdown_connections 2024-04-18T10:38:35.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.287+0000 7f4a5b110700 1 -- 172.21.15.31:0/2556740687 wait complete. 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.288+0000 7f4a5b110700 1 Processor -- start 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.288+0000 7f4a5b110700 1 -- start start 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a5b110700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a54063b80 0x7f4a5413e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a5b110700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a540a5b10 0x7f4a5413f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a5b110700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a54131700 0x7f4a5414c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a5b110700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5413fcf0 con 0x7f4a54131700 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a5b110700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5413e3b0 con 0x7f4a54063b80 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a5b110700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5413fef0 con 0x7f4a540a5b10 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a58eac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a54063b80 0x7f4a5413e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a53fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a540a5b10 0x7f4a5413f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a58eac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a54063b80 0x7f4a5413e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34912/0 (socket says 172.21.15.31:34912) 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a58eac700 1 -- 172.21.15.31:0/1079157214 learned_addr learned my addr 172.21.15.31:0/1079157214 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:35.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a596ad700 1 --2- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a54131700 0x7f4a5414c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a58eac700 1 -- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a540a5b10 msgr2=0x7f4a5413f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a58eac700 1 --2- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a540a5b10 0x7f4a5413f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a58eac700 1 -- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a54131700 msgr2=0x7f4a5414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a58eac700 1 --2- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a54131700 0x7f4a5414c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a58eac700 1 -- 172.21.15.31:0/1079157214 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40009420 con 0x7f4a54063b80 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a596ad700 1 --2- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a54131700 0x7f4a5414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a58eac700 1 --2- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a54063b80 0x7f4a5413e7e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009fb0 tx=0x7f4a48017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.289+0000 7f4a50ff9700 1 -- 172.21.15.31:0/1079157214 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4801f070 con 0x7f4a54063b80 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.290+0000 7f4a50ff9700 1 -- 172.21.15.31:0/1079157214 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800bb20 con 0x7f4a54063b80 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.290+0000 7f4a50ff9700 1 -- 172.21.15.31:0/1079157214 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48011650 con 0x7f4a54063b80 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.290+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a48009420 con 0x7f4a54063b80 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.290+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5414bfd0 con 0x7f4a54063b80 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.290+0000 7f4a50ff9700 1 -- 172.21.15.31:0/1079157214 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f4a48011a00 con 0x7f4a54063b80 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.290+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5413f680 con 0x7f4a54063b80 2024-04-18T10:38:35.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.291+0000 7f4a50ff9700 1 -- 172.21.15.31:0/1079157214 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f4a4805c5f0 con 0x7f4a54063b80 2024-04-18T10:38:35.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.294+0000 7f4a50ff9700 1 -- 172.21.15.31:0/1079157214 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4a48011cb0 con 0x7f4a54063b80 2024-04-18T10:38:35.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.430+0000 7f4a50ff9700 1 -- 172.21.15.31:0/1079157214 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f4a4802c3f0 con 0x7f4a54063b80 2024-04-18T10:38:35.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.462+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a540651b0 con 0x7f4a54063b80 2024-04-18T10:38:35.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.462+0000 7f4a50ff9700 1 -- 172.21.15.31:0/1079157214 <== mon.1 v2:172.21.15.31:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4a48015880 con 0x7f4a54063b80 2024-04-18T10:38:35.463 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:38:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 >> v1:172.21.15.31:6816/46601 conn(0x7f4a38045f80 legacy=0x7f4a38048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a54063b80 msgr2=0x7f4a5413e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 --2- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a54063b80 0x7f4a5413e7e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009fb0 tx=0x7f4a48017000 comp rx=0 tx=0).stop 2024-04-18T10:38:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 shutdown_connections 2024-04-18T10:38:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 --2- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a54131700 0x7f4a5414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 --2- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a54063b80 0x7f4a5413e7e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 --2- 172.21.15.31:0/1079157214 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a540a5b10 0x7f4a5413f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 >> 172.21.15.31:0/1079157214 conn(0x7f4a540b1290 msgr2=0x7f4a540ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 shutdown_connections 2024-04-18T10:38:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.464+0000 7f4a5b110700 1 -- 172.21.15.31:0/1079157214 wait complete. 2024-04-18T10:38:35.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:38:35.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.599+0000 7f3031cf9700 1 Processor -- start 2024-04-18T10:38:35.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.599+0000 7f3031cf9700 1 -- start start 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f3031cf9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c0a3680 0x7f302c0680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f3031cf9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f302c147630 0x7f302c149a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f3031cf9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0a3db0 con 0x7f302c069200 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f3031cf9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302c06e2f0 con 0x7f302c147630 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f3031cf9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f302c06fb40 con 0x7f302c0a3680 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f302c147630 0x7f302c149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c0a3680 0x7f302c0680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f302c069200 0x7f302c0679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45202/0 (socket says 172.21.15.31:45202) 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302b7fe700 1 -- 172.21.15.31:0/3995758537 learned_addr learned my addr 172.21.15.31:0/3995758537 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302bfff700 1 -- 172.21.15.31:0/3995758537 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c0a3680 msgr2=0x7f302c0680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:35.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302bfff700 1 --2- 172.21.15.31:0/3995758537 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c0a3680 0x7f302c0680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302bfff700 1 -- 172.21.15.31:0/3995758537 >> v1:172.21.15.31:6789/0 conn(0x7f302c069200 legacy=0x7f302c0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302bfff700 1 -- 172.21.15.31:0/3995758537 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c06fde0 con 0x7f302c147630 2024-04-18T10:38:35.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302affd700 1 --2- 172.21.15.31:0/3995758537 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c0a3680 0x7f302c0680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:35.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302bfff700 1 --2- 172.21.15.31:0/3995758537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f302c147630 0x7f302c149a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3024009e60 tx=0x7f3024009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9556edc9a6d13d79 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:35.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302a7fc700 1 -- 172.21.15.31:0/3995758537 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302400e070 con 0x7f302c147630 2024-04-18T10:38:35.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302a7fc700 1 -- 172.21.15.31:0/3995758537 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302400bb60 con 0x7f302c147630 2024-04-18T10:38:35.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.600+0000 7f302a7fc700 1 -- 172.21.15.31:0/3995758537 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024012430 con 0x7f302c147630 2024-04-18T10:38:35.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.601+0000 7f3031cf9700 1 -- 172.21.15.31:0/3995758537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f302c147630 msgr2=0x7f302c149a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.601+0000 7f3031cf9700 1 --2- 172.21.15.31:0/3995758537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f302c147630 0x7f302c149a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3024009e60 tx=0x7f3024009780 comp rx=0 tx=0).stop 2024-04-18T10:38:35.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.601+0000 7f3031cf9700 1 -- 172.21.15.31:0/3995758537 shutdown_connections 2024-04-18T10:38:35.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.601+0000 7f3031cf9700 1 --2- 172.21.15.31:0/3995758537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f302c147630 0x7f302c149a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.601+0000 7f3031cf9700 1 --2- 172.21.15.31:0/3995758537 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c0a3680 0x7f302c0680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.601+0000 7f3031cf9700 1 -- 172.21.15.31:0/3995758537 >> 172.21.15.31:0/3995758537 conn(0x7f302c06af40 msgr2=0x7f302c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:35.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.601+0000 7f3031cf9700 1 -- 172.21.15.31:0/3995758537 shutdown_connections 2024-04-18T10:38:35.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.601+0000 7f3031cf9700 1 -- 172.21.15.31:0/3995758537 wait complete. 2024-04-18T10:38:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.602+0000 7f3031cf9700 1 Processor -- start 2024-04-18T10:38:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.602+0000 7f3031cf9700 1 -- start start 2024-04-18T10:38:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f3031cf9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f302c069200 0x7f302c0989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f3031cf9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f302c0a3680 0x7f302c0975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f3031cf9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c147630 0x7f302c14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f3031cf9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c098200 con 0x7f302c0a3680 2024-04-18T10:38:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f3031cf9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c14e410 con 0x7f302c069200 2024-04-18T10:38:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f3031cf9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f302c098f20 con 0x7f302c147630 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f302c069200 0x7f302c0989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c147630 0x7f302c14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f302c069200 0x7f302c0989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34914/0 (socket says 172.21.15.31:34914) 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302b7fe700 1 -- 172.21.15.31:0/1018341774 learned_addr learned my addr 172.21.15.31:0/1018341774 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302affd700 1 --2- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f302c0a3680 0x7f302c0975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302b7fe700 1 -- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c147630 msgr2=0x7f302c14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302b7fe700 1 --2- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c147630 0x7f302c14e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302b7fe700 1 -- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f302c0a3680 msgr2=0x7f302c0975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302b7fe700 1 --2- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f302c0a3680 0x7f302c0975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302b7fe700 1 -- 172.21.15.31:0/1018341774 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3014009420 con 0x7f302c069200 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302bfff700 1 --2- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c147630 0x7f302c14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f302b7fe700 1 --2- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f302c069200 0x7f302c0989e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c560 tx=0x7f301c001020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f30237fe700 1 -- 172.21.15.31:0/1018341774 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c005b30 con 0x7f302c069200 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f30237fe700 1 -- 172.21.15.31:0/1018341774 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c005c90 con 0x7f302c069200 2024-04-18T10:38:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3024009a20 con 0x7f302c069200 2024-04-18T10:38:35.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f30237fe700 1 -- 172.21.15.31:0/1018341774 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c007320 con 0x7f302c069200 2024-04-18T10:38:35.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.603+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c0ad660 con 0x7f302c069200 2024-04-18T10:38:35.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.604+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302c0695d0 con 0x7f302c069200 2024-04-18T10:38:35.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.604+0000 7f30237fe700 1 -- 172.21.15.31:0/1018341774 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f301c01b3b0 con 0x7f302c069200 2024-04-18T10:38:35.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.605+0000 7f30237fe700 1 -- 172.21.15.31:0/1018341774 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f301c05a5f0 con 0x7f302c069200 2024-04-18T10:38:35.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.608+0000 7f30237fe700 1 -- 172.21.15.31:0/1018341774 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f301c0387e0 con 0x7f302c069200 2024-04-18T10:38:35.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.772+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f302c0b14b0 con 0x7f302c069200 2024-04-18T10:38:35.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.772+0000 7f30237fe700 1 -- 172.21.15.31:0/1018341774 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f301c017020 con 0x7f302c069200 2024-04-18T10:38:35.773 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:38:35.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 >> v1:172.21.15.31:6816/46601 conn(0x7f300c046010 legacy=0x7f300c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f302c069200 msgr2=0x7f302c0989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 --2- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f302c069200 0x7f302c0989e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c560 tx=0x7f301c001020 comp rx=0 tx=0).stop 2024-04-18T10:38:35.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 shutdown_connections 2024-04-18T10:38:35.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 --2- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f302c147630 0x7f302c14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 --2- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f302c069200 0x7f302c0989e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 --2- 172.21.15.31:0/1018341774 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f302c0a3680 0x7f302c0975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 >> 172.21.15.31:0/1018341774 conn(0x7f302c06af40 msgr2=0x7f302c0b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:35.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 shutdown_connections 2024-04-18T10:38:35.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.774+0000 7f3031cf9700 1 -- 172.21.15.31:0/1018341774 wait complete. 2024-04-18T10:38:35.786 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f8945d2c700 1 Processor -- start 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f8945d2c700 1 -- start start 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f8945d2c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f894006ecf0 0x7f89400a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f8945d2c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f89400a6d60 0x7f8940142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f8945d2c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89400a7130 0x7f89401450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f8945d2c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89400a3540 con 0x7f89400a6d60 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f8945d2c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89400a37e0 con 0x7f89400a7130 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f8945d2c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89400a5d60 con 0x7f894006ecf0 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f893f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f894006ecf0 0x7f89400a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f893effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f89400a6d60 0x7f8940142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f893ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89400a7130 0x7f89401450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f893effd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f89400a6d60 0x7f8940142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40300/0 (socket says 172.21.15.31:40300) 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f893ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89400a7130 0x7f89401450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34926/0 (socket says 172.21.15.31:34926) 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f893f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f894006ecf0 0x7f89400a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54314/0 (socket says 172.21.15.31:54314) 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.909+0000 7f893effd700 1 -- 172.21.15.31:0/2976648999 learned_addr learned my addr 172.21.15.31:0/2976648999 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893effd700 1 -- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f894006ecf0 msgr2=0x7f89400a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893effd700 1 --2- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f894006ecf0 0x7f89400a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893effd700 1 -- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89400a7130 msgr2=0x7f89401450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893effd700 1 --2- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89400a7130 0x7f89401450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893effd700 1 -- 172.21.15.31:0/2976648999 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894006d980 con 0x7f89400a6d60 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893ffff700 1 --2- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89400a7130 0x7f89401450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893f7fe700 1 --2- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f894006ecf0 0x7f89400a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:35.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893effd700 1 --2- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89400a6d60 0x7f8940142b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f89340099b0 tx=0x7f8934009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2451fa64730d237 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893e7fc700 1 -- 172.21.15.31:0/2976648999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400b680 con 0x7f89400a6d60 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893e7fc700 1 -- 172.21.15.31:0/2976648999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893400b7e0 con 0x7f89400a6d60 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.910+0000 7f893e7fc700 1 -- 172.21.15.31:0/2976648999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400bb80 con 0x7f89400a6d60 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.911+0000 7f8945d2c700 1 -- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89400a6d60 msgr2=0x7f8940142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.911+0000 7f8945d2c700 1 --2- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89400a6d60 0x7f8940142b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f89340099b0 tx=0x7f8934009250 comp rx=0 tx=0).stop 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.911+0000 7f8945d2c700 1 -- 172.21.15.31:0/2976648999 shutdown_connections 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.911+0000 7f8945d2c700 1 --2- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89400a7130 0x7f89401450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.911+0000 7f8945d2c700 1 --2- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f894006ecf0 0x7f89400a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.911+0000 7f8945d2c700 1 --2- 172.21.15.31:0/2976648999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89400a6d60 0x7f8940142b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.911+0000 7f8945d2c700 1 -- 172.21.15.31:0/2976648999 >> 172.21.15.31:0/2976648999 conn(0x7f89400679e0 msgr2=0x7f8940067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.911+0000 7f8945d2c700 1 -- 172.21.15.31:0/2976648999 shutdown_connections 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.911+0000 7f8945d2c700 1 -- 172.21.15.31:0/2976648999 wait complete. 2024-04-18T10:38:35.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f8945d2c700 1 Processor -- start 2024-04-18T10:38:35.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f8945d2c700 1 -- start start 2024-04-18T10:38:35.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f8945d2c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f894006ecf0 0x7f89400ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f8945d2c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89400a6d60 0x7f894014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f8945d2c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89400a7130 0x7f894014f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:35.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f8945d2c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400aa8e0 con 0x7f89400a7130 2024-04-18T10:38:35.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f8945d2c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89400ab160 con 0x7f894006ecf0 2024-04-18T10:38:35.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f8945d2c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89400abf60 con 0x7f89400a6d60 2024-04-18T10:38:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f893effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89400a6d60 0x7f894014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f893effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89400a6d60 0x7f894014ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54324/0 (socket says 172.21.15.31:54324) 2024-04-18T10:38:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f893effd700 1 -- 172.21.15.31:0/3568432534 learned_addr learned my addr 172.21.15.31:0/3568432534 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f893ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89400a7130 0x7f894014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.912+0000 7f893f7fe700 1 --2- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f894006ecf0 0x7f89400ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f893effd700 1 -- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f894006ecf0 msgr2=0x7f89400ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f893effd700 1 --2- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f894006ecf0 0x7f89400ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f893effd700 1 -- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89400a7130 msgr2=0x7f894014f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:35.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f893effd700 1 --2- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89400a7130 0x7f894014f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:35.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f893effd700 1 -- 172.21.15.31:0/3568432534 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8930009420 con 0x7f89400a6d60 2024-04-18T10:38:35.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f893effd700 1 --2- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89400a6d60 0x7f894014ef00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8934009290 tx=0x7f8934017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:35.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f89277fe700 1 -- 172.21.15.31:0/3568432534 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893400b950 con 0x7f89400a6d60 2024-04-18T10:38:35.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f89277fe700 1 -- 172.21.15.31:0/3568432534 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893400bab0 con 0x7f89400a6d60 2024-04-18T10:38:35.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8938009a20 con 0x7f89400a6d60 2024-04-18T10:38:35.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f89277fe700 1 -- 172.21.15.31:0/3568432534 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893401a680 con 0x7f89400a6d60 2024-04-18T10:38:35.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.913+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89340094f0 con 0x7f89400a6d60 2024-04-18T10:38:35.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.914+0000 7f89277fe700 1 -- 172.21.15.31:0/3568432534 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f893401aa70 con 0x7f89400a6d60 2024-04-18T10:38:35.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.914+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89400a7650 con 0x7f89400a6d60 2024-04-18T10:38:35.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.914+0000 7f89277fe700 1 -- 172.21.15.31:0/3568432534 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f893405cd20 con 0x7f89400a6d60 2024-04-18T10:38:35.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:35.918+0000 7f89277fe700 1 -- 172.21.15.31:0/3568432534 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8934005a00 con 0x7f89400a6d60 2024-04-18T10:38:36.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.079+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8940065190 con 0x7f89400a6d60 2024-04-18T10:38:36.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.080+0000 7f89277fe700 1 -- 172.21.15.31:0/3568432534 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8934015070 con 0x7f89400a6d60 2024-04-18T10:38:36.080 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:38:36.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.081+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 >> v1:172.21.15.31:6816/46601 conn(0x7f892c046010 legacy=0x7f892c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.081+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89400a6d60 msgr2=0x7f894014ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.081+0000 7f8945d2c700 1 --2- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89400a6d60 0x7f894014ef00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8934009290 tx=0x7f8934017000 comp rx=0 tx=0).stop 2024-04-18T10:38:36.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.081+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 shutdown_connections 2024-04-18T10:38:36.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.081+0000 7f8945d2c700 1 --2- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89400a7130 0x7f894014f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.081+0000 7f8945d2c700 1 --2- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f894006ecf0 0x7f89400ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.081+0000 7f8945d2c700 1 --2- 172.21.15.31:0/3568432534 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89400a6d60 0x7f894014ef00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.082+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 >> 172.21.15.31:0/3568432534 conn(0x7f89400679e0 msgr2=0x7f89400b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:36.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.082+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 shutdown_connections 2024-04-18T10:38:36.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.082+0000 7f8945d2c700 1 -- 172.21.15.31:0/3568432534 wait complete. 2024-04-18T10:38:36.094 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:38:36.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.213+0000 7fb230049700 1 Processor -- start 2024-04-18T10:38:36.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb230049700 1 -- start start 2024-04-18T10:38:36.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb230049700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb228069200 0x7fb22806eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb230049700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2280af640 0x7fb2280679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb230049700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2280a33d0 con 0x7fb228067f20 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb230049700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280a3d60 con 0x7fb228069200 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb230049700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280a3670 con 0x7fb2280af640 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb22dde5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb228069200 0x7fb22806eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb22dde5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb228069200 0x7fb22806eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34946/0 (socket says 172.21.15.31:34946) 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb22e5e6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb228067f20 0x7fb228148630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45208/0 (socket says 172.21.15.31:45208) 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb22dde5700 1 -- 172.21.15.31:0/2511635679 learned_addr learned my addr 172.21.15.31:0/2511635679 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.214+0000 7fb22d5e4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2280af640 0x7fb2280679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22dde5700 1 -- 172.21.15.31:0/2511635679 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2280af640 msgr2=0x7fb2280679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22dde5700 1 --2- 172.21.15.31:0/2511635679 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2280af640 0x7fb2280679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22dde5700 1 -- 172.21.15.31:0/2511635679 >> v1:172.21.15.31:6789/0 conn(0x7fb228067f20 legacy=0x7fb228148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22cde3700 1 -- 172.21.15.31:0/2511635679 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628951289 0 0) 0x7fb2280a33d0 con 0x7fb228067f20 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22dde5700 1 -- 172.21.15.31:0/2511635679 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280a27f0 con 0x7fb228069200 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22d5e4700 1 --2- 172.21.15.31:0/2511635679 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2280af640 0x7fb2280679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:36.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22dde5700 1 --2- 172.21.15.31:0/2511635679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb228069200 0x7fb22806eea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb218009a10 tx=0x7fb218009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fa772ce9628e806 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:36.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22cde3700 1 -- 172.21.15.31:0/2511635679 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21800b820 con 0x7fb228069200 2024-04-18T10:38:36.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22cde3700 1 -- 172.21.15.31:0/2511635679 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21800b980 con 0x7fb228069200 2024-04-18T10:38:36.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb22cde3700 1 -- 172.21.15.31:0/2511635679 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21800bd20 con 0x7fb228069200 2024-04-18T10:38:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb230049700 1 -- 172.21.15.31:0/2511635679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb228069200 msgr2=0x7fb22806eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.215+0000 7fb230049700 1 --2- 172.21.15.31:0/2511635679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb228069200 0x7fb22806eea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb218009a10 tx=0x7fb218009250 comp rx=0 tx=0).stop 2024-04-18T10:38:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.216+0000 7fb230049700 1 -- 172.21.15.31:0/2511635679 shutdown_connections 2024-04-18T10:38:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.216+0000 7fb230049700 1 --2- 172.21.15.31:0/2511635679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb228069200 0x7fb22806eea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.216+0000 7fb230049700 1 --2- 172.21.15.31:0/2511635679 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb2280af640 0x7fb2280679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.216+0000 7fb230049700 1 -- 172.21.15.31:0/2511635679 >> 172.21.15.31:0/2511635679 conn(0x7fb22806af40 msgr2=0x7fb228068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.216+0000 7fb230049700 1 -- 172.21.15.31:0/2511635679 shutdown_connections 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.216+0000 7fb230049700 1 -- 172.21.15.31:0/2511635679 wait complete. 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb230049700 1 Processor -- start 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb230049700 1 -- start start 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb230049700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb228067f20 0x7fb228151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb230049700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb228069200 0x7fb228151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb230049700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2280af640 0x7fb2281521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb230049700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280a1b20 con 0x7fb228067f20 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb230049700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb228097c80 con 0x7fb2280af640 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb230049700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2280ab130 con 0x7fb228069200 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb22dde5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb228067f20 0x7fb228151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb22e5e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2280af640 0x7fb2281521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb22d5e4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb228069200 0x7fb228151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb22d5e4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb228069200 0x7fb228151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54348/0 (socket says 172.21.15.31:54348) 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb22e5e6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2280af640 0x7fb2281521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34954/0 (socket says 172.21.15.31:34954) 2024-04-18T10:38:36.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb22d5e4700 1 -- 172.21.15.31:0/2633305083 learned_addr learned my addr 172.21.15.31:0/2633305083 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.217+0000 7fb22dde5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb228067f20 0x7fb228151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40318/0 (socket says 172.21.15.31:40318) 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb22dde5700 1 -- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb228069200 msgr2=0x7fb228151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb22dde5700 1 --2- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb228069200 0x7fb228151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb22dde5700 1 -- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2280af640 msgr2=0x7fb2281521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb22dde5700 1 --2- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2280af640 0x7fb2281521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb22dde5700 1 -- 172.21.15.31:0/2633305083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224009420 con 0x7fb228067f20 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb22d5e4700 1 --2- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb228069200 0x7fb228151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb22e5e6700 1 --2- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2280af640 0x7fb2281521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb22dde5700 1 --2- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb228067f20 0x7fb228151720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb218016000 tx=0x7fb218017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb21dffb700 1 -- 172.21.15.31:0/2633305083 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21801f070 con 0x7fb228067f20 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb21dffb700 1 -- 172.21.15.31:0/2633305083 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb218011d30 con 0x7fb228067f20 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2180094f0 con 0x7fb228067f20 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb21dffb700 1 -- 172.21.15.31:0/2633305083 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21800b820 con 0x7fb228067f20 2024-04-18T10:38:36.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.218+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2280ad470 con 0x7fb228067f20 2024-04-18T10:38:36.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.219+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22806f220 con 0x7fb228067f20 2024-04-18T10:38:36.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.219+0000 7fb21dffb700 1 -- 172.21.15.31:0/2633305083 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fb21801a8a0 con 0x7fb228067f20 2024-04-18T10:38:36.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.220+0000 7fb21dffb700 1 -- 172.21.15.31:0/2633305083 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fb21805c130 con 0x7fb228067f20 2024-04-18T10:38:36.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.223+0000 7fb21dffb700 1 -- 172.21.15.31:0/2633305083 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fb21802c940 con 0x7fb228067f20 2024-04-18T10:38:36.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.415+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2280651b0 con 0x7fb228067f20 2024-04-18T10:38:36.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.416+0000 7fb21dffb700 1 -- 172.21.15.31:0/2633305083 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+3663 (secure 0 0 0) 0x7fb218015090 con 0x7fb228067f20 2024-04-18T10:38:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:36.417 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3984682861","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3984682861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:56.046578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14141},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:38:36.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.417+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 >> v1:172.21.15.31:6816/46601 conn(0x7fb20c046010 legacy=0x7fb20c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.417+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb228067f20 msgr2=0x7fb228151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.417+0000 7fb230049700 1 --2- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb228067f20 0x7fb228151720 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb218016000 tx=0x7fb218017000 comp rx=0 tx=0).stop 2024-04-18T10:38:36.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.418+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 shutdown_connections 2024-04-18T10:38:36.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.418+0000 7fb230049700 1 --2- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb2280af640 0x7fb2281521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.418+0000 7fb230049700 1 --2- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb228067f20 0x7fb228151720 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.418+0000 7fb230049700 1 --2- 172.21.15.31:0/2633305083 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb228069200 0x7fb228151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.418+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 >> 172.21.15.31:0/2633305083 conn(0x7fb22806af40 msgr2=0x7fb2280b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:36.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.418+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 shutdown_connections 2024-04-18T10:38:36.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.418+0000 7fb230049700 1 -- 172.21.15.31:0/2633305083 wait complete. 2024-04-18T10:38:36.419 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-18T10:38:36.431 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:36.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a25935700 1 Processor -- start 2024-04-18T10:38:36.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a25935700 1 -- start start 2024-04-18T10:38:36.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a25935700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a25935700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 0x7f4a200a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a25935700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a200aa260 con 0x7f4a2013ea30 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a25935700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200a7e20 con 0x7f4a2013eea0 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a25935700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200a9d60 con 0x7f4a20063f70 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a1effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a1f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 0x7f4a200a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a1e7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4a2013ea30 0x7f4a200a5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45218/0 (socket says 172.21.15.31:45218) 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.551+0000 7f4a1e7fc700 1 -- 172.21.15.31:0/3473509026 learned_addr learned my addr 172.21.15.31:0/3473509026 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1dffb700 1 -- 172.21.15.31:0/3473509026 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994534980 0 0) 0x7f4a200aa260 con 0x7f4a2013ea30 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1f7fe700 1 -- 172.21.15.31:0/3473509026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 msgr2=0x7f4a200a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1f7fe700 1 --2- 172.21.15.31:0/3473509026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200a78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1f7fe700 1 -- 172.21.15.31:0/3473509026 >> v1:172.21.15.31:6789/0 conn(0x7f4a2013ea30 legacy=0x7f4a200a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1f7fe700 1 -- 172.21.15.31:0/3473509026 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200a6de0 con 0x7f4a2013eea0 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1effd700 1 --2- 172.21.15.31:0/3473509026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1f7fe700 1 --2- 172.21.15.31:0/3473509026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 0x7f4a200a5a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009e90 tx=0x7f4a18009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6973e71acb03208 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:36.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1dffb700 1 -- 172.21.15.31:0/3473509026 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800e070 con 0x7f4a2013eea0 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1dffb700 1 -- 172.21.15.31:0/3473509026 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1800bc30 con 0x7f4a2013eea0 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.552+0000 7f4a1dffb700 1 -- 172.21.15.31:0/3473509026 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18012430 con 0x7f4a2013eea0 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.553+0000 7f4a25935700 1 -- 172.21.15.31:0/3473509026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 msgr2=0x7f4a200a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.553+0000 7f4a25935700 1 --2- 172.21.15.31:0/3473509026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 0x7f4a200a5a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009e90 tx=0x7f4a18009780 comp rx=0 tx=0).stop 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.553+0000 7f4a25935700 1 -- 172.21.15.31:0/3473509026 shutdown_connections 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.553+0000 7f4a25935700 1 --2- 172.21.15.31:0/3473509026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 0x7f4a200a5a90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.553+0000 7f4a25935700 1 --2- 172.21.15.31:0/3473509026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.553+0000 7f4a25935700 1 -- 172.21.15.31:0/3473509026 >> 172.21.15.31:0/3473509026 conn(0x7f4a2006f110 msgr2=0x7f4a20063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.553+0000 7f4a25935700 1 -- 172.21.15.31:0/3473509026 shutdown_connections 2024-04-18T10:38:36.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.553+0000 7f4a25935700 1 -- 172.21.15.31:0/3473509026 wait complete. 2024-04-18T10:38:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.554+0000 7f4a25935700 1 Processor -- start 2024-04-18T10:38:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.554+0000 7f4a25935700 1 -- start start 2024-04-18T10:38:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.554+0000 7f4a25935700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a25935700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2013ea30 0x7f4a200abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a25935700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 0x7f4a200ac420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a25935700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200afd90 con 0x7f4a2013ea30 2024-04-18T10:38:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a25935700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200aee40 con 0x7f4a2013eea0 2024-04-18T10:38:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a25935700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200ad9e0 con 0x7f4a20063f70 2024-04-18T10:38:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2013ea30 0x7f4a200abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54364/0 (socket says 172.21.15.31:54364) 2024-04-18T10:38:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1effd700 1 -- 172.21.15.31:0/487211223 learned_addr learned my addr 172.21.15.31:0/487211223 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1f7fe700 1 --2- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 0x7f4a200ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1effd700 1 -- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 msgr2=0x7f4a200ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1effd700 1 --2- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 0x7f4a200ac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1effd700 1 -- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2013ea30 msgr2=0x7f4a200abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1effd700 1 --2- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2013ea30 0x7f4a200abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1effd700 1 -- 172.21.15.31:0/487211223 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10009420 con 0x7f4a20063f70 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1e7fc700 1 --2- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2013ea30 0x7f4a200abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a1effd700 1 --2- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200b0750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000ec80 tx=0x7f4a100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a06ffd700 1 -- 172.21.15.31:0/487211223 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000c920 con 0x7f4a20063f70 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a06ffd700 1 -- 172.21.15.31:0/487211223 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1000ca80 con 0x7f4a20063f70 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a18009a20 con 0x7f4a20063f70 2024-04-18T10:38:36.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a06ffd700 1 -- 172.21.15.31:0/487211223 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000ce00 con 0x7f4a20063f70 2024-04-18T10:38:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.555+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a200afff0 con 0x7f4a20063f70 2024-04-18T10:38:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.556+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a200b1bb0 con 0x7f4a20063f70 2024-04-18T10:38:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.556+0000 7f4a06ffd700 1 -- 172.21.15.31:0/487211223 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f4a10013680 con 0x7f4a20063f70 2024-04-18T10:38:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.557+0000 7f4a06ffd700 1 -- 172.21.15.31:0/487211223 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f4a1005b570 con 0x7f4a20063f70 2024-04-18T10:38:36.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.560+0000 7f4a06ffd700 1 -- 172.21.15.31:0/487211223 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4a200b1bb0 con 0x7f4a20063f70 2024-04-18T10:38:36.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.725+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a200af9f0 con 0x7f4a20063f70 2024-04-18T10:38:36.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.726+0000 7f4a06ffd700 1 -- 172.21.15.31:0/487211223 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+11533 (secure 0 0 0) 0x7f4a10039760 con 0x7f4a20063f70 2024-04-18T10:38:36.726 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:36.726 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:32.400116+0000","last_up_change":"2024-04-18T10:35:55.406271+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:36.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.727+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 >> v1:172.21.15.31:6816/46601 conn(0x7f4a0c046010 legacy=0x7f4a0c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.727+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 msgr2=0x7f4a200b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.727+0000 7f4a25935700 1 --2- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200b0750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000ec80 tx=0x7f4a100091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.728+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 shutdown_connections 2024-04-18T10:38:36.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.728+0000 7f4a25935700 1 --2- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4a20063f70 0x7f4a200b0750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.728+0000 7f4a25935700 1 --2- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4a2013eea0 0x7f4a200ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.728+0000 7f4a25935700 1 --2- 172.21.15.31:0/487211223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2013ea30 0x7f4a200abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.728+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 >> 172.21.15.31:0/487211223 conn(0x7f4a2006f110 msgr2=0x7f4a2013ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:36.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.728+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 shutdown_connections 2024-04-18T10:38:36.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.728+0000 7f4a25935700 1 -- 172.21.15.31:0/487211223 wait complete. 2024-04-18T10:38:36.740 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:38:36.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.859+0000 7f014c651700 1 Processor -- start 2024-04-18T10:38:36.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.859+0000 7f014c651700 1 -- start start 2024-04-18T10:38:36.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f014c651700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 0x7f01440a3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f014c651700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144067e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f014c651700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01440a3b50 con 0x7f0144068370 2024-04-18T10:38:36.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f014c651700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0144068810 con 0x7f0144069200 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f014c651700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01440a45d0 con 0x7f01440679e0 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f0149bec700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f014abee700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0144068370 0x7f0144148630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45222/0 (socket says 172.21.15.31:45222) 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f014a3ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 0x7f01440a3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f014abee700 1 -- 172.21.15.31:0/3022103734 learned_addr learned my addr 172.21.15.31:0/3022103734 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f0149bec700 1 -- 172.21.15.31:0/3022103734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 msgr2=0x7f01440a3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f01493eb700 1 -- 172.21.15.31:0/3022103734 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19837026 0 0) 0x7f01440a3b50 con 0x7f0144068370 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f0149bec700 1 --2- 172.21.15.31:0/3022103734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 0x7f01440a3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f0149bec700 1 -- 172.21.15.31:0/3022103734 >> v1:172.21.15.31:6789/0 conn(0x7f0144068370 legacy=0x7f0144148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.860+0000 7f0149bec700 1 -- 172.21.15.31:0/3022103734 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014406e070 con 0x7f01440679e0 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.861+0000 7f014a3ed700 1 --2- 172.21.15.31:0/3022103734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 0x7f01440a3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.861+0000 7f0149bec700 1 --2- 172.21.15.31:0/3022103734 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144067e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0140009910 tx=0x7f01400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54858efd46c86b13 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.861+0000 7f01493eb700 1 -- 172.21.15.31:0/3022103734 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014000b680 con 0x7f01440679e0 2024-04-18T10:38:36.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.861+0000 7f01493eb700 1 -- 172.21.15.31:0/3022103734 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014000b7e0 con 0x7f01440679e0 2024-04-18T10:38:36.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.861+0000 7f01493eb700 1 -- 172.21.15.31:0/3022103734 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014000bba0 con 0x7f01440679e0 2024-04-18T10:38:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.861+0000 7f014c651700 1 -- 172.21.15.31:0/3022103734 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 msgr2=0x7f0144067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.861+0000 7f014c651700 1 --2- 172.21.15.31:0/3022103734 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144067e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0140009910 tx=0x7f01400091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.862+0000 7f014c651700 1 -- 172.21.15.31:0/3022103734 shutdown_connections 2024-04-18T10:38:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.862+0000 7f014c651700 1 --2- 172.21.15.31:0/3022103734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 0x7f01440a3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.862+0000 7f014c651700 1 --2- 172.21.15.31:0/3022103734 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144067e30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.862+0000 7f014c651700 1 -- 172.21.15.31:0/3022103734 >> 172.21.15.31:0/3022103734 conn(0x7f014406ae80 msgr2=0x7f0144068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.862+0000 7f014c651700 1 -- 172.21.15.31:0/3022103734 shutdown_connections 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.862+0000 7f014c651700 1 -- 172.21.15.31:0/3022103734 wait complete. 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.862+0000 7f014c651700 1 Processor -- start 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014c651700 1 -- start start 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014c651700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144097b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014c651700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0144068370 0x7f0144098e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014c651700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 0x7f014414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014c651700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0144098650 con 0x7f0144068370 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014c651700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440980d0 con 0x7f0144069200 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014c651700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f014414df00 con 0x7f01440679e0 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014a3ed700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144097b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014abee700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 0x7f014414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f0149bec700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0144068370 0x7f0144098e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014a3ed700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144097b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54378/0 (socket says 172.21.15.31:54378) 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014a3ed700 1 -- 172.21.15.31:0/2367066130 learned_addr learned my addr 172.21.15.31:0/2367066130 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014a3ed700 1 -- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 msgr2=0x7f014414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014a3ed700 1 --2- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 0x7f014414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014a3ed700 1 -- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0144068370 msgr2=0x7f0144098e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014a3ed700 1 --2- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0144068370 0x7f0144098e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.863+0000 7f014a3ed700 1 -- 172.21.15.31:0/2367066130 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138009420 con 0x7f01440679e0 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.864+0000 7f014a3ed700 1 --2- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144097b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f013800ec80 tx=0x7f01380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.864+0000 7f01367fc700 1 -- 172.21.15.31:0/2367066130 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800c850 con 0x7f01440679e0 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.864+0000 7f01367fc700 1 -- 172.21.15.31:0/2367066130 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013800c9b0 con 0x7f01440679e0 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.864+0000 7f01367fc700 1 -- 172.21.15.31:0/2367066130 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013800cd30 con 0x7f01440679e0 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.864+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140009420 con 0x7f01440679e0 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.864+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014414dbf0 con 0x7f01440679e0 2024-04-18T10:38:36.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.865+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01440979e0 con 0x7f01440679e0 2024-04-18T10:38:36.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.865+0000 7f01367fc700 1 -- 172.21.15.31:0/2367066130 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f0138013680 con 0x7f01440679e0 2024-04-18T10:38:36.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.865+0000 7f01367fc700 1 -- 172.21.15.31:0/2367066130 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f013805b400 con 0x7f01440679e0 2024-04-18T10:38:36.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:36.869+0000 7f01367fc700 1 -- 172.21.15.31:0/2367066130 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f01380395f0 con 0x7f01440679e0 2024-04-18T10:38:37.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.060+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01440651b0 con 0x7f01440679e0 2024-04-18T10:38:37.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.061+0000 7f01367fc700 1 -- 172.21.15.31:0/2367066130 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+3663 (secure 0 0 0) 0x7f0138021070 con 0x7f01440679e0 2024-04-18T10:38:37.061 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:37.061 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4684,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3984682861","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3984682861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":14135,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.31:6818/189836504","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":189836504}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:36:56.046578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14141},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14141":{"gid":14141,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/3321563080","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":3321563080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:38:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 >> v1:172.21.15.31:6816/46601 conn(0x7f0128046010 legacy=0x7f01280484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 msgr2=0x7f0144097b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 --2- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144097b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f013800ec80 tx=0x7f01380091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 shutdown_connections 2024-04-18T10:38:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 --2- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01440679e0 0x7f0144097b90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 --2- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0144069200 0x7f014414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 --2- 172.21.15.31:0/2367066130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0144068370 0x7f0144098e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 >> 172.21.15.31:0/2367066130 conn(0x7f014406ae80 msgr2=0x7f0144143c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 shutdown_connections 2024-04-18T10:38:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.062+0000 7f014c651700 1 -- 172.21.15.31:0/2367066130 wait complete. 2024-04-18T10:38:37.064 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 12 2024-04-18T10:38:37.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:36:56.046578+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14141}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_14141': {'gid': 14141, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/3321563080', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 3321563080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:38:37.378 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-18T10:38:37.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-18T10:38:37.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.503+0000 7fdb82ba4700 1 Processor -- start 2024-04-18T10:38:37.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.503+0000 7fdb82ba4700 1 -- start start 2024-04-18T10:38:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb82ba4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c0680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb82ba4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb7c068630 0x7fdb7c1495d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb82ba4700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb7c0a23b0 con 0x7fdb7c069200 2024-04-18T10:38:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb82ba4700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb7c06b640 con 0x7fdb7c068630 2024-04-18T10:38:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb82ba4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c0a39c0 con 0x7fdb7c0a3270 2024-04-18T10:38:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c0680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb81141700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb7c068630 0x7fdb7c1495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb81141700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb7c068630 0x7fdb7c1495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40346/0 (socket says 172.21.15.31:40346) 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c0680f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34990/0 (socket says 172.21.15.31:34990) 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb81141700 1 -- 172.21.15.31:0/2684252224 learned_addr learned my addr 172.21.15.31:0/2684252224 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb80940700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdb7c069200 0x7fdb7c0679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45226/0 (socket says 172.21.15.31:45226) 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb7bfff700 1 -- 172.21.15.31:0/2684252224 >> v2:172.21.15.31:3300/0 conn(0x7fdb7c068630 msgr2=0x7fdb7c1495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/2684252224 >> v2:172.21.15.31:3300/0 conn(0x7fdb7c068630 0x7fdb7c1495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb7bfff700 1 -- 172.21.15.31:0/2684252224 >> v1:172.21.15.31:6789/0 conn(0x7fdb7c069200 legacy=0x7fdb7c0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb7bfff700 1 -- 172.21.15.31:0/2684252224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c0a4720 con 0x7fdb7c0a3270 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.504+0000 7fdb81141700 1 --2- 172.21.15.31:0/2684252224 >> v2:172.21.15.31:3300/0 conn(0x7fdb7c068630 0x7fdb7c1495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/2684252224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c0680f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb680098e0 tx=0x7fdb680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395e18d8bbeaf7df server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb7b7fe700 1 -- 172.21.15.31:0/2684252224 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800b640 con 0x7fdb7c0a3270 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb7b7fe700 1 -- 172.21.15.31:0/2684252224 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6800b7a0 con 0x7fdb7c0a3270 2024-04-18T10:38:37.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb7b7fe700 1 -- 172.21.15.31:0/2684252224 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800bb40 con 0x7fdb7c0a3270 2024-04-18T10:38:37.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb82ba4700 1 -- 172.21.15.31:0/2684252224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 msgr2=0x7fdb7c0680f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb82ba4700 1 --2- 172.21.15.31:0/2684252224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c0680f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdb680098e0 tx=0x7fdb680091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb82ba4700 1 -- 172.21.15.31:0/2684252224 shutdown_connections 2024-04-18T10:38:37.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb82ba4700 1 --2- 172.21.15.31:0/2684252224 >> v2:172.21.15.31:3300/0 conn(0x7fdb7c068630 0x7fdb7c1495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb82ba4700 1 --2- 172.21.15.31:0/2684252224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c0680f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb82ba4700 1 -- 172.21.15.31:0/2684252224 >> 172.21.15.31:0/2684252224 conn(0x7fdb7c06ad80 msgr2=0x7fdb7c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:37.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb82ba4700 1 -- 172.21.15.31:0/2684252224 shutdown_connections 2024-04-18T10:38:37.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.505+0000 7fdb82ba4700 1 -- 172.21.15.31:0/2684252224 wait complete. 2024-04-18T10:38:37.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.506+0000 7fdb82ba4700 1 Processor -- start 2024-04-18T10:38:37.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb82ba4700 1 -- start start 2024-04-18T10:38:37.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb82ba4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdb7c069200 0x7fdb7c097fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb82ba4700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c099020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb82ba4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7c13e550 0x7fdb7c13e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb82ba4700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c097470 con 0x7fdb7c13e550 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb82ba4700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c096a70 con 0x7fdb7c0a3270 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb82ba4700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c096d10 con 0x7fdb7c069200 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb80940700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdb7c069200 0x7fdb7c097fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb81141700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7c13e550 0x7fdb7c13e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c099020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb80940700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdb7c069200 0x7fdb7c097fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54384/0 (socket says 172.21.15.31:54384) 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb81141700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7c13e550 0x7fdb7c13e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40360/0 (socket says 172.21.15.31:40360) 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c099020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:34998/0 (socket says 172.21.15.31:34998) 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb80940700 1 -- 172.21.15.31:0/599184979 learned_addr learned my addr 172.21.15.31:0/599184979 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb7bfff700 1 -- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdb7c069200 msgr2=0x7fdb7c097fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdb7c069200 0x7fdb7c097fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb7bfff700 1 -- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7c13e550 msgr2=0x7fdb7c13e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7c13e550 0x7fdb7c13e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb7bfff700 1 -- 172.21.15.31:0/599184979 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74009ae0 con 0x7fdb7c0a3270 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.507+0000 7fdb80940700 1 --2- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdb7c069200 0x7fdb7c097fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.508+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c099020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c068a10 tx=0x7fdb68017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.508+0000 7fdb78ff9700 1 -- 172.21.15.31:0/599184979 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6801bc00 con 0x7fdb7c0a3270 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.508+0000 7fdb78ff9700 1 -- 172.21.15.31:0/599184979 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6801bd80 con 0x7fdb7c0a3270 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.508+0000 7fdb82ba4700 1 -- 172.21.15.31:0/599184979 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb68009420 con 0x7fdb7c0a3270 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.508+0000 7fdb78ff9700 1 -- 172.21.15.31:0/599184979 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68011670 con 0x7fdb7c0a3270 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.508+0000 7fdb82ba4700 1 -- 172.21.15.31:0/599184979 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c0ade30 con 0x7fdb7c0a3270 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.509+0000 7fdb78ff9700 1 -- 172.21.15.31:0/599184979 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fdb68011a20 con 0x7fdb7c0a3270 2024-04-18T10:38:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.509+0000 7fdb78ff9700 1 -- 172.21.15.31:0/599184979 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fdb6805c5e0 con 0x7fdb7c0a3270 2024-04-18T10:38:37.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.511+0000 7fdb8bebdb80 1 Processor -- start 2024-04-18T10:38:37.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.511+0000 7fdb8bebdb80 1 -- start start 2024-04-18T10:38:37.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee5067b0 con 0x55a8ee5b1150 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee504170 con 0x55a8ee5cec10 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee4fff60 con 0x55a8ee5b0a80 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb81141700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb81141700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5e40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40366/0 (socket says 172.21.15.31:40366) 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb81141700 1 -- 172.21.15.31:0/308862487 learned_addr learned my addr 172.21.15.31:0/308862487 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5e3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35000/0 (socket says 172.21.15.31:35000) 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb80940700 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb81141700 1 -- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 msgr2=0x55a8ee5af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb81141700 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb81141700 1 -- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 msgr2=0x55a8ee5e3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb81141700 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5e3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb81141700 1 -- 172.21.15.31:0/308862487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8ee37c040 con 0x55a8ee5b1150 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5e3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.512+0000 7fdb80940700 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb81141700 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5e40a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb74011560 tx=0x7fdb7400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fc5e89ed5706b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb65ffb700 1 -- 172.21.15.31:0/308862487 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400e040 con 0x55a8ee5b1150 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb65ffb700 1 -- 172.21.15.31:0/308862487 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7400f040 con 0x55a8ee5b1150 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb65ffb700 1 -- 172.21.15.31:0/308862487 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74015430 con 0x55a8ee5b1150 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 msgr2=0x55a8ee5e40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5e40a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb74011560 tx=0x7fdb7400b040 comp rx=0 tx=0).stop 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/308862487 shutdown_connections 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5e40a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/308862487 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5e3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/308862487 >> 172.21.15.31:0/308862487 conn(0x55a8ee5ae3a0 msgr2=0x55a8ee5b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/308862487 shutdown_connections 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.513+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/308862487 wait complete. 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.514+0000 7fdb8bebdb80 1 -- start start 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.514+0000 7fdb8bebdb80 1 Processor -- start 2024-04-18T10:38:37.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5db6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5cd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee4aad70 con 0x55a8ee5b1150 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee4aaa10 con 0x55a8ee5cec10 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee3f8290 con 0x55a8ee5b0a80 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb8bebdb80 10 client.0 _ll_register_callbacks cb 0x55a8ee4ace30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb80940700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5db6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40382/0 (socket says 172.21.15.31:40382) 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb80940700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5db6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54390/0 (socket says 172.21.15.31:54390) 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb7bfff700 1 -- 172.21.15.31:0/532552201 learned_addr learned my addr 172.21.15.31:0/532552201 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb81141700 1 --2- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb7bfff700 1 -- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 msgr2=0x55a8ee5db6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5db6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb7bfff700 1 -- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 msgr2=0x55a8ee5cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb7bfff700 1 -- 172.21.15.31:0/532552201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c0ade30 con 0x55a8ee5b1150 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb80940700 1 --2- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5db6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5cd650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdb680030c0 tx=0x7fdb68027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5758b5f9a4eef6d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb5affd700 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb5affd700 1 -- 172.21.15.31:0/532552201 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68046040 con 0x55a8ee5b1150 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb5affd700 1 -- 172.21.15.31:0/532552201 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fdb68026de0 con 0x55a8ee5b1150 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.515+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/532552201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8ee529690 con 0x55a8ee5b1150 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb5affd700 1 -- 172.21.15.31:0/532552201 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb6803d620 con 0x55a8ee5b1150 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb8bebdb80 10 client.24411 fetch_fsmap learned FSMap version 12 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/532552201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=3+}) v3 -- 0x7fdb74011290 con 0x55a8ee5b1150 2024-04-18T10:38:37.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb5affd700 1 -- 172.21.15.31:0/532552201 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8ee529690 con 0x55a8ee5b1150 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb5affd700 1 -- 172.21.15.31:0/532552201 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 12) v1 ==== 2454+0+0 (secure 0 0 0) 0x7fdb6803d780 con 0x55a8ee5b1150 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb8bebdb80 10 client.24411 fetch_fsmap finished waiting for FSMap version 12 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb8bebdb80 10 client.24411 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb8bebdb80 20 client.24411 populate_metadata read hostname 'smithi031' 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb8bebdb80 4 client.24411 mds_command: new command op to 14141 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/532552201 --> v1:172.21.15.31:6819/3321563080 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8ee4a20e0 con 0x55a8ee5d53f0 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.516+0000 7fdb5affd700 10 client.24411 ms_handle_connect on v1:172.21.15.31:6819/3321563080 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb5affd700 1 -- 172.21.15.31:0/532552201 <== mds.0 v1:172.21.15.31:6819/3321563080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55a8ee4a20e0 con 0x55a8ee5d53f0 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb5affd700 10 client.24411 handle_command_reply: tid=0 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 client.24411 shutdown 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 msgr2=0x55a8ee5cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5cd650 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdb680030c0 tx=0x7fdb68027000 comp rx=0 tx=0).stop 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/532552201 shutdown_connections 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5db6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5cec10 0x55a8ee5cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/532552201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5cd650 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb5affd700 0 client.24411 ms_handle_reset on v1:172.21.15.31:6819/3321563080 2024-04-18T10:38:37.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/532552201 >> 172.21.15.31:0/532552201 conn(0x55a8ee5ae3a0 msgr2=0x55a8ee5abfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:37.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/532552201 shutdown_connections 2024-04-18T10:38:37.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/532552201 wait complete. 2024-04-18T10:38:37.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.517+0000 7fdb8bebdb80 20 client.24411 trim_cache size 0 max 16384 2024-04-18T10:38:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.534+0000 7fdb8bebdb80 1 Processor -- start 2024-04-18T10:38:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.534+0000 7fdb8bebdb80 1 -- start start 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5d57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b1150 0x55a8ee5cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5cec10 0x55a8ee5cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee5afb90 con 0x55a8ee5cec10 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee5d0190 con 0x55a8ee5b1150 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee4a20e0 con 0x55a8ee5b0a80 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb81141700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5cec10 0x55a8ee5cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b1150 0x55a8ee5cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb80940700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5d57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb81141700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5cec10 0x55a8ee5cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40390/0 (socket says 172.21.15.31:40390) 2024-04-18T10:38:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb81141700 1 -- 172.21.15.31:0/1335372333 learned_addr learned my addr 172.21.15.31:0/1335372333 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb81141700 1 -- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 msgr2=0x55a8ee5d57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb81141700 1 --2- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5d57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb81141700 1 -- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b1150 msgr2=0x55a8ee5cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb81141700 1 --2- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b1150 0x55a8ee5cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb81141700 1 -- 172.21.15.31:0/1335372333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8ee33e230 con 0x55a8ee5cec10 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b1150 0x55a8ee5cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb80940700 1 --2- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5d57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb81141700 1 --2- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5cec10 0x55a8ee5cdac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb74017000 tx=0x7fdb7401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac49ead9a0aae79 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb667fc700 1 -- 172.21.15.31:0/1335372333 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74024070 con 0x55a8ee5cec10 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb667fc700 1 -- 172.21.15.31:0/1335372333 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb74000f40 con 0x55a8ee5cec10 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.535+0000 7fdb667fc700 1 -- 172.21.15.31:0/1335372333 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7400e040 con 0x55a8ee5cec10 2024-04-18T10:38:37.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5cec10 msgr2=0x55a8ee5cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5cec10 0x55a8ee5cdac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb74017000 tx=0x7fdb7401a000 comp rx=0 tx=0).stop 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/1335372333 shutdown_connections 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5b0a80 0x55a8ee5d57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5cec10 0x55a8ee5cdac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/1335372333 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b1150 0x55a8ee5cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/1335372333 >> 172.21.15.31:0/1335372333 conn(0x55a8ee5ae3a0 msgr2=0x55a8ee5db350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/1335372333 shutdown_connections 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/1335372333 wait complete. 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.536+0000 7fdb8bebdb80 1 -- start start 2024-04-18T10:38:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb8bebdb80 1 Processor -- start 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b0a80 0x55a8ee5d85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5fd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb8bebdb80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5cec10 0x55a8ee5fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee5f0f10 con 0x55a8ee5b1150 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee5f11d0 con 0x55a8ee5b0a80 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb8bebdb80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a8ee5f14a0 con 0x55a8ee5cec10 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb8bebdb80 10 client.0 _ll_register_callbacks cb 0x55a8ee4ace30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb81141700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5cec10 0x55a8ee5fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb81141700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5cec10 0x55a8ee5fd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54400/0 (socket says 172.21.15.31:54400) 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb7bfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40402/0 (socket says 172.21.15.31:40402) 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb81141700 1 -- 172.21.15.31:0/85217815 learned_addr learned my addr 172.21.15.31:0/85217815 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.537+0000 7fdb80940700 1 --2- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b0a80 0x55a8ee5d85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb81141700 1 -- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b0a80 msgr2=0x55a8ee5d85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb81141700 1 --2- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b0a80 0x55a8ee5d85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb81141700 1 -- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 msgr2=0x55a8ee5fd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb81141700 1 --2- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5fd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb81141700 1 -- 172.21.15.31:0/85217815 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7000f040 con 0x55a8ee5cec10 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb7bfff700 1 --2- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb81141700 1 --2- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5cec10 0x55a8ee5fd760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb740072f0 tx=0x7fdb74024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c2dca1693e3d83 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb5affd700 10 client.0 ms_handle_connect on v2:172.21.15.31:3302/0 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb5affd700 1 -- 172.21.15.31:0/85217815 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7402f070 con 0x55a8ee5cec10 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb5affd700 1 -- 172.21.15.31:0/85217815 <== mon.2 v2:172.21.15.31:3302/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fdb74015430 con 0x55a8ee5cec10 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/85217815 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8ee5a7770 con 0x55a8ee5cec10 2024-04-18T10:38:37.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb5affd700 1 -- 172.21.15.31:0/85217815 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb7400e040 con 0x55a8ee5cec10 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb8bebdb80 10 client.24350 fetch_fsmap learned FSMap version 12 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/85217815 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,fsmap=12,monmap=3+}) v3 -- 0x7fdb74011290 con 0x55a8ee5cec10 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb5affd700 1 -- 172.21.15.31:0/85217815 <== mon.2 v2:172.21.15.31:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7403b030 con 0x55a8ee5cec10 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb5affd700 1 -- 172.21.15.31:0/85217815 <== mon.2 v2:172.21.15.31:3302/0 5 ==== fsmap(e 12) v1 ==== 2454+0+0 (secure 0 0 0) 0x7fdb74034420 con 0x55a8ee5cec10 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb8bebdb80 10 client.24350 fetch_fsmap finished waiting for FSMap version 12 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb8bebdb80 10 client.24350 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb8bebdb80 20 client.24350 populate_metadata read hostname 'smithi031' 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb8bebdb80 4 client.24350 mds_command: new command op to 14141 tid=0[{"prefix": "status"}] 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.538+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/85217815 --> v1:172.21.15.31:6819/3321563080 -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fdb7400f040 con 0x55a8ee63c2a0 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb5affd700 10 client.24350 ms_handle_connect on v1:172.21.15.31:6819/3321563080 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb5affd700 1 -- 172.21.15.31:0/85217815 <== mds.0 v1:172.21.15.31:6819/3321563080 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+302 (unknown 0 0 2610871308) 0x7fdb7400f040 con 0x55a8ee63c2a0 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb5affd700 10 client.24350 handle_command_reply: tid=0 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 client.24350 shutdown 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5cec10 msgr2=0x55a8ee5fd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5cec10 0x55a8ee5fd760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb740072f0 tx=0x7fdb74024000 comp rx=0 tx=0).stop 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/85217815 shutdown_connections 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x55a8ee5cec10 0x55a8ee5fd760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x55a8ee5b0a80 0x55a8ee5d85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 --2- 172.21.15.31:0/85217815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a8ee5b1150 0x55a8ee5fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/85217815 >> 172.21.15.31:0/85217815 conn(0x55a8ee5ae3a0 msgr2=0x55a8ee5a6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb5affd700 0 client.24350 ms_handle_reset on v1:172.21.15.31:6819/3321563080 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/85217815 shutdown_connections 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.539+0000 7fdb8bebdb80 1 -- 172.21.15.31:0/85217815 wait complete. 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb8bebdb80 20 client.24350 trim_cache size 0 max 16384 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:38:37.546 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "2dc05854-5716-4ea6-add8-fd949f4dd05c", 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 14141, 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 148.551585364, 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 11, 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 23, 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 20, 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 156.90291089900001 2024-04-18T10:38:37.547 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:38:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 -- 172.21.15.31:0/599184979 >> v1:172.21.15.31:6816/46601 conn(0x7fdb60046040 legacy=0x7fdb600484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 -- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 msgr2=0x7fdb7c099020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 --2- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c099020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c068a10 tx=0x7fdb68017000 comp rx=0 tx=0).stop 2024-04-18T10:38:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 -- 172.21.15.31:0/599184979 shutdown_connections 2024-04-18T10:38:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 --2- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdb7c069200 0x7fdb7c097fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 --2- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7c13e550 0x7fdb7c13e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 --2- 172.21.15.31:0/599184979 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdb7c0a3270 0x7fdb7c099020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 -- 172.21.15.31:0/599184979 >> 172.21.15.31:0/599184979 conn(0x7fdb7c06ad80 msgr2=0x7fdb7c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:37.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 -- 172.21.15.31:0/599184979 shutdown_connections 2024-04-18T10:38:37.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.540+0000 7fdb82ba4700 1 -- 172.21.15.31:0/599184979 wait complete. 2024-04-18T10:38:37.552 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-04-18T10:38:37.563 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-18T10:38:37.563 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:37.593 INFO:tasks.ceph.osd.0:Stopped 2024-04-18T10:38:37.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2024-04-18T10:38:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.755+0000 7f9f4526c700 1 Processor -- start 2024-04-18T10:38:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.755+0000 7f9f4526c700 1 -- start start 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.755+0000 7f9f4526c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f400a2740 0x7f9f4013b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.755+0000 7f9f4526c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f4013b9d0 0x7f9f4013be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.755+0000 7f9f4526c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400a4160 con 0x7f9f400b5460 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f4526c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400a32c0 con 0x7f9f4013b9d0 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f4526c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400a1820 con 0x7f9f400a2740 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3f7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9f4013b9d0 0x7f9f4013be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3e7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f400a2740 0x7f9f4013b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3effd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9f400b5460 0x7f9f400a3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45230/0 (socket says 172.21.15.31:45230) 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3effd700 1 -- 172.21.15.31:0/3432373099 learned_addr learned my addr 172.21.15.31:0/3432373099 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3f7fe700 1 -- 172.21.15.31:0/3432373099 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f400a2740 msgr2=0x7f9f4013b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3f7fe700 1 --2- 172.21.15.31:0/3432373099 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f400a2740 0x7f9f4013b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3f7fe700 1 -- 172.21.15.31:0/3432373099 >> v1:172.21.15.31:6789/0 conn(0x7f9f400b5460 legacy=0x7f9f400a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3f7fe700 1 -- 172.21.15.31:0/3432373099 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400a1ae0 con 0x7f9f4013b9d0 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3dffb700 1 -- 172.21.15.31:0/3432373099 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620216021 0 0) 0x7f9f400a4160 con 0x7f9f400b5460 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3e7fc700 1 --2- 172.21.15.31:0/3432373099 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f400a2740 0x7f9f4013b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3f7fe700 1 --2- 172.21.15.31:0/3432373099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4013b9d0 0x7f9f4013be50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009e60 tx=0x7f9f38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75f076e22493fac server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3dffb700 1 -- 172.21.15.31:0/3432373099 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3800e070 con 0x7f9f4013b9d0 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3dffb700 1 -- 172.21.15.31:0/3432373099 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3800bb60 con 0x7f9f4013b9d0 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.756+0000 7f9f3dffb700 1 -- 172.21.15.31:0/3432373099 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38012430 con 0x7f9f4013b9d0 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.757+0000 7f9f4526c700 1 -- 172.21.15.31:0/3432373099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4013b9d0 msgr2=0x7f9f4013be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.757+0000 7f9f4526c700 1 --2- 172.21.15.31:0/3432373099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4013b9d0 0x7f9f4013be50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009e60 tx=0x7f9f38009780 comp rx=0 tx=0).stop 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.757+0000 7f9f4526c700 1 -- 172.21.15.31:0/3432373099 shutdown_connections 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.757+0000 7f9f4526c700 1 --2- 172.21.15.31:0/3432373099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4013b9d0 0x7f9f4013be50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.757+0000 7f9f4526c700 1 --2- 172.21.15.31:0/3432373099 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f400a2740 0x7f9f4013b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.757+0000 7f9f4526c700 1 -- 172.21.15.31:0/3432373099 >> 172.21.15.31:0/3432373099 conn(0x7f9f40068df0 msgr2=0x7f9f400691f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.757+0000 7f9f4526c700 1 -- 172.21.15.31:0/3432373099 shutdown_connections 2024-04-18T10:38:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.757+0000 7f9f4526c700 1 -- 172.21.15.31:0/3432373099 wait complete. 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.758+0000 7f9f4526c700 1 Processor -- start 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.758+0000 7f9f4526c700 1 -- start start 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f4526c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f400a2740 0x7f9f4013efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f4526c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f400b5460 0x7f9f4014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f4526c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f4013b9d0 0x7f9f4014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f4526c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f40097fe0 con 0x7f9f400a2740 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f4526c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4014daa0 con 0x7f9f400b5460 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f4526c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400999f0 con 0x7f9f4013b9d0 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f400b5460 0x7f9f4014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3effd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f400a2740 0x7f9f4013efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f4013b9d0 0x7f9f4014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f400b5460 0x7f9f4014ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35046/0 (socket says 172.21.15.31:35046) 2024-04-18T10:38:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3e7fc700 1 -- 172.21.15.31:0/2355024452 learned_addr learned my addr 172.21.15.31:0/2355024452 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3f7fe700 1 -- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f400b5460 msgr2=0x7f9f4014ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3f7fe700 1 --2- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f400b5460 0x7f9f4014ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3f7fe700 1 -- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f400a2740 msgr2=0x7f9f4013efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3f7fe700 1 --2- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f400a2740 0x7f9f4013efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3f7fe700 1 -- 172.21.15.31:0/2355024452 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f30009420 con 0x7f9f4013b9d0 2024-04-18T10:38:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3effd700 1 --2- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f400a2740 0x7f9f4013efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f3f7fe700 1 --2- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f4013b9d0 0x7f9f4014e410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f38016000 tx=0x7f9f38019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f26ffd700 1 -- 172.21.15.31:0/2355024452 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38027470 con 0x7f9f4013b9d0 2024-04-18T10:38:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f26ffd700 1 -- 172.21.15.31:0/2355024452 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380275d0 con 0x7f9f4013b9d0 2024-04-18T10:38:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f38009a20 con 0x7f9f4013b9d0 2024-04-18T10:38:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f26ffd700 1 -- 172.21.15.31:0/2355024452 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38027990 con 0x7f9f4013b9d0 2024-04-18T10:38:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.759+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4014e950 con 0x7f9f4013b9d0 2024-04-18T10:38:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.760+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f40064920 con 0x7f9f4013b9d0 2024-04-18T10:38:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.761+0000 7f9f26ffd700 1 -- 172.21.15.31:0/2355024452 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f9f38024070 con 0x7f9f4013b9d0 2024-04-18T10:38:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.761+0000 7f9f26ffd700 1 -- 172.21.15.31:0/2355024452 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f9f3805de70 con 0x7f9f4013b9d0 2024-04-18T10:38:37.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.764+0000 7f9f26ffd700 1 -- 172.21.15.31:0/2355024452 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f9f3800eb10 con 0x7f9f4013b9d0 2024-04-18T10:38:37.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:37.941+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f9f400a43b0 con 0x7f9f4013b9d0 2024-04-18T10:38:37.942 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-04-18T10:38:37.942+0000 7f4102766700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2024-04-18T10:38:38.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.451+0000 7f9f26ffd700 1 -- 172.21.15.31:0/2355024452 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7f9f3801fed0 con 0x7f9f4013b9d0 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 >> v1:172.21.15.31:6816/46601 conn(0x7f9f2c046010 legacy=0x7f9f2c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f4013b9d0 msgr2=0x7f9f4014e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 --2- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f4013b9d0 0x7f9f4014e410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f38016000 tx=0x7f9f38019000 comp rx=0 tx=0).stop 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 shutdown_connections 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 --2- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9f4013b9d0 0x7f9f4014e410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 --2- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f400a2740 0x7f9f4013efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 --2- 172.21.15.31:0/2355024452 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9f400b5460 0x7f9f4014ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 >> 172.21.15.31:0/2355024452 conn(0x7f9f40068df0 msgr2=0x7f9f400a39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 shutdown_connections 2024-04-18T10:38:38.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.455+0000 7f9f4526c700 1 -- 172.21.15.31:0/2355024452 wait complete. 2024-04-18T10:38:38.457 INFO:teuthology.orchestra.run.smithi031.stderr:marked down osd.0. 2024-04-18T10:38:38.470 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-18T10:38:38.470 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-18T10:38:38.472 INFO:tasks.ceph.osd.0:Started 2024-04-18T10:38:38.473 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-18T10:38:38.473 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:38.505 INFO:tasks.ceph.osd.1:Stopped 2024-04-18T10:38:38.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2024-04-18T10:38:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.667+0000 7f1c6a710700 1 Processor -- start 2024-04-18T10:38:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.667+0000 7f1c6a710700 1 -- start start 2024-04-18T10:38:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c6a710700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c640680f0 0x7f1c640a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c6a710700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c64069f20 0x7f1c6406f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c6a710700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6406a480 con 0x7f1c64069b50 2024-04-18T10:38:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c6a710700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c640a3430 con 0x7f1c64069f20 2024-04-18T10:38:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c6a710700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6406a720 con 0x7f1c640680f0 2024-04-18T10:38:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c640680f0 0x7f1c640a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c68cad700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1c64069f20 0x7f1c6406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c637fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1c64069b50 0x7f1c6406ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45260/0 (socket says 172.21.15.31:45260) 2024-04-18T10:38:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c637fe700 1 -- 172.21.15.31:0/2815364033 learned_addr learned my addr 172.21.15.31:0/2815364033 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c63fff700 1 -- 172.21.15.31:0/2815364033 >> v2:172.21.15.31:3300/0 conn(0x7f1c64069f20 msgr2=0x7f1c6406f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c63fff700 1 --2- 172.21.15.31:0/2815364033 >> v2:172.21.15.31:3300/0 conn(0x7f1c64069f20 0x7f1c6406f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c63fff700 1 -- 172.21.15.31:0/2815364033 >> v1:172.21.15.31:6789/0 conn(0x7f1c64069b50 legacy=0x7f1c6406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c62ffd700 1 -- 172.21.15.31:0/2815364033 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776027781 0 0) 0x7f1c6406a480 con 0x7f1c64069b50 2024-04-18T10:38:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c63fff700 1 -- 172.21.15.31:0/2815364033 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6406aa80 con 0x7f1c640680f0 2024-04-18T10:38:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.668+0000 7f1c68cad700 1 --2- 172.21.15.31:0/2815364033 >> v2:172.21.15.31:3300/0 conn(0x7f1c64069f20 0x7f1c6406f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c63fff700 1 --2- 172.21.15.31:0/2815364033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c640680f0 0x7f1c640a3b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c540098e0 tx=0x7f1c540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f3a12f63e7f0708 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c62ffd700 1 -- 172.21.15.31:0/2815364033 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400b640 con 0x7f1c640680f0 2024-04-18T10:38:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c62ffd700 1 -- 172.21.15.31:0/2815364033 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5400b7a0 con 0x7f1c640680f0 2024-04-18T10:38:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c62ffd700 1 -- 172.21.15.31:0/2815364033 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400bb40 con 0x7f1c640680f0 2024-04-18T10:38:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c6a710700 1 -- 172.21.15.31:0/2815364033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c640680f0 msgr2=0x7f1c640a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c6a710700 1 --2- 172.21.15.31:0/2815364033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c640680f0 0x7f1c640a3b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c540098e0 tx=0x7f1c540091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c6a710700 1 -- 172.21.15.31:0/2815364033 shutdown_connections 2024-04-18T10:38:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c6a710700 1 --2- 172.21.15.31:0/2815364033 >> v2:172.21.15.31:3300/0 conn(0x7f1c64069f20 0x7f1c6406f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c6a710700 1 --2- 172.21.15.31:0/2815364033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c640680f0 0x7f1c640a3b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c6a710700 1 -- 172.21.15.31:0/2815364033 >> 172.21.15.31:0/2815364033 conn(0x7f1c6406dd70 msgr2=0x7f1c640679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:38.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c6a710700 1 -- 172.21.15.31:0/2815364033 shutdown_connections 2024-04-18T10:38:38.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.669+0000 7f1c6a710700 1 -- 172.21.15.31:0/2815364033 wait complete. 2024-04-18T10:38:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.670+0000 7f1c6a710700 1 Processor -- start 2024-04-18T10:38:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.670+0000 7f1c6a710700 1 -- start start 2024-04-18T10:38:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c6a710700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c640680f0 0x7f1c640973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c6a710700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c64069b50 0x7f1c640ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c6a710700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c64069f20 0x7f1c64151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c6a710700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640aeea0 con 0x7f1c64069b50 2024-04-18T10:38:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c6a710700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64097fd0 con 0x7f1c64069f20 2024-04-18T10:38:38.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c6a710700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640aec00 con 0x7f1c640680f0 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c637fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c64069b50 0x7f1c640ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c63fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c640680f0 0x7f1c640973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c68cad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c64069f20 0x7f1c64151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c68cad700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c64069f20 0x7f1c64151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35066/0 (socket says 172.21.15.31:35066) 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c637fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c64069b50 0x7f1c640ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40446/0 (socket says 172.21.15.31:40446) 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c68cad700 1 -- 172.21.15.31:0/1969657675 learned_addr learned my addr 172.21.15.31:0/1969657675 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c63fff700 1 -- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c64069f20 msgr2=0x7f1c64151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c63fff700 1 --2- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c64069f20 0x7f1c64151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c63fff700 1 -- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c64069b50 msgr2=0x7f1c640ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c63fff700 1 --2- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c64069b50 0x7f1c640ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c63fff700 1 -- 172.21.15.31:0/1969657675 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c009a20 con 0x7f1c640680f0 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c68cad700 1 --2- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c64069f20 0x7f1c64151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.671+0000 7f1c637fe700 1 --2- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c64069b50 0x7f1c640ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:38.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.672+0000 7f1c63fff700 1 --2- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c640680f0 0x7f1c640973f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c54016000 tx=0x7f1c54017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.672+0000 7f1c5bfff700 1 -- 172.21.15.31:0/1969657675 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400bb20 con 0x7f1c640680f0 2024-04-18T10:38:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.672+0000 7f1c5bfff700 1 -- 172.21.15.31:0/1969657675 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54000c90 con 0x7f1c640680f0 2024-04-18T10:38:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.672+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c54009420 con 0x7f1c640680f0 2024-04-18T10:38:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.672+0000 7f1c5bfff700 1 -- 172.21.15.31:0/1969657675 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54011650 con 0x7f1c640680f0 2024-04-18T10:38:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.672+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c64096a70 con 0x7f1c640680f0 2024-04-18T10:38:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.673+0000 7f1c5bfff700 1 -- 172.21.15.31:0/1969657675 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f1c54011a00 con 0x7f1c640680f0 2024-04-18T10:38:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.673+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c640651b0 con 0x7f1c640680f0 2024-04-18T10:38:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.673+0000 7f1c5bfff700 1 -- 172.21.15.31:0/1969657675 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f1c5405c560 con 0x7f1c640680f0 2024-04-18T10:38:38.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.677+0000 7f1c5bfff700 1 -- 172.21.15.31:0/1969657675 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f1c54011cb0 con 0x7f1c640680f0 2024-04-18T10:38:38.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:38.858+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f1c640afaa0 con 0x7f1c640680f0 2024-04-18T10:38:38.858 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-04-18T10:38:38.858+0000 7f4102766700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2024-04-18T10:38:39.065 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:39.064+0000 7f71a6dc6540 -1 Falling back to public interface 2024-04-18T10:38:39.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.448+0000 7f1c5bfff700 1 -- 172.21.15.31:0/1969657675 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7f1c54015030 con 0x7f1c640680f0 2024-04-18T10:38:39.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.454+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 >> v1:172.21.15.31:6816/46601 conn(0x7f1c44046010 legacy=0x7f1c440484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.454+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c640680f0 msgr2=0x7f1c640973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.454+0000 7f1c6a710700 1 --2- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c640680f0 0x7f1c640973f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c54016000 tx=0x7f1c54017000 comp rx=0 tx=0).stop 2024-04-18T10:38:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.454+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 shutdown_connections 2024-04-18T10:38:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.454+0000 7f1c6a710700 1 --2- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1c640680f0 0x7f1c640973f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.454+0000 7f1c6a710700 1 --2- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1c64069f20 0x7f1c64151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.454+0000 7f1c6a710700 1 --2- 172.21.15.31:0/1969657675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c64069b50 0x7f1c640ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.454+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 >> 172.21.15.31:0/1969657675 conn(0x7f1c6406dd70 msgr2=0x7f1c640679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.455+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 shutdown_connections 2024-04-18T10:38:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.455+0000 7f1c6a710700 1 -- 172.21.15.31:0/1969657675 wait complete. 2024-04-18T10:38:39.460 INFO:teuthology.orchestra.run.smithi031.stderr:marked down osd.1. 2024-04-18T10:38:39.472 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-18T10:38:39.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-18T10:38:39.474 INFO:tasks.ceph.osd.1:Started 2024-04-18T10:38:39.475 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-18T10:38:39.475 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:39.498 INFO:tasks.ceph.osd.2:Stopped 2024-04-18T10:38:39.498 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2024-04-18T10:38:39.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.661+0000 7f6d33b82700 1 Processor -- start 2024-04-18T10:38:39.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.661+0000 7f6d33b82700 1 -- start start 2024-04-18T10:38:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d33b82700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a24f0 0x7f6d2c0a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d33b82700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6d2c0a31e0 0x7f6d2c1451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d33b82700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2c0a3c80 con 0x7f6d2c0a49a0 2024-04-18T10:38:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d33b82700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c06da50 con 0x7f6d2c0a31e0 2024-04-18T10:38:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d33b82700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c06dd10 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3211f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6d2c0a31e0 0x7f6d2c1451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3111d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6d2c0a49a0 0x7f6d2c141ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45266/0 (socket says 172.21.15.31:45266) 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3111d700 1 -- 172.21.15.31:0/339477546 learned_addr learned my addr 172.21.15.31:0/339477546 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3191e700 1 --2- 172.21.15.31:0/339477546 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a24f0 0x7f6d2c0a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3211f700 1 -- 172.21.15.31:0/339477546 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a24f0 msgr2=0x7f6d2c0a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3211f700 1 --2- 172.21.15.31:0/339477546 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a24f0 0x7f6d2c0a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3211f700 1 -- 172.21.15.31:0/339477546 >> v1:172.21.15.31:6789/0 conn(0x7f6d2c0a49a0 legacy=0x7f6d2c141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3091c700 1 -- 172.21.15.31:0/339477546 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660932717 0 0) 0x7f6d2c0a3c80 con 0x7f6d2c0a49a0 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3211f700 1 -- 172.21.15.31:0/339477546 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0a3920 con 0x7f6d2c0a31e0 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3191e700 1 --2- 172.21.15.31:0/339477546 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a24f0 0x7f6d2c0a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.662+0000 7f6d3211f700 1 --2- 172.21.15.31:0/339477546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a31e0 0x7f6d2c1451f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009e60 tx=0x7f6d24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d924997dff2347a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d3091c700 1 -- 172.21.15.31:0/339477546 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400e070 con 0x7f6d2c0a31e0 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d3091c700 1 -- 172.21.15.31:0/339477546 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2400bbf0 con 0x7f6d2c0a31e0 2024-04-18T10:38:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d3091c700 1 -- 172.21.15.31:0/339477546 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d24012430 con 0x7f6d2c0a31e0 2024-04-18T10:38:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d33b82700 1 -- 172.21.15.31:0/339477546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a31e0 msgr2=0x7f6d2c1451f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d33b82700 1 --2- 172.21.15.31:0/339477546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a31e0 0x7f6d2c1451f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009e60 tx=0x7f6d24009780 comp rx=0 tx=0).stop 2024-04-18T10:38:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d33b82700 1 -- 172.21.15.31:0/339477546 shutdown_connections 2024-04-18T10:38:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d33b82700 1 --2- 172.21.15.31:0/339477546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a31e0 0x7f6d2c1451f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d33b82700 1 --2- 172.21.15.31:0/339477546 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a24f0 0x7f6d2c0a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d33b82700 1 -- 172.21.15.31:0/339477546 >> 172.21.15.31:0/339477546 conn(0x7f6d2c068af0 msgr2=0x7f6d2c068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d33b82700 1 -- 172.21.15.31:0/339477546 shutdown_connections 2024-04-18T10:38:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.663+0000 7f6d33b82700 1 -- 172.21.15.31:0/339477546 wait complete. 2024-04-18T10:38:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.664+0000 7f6d33b82700 1 Processor -- start 2024-04-18T10:38:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.664+0000 7f6d33b82700 1 -- start start 2024-04-18T10:38:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d33b82700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a24f0 0x7f6d2c14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d33b82700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a31e0 0x7f6d2c13b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d33b82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d2c0a49a0 0x7f6d2c13bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d33b82700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0aa8e0 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d33b82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c14f370 con 0x7f6d2c0a49a0 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d33b82700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c14f630 con 0x7f6d2c0a31e0 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3191e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a24f0 0x7f6d2c14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3111d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a31e0 0x7f6d2c13b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3191e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a24f0 0x7f6d2c14ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40482/0 (socket says 172.21.15.31:40482) 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3211f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d2c0a49a0 0x7f6d2c13bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3111d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a31e0 0x7f6d2c13b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54470/0 (socket says 172.21.15.31:54470) 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3191e700 1 -- 172.21.15.31:0/2173465136 learned_addr learned my addr 172.21.15.31:0/2173465136 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3191e700 1 -- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a31e0 msgr2=0x7f6d2c13b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3191e700 1 --2- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a31e0 0x7f6d2c13b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3191e700 1 -- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d2c0a49a0 msgr2=0x7f6d2c13bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3191e700 1 --2- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d2c0a49a0 0x7f6d2c13bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3191e700 1 -- 172.21.15.31:0/2173465136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c009420 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d3191e700 1 --2- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a24f0 0x7f6d2c14ed50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00ec80 tx=0x7f6d1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d21ffb700 1 -- 172.21.15.31:0/2173465136 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00c9b0 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d21ffb700 1 -- 172.21.15.31:0/2173465136 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c00cb10 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d24009a20 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.665+0000 7f6d21ffb700 1 -- 172.21.15.31:0/2173465136 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c00ce90 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.666+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c13c240 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.667+0000 7f6d21ffb700 1 -- 172.21.15.31:0/2173465136 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f6d1c013680 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.667+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c0651b0 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.667+0000 7f6d21ffb700 1 -- 172.21.15.31:0/2173465136 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f6d1c05b8d0 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.671+0000 7f6d21ffb700 1 -- 172.21.15.31:0/2173465136 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f6d1c039c90 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:39.849+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f6d2c0aeaf0 con 0x7f6d2c0a24f0 2024-04-18T10:38:39.850 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-04-18T10:38:39.849+0000 7f4102766700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2024-04-18T10:38:40.067 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:40.066+0000 7ff93b9c4540 -1 Falling back to public interface 2024-04-18T10:38:40.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.457+0000 7f6d21ffb700 1 -- 172.21.15.31:0/2173465136 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7f6d1c021030 con 0x7f6d2c0a24f0 2024-04-18T10:38:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.463+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 >> v1:172.21.15.31:6816/46601 conn(0x7f6d10046010 legacy=0x7f6d100484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.463+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a24f0 msgr2=0x7f6d2c14ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.463+0000 7f6d33b82700 1 --2- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a24f0 0x7f6d2c14ed50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00ec80 tx=0x7f6d1c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.463+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 shutdown_connections 2024-04-18T10:38:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.463+0000 7f6d33b82700 1 --2- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6d2c0a49a0 0x7f6d2c13bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.463+0000 7f6d33b82700 1 --2- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d2c0a24f0 0x7f6d2c14ed50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.463+0000 7f6d33b82700 1 --2- 172.21.15.31:0/2173465136 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6d2c0a31e0 0x7f6d2c13b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.463+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 >> 172.21.15.31:0/2173465136 conn(0x7f6d2c068af0 msgr2=0x7f6d2c0b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.463+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 shutdown_connections 2024-04-18T10:38:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.464+0000 7f6d33b82700 1 -- 172.21.15.31:0/2173465136 wait complete. 2024-04-18T10:38:40.467 INFO:teuthology.orchestra.run.smithi031.stderr:marked down osd.2. 2024-04-18T10:38:40.481 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-18T10:38:40.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-18T10:38:40.483 INFO:tasks.ceph.osd.2:Started 2024-04-18T10:38:40.484 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-18T10:38:40.484 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:40.523 INFO:tasks.ceph.osd.3:Stopped 2024-04-18T10:38:40.523 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2024-04-18T10:38:40.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.685+0000 7f0e3ae54700 1 Processor -- start 2024-04-18T10:38:40.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.685+0000 7f0e3ae54700 1 -- start start 2024-04-18T10:38:40.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e3ae54700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e3406fa70 0x7f0e340a8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e3ae54700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e340aa2a0 0x7f0e3413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e3ae54700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e340a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e3ae54700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e340aae00 con 0x7f0e340aa2a0 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e3ae54700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340aaa10 con 0x7f0e3413ef90 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e3ae54700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340a9ac0 con 0x7f0e3406fa70 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e33fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e340aa2a0 0x7f0e3413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e38bf0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e3406fa70 0x7f0e340a8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e393f1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e340a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e33fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e340aa2a0 0x7f0e3413ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40500/0 (socket says 172.21.15.31:40500) 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e38bf0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e3406fa70 0x7f0e340a8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:54488/0 (socket says 172.21.15.31:54488) 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e393f1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e340a5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:35108/0 (socket says 172.21.15.31:35108) 2024-04-18T10:38:40.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e33fff700 1 -- 172.21.15.31:0/2491525747 learned_addr learned my addr 172.21.15.31:0/2491525747 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e33fff700 1 -- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e3406fa70 msgr2=0x7f0e340a8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e33fff700 1 --2- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e3406fa70 0x7f0e340a8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e33fff700 1 -- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 msgr2=0x7f0e340a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e33fff700 1 --2- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e340a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e33fff700 1 -- 172.21.15.31:0/2491525747 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e340a9180 con 0x7f0e340aa2a0 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e38bf0700 1 --2- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e3406fa70 0x7f0e340a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e393f1700 1 --2- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e340a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e33fff700 1 --2- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e340aa2a0 0x7f0e3413ea50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e200099e0 tx=0x7f0e20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973d8a23357c7f71 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e337fe700 1 -- 172.21.15.31:0/2491525747 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2000b6d0 con 0x7f0e340aa2a0 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e337fe700 1 -- 172.21.15.31:0/2491525747 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2000b830 con 0x7f0e340aa2a0 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.686+0000 7f0e337fe700 1 -- 172.21.15.31:0/2491525747 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2000bbd0 con 0x7f0e340aa2a0 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.687+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e340aa2a0 msgr2=0x7f0e3413ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:40.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.687+0000 7f0e3ae54700 1 --2- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e340aa2a0 0x7f0e3413ea50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e200099e0 tx=0x7f0e20009250 comp rx=0 tx=0).stop 2024-04-18T10:38:40.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.687+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2491525747 shutdown_connections 2024-04-18T10:38:40.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.687+0000 7f0e3ae54700 1 --2- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e340a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.687+0000 7f0e3ae54700 1 --2- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e3406fa70 0x7f0e340a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.687+0000 7f0e3ae54700 1 --2- 172.21.15.31:0/2491525747 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e340aa2a0 0x7f0e3413ea50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.687+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2491525747 >> 172.21.15.31:0/2491525747 conn(0x7f0e340638b0 msgr2=0x7f0e3406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:40.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.687+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2491525747 shutdown_connections 2024-04-18T10:38:40.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.687+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2491525747 wait complete. 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.688+0000 7f0e3ae54700 1 Processor -- start 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.688+0000 7f0e3ae54700 1 -- start start 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e3ae54700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3406fa70 0x7f0e340b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e3ae54700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e340aa2a0 0x7f0e34151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e3ae54700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e34151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e3ae54700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340b1870 con 0x7f0e3406fa70 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e3ae54700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340af3c0 con 0x7f0e3413ef90 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e3ae54700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340ae830 con 0x7f0e340aa2a0 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e38bf0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3406fa70 0x7f0e340b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e33fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e340aa2a0 0x7f0e34151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e38bf0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3406fa70 0x7f0e340b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40512/0 (socket says 172.21.15.31:40512) 2024-04-18T10:38:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e38bf0700 1 -- 172.21.15.31:0/2664342875 learned_addr learned my addr 172.21.15.31:0/2664342875 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e393f1700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e34151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e38bf0700 1 -- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e340aa2a0 msgr2=0x7f0e34151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e38bf0700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e340aa2a0 0x7f0e34151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e38bf0700 1 -- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 msgr2=0x7f0e34151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e38bf0700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e34151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e38bf0700 1 -- 172.21.15.31:0/2664342875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28009420 con 0x7f0e3406fa70 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e33fff700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e340aa2a0 0x7f0e34151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e393f1700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e34151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e38bf0700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3406fa70 0x7f0e340b0ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800ec80 tx=0x7f0e280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e30ff9700 1 -- 172.21.15.31:0/2664342875 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800c8f0 con 0x7f0e3406fa70 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.689+0000 7f0e30ff9700 1 -- 172.21.15.31:0/2664342875 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2800ca50 con 0x7f0e3406fa70 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.690+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2c009a20 con 0x7f0e3406fa70 2024-04-18T10:38:40.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.690+0000 7f0e30ff9700 1 -- 172.21.15.31:0/2664342875 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800cdd0 con 0x7f0e3406fa70 2024-04-18T10:38:40.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.690+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e200094f0 con 0x7f0e3406fa70 2024-04-18T10:38:40.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.690+0000 7f0e30ff9700 1 -- 172.21.15.31:0/2664342875 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f0e28013680 con 0x7f0e3406fa70 2024-04-18T10:38:40.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.690+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e340651b0 con 0x7f0e3406fa70 2024-04-18T10:38:40.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.691+0000 7f0e30ff9700 1 -- 172.21.15.31:0/2664342875 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f0e2805b470 con 0x7f0e3406fa70 2024-04-18T10:38:40.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.694+0000 7f0e30ff9700 1 -- 172.21.15.31:0/2664342875 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f0e28039720 con 0x7f0e3406fa70 2024-04-18T10:38:40.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:40.874+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7f0e340b3e10 con 0x7f0e3406fa70 2024-04-18T10:38:40.875 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-04-18T10:38:40.874+0000 7f4102766700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2024-04-18T10:38:41.082 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:41.082+0000 7f7898533540 -1 Falling back to public interface 2024-04-18T10:38:41.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.453+0000 7f0e30ff9700 1 -- 172.21.15.31:0/2664342875 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7f0e2803cf10 con 0x7f0e3406fa70 2024-04-18T10:38:41.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 >> v1:172.21.15.31:6816/46601 conn(0x7f0e18046010 legacy=0x7f0e180484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:41.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3406fa70 msgr2=0x7f0e340b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:41.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3406fa70 0x7f0e340b0ef0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800ec80 tx=0x7f0e280091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 shutdown_connections 2024-04-18T10:38:41.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0e3413ef90 0x7f0e34151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e3406fa70 0x7f0e340b0ef0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 --2- 172.21.15.31:0/2664342875 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0e340aa2a0 0x7f0e34151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 >> 172.21.15.31:0/2664342875 conn(0x7f0e340638b0 msgr2=0x7f0e340b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:41.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 shutdown_connections 2024-04-18T10:38:41.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.457+0000 7f0e3ae54700 1 -- 172.21.15.31:0/2664342875 wait complete. 2024-04-18T10:38:41.458 INFO:teuthology.orchestra.run.smithi031.stderr:marked down osd.3. 2024-04-18T10:38:41.476 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-18T10:38:41.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-18T10:38:41.478 INFO:tasks.ceph.osd.3:Started 2024-04-18T10:38:41.479 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T10:38:41.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:41.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.602+0000 7f9d33713700 1 Processor -- start 2024-04-18T10:38:41.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.602+0000 7f9d33713700 1 -- start start 2024-04-18T10:38:41.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d33713700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c0680f0 0x7f9d2c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:41.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d33713700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 0x7f9d2c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:41.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d33713700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c06a480 con 0x7f9d2c069b50 2024-04-18T10:38:41.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d33713700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0a3430 con 0x7f9d2c069f20 2024-04-18T10:38:41.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d33713700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c06a720 con 0x7f9d2c0680f0 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d314af700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c0680f0 0x7f9d2c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d31cb0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 0x7f9d2c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d30cae700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9d2c069b50 0x7f9d2c06ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45282/0 (socket says 172.21.15.31:45282) 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d30cae700 1 -- 172.21.15.31:0/3227544954 learned_addr learned my addr 172.21.15.31:0/3227544954 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d314af700 1 -- 172.21.15.31:0/3227544954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 msgr2=0x7f9d2c06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d314af700 1 --2- 172.21.15.31:0/3227544954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 0x7f9d2c06f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d314af700 1 -- 172.21.15.31:0/3227544954 >> v1:172.21.15.31:6789/0 conn(0x7f9d2c069b50 legacy=0x7f9d2c06ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d314af700 1 -- 172.21.15.31:0/3227544954 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c06aa80 con 0x7f9d2c0680f0 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.603+0000 7f9d23fff700 1 -- 172.21.15.31:0/3227544954 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251262666 0 0) 0x7f9d2c06a480 con 0x7f9d2c069b50 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d314af700 1 --2- 172.21.15.31:0/3227544954 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c0680f0 0x7f9d2c0a3b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009910 tx=0x7f9d1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94c950e0069664e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d23fff700 1 -- 172.21.15.31:0/3227544954 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011630 con 0x7f9d2c0680f0 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d23fff700 1 -- 172.21.15.31:0/3227544954 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c011790 con 0x7f9d2c0680f0 2024-04-18T10:38:41.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d23fff700 1 -- 172.21.15.31:0/3227544954 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011b50 con 0x7f9d2c0680f0 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d33713700 1 -- 172.21.15.31:0/3227544954 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c0680f0 msgr2=0x7f9d2c0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d33713700 1 --2- 172.21.15.31:0/3227544954 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c0680f0 0x7f9d2c0a3b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009910 tx=0x7f9d1c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d33713700 1 -- 172.21.15.31:0/3227544954 shutdown_connections 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d33713700 1 --2- 172.21.15.31:0/3227544954 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 0x7f9d2c06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d33713700 1 --2- 172.21.15.31:0/3227544954 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c0680f0 0x7f9d2c0a3b30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d33713700 1 -- 172.21.15.31:0/3227544954 >> 172.21.15.31:0/3227544954 conn(0x7f9d2c06dd70 msgr2=0x7f9d2c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d33713700 1 -- 172.21.15.31:0/3227544954 shutdown_connections 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.604+0000 7f9d33713700 1 -- 172.21.15.31:0/3227544954 wait complete. 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.605+0000 7f9d33713700 1 Processor -- start 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.605+0000 7f9d33713700 1 -- start start 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d33713700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0680f0 0x7f9d2c097170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d33713700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c069b50 0x7f9d2c0a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d33713700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 0x7f9d2c1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d33713700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0978a0 con 0x7f9d2c0680f0 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d33713700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0ae2f0 con 0x7f9d2c069f20 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d33713700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0adaa0 con 0x7f9d2c069b50 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d314af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0680f0 0x7f9d2c097170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d314af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0680f0 0x7f9d2c097170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40528/0 (socket says 172.21.15.31:40528) 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d314af700 1 -- 172.21.15.31:0/1667389072 learned_addr learned my addr 172.21.15.31:0/1667389072 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d31cb0700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 0x7f9d2c1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d30cae700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c069b50 0x7f9d2c0a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d314af700 1 -- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c069b50 msgr2=0x7f9d2c0a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d314af700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c069b50 0x7f9d2c0a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d314af700 1 -- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 msgr2=0x7f9d2c1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.606+0000 7f9d314af700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 0x7f9d2c1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.607+0000 7f9d314af700 1 -- 172.21.15.31:0/1667389072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c009420 con 0x7f9d2c0680f0 2024-04-18T10:38:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.607+0000 7f9d31cb0700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 0x7f9d2c1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:41.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.607+0000 7f9d314af700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0680f0 0x7f9d2c097170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009fb0 tx=0x7f9d1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:41.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.607+0000 7f9d217fa700 1 -- 172.21.15.31:0/1667389072 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011b10 con 0x7f9d2c0680f0 2024-04-18T10:38:41.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.607+0000 7f9d217fa700 1 -- 172.21.15.31:0/1667389072 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c000c90 con 0x7f9d2c0680f0 2024-04-18T10:38:41.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.607+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c098260 con 0x7f9d2c0680f0 2024-04-18T10:38:41.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.607+0000 7f9d217fa700 1 -- 172.21.15.31:0/1667389072 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c01a680 con 0x7f9d2c0680f0 2024-04-18T10:38:41.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.607+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c13f700 con 0x7f9d2c0680f0 2024-04-18T10:38:41.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.608+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c0651b0 con 0x7f9d2c0680f0 2024-04-18T10:38:41.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.608+0000 7f9d217fa700 1 -- 172.21.15.31:0/1667389072 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f9d1c01a9f0 con 0x7f9d2c0680f0 2024-04-18T10:38:41.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.608+0000 7f9d217fa700 1 -- 172.21.15.31:0/1667389072 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f9d1c05cd30 con 0x7f9d2c0680f0 2024-04-18T10:38:41.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.612+0000 7f9d217fa700 1 -- 172.21.15.31:0/1667389072 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f9d1c006fe0 con 0x7f9d2c0680f0 2024-04-18T10:38:41.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.784+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d2c0a4520 con 0x7f9d2c0680f0 2024-04-18T10:38:41.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.785+0000 7f9d217fa700 1 -- 172.21.15.31:0/1667389072 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11543 (secure 0 0 0) 0x7f9d1c015030 con 0x7f9d2c0680f0 2024-04-18T10:38:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:41.786 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:41.447571+0000","last_up_change":"2024-04-18T10:38:41.447571+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":17,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":40171}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":40171}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":40171}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":40171}]},"public_addr":"172.21.15.31:6800/40171","cluster_addr":"172.21.15.31:6801/40171","heartbeat_back_addr":"172.21.15.31:6803/40171","heartbeat_front_addr":"172.21.15.31:6802/40171","state":["exists"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:41.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 >> v1:172.21.15.31:6816/46601 conn(0x7f9d10046010 legacy=0x7f9d100484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:41.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0680f0 msgr2=0x7f9d2c097170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:41.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0680f0 0x7f9d2c097170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009fb0 tx=0x7f9d1c017000 comp rx=0 tx=0).stop 2024-04-18T10:38:41.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 shutdown_connections 2024-04-18T10:38:41.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9d2c069f20 0x7f9d2c1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d2c0680f0 0x7f9d2c097170 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 --2- 172.21.15.31:0/1667389072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9d2c069b50 0x7f9d2c0a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:41.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 >> 172.21.15.31:0/1667389072 conn(0x7f9d2c06dd70 msgr2=0x7f9d2c06f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:41.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 shutdown_connections 2024-04-18T10:38:41.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:41.787+0000 7f9d33713700 1 -- 172.21.15.31:0/1667389072 wait complete. 2024-04-18T10:38:41.798 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.797+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.802 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.802 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.802 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.802 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.802 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.802 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.802 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.799+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:41.802 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:41.800+0000 7f71a6dc6540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.070 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:42.070+0000 7f4e2cfc8540 -1 Falling back to public interface 2024-04-18T10:38:42.501 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:42.501+0000 7f71a6dc6540 -1 osd.0 0 read_superblock omap replica is missing. 2024-04-18T10:38:42.531 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:42.529+0000 7f71a6dc6540 -1 osd.0 23 log_to_monitors true 2024-04-18T10:38:42.820 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.819+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2024-04-18T10:38:42.823 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.823 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.823 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.823 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.823 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.823 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.824 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.824 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.824 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.824 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.824 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.824 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:42.824 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:42.822+0000 7ff93b9c4540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:43.557 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:43.557+0000 7ff93b9c4540 -1 osd.1 0 read_superblock omap replica is missing. 2024-04-18T10:38:43.606 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:43.606+0000 7ff93b9c4540 -1 osd.1 24 log_to_monitors true 2024-04-18T10:38:43.818 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:43.818+0000 7f7898533540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2024-04-18T10:38:43.821 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:43.820+0000 7f7898533540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-04-18T10:38:43.821 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:43.820+0000 7f7898533540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:43.821 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:43.820+0000 7f7898533540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:43.821 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:43.820+0000 7f7898533540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:43.821 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:43.820+0000 7f7898533540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:43.821 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:43.820+0000 7f7898533540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:43.821 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:43.820+0000 7f7898533540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:43.821 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:43.820+0000 7f7898533540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.407 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-04-18T10:38:44.407+0000 7f71967c2700 -1 osd.0 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T10:38:44.796 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:44.796+0000 7f7898533540 -1 osd.2 0 read_superblock omap replica is missing. 2024-04-18T10:38:44.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:44.814 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.814+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.816+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.816+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.816+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.818 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.819 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.819 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.819 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.819 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.819 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.819 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.819 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:44.817+0000 7f4e2cfc8540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2024-04-18T10:38:44.834 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:44.834+0000 7f7898533540 -1 osd.2 25 log_to_monitors true 2024-04-18T10:38:44.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.966+0000 7fe283b9f700 1 Processor -- start 2024-04-18T10:38:44.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.966+0000 7fe283b9f700 1 -- start start 2024-04-18T10:38:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe283b9f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c06ecf0 0x7fe27c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe283b9f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a6d60 0x7fe27c142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe283b9f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe27c0a7130 0x7fe27c1450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe283b9f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27c0a3540 con 0x7fe27c0a7130 2024-04-18T10:38:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe283b9f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0a37e0 con 0x7fe27c0a6d60 2024-04-18T10:38:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe283b9f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0a5d60 con 0x7fe27c06ecf0 2024-04-18T10:38:44.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28113a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a6d60 0x7fe27c142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28193b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c06ecf0 0x7fe27c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28193b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c06ecf0 0x7fe27c0a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50552/0 (socket says 172.21.15.31:50552) 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28193b700 1 -- 172.21.15.31:0/3332224719 learned_addr learned my addr 172.21.15.31:0/3332224719 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28113a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a6d60 0x7fe27c142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:58216/0 (socket says 172.21.15.31:58216) 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28213c700 1 --2- 172.21.15.31:0/3332224719 >> v2:172.21.15.31:3300/0 conn(0x7fe27c0a7130 0x7fe27c1450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28113a700 1 -- 172.21.15.31:0/3332224719 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c06ecf0 msgr2=0x7fe27c0a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28113a700 1 --2- 172.21.15.31:0/3332224719 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c06ecf0 0x7fe27c0a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28113a700 1 -- 172.21.15.31:0/3332224719 >> v2:172.21.15.31:3300/0 conn(0x7fe27c0a7130 msgr2=0x7fe27c1450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28113a700 1 --2- 172.21.15.31:0/3332224719 >> v2:172.21.15.31:3300/0 conn(0x7fe27c0a7130 0x7fe27c1450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28113a700 1 -- 172.21.15.31:0/3332224719 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c06d980 con 0x7fe27c0a6d60 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.967+0000 7fe28193b700 1 --2- 172.21.15.31:0/3332224719 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c06ecf0 0x7fe27c0a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe28113a700 1 --2- 172.21.15.31:0/3332224719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a6d60 0x7fe27c142b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0098e0 tx=0x7fe26c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=666545466bbacb28 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:44.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe280939700 1 -- 172.21.15.31:0/3332224719 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c00b640 con 0x7fe27c0a6d60 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe280939700 1 -- 172.21.15.31:0/3332224719 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c00b7a0 con 0x7fe27c0a6d60 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe280939700 1 -- 172.21.15.31:0/3332224719 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c00bb40 con 0x7fe27c0a6d60 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe283b9f700 1 -- 172.21.15.31:0/3332224719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a6d60 msgr2=0x7fe27c142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe283b9f700 1 --2- 172.21.15.31:0/3332224719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a6d60 0x7fe27c142b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0098e0 tx=0x7fe26c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe283b9f700 1 -- 172.21.15.31:0/3332224719 shutdown_connections 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe283b9f700 1 --2- 172.21.15.31:0/3332224719 >> v2:172.21.15.31:3300/0 conn(0x7fe27c0a7130 0x7fe27c1450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe283b9f700 1 --2- 172.21.15.31:0/3332224719 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c06ecf0 0x7fe27c0a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe283b9f700 1 --2- 172.21.15.31:0/3332224719 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a6d60 0x7fe27c142b70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.968+0000 7fe283b9f700 1 -- 172.21.15.31:0/3332224719 >> 172.21.15.31:0/3332224719 conn(0x7fe27c0679e0 msgr2=0x7fe27c067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.969+0000 7fe283b9f700 1 -- 172.21.15.31:0/3332224719 shutdown_connections 2024-04-18T10:38:44.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.969+0000 7fe283b9f700 1 -- 172.21.15.31:0/3332224719 wait complete. 2024-04-18T10:38:44.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.970+0000 7fe283b9f700 1 Processor -- start 2024-04-18T10:38:44.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.970+0000 7fe283b9f700 1 -- start start 2024-04-18T10:38:44.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe283b9f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe27c06ecf0 0x7fe27c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:44.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe283b9f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c0a6d60 0x7fe27c0acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:44.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe283b9f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a7130 0x7fe27c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:44.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe283b9f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0698a0 con 0x7fe27c06ecf0 2024-04-18T10:38:44.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe283b9f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0aca60 con 0x7fe27c0a7130 2024-04-18T10:38:44.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe283b9f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c14de00 con 0x7fe27c0a6d60 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28113a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c0a6d60 0x7fe27c0acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28113a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c0a6d60 0x7fe27c0acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50558/0 (socket says 172.21.15.31:50558) 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28193b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe27c06ecf0 0x7fe27c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28113a700 1 -- 172.21.15.31:0/1538600230 learned_addr learned my addr 172.21.15.31:0/1538600230 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28213c700 1 --2- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a7130 0x7fe27c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28193b700 1 -- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c0a6d60 msgr2=0x7fe27c0acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28193b700 1 --2- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c0a6d60 0x7fe27c0acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28193b700 1 -- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a7130 msgr2=0x7fe27c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28193b700 1 --2- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a7130 0x7fe27c14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.971+0000 7fe28193b700 1 -- 172.21.15.31:0/1538600230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2780094f0 con 0x7fe27c06ecf0 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.972+0000 7fe28193b700 1 --2- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe27c06ecf0 0x7fe27c0abce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe278006fd0 tx=0x7fe278009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.972+0000 7fe271ffb700 1 -- 172.21.15.31:0/1538600230 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800c850 con 0x7fe27c06ecf0 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.972+0000 7fe271ffb700 1 -- 172.21.15.31:0/1538600230 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800c9b0 con 0x7fe27c06ecf0 2024-04-18T10:38:44.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.972+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c009420 con 0x7fe27c06ecf0 2024-04-18T10:38:44.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.972+0000 7fe271ffb700 1 -- 172.21.15.31:0/1538600230 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800cd30 con 0x7fe27c06ecf0 2024-04-18T10:38:44.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.972+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c14b890 con 0x7fe27c06ecf0 2024-04-18T10:38:44.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.973+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27c0651b0 con 0x7fe27c06ecf0 2024-04-18T10:38:44.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.973+0000 7fe271ffb700 1 -- 172.21.15.31:0/1538600230 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fe278013680 con 0x7fe27c06ecf0 2024-04-18T10:38:44.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.974+0000 7fe271ffb700 1 -- 172.21.15.31:0/1538600230 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fe278063350 con 0x7fe27c06ecf0 2024-04-18T10:38:44.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:44.979+0000 7fe271ffb700 1 -- 172.21.15.31:0/1538600230 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe278060060 con 0x7fe27c06ecf0 2024-04-18T10:38:45.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.204+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe27c069b60 con 0x7fe27c06ecf0 2024-04-18T10:38:45.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.205+0000 7fe271ffb700 1 -- 172.21.15.31:0/1538600230 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+11550 (secure 0 0 0) 0x7fe278060030 con 0x7fe27c06ecf0 2024-04-18T10:38:45.205 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:45.205 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:44.467706+0000","last_up_change":"2024-04-18T10:38:44.467706+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":17,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":40172}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":40172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":40172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":40172}]},"public_addr":"172.21.15.31:6804/40172","cluster_addr":"172.21.15.31:6805/40172","heartbeat_back_addr":"172.21.15.31:6807/40172","heartbeat_front_addr":"172.21.15.31:6806/40172","state":["exists"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":40174}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":40174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":40174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":40174}]},"public_addr":"172.21.15.31:6808/40174","cluster_addr":"172.21.15.31:6810/40174","heartbeat_back_addr":"172.21.15.31:6814/40174","heartbeat_front_addr":"172.21.15.31:6812/40174","state":["exists"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":40173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":40173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":40173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":40173}]},"public_addr":"172.21.15.31:6809/40173","cluster_addr":"172.21.15.31:6811/40173","heartbeat_back_addr":"172.21.15.31:6815/40173","heartbeat_front_addr":"172.21.15.31:6813/40173","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 >> v1:172.21.15.31:6816/46601 conn(0x7fe260046010 legacy=0x7fe2600484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe27c06ecf0 msgr2=0x7fe27c0abce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 --2- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe27c06ecf0 0x7fe27c0abce0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe278006fd0 tx=0x7fe278009250 comp rx=0 tx=0).stop 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 shutdown_connections 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 --2- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe27c0a7130 0x7fe27c14e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 --2- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe27c06ecf0 0x7fe27c0abce0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 --2- 172.21.15.31:0/1538600230 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe27c0a6d60 0x7fe27c0acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 >> 172.21.15.31:0/1538600230 conn(0x7fe27c0679e0 msgr2=0x7fe27c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 shutdown_connections 2024-04-18T10:38:45.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:45.207+0000 7fe283b9f700 1 -- 172.21.15.31:0/1538600230 wait complete. 2024-04-18T10:38:45.437 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-04-18T10:38:45.437+0000 7ff92b3c0700 -1 osd.1 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T10:38:45.808 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:45.808+0000 7f4e2cfc8540 -1 osd.3 0 read_superblock omap replica is missing. 2024-04-18T10:38:45.855 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:45.854+0000 7f4e2cfc8540 -1 osd.3 26 log_to_monitors true 2024-04-18T10:38:46.369 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-04-18T10:38:46.369+0000 7f7887f2f700 -1 osd.2 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T10:38:47.386 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-04-18T10:38:47.385+0000 7f4e1c9c4700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-18T10:38:48.221 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:48.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabca304700 1 Processor -- start 2024-04-18T10:38:48.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabca304700 1 -- start start 2024-04-18T10:38:48.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabca304700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc40b0560 0x7fabc413fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:48.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabca304700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fabc4140360 0x7fabc4146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:48.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabca304700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc40a73b0 con 0x7fabc4068340 2024-04-18T10:38:48.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabca304700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc40a55e0 con 0x7fabc4140360 2024-04-18T10:38:48.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabca304700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40a41a0 con 0x7fabc40b0560 2024-04-18T10:38:48.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabc37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc40b0560 0x7fabc413fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:48.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabc88a1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fabc4140360 0x7fabc4146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabc3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fabc4068340 0x7fabc40a6bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37976/0 (socket says 172.21.15.31:37976) 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.355+0000 7fabc3fff700 1 -- 172.21.15.31:0/1350356653 learned_addr learned my addr 172.21.15.31:0/1350356653 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc37fe700 1 -- 172.21.15.31:0/1350356653 >> v2:172.21.15.31:3300/0 conn(0x7fabc4140360 msgr2=0x7fabc4146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc37fe700 1 --2- 172.21.15.31:0/1350356653 >> v2:172.21.15.31:3300/0 conn(0x7fabc4140360 0x7fabc4146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc37fe700 1 -- 172.21.15.31:0/1350356653 >> v1:172.21.15.31:6789/0 conn(0x7fabc4068340 legacy=0x7fabc40a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc37fe700 1 -- 172.21.15.31:0/1350356653 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc413f850 con 0x7fabc40b0560 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc2ffd700 1 -- 172.21.15.31:0/1350356653 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501834635 0 0) 0x7fabc40a73b0 con 0x7fabc4068340 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc88a1700 1 --2- 172.21.15.31:0/1350356653 >> v2:172.21.15.31:3300/0 conn(0x7fabc4140360 0x7fabc4146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc37fe700 1 --2- 172.21.15.31:0/1350356653 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc40b0560 0x7fabc413fe20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fabb80098e0 tx=0x7fabb80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c891da631ced27d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc2ffd700 1 -- 172.21.15.31:0/1350356653 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800b640 con 0x7fabc40b0560 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc2ffd700 1 -- 172.21.15.31:0/1350356653 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800b7a0 con 0x7fabc40b0560 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.356+0000 7fabc2ffd700 1 -- 172.21.15.31:0/1350356653 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800bb40 con 0x7fabc40b0560 2024-04-18T10:38:48.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.357+0000 7fabca304700 1 -- 172.21.15.31:0/1350356653 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc40b0560 msgr2=0x7fabc413fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:48.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.357+0000 7fabca304700 1 --2- 172.21.15.31:0/1350356653 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc40b0560 0x7fabc413fe20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fabb80098e0 tx=0x7fabb80091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:48.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.357+0000 7fabca304700 1 -- 172.21.15.31:0/1350356653 shutdown_connections 2024-04-18T10:38:48.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.357+0000 7fabca304700 1 --2- 172.21.15.31:0/1350356653 >> v2:172.21.15.31:3300/0 conn(0x7fabc4140360 0x7fabc4146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:48.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.357+0000 7fabca304700 1 --2- 172.21.15.31:0/1350356653 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc40b0560 0x7fabc413fe20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:48.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.357+0000 7fabca304700 1 -- 172.21.15.31:0/1350356653 >> 172.21.15.31:0/1350356653 conn(0x7fabc406dd70 msgr2=0x7fabc40679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:48.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.357+0000 7fabca304700 1 -- 172.21.15.31:0/1350356653 shutdown_connections 2024-04-18T10:38:48.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.357+0000 7fabca304700 1 -- 172.21.15.31:0/1350356653 wait complete. 2024-04-18T10:38:48.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.358+0000 7fabca304700 1 Processor -- start 2024-04-18T10:38:48.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.358+0000 7fabca304700 1 -- start start 2024-04-18T10:38:48.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.358+0000 7fabca304700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc4068340 0x7fabc40ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:48.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.358+0000 7fabca304700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc40b0560 0x7fabc41517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:48.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.358+0000 7fabca304700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc4140360 0x7fabc4151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:48.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.358+0000 7fabca304700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4151410 con 0x7fabc40b0560 2024-04-18T10:38:48.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.358+0000 7fabca304700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40ae0b0 con 0x7fabc4068340 2024-04-18T10:38:48.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.358+0000 7fabca304700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabc40a29f0 con 0x7fabc4140360 2024-04-18T10:38:48.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc40b0560 0x7fabc41517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:48.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc4068340 0x7fabc40ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:48.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc37fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc40b0560 0x7fabc41517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57176/0 (socket says 172.21.15.31:57176) 2024-04-18T10:38:48.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc37fe700 1 -- 172.21.15.31:0/3342801270 learned_addr learned my addr 172.21.15.31:0/3342801270 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc3fff700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc4068340 0x7fabc40ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:58236/0 (socket says 172.21.15.31:58236) 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc88a1700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc4140360 0x7fabc4151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc37fe700 1 -- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc4140360 msgr2=0x7fabc4151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc37fe700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc4140360 0x7fabc4151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc37fe700 1 -- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc4068340 msgr2=0x7fabc40ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc37fe700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc4068340 0x7fabc40ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc37fe700 1 -- 172.21.15.31:0/3342801270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc009a20 con 0x7fabc40b0560 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc88a1700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc4140360 0x7fabc4151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc3fff700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc4068340 0x7fabc40ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabc37fe700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc40b0560 0x7fabc41517d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fabb8013000 tx=0x7fabb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fababfff700 1 -- 172.21.15.31:0/3342801270 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8000d10 con 0x7fabc40b0560 2024-04-18T10:38:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fababfff700 1 -- 172.21.15.31:0/3342801270 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800bb20 con 0x7fabc40b0560 2024-04-18T10:38:48.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fababfff700 1 -- 172.21.15.31:0/3342801270 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8011670 con 0x7fabc40b0560 2024-04-18T10:38:48.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb8009420 con 0x7fabc40b0560 2024-04-18T10:38:48.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.359+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc4152250 con 0x7fabc40b0560 2024-04-18T10:38:48.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.360+0000 7fababfff700 1 -- 172.21.15.31:0/3342801270 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fabb8011a20 con 0x7fabc40b0560 2024-04-18T10:38:48.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.360+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc40651b0 con 0x7fabc40b0560 2024-04-18T10:38:48.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.361+0000 7fababfff700 1 -- 172.21.15.31:0/3342801270 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fabb805c590 con 0x7fabc40b0560 2024-04-18T10:38:48.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.364+0000 7fababfff700 1 -- 172.21.15.31:0/3342801270 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fabb8005f10 con 0x7fabc40b0560 2024-04-18T10:38:48.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.554+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabc40af680 con 0x7fabc40b0560 2024-04-18T10:38:48.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.554+0000 7fababfff700 1 -- 172.21.15.31:0/3342801270 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+11571 (secure 0 0 0) 0x7fabb8029020 con 0x7fabc40b0560 2024-04-18T10:38:48.556 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:48.556 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":33,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:48.495600+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 >> v1:172.21.15.31:6816/46601 conn(0x7fabb0046010 legacy=0x7fabb00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc40b0560 msgr2=0x7fabc41517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc40b0560 0x7fabc41517d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fabb8013000 tx=0x7fabb8017000 comp rx=0 tx=0).stop 2024-04-18T10:38:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 shutdown_connections 2024-04-18T10:38:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fabc4140360 0x7fabc4151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:48.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fabc4068340 0x7fabc40ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 --2- 172.21.15.31:0/3342801270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fabc40b0560 0x7fabc41517d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 >> 172.21.15.31:0/3342801270 conn(0x7fabc406dd70 msgr2=0x7fabc406ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 shutdown_connections 2024-04-18T10:38:48.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:48.556+0000 7fabca304700 1 -- 172.21.15.31:0/3342801270 wait complete. 2024-04-18T10:38:48.569 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T10:38:48.570 INFO:teuthology.run_tasks:Running task ceph.stop... 2024-04-18T10:38:48.586 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-18T10:38:48.586 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:48.593 INFO:tasks.ceph.mds.a:Stopped 2024-04-18T10:38:48.594 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-18T10:38:48.594 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:48.643 INFO:tasks.ceph.mds.b:Stopped 2024-04-18T10:38:48.643 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-18T10:38:48.643 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:38:48.694 INFO:tasks.ceph.mds.c:Stopped 2024-04-18T10:38:52.365 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2024-04-18T10:38:52.366 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-04-18T10:38:52.376 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-04-18T10:38:52.376 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-18T10:38:52.376 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-18T10:38:52.379 INFO:tasks.ceph.mds.a:Started 2024-04-18T10:38:52.379 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-04-18T10:38:52.379 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-18T10:38:52.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-18T10:38:52.382 INFO:tasks.ceph.mds.b:Started 2024-04-18T10:38:52.382 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-04-18T10:38:52.382 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-18T10:38:52.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-18T10:38:52.384 INFO:tasks.ceph.mds.c:Started 2024-04-18T10:38:52.384 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T10:38:52.384 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:52.473 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-04-18T10:38:52.477 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-04-18T10:38:52.487 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2024-04-18T10:38:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aaab84700 1 Processor -- start 2024-04-18T10:38:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aaab84700 1 -- start start 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aaab84700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7aa406eaa0 0x7f7aa4068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aaab84700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 0x7f7aa4069030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aaab84700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa40a3bc0 con 0x7f7aa40a4870 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aaab84700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa406a260 con 0x7f7aa406eaa0 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aaab84700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa406a500 con 0x7f7aa40a4f60 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aa8920700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7aa406eaa0 0x7f7aa4068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aa3fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 0x7f7aa4069030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aa9121700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7aa40a4870 0x7f7aa41485c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38028/0 (socket says 172.21.15.31:38028) 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.539+0000 7f7aa9121700 1 -- 172.21.15.31:0/3075273805 learned_addr learned my addr 172.21.15.31:0/3075273805 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa8920700 1 -- 172.21.15.31:0/3075273805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 msgr2=0x7f7aa4069030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa8920700 1 --2- 172.21.15.31:0/3075273805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 0x7f7aa4069030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa8920700 1 -- 172.21.15.31:0/3075273805 >> v1:172.21.15.31:6789/0 conn(0x7f7aa40a4870 legacy=0x7f7aa41485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa8920700 1 -- 172.21.15.31:0/3075273805 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa406f870 con 0x7f7aa406eaa0 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa37fe700 1 -- 172.21.15.31:0/3075273805 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931434903 0 0) 0x7f7aa40a3bc0 con 0x7f7aa40a4870 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa3fff700 1 --2- 172.21.15.31:0/3075273805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 0x7f7aa4069030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa8920700 1 --2- 172.21.15.31:0/3075273805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa406eaa0 0x7f7aa4068af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a980098e0 tx=0x7f7a980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0c4e7131b6348a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa37fe700 1 -- 172.21.15.31:0/3075273805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800b640 con 0x7f7aa406eaa0 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa37fe700 1 -- 172.21.15.31:0/3075273805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9800b7a0 con 0x7f7aa406eaa0 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.540+0000 7f7aa37fe700 1 -- 172.21.15.31:0/3075273805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800bb40 con 0x7f7aa406eaa0 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.541+0000 7f7aaab84700 1 -- 172.21.15.31:0/3075273805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa406eaa0 msgr2=0x7f7aa4068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.541+0000 7f7aaab84700 1 --2- 172.21.15.31:0/3075273805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa406eaa0 0x7f7aa4068af0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a980098e0 tx=0x7f7a980091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.541+0000 7f7aaab84700 1 -- 172.21.15.31:0/3075273805 shutdown_connections 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.541+0000 7f7aaab84700 1 --2- 172.21.15.31:0/3075273805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa406eaa0 0x7f7aa4068af0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.541+0000 7f7aaab84700 1 --2- 172.21.15.31:0/3075273805 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 0x7f7aa4069030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.541+0000 7f7aaab84700 1 -- 172.21.15.31:0/3075273805 >> 172.21.15.31:0/3075273805 conn(0x7f7aa40679e0 msgr2=0x7f7aa4067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:52.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.541+0000 7f7aaab84700 1 -- 172.21.15.31:0/3075273805 shutdown_connections 2024-04-18T10:38:52.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.541+0000 7f7aaab84700 1 -- 172.21.15.31:0/3075273805 wait complete. 2024-04-18T10:38:52.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.542+0000 7f7aaab84700 1 Processor -- start 2024-04-18T10:38:52.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.542+0000 7f7aaab84700 1 -- start start 2024-04-18T10:38:52.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aaab84700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7aa406eaa0 0x7f7aa40add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aaab84700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa40a4870 0x7f7aa4151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aaab84700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 0x7f7aa4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aaab84700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40adbb0 con 0x7f7aa40a4870 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aaab84700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40ab6e0 con 0x7f7aa40a4f60 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aaab84700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40af8f0 con 0x7f7aa406eaa0 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aa3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa40a4870 0x7f7aa4151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aa3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa40a4870 0x7f7aa4151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57212/0 (socket says 172.21.15.31:57212) 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aa3fff700 1 -- 172.21.15.31:0/2668354734 learned_addr learned my addr 172.21.15.31:0/2668354734 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aa8920700 1 --2- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7aa406eaa0 0x7f7aa40add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aa3fff700 1 -- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7aa406eaa0 msgr2=0x7f7aa40add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aa3fff700 1 --2- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7aa406eaa0 0x7f7aa40add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aa3fff700 1 -- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 msgr2=0x7f7aa4151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aa3fff700 1 --2- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 0x7f7aa4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.543+0000 7f7aa3fff700 1 -- 172.21.15.31:0/2668354734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a90009420 con 0x7f7aa40a4870 2024-04-18T10:38:52.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.544+0000 7f7aa3fff700 1 --2- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa40a4870 0x7f7aa4151650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000ecb0 tx=0x7f7a900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:52.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.548+0000 7f7aa0ff9700 1 -- 172.21.15.31:0/2668354734 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9000c950 con 0x7f7aa40a4870 2024-04-18T10:38:52.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.548+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a98009420 con 0x7f7aa40a4870 2024-04-18T10:38:52.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.549+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa40a2990 con 0x7f7aa40a4870 2024-04-18T10:38:52.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.549+0000 7f7aa0ff9700 1 -- 172.21.15.31:0/2668354734 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9000ccc0 con 0x7f7aa40a4870 2024-04-18T10:38:52.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.549+0000 7f7aa0ff9700 1 -- 172.21.15.31:0/2668354734 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9000ce30 con 0x7f7aa40a4870 2024-04-18T10:38:52.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.550+0000 7f7aa0ff9700 1 -- 172.21.15.31:0/2668354734 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f7a90013680 con 0x7f7aa40a4870 2024-04-18T10:38:52.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.550+0000 7f7aa0ff9700 1 -- 172.21.15.31:0/2668354734 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f7a9005b8c0 con 0x7f7aa40a4870 2024-04-18T10:38:52.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.550+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa4097420 con 0x7f7aa40a4870 2024-04-18T10:38:52.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.554+0000 7f7aa0ff9700 1 -- 172.21.15.31:0/2668354734 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7aa4097420 con 0x7f7aa40a4870 2024-04-18T10:38:52.564 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-04-18T10:38:52.564+0000 7f40fff61700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-18T10:38:52.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.734+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7aa4097420 con 0x7f7aa40a4870 2024-04-18T10:38:52.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.735+0000 7f7aa0ff9700 1 -- 172.21.15.31:0/2668354734 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+11636 (secure 0 0 0) 0x7f7aa4097420 con 0x7f7aa40a4870 2024-04-18T10:38:52.735 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:52.735 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":36,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:52.565150+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:52.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.736+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 >> v1:172.21.15.31:6816/46601 conn(0x7f7a88046010 legacy=0x7f7a880484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.736+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa40a4870 msgr2=0x7f7aa4151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.736+0000 7f7aaab84700 1 --2- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa40a4870 0x7f7aa4151650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000ecb0 tx=0x7f7a900091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.737+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 shutdown_connections 2024-04-18T10:38:52.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.737+0000 7f7aaab84700 1 --2- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7aa406eaa0 0x7f7aa40add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.737+0000 7f7aaab84700 1 --2- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7aa40a4f60 0x7f7aa4151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.737+0000 7f7aaab84700 1 --2- 172.21.15.31:0/2668354734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7aa40a4870 0x7f7aa4151650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.737+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 >> 172.21.15.31:0/2668354734 conn(0x7f7aa40679e0 msgr2=0x7f7aa40b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:52.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.737+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 shutdown_connections 2024-04-18T10:38:52.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.737+0000 7f7aaab84700 1 -- 172.21.15.31:0/2668354734 wait complete. 2024-04-18T10:38:52.749 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T10:38:52.749 INFO:teuthology.run_tasks:Running task exec... 2024-04-18T10:38:52.761 INFO:teuthology.task.exec:Executing custom commands... 2024-04-18T10:38:52.761 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:38:52.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2024-04-18T10:38:52.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.877+0000 7fef56179700 1 Processor -- start 2024-04-18T10:38:52.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.877+0000 7fef56179700 1 -- start start 2024-04-18T10:38:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef56179700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef5013edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef56179700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef5006f880 0x7fef500b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef56179700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5013e930 con 0x7fef50141b40 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef56179700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5006cae0 con 0x7fef50063be0 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef56179700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef500b1b20 con 0x7fef5006f880 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef5013edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef5006f880 0x7fef500b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fef50141b40 0x7fef50141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38030/0 (socket says 172.21.15.31:38030) 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4ffff700 1 -- 172.21.15.31:0/787334352 learned_addr learned my addr 172.21.15.31:0/787334352 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4e7fc700 1 -- 172.21.15.31:0/787334352 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883949606 0 0) 0x7fef5013e930 con 0x7fef50141b40 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4effd700 1 -- 172.21.15.31:0/787334352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 msgr2=0x7fef5013edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4effd700 1 --2- 172.21.15.31:0/787334352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef5013edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4effd700 1 -- 172.21.15.31:0/787334352 >> v1:172.21.15.31:6789/0 conn(0x7fef50141b40 legacy=0x7fef50141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4effd700 1 -- 172.21.15.31:0/787334352 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef500b1de0 con 0x7fef5006f880 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4f7fe700 1 --2- 172.21.15.31:0/787334352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef5013edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.878+0000 7fef4effd700 1 --2- 172.21.15.31:0/787334352 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef5006f880 0x7fef500b2230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef40009940 tx=0x7fef400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=def727d3ecd6747a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef4e7fc700 1 -- 172.21.15.31:0/787334352 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000b670 con 0x7fef5006f880 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef4e7fc700 1 -- 172.21.15.31:0/787334352 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4000b7d0 con 0x7fef5006f880 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef4e7fc700 1 -- 172.21.15.31:0/787334352 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000bb90 con 0x7fef5006f880 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef56179700 1 -- 172.21.15.31:0/787334352 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef5006f880 msgr2=0x7fef500b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef56179700 1 --2- 172.21.15.31:0/787334352 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef5006f880 0x7fef500b2230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fef40009940 tx=0x7fef400091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef56179700 1 -- 172.21.15.31:0/787334352 shutdown_connections 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef56179700 1 --2- 172.21.15.31:0/787334352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef5013edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef56179700 1 --2- 172.21.15.31:0/787334352 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef5006f880 0x7fef500b2230 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef56179700 1 -- 172.21.15.31:0/787334352 >> 172.21.15.31:0/787334352 conn(0x7fef5006a1f0 msgr2=0x7fef5006a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:52.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef56179700 1 -- 172.21.15.31:0/787334352 shutdown_connections 2024-04-18T10:38:52.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.879+0000 7fef56179700 1 -- 172.21.15.31:0/787334352 wait complete. 2024-04-18T10:38:52.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.880+0000 7fef56179700 1 Processor -- start 2024-04-18T10:38:52.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.880+0000 7fef56179700 1 -- start start 2024-04-18T10:38:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef56179700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef500ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef56179700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50141b40 0x7fef500ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef56179700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef500ac5a0 0x7fef50151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef56179700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef500adea0 con 0x7fef50141b40 2024-04-18T10:38:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef56179700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef500acc70 con 0x7fef50063be0 2024-04-18T10:38:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef56179700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef500ab520 con 0x7fef500ac5a0 2024-04-18T10:38:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef500ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef500ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:58292/0 (socket says 172.21.15.31:58292) 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4f7fe700 1 -- 172.21.15.31:0/2447493976 learned_addr learned my addr 172.21.15.31:0/2447493976 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4effd700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50141b40 0x7fef500ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4ffff700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef500ac5a0 0x7fef50151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4f7fe700 1 -- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef500ac5a0 msgr2=0x7fef50151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4f7fe700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef500ac5a0 0x7fef50151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4f7fe700 1 -- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50141b40 msgr2=0x7fef500ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4f7fe700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50141b40 0x7fef500ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4f7fe700 1 -- 172.21.15.31:0/2447493976 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef38009420 con 0x7fef50063be0 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4effd700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50141b40 0x7fef500ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.881+0000 7fef4f7fe700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef500ae290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fef3800ec80 tx=0x7fef380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.882+0000 7fef477fe700 1 -- 172.21.15.31:0/2447493976 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3800c7f0 con 0x7fef50063be0 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.882+0000 7fef477fe700 1 -- 172.21.15.31:0/2447493976 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3800c950 con 0x7fef50063be0 2024-04-18T10:38:52.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.882+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef40009420 con 0x7fef50063be0 2024-04-18T10:38:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.882+0000 7fef477fe700 1 -- 172.21.15.31:0/2447493976 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3800ccd0 con 0x7fef50063be0 2024-04-18T10:38:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.882+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef500ab1e0 con 0x7fef50063be0 2024-04-18T10:38:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.882+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef500ad6a0 con 0x7fef50063be0 2024-04-18T10:38:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.883+0000 7fef477fe700 1 -- 172.21.15.31:0/2447493976 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fef38013470 con 0x7fef50063be0 2024-04-18T10:38:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.883+0000 7fef477fe700 1 -- 172.21.15.31:0/2447493976 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fef3805b780 con 0x7fef50063be0 2024-04-18T10:38:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:52.887+0000 7fef477fe700 1 -- 172.21.15.31:0/2447493976 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fef500ad6a0 con 0x7fef50063be0 2024-04-18T10:38:53.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.113+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fef500ad6a0 con 0x7fef50063be0 2024-04-18T10:38:53.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.113+0000 7fef477fe700 1 -- 172.21.15.31:0/2447493976 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fef500ad6a0 con 0x7fef50063be0 2024-04-18T10:38:53.114 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:38:53.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": { 2024-04-18T10:38:53.114 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 17.2.7-872-ge85153d5 (e85153d553ddc8420b6b154a57813a504f51c01a) quincy (stable)": 3 2024-04-18T10:38:53.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": { 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 17.2.7-872-ge85153d5 (e85153d553ddc8420b6b154a57813a504f51c01a) quincy (stable)": 2 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": { 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 17.2.7-872-ge85153d5 (e85153d553ddc8420b6b154a57813a504f51c01a) quincy (stable)": 4 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": { 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 17.2.7-872-ge85153d5 (e85153d553ddc8420b6b154a57813a504f51c01a) quincy (stable)": 3 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: "overall": { 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph version 17.2.7-872-ge85153d5 (e85153d553ddc8420b6b154a57813a504f51c01a) quincy (stable)": 12 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.115 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:38:53.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 >> v1:172.21.15.31:6816/46601 conn(0x7fef30046010 legacy=0x7fef300484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 msgr2=0x7fef500ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef500ae290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fef3800ec80 tx=0x7fef380091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 shutdown_connections 2024-04-18T10:38:53.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fef500ac5a0 0x7fef50151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fef50063be0 0x7fef500ae290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 --2- 172.21.15.31:0/2447493976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef50141b40 0x7fef500ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 >> 172.21.15.31:0/2447493976 conn(0x7fef5006a1f0 msgr2=0x7fef5013dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:53.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 shutdown_connections 2024-04-18T10:38:53.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.115+0000 7fef56179700 1 -- 172.21.15.31:0/2447493976 wait complete. 2024-04-18T10:38:53.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2024-04-18T10:38:53.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f06fb9700 1 Processor -- start 2024-04-18T10:38:53.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f06fb9700 1 -- start start 2024-04-18T10:38:53.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f06fb9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f00067c30 0x7f5f0009fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f06fb9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f000a0420 0x7f5f000a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f06fb9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f000a3d20 con 0x7f5f000a1ed0 2024-04-18T10:38:53.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f06fb9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f000a4d90 con 0x7f5f000a0420 2024-04-18T10:38:53.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f06fb9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000a08e0 con 0x7f5f00067c30 2024-04-18T10:38:53.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f04d55700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f00067c30 0x7f5f0009fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5efffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f000a0420 0x7f5f000a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5efffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f000a0420 0x7f5f000a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57232/0 (socket says 172.21.15.31:57232) 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f04d55700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f00067c30 0x7f5f0009fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:58298/0 (socket says 172.21.15.31:58298) 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5f05556700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5f000a1ed0 0x7f5f00141c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38036/0 (socket says 172.21.15.31:38036) 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.245+0000 7f5efffff700 1 -- 172.21.15.31:0/1406402153 learned_addr learned my addr 172.21.15.31:0/1406402153 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5f04d55700 1 -- 172.21.15.31:0/1406402153 >> v2:172.21.15.31:3300/0 conn(0x7f5f000a0420 msgr2=0x7f5f000a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5f04d55700 1 --2- 172.21.15.31:0/1406402153 >> v2:172.21.15.31:3300/0 conn(0x7f5f000a0420 0x7f5f000a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5f04d55700 1 -- 172.21.15.31:0/1406402153 >> v1:172.21.15.31:6789/0 conn(0x7f5f000a1ed0 legacy=0x7f5f00141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5eff7fe700 1 -- 172.21.15.31:0/1406402153 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825750459 0 0) 0x7f5f000a3d20 con 0x7f5f000a1ed0 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5f04d55700 1 -- 172.21.15.31:0/1406402153 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000a0ba0 con 0x7f5f00067c30 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5efffff700 1 --2- 172.21.15.31:0/1406402153 >> v2:172.21.15.31:3300/0 conn(0x7f5f000a0420 0x7f5f000a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5f04d55700 1 --2- 172.21.15.31:0/1406402153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f00067c30 0x7f5f0009fbb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009910 tx=0x7f5ef40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fa5e1c8487da20b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5eff7fe700 1 -- 172.21.15.31:0/1406402153 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400b640 con 0x7f5f00067c30 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5eff7fe700 1 -- 172.21.15.31:0/1406402153 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400b7a0 con 0x7f5f00067c30 2024-04-18T10:38:53.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5eff7fe700 1 -- 172.21.15.31:0/1406402153 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400bb60 con 0x7f5f00067c30 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5f06fb9700 1 -- 172.21.15.31:0/1406402153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f00067c30 msgr2=0x7f5f0009fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.246+0000 7f5f06fb9700 1 --2- 172.21.15.31:0/1406402153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f00067c30 0x7f5f0009fbb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009910 tx=0x7f5ef40091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.247+0000 7f5f06fb9700 1 -- 172.21.15.31:0/1406402153 shutdown_connections 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.247+0000 7f5f06fb9700 1 --2- 172.21.15.31:0/1406402153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f00067c30 0x7f5f0009fbb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.247+0000 7f5f06fb9700 1 --2- 172.21.15.31:0/1406402153 >> v2:172.21.15.31:3300/0 conn(0x7f5f000a0420 0x7f5f000a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.247+0000 7f5f06fb9700 1 -- 172.21.15.31:0/1406402153 >> 172.21.15.31:0/1406402153 conn(0x7f5f000b20d0 msgr2=0x7f5f000b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.247+0000 7f5f06fb9700 1 -- 172.21.15.31:0/1406402153 shutdown_connections 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.247+0000 7f5f06fb9700 1 -- 172.21.15.31:0/1406402153 wait complete. 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.247+0000 7f5f06fb9700 1 Processor -- start 2024-04-18T10:38:53.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f06fb9700 1 -- start start 2024-04-18T10:38:53.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f06fb9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5f00067c30 0x7f5f0006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f06fb9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000a0420 0x7f5f00151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f06fb9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f000a1ed0 0x7f5f00152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f06fb9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006dec0 con 0x7f5f000a0420 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f06fb9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006dc00 con 0x7f5f000a1ed0 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f06fb9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0006cef0 con 0x7f5f00067c30 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f04d55700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5f00067c30 0x7f5f0006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5efffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000a0420 0x7f5f00151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f04d55700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5f00067c30 0x7f5f0006d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50642/0 (socket says 172.21.15.31:50642) 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5efffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000a0420 0x7f5f00151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57240/0 (socket says 172.21.15.31:57240) 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f04d55700 1 -- 172.21.15.31:0/901345033 learned_addr learned my addr 172.21.15.31:0/901345033 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.248+0000 7f5f05556700 1 --2- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f000a1ed0 0x7f5f00152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5f04d55700 1 -- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f000a1ed0 msgr2=0x7f5f00152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5f04d55700 1 --2- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f000a1ed0 0x7f5f00152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5f04d55700 1 -- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000a0420 msgr2=0x7f5f00151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5f04d55700 1 --2- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000a0420 0x7f5f00151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5f04d55700 1 -- 172.21.15.31:0/901345033 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec0094f0 con 0x7f5f00067c30 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5efffff700 1 --2- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000a0420 0x7f5f00151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5f04d55700 1 --2- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5f00067c30 0x7f5f0006d270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009fb0 tx=0x7f5ef4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5efcff9700 1 -- 172.21.15.31:0/901345033 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef401f070 con 0x7f5f00067c30 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5efcff9700 1 -- 172.21.15.31:0/901345033 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400bed0 con 0x7f5f00067c30 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef4009420 con 0x7f5f00067c30 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5efcff9700 1 -- 172.21.15.31:0/901345033 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400bb40 con 0x7f5f00067c30 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.249+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0006d7b0 con 0x7f5f00067c30 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.250+0000 7f5efcff9700 1 -- 172.21.15.31:0/901345033 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f5ef4011630 con 0x7f5f00067c30 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.250+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0006d9a0 con 0x7f5f00067c30 2024-04-18T10:38:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.250+0000 7f5efcff9700 1 -- 172.21.15.31:0/901345033 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5ef405c4c0 con 0x7f5f00067c30 2024-04-18T10:38:53.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.254+0000 7f5efcff9700 1 -- 172.21.15.31:0/901345033 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5ef402ee80 con 0x7f5f00067c30 2024-04-18T10:38:53.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.418+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5f0005f5f0 con 0x7f5f00067c30 2024-04-18T10:38:53.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.419+0000 7f5efcff9700 1 -- 172.21.15.31:0/901345033 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v36) v1 ==== 81+0+21158 (secure 0 0 0) 0x7f5ef4028070 con 0x7f5f00067c30 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 36, 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: "fsid": "2dc05854-5716-4ea6-add8-fd949f4dd05c", 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2024-04-18T10:35:48.469780+0000", 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2024-04-18T10:38:52.565150+0000", 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: "last_up_change": "2024-04-18T10:38:47.487613+0000", 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: "last_in_change": "2024-04-18T10:35:55.406271+0000", 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_num": 5799936, 2024-04-18T10:38:53.420 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_set": [ 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "pglog_hardlimit", 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "purged_snapdirs", 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_deletes", 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "sortbitwise" 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_version": 8, 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "full_ratio": 0.94999998807907104, 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_snapshot": "", 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_max": 4, 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd": 4, 2024-04-18T10:38:53.421 INFO:teuthology.orchestra.run.smithi031.stdout: "require_min_compat_client": "octopus", 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "min_compat_client": "jewel", 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "require_osd_release": "octopus", 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "pools": [ 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 1, 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": ".mgr", 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2024-04-18T10:35:51.422706+0000", 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2024-04-18T10:38:53.422 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 1, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 1, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 1, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 1, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 1, 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2024-04-18T10:38:53.423 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "23", 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2024-04-18T10:38:53.424 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T10:38:53.425 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2024-04-18T10:38:53.426 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 1 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": {}, 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr_devicehealth": {} 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 2, 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "rbd", 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2024-04-18T10:35:58.551846+0000", 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T10:38:53.428 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 8, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 8, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 8, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 8, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 8, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2024-04-18T10:38:53.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "15", 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2024-04-18T10:38:53.430 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.431 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "options": {}, 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd": {} 2024-04-18T10:38:53.432 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 3, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_metadata", 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2024-04-18T10:36:07.428725+0000", 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T10:38:53.433 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 32, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 32, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 32, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 32, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 32, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2024-04-18T10:38:53.434 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "18", 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2024-04-18T10:38:53.435 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2024-04-18T10:38:53.436 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_bias": 4, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 16, 2024-04-18T10:38:53.437 INFO:teuthology.orchestra.run.smithi031.stdout: "recovery_priority": 5 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": "cephfs" 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: "pool": 4, 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": "cephfs_data", 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: "create_time": "2024-04-18T10:36:07.976197+0000", 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-04-18T10:38:53.438 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_names": "hashpspool", 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "type": 1, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 2, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": 1, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_rule": 0, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_count": 0, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_target": 0, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_barrier": 0, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "object_hash": 2, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscale_mode": "off", 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": 64, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num": 64, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_placement_num_target": 64, 2024-04-18T10:38:53.439 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_target": 64, 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_pending": 64, 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "last_pg_merge_meta": { 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "source_pgid": "0.0", 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "ready_epoch": 0, 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_started": 0, 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "last_epoch_clean": 0, 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "source_version": "0'0", 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "target_version": "0'0" 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "last_change": "19", 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend": "0", 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-18T10:38:53.440 INFO:teuthology.orchestra.run.smithi031.stdout: "last_force_op_resend_preluminous": "0", 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "auid": 0, 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_mode": "selfmanaged", 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_seq": 0, 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "snap_epoch": 0, 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_snaps": [], 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps": "[]", 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_bytes": 0, 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "quota_max_objects": 0, 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "tiers": [], 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "tier_of": -1, 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "read_tier": -1, 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "write_tier": -1, 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_mode": "none", 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_bytes": 0, 2024-04-18T10:38:53.441 INFO:teuthology.orchestra.run.smithi031.stdout: "target_max_objects": 0, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_flush_age": 0, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "cache_min_evict_age": 0, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profile": "", 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_params": { 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "none" 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_period": 0, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_count": 0, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "use_gmt_hitset": true, 2024-04-18T10:38:53.442 INFO:teuthology.orchestra.run.smithi031.stdout: "min_read_recency_for_promote": 0, 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "min_write_recency_for_promote": 0, 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_grade_decay_rate": 0, 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "hit_set_search_last_n": 0, 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "grade_table": [], 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "stripe_width": 0, 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "expected_num_objects": 0, 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "fast_read": false, 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "options": { 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num_min": 64, 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "target_size_ratio": 0.89999997615814209 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "application_metadata": { 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "cephfs": { 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: "data": "cephfs" 2024-04-18T10:38:53.443 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "osds": [ 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "26ab35e2-f662-41bb-84a6-ae50230f2ff5", 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 10, 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 23, 2024-04-18T10:38:53.444 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 29, 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 32, 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 24, 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6800", 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49212 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.445 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6801", 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49212 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6803", 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49212 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.446 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6802", 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49212 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6800/49212", 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6801/49212", 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6803/49212", 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6802/49212", 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2024-04-18T10:38:53.447 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "4e922862-50c2-4a41-8eba-8450b48538a9", 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 10, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 24, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 30, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 32, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 25, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2024-04-18T10:38:53.448 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6804", 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49310 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6805", 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49310 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.449 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6807", 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49310 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.450 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6806", 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49310 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6804/49310", 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6805/49310", 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6807/49310", 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6806/49310", 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "e7051e98-337d-4aee-91e3-86589be64be4", 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 10, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 25, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 31, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 32, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 26, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6808", 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49420 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6809", 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49420 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6811", 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49420 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.454 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6810", 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49420 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6808/49420", 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6809/49420", 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6811/49420", 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6810/49420", 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "uuid": "b3017445-c716-4557-9ef9-5cd838ef1cdf", 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "up": 1, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "in": 1, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "weight": 1, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_affinity": 1, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_begin": 10, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "last_clean_end": 26, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "up_from": 32, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "up_thru": 32, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "down_at": 27, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "lost_at": 0, 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addrs": { 2024-04-18T10:38:53.456 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6812", 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49601 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addrs": { 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6813", 2024-04-18T10:38:53.457 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49601 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addrs": { 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6815", 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49601 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.458 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addrs": { 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6814", 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 49601 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "public_addr": "172.21.15.31:6812/49601", 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_addr": "172.21.15.31:6813/49601", 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_back_addr": "172.21.15.31:6815/49601", 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "heartbeat_front_addr": "172.21.15.31:6814/49601", 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "state": [ 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "exists", 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: "up" 2024-04-18T10:38:53.459 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_xinfo": [ 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 0, 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2024-04-18T10:35:53.404673+0000", 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 24 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.460 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 1, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2024-04-18T10:35:53.409390+0000", 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 25 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 2, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "0.000000", 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2024-04-18T10:38:53.461 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2024-04-18T10:35:53.445864+0000", 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 26 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": 3, 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "down_stamp": "2024-04-18T10:38:41.447571+0000", 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_probability": 0, 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "laggy_interval": 0, 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "old_weight": 0, 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "last_purged_snaps_scrub": "2024-04-18T10:35:53.480148+0000", 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "dead_epoch": 0 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-18T10:38:53.462 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap": [], 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_upmap_items": [], 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_temp": [], 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "primary_temp": [], 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklist": { 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.31:6819/3321563080": "2024-04-19T10:38:52.565121+0000", 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.31:0/2921291208": "2024-04-19T10:38:28.389077+0000", 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.31:0/2767636595": "2024-04-19T10:38:28.389077+0000", 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.31:0/3252462560": "2024-04-19T10:38:28.389077+0000", 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.31:6816/39551": "2024-04-19T10:38:28.389077+0000" 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "range_blocklist": {}, 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "erasure_code_profiles": { 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "default": { 2024-04-18T10:38:53.463 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-failure-domain": "osd", 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "k": "2", 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "m": "1", 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "plugin": "jerasure", 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "technique": "reed_sol_van" 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "removed_snaps_queue": [], 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "new_removed_snaps": [], 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "new_purged_snaps": [], 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_node_flags": {}, 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "device_class_flags": {}, 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode": { 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_enabled": false, 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_bucket_count": 0, 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "degraded_stretch_mode": 0, 2024-04-18T10:38:53.464 INFO:teuthology.orchestra.run.smithi031.stdout: "recovering_stretch_mode": 0, 2024-04-18T10:38:53.465 INFO:teuthology.orchestra.run.smithi031.stdout: "stretch_mode_bucket": 0 2024-04-18T10:38:53.465 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:38:53.465 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:38:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 >> v1:172.21.15.31:6816/46601 conn(0x7f5ee4046010 legacy=0x7f5ee40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5f00067c30 msgr2=0x7f5f0006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 --2- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5f00067c30 0x7f5f0006d270 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009fb0 tx=0x7f5ef4017000 comp rx=0 tx=0).stop 2024-04-18T10:38:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 shutdown_connections 2024-04-18T10:38:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 --2- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5f00067c30 0x7f5f0006d270 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 --2- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5f000a1ed0 0x7f5f00152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 --2- 172.21.15.31:0/901345033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000a0420 0x7f5f00151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 >> 172.21.15.31:0/901345033 conn(0x7f5f000b20d0 msgr2=0x7f5f00070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 shutdown_connections 2024-04-18T10:38:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.421+0000 7f5f06fb9700 1 -- 172.21.15.31:0/901345033 wait complete. 2024-04-18T10:38:53.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release quincy' 2024-04-18T10:38:53.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.589+0000 7f5cdd7e3700 1 Processor -- start 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.589+0000 7f5cdd7e3700 1 -- start start 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.589+0000 7f5cdd7e3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a1f80 0x7f5cd806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.589+0000 7f5cdd7e3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 0x7f5cd80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.589+0000 7f5cdd7e3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd806d920 con 0x7f5cd80a3a90 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.589+0000 7f5cdd7e3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80a3f20 con 0x7f5cd80b20e0 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.589+0000 7f5cdd7e3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80a41c0 con 0x7f5cd80a1f80 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd67fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 0x7f5cd80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd6ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a1f80 0x7f5cd806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd77fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5cd80a3a90 0x7f5cd80679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38046/0 (socket says 172.21.15.31:38046) 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd77fe700 1 -- 172.21.15.31:0/3161968336 learned_addr learned my addr 172.21.15.31:0/3161968336 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd5ffb700 1 -- 172.21.15.31:0/3161968336 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202259614 0 0) 0x7f5cd806d920 con 0x7f5cd80a3a90 2024-04-18T10:38:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd67fc700 1 -- 172.21.15.31:0/3161968336 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a1f80 msgr2=0x7f5cd806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd67fc700 1 --2- 172.21.15.31:0/3161968336 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a1f80 0x7f5cd806d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd67fc700 1 -- 172.21.15.31:0/3161968336 >> v1:172.21.15.31:6789/0 conn(0x7f5cd80a3a90 legacy=0x7f5cd80679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd67fc700 1 -- 172.21.15.31:0/3161968336 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd80a4a10 con 0x7f5cd80b20e0 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd6ffd700 1 --2- 172.21.15.31:0/3161968336 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a1f80 0x7f5cd806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd67fc700 1 --2- 172.21.15.31:0/3161968336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 0x7f5cd80a3550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009910 tx=0x7f5ccc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9caf7a6d96621a10 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd5ffb700 1 -- 172.21.15.31:0/3161968336 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00b680 con 0x7f5cd80b20e0 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd5ffb700 1 -- 172.21.15.31:0/3161968336 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00b7e0 con 0x7f5cd80b20e0 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.590+0000 7f5cd5ffb700 1 -- 172.21.15.31:0/3161968336 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00bba0 con 0x7f5cd80b20e0 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.591+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3161968336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 msgr2=0x7f5cd80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.591+0000 7f5cdd7e3700 1 --2- 172.21.15.31:0/3161968336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 0x7f5cd80a3550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009910 tx=0x7f5ccc0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.591+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3161968336 shutdown_connections 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.591+0000 7f5cdd7e3700 1 --2- 172.21.15.31:0/3161968336 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a1f80 0x7f5cd806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.591+0000 7f5cdd7e3700 1 --2- 172.21.15.31:0/3161968336 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 0x7f5cd80a3550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.591+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3161968336 >> 172.21.15.31:0/3161968336 conn(0x7f5cd806c1b0 msgr2=0x7f5cd806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:53.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.591+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3161968336 shutdown_connections 2024-04-18T10:38:53.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.591+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3161968336 wait complete. 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.592+0000 7f5cdd7e3700 1 Processor -- start 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.592+0000 7f5cdd7e3700 1 -- start start 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.592+0000 7f5cdd7e3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cd80a1f80 0x7f5cd8097ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.592+0000 7f5cdd7e3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a3a90 0x7f5cd8151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.592+0000 7f5cdd7e3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 0x7f5cd8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.592+0000 7f5cdd7e3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8098430 con 0x7f5cd80a1f80 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.592+0000 7f5cdd7e3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8098c70 con 0x7f5cd80b20e0 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.592+0000 7f5cdd7e3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80ab870 con 0x7f5cd80a3a90 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd67fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a3a90 0x7f5cd8151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd77fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 0x7f5cd8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd67fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a3a90 0x7f5cd8151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50662/0 (socket says 172.21.15.31:50662) 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd67fc700 1 -- 172.21.15.31:0/3731724995 learned_addr learned my addr 172.21.15.31:0/3731724995 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd6ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cd80a1f80 0x7f5cd8097ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd67fc700 1 -- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 msgr2=0x7f5cd8151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd67fc700 1 --2- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 0x7f5cd8151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd67fc700 1 -- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cd80a1f80 msgr2=0x7f5cd8097ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd67fc700 1 --2- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cd80a1f80 0x7f5cd8097ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd67fc700 1 -- 172.21.15.31:0/3731724995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc8009420 con 0x7f5cd80a3a90 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd6ffd700 1 --2- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cd80a1f80 0x7f5cd8097ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cd67fc700 1 --2- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a3a90 0x7f5cd8151920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5cd806dab0 tx=0x7f5ccc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cbeffd700 1 -- 172.21.15.31:0/3731724995 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc00bb60 con 0x7f5cd80a3a90 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cbeffd700 1 -- 172.21.15.31:0/3731724995 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc000c90 con 0x7f5cd80a3a90 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc009420 con 0x7f5cd80a3a90 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cbeffd700 1 -- 172.21.15.31:0/3731724995 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc01a680 con 0x7f5cd80a3a90 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.593+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd8098990 con 0x7f5cd80a3a90 2024-04-18T10:38:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.594+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd805f5f0 con 0x7f5cd80a3a90 2024-04-18T10:38:53.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.594+0000 7f5cbeffd700 1 -- 172.21.15.31:0/3731724995 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f5ccc01aa70 con 0x7f5cd80a3a90 2024-04-18T10:38:53.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.595+0000 7f5cbeffd700 1 -- 172.21.15.31:0/3731724995 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5ccc05ccd0 con 0x7f5cd80a3a90 2024-04-18T10:38:53.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.598+0000 7f5cbeffd700 1 -- 172.21.15.31:0/3731724995 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5ccc0071b0 con 0x7f5cd80a3a90 2024-04-18T10:38:53.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:53.773+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "quincy"} v 0) v1 -- 0x7f5cd80b1aa0 con 0x7f5cd80a3a90 2024-04-18T10:38:54.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.588+0000 7f5cbeffd700 1 -- 172.21.15.31:0/3731724995 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "quincy"}]=0 v37) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5ccc015020 con 0x7f5cd80a3a90 2024-04-18T10:38:54.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.591+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 >> v1:172.21.15.31:6816/46601 conn(0x7f5cc4046010 legacy=0x7f5cc40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:54.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.591+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a3a90 msgr2=0x7f5cd8151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:54.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.591+0000 7f5cdd7e3700 1 --2- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a3a90 0x7f5cd8151920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5cd806dab0 tx=0x7f5ccc017000 comp rx=0 tx=0).stop 2024-04-18T10:38:54.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.592+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 shutdown_connections 2024-04-18T10:38:54.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.592+0000 7f5cdd7e3700 1 --2- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5cd80b20e0 0x7f5cd8151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.592+0000 7f5cdd7e3700 1 --2- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cd80a1f80 0x7f5cd8097ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.592+0000 7f5cdd7e3700 1 --2- 172.21.15.31:0/3731724995 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5cd80a3a90 0x7f5cd8151920 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.592+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 >> 172.21.15.31:0/3731724995 conn(0x7f5cd806c1b0 msgr2=0x7f5cd806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:54.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.592+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 shutdown_connections 2024-04-18T10:38:54.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.592+0000 7f5cdd7e3700 1 -- 172.21.15.31:0/3731724995 wait complete. 2024-04-18T10:38:54.607 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2024-04-18T10:38:54.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.731+0000 7f55a3300700 1 Processor -- start 2024-04-18T10:38:54.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a3300700 1 -- start start 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a3300700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a3300700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c0a2d20 0x7f559c06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a3300700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c06ef70 con 0x7f559c06a730 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a3300700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c06c1e0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a3300700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f559c06ded0 con 0x7f559c0a2d20 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a109c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a089b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c0a2d20 0x7f559c06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a109c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c0689f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53762/0 (socket says 172.21.15.31:53762) 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f55a109c700 1 -- 172.21.15.31:0/6623694 learned_addr learned my addr 172.21.15.31:0/6623694 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.732+0000 7f55a189d700 1 --1- 172.21.15.31:0/6623694 >> v1:172.21.15.31:6789/0 conn(0x7f559c06a730 0x7f559c148a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53210/0 (socket says 172.21.15.31:53210) 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f55a089b700 1 -- 172.21.15.31:0/6623694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 msgr2=0x7f559c0689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f55a089b700 1 --2- 172.21.15.31:0/6623694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c0689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f55a089b700 1 -- 172.21.15.31:0/6623694 >> v1:172.21.15.31:6789/0 conn(0x7f559c06a730 legacy=0x7f559c148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f5593fff700 1 -- 172.21.15.31:0/6623694 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169707839 0 0) 0x7f559c06ef70 con 0x7f559c06a730 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f55a089b700 1 -- 172.21.15.31:0/6623694 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c06e670 con 0x7f559c0a2d20 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f55a109c700 1 --2- 172.21.15.31:0/6623694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c0689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f55a089b700 1 --2- 172.21.15.31:0/6623694 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c0a2d20 0x7f559c06a1f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5598009970 tx=0x7f55980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ef2b1fae33df65 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f5593fff700 1 -- 172.21.15.31:0/6623694 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598009e60 con 0x7f559c0a2d20 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f5593fff700 1 -- 172.21.15.31:0/6623694 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559800b870 con 0x7f559c0a2d20 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.733+0000 7f5593fff700 1 -- 172.21.15.31:0/6623694 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559800bc10 con 0x7f559c0a2d20 2024-04-18T10:38:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.734+0000 7f55a3300700 1 -- 172.21.15.31:0/6623694 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c0a2d20 msgr2=0x7f559c06a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.734+0000 7f55a3300700 1 --2- 172.21.15.31:0/6623694 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c0a2d20 0x7f559c06a1f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5598009970 tx=0x7f55980091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.734+0000 7f55a3300700 1 -- 172.21.15.31:0/6623694 shutdown_connections 2024-04-18T10:38:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.734+0000 7f55a3300700 1 --2- 172.21.15.31:0/6623694 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c0689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.734+0000 7f55a3300700 1 --2- 172.21.15.31:0/6623694 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c0a2d20 0x7f559c06a1f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.734+0000 7f55a3300700 1 -- 172.21.15.31:0/6623694 >> 172.21.15.31:0/6623694 conn(0x7f559c0b3260 msgr2=0x7f559c0b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.734+0000 7f55a3300700 1 -- 172.21.15.31:0/6623694 shutdown_connections 2024-04-18T10:38:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.734+0000 7f55a3300700 1 -- 172.21.15.31:0/6623694 wait complete. 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.735+0000 7f55a3300700 1 Processor -- start 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.735+0000 7f55a3300700 1 -- start start 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a3300700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c06a730 0x7f559c09a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a3300700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f559c0a2d20 0x7f559c097a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a3300700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a3300700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0983c0 con 0x7f559c0a2d20 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a3300700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c06e0d0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a3300700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0987e0 con 0x7f559c06a730 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a109c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c06a730 0x7f559c09a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a109c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c06a730 0x7f559c09a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43796/0 (socket says 172.21.15.31:43796) 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a109c700 1 -- 172.21.15.31:0/103214427 learned_addr learned my addr 172.21.15.31:0/103214427 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a089b700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f559c0a2d20 0x7f559c097a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a189d700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a189d700 1 -- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c06a730 msgr2=0x7f559c09a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a189d700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c06a730 0x7f559c09a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a189d700 1 -- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f559c0a2d20 msgr2=0x7f559c097a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a189d700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f559c0a2d20 0x7f559c097a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.736+0000 7f55a189d700 1 -- 172.21.15.31:0/103214427 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c0094f0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.737+0000 7f55a089b700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f559c0a2d20 0x7f559c097a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.737+0000 7f55a189d700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c151830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f559400cc90 tx=0x7f5594001a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.737+0000 7f55917fa700 1 -- 172.21.15.31:0/103214427 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594005df0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.737+0000 7f55917fa700 1 -- 172.21.15.31:0/103214427 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559400a6a0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.737+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5598009420 con 0x7f559c0b0ae0 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.737+0000 7f55917fa700 1 -- 172.21.15.31:0/103214427 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400aa60 con 0x7f559c0b0ae0 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.737+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c0992d0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.738+0000 7f55917fa700 1 -- 172.21.15.31:0/103214427 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f55940070f0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.738+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c09aae0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.738+0000 7f55917fa700 1 -- 172.21.15.31:0/103214427 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f559405b140 con 0x7f559c0b0ae0 2024-04-18T10:38:54.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.742+0000 7f55917fa700 1 -- 172.21.15.31:0/103214427 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f559c09aae0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.904+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f559c09aae0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.905+0000 7f55917fa700 1 -- 172.21.15.31:0/103214427 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v37) v1 ==== 59+0+37 (secure 0 0 0) 0x7f559c09aae0 con 0x7f559c0b0ae0 2024-04-18T10:38:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 >> v1:172.21.15.31:6816/46601 conn(0x7f5580046010 legacy=0x7f55800484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 msgr2=0x7f559c151830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c151830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f559400cc90 tx=0x7f5594001a60 comp rx=0 tx=0).stop 2024-04-18T10:38:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 shutdown_connections 2024-04-18T10:38:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f559c06a730 0x7f559c09a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f559c0b0ae0 0x7f559c151830 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 --2- 172.21.15.31:0/103214427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f559c0a2d20 0x7f559c097a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 >> 172.21.15.31:0/103214427 conn(0x7f559c0b3260 msgr2=0x7f559c0a4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 shutdown_connections 2024-04-18T10:38:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:54.906+0000 7f55a3300700 1 -- 172.21.15.31:0/103214427 wait complete. 2024-04-18T10:38:55.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.012+0000 7fc88fba9700 1 Processor -- start 2024-04-18T10:38:55.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.012+0000 7fc88fba9700 1 -- start start 2024-04-18T10:38:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88fba9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888064e20 0x7fc8880acb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88fba9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc888141fe0 0x7fc8881423d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88fba9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880ac3c0 con 0x7fc888142910 2024-04-18T10:38:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88fba9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880abdf0 con 0x7fc888141fe0 2024-04-18T10:38:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88fba9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880a9c50 con 0x7fc888064e20 2024-04-18T10:38:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88d144700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc888141fe0 0x7fc8881423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88d945700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888064e20 0x7fc8880acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88e146700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc888142910 0x7fc8880adfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53224/0 (socket says 172.21.15.31:53224) 2024-04-18T10:38:55.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88e146700 1 -- 172.21.15.31:0/20652616 learned_addr learned my addr 172.21.15.31:0/20652616 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88d945700 1 -- 172.21.15.31:0/20652616 >> v2:172.21.15.31:3300/0 conn(0x7fc888141fe0 msgr2=0x7fc8881423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88d945700 1 --2- 172.21.15.31:0/20652616 >> v2:172.21.15.31:3300/0 conn(0x7fc888141fe0 0x7fc8881423d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88d945700 1 -- 172.21.15.31:0/20652616 >> v1:172.21.15.31:6789/0 conn(0x7fc888142910 legacy=0x7fc8880adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88d945700 1 -- 172.21.15.31:0/20652616 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880ad090 con 0x7fc888064e20 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88d144700 1 --2- 172.21.15.31:0/20652616 >> v2:172.21.15.31:3300/0 conn(0x7fc888141fe0 0x7fc8881423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88d945700 1 --2- 172.21.15.31:0/20652616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888064e20 0x7fc8880acb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc884009910 tx=0x7fc8840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c17546a0ef4dbe server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88c943700 1 -- 172.21.15.31:0/20652616 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88400b640 con 0x7fc888064e20 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88c943700 1 -- 172.21.15.31:0/20652616 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88400b7a0 con 0x7fc888064e20 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.013+0000 7fc88c943700 1 -- 172.21.15.31:0/20652616 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88400bb60 con 0x7fc888064e20 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.014+0000 7fc88fba9700 1 -- 172.21.15.31:0/20652616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888064e20 msgr2=0x7fc8880acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.014+0000 7fc88fba9700 1 --2- 172.21.15.31:0/20652616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888064e20 0x7fc8880acb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc884009910 tx=0x7fc8840091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.014+0000 7fc88fba9700 1 -- 172.21.15.31:0/20652616 shutdown_connections 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.014+0000 7fc88fba9700 1 --2- 172.21.15.31:0/20652616 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888064e20 0x7fc8880acb50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.014+0000 7fc88fba9700 1 --2- 172.21.15.31:0/20652616 >> v2:172.21.15.31:3300/0 conn(0x7fc888141fe0 0x7fc8881423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.014+0000 7fc88fba9700 1 -- 172.21.15.31:0/20652616 >> 172.21.15.31:0/20652616 conn(0x7fc88806a1f0 msgr2=0x7fc8880679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:55.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.014+0000 7fc88fba9700 1 -- 172.21.15.31:0/20652616 shutdown_connections 2024-04-18T10:38:55.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.014+0000 7fc88fba9700 1 -- 172.21.15.31:0/20652616 wait complete. 2024-04-18T10:38:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.015+0000 7fc88fba9700 1 Processor -- start 2024-04-18T10:38:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.015+0000 7fc88fba9700 1 -- start start 2024-04-18T10:38:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88fba9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc888064e20 0x7fc88806ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88fba9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888141fe0 0x7fc88813bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88fba9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc888142910 0x7fc88813c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88fba9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888099b60 con 0x7fc888064e20 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88fba9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88806f190 con 0x7fc888141fe0 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88fba9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc88806f450 con 0x7fc888142910 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d144700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888141fe0 0x7fc88813bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d945700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc888064e20 0x7fc88806ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d144700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888141fe0 0x7fc88813bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53788/0 (socket says 172.21.15.31:53788) 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d144700 1 -- 172.21.15.31:0/1693985982 learned_addr learned my addr 172.21.15.31:0/1693985982 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88e146700 1 --2- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc888142910 0x7fc88813c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d945700 1 -- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc888142910 msgr2=0x7fc88813c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d945700 1 --2- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc888142910 0x7fc88813c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d945700 1 -- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888141fe0 msgr2=0x7fc88813bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d945700 1 --2- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888141fe0 0x7fc88813bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d945700 1 -- 172.21.15.31:0/1693985982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878009420 con 0x7fc888064e20 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d144700 1 --2- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888141fe0 0x7fc88813bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88d945700 1 --2- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc888064e20 0x7fc88806ebb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc884016000 tx=0x7fc884017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc87dffb700 1 -- 172.21.15.31:0/1693985982 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88401f070 con 0x7fc888064e20 2024-04-18T10:38:55.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc87dffb700 1 -- 172.21.15.31:0/1693985982 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88400bb20 con 0x7fc888064e20 2024-04-18T10:38:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc884009420 con 0x7fc888064e20 2024-04-18T10:38:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.016+0000 7fc87dffb700 1 -- 172.21.15.31:0/1693985982 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884011690 con 0x7fc888064e20 2024-04-18T10:38:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.017+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc888098630 con 0x7fc888064e20 2024-04-18T10:38:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.018+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88806e860 con 0x7fc888064e20 2024-04-18T10:38:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.018+0000 7fc87dffb700 1 -- 172.21.15.31:0/1693985982 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fc884011a40 con 0x7fc888064e20 2024-04-18T10:38:55.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.018+0000 7fc87dffb700 1 -- 172.21.15.31:0/1693985982 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fc88405c3f0 con 0x7fc888064e20 2024-04-18T10:38:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.022+0000 7fc87dffb700 1 -- 172.21.15.31:0/1693985982 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fc88402eb50 con 0x7fc888064e20 2024-04-18T10:38:55.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.184+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fc88805f5f0 con 0x7fc888064e20 2024-04-18T10:38:55.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.591+0000 7fc87dffb700 1 -- 172.21.15.31:0/1693985982 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v38) v1 ==== 153+0+0 (secure 0 0 0) 0x7fc8840150b0 con 0x7fc888064e20 2024-04-18T10:38:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.595+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 >> v1:172.21.15.31:6816/46601 conn(0x7fc86c046010 legacy=0x7fc86c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.595+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc888064e20 msgr2=0x7fc88806ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.595+0000 7fc88fba9700 1 --2- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc888064e20 0x7fc88806ebb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc884016000 tx=0x7fc884017000 comp rx=0 tx=0).stop 2024-04-18T10:38:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.595+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 shutdown_connections 2024-04-18T10:38:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.595+0000 7fc88fba9700 1 --2- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc888142910 0x7fc88813c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.595+0000 7fc88fba9700 1 --2- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc888064e20 0x7fc88806ebb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.595+0000 7fc88fba9700 1 --2- 172.21.15.31:0/1693985982 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc888141fe0 0x7fc88813bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.595+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 >> 172.21.15.31:0/1693985982 conn(0x7fc88806a1f0 msgr2=0x7fc8880b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.596+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 shutdown_connections 2024-04-18T10:38:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.596+0000 7fc88fba9700 1 -- 172.21.15.31:0/1693985982 wait complete. 2024-04-18T10:38:55.597 INFO:teuthology.orchestra.run.smithi031.stderr:set pool 1 pg_autoscale_mode to off 2024-04-18T10:38:55.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.708+0000 7ff352f31700 1 Processor -- start 2024-04-18T10:38:55.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.708+0000 7ff352f31700 1 -- start start 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff352f31700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c064020 0x7ff34c06e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff352f31700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c06f980 0x7ff34c13cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff352f31700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c06d4f0 con 0x7ff34c13d0a0 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff352f31700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c06edc0 con 0x7ff34c06f980 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff352f31700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c06e990 con 0x7ff34c064020 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff34bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c06f980 0x7ff34c13cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff350ccd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c064020 0x7ff34c06e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff350ccd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c064020 0x7ff34c06e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43812/0 (socket says 172.21.15.31:43812) 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff34bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c06f980 0x7ff34c13cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53798/0 (socket says 172.21.15.31:53798) 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff350ccd700 1 -- 172.21.15.31:0/195931026 learned_addr learned my addr 172.21.15.31:0/195931026 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:55.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff3514ce700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff34c13d0a0 0x7ff34c0679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53226/0 (socket says 172.21.15.31:53226) 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff350ccd700 1 -- 172.21.15.31:0/195931026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c06f980 msgr2=0x7ff34c13cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff350ccd700 1 --2- 172.21.15.31:0/195931026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c06f980 0x7ff34c13cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff34b7fe700 1 -- 172.21.15.31:0/195931026 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268445023 0 0) 0x7ff34c06d4f0 con 0x7ff34c13d0a0 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff350ccd700 1 -- 172.21.15.31:0/195931026 >> v1:172.21.15.31:6789/0 conn(0x7ff34c13d0a0 legacy=0x7ff34c0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff350ccd700 1 -- 172.21.15.31:0/195931026 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c06aa20 con 0x7ff34c064020 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff34bfff700 1 --2- 172.21.15.31:0/195931026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c06f980 0x7ff34c13cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.709+0000 7ff350ccd700 1 --2- 172.21.15.31:0/195931026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c064020 0x7ff34c06e450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3400099e0 tx=0x7ff340009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f28c814203ec95 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff34b7fe700 1 -- 172.21.15.31:0/195931026 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000b860 con 0x7ff34c064020 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff34b7fe700 1 -- 172.21.15.31:0/195931026 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34000b9c0 con 0x7ff34c064020 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff34b7fe700 1 -- 172.21.15.31:0/195931026 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000bd60 con 0x7ff34c064020 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff352f31700 1 -- 172.21.15.31:0/195931026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c064020 msgr2=0x7ff34c06e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff352f31700 1 --2- 172.21.15.31:0/195931026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c064020 0x7ff34c06e450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff3400099e0 tx=0x7ff340009250 comp rx=0 tx=0).stop 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff352f31700 1 -- 172.21.15.31:0/195931026 shutdown_connections 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff352f31700 1 --2- 172.21.15.31:0/195931026 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c064020 0x7ff34c06e450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff352f31700 1 --2- 172.21.15.31:0/195931026 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c06f980 0x7ff34c13cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff352f31700 1 -- 172.21.15.31:0/195931026 >> 172.21.15.31:0/195931026 conn(0x7ff34c06a4c0 msgr2=0x7ff34c0636c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff352f31700 1 -- 172.21.15.31:0/195931026 shutdown_connections 2024-04-18T10:38:55.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.710+0000 7ff352f31700 1 -- 172.21.15.31:0/195931026 wait complete. 2024-04-18T10:38:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.711+0000 7ff352f31700 1 Processor -- start 2024-04-18T10:38:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff352f31700 1 -- start start 2024-04-18T10:38:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff352f31700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c064020 0x7ff34c1386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff352f31700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c06f980 0x7ff34c1370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff352f31700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c13d0a0 0x7ff34c135700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff352f31700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c13a3c0 con 0x7ff34c064020 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff352f31700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0a5e30 con 0x7ff34c13d0a0 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff352f31700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c137a70 con 0x7ff34c06f980 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff350ccd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c064020 0x7ff34c1386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff3514ce700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c13d0a0 0x7ff34c135700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff350ccd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c064020 0x7ff34c1386b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54216/0 (socket says 172.21.15.31:54216) 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff34bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c06f980 0x7ff34c1370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.712+0000 7ff350ccd700 1 -- 172.21.15.31:0/2685872461 learned_addr learned my addr 172.21.15.31:0/2685872461 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff3514ce700 1 -- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c06f980 msgr2=0x7ff34c1370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff3514ce700 1 --2- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c06f980 0x7ff34c1370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff3514ce700 1 -- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c064020 msgr2=0x7ff34c1386b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff3514ce700 1 --2- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c064020 0x7ff34c1386b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff3514ce700 1 -- 172.21.15.31:0/2685872461 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338009420 con 0x7ff34c13d0a0 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff34bfff700 1 --2- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c06f980 0x7ff34c1370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff350ccd700 1 --2- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c064020 0x7ff34c1386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:55.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff3514ce700 1 --2- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c13d0a0 0x7ff34c135700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff34400cbf0 tx=0x7ff3440019b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff348ff9700 1 -- 172.21.15.31:0/2685872461 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344005df0 con 0x7ff34c13d0a0 2024-04-18T10:38:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff348ff9700 1 -- 172.21.15.31:0/2685872461 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34400a6a0 con 0x7ff34c13d0a0 2024-04-18T10:38:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff348ff9700 1 -- 172.21.15.31:0/2685872461 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34400aa60 con 0x7ff34c13d0a0 2024-04-18T10:38:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3400094f0 con 0x7ff34c13d0a0 2024-04-18T10:38:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.713+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c0a6c10 con 0x7ff34c13d0a0 2024-04-18T10:38:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.714+0000 7ff348ff9700 1 -- 172.21.15.31:0/2685872461 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7ff3440070f0 con 0x7ff34c13d0a0 2024-04-18T10:38:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.714+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c05f5f0 con 0x7ff34c13d0a0 2024-04-18T10:38:55.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.715+0000 7ff348ff9700 1 -- 172.21.15.31:0/2685872461 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3883+0+0 (secure 0 0 0) 0x7ff34405ae60 con 0x7ff34c13d0a0 2024-04-18T10:38:55.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.718+0000 7ff348ff9700 1 -- 172.21.15.31:0/2685872461 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ff3440390a0 con 0x7ff34c13d0a0 2024-04-18T10:38:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:55.881+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7ff34c06d2d0 con 0x7ff34c13d0a0 2024-04-18T10:38:56.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.594+0000 7ff348ff9700 1 -- 172.21.15.31:0/2685872461 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v39) v1 ==== 152+0+0 (secure 0 0 0) 0x7ff34403c890 con 0x7ff34c13d0a0 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 >> v1:172.21.15.31:6816/46601 conn(0x7ff330046010 legacy=0x7ff3300484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c13d0a0 msgr2=0x7ff34c135700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 --2- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c13d0a0 0x7ff34c135700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff34400cbf0 tx=0x7ff3440019b0 comp rx=0 tx=0).stop 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 shutdown_connections 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 --2- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff34c13d0a0 0x7ff34c135700 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 --2- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c064020 0x7ff34c1386b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 --2- 172.21.15.31:0/2685872461 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff34c06f980 0x7ff34c1370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 >> 172.21.15.31:0/2685872461 conn(0x7ff34c06a4c0 msgr2=0x7ff34c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 shutdown_connections 2024-04-18T10:38:56.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.598+0000 7ff352f31700 1 -- 172.21.15.31:0/2685872461 wait complete. 2024-04-18T10:38:56.600 INFO:teuthology.orchestra.run.smithi031.stderr:set pool 2 pg_autoscale_mode to off 2024-04-18T10:38:56.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.712+0000 7fd295302700 1 Processor -- start 2024-04-18T10:38:56.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.712+0000 7fd295302700 1 -- start start 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd295302700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd2900a5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd295302700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2900a3690 0x7fd29013cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd295302700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2900a3b50 con 0x7fd29013d2a0 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd295302700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2900a5ec0 con 0x7fd2900a3690 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd295302700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900a49a0 con 0x7fd2900a45d0 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd2900a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2900a3690 0x7fd29013cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd2900a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53818/0 (socket says 172.21.15.31:53818) 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2900a3690 0x7fd29013cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54230/0 (socket says 172.21.15.31:54230) 2024-04-18T10:38:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd29013d2a0 0x7fd29013fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53230/0 (socket says 172.21.15.31:53230) 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28effd700 1 -- 172.21.15.31:0/1822054827 learned_addr learned my addr 172.21.15.31:0/1822054827 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28effd700 1 -- 172.21.15.31:0/1822054827 >> v2:172.21.15.31:3300/0 conn(0x7fd2900a3690 msgr2=0x7fd29013cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28effd700 1 --2- 172.21.15.31:0/1822054827 >> v2:172.21.15.31:3300/0 conn(0x7fd2900a3690 0x7fd29013cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28effd700 1 -- 172.21.15.31:0/1822054827 >> v1:172.21.15.31:6789/0 conn(0x7fd29013d2a0 legacy=0x7fd29013fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28effd700 1 -- 172.21.15.31:0/1822054827 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29006e130 con 0x7fd2900a45d0 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28dffb700 1 -- 172.21.15.31:0/1822054827 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761282397 0 0) 0x7fd2900a3b50 con 0x7fd29013d2a0 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.713+0000 7fd28e7fc700 1 --2- 172.21.15.31:0/1822054827 >> v2:172.21.15.31:3300/0 conn(0x7fd2900a3690 0x7fd29013cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd28effd700 1 --2- 172.21.15.31:0/1822054827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd2900a5980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2840099e0 tx=0x7fd284009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a838ceb932372638 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd28dffb700 1 -- 172.21.15.31:0/1822054827 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400b820 con 0x7fd2900a45d0 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd28dffb700 1 -- 172.21.15.31:0/1822054827 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28400b980 con 0x7fd2900a45d0 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd28dffb700 1 -- 172.21.15.31:0/1822054827 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400bd20 con 0x7fd2900a45d0 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd295302700 1 -- 172.21.15.31:0/1822054827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 msgr2=0x7fd2900a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:56.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd295302700 1 --2- 172.21.15.31:0/1822054827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd2900a5980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2840099e0 tx=0x7fd284009250 comp rx=0 tx=0).stop 2024-04-18T10:38:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd295302700 1 -- 172.21.15.31:0/1822054827 shutdown_connections 2024-04-18T10:38:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd295302700 1 --2- 172.21.15.31:0/1822054827 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd2900a5980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd295302700 1 --2- 172.21.15.31:0/1822054827 >> v2:172.21.15.31:3300/0 conn(0x7fd2900a3690 0x7fd29013cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd295302700 1 -- 172.21.15.31:0/1822054827 >> 172.21.15.31:0/1822054827 conn(0x7fd2900636c0 msgr2=0x7fd290063ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd295302700 1 -- 172.21.15.31:0/1822054827 shutdown_connections 2024-04-18T10:38:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.714+0000 7fd295302700 1 -- 172.21.15.31:0/1822054827 wait complete. 2024-04-18T10:38:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.715+0000 7fd295302700 1 Processor -- start 2024-04-18T10:38:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.715+0000 7fd295302700 1 -- start start 2024-04-18T10:38:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd295302700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2900a3690 0x7fd290140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd295302700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd29013da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd295302700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd29013d2a0 0x7fd290138b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd295302700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29013e380 con 0x7fd29013d2a0 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd295302700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29013e640 con 0x7fd2900a45d0 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd295302700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd29006b760 con 0x7fd2900a3690 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd29013da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd29013d2a0 0x7fd290138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28e7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd29013da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53820/0 (socket says 172.21.15.31:53820) 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28e7fc700 1 -- 172.21.15.31:0/120897552 learned_addr learned my addr 172.21.15.31:0/120897552 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28effd700 1 --2- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2900a3690 0x7fd290140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28e7fc700 1 -- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2900a3690 msgr2=0x7fd290140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28e7fc700 1 --2- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2900a3690 0x7fd290140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28e7fc700 1 -- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd29013d2a0 msgr2=0x7fd290138b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28e7fc700 1 --2- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd29013d2a0 0x7fd290138b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28e7fc700 1 -- 172.21.15.31:0/120897552 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd280009420 con 0x7fd2900a45d0 2024-04-18T10:38:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.716+0000 7fd28f7fe700 1 --2- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd29013d2a0 0x7fd290138b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.717+0000 7fd28e7fc700 1 --2- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd29013da90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd28000ec50 tx=0x7fd2800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.717+0000 7fd276ffd700 1 -- 172.21.15.31:0/120897552 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000c850 con 0x7fd2900a45d0 2024-04-18T10:38:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.717+0000 7fd276ffd700 1 -- 172.21.15.31:0/120897552 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28000c9b0 con 0x7fd2900a45d0 2024-04-18T10:38:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.717+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2840094f0 con 0x7fd2900a45d0 2024-04-18T10:38:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.717+0000 7fd276ffd700 1 -- 172.21.15.31:0/120897552 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28000cd50 con 0x7fd2900a45d0 2024-04-18T10:38:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.717+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2900a20b0 con 0x7fd2900a45d0 2024-04-18T10:38:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.718+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2901406b0 con 0x7fd2900a45d0 2024-04-18T10:38:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.718+0000 7fd276ffd700 1 -- 172.21.15.31:0/120897552 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fd280013680 con 0x7fd2900a45d0 2024-04-18T10:38:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.719+0000 7fd276ffd700 1 -- 172.21.15.31:0/120897552 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fd28005ba80 con 0x7fd2900a45d0 2024-04-18T10:38:56.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.722+0000 7fd276ffd700 1 -- 172.21.15.31:0/120897552 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd280039e90 con 0x7fd2900a45d0 2024-04-18T10:38:56.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:56.885+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fd2901406b0 con 0x7fd2900a45d0 2024-04-18T10:38:57.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.597+0000 7fd276ffd700 1 -- 172.21.15.31:0/120897552 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v40) v1 ==== 164+0+0 (secure 0 0 0) 0x7fd2901406b0 con 0x7fd2900a45d0 2024-04-18T10:38:57.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.600+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 >> v1:172.21.15.31:6816/46601 conn(0x7fd27c046010 legacy=0x7fd27c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:57.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.600+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 msgr2=0x7fd29013da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:57.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.600+0000 7fd295302700 1 --2- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd29013da90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd28000ec50 tx=0x7fd2800091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.601+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 shutdown_connections 2024-04-18T10:38:57.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.601+0000 7fd295302700 1 --2- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd2900a3690 0x7fd290140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.601+0000 7fd295302700 1 --2- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd29013d2a0 0x7fd290138b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.601+0000 7fd295302700 1 --2- 172.21.15.31:0/120897552 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd2900a45d0 0x7fd29013da90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.601+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 >> 172.21.15.31:0/120897552 conn(0x7fd2900636c0 msgr2=0x7fd290070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:57.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.601+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 shutdown_connections 2024-04-18T10:38:57.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.601+0000 7fd295302700 1 -- 172.21.15.31:0/120897552 wait complete. 2024-04-18T10:38:57.602 INFO:teuthology.orchestra.run.smithi031.stderr:set pool 3 pg_autoscale_mode to off 2024-04-18T10:38:57.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.715+0000 7f538e8c1700 1 Processor -- start 2024-04-18T10:38:57.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.715+0000 7f538e8c1700 1 -- start start 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.715+0000 7f538e8c1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5388064e20 0x7f53880acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.715+0000 7f538e8c1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f53880ad2a0 0x7f5388141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f538e8c1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53880a9950 con 0x7f5388142440 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f538e8c1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53880ad730 con 0x7f53880ad2a0 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f538e8c1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53880ad9d0 con 0x7f5388064e20 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f5387fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5388064e20 0x7f53880acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f53877fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f53880ad2a0 0x7f5388141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f538ce5e700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5388142440 0x7f53880adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53234/0 (socket says 172.21.15.31:53234) 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f5387fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5388064e20 0x7f53880acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53822/0 (socket says 172.21.15.31:53822) 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f53877fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f53880ad2a0 0x7f5388141f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54238/0 (socket says 172.21.15.31:54238) 2024-04-18T10:38:57.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f538ce5e700 1 -- 172.21.15.31:0/1944554339 learned_addr learned my addr 172.21.15.31:0/1944554339 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f53877fe700 1 -- 172.21.15.31:0/1944554339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5388064e20 msgr2=0x7f53880acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f53877fe700 1 --2- 172.21.15.31:0/1944554339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5388064e20 0x7f53880acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f53877fe700 1 -- 172.21.15.31:0/1944554339 >> v1:172.21.15.31:6789/0 conn(0x7f5388142440 legacy=0x7f53880adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f53877fe700 1 -- 172.21.15.31:0/1944554339 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880abd70 con 0x7f53880ad2a0 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f5386ffd700 1 -- 172.21.15.31:0/1944554339 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120468102 0 0) 0x7f53880a9950 con 0x7f5388142440 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f5387fff700 1 --2- 172.21.15.31:0/1944554339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5388064e20 0x7f53880acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f53877fe700 1 --2- 172.21.15.31:0/1944554339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53880ad2a0 0x7f5388141f00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f53780098e0 tx=0x7f53780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d3941da9f74369 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f5386ffd700 1 -- 172.21.15.31:0/1944554339 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800b640 con 0x7f53880ad2a0 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f5386ffd700 1 -- 172.21.15.31:0/1944554339 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537800b7a0 con 0x7f53880ad2a0 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.716+0000 7f5386ffd700 1 -- 172.21.15.31:0/1944554339 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537800bb40 con 0x7f53880ad2a0 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.717+0000 7f538e8c1700 1 -- 172.21.15.31:0/1944554339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53880ad2a0 msgr2=0x7f5388141f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.717+0000 7f538e8c1700 1 --2- 172.21.15.31:0/1944554339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53880ad2a0 0x7f5388141f00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f53780098e0 tx=0x7f53780091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.717+0000 7f538e8c1700 1 -- 172.21.15.31:0/1944554339 shutdown_connections 2024-04-18T10:38:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.717+0000 7f538e8c1700 1 --2- 172.21.15.31:0/1944554339 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5388064e20 0x7f53880acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.717+0000 7f538e8c1700 1 --2- 172.21.15.31:0/1944554339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53880ad2a0 0x7f5388141f00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.717+0000 7f538e8c1700 1 -- 172.21.15.31:0/1944554339 >> 172.21.15.31:0/1944554339 conn(0x7f538806a1f0 msgr2=0x7f53880679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.717+0000 7f538e8c1700 1 -- 172.21.15.31:0/1944554339 shutdown_connections 2024-04-18T10:38:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.717+0000 7f538e8c1700 1 -- 172.21.15.31:0/1944554339 wait complete. 2024-04-18T10:38:57.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.718+0000 7f538e8c1700 1 Processor -- start 2024-04-18T10:38:57.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.718+0000 7f538e8c1700 1 -- start start 2024-04-18T10:38:57.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f538e8c1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5388064e20 0x7f538809c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f538e8c1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53880ad2a0 0x7f538814e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f538e8c1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5388142440 0x7f538814eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f538e8c1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538809eaf0 con 0x7f5388142440 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f538e8c1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538809df00 con 0x7f53880ad2a0 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f538e8c1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f538809acd0 con 0x7f5388064e20 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f5387fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5388064e20 0x7f538809c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f538ce5e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5388142440 0x7f538814eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f5387fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5388064e20 0x7f538809c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43836/0 (socket says 172.21.15.31:43836) 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f538ce5e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5388142440 0x7f538814eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54248/0 (socket says 172.21.15.31:54248) 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f5387fff700 1 -- 172.21.15.31:0/670472182 learned_addr learned my addr 172.21.15.31:0/670472182 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f53877fe700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53880ad2a0 0x7f538814e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f5387fff700 1 -- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53880ad2a0 msgr2=0x7f538814e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f5387fff700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53880ad2a0 0x7f538814e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f5387fff700 1 -- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5388142440 msgr2=0x7f538814eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f5387fff700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5388142440 0x7f538814eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f5387fff700 1 -- 172.21.15.31:0/670472182 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c009420 con 0x7f5388064e20 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f53877fe700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53880ad2a0 0x7f538814e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f538ce5e700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5388142440 0x7f538814eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f5387fff700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5388064e20 0x7f538809c5c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f537c00ec80 tx=0x7f537c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.719+0000 7f536ffff700 1 -- 172.21.15.31:0/670472182 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00c850 con 0x7f5388064e20 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.720+0000 7f536ffff700 1 -- 172.21.15.31:0/670472182 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c00c9b0 con 0x7f5388064e20 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.720+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5378009420 con 0x7f5388064e20 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.720+0000 7f536ffff700 1 -- 172.21.15.31:0/670472182 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c00cd30 con 0x7f5388064e20 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.720+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53880a4ba0 con 0x7f5388064e20 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.721+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538809ed60 con 0x7f5388064e20 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.721+0000 7f536ffff700 1 -- 172.21.15.31:0/670472182 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f537c013680 con 0x7f5388064e20 2024-04-18T10:38:57.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.721+0000 7f536ffff700 1 -- 172.21.15.31:0/670472182 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f537c05b3b0 con 0x7f5388064e20 2024-04-18T10:38:57.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.725+0000 7f536ffff700 1 -- 172.21.15.31:0/670472182 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f537c0395d0 con 0x7f5388064e20 2024-04-18T10:38:57.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:57.889+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f538805f5f0 con 0x7f5388064e20 2024-04-18T10:38:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.608+0000 7f536ffff700 1 -- 172.21.15.31:0/670472182 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v41) v1 ==== 160+0+0 (secure 0 0 0) 0x7f537c03cdc0 con 0x7f5388064e20 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 >> v1:172.21.15.31:6816/46601 conn(0x7f5374046010 legacy=0x7f53740484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5388064e20 msgr2=0x7f538809c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5388064e20 0x7f538809c5c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f537c00ec80 tx=0x7f537c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 shutdown_connections 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5388064e20 0x7f538809c5c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5388142440 0x7f538814eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 --2- 172.21.15.31:0/670472182 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f53880ad2a0 0x7f538814e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 >> 172.21.15.31:0/670472182 conn(0x7f538806a1f0 msgr2=0x7f53880ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 shutdown_connections 2024-04-18T10:38:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.611+0000 7f538e8c1700 1 -- 172.21.15.31:0/670472182 wait complete. 2024-04-18T10:38:58.613 INFO:teuthology.orchestra.run.smithi031.stderr:set pool 4 pg_autoscale_mode to off 2024-04-18T10:38:58.627 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-04-18T10:38:58.638 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-18T10:38:58.638 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-18T10:38:58.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-18T10:38:58.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.765+0000 7f17615cd700 1 Processor -- start 2024-04-18T10:38:58.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f17615cd700 1 -- start start 2024-04-18T10:38:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f17615cd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f175c063f70 0x7f175c0a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f17615cd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c13eea0 0x7f175c0a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f17615cd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175c0aa260 con 0x7f175c13ea30 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f17615cd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175c0a7e20 con 0x7f175c063f70 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f17615cd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0a9d60 con 0x7f175c13eea0 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f175affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f175c063f70 0x7f175c0a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f175b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c13eea0 0x7f175c0a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f175a7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f175c13ea30 0x7f175c0a5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53242/0 (socket says 172.21.15.31:53242) 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f175a7fc700 1 -- 172.21.15.31:0/760934251 learned_addr learned my addr 172.21.15.31:0/760934251 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f175b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c13eea0 0x7f175c0a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53832/0 (socket says 172.21.15.31:53832) 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.766+0000 7f175affd700 1 --2- 172.21.15.31:0/760934251 >> v2:172.21.15.31:3300/0 conn(0x7f175c063f70 0x7f175c0a78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54250/0 (socket says 172.21.15.31:54250) 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f175affd700 1 -- 172.21.15.31:0/760934251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c13eea0 msgr2=0x7f175c0a5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f175affd700 1 --2- 172.21.15.31:0/760934251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c13eea0 0x7f175c0a5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f175affd700 1 -- 172.21.15.31:0/760934251 >> v1:172.21.15.31:6789/0 conn(0x7f175c13ea30 legacy=0x7f175c0a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f1759ffb700 1 -- 172.21.15.31:0/760934251 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357645319 0 0) 0x7f175c0aa260 con 0x7f175c13ea30 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f175affd700 1 -- 172.21.15.31:0/760934251 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c0a6de0 con 0x7f175c063f70 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f175b7fe700 1 --2- 172.21.15.31:0/760934251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c13eea0 0x7f175c0a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f175affd700 1 --2- 172.21.15.31:0/760934251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c063f70 0x7f175c0a78e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f174c0098e0 tx=0x7f174c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bac3f5fa438cfca server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f1759ffb700 1 -- 172.21.15.31:0/760934251 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00b640 con 0x7f175c063f70 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f1759ffb700 1 -- 172.21.15.31:0/760934251 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00b7a0 con 0x7f175c063f70 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f1759ffb700 1 -- 172.21.15.31:0/760934251 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00bb40 con 0x7f175c063f70 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.767+0000 7f17615cd700 1 -- 172.21.15.31:0/760934251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c063f70 msgr2=0x7f175c0a78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.768+0000 7f17615cd700 1 --2- 172.21.15.31:0/760934251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c063f70 0x7f175c0a78e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f174c0098e0 tx=0x7f174c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.768+0000 7f17615cd700 1 -- 172.21.15.31:0/760934251 shutdown_connections 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.768+0000 7f17615cd700 1 --2- 172.21.15.31:0/760934251 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c13eea0 0x7f175c0a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.768+0000 7f17615cd700 1 --2- 172.21.15.31:0/760934251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c063f70 0x7f175c0a78e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.768+0000 7f17615cd700 1 -- 172.21.15.31:0/760934251 >> 172.21.15.31:0/760934251 conn(0x7f175c06f110 msgr2=0x7f175c063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.768+0000 7f17615cd700 1 -- 172.21.15.31:0/760934251 shutdown_connections 2024-04-18T10:38:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.768+0000 7f17615cd700 1 -- 172.21.15.31:0/760934251 wait complete. 2024-04-18T10:38:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f17615cd700 1 Processor -- start 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f17615cd700 1 -- start start 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f17615cd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c063f70 0x7f175c0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f17615cd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175c13ea30 0x7f175c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f17615cd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c13eea0 0x7f175c1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f17615cd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0ab5c0 con 0x7f175c13eea0 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f17615cd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0ae5f0 con 0x7f175c063f70 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f17615cd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f175c0b0b80 con 0x7f175c13ea30 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f175affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c063f70 0x7f175c0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f175b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c13eea0 0x7f175c1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f175a7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175c13ea30 0x7f175c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f175affd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c063f70 0x7f175c0adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53844/0 (socket says 172.21.15.31:53844) 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f175b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c13eea0 0x7f175c1518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54256/0 (socket says 172.21.15.31:54256) 2024-04-18T10:38:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.769+0000 7f175affd700 1 -- 172.21.15.31:0/2877709841 learned_addr learned my addr 172.21.15.31:0/2877709841 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f175affd700 1 -- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175c13ea30 msgr2=0x7f175c151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f175affd700 1 --2- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175c13ea30 0x7f175c151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f175affd700 1 -- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c13eea0 msgr2=0x7f175c1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f175affd700 1 --2- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c13eea0 0x7f175c1518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f175affd700 1 -- 172.21.15.31:0/2877709841 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1754009a20 con 0x7f175c063f70 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f175affd700 1 --2- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c063f70 0x7f175c0adf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f175c068820 tx=0x7f174c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f1752ffd700 1 -- 172.21.15.31:0/2877709841 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c000d10 con 0x7f175c063f70 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f1752ffd700 1 -- 172.21.15.31:0/2877709841 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00bb20 con 0x7f175c063f70 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c009420 con 0x7f175c063f70 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f1752ffd700 1 -- 172.21.15.31:0/2877709841 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c011670 con 0x7f175c063f70 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.770+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175c0b1400 con 0x7f175c063f70 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.771+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175c064920 con 0x7f175c063f70 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.771+0000 7f1752ffd700 1 -- 172.21.15.31:0/2877709841 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f174c011a20 con 0x7f175c063f70 2024-04-18T10:38:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.771+0000 7f1752ffd700 1 -- 172.21.15.31:0/2877709841 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f174c05c5d0 con 0x7f175c063f70 2024-04-18T10:38:58.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.775+0000 7f1752ffd700 1 -- 172.21.15.31:0/2877709841 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f174c005f50 con 0x7f175c063f70 2024-04-18T10:38:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.973+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f175c0b1f80 con 0x7f175c063f70 2024-04-18T10:38:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.975+0000 7f1752ffd700 1 -- 172.21.15.31:0/2877709841 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) v1 ==== 74+0+105272 (secure 0 0 0) 0x7f174c015020 con 0x7f175c063f70 2024-04-18T10:38:58.977 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:58.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 >> v1:172.21.15.31:6816/46601 conn(0x7f173c046010 legacy=0x7f173c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:58.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c063f70 msgr2=0x7f175c0adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:58.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 --2- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c063f70 0x7f175c0adf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f175c068820 tx=0x7f174c017000 comp rx=0 tx=0).stop 2024-04-18T10:38:58.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 shutdown_connections 2024-04-18T10:38:58.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 --2- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f175c13eea0 0x7f175c1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 --2- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f175c063f70 0x7f175c0adf30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 --2- 172.21.15.31:0/2877709841 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f175c13ea30 0x7f175c151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:58.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 >> 172.21.15.31:0/2877709841 conn(0x7f175c06f110 msgr2=0x7f175c1434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:58.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 shutdown_connections 2024-04-18T10:38:58.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:58.977+0000 7f17615cd700 1 -- 172.21.15.31:0/2877709841 wait complete. 2024-04-18T10:38:58.989 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"flags":0,"active_gid":24105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6816","nonce":46601}]},"active_addr":"172.21.15.31:6816/46601","active_change":"2024-04-18T10:38:28.389222+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":24103,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":21,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":363745350}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":510504465}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":383242398}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":847614527}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3808362337}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3022062819}]}]} 2024-04-18T10:38:58.992 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-18T10:38:58.992 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-18T10:38:58.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:59.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.111+0000 7f2b0849f700 1 Processor -- start 2024-04-18T10:38:59.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.111+0000 7f2b0849f700 1 -- start start 2024-04-18T10:38:59.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b0849f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b000a7110 0x7f2b0013c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b0849f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b00144920 0x7f2b00146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b0849f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0006fd30 con 0x7f2b000680f0 2024-04-18T10:38:59.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b0849f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000a5050 con 0x7f2b00144920 2024-04-18T10:38:59.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b0849f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0013c130 con 0x7f2b000a7110 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b06a3c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b00144920 0x7f2b00146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b05a3a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b000a7110 0x7f2b0013c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b0623b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2b000680f0 0x7f2b000a4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53258/0 (socket says 172.21.15.31:53258) 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b0623b700 1 -- 172.21.15.31:0/3220369075 learned_addr learned my addr 172.21.15.31:0/3220369075 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b05239700 1 -- 172.21.15.31:0/3220369075 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733311149 0 0) 0x7f2b0006fd30 con 0x7f2b000680f0 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b05a3a700 1 -- 172.21.15.31:0/3220369075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b00144920 msgr2=0x7f2b00146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b05a3a700 1 --2- 172.21.15.31:0/3220369075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b00144920 0x7f2b00146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b05a3a700 1 -- 172.21.15.31:0/3220369075 >> v1:172.21.15.31:6789/0 conn(0x7f2b000680f0 legacy=0x7f2b000a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b05a3a700 1 -- 172.21.15.31:0/3220369075 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000a4510 con 0x7f2b000a7110 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.112+0000 7f2b06a3c700 1 --2- 172.21.15.31:0/3220369075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b00144920 0x7f2b00146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b05a3a700 1 --2- 172.21.15.31:0/3220369075 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b000a7110 0x7f2b0013c800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009910 tx=0x7f2afc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85a1838646ffeb59 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b05239700 1 -- 172.21.15.31:0/3220369075 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00b680 con 0x7f2b000a7110 2024-04-18T10:38:59.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b05239700 1 -- 172.21.15.31:0/3220369075 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc00b7e0 con 0x7f2b000a7110 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b05239700 1 -- 172.21.15.31:0/3220369075 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00bba0 con 0x7f2b000a7110 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b0849f700 1 -- 172.21.15.31:0/3220369075 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b000a7110 msgr2=0x7f2b0013c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b0849f700 1 --2- 172.21.15.31:0/3220369075 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b000a7110 0x7f2b0013c800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009910 tx=0x7f2afc0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b0849f700 1 -- 172.21.15.31:0/3220369075 shutdown_connections 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b0849f700 1 --2- 172.21.15.31:0/3220369075 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b00144920 0x7f2b00146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b0849f700 1 --2- 172.21.15.31:0/3220369075 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b000a7110 0x7f2b0013c800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b0849f700 1 -- 172.21.15.31:0/3220369075 >> 172.21.15.31:0/3220369075 conn(0x7f2b0006bfc0 msgr2=0x7f2b000679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b0849f700 1 -- 172.21.15.31:0/3220369075 shutdown_connections 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.113+0000 7f2b0849f700 1 -- 172.21.15.31:0/3220369075 wait complete. 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.114+0000 7f2b0849f700 1 Processor -- start 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.114+0000 7f2b0849f700 1 -- start start 2024-04-18T10:38:59.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0849f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b000680f0 0x7f2b000a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0849f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b000a7110 0x7f2b000a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0849f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b00144920 0x7f2b0014f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0849f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000a9460 con 0x7f2b000a7110 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0849f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000aa530 con 0x7f2b000680f0 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0849f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000a91a0 con 0x7f2b00144920 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0623b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b000680f0 0x7f2b000a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0623b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b000680f0 0x7f2b000a9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53864/0 (socket says 172.21.15.31:53864) 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0623b700 1 -- 172.21.15.31:0/3033558969 learned_addr learned my addr 172.21.15.31:0/3033558969 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b05a3a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b000a7110 0x7f2b000a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b06a3c700 1 --2- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b00144920 0x7f2b0014f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0623b700 1 -- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b00144920 msgr2=0x7f2b0014f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0623b700 1 --2- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b00144920 0x7f2b0014f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0623b700 1 -- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b000a7110 msgr2=0x7f2b000a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0623b700 1 --2- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b000a7110 0x7f2b000a87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0623b700 1 -- 172.21.15.31:0/3033558969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8009a20 con 0x7f2b000680f0 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b05a3a700 1 --2- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b000a7110 0x7f2b000a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.115+0000 7f2b0623b700 1 --2- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b000680f0 0x7f2b000a9b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c560 tx=0x7f2af0000fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.116+0000 7f2af67fc700 1 -- 172.21.15.31:0/3033558969 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0005b30 con 0x7f2b000680f0 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.116+0000 7f2af67fc700 1 -- 172.21.15.31:0/3033558969 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0005c90 con 0x7f2b000680f0 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.116+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc009420 con 0x7f2b000680f0 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.116+0000 7f2af67fc700 1 -- 172.21.15.31:0/3033558969 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0007320 con 0x7f2b000680f0 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.116+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b000b0640 con 0x7f2b000680f0 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.116+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b000651b0 con 0x7f2b000680f0 2024-04-18T10:38:59.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.117+0000 7f2af67fc700 1 -- 172.21.15.31:0/3033558969 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f2af001b3b0 con 0x7f2b000680f0 2024-04-18T10:38:59.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.117+0000 7f2af67fc700 1 -- 172.21.15.31:0/3033558969 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f2af005a610 con 0x7f2b000680f0 2024-04-18T10:38:59.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.120+0000 7f2af67fc700 1 -- 172.21.15.31:0/3033558969 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2af0038890 con 0x7f2b000680f0 2024-04-18T10:38:59.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.285+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b000a38b0 con 0x7f2b000680f0 2024-04-18T10:38:59.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.286+0000 7f2af67fc700 1 -- 172.21.15.31:0/3033558969 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11635 (secure 0 0 0) 0x7f2af0017070 con 0x7f2b000680f0 2024-04-18T10:38:59.286 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:59.286 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":41,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:58.600312+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:59.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.287+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 >> v1:172.21.15.31:6816/46601 conn(0x7f2ae4046010 legacy=0x7f2ae40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.287+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b000680f0 msgr2=0x7f2b000a9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.287+0000 7f2b0849f700 1 --2- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b000680f0 0x7f2b000a9b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c560 tx=0x7f2af0000fe0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.287+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 shutdown_connections 2024-04-18T10:38:59.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.287+0000 7f2b0849f700 1 --2- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b00144920 0x7f2b0014f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.287+0000 7f2b0849f700 1 --2- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b000680f0 0x7f2b000a9b90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.287+0000 7f2b0849f700 1 --2- 172.21.15.31:0/3033558969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b000a7110 0x7f2b000a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.287+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 >> 172.21.15.31:0/3033558969 conn(0x7f2b0006bfc0 msgr2=0x7f2b0013c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.288+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 shutdown_connections 2024-04-18T10:38:59.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.288+0000 7f2b0849f700 1 -- 172.21.15.31:0/3033558969 wait complete. 2024-04-18T10:38:59.300 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-18T10:38:59.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:38:59.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc49183a700 1 Processor -- start 2024-04-18T10:38:59.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc49183a700 1 -- start start 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc49183a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc48c063f70 0x7fc48c0a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc49183a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c13eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc49183a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c0a5380 0x7fc48c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc49183a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c0a7e20 con 0x7fc48c063f70 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc49183a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c13f3e0 con 0x7fc48c13ea30 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc49183a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0aa260 con 0x7fc48c0a5380 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc48b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c0a5380 0x7fc48c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc48a7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c13eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc48affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc48c063f70 0x7fc48c0a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc48b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c0a5380 0x7fc48c0a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43882/0 (socket says 172.21.15.31:43882) 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.420+0000 7fc48a7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c13eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53868/0 (socket says 172.21.15.31:53868) 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc48b7fe700 1 -- 172.21.15.31:0/4142698555 learned_addr learned my addr 172.21.15.31:0/4142698555 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc48b7fe700 1 -- 172.21.15.31:0/4142698555 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 msgr2=0x7fc48c13eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc48b7fe700 1 --2- 172.21.15.31:0/4142698555 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c13eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc48b7fe700 1 -- 172.21.15.31:0/4142698555 >> v2:172.21.15.31:3300/0 conn(0x7fc48c063f70 msgr2=0x7fc48c0a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc48b7fe700 1 --2- 172.21.15.31:0/4142698555 >> v2:172.21.15.31:3300/0 conn(0x7fc48c063f70 0x7fc48c0a78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc48b7fe700 1 -- 172.21.15.31:0/4142698555 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0a9d60 con 0x7fc48c0a5380 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc48a7fc700 1 --2- 172.21.15.31:0/4142698555 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc48affd700 1 --2- 172.21.15.31:0/4142698555 >> v2:172.21.15.31:3300/0 conn(0x7fc48c063f70 0x7fc48c0a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc48b7fe700 1 --2- 172.21.15.31:0/4142698555 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c0a5380 0x7fc48c0a5800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc484009f20 tx=0x7fc484009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40bb1feff77012b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc489ffb700 1 -- 172.21.15.31:0/4142698555 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48400e070 con 0x7fc48c0a5380 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc489ffb700 1 -- 172.21.15.31:0/4142698555 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48400b970 con 0x7fc48c0a5380 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.421+0000 7fc489ffb700 1 -- 172.21.15.31:0/4142698555 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4840092e0 con 0x7fc48c0a5380 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.422+0000 7fc49183a700 1 -- 172.21.15.31:0/4142698555 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c0a5380 msgr2=0x7fc48c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.422+0000 7fc49183a700 1 --2- 172.21.15.31:0/4142698555 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c0a5380 0x7fc48c0a5800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc484009f20 tx=0x7fc484009840 comp rx=0 tx=0).stop 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.422+0000 7fc49183a700 1 -- 172.21.15.31:0/4142698555 shutdown_connections 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.422+0000 7fc49183a700 1 --2- 172.21.15.31:0/4142698555 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c0a5380 0x7fc48c0a5800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.422+0000 7fc49183a700 1 --2- 172.21.15.31:0/4142698555 >> v2:172.21.15.31:3300/0 conn(0x7fc48c063f70 0x7fc48c0a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.422+0000 7fc49183a700 1 --2- 172.21.15.31:0/4142698555 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.422+0000 7fc49183a700 1 -- 172.21.15.31:0/4142698555 >> 172.21.15.31:0/4142698555 conn(0x7fc48c06f110 msgr2=0x7fc48c063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.422+0000 7fc49183a700 1 -- 172.21.15.31:0/4142698555 shutdown_connections 2024-04-18T10:38:59.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.422+0000 7fc49183a700 1 -- 172.21.15.31:0/4142698555 wait complete. 2024-04-18T10:38:59.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.423+0000 7fc49183a700 1 Processor -- start 2024-04-18T10:38:59.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.423+0000 7fc49183a700 1 -- start start 2024-04-18T10:38:59.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc49183a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c063f70 0x7fc48c0adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc49183a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48c0a5380 0x7fc48c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc49183a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc49183a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0b1020 con 0x7fc48c0a5380 2024-04-18T10:38:59.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc49183a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0ae5b0 con 0x7fc48c13ea30 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc49183a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0ae850 con 0x7fc48c063f70 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48c0a5380 0x7fc48c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c063f70 0x7fc48c0adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48a7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48c0a5380 0x7fc48c151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54290/0 (socket says 172.21.15.31:54290) 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48a7fc700 1 -- 172.21.15.31:0/254340076 learned_addr learned my addr 172.21.15.31:0/254340076 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48b7fe700 1 --2- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48affd700 1 -- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 msgr2=0x7fc48c151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48affd700 1 --2- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48affd700 1 -- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48c0a5380 msgr2=0x7fc48c151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48affd700 1 --2- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48c0a5380 0x7fc48c151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48affd700 1 -- 172.21.15.31:0/254340076 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c009420 con 0x7fc48c063f70 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.424+0000 7fc48a7fc700 1 --2- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48c0a5380 0x7fc48c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.425+0000 7fc48affd700 1 --2- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c063f70 0x7fc48c0adcf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00ec80 tx=0x7fc47c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.425+0000 7fc472ffd700 1 -- 172.21.15.31:0/254340076 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00c850 con 0x7fc48c063f70 2024-04-18T10:38:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.425+0000 7fc472ffd700 1 -- 172.21.15.31:0/254340076 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c00c9b0 con 0x7fc48c063f70 2024-04-18T10:38:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.425+0000 7fc472ffd700 1 -- 172.21.15.31:0/254340076 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00cd70 con 0x7fc48c063f70 2024-04-18T10:38:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.425+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc480009420 con 0x7fc48c063f70 2024-04-18T10:38:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.425+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc484009ae0 con 0x7fc48c063f70 2024-04-18T10:38:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.426+0000 7fc472ffd700 1 -- 172.21.15.31:0/254340076 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fc47c013680 con 0x7fc48c063f70 2024-04-18T10:38:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.426+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c0b0110 con 0x7fc48c063f70 2024-04-18T10:38:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.426+0000 7fc472ffd700 1 -- 172.21.15.31:0/254340076 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fc47c05b410 con 0x7fc48c063f70 2024-04-18T10:38:59.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.430+0000 7fc472ffd700 1 -- 172.21.15.31:0/254340076 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fc47c0395d0 con 0x7fc48c063f70 2024-04-18T10:38:59.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.595+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc48c064920 con 0x7fc48c063f70 2024-04-18T10:38:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.595+0000 7fc472ffd700 1 -- 172.21.15.31:0/254340076 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11635 (secure 0 0 0) 0x7fc47c03cdc0 con 0x7fc48c063f70 2024-04-18T10:38:59.596 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:38:59.596 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":41,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:58.600312+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 >> v1:172.21.15.31:6816/46601 conn(0x7fc478046040 legacy=0x7fc4780484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c063f70 msgr2=0x7fc48c0adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 --2- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c063f70 0x7fc48c0adcf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00ec80 tx=0x7fc47c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 shutdown_connections 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 --2- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc48c063f70 0x7fc48c0adcf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 --2- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc48c13ea30 0x7fc48c151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 --2- 172.21.15.31:0/254340076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48c0a5380 0x7fc48c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 >> 172.21.15.31:0/254340076 conn(0x7fc48c06f110 msgr2=0x7fc48c13d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 shutdown_connections 2024-04-18T10:38:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.597+0000 7fc49183a700 1 -- 172.21.15.31:0/254340076 wait complete. 2024-04-18T10:38:59.610 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-18T10:38:59.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-18T10:38:59.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-18T10:38:59.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-18T10:38:59.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.741+0000 7f679e983700 1 Processor -- start 2024-04-18T10:38:59.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.741+0000 7f679e983700 1 -- start start 2024-04-18T10:38:59.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f3dd77d7700 1 Processor -- start 2024-04-18T10:38:59.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f3dd77d7700 1 -- start start 2024-04-18T10:38:59.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f679e983700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 0x7f679813b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f679e983700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798142170 0x7f679813bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f679e983700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980aaa30 con 0x7f6798063b00 2024-04-18T10:38:59.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f679e983700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679813e4e0 con 0x7f6798142170 2024-04-18T10:38:59.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f679e983700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f679813c010 con 0x7f6798141d40 2024-04-18T10:38:59.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f679cf20700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798142170 0x7f679813bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f678ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 0x7f679813b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f679cf20700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798142170 0x7f679813bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53890/0 (socket says 172.21.15.31:53890) 2024-04-18T10:38:59.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f678ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 0x7f679813b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43904/0 (socket says 172.21.15.31:43904) 2024-04-18T10:38:59.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.742+0000 7f679cf20700 1 -- 172.21.15.31:0/980443090 learned_addr learned my addr 172.21.15.31:0/980443090 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd77d7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 0x7f3dd00ac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd77d7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3dd0131700 0x7f3dd0131b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd77d7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00a5680 con 0x7f3dd00a5b10 2024-04-18T10:38:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd77d7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00ad710 con 0x7f3dd0131700 2024-04-18T10:38:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd77d7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00a5f80 con 0x7f3dd0063b80 2024-04-18T10:38:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f678ffff700 1 -- 172.21.15.31:0/980443090 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798142170 msgr2=0x7f679813bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f678ffff700 1 --2- 172.21.15.31:0/980443090 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798142170 0x7f679813bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f678ffff700 1 -- 172.21.15.31:0/980443090 >> v1:172.21.15.31:6789/0 conn(0x7f6798063b00 legacy=0x7f67980aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f678ffff700 1 -- 172.21.15.31:0/980443090 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6798142710 con 0x7f6798141d40 2024-04-18T10:38:59.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd5573700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 0x7f3dd00ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd5573700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 0x7f3dd00ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43920/0 (socket says 172.21.15.31:43920) 2024-04-18T10:38:59.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd5573700 1 -- 172.21.15.31:0/1419488797 learned_addr learned my addr 172.21.15.31:0/1419488797 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f679cf20700 1 --2- 172.21.15.31:0/980443090 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798142170 0x7f679813bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd5d74700 1 --2- 172.21.15.31:0/1419488797 >> v2:172.21.15.31:3300/0 conn(0x7f3dd0131700 0x7f3dd0131b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f678ffff700 1 --2- 172.21.15.31:0/980443090 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 0x7f679813b590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6780009910 tx=0x7f67800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39f72506b96407c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd5573700 1 -- 172.21.15.31:0/1419488797 >> v2:172.21.15.31:3300/0 conn(0x7f3dd0131700 msgr2=0x7f3dd0131b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd5573700 1 --2- 172.21.15.31:0/1419488797 >> v2:172.21.15.31:3300/0 conn(0x7f3dd0131700 0x7f3dd0131b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd5573700 1 -- 172.21.15.31:0/1419488797 >> v1:172.21.15.31:6789/0 conn(0x7f3dd00a5b10 legacy=0x7f3dd00ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f3dd5573700 1 -- 172.21.15.31:0/1419488797 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00a6220 con 0x7f3dd0063b80 2024-04-18T10:38:59.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f67977fe700 1 -- 172.21.15.31:0/980443090 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000b680 con 0x7f6798141d40 2024-04-18T10:38:59.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f67977fe700 1 -- 172.21.15.31:0/980443090 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678000b7e0 con 0x7f6798141d40 2024-04-18T10:38:59.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.743+0000 7f67977fe700 1 -- 172.21.15.31:0/980443090 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678000bb60 con 0x7f6798141d40 2024-04-18T10:38:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f3dd5573700 1 --2- 172.21.15.31:0/1419488797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 0x7f3dd00ac390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0099e0 tx=0x7f3dcc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3766f9a1b5855b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f3dc7fff700 1 -- 172.21.15.31:0/1419488797 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00b7e0 con 0x7f3dd0063b80 2024-04-18T10:38:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f3dc7fff700 1 -- 172.21.15.31:0/1419488797 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc00b940 con 0x7f3dd0063b80 2024-04-18T10:38:59.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f3dc7fff700 1 -- 172.21.15.31:0/1419488797 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00bcc0 con 0x7f3dd0063b80 2024-04-18T10:38:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f679e983700 1 -- 172.21.15.31:0/980443090 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 msgr2=0x7f679813b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f679e983700 1 --2- 172.21.15.31:0/980443090 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 0x7f679813b590 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6780009910 tx=0x7f67800091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f679e983700 1 -- 172.21.15.31:0/980443090 shutdown_connections 2024-04-18T10:38:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f679e983700 1 --2- 172.21.15.31:0/980443090 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798142170 0x7f679813bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f679e983700 1 --2- 172.21.15.31:0/980443090 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 0x7f679813b590 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f679e983700 1 -- 172.21.15.31:0/980443090 >> 172.21.15.31:0/980443090 conn(0x7f679806a390 msgr2=0x7f679806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.744+0000 7f679e983700 1 -- 172.21.15.31:0/980443090 shutdown_connections 2024-04-18T10:38:59.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.745+0000 7f679e983700 1 -- 172.21.15.31:0/980443090 wait complete. 2024-04-18T10:38:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.745+0000 7f3dd77d7700 1 -- 172.21.15.31:0/1419488797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 msgr2=0x7f3dd00ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.745+0000 7f3dd77d7700 1 --2- 172.21.15.31:0/1419488797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 0x7f3dd00ac390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0099e0 tx=0x7f3dcc009250 comp rx=0 tx=0).stop 2024-04-18T10:38:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.745+0000 7f3dd77d7700 1 -- 172.21.15.31:0/1419488797 shutdown_connections 2024-04-18T10:38:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.745+0000 7f3dd77d7700 1 --2- 172.21.15.31:0/1419488797 >> v2:172.21.15.31:3300/0 conn(0x7f3dd0131700 0x7f3dd0131b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.745+0000 7f3dd77d7700 1 --2- 172.21.15.31:0/1419488797 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 0x7f3dd00ac390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.745+0000 7f3dd77d7700 1 -- 172.21.15.31:0/1419488797 >> 172.21.15.31:0/1419488797 conn(0x7f3dd00b1290 msgr2=0x7f3dd00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.745+0000 7f3dd77d7700 1 -- 172.21.15.31:0/1419488797 shutdown_connections 2024-04-18T10:38:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.745+0000 7f3dd77d7700 1 -- 172.21.15.31:0/1419488797 wait complete. 2024-04-18T10:38:59.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f679e983700 1 Processor -- start 2024-04-18T10:38:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f679e983700 1 -- start start 2024-04-18T10:38:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f679e983700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798063b00 0x7f6798151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f679e983700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 0x7f67981343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f679e983700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6798142170 0x7f6798134930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f679e983700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6798151960 con 0x7f6798142170 2024-04-18T10:38:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f679e983700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6798151b50 con 0x7f6798063b00 2024-04-18T10:38:59.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f679e983700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6798151df0 con 0x7f6798141d40 2024-04-18T10:38:59.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f3dd77d7700 1 Processor -- start 2024-04-18T10:38:59.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f3dd77d7700 1 -- start start 2024-04-18T10:38:59.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f6797fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798063b00 0x7f6798151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f6797fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798063b00 0x7f6798151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53896/0 (socket says 172.21.15.31:53896) 2024-04-18T10:38:59.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.746+0000 7f6797fff700 1 -- 172.21.15.31:0/2341776750 learned_addr learned my addr 172.21.15.31:0/2341776750 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f6797fff700 1 -- 172.21.15.31:0/2341776750 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 msgr2=0x7f67981343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f6797fff700 1 --2- 172.21.15.31:0/2341776750 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f6798141d40 0x7f67981343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f6797fff700 1 -- 172.21.15.31:0/2341776750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6798142170 msgr2=0x7f6798134930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f6797fff700 1 --2- 172.21.15.31:0/2341776750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6798142170 0x7f6798134930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f6797fff700 1 -- 172.21.15.31:0/2341776750 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6790009ae0 con 0x7f6798063b00 2024-04-18T10:38:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f6797fff700 1 --2- 172.21.15.31:0/2341776750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798063b00 0x7f6798151420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f678800c5c0 tx=0x7f678800c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f6794ff9700 1 -- 172.21.15.31:0/2341776750 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788011590 con 0x7f6798063b00 2024-04-18T10:38:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f6794ff9700 1 -- 172.21.15.31:0/2341776750 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788011710 con 0x7f6798063b00 2024-04-18T10:38:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6780009420 con 0x7f6798063b00 2024-04-18T10:38:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f6794ff9700 1 -- 172.21.15.31:0/2341776750 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788011ad0 con 0x7f6798063b00 2024-04-18T10:38:59.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67980ae5a0 con 0x7f6798063b00 2024-04-18T10:38:59.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f3dd77d7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 0x7f3dd00aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f3dd77d7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3dd00a5b10 0x7f3dd013f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f3dd77d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dd0131700 0x7f3dd00a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f3dd77d7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00a8ac0 con 0x7f3dd0131700 2024-04-18T10:38:59.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f3dd77d7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00aa400 con 0x7f3dd00a5b10 2024-04-18T10:38:59.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.747+0000 7f3dd77d7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00aa6c0 con 0x7f3dd0063b80 2024-04-18T10:38:59.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd4d72700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3dd00a5b10 0x7f3dd013f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd4d72700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3dd00a5b10 0x7f3dd013f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53908/0 (socket says 172.21.15.31:53908) 2024-04-18T10:38:59.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd4d72700 1 -- 172.21.15.31:0/2691595659 learned_addr learned my addr 172.21.15.31:0/2691595659 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd4d72700 1 -- 172.21.15.31:0/2691595659 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 msgr2=0x7f3dd00aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd4d72700 1 --2- 172.21.15.31:0/2691595659 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3dd0063b80 0x7f3dd00aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd4d72700 1 -- 172.21.15.31:0/2691595659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dd0131700 msgr2=0x7f3dd00a67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd4d72700 1 --2- 172.21.15.31:0/2691595659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3dd0131700 0x7f3dd00a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd4d72700 1 -- 172.21.15.31:0/2691595659 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc0094f0 con 0x7f3dd00a5b10 2024-04-18T10:38:59.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67980651b0 con 0x7f6798063b00 2024-04-18T10:38:59.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd4d72700 1 --2- 172.21.15.31:0/2691595659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3dd00a5b10 0x7f3dd013f0e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000b610 tx=0x7f3dc00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dc57fa700 1 -- 172.21.15.31:0/2691595659 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000f510 con 0x7f3dd00a5b10 2024-04-18T10:38:59.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd00a85c0 con 0x7f3dd00a5b10 2024-04-18T10:38:59.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dc57fa700 1 -- 172.21.15.31:0/2691595659 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc000f670 con 0x7f3dd00a5b10 2024-04-18T10:38:59.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dc57fa700 1 -- 172.21.15.31:0/2691595659 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000fa10 con 0x7f3dd00a5b10 2024-04-18T10:38:59.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.748+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd00a92f0 con 0x7f3dd00a5b10 2024-04-18T10:38:59.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.749+0000 7f6794ff9700 1 -- 172.21.15.31:0/2341776750 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f678801b3b0 con 0x7f6798063b00 2024-04-18T10:38:59.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.749+0000 7f6794ff9700 1 -- 172.21.15.31:0/2341776750 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f678805aed0 con 0x7f6798063b00 2024-04-18T10:38:59.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.749+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3db0000fd0 con 0x7f3dd00a5b10 2024-04-18T10:38:59.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.749+0000 7f6794ff9700 1 -- 172.21.15.31:0/2341776750 --> v1:172.21.15.31:6808/49420 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6778052a60 con 0x7f677804eda0 2024-04-18T10:38:59.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.749+0000 7f6794ff9700 1 -- 172.21.15.31:0/2341776750 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f678805b2a0 con 0x7f6798063b00 2024-04-18T10:38:59.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.750+0000 7f89b2236700 1 Processor -- start 2024-04-18T10:38:59.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.750+0000 7f3dc57fa700 1 -- 172.21.15.31:0/2691595659 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f3dc001a400 con 0x7f3dd00a5b10 2024-04-18T10:38:59.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.750+0000 7f3dc57fa700 1 -- 172.21.15.31:0/2691595659 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3dc005ac50 con 0x7f3dd00a5b10 2024-04-18T10:38:59.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.750+0000 7f3dc57fa700 1 -- 172.21.15.31:0/2691595659 --> v1:172.21.15.31:6804/49310 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3db40529e0 con 0x7f3db404ed20 2024-04-18T10:38:59.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.750+0000 7f3dc57fa700 1 -- 172.21.15.31:0/2691595659 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3dc0060260 con 0x7f3dd00a5b10 2024-04-18T10:38:59.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.751+0000 7f89b2236700 1 -- start start 2024-04-18T10:38:59.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.751+0000 7f6399e1e700 1 Processor -- start 2024-04-18T10:38:59.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.751+0000 7f6399e1e700 1 -- start start 2024-04-18T10:38:59.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.751+0000 7f3dc57fa700 1 -- 172.21.15.31:0/2691595659 <== osd.1 v1:172.21.15.31:6804/49310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f3db40529e0 con 0x7f3db404ed20 2024-04-18T10:38:59.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.751+0000 7f6399e1e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f639406ecf0 0x7f63940a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f6399e1e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f63940a7130 0x7f63941462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f6399e1e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63940a3540 con 0x7f63940a6d60 2024-04-18T10:38:59.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f6399e1e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63940a37e0 con 0x7f639406ecf0 2024-04-18T10:38:59.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f6399e1e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63940a5d60 con 0x7f63940a7130 2024-04-18T10:38:59.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f6794ff9700 1 -- 172.21.15.31:0/2341776750 <== osd.2 v1:172.21.15.31:6808/49420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f6778052a60 con 0x7f677804eda0 2024-04-18T10:38:59.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f89b2236700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f89ac06e9d0 0x7f89ac06f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f89b2236700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ac0680f0 0x7f89ac14d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f89b2236700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac06f0f0 con 0x7f89ac069450 2024-04-18T10:38:59.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f89b2236700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac06dd20 con 0x7f89ac06e9d0 2024-04-18T10:38:59.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f89b2236700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0a18d0 con 0x7f89ac0680f0 2024-04-18T10:38:59.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f89ab7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f89ac069450 0x7f89ac0679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53304/0 (socket says 172.21.15.31:53304) 2024-04-18T10:38:59.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f89ab7fe700 1 -- 172.21.15.31:0/2763227617 learned_addr learned my addr 172.21.15.31:0/2763227617 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:59.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f89aaffd700 1 --2- 172.21.15.31:0/2763227617 >> v2:172.21.15.31:3300/0 conn(0x7f89ac06e9d0 0x7f89ac06f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f638bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f63940a6d60 0x7f6394142b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53310/0 (socket says 172.21.15.31:53310) 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f638bfff700 1 -- 172.21.15.31:0/252524972 learned_addr learned my addr 172.21.15.31:0/252524972 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f63937fe700 1 --2- 172.21.15.31:0/252524972 >> v2:172.21.15.31:3300/0 conn(0x7f639406ecf0 0x7f63940a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f6393fff700 1 --2- 172.21.15.31:0/252524972 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f63940a7130 0x7f63941462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f63937fe700 1 -- 172.21.15.31:0/252524972 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f63940a7130 msgr2=0x7f63941462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f63937fe700 1 --2- 172.21.15.31:0/252524972 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f63940a7130 0x7f63941462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f63937fe700 1 -- 172.21.15.31:0/252524972 >> v1:172.21.15.31:6789/0 conn(0x7f63940a6d60 legacy=0x7f6394142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f63937fe700 1 -- 172.21.15.31:0/252524972 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639406d980 con 0x7f639406ecf0 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.752+0000 7f6393fff700 1 --2- 172.21.15.31:0/252524972 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f63940a7130 0x7f63941462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f63937fe700 1 --2- 172.21.15.31:0/252524972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f639406ecf0 0x7f63940a5260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63840098e0 tx=0x7f63840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d576f86795842fde server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f6392ffd700 1 -- 172.21.15.31:0/252524972 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400b640 con 0x7f639406ecf0 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f6392ffd700 1 -- 172.21.15.31:0/252524972 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638400b7a0 con 0x7f639406ecf0 2024-04-18T10:38:59.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f6392ffd700 1 -- 172.21.15.31:0/252524972 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638400bb40 con 0x7f639406ecf0 2024-04-18T10:38:59.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f89aaffd700 1 -- 172.21.15.31:0/2763227617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ac0680f0 msgr2=0x7f89ac14d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f89aaffd700 1 --2- 172.21.15.31:0/2763227617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ac0680f0 0x7f89ac14d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f89aaffd700 1 -- 172.21.15.31:0/2763227617 >> v1:172.21.15.31:6789/0 conn(0x7f89ac069450 legacy=0x7f89ac0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f89aaffd700 1 -- 172.21.15.31:0/2763227617 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0a1b70 con 0x7f89ac06e9d0 2024-04-18T10:38:59.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f89aaffd700 1 --2- 172.21.15.31:0/2763227617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac06e9d0 0x7f89ac06f530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f89a00098e0 tx=0x7f89a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33766303f4e4633e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f6399e1e700 1 -- 172.21.15.31:0/252524972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f639406ecf0 msgr2=0x7f63940a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.753+0000 7f6399e1e700 1 --2- 172.21.15.31:0/252524972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f639406ecf0 0x7f63940a5260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63840098e0 tx=0x7f63840091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.754+0000 7f6399e1e700 1 -- 172.21.15.31:0/252524972 shutdown_connections 2024-04-18T10:38:59.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.754+0000 7f6399e1e700 1 --2- 172.21.15.31:0/252524972 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f63940a7130 0x7f63941462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.754+0000 7f6399e1e700 1 --2- 172.21.15.31:0/252524972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f639406ecf0 0x7f63940a5260 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.754+0000 7f6399e1e700 1 -- 172.21.15.31:0/252524972 >> 172.21.15.31:0/252524972 conn(0x7f63940679e0 msgr2=0x7f6394067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.755+0000 7f6399e1e700 1 -- 172.21.15.31:0/252524972 shutdown_connections 2024-04-18T10:38:59.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.755+0000 7f6399e1e700 1 -- 172.21.15.31:0/252524972 wait complete. 2024-04-18T10:38:59.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.756+0000 7f89aa7fc700 1 -- 172.21.15.31:0/2763227617 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0009e80 con 0x7f89ac06e9d0 2024-04-18T10:38:59.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.756+0000 7f89aa7fc700 1 -- 172.21.15.31:0/2763227617 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a000b760 con 0x7f89ac06e9d0 2024-04-18T10:38:59.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.756+0000 7f89aa7fc700 1 -- 172.21.15.31:0/2763227617 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000bae0 con 0x7f89ac06e9d0 2024-04-18T10:38:59.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.756+0000 7f89b2236700 1 -- 172.21.15.31:0/2763227617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac06e9d0 msgr2=0x7f89ac06f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.756+0000 7f89b2236700 1 --2- 172.21.15.31:0/2763227617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac06e9d0 0x7f89ac06f530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f89a00098e0 tx=0x7f89a00091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.756+0000 7f6399e1e700 1 Processor -- start 2024-04-18T10:38:59.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.756+0000 7f6399e1e700 1 -- start start 2024-04-18T10:38:59.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f89b2236700 1 -- 172.21.15.31:0/2763227617 shutdown_connections 2024-04-18T10:38:59.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f89b2236700 1 --2- 172.21.15.31:0/2763227617 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ac0680f0 0x7f89ac14d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f89b2236700 1 --2- 172.21.15.31:0/2763227617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac06e9d0 0x7f89ac06f530 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f89b2236700 1 -- 172.21.15.31:0/2763227617 >> 172.21.15.31:0/2763227617 conn(0x7f89ac06adc0 msgr2=0x7f89ac068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f6399e1e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f639406ecf0 0x7f63940ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f6399e1e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63940a6d60 0x7f63940ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f6399e1e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63940a7130 0x7f639414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f6399e1e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63940a29e0 con 0x7f63940a7130 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f6399e1e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6394097ad0 con 0x7f63940a6d60 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f6399e1e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63940ac780 con 0x7f639406ecf0 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f638bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63940a6d60 0x7f63940ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f638bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63940a6d60 0x7f63940ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53918/0 (socket says 172.21.15.31:53918) 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f638bfff700 1 -- 172.21.15.31:0/2211701679 learned_addr learned my addr 172.21.15.31:0/2211701679 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f63937fe700 1 --2- 172.21.15.31:0/2211701679 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f639406ecf0 0x7f63940ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f6393fff700 1 --2- 172.21.15.31:0/2211701679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63940a7130 0x7f639414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f63937fe700 1 -- 172.21.15.31:0/2211701679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63940a6d60 msgr2=0x7f63940ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f63937fe700 1 --2- 172.21.15.31:0/2211701679 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f63940a6d60 0x7f63940ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f63937fe700 1 -- 172.21.15.31:0/2211701679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63940a7130 msgr2=0x7f639414d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f63937fe700 1 --2- 172.21.15.31:0/2211701679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63940a7130 0x7f639414d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f63937fe700 1 -- 172.21.15.31:0/2211701679 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c00de50 con 0x7f639406ecf0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.757+0000 7f63937fe700 1 --2- 172.21.15.31:0/2211701679 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f639406ecf0 0x7f63940ace90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6394070090 tx=0x7f6384017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.758+0000 7f638b7fe700 1 -- 172.21.15.31:0/2211701679 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638401bb20 con 0x7f639406ecf0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.758+0000 7f638b7fe700 1 -- 172.21.15.31:0/2211701679 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638401bca0 con 0x7f639406ecf0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.758+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6384009420 con 0x7f639406ecf0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.758+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6394097db0 con 0x7f639406ecf0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.758+0000 7f638b7fe700 1 -- 172.21.15.31:0/2211701679 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63840266d0 con 0x7f639406ecf0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.758+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6378000fd0 con 0x7f639406ecf0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.759+0000 7f638b7fe700 1 -- 172.21.15.31:0/2211701679 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f6384023030 con 0x7f639406ecf0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.760+0000 7f638b7fe700 1 -- 172.21.15.31:0/2211701679 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f638405d060 con 0x7f639406ecf0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.760+0000 7f638b7fe700 1 -- 172.21.15.31:0/2211701679 --> v1:172.21.15.31:6812/49601 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6374052a60 con 0x7f637404eda0 2024-04-18T10:38:59.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.760+0000 7f638b7fe700 1 -- 172.21.15.31:0/2211701679 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f638405d430 con 0x7f639406ecf0 2024-04-18T10:38:59.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.761+0000 7f89b2236700 1 -- 172.21.15.31:0/2763227617 shutdown_connections 2024-04-18T10:38:59.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.761+0000 7f89b2236700 1 -- 172.21.15.31:0/2763227617 wait complete. 2024-04-18T10:38:59.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.762+0000 7f89b2236700 1 Processor -- start 2024-04-18T10:38:59.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.762+0000 7f89b2236700 1 -- start start 2024-04-18T10:38:59.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f89b2236700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac0680f0 0x7f89ac0a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f89b2236700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89ac069450 0x7f89ac0a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f89b2236700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ac06e9d0 0x7f89ac1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f89b2236700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0a7e70 con 0x7f89ac0680f0 2024-04-18T10:38:59.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f89b2236700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0a8330 con 0x7f89ac06e9d0 2024-04-18T10:38:59.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f89b2236700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac14fc60 con 0x7f89ac069450 2024-04-18T10:38:59.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f638b7fe700 1 -- 172.21.15.31:0/2211701679 <== osd.3 v1:172.21.15.31:6812/49601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f6374052a60 con 0x7f637404eda0 2024-04-18T10:38:59.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f89ab7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac0680f0 0x7f89ac0a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f89ab7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac0680f0 0x7f89ac0a6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54334/0 (socket says 172.21.15.31:54334) 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.763+0000 7f89ab7fe700 1 -- 172.21.15.31:0/1137823453 learned_addr learned my addr 172.21.15.31:0/1137823453 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.764+0000 7f89ab7fe700 1 -- 172.21.15.31:0/1137823453 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89ac069450 msgr2=0x7f89ac0a7360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.764+0000 7f89ab7fe700 1 --2- 172.21.15.31:0/1137823453 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f89ac069450 0x7f89ac0a7360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.764+0000 7f89ab7fe700 1 -- 172.21.15.31:0/1137823453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ac06e9d0 msgr2=0x7f89ac1523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.764+0000 7f89ab7fe700 1 --2- 172.21.15.31:0/1137823453 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f89ac06e9d0 0x7f89ac1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.764+0000 7f89ab7fe700 1 -- 172.21.15.31:0/1137823453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0009420 con 0x7f89ac0680f0 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.764+0000 7f89ab7fe700 1 --2- 172.21.15.31:0/1137823453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac0680f0 0x7f89ac0a6160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f899c00c960 tx=0x7f899c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.764+0000 7f89937fe700 1 -- 172.21.15.31:0/1137823453 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c00cea0 con 0x7f89ac0680f0 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.764+0000 7f89937fe700 1 -- 172.21.15.31:0/1137823453 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c005b30 con 0x7f89ac0680f0 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.764+0000 7f89937fe700 1 -- 172.21.15.31:0/1137823453 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0070f0 con 0x7f89ac0680f0 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.766+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac152190 con 0x7f89ac0680f0 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.766+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac0a78a0 con 0x7f89ac0680f0 2024-04-18T10:38:59.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.766+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f89ac0651b0 con 0x7f89ac0680f0 2024-04-18T10:38:59.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.767+0000 7f89937fe700 1 -- 172.21.15.31:0/1137823453 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f899c007520 con 0x7f89ac0680f0 2024-04-18T10:38:59.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.767+0000 7f89937fe700 1 -- 172.21.15.31:0/1137823453 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f899c05a680 con 0x7f89ac0680f0 2024-04-18T10:38:59.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.767+0000 7f89937fe700 1 -- 172.21.15.31:0/1137823453 --> v1:172.21.15.31:6800/49212 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f89980529e0 con 0x7f899804ed20 2024-04-18T10:38:59.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.767+0000 7f89937fe700 1 -- 172.21.15.31:0/1137823453 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f899c038a50 con 0x7f89ac0680f0 2024-04-18T10:38:59.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.769+0000 7f89937fe700 1 -- 172.21.15.31:0/1137823453 <== osd.0 v1:172.21.15.31:6800/49212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f89980529e0 con 0x7f899804ed20 2024-04-18T10:38:59.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.770+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 --> v1:172.21.15.31:6808/49420 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67980ac260 con 0x7f677804eda0 2024-04-18T10:38:59.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.770+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 --> v1:172.21.15.31:6804/49310 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3db0002d00 con 0x7f3db404ed20 2024-04-18T10:38:59.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.771+0000 7f3dc57fa700 1 -- 172.21.15.31:0/2691595659 <== osd.1 v1:172.21.15.31:6804/49310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1525574182) 0x7f3db0002d00 con 0x7f3db404ed20 2024-04-18T10:38:59.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.771+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 >> v1:172.21.15.31:6804/49310 conn(0x7f3db404ed20 legacy=0x7f3db4051170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.771+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 >> v1:172.21.15.31:6816/46601 conn(0x7f3db4046010 legacy=0x7f3db40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.771+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3dd00a5b10 msgr2=0x7f3dd013f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.771+0000 7f3dd77d7700 1 --2- 172.21.15.31:0/2691595659 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3dd00a5b10 0x7f3dd013f0e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000b610 tx=0x7f3dc00091a0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.771+0000 7f3dd5d74700 1 -- 172.21.15.31:0/2691595659 reap_dead start 2024-04-18T10:38:59.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.771+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 shutdown_connections 2024-04-18T10:38:59.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.771+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 >> 172.21.15.31:0/2691595659 conn(0x7f3dd00b1290 msgr2=0x7f3dd00b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.772+0000 7f6794ff9700 1 -- 172.21.15.31:0/2341776750 <== osd.2 v1:172.21.15.31:6808/49420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3918910179) 0x7f67980ac260 con 0x7f677804eda0 2024-04-18T10:38:59.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.772+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 shutdown_connections 2024-04-18T10:38:59.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.772+0000 7f3dd77d7700 1 -- 172.21.15.31:0/2691595659 wait complete. 2024-04-18T10:38:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.772+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 >> v1:172.21.15.31:6808/49420 conn(0x7f677804eda0 legacy=0x7f67780511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.772+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 >> v1:172.21.15.31:6816/46601 conn(0x7f6778046010 legacy=0x7f67780484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.772+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798063b00 msgr2=0x7f6798151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.772+0000 7f679e983700 1 --2- 172.21.15.31:0/2341776750 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f6798063b00 0x7f6798151420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f678800c5c0 tx=0x7f678800c980 comp rx=0 tx=0).stop 2024-04-18T10:38:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.772+0000 7f679cf20700 1 -- 172.21.15.31:0/2341776750 reap_dead start 2024-04-18T10:38:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.774+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 shutdown_connections 2024-04-18T10:38:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.774+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 >> 172.21.15.31:0/2341776750 conn(0x7f679806a390 msgr2=0x7f67980ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.777+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 shutdown_connections 2024-04-18T10:38:59.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.777+0000 7f679e983700 1 -- 172.21.15.31:0/2341776750 wait complete. 2024-04-18T10:38:59.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.786+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 --> v1:172.21.15.31:6812/49601 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6378002d00 con 0x7f637404eda0 2024-04-18T10:38:59.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.787+0000 7f638b7fe700 1 -- 172.21.15.31:0/2211701679 <== osd.3 v1:172.21.15.31:6812/49601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2909512871) 0x7f6378002d00 con 0x7f637404eda0 2024-04-18T10:38:59.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.787+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 >> v1:172.21.15.31:6812/49601 conn(0x7f637404eda0 legacy=0x7f63740511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.788+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 >> v1:172.21.15.31:6816/46601 conn(0x7f6374046010 legacy=0x7f63740484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.788+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f639406ecf0 msgr2=0x7f63940ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.788+0000 7f6399e1e700 1 --2- 172.21.15.31:0/2211701679 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f639406ecf0 0x7f63940ace90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6394070090 tx=0x7f6384017000 comp rx=0 tx=0).stop 2024-04-18T10:38:59.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.788+0000 7f6393fff700 1 -- 172.21.15.31:0/2211701679 reap_dead start 2024-04-18T10:38:59.789 INFO:teuthology.orchestra.run.smithi031.stdout:128849018885 2024-04-18T10:38:59.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T10:38:59.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.788+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 shutdown_connections 2024-04-18T10:38:59.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.788+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 >> 172.21.15.31:0/2211701679 conn(0x7f63940679e0 msgr2=0x7f63940b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.788+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 shutdown_connections 2024-04-18T10:38:59.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.788+0000 7f6399e1e700 1 -- 172.21.15.31:0/2211701679 wait complete. 2024-04-18T10:38:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.794+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 --> v1:172.21.15.31:6800/49212 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f89ac0a8fd0 con 0x7f899804ed20 2024-04-18T10:38:59.795 INFO:teuthology.orchestra.run.smithi031.stdout:133143986180 2024-04-18T10:38:59.795 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T10:38:59.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.794+0000 7f89937fe700 1 -- 172.21.15.31:0/1137823453 <== osd.0 v1:172.21.15.31:6800/49212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3806383025) 0x7f89ac0a8fd0 con 0x7f899804ed20 2024-04-18T10:38:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.794+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 >> v1:172.21.15.31:6800/49212 conn(0x7f899804ed20 legacy=0x7f8998051170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.795+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 >> v1:172.21.15.31:6816/46601 conn(0x7f8998046010 legacy=0x7f89980484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.795+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac0680f0 msgr2=0x7f89ac0a6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.795+0000 7f89b2236700 1 --2- 172.21.15.31:0/1137823453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89ac0680f0 0x7f89ac0a6160 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f899c00c960 tx=0x7f899c007ef0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.795+0000 7f89abfff700 1 -- 172.21.15.31:0/1137823453 reap_dead start 2024-04-18T10:38:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.795+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 shutdown_connections 2024-04-18T10:38:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.795+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 >> 172.21.15.31:0/1137823453 conn(0x7f89ac06adc0 msgr2=0x7f89ac0a3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.795+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 shutdown_connections 2024-04-18T10:38:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.795+0000 7f89b2236700 1 -- 172.21.15.31:0/1137823453 wait complete. 2024-04-18T10:38:59.803 INFO:teuthology.orchestra.run.smithi031.stdout:137438953476 2024-04-18T10:38:59.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T10:38:59.809 INFO:teuthology.orchestra.run.smithi031.stdout:124554051589 2024-04-18T10:38:59.809 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T10:38:59.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.924+0000 7fb718c0f700 1 Processor -- start 2024-04-18T10:38:59.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.924+0000 7fb718c0f700 1 -- start start 2024-04-18T10:38:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb718c0f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb714063b80 0x7fb7140ab350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb718c0f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7140aa7f0 0x7fb71413b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb718c0f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aabe0 0x7fb71413bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb718c0f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7140a9fd0 con 0x7fb7140aa7f0 2024-04-18T10:38:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb718c0f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140acba0 con 0x7fb7140aabe0 2024-04-18T10:38:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb718c0f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7140ace40 con 0x7fb714063b80 2024-04-18T10:38:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb712d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aabe0 0x7fb71413bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb712d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aabe0 0x7fb71413bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53928/0 (socket says 172.21.15.31:53928) 2024-04-18T10:38:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb712d9d700 1 -- 172.21.15.31:0/244556175 learned_addr learned my addr 172.21.15.31:0/244556175 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.925+0000 7fb711d9b700 1 --2- 172.21.15.31:0/244556175 >> v2:172.21.15.31:3300/0 conn(0x7fb7140aa7f0 0x7fb71413b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb712d9d700 1 -- 172.21.15.31:0/244556175 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb714063b80 msgr2=0x7fb7140ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb712d9d700 1 --2- 172.21.15.31:0/244556175 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb714063b80 0x7fb7140ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb712d9d700 1 -- 172.21.15.31:0/244556175 >> v2:172.21.15.31:3300/0 conn(0x7fb7140aa7f0 msgr2=0x7fb71413b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb712d9d700 1 --2- 172.21.15.31:0/244556175 >> v2:172.21.15.31:3300/0 conn(0x7fb7140aa7f0 0x7fb71413b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb712d9d700 1 -- 172.21.15.31:0/244556175 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7140ac390 con 0x7fb7140aabe0 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb711d9b700 1 --2- 172.21.15.31:0/244556175 >> v2:172.21.15.31:3300/0 conn(0x7fb7140aa7f0 0x7fb71413b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb712d9d700 1 --2- 172.21.15.31:0/244556175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aabe0 0x7fb71413bab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009f20 tx=0x7fb70c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240b429aae56f86e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb71159a700 1 -- 172.21.15.31:0/244556175 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c00e070 con 0x7fb7140aabe0 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb71159a700 1 -- 172.21.15.31:0/244556175 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c00b9d0 con 0x7fb7140aabe0 2024-04-18T10:38:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.926+0000 7fb71159a700 1 -- 172.21.15.31:0/244556175 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0092e0 con 0x7fb7140aabe0 2024-04-18T10:38:59.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.927+0000 7fb718c0f700 1 -- 172.21.15.31:0/244556175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aabe0 msgr2=0x7fb71413bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.927+0000 7fb718c0f700 1 --2- 172.21.15.31:0/244556175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aabe0 0x7fb71413bab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009f20 tx=0x7fb70c009840 comp rx=0 tx=0).stop 2024-04-18T10:38:59.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.927+0000 7fb718c0f700 1 -- 172.21.15.31:0/244556175 shutdown_connections 2024-04-18T10:38:59.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.927+0000 7fb718c0f700 1 --2- 172.21.15.31:0/244556175 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aabe0 0x7fb71413bab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.927+0000 7fb718c0f700 1 --2- 172.21.15.31:0/244556175 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb714063b80 0x7fb7140ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.927+0000 7fb718c0f700 1 --2- 172.21.15.31:0/244556175 >> v2:172.21.15.31:3300/0 conn(0x7fb7140aa7f0 0x7fb71413b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.927+0000 7fb718c0f700 1 -- 172.21.15.31:0/244556175 >> 172.21.15.31:0/244556175 conn(0x7fb7140b1290 msgr2=0x7fb7140b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.927+0000 7fb718c0f700 1 -- 172.21.15.31:0/244556175 shutdown_connections 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.927+0000 7fb718c0f700 1 -- 172.21.15.31:0/244556175 wait complete. 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.929+0000 7fb718c0f700 1 Processor -- start 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.929+0000 7fb718c0f700 1 -- start start 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.929+0000 7fb718c0f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb714063b80 0x7fb714140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.929+0000 7fb718c0f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aa7f0 0x7fb714151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.929+0000 7fb718c0f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7140aabe0 0x7fb714151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.929+0000 7fb718c0f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7141415d0 con 0x7fb714063b80 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.929+0000 7fb718c0f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7141401e0 con 0x7fb7140aa7f0 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.929+0000 7fb718c0f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7141417f0 con 0x7fb7140aabe0 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb711d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aa7f0 0x7fb714151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb711d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aa7f0 0x7fb714151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53932/0 (socket says 172.21.15.31:53932) 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb711d9b700 1 -- 172.21.15.31:0/4068298864 learned_addr learned my addr 172.21.15.31:0/4068298864 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb712d9d700 1 --2- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7140aabe0 0x7fb714151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb71259c700 1 --2- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb714063b80 0x7fb714140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb711d9b700 1 -- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7140aabe0 msgr2=0x7fb714151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb711d9b700 1 --2- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7140aabe0 0x7fb714151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb711d9b700 1 -- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb714063b80 msgr2=0x7fb714140ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb711d9b700 1 --2- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb714063b80 0x7fb714140ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb711d9b700 1 -- 172.21.15.31:0/4068298864 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708009420 con 0x7fb7140aa7f0 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb711d9b700 1 --2- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aa7f0 0x7fb714151420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb70800ec80 tx=0x7fb7080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb7027fc700 1 -- 172.21.15.31:0/4068298864 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800c850 con 0x7fb7140aa7f0 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb7027fc700 1 -- 172.21.15.31:0/4068298864 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70800c9b0 con 0x7fb7140aa7f0 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.930+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c009ae0 con 0x7fb7140aa7f0 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.931+0000 7fb7027fc700 1 -- 172.21.15.31:0/4068298864 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800cd30 con 0x7fb7140aa7f0 2024-04-18T10:38:59.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.931+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb714141020 con 0x7fb7140aa7f0 2024-04-18T10:38:59.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.931+0000 7fb7027fc700 1 -- 172.21.15.31:0/4068298864 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fb708013680 con 0x7fb7140aa7f0 2024-04-18T10:38:59.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.932+0000 7fb7027fc700 1 -- 172.21.15.31:0/4068298864 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fb70805b7d0 con 0x7fb7140aa7f0 2024-04-18T10:38:59.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.932+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7140651b0 con 0x7fb7140aa7f0 2024-04-18T10:38:59.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.936+0000 7fb7027fc700 1 -- 172.21.15.31:0/4068298864 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fb7080399f0 con 0x7fb7140aa7f0 2024-04-18T10:38:59.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.940+0000 7f823c9d3700 1 Processor -- start 2024-04-18T10:38:59.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.941+0000 7f823c9d3700 1 -- start start 2024-04-18T10:38:59.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.941+0000 7f823c9d3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380ad750 0x7f823806df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.941+0000 7f823c9d3700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f823813b200 0x7f823813e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.941+0000 7f823c9d3700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82380adb20 con 0x7f823813add0 2024-04-18T10:38:59.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.941+0000 7f823c9d3700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823813a660 con 0x7f823813b200 2024-04-18T10:38:59.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.941+0000 7f823c9d3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f823813a900 con 0x7f82380ad750 2024-04-18T10:38:59.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.941+0000 7f8236d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f823813b200 0x7f823813e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f8236d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f823813b200 0x7f823813e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54358/0 (socket says 172.21.15.31:54358) 2024-04-18T10:38:59.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380ad750 0x7f823806df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f8236d9d700 1 -- 172.21.15.31:0/3182192510 learned_addr learned my addr 172.21.15.31:0/3182192510 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f8235d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f823813add0 0x7f823813dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53320/0 (socket says 172.21.15.31:53320) 2024-04-18T10:38:59.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823659c700 1 -- 172.21.15.31:0/3182192510 >> v2:172.21.15.31:3300/0 conn(0x7f823813b200 msgr2=0x7f823813e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823659c700 1 --2- 172.21.15.31:0/3182192510 >> v2:172.21.15.31:3300/0 conn(0x7f823813b200 0x7f823813e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823559a700 1 -- 172.21.15.31:0/3182192510 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711449895 0 0) 0x7f82380adb20 con 0x7f823813add0 2024-04-18T10:38:59.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823659c700 1 -- 172.21.15.31:0/3182192510 >> v1:172.21.15.31:6789/0 conn(0x7f823813add0 legacy=0x7f823813dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823659c700 1 -- 172.21.15.31:0/3182192510 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82380ac500 con 0x7f82380ad750 2024-04-18T10:38:59.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823659c700 1 --2- 172.21.15.31:0/3182192510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380ad750 0x7f823806df40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82280098f0 tx=0x7f8228009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=579f7e3c71b4d377 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823559a700 1 -- 172.21.15.31:0/3182192510 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228017070 con 0x7f82380ad750 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823559a700 1 -- 172.21.15.31:0/3182192510 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822800d040 con 0x7f82380ad750 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.942+0000 7f823559a700 1 -- 172.21.15.31:0/3182192510 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228006d40 con 0x7f82380ad750 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.943+0000 7f823c9d3700 1 -- 172.21.15.31:0/3182192510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380ad750 msgr2=0x7f823806df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.943+0000 7f823c9d3700 1 --2- 172.21.15.31:0/3182192510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380ad750 0x7f823806df40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82280098f0 tx=0x7f8228009190 comp rx=0 tx=0).stop 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.943+0000 7f823c9d3700 1 -- 172.21.15.31:0/3182192510 shutdown_connections 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.943+0000 7f823c9d3700 1 --2- 172.21.15.31:0/3182192510 >> v2:172.21.15.31:3300/0 conn(0x7f823813b200 0x7f823813e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.943+0000 7f823c9d3700 1 --2- 172.21.15.31:0/3182192510 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380ad750 0x7f823806df40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.943+0000 7f823c9d3700 1 -- 172.21.15.31:0/3182192510 >> 172.21.15.31:0/3182192510 conn(0x7f82380b1390 msgr2=0x7f82380b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.943+0000 7f823c9d3700 1 -- 172.21.15.31:0/3182192510 shutdown_connections 2024-04-18T10:38:59.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.943+0000 7f823c9d3700 1 -- 172.21.15.31:0/3182192510 wait complete. 2024-04-18T10:38:59.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.944+0000 7f823c9d3700 1 Processor -- start 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.944+0000 7f823c9d3700 1 -- start start 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823c9d3700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380ad750 0x7f82380aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823c9d3700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823813add0 0x7f8238151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823c9d3700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823813b200 0x7f82381519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823c9d3700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82380ab510 con 0x7f823813b200 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823c9d3700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823811ef90 con 0x7f82380ad750 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823c9d3700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82380aaca0 con 0x7f823813add0 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380ad750 0x7f82380aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380ad750 0x7f82380aa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53944/0 (socket says 172.21.15.31:53944) 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f8235d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823813add0 0x7f8238151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823659c700 1 -- 172.21.15.31:0/1632793926 learned_addr learned my addr 172.21.15.31:0/1632793926 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f8236d9d700 1 --2- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823813b200 0x7f82381519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823659c700 1 -- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823813add0 msgr2=0x7f8238151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823659c700 1 --2- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823813add0 0x7f8238151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823659c700 1 -- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823813b200 msgr2=0x7f82381519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823659c700 1 --2- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823813b200 0x7f82381519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.945+0000 7f823659c700 1 -- 172.21.15.31:0/1632793926 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228009430 con 0x7f82380ad750 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.946+0000 7f823659c700 1 --2- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380ad750 0x7f82380aa2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8228009f90 tx=0x7f8228019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.946+0000 7f82267fc700 1 -- 172.21.15.31:0/1632793926 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228006ad0 con 0x7f82380ad750 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.946+0000 7f82267fc700 1 -- 172.21.15.31:0/1632793926 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8228006c50 con 0x7f82380ad750 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.946+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82380aafc0 con 0x7f82380ad750 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.946+0000 7f82267fc700 1 -- 172.21.15.31:0/1632793926 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228013a90 con 0x7f82380ad750 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.946+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823811d9b0 con 0x7f82380ad750 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.947+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82380651b0 con 0x7f82380ad750 2024-04-18T10:38:59.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.947+0000 7f82267fc700 1 -- 172.21.15.31:0/1632793926 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f8228007030 con 0x7f82380ad750 2024-04-18T10:38:59.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.947+0000 7f82267fc700 1 -- 172.21.15.31:0/1632793926 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f822805c750 con 0x7f82380ad750 2024-04-18T10:38:59.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.951+0000 7f82267fc700 1 -- 172.21.15.31:0/1632793926 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f822803e1f0 con 0x7f82380ad750 2024-04-18T10:38:59.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.985+0000 7f791411a700 1 Processor -- start 2024-04-18T10:38:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.985+0000 7f791411a700 1 -- start start 2024-04-18T10:38:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f791411a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c06eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f791411a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0679e0 0x7f790c067db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f791411a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f790c0682f0 0x7f790c14c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f791411a700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790c06f0d0 con 0x7f790c0682f0 2024-04-18T10:38:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f791411a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0a27f0 con 0x7f790c0679e0 2024-04-18T10:38:59.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f791411a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f790c06e070 con 0x7f790c069200 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f7911eb6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c06eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f79126b7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f790c0682f0 0x7f790c14c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f79116b5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0679e0 0x7f790c067db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f7911eb6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c06eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43998/0 (socket says 172.21.15.31:43998) 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f79126b7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f790c0682f0 0x7f790c14c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54380/0 (socket says 172.21.15.31:54380) 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f7911eb6700 1 -- 172.21.15.31:0/2244412348 learned_addr learned my addr 172.21.15.31:0/2244412348 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f7911eb6700 1 -- 172.21.15.31:0/2244412348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0679e0 msgr2=0x7f790c067db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f7911eb6700 1 --2- 172.21.15.31:0/2244412348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0679e0 0x7f790c067db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f7911eb6700 1 -- 172.21.15.31:0/2244412348 >> v2:172.21.15.31:3300/0 conn(0x7f790c0682f0 msgr2=0x7f790c14c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f7911eb6700 1 --2- 172.21.15.31:0/2244412348 >> v2:172.21.15.31:3300/0 conn(0x7f790c0682f0 0x7f790c14c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f7911eb6700 1 -- 172.21.15.31:0/2244412348 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0a3090 con 0x7f790c069200 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f79116b5700 1 --2- 172.21.15.31:0/2244412348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0679e0 0x7f790c067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.986+0000 7f79126b7700 1 --2- 172.21.15.31:0/2244412348 >> v2:172.21.15.31:3300/0 conn(0x7f790c0682f0 0x7f790c14c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:38:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.987+0000 7f7911eb6700 1 --2- 172.21.15.31:0/2244412348 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c06eb90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79080099e0 tx=0x7f7908009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a9b390c3f115710 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.987+0000 7f7910eb4700 1 -- 172.21.15.31:0/2244412348 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790800b640 con 0x7f790c069200 2024-04-18T10:38:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.987+0000 7f7910eb4700 1 -- 172.21.15.31:0/2244412348 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790800b7a0 con 0x7f790c069200 2024-04-18T10:38:59.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.987+0000 7f7910eb4700 1 -- 172.21.15.31:0/2244412348 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790800bb60 con 0x7f790c069200 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.988+0000 7f791411a700 1 -- 172.21.15.31:0/2244412348 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 msgr2=0x7f790c06eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.988+0000 7f791411a700 1 --2- 172.21.15.31:0/2244412348 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c06eb90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79080099e0 tx=0x7f7908009250 comp rx=0 tx=0).stop 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.988+0000 7f791411a700 1 -- 172.21.15.31:0/2244412348 shutdown_connections 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.988+0000 7f791411a700 1 --2- 172.21.15.31:0/2244412348 >> v2:172.21.15.31:3300/0 conn(0x7f790c0682f0 0x7f790c14c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.988+0000 7f791411a700 1 --2- 172.21.15.31:0/2244412348 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c06eb90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.988+0000 7f791411a700 1 --2- 172.21.15.31:0/2244412348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0679e0 0x7f790c067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.988+0000 7f791411a700 1 -- 172.21.15.31:0/2244412348 >> 172.21.15.31:0/2244412348 conn(0x7f790c06ae80 msgr2=0x7f790c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.988+0000 7f791411a700 1 -- 172.21.15.31:0/2244412348 shutdown_connections 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.988+0000 7f791411a700 1 -- 172.21.15.31:0/2244412348 wait complete. 2024-04-18T10:38:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.989+0000 7f791411a700 1 Processor -- start 2024-04-18T10:38:59.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.989+0000 7f791411a700 1 -- start start 2024-04-18T10:38:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f791411a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f790c0679e0 0x7f790c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f791411a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0682f0 0x7f790c0ac510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f791411a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c0aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f791411a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0adf50 con 0x7f790c0679e0 2024-04-18T10:38:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f791411a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c13c9e0 con 0x7f790c0682f0 2024-04-18T10:38:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f791411a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f790c13cc40 con 0x7f790c069200 2024-04-18T10:38:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f79126b7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c0aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f79126b7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c0aca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44000/0 (socket says 172.21.15.31:44000) 2024-04-18T10:38:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f79126b7700 1 -- 172.21.15.31:0/3850433496 learned_addr learned my addr 172.21.15.31:0/3850433496 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f79116b5700 1 --2- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0682f0 0x7f790c0ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.990+0000 7f7911eb6700 1 --2- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f790c0679e0 0x7f790c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f79126b7700 1 -- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0682f0 msgr2=0x7f790c0ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f79126b7700 1 --2- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0682f0 0x7f790c0ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f79126b7700 1 -- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f790c0679e0 msgr2=0x7f790c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f79126b7700 1 --2- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f790c0679e0 0x7f790c0ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f79126b7700 1 -- 172.21.15.31:0/3850433496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc009420 con 0x7f790c069200 2024-04-18T10:38:59.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f79126b7700 1 --2- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c0aca50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f790400c0f0 tx=0x7f790400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f5563179700 1 Processor -- start 2024-04-18T10:38:59.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f7901ffb700 1 -- 172.21.15.31:0/3850433496 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790400ccc0 con 0x7f790c069200 2024-04-18T10:38:59.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f5563179700 1 -- start start 2024-04-18T10:38:59.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f7901ffb700 1 -- 172.21.15.31:0/3850433496 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790400f040 con 0x7f790c069200 2024-04-18T10:38:59.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f7901ffb700 1 -- 172.21.15.31:0/3850433496 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7904014480 con 0x7f790c069200 2024-04-18T10:38:59.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.991+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7904009a20 con 0x7f790c069200 2024-04-18T10:38:59.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79080094f0 con 0x7f790c069200 2024-04-18T10:38:59.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5563179700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c06e900 0x7f555c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5563179700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f555c142fd0 0x7f555c1453b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:38:59.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5563179700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c0ac620 con 0x7f555c0ad3b0 2024-04-18T10:38:59.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5563179700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555c06e190 con 0x7f555c142fd0 2024-04-18T10:38:59.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5563179700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f555c06d810 con 0x7f555c06e900 2024-04-18T10:38:59.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5560f15700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c06e900 0x7f555c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5561716700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f555c142fd0 0x7f555c1453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5560f15700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c06e900 0x7f555c06d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44004/0 (socket says 172.21.15.31:44004) 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5561716700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f555c142fd0 0x7f555c1453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54386/0 (socket says 172.21.15.31:54386) 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.992+0000 7f5560f15700 1 -- 172.21.15.31:0/3898677434 learned_addr learned my addr 172.21.15.31:0/3898677434 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.993+0000 7f5560f15700 1 -- 172.21.15.31:0/3898677434 >> v2:172.21.15.31:3300/0 conn(0x7f555c142fd0 msgr2=0x7f555c1453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.993+0000 7f5560f15700 1 --2- 172.21.15.31:0/3898677434 >> v2:172.21.15.31:3300/0 conn(0x7f555c142fd0 0x7f555c1453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.993+0000 7f5560f15700 1 -- 172.21.15.31:0/3898677434 >> v1:172.21.15.31:6789/0 conn(0x7f555c0ad3b0 legacy=0x7f555c13e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.993+0000 7f5560f15700 1 -- 172.21.15.31:0/3898677434 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c13dc60 con 0x7f555c06e900 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.993+0000 7f5561716700 1 --2- 172.21.15.31:0/3898677434 >> v2:172.21.15.31:3300/0 conn(0x7f555c142fd0 0x7f555c1453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.993+0000 7f5560f15700 1 --2- 172.21.15.31:0/3898677434 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c06e900 0x7f555c06d150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f554800bc40 tx=0x7f554800b4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a85c4f6067500d48 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.993+0000 7f555b7fe700 1 -- 172.21.15.31:0/3898677434 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800db90 con 0x7f555c06e900 2024-04-18T10:38:59.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.993+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c0ab700 con 0x7f790c069200 2024-04-18T10:38:59.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.994+0000 7f7901ffb700 1 -- 172.21.15.31:0/3850433496 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f7904003020 con 0x7f790c069200 2024-04-18T10:38:59.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.994+0000 7f7901ffb700 1 -- 172.21.15.31:0/3850433496 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f790405c720 con 0x7f790c069200 2024-04-18T10:38:59.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.997+0000 7f555b7fe700 1 -- 172.21.15.31:0/3898677434 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554800dcf0 con 0x7f555c06e900 2024-04-18T10:38:59.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.997+0000 7f555b7fe700 1 -- 172.21.15.31:0/3898677434 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548017640 con 0x7f555c06e900 2024-04-18T10:38:59.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.997+0000 7f5563179700 1 -- 172.21.15.31:0/3898677434 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c06e900 msgr2=0x7f555c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:38:59.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.997+0000 7f5563179700 1 --2- 172.21.15.31:0/3898677434 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c06e900 0x7f555c06d150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f554800bc40 tx=0x7f554800b4e0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.997+0000 7f7901ffb700 1 -- 172.21.15.31:0/3850433496 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f790403a830 con 0x7f790c069200 2024-04-18T10:38:59.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.998+0000 7f5563179700 1 -- 172.21.15.31:0/3898677434 shutdown_connections 2024-04-18T10:38:59.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.998+0000 7f5563179700 1 --2- 172.21.15.31:0/3898677434 >> v2:172.21.15.31:3300/0 conn(0x7f555c142fd0 0x7f555c1453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.998+0000 7f5563179700 1 --2- 172.21.15.31:0/3898677434 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c06e900 0x7f555c06d150 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:38:59.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.998+0000 7f5563179700 1 -- 172.21.15.31:0/3898677434 >> 172.21.15.31:0/3898677434 conn(0x7f555c0b1290 msgr2=0x7f555c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:00.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.998+0000 7f5563179700 1 -- 172.21.15.31:0/3898677434 shutdown_connections 2024-04-18T10:39:00.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.998+0000 7f5563179700 1 -- 172.21.15.31:0/3898677434 wait complete. 2024-04-18T10:39:00.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.999+0000 7f5563179700 1 Processor -- start 2024-04-18T10:39:00.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:38:59.999+0000 7f5563179700 1 -- start start 2024-04-18T10:39:00.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5563179700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c06e900 0x7f555c1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:00.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5563179700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c142fd0 0x7f555c151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5563179700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c141170 0x7f555c151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5563179700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555c13fc20 con 0x7f555c141170 2024-04-18T10:39:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5563179700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555c0aac70 con 0x7f555c06e900 2024-04-18T10:39:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5563179700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f555c13f850 con 0x7f555c142fd0 2024-04-18T10:39:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5561716700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c141170 0x7f555c151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5560f15700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c06e900 0x7f555c1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5560f15700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c06e900 0x7f555c1408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53970/0 (socket says 172.21.15.31:53970) 2024-04-18T10:39:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5561716700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c141170 0x7f555c151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54394/0 (socket says 172.21.15.31:54394) 2024-04-18T10:39:00.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5560f15700 1 -- 172.21.15.31:0/254355396 learned_addr learned my addr 172.21.15.31:0/254355396 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:00.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5560f15700 1 -- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c142fd0 msgr2=0x7f555c151700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:39:00.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5560f15700 1 --2- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c142fd0 0x7f555c151700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5560f15700 1 -- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c141170 msgr2=0x7f555c151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:00.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5560f15700 1 --2- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c141170 0x7f555c151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5560f15700 1 -- 172.21.15.31:0/254355396 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554800b780 con 0x7f555c06e900 2024-04-18T10:39:00.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.000+0000 7f5560f15700 1 --2- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c06e900 0x7f555c1408d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f554800b520 tx=0x7f5548019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:00.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.001+0000 7f5558ff9700 1 -- 172.21.15.31:0/254355396 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548009040 con 0x7f555c06e900 2024-04-18T10:39:00.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.001+0000 7f5558ff9700 1 -- 172.21.15.31:0/254355396 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55480165d0 con 0x7f555c06e900 2024-04-18T10:39:00.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.001+0000 7f5558ff9700 1 -- 172.21.15.31:0/254355396 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548016990 con 0x7f555c06e900 2024-04-18T10:39:00.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.001+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c0aaf10 con 0x7f555c06e900 2024-04-18T10:39:00.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.001+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c0aa900 con 0x7f555c06e900 2024-04-18T10:39:00.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.002+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555c0651b0 con 0x7f555c06e900 2024-04-18T10:39:00.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.004+0000 7f5558ff9700 1 -- 172.21.15.31:0/254355396 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f5548015070 con 0x7f555c06e900 2024-04-18T10:39:00.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.004+0000 7f5558ff9700 1 -- 172.21.15.31:0/254355396 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f554805d430 con 0x7f555c06e900 2024-04-18T10:39:00.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.006+0000 7f5558ff9700 1 -- 172.21.15.31:0/254355396 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5548007050 con 0x7f555c06e900 2024-04-18T10:39:00.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.121+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f823806e930 con 0x7f82380ad750 2024-04-18T10:39:00.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.122+0000 7f82267fc700 1 -- 172.21.15.31:0/1632793926 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8228021090 con 0x7f82380ad750 2024-04-18T10:39:00.123 INFO:teuthology.orchestra.run.smithi031.stdout:133143986179 2024-04-18T10:39:00.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 >> v1:172.21.15.31:6816/46601 conn(0x7f8218046010 legacy=0x7f82180484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:00.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380ad750 msgr2=0x7f82380aa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:00.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 --2- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380ad750 0x7f82380aa2d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8228009f90 tx=0x7f8228019000 comp rx=0 tx=0).stop 2024-04-18T10:39:00.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 shutdown_connections 2024-04-18T10:39:00.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 --2- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f823813b200 0x7f82381519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 --2- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380ad750 0x7f82380aa2d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 --2- 172.21.15.31:0/1632793926 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f823813add0 0x7f8238151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 >> 172.21.15.31:0/1632793926 conn(0x7f82380b1390 msgr2=0x7f823806de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:00.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 shutdown_connections 2024-04-18T10:39:00.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.124+0000 7f823c9d3700 1 -- 172.21.15.31:0/1632793926 wait complete. 2024-04-18T10:39:00.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.125+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb7140ab130 con 0x7fb7140aa7f0 2024-04-18T10:39:00.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.125+0000 7fb7027fc700 1 -- 172.21.15.31:0/4068298864 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb70803d1e0 con 0x7fb7140aa7f0 2024-04-18T10:39:00.126 INFO:teuthology.orchestra.run.smithi031.stdout:128849018883 2024-04-18T10:39:00.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 >> v1:172.21.15.31:6816/46601 conn(0x7fb6f4046010 legacy=0x7fb6f40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:00.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aa7f0 msgr2=0x7fb714151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:00.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 --2- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aa7f0 0x7fb714151420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb70800ec80 tx=0x7fb7080091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 shutdown_connections 2024-04-18T10:39:00.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 --2- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7140aabe0 0x7fb714151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 --2- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb714063b80 0x7fb714140ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 --2- 172.21.15.31:0/4068298864 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7140aa7f0 0x7fb714151420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 >> 172.21.15.31:0/4068298864 conn(0x7fb7140b1290 msgr2=0x7fb7140b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:00.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 shutdown_connections 2024-04-18T10:39:00.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.128+0000 7fb718c0f700 1 -- 172.21.15.31:0/4068298864 wait complete. 2024-04-18T10:39:00.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2024-04-18T10:39:00.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018883 for osd.1 2024-04-18T10:39:00.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.189+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f790c0651b0 con 0x7f790c069200 2024-04-18T10:39:00.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.189+0000 7f7901ffb700 1 -- 172.21.15.31:0/3850433496 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7904018030 con 0x7f790c069200 2024-04-18T10:39:00.190 INFO:teuthology.orchestra.run.smithi031.stdout:124554051587 2024-04-18T10:39:00.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.191+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 >> v1:172.21.15.31:6816/46601 conn(0x7f78f0046010 legacy=0x7f78f00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:00.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.191+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 msgr2=0x7f790c0aca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:00.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.191+0000 7f791411a700 1 --2- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c0aca50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f790400c0f0 tx=0x7f790400b040 comp rx=0 tx=0).stop 2024-04-18T10:39:00.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.191+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 shutdown_connections 2024-04-18T10:39:00.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.191+0000 7f791411a700 1 --2- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f790c069200 0x7f790c0aca50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.191+0000 7f791411a700 1 --2- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f790c0679e0 0x7f790c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.191+0000 7f791411a700 1 --2- 172.21.15.31:0/3850433496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f790c0682f0 0x7f790c0ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.191+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 >> 172.21.15.31:0/3850433496 conn(0x7f790c06ae80 msgr2=0x7f790c140100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:00.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.192+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 shutdown_connections 2024-04-18T10:39:00.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.192+0000 7f791411a700 1 -- 172.21.15.31:0/3850433496 wait complete. 2024-04-18T10:39:00.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.197+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f555c0651b0 con 0x7f555c06e900 2024-04-18T10:39:00.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.197+0000 7f5558ff9700 1 -- 172.21.15.31:0/254355396 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f55480061f0 con 0x7f555c06e900 2024-04-18T10:39:00.197 INFO:teuthology.orchestra.run.smithi031.stdout:137438953475 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 >> v1:172.21.15.31:6816/46601 conn(0x7f5540046090 legacy=0x7f5540048540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c06e900 msgr2=0x7f555c1408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 --2- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c06e900 0x7f555c1408d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f554800b520 tx=0x7f5548019000 comp rx=0 tx=0).stop 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 shutdown_connections 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 --2- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c141170 0x7f555c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 --2- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f555c06e900 0x7f555c1408d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 --2- 172.21.15.31:0/254355396 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f555c142fd0 0x7f555c151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 >> 172.21.15.31:0/254355396 conn(0x7f555c0b1290 msgr2=0x7f555c13bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 shutdown_connections 2024-04-18T10:39:00.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:00.199+0000 7f5563179700 1 -- 172.21.15.31:0/254355396 wait complete. 2024-04-18T10:39:00.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051589 got 124554051587 for osd.0 2024-04-18T10:39:00.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.3 2024-04-18T10:39:01.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-18T10:39:01.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-18T10:39:01.205 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-18T10:39:01.212 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-18T10:39:01.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.284+0000 7fd526170700 1 Processor -- start 2024-04-18T10:39:01.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.284+0000 7fd526170700 1 -- start start 2024-04-18T10:39:01.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.284+0000 7f3e0cd76700 1 Processor -- start 2024-04-18T10:39:01.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.284+0000 7f3e0cd76700 1 -- start start 2024-04-18T10:39:01.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.284+0000 7fd526170700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd52006efe0 0x7fd5200680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd526170700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd520147550 0x7fd520149930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd526170700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5200a2ca0 con 0x7fd5200b1c90 2024-04-18T10:39:01.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd526170700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200a2620 con 0x7fd520147550 2024-04-18T10:39:01.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd526170700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200a3cc0 con 0x7fd52006efe0 2024-04-18T10:39:01.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd51ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd520147550 0x7fd520149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd51ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd520147550 0x7fd520149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54406/0 (socket says 172.21.15.31:54406) 2024-04-18T10:39:01.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd51ffff700 1 -- 172.21.15.31:0/3419324006 learned_addr learned my addr 172.21.15.31:0/3419324006 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e0cd76700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e08069200 0x7f3e080a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e0cd76700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e080a6070 0x7f3e0813c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e0cd76700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813cc60 0x7f3e080679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e0cd76700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0813bfc0 con 0x7f3e08069200 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e0cd76700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0813c1b0 con 0x7f3e0813cc60 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e0cd76700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0813c470 con 0x7f3e080a6070 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd51ffff700 1 -- 172.21.15.31:0/3419324006 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd52006efe0 msgr2=0x7fd5200680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd51ffff700 1 --2- 172.21.15.31:0/3419324006 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd52006efe0 0x7fd5200680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd51ffff700 1 -- 172.21.15.31:0/3419324006 >> v1:172.21.15.31:6789/0 conn(0x7fd5200b1c90 legacy=0x7fd5200679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7fd51ffff700 1 -- 172.21.15.31:0/3419324006 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200a3f60 con 0x7fd520147550 2024-04-18T10:39:01.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e05d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e080a6070 0x7f3e0813c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e0659c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3e08069200 0x7f3e080a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e05d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e080a6070 0x7f3e0813c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44030/0 (socket says 172.21.15.31:44030) 2024-04-18T10:39:01.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.285+0000 7f3e05d9b700 1 -- 172.21.15.31:0/2553536004 learned_addr learned my addr 172.21.15.31:0/2553536004 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:01.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e06d9d700 1 --2- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813cc60 0x7f3e080679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7fd51ffff700 1 --2- 172.21.15.31:0/3419324006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd520147550 0x7fd520149930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd518009f20 tx=0x7fd518009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca413af0d807bc9e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7fd51e7fc700 1 -- 172.21.15.31:0/3419324006 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800e070 con 0x7fd520147550 2024-04-18T10:39:01.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7fd51e7fc700 1 -- 172.21.15.31:0/3419324006 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51800bb10 con 0x7fd520147550 2024-04-18T10:39:01.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7fd51e7fc700 1 -- 172.21.15.31:0/3419324006 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180092e0 con 0x7fd520147550 2024-04-18T10:39:01.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e0659c700 1 -- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e080a6070 msgr2=0x7f3e0813c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:01.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e0659c700 1 --2- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e080a6070 0x7f3e0813c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e0659c700 1 -- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813cc60 msgr2=0x7f3e080679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:01.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e0659c700 1 --2- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813cc60 0x7f3e080679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e0659c700 1 -- 172.21.15.31:0/2553536004 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080a4a40 con 0x7f3e08069200 2024-04-18T10:39:01.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e0659c700 1 --2- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e08069200 0x7f3e080a3e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3df80098e0 tx=0x7f3df80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5528567fc1eddef3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e0559a700 1 -- 172.21.15.31:0/2553536004 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8011630 con 0x7f3e08069200 2024-04-18T10:39:01.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e0559a700 1 -- 172.21.15.31:0/2553536004 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df8011790 con 0x7f3e08069200 2024-04-18T10:39:01.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.286+0000 7f3e0559a700 1 -- 172.21.15.31:0/2553536004 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8011b10 con 0x7f3e08069200 2024-04-18T10:39:01.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7fd526170700 1 -- 172.21.15.31:0/3419324006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd520147550 msgr2=0x7fd520149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7fd526170700 1 --2- 172.21.15.31:0/3419324006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd520147550 0x7fd520149930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd518009f20 tx=0x7fd518009840 comp rx=0 tx=0).stop 2024-04-18T10:39:01.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7fd526170700 1 -- 172.21.15.31:0/3419324006 shutdown_connections 2024-04-18T10:39:01.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7fd526170700 1 --2- 172.21.15.31:0/3419324006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd520147550 0x7fd520149930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7fd526170700 1 --2- 172.21.15.31:0/3419324006 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd52006efe0 0x7fd5200680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7fd526170700 1 -- 172.21.15.31:0/3419324006 >> 172.21.15.31:0/3419324006 conn(0x7fd52006ab10 msgr2=0x7fd52006aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7fd526170700 1 -- 172.21.15.31:0/3419324006 shutdown_connections 2024-04-18T10:39:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7fd526170700 1 -- 172.21.15.31:0/3419324006 wait complete. 2024-04-18T10:39:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e08069200 msgr2=0x7f3e080a3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7f3e0cd76700 1 --2- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e08069200 0x7f3e080a3e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3df80098e0 tx=0x7f3df80091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2553536004 shutdown_connections 2024-04-18T10:39:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7f3e0cd76700 1 --2- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e0813cc60 0x7f3e080679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7f3e0cd76700 1 --2- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e08069200 0x7f3e080a3e70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7f3e0cd76700 1 --2- 172.21.15.31:0/2553536004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e080a6070 0x7f3e0813c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2553536004 >> 172.21.15.31:0/2553536004 conn(0x7f3e0806ae80 msgr2=0x7f3e08068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2553536004 shutdown_connections 2024-04-18T10:39:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.287+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2553536004 wait complete. 2024-04-18T10:39:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.288+0000 7fd526170700 1 Processor -- start 2024-04-18T10:39:01.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.288+0000 7fd526170700 1 -- start start 2024-04-18T10:39:01.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.288+0000 7f3e0cd76700 1 Processor -- start 2024-04-18T10:39:01.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.288+0000 7f3e0cd76700 1 -- start start 2024-04-18T10:39:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd526170700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd52006efe0 0x7fd520097e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd526170700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd5200b1c90 0x7fd520098e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd526170700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520147550 0x7fd5200ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd526170700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520096a70 con 0x7fd52006efe0 2024-04-18T10:39:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd526170700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52014e6d0 con 0x7fd520147550 2024-04-18T10:39:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd526170700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd52014e990 con 0x7fd5200b1c90 2024-04-18T10:39:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd52006efe0 0x7fd520097e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520147550 0x7fd5200ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e0cd76700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e08069200 0x7f3e080ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e0cd76700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e080a6070 0x7f3e080ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e0cd76700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e0813cc60 0x7f3e0814e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e0cd76700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080aeee0 con 0x7f3e08069200 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e0cd76700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0814e3a0 con 0x7f3e080a6070 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e0cd76700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0806f4a0 con 0x7f3e0813cc60 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e05d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e080a6070 0x7f3e080ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e05d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e080a6070 0x7f3e080ad440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53994/0 (socket says 172.21.15.31:53994) 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e05d9b700 1 -- 172.21.15.31:0/2038718973 learned_addr learned my addr 172.21.15.31:0/2038718973 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7f3e06d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e0813cc60 0x7f3e0814e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3e06d9d700 1 -- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e080a6070 msgr2=0x7f3e080ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3e06d9d700 1 --2- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e080a6070 0x7f3e080ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3e06d9d700 1 -- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e08069200 msgr2=0x7f3e080ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3e06d9d700 1 --2- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e08069200 0x7f3e080ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3e06d9d700 1 -- 172.21.15.31:0/2038718973 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df8009420 con 0x7f3e0813cc60 2024-04-18T10:39:01.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd52006efe0 0x7fd520097e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54428/0 (socket says 172.21.15.31:54428) 2024-04-18T10:39:01.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520147550 0x7fd5200ac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53986/0 (socket says 172.21.15.31:53986) 2024-04-18T10:39:01.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51f7fe700 1 -- 172.21.15.31:0/377050600 learned_addr learned my addr 172.21.15.31:0/377050600 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:01.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51ffff700 1 -- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd5200b1c90 msgr2=0x7fd520098e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-18T10:39:01.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51ffff700 1 --2- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd5200b1c90 0x7fd520098e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51ffff700 1 -- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd52006efe0 msgr2=0x7fd520097e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51ffff700 1 --2- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd52006efe0 0x7fd520097e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.289+0000 7fd51ffff700 1 -- 172.21.15.31:0/377050600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518009ae0 con 0x7fd520147550 2024-04-18T10:39:01.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7fd51ffff700 1 --2- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520147550 0x7fd5200ac8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd518015000 tx=0x7fd518018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3e06d9d700 1 --2- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e0813cc60 0x7f3e0814e6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000ec90 tx=0x7f3e0000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7fd5077fe700 1 -- 172.21.15.31:0/377050600 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518008d90 con 0x7fd520147550 2024-04-18T10:39:01.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7fd5077fe700 1 -- 172.21.15.31:0/377050600 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51801c410 con 0x7fd520147550 2024-04-18T10:39:01.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7fd5077fe700 1 -- 172.21.15.31:0/377050600 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51801c810 con 0x7fd520147550 2024-04-18T10:39:01.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3df67fc700 1 -- 172.21.15.31:0/2038718973 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000eea0 con 0x7f3e0813cc60 2024-04-18T10:39:01.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3df67fc700 1 -- 172.21.15.31:0/2038718973 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0000f040 con 0x7f3e0813cc60 2024-04-18T10:39:01.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd520099390 con 0x7fd520147550 2024-04-18T10:39:01.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3df67fc700 1 -- 172.21.15.31:0/2038718973 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000cdc0 con 0x7f3e0813cc60 2024-04-18T10:39:01.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e080ad980 con 0x7f3e0813cc60 2024-04-18T10:39:01.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0806f910 con 0x7f3e0813cc60 2024-04-18T10:39:01.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.290+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52014f030 con 0x7fd520147550 2024-04-18T10:39:01.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.291+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e080651b0 con 0x7f3e0813cc60 2024-04-18T10:39:01.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.292+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5200651b0 con 0x7fd520147550 2024-04-18T10:39:01.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.292+0000 7f3df67fc700 1 -- 172.21.15.31:0/2038718973 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f3e00014690 con 0x7f3e0813cc60 2024-04-18T10:39:01.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.292+0000 7f3df67fc700 1 -- 172.21.15.31:0/2038718973 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3e0005ba70 con 0x7f3e0813cc60 2024-04-18T10:39:01.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.292+0000 7fd5077fe700 1 -- 172.21.15.31:0/377050600 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fd518003040 con 0x7fd520147550 2024-04-18T10:39:01.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.292+0000 7fd5077fe700 1 -- 172.21.15.31:0/377050600 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fd51805caa0 con 0x7fd520147550 2024-04-18T10:39:01.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.296+0000 7fd5077fe700 1 -- 172.21.15.31:0/377050600 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd51801eca0 con 0x7fd520147550 2024-04-18T10:39:01.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.298+0000 7f3df67fc700 1 -- 172.21.15.31:0/2038718973 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3e00039ba0 con 0x7f3e0813cc60 2024-04-18T10:39:01.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.360+0000 7f49c5ecf700 1 Processor -- start 2024-04-18T10:39:01.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.360+0000 7f49c5ecf700 1 -- start start 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.360+0000 7f49c5ecf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c006e900 0x7f49c006d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.360+0000 7f49c5ecf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49c00ad3b0 0x7f49c013e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.360+0000 7f49c5ecf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00ac620 con 0x7f49c013e820 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.360+0000 7f49c5ecf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c006e190 con 0x7f49c00ad3b0 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.360+0000 7f49c5ecf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49c006d810 con 0x7f49c006e900 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49beffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49c00ad3b0 0x7f49c013e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c006e900 0x7f49c006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c006e900 0x7f49c006d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44062/0 (socket says 172.21.15.31:44062) 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49beffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f49c00ad3b0 0x7f49c013e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54434/0 (socket says 172.21.15.31:54434) 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49bf7fe700 1 -- 172.21.15.31:0/1977429600 learned_addr learned my addr 172.21.15.31:0/1977429600 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49beffd700 1 -- 172.21.15.31:0/1977429600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c006e900 msgr2=0x7f49c006d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49beffd700 1 --2- 172.21.15.31:0/1977429600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c006e900 0x7f49c006d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49beffd700 1 -- 172.21.15.31:0/1977429600 >> v1:172.21.15.31:6789/0 conn(0x7f49c013e820 legacy=0x7f49c013a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49beffd700 1 -- 172.21.15.31:0/1977429600 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c013dc60 con 0x7f49c00ad3b0 2024-04-18T10:39:01.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49bf7fe700 1 --2- 172.21.15.31:0/1977429600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c006e900 0x7f49c006d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:01.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49beffd700 1 --2- 172.21.15.31:0/1977429600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c00ad3b0 0x7f49c013e2e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f49b40098e0 tx=0x7f49b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2c464220c42da server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49be7fc700 1 -- 172.21.15.31:0/1977429600 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400c7e0 con 0x7f49c00ad3b0 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49be7fc700 1 -- 172.21.15.31:0/1977429600 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b400c940 con 0x7f49c00ad3b0 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.361+0000 7f49be7fc700 1 -- 172.21.15.31:0/1977429600 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400cce0 con 0x7f49c00ad3b0 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.362+0000 7f49c5ecf700 1 -- 172.21.15.31:0/1977429600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c00ad3b0 msgr2=0x7f49c013e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.362+0000 7f49c5ecf700 1 --2- 172.21.15.31:0/1977429600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c00ad3b0 0x7f49c013e2e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f49b40098e0 tx=0x7f49b40091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.362+0000 7f49c5ecf700 1 -- 172.21.15.31:0/1977429600 shutdown_connections 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.362+0000 7f49c5ecf700 1 --2- 172.21.15.31:0/1977429600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c006e900 0x7f49c006d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.362+0000 7f49c5ecf700 1 --2- 172.21.15.31:0/1977429600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c00ad3b0 0x7f49c013e2e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.362+0000 7f49c5ecf700 1 -- 172.21.15.31:0/1977429600 >> 172.21.15.31:0/1977429600 conn(0x7f49c00b1290 msgr2=0x7f49c00b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.362+0000 7f49c5ecf700 1 -- 172.21.15.31:0/1977429600 shutdown_connections 2024-04-18T10:39:01.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.362+0000 7f49c5ecf700 1 -- 172.21.15.31:0/1977429600 wait complete. 2024-04-18T10:39:01.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.363+0000 7f49c5ecf700 1 Processor -- start 2024-04-18T10:39:01.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.363+0000 7f49c5ecf700 1 -- start start 2024-04-18T10:39:01.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49c5ecf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c006e900 0x7f49c0144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49c5ecf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49c013e820 0x7f49c01519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49c5ecf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c0151ee0 0x7f49c0142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49c5ecf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c01447d0 con 0x7f49c006e900 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49c5ecf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0152370 con 0x7f49c013e820 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49c5ecf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0152630 con 0x7f49c0151ee0 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49bffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c0151ee0 0x7f49c0142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49beffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49c013e820 0x7f49c01519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49bffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c0151ee0 0x7f49c0142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44076/0 (socket says 172.21.15.31:44076) 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49bffff700 1 -- 172.21.15.31:0/3204826744 learned_addr learned my addr 172.21.15.31:0/3204826744 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.364+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c006e900 0x7f49c0144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49bffff700 1 -- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49c013e820 msgr2=0x7f49c01519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49bffff700 1 --2- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49c013e820 0x7f49c01519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49bffff700 1 -- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c006e900 msgr2=0x7f49c0144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49bffff700 1 --2- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c006e900 0x7f49c0144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49bffff700 1 -- 172.21.15.31:0/3204826744 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b00094f0 con 0x7f49c0151ee0 2024-04-18T10:39:01.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49bf7fe700 1 --2- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c006e900 0x7f49c0144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:01.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49bffff700 1 --2- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c0151ee0 0x7f49c0142f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c840 tx=0x7f49b8001670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49a77fe700 1 -- 172.21.15.31:0/3204826744 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8012630 con 0x7f49c0151ee0 2024-04-18T10:39:01.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49a77fe700 1 -- 172.21.15.31:0/3204826744 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8012790 con 0x7f49c0151ee0 2024-04-18T10:39:01.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b4009420 con 0x7f49c0151ee0 2024-04-18T10:39:01.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49a77fe700 1 -- 172.21.15.31:0/3204826744 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b8012b50 con 0x7f49c0151ee0 2024-04-18T10:39:01.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.365+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c01422c0 con 0x7f49c0151ee0 2024-04-18T10:39:01.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.366+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c00651b0 con 0x7f49c0151ee0 2024-04-18T10:39:01.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.366+0000 7f49a77fe700 1 -- 172.21.15.31:0/3204826744 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f49b8003030 con 0x7f49c0151ee0 2024-04-18T10:39:01.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.367+0000 7f49a77fe700 1 -- 172.21.15.31:0/3204826744 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f49b805af30 con 0x7f49c0151ee0 2024-04-18T10:39:01.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.374+0000 7f49a77fe700 1 -- 172.21.15.31:0/3204826744 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f49b8039150 con 0x7f49c0151ee0 2024-04-18T10:39:01.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.406+0000 7f500989e700 1 Processor -- start 2024-04-18T10:39:01.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.406+0000 7f500989e700 1 -- start start 2024-04-18T10:39:01.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.406+0000 7f500989e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50040ad3b0 0x7f500406d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.406+0000 7f500989e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5004142fd0 0x7f50041453b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.406+0000 7f500989e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50040ac620 con 0x7f500406e900 2024-04-18T10:39:01.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.406+0000 7f500989e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500406e190 con 0x7f5004142fd0 2024-04-18T10:39:01.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.406+0000 7f500989e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500406d810 con 0x7f50040ad3b0 2024-04-18T10:39:01.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.406+0000 7f5002ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f500406e900 0x7f500413e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53350/0 (socket says 172.21.15.31:53350) 2024-04-18T10:39:01.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.406+0000 7f5002ffd700 1 -- 172.21.15.31:0/978113094 learned_addr learned my addr 172.21.15.31:0/978113094 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:01.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f50037fe700 1 --2- 172.21.15.31:0/978113094 >> v2:172.21.15.31:3300/0 conn(0x7f5004142fd0 0x7f50041453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f50027fc700 1 --2- 172.21.15.31:0/978113094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50040ad3b0 0x7f500406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f5001ffb700 1 -- 172.21.15.31:0/978113094 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827130888 0 0) 0x7f50040ac620 con 0x7f500406e900 2024-04-18T10:39:01.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f5001ffb700 1 -- 172.21.15.31:0/978113094 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fec003570 con 0x7f500406e900 2024-04-18T10:39:01.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f50027fc700 1 -- 172.21.15.31:0/978113094 >> v2:172.21.15.31:3300/0 conn(0x7f5004142fd0 msgr2=0x7f50041453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:01.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f50027fc700 1 --2- 172.21.15.31:0/978113094 >> v2:172.21.15.31:3300/0 conn(0x7f5004142fd0 0x7f50041453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f50027fc700 1 -- 172.21.15.31:0/978113094 >> v1:172.21.15.31:6789/0 conn(0x7f500406e900 legacy=0x7f500413e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f50027fc700 1 -- 172.21.15.31:0/978113094 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500413dc60 con 0x7f50040ad3b0 2024-04-18T10:39:01.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f50037fe700 1 --2- 172.21.15.31:0/978113094 >> v2:172.21.15.31:3300/0 conn(0x7f5004142fd0 0x7f50041453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f50027fc700 1 --2- 172.21.15.31:0/978113094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50040ad3b0 0x7f500406d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009940 tx=0x7f4ff80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=242c34fd13e6773 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.407+0000 7f5001ffb700 1 -- 172.21.15.31:0/978113094 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8011630 con 0x7f50040ad3b0 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f5001ffb700 1 -- 172.21.15.31:0/978113094 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8011790 con 0x7f50040ad3b0 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f5001ffb700 1 -- 172.21.15.31:0/978113094 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8011b50 con 0x7f50040ad3b0 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f500989e700 1 -- 172.21.15.31:0/978113094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50040ad3b0 msgr2=0x7f500406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f500989e700 1 --2- 172.21.15.31:0/978113094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50040ad3b0 0x7f500406d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009940 tx=0x7f4ff80091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f500989e700 1 -- 172.21.15.31:0/978113094 shutdown_connections 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f500989e700 1 --2- 172.21.15.31:0/978113094 >> v2:172.21.15.31:3300/0 conn(0x7f5004142fd0 0x7f50041453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f500989e700 1 --2- 172.21.15.31:0/978113094 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f50040ad3b0 0x7f500406d150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f500989e700 1 -- 172.21.15.31:0/978113094 >> 172.21.15.31:0/978113094 conn(0x7f50040b1290 msgr2=0x7f50040b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f500989e700 1 -- 172.21.15.31:0/978113094 shutdown_connections 2024-04-18T10:39:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.408+0000 7f500989e700 1 -- 172.21.15.31:0/978113094 wait complete. 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.409+0000 7f500989e700 1 Processor -- start 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.409+0000 7f500989e700 1 -- start start 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.410+0000 7f500989e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f500406e900 0x7f50041437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.410+0000 7f500989e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5004142fd0 0x7f5004145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.410+0000 7f500989e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f500413a7f0 0x7f5004145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.410+0000 7f500989e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500413a170 con 0x7f5004142fd0 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.410+0000 7f500989e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500413ad30 con 0x7f500406e900 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.410+0000 7f500989e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5004144b70 con 0x7f500413a7f0 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.410+0000 7f5002ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f500406e900 0x7f50041437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.410+0000 7f5002ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f500406e900 0x7f50041437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54022/0 (socket says 172.21.15.31:54022) 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.410+0000 7f5002ffd700 1 -- 172.21.15.31:0/2054231994 learned_addr learned my addr 172.21.15.31:0/2054231994 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f50027fc700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5004142fd0 0x7f5004145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f50037fe700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f500413a7f0 0x7f5004145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f5002ffd700 1 -- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f500413a7f0 msgr2=0x7f5004145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f5002ffd700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f500413a7f0 0x7f5004145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f5002ffd700 1 -- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5004142fd0 msgr2=0x7f5004145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f5002ffd700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5004142fd0 0x7f5004145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f5002ffd700 1 -- 172.21.15.31:0/2054231994 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009a20 con 0x7f500406e900 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f50027fc700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5004142fd0 0x7f5004145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f50037fe700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f500413a7f0 0x7f5004145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f5002ffd700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f500406e900 0x7f50041437f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c7c0 tx=0x7f4ff4007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f4feaffd700 1 -- 172.21.15.31:0/2054231994 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4005b30 con 0x7f500406e900 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f4feaffd700 1 -- 172.21.15.31:0/2054231994 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff4005c90 con 0x7f500406e900 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff8009420 con 0x7f500406e900 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f4feaffd700 1 -- 172.21.15.31:0/2054231994 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4007340 con 0x7f500406e900 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.411+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004139e20 con 0x7f500406e900 2024-04-18T10:39:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.412+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50040651b0 con 0x7f500406e900 2024-04-18T10:39:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.413+0000 7f4feaffd700 1 -- 172.21.15.31:0/2054231994 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f4ff4025430 con 0x7f500406e900 2024-04-18T10:39:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.414+0000 7f4feaffd700 1 -- 172.21.15.31:0/2054231994 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f4ff405b6c0 con 0x7f500406e900 2024-04-18T10:39:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.420+0000 7f4feaffd700 1 -- 172.21.15.31:0/2054231994 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4ff4039bb0 con 0x7f500406e900 2024-04-18T10:39:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.467+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3e0813b930 con 0x7f3e0813cc60 2024-04-18T10:39:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.467+0000 7f3df67fc700 1 -- 172.21.15.31:0/2038718973 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e00018030 con 0x7f3e0813cc60 2024-04-18T10:39:01.468 INFO:teuthology.orchestra.run.smithi031.stdout:128849018885 2024-04-18T10:39:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.470+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 >> v1:172.21.15.31:6816/46601 conn(0x7f3de80460e0 legacy=0x7f3de8048590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.470+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e0813cc60 msgr2=0x7f3e0814e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.470+0000 7f3e0cd76700 1 --2- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e0813cc60 0x7f3e0814e6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000ec90 tx=0x7f3e0000b040 comp rx=0 tx=0).stop 2024-04-18T10:39:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.470+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 shutdown_connections 2024-04-18T10:39:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.470+0000 7f3e0cd76700 1 --2- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3e0813cc60 0x7f3e0814e6d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.470+0000 7f3e0cd76700 1 --2- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e08069200 0x7f3e080ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.470+0000 7f3e0cd76700 1 --2- 172.21.15.31:0/2038718973 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3e080a6070 0x7f3e080ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.470+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 >> 172.21.15.31:0/2038718973 conn(0x7f3e0806ae80 msgr2=0x7f3e080b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.471+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 shutdown_connections 2024-04-18T10:39:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.471+0000 7f3e0cd76700 1 -- 172.21.15.31:0/2038718973 wait complete. 2024-04-18T10:39:01.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.475+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd5200ae570 con 0x7fd520147550 2024-04-18T10:39:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.475+0000 7fd5077fe700 1 -- 172.21.15.31:0/377050600 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd51801ead0 con 0x7fd520147550 2024-04-18T10:39:01.476 INFO:teuthology.orchestra.run.smithi031.stdout:133143986180 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 >> v1:172.21.15.31:6816/46601 conn(0x7fd50c0460e0 legacy=0x7fd50c048590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520147550 msgr2=0x7fd5200ac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 --2- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520147550 0x7fd5200ac8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd518015000 tx=0x7fd518018000 comp rx=0 tx=0).stop 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 shutdown_connections 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 --2- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd520147550 0x7fd5200ac8b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 --2- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd52006efe0 0x7fd520097e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 --2- 172.21.15.31:0/377050600 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd5200b1c90 0x7fd520098e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 >> 172.21.15.31:0/377050600 conn(0x7fd52006ab10 msgr2=0x7fd520143620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 shutdown_connections 2024-04-18T10:39:01.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.478+0000 7fd526170700 1 -- 172.21.15.31:0/377050600 wait complete. 2024-04-18T10:39:01.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018885 got 128849018885 for osd.1 2024-04-18T10:39:01.485 DEBUG:teuthology.parallel:result is None 2024-04-18T10:39:01.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986180 for osd.2 2024-04-18T10:39:01.496 DEBUG:teuthology.parallel:result is None 2024-04-18T10:39:01.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.547+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f49c013cd10 con 0x7f49c0151ee0 2024-04-18T10:39:01.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.547+0000 7f49a77fe700 1 -- 172.21.15.31:0/3204826744 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49b803c940 con 0x7f49c0151ee0 2024-04-18T10:39:01.548 INFO:teuthology.orchestra.run.smithi031.stdout:124554051589 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 >> v1:172.21.15.31:6816/46601 conn(0x7f49ac046010 legacy=0x7f49ac0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c0151ee0 msgr2=0x7f49c0142f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 --2- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c0151ee0 0x7f49c0142f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c840 tx=0x7f49b8001670 comp rx=0 tx=0).stop 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 shutdown_connections 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 --2- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f49c0151ee0 0x7f49c0142f20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 --2- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49c006e900 0x7f49c0144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 --2- 172.21.15.31:0/3204826744 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f49c013e820 0x7f49c01519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 >> 172.21.15.31:0/3204826744 conn(0x7f49c00b1290 msgr2=0x7f49c013d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 shutdown_connections 2024-04-18T10:39:01.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.549+0000 7f49c5ecf700 1 -- 172.21.15.31:0/3204826744 wait complete. 2024-04-18T10:39:01.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051589 got 124554051589 for osd.0 2024-04-18T10:39:01.562 DEBUG:teuthology.parallel:result is None 2024-04-18T10:39:01.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.596+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5004144390 con 0x7f500406e900 2024-04-18T10:39:01.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.596+0000 7f4feaffd700 1 -- 172.21.15.31:0/2054231994 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ff403d1d0 con 0x7f500406e900 2024-04-18T10:39:01.597 INFO:teuthology.orchestra.run.smithi031.stdout:137438953476 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 >> v1:172.21.15.31:6816/46601 conn(0x7f4ff0046010 legacy=0x7f4ff00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f500406e900 msgr2=0x7f50041437f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f500406e900 0x7f50041437f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400c7c0 tx=0x7f4ff4007e00 comp rx=0 tx=0).stop 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 shutdown_connections 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f500413a7f0 0x7f5004145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f500406e900 0x7f50041437f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 --2- 172.21.15.31:0/2054231994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5004142fd0 0x7f5004145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 >> 172.21.15.31:0/2054231994 conn(0x7f50040b1290 msgr2=0x7f500413ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 shutdown_connections 2024-04-18T10:39:01.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.598+0000 7f500989e700 1 -- 172.21.15.31:0/2054231994 wait complete. 2024-04-18T10:39:01.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953476 for osd.3 2024-04-18T10:39:01.610 DEBUG:teuthology.parallel:result is None 2024-04-18T10:39:01.611 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T10:39:01.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:39:01.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.770+0000 7f2f040fb700 1 Processor -- start 2024-04-18T10:39:01.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.770+0000 7f2f040fb700 1 -- start start 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f040fb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a40c0 0x7f2efc143740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f040fb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2efc143c80 0x7f2efc146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f040fb700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0a38e0 con 0x7f2efc069450 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f040fb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc0a3bc0 con 0x7f2efc143c80 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f040fb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0a4810 con 0x7f2efc0a40c0 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f01696700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a40c0 0x7f2efc143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f02698700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2efc143c80 0x7f2efc146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f01e97700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2efc069450 0x7f2efc13ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53356/0 (socket says 172.21.15.31:53356) 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f01e97700 1 -- 172.21.15.31:0/1682970935 learned_addr learned my addr 172.21.15.31:0/1682970935 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f02698700 1 -- 172.21.15.31:0/1682970935 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a40c0 msgr2=0x7f2efc143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f02698700 1 --2- 172.21.15.31:0/1682970935 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a40c0 0x7f2efc143740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f02698700 1 -- 172.21.15.31:0/1682970935 >> v1:172.21.15.31:6789/0 conn(0x7f2efc069450 legacy=0x7f2efc13ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f02698700 1 -- 172.21.15.31:0/1682970935 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc13e450 con 0x7f2efc143c80 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f00e95700 1 -- 172.21.15.31:0/1682970935 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203846399 0 0) 0x7f2efc0a38e0 con 0x7f2efc069450 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f01696700 1 --2- 172.21.15.31:0/1682970935 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a40c0 0x7f2efc143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.771+0000 7f2f02698700 1 --2- 172.21.15.31:0/1682970935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 0x7f2efc146060 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40098e0 tx=0x7f2ef40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f35b42ec0bae6b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f00e95700 1 -- 172.21.15.31:0/1682970935 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400b6d0 con 0x7f2efc143c80 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f00e95700 1 -- 172.21.15.31:0/1682970935 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400b830 con 0x7f2efc143c80 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f00e95700 1 -- 172.21.15.31:0/1682970935 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400bbd0 con 0x7f2efc143c80 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f040fb700 1 -- 172.21.15.31:0/1682970935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 msgr2=0x7f2efc146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f040fb700 1 --2- 172.21.15.31:0/1682970935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 0x7f2efc146060 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40098e0 tx=0x7f2ef40091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f040fb700 1 -- 172.21.15.31:0/1682970935 shutdown_connections 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f040fb700 1 --2- 172.21.15.31:0/1682970935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 0x7f2efc146060 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f040fb700 1 --2- 172.21.15.31:0/1682970935 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a40c0 0x7f2efc143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f040fb700 1 -- 172.21.15.31:0/1682970935 >> 172.21.15.31:0/1682970935 conn(0x7f2efc06af40 msgr2=0x7f2efc068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f040fb700 1 -- 172.21.15.31:0/1682970935 shutdown_connections 2024-04-18T10:39:01.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.772+0000 7f2f040fb700 1 -- 172.21.15.31:0/1682970935 wait complete. 2024-04-18T10:39:01.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.773+0000 7f2f040fb700 1 Processor -- start 2024-04-18T10:39:01.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f040fb700 1 -- start start 2024-04-18T10:39:01.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f040fb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc069450 0x7f2efc067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f040fb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a40c0 0x7f2efc142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f040fb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 0x7f2efc142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:01.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f040fb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0a7de0 con 0x7f2efc143c80 2024-04-18T10:39:01.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f040fb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0a81c0 con 0x7f2efc0a40c0 2024-04-18T10:39:01.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f040fb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0686b0 con 0x7f2efc069450 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f01e97700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc069450 0x7f2efc067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f01696700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a40c0 0x7f2efc142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f01696700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a40c0 0x7f2efc142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54036/0 (socket says 172.21.15.31:54036) 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f01696700 1 -- 172.21.15.31:0/1381091071 learned_addr learned my addr 172.21.15.31:0/1381091071 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f01e97700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc069450 0x7f2efc067b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44114/0 (socket says 172.21.15.31:44114) 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.774+0000 7f2f02698700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 0x7f2efc142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f01696700 1 -- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc069450 msgr2=0x7f2efc067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f01696700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc069450 0x7f2efc067b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f01696700 1 -- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 msgr2=0x7f2efc142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f01696700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 0x7f2efc142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f01696700 1 -- 172.21.15.31:0/1381091071 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0009420 con 0x7f2efc0a40c0 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f02698700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 0x7f2efc142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f01e97700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc069450 0x7f2efc067b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:01.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f01696700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a40c0 0x7f2efc142250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000ec80 tx=0x7f2ef00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:01.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2ef9ffb700 1 -- 172.21.15.31:0/1381091071 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000c920 con 0x7f2efc0a40c0 2024-04-18T10:39:01.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2ef9ffb700 1 -- 172.21.15.31:0/1381091071 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef000ca80 con 0x7f2efc0a40c0 2024-04-18T10:39:01.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef4009420 con 0x7f2efc0a40c0 2024-04-18T10:39:01.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2ef9ffb700 1 -- 172.21.15.31:0/1381091071 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000ce00 con 0x7f2efc0a40c0 2024-04-18T10:39:01.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.775+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc0a8440 con 0x7f2efc0a40c0 2024-04-18T10:39:01.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.776+0000 7f2ef9ffb700 1 -- 172.21.15.31:0/1381091071 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f2ef0013680 con 0x7f2efc0a40c0 2024-04-18T10:39:01.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.776+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc0aab10 con 0x7f2efc0a40c0 2024-04-18T10:39:01.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.777+0000 7f2ef9ffb700 1 -- 172.21.15.31:0/1381091071 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f2ef005b8b0 con 0x7f2efc0a40c0 2024-04-18T10:39:01.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.780+0000 7f2ef9ffb700 1 -- 172.21.15.31:0/1381091071 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2ef0039a70 con 0x7f2efc0a40c0 2024-04-18T10:39:01.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.942+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2efc0651b0 con 0x7f2ee8046010 2024-04-18T10:39:01.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.949+0000 7f2ef9ffb700 1 -- 172.21.15.31:0/1381091071 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271464 (unknown 2965378022 0 3166582305) 0x7f2efc0651b0 con 0x7f2ee8046010 2024-04-18T10:39:01.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:39:01.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 >> v1:172.21.15.31:6816/46601 conn(0x7f2ee8046010 legacy=0x7f2ee80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a40c0 msgr2=0x7f2efc142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:01.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a40c0 0x7f2efc142250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000ec80 tx=0x7f2ef00091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 shutdown_connections 2024-04-18T10:39:01.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc069450 0x7f2efc067b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc143c80 0x7f2efc142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 --2- 172.21.15.31:0/1381091071 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a40c0 0x7f2efc142250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:01.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 >> 172.21.15.31:0/1381091071 conn(0x7f2efc06af40 msgr2=0x7f2efc13ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:01.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 shutdown_connections 2024-04-18T10:39:01.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:01.952+0000 7f2f040fb700 1 -- 172.21.15.31:0/1381091071 wait complete. 2024-04-18T10:39:01.956 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:39:01.964 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-18T10:39:00.415567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599151,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":273,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1199472,"kb_used_data":2600,"kb_used_omap":44,"kb_used_meta":1196755,"kb_avail":376287888,"statfs":{"total":386547056640,"available":385318797312,"internally_reserved":0,"allocated":2662400,"data_stored":1801444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1225477919},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.822265"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598015+0000","last_change":"2024-04-18T10:38:48.515671+0000","last_active":"2024-04-18T10:38:57.598015+0000","last_peered":"2024-04-18T10:38:57.598015+0000","last_clean":"2024-04-18T10:38:57.598015+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:38:57.598015+0000","last_undegraded":"2024-04-18T10:38:57.598015+0000","last_fullsized":"2024-04-18T10:38:57.598015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:55:56.692744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597866+0000","last_change":"2024-04-18T10:38:47.514349+0000","last_active":"2024-04-18T10:38:57.597866+0000","last_peered":"2024-04-18T10:38:57.597866+0000","last_clean":"2024-04-18T10:38:57.597866+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:38:57.597866+0000","last_undegraded":"2024-04-18T10:38:57.597866+0000","last_fullsized":"2024-04-18T10:38:57.597866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:40:55.175836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599562+0000","last_change":"2024-04-18T10:38:46.523814+0000","last_active":"2024-04-18T10:38:57.599562+0000","last_peered":"2024-04-18T10:38:57.599562+0000","last_clean":"2024-04-18T10:38:57.599562+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:38:57.599562+0000","last_undegraded":"2024-04-18T10:38:57.599562+0000","last_fullsized":"2024-04-18T10:38:57.599562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:17.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599621+0000","last_change":"2024-04-18T10:38:46.523213+0000","last_active":"2024-04-18T10:38:57.599621+0000","last_peered":"2024-04-18T10:38:57.599621+0000","last_clean":"2024-04-18T10:38:57.599621+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:38:57.599621+0000","last_undegraded":"2024-04-18T10:38:57.599621+0000","last_fullsized":"2024-04-18T10:38:57.599621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:17.296380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599649+0000","last_change":"2024-04-18T10:38:48.531222+0000","last_active":"2024-04-18T10:38:57.599649+0000","last_peered":"2024-04-18T10:38:57.599649+0000","last_clean":"2024-04-18T10:38:57.599649+0000","last_became_active":"2024-04-18T10:38:48.530921+0000","last_became_peered":"2024-04-18T10:38:48.530921+0000","last_unstale":"2024-04-18T10:38:57.599649+0000","last_undegraded":"2024-04-18T10:38:57.599649+0000","last_fullsized":"2024-04-18T10:38:57.599649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:17:12.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595180+0000","last_change":"2024-04-18T10:38:48.523564+0000","last_active":"2024-04-18T10:38:55.595180+0000","last_peered":"2024-04-18T10:38:55.595180+0000","last_clean":"2024-04-18T10:38:55.595180+0000","last_became_active":"2024-04-18T10:38:48.521237+0000","last_became_peered":"2024-04-18T10:38:48.521237+0000","last_unstale":"2024-04-18T10:38:55.595180+0000","last_undegraded":"2024-04-18T10:38:55.595180+0000","last_fullsized":"2024-04-18T10:38:55.595180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:14:15.092963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595560+0000","last_change":"2024-04-18T10:38:48.526481+0000","last_active":"2024-04-18T10:38:55.595560+0000","last_peered":"2024-04-18T10:38:55.595560+0000","last_clean":"2024-04-18T10:38:55.595560+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:38:55.595560+0000","last_undegraded":"2024-04-18T10:38:55.595560+0000","last_fullsized":"2024-04-18T10:38:55.595560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:52:21.244414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436594+0000","last_change":"2024-04-18T10:38:46.507263+0000","last_active":"2024-04-18T10:38:57.436594+0000","last_peered":"2024-04-18T10:38:57.436594+0000","last_clean":"2024-04-18T10:38:57.436594+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:38:57.436594+0000","last_undegraded":"2024-04-18T10:38:57.436594+0000","last_fullsized":"2024-04-18T10:38:57.436594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:09:47.927239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600773+0000","last_change":"2024-04-18T10:38:48.521319+0000","last_active":"2024-04-18T10:38:57.600773+0000","last_peered":"2024-04-18T10:38:57.600773+0000","last_clean":"2024-04-18T10:38:57.600773+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:38:57.600773+0000","last_undegraded":"2024-04-18T10:38:57.600773+0000","last_fullsized":"2024-04-18T10:38:57.600773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:08:27.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437690+0000","last_change":"2024-04-18T10:38:46.520305+0000","last_active":"2024-04-18T10:38:57.437690+0000","last_peered":"2024-04-18T10:38:57.437690+0000","last_clean":"2024-04-18T10:38:57.437690+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:38:57.437690+0000","last_undegraded":"2024-04-18T10:38:57.437690+0000","last_fullsized":"2024-04-18T10:38:57.437690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.888537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436926+0000","last_change":"2024-04-18T10:38:46.520635+0000","last_active":"2024-04-18T10:38:57.436926+0000","last_peered":"2024-04-18T10:38:57.436926+0000","last_clean":"2024-04-18T10:38:57.436926+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:38:57.436926+0000","last_undegraded":"2024-04-18T10:38:57.436926+0000","last_fullsized":"2024-04-18T10:38:57.436926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:25.599792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598218+0000","last_change":"2024-04-18T10:38:48.520598+0000","last_active":"2024-04-18T10:38:57.598218+0000","last_peered":"2024-04-18T10:38:57.598218+0000","last_clean":"2024-04-18T10:38:57.598218+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:38:57.598218+0000","last_undegraded":"2024-04-18T10:38:57.598218+0000","last_fullsized":"2024-04-18T10:38:57.598218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:57:15.523949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598014+0000","last_change":"2024-04-18T10:38:48.531599+0000","last_active":"2024-04-18T10:38:57.598014+0000","last_peered":"2024-04-18T10:38:57.598014+0000","last_clean":"2024-04-18T10:38:57.598014+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:38:57.598014+0000","last_undegraded":"2024-04-18T10:38:57.598014+0000","last_fullsized":"2024-04-18T10:38:57.598014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:07:18.483736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436905+0000","last_change":"2024-04-18T10:38:47.515586+0000","last_active":"2024-04-18T10:38:57.436905+0000","last_peered":"2024-04-18T10:38:57.436905+0000","last_clean":"2024-04-18T10:38:57.436905+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:38:57.436905+0000","last_undegraded":"2024-04-18T10:38:57.436905+0000","last_fullsized":"2024-04-18T10:38:57.436905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:38.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599363+0000","last_change":"2024-04-18T10:38:46.523038+0000","last_active":"2024-04-18T10:38:57.599363+0000","last_peered":"2024-04-18T10:38:57.599363+0000","last_clean":"2024-04-18T10:38:57.599363+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:38:57.599363+0000","last_undegraded":"2024-04-18T10:38:57.599363+0000","last_fullsized":"2024-04-18T10:38:57.599363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:47.558311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594519+0000","last_change":"2024-04-18T10:38:48.523774+0000","last_active":"2024-04-18T10:38:55.594519+0000","last_peered":"2024-04-18T10:38:55.594519+0000","last_clean":"2024-04-18T10:38:55.594519+0000","last_became_active":"2024-04-18T10:38:48.518293+0000","last_became_peered":"2024-04-18T10:38:48.518293+0000","last_unstale":"2024-04-18T10:38:55.594519+0000","last_undegraded":"2024-04-18T10:38:55.594519+0000","last_fullsized":"2024-04-18T10:38:55.594519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:25.082701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600832+0000","last_change":"2024-04-18T10:38:48.527369+0000","last_active":"2024-04-18T10:38:57.600832+0000","last_peered":"2024-04-18T10:38:57.600832+0000","last_clean":"2024-04-18T10:38:57.600832+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:38:57.600832+0000","last_undegraded":"2024-04-18T10:38:57.600832+0000","last_fullsized":"2024-04-18T10:38:57.600832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:05:08.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599433+0000","last_change":"2024-04-18T10:38:47.514997+0000","last_active":"2024-04-18T10:38:57.599433+0000","last_peered":"2024-04-18T10:38:57.599433+0000","last_clean":"2024-04-18T10:38:57.599433+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:38:57.599433+0000","last_undegraded":"2024-04-18T10:38:57.599433+0000","last_fullsized":"2024-04-18T10:38:57.599433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:28.335154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597802+0000","last_change":"2024-04-18T10:38:48.518698+0000","last_active":"2024-04-18T10:38:57.597802+0000","last_peered":"2024-04-18T10:38:57.597802+0000","last_clean":"2024-04-18T10:38:57.597802+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:38:57.597802+0000","last_undegraded":"2024-04-18T10:38:57.597802+0000","last_fullsized":"2024-04-18T10:38:57.597802+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:42.362882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437375+0000","last_change":"2024-04-18T10:38:48.535465+0000","last_active":"2024-04-18T10:38:57.437375+0000","last_peered":"2024-04-18T10:38:57.437375+0000","last_clean":"2024-04-18T10:38:57.437375+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:38:57.437375+0000","last_undegraded":"2024-04-18T10:38:57.437375+0000","last_fullsized":"2024-04-18T10:38:57.437375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:15:57.026266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436785+0000","last_change":"2024-04-18T10:38:48.536144+0000","last_active":"2024-04-18T10:38:57.436785+0000","last_peered":"2024-04-18T10:38:57.436785+0000","last_clean":"2024-04-18T10:38:57.436785+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:38:57.436785+0000","last_undegraded":"2024-04-18T10:38:57.436785+0000","last_fullsized":"2024-04-18T10:38:57.436785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:30:36.746569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599270+0000","last_change":"2024-04-18T10:38:46.523917+0000","last_active":"2024-04-18T10:38:57.599270+0000","last_peered":"2024-04-18T10:38:57.599270+0000","last_clean":"2024-04-18T10:38:57.599270+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:38:57.599270+0000","last_undegraded":"2024-04-18T10:38:57.599270+0000","last_fullsized":"2024-04-18T10:38:57.599270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:50:08.234356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594991+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:38:55.594991+0000","last_peered":"2024-04-18T10:38:55.594991+0000","last_clean":"2024-04-18T10:38:55.594991+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:38:55.594991+0000","last_undegraded":"2024-04-18T10:38:55.594991+0000","last_fullsized":"2024-04-18T10:38:55.594991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:36:26.788947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436561+0000","last_change":"2024-04-18T10:38:48.532902+0000","last_active":"2024-04-18T10:38:57.436561+0000","last_peered":"2024-04-18T10:38:57.436561+0000","last_clean":"2024-04-18T10:38:57.436561+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:38:57.436561+0000","last_undegraded":"2024-04-18T10:38:57.436561+0000","last_fullsized":"2024-04-18T10:38:57.436561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:21:05.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437777+0000","last_change":"2024-04-18T10:38:48.538316+0000","last_active":"2024-04-18T10:38:57.437777+0000","last_peered":"2024-04-18T10:38:57.437777+0000","last_clean":"2024-04-18T10:38:57.437777+0000","last_became_active":"2024-04-18T10:38:48.538024+0000","last_became_peered":"2024-04-18T10:38:48.538024+0000","last_unstale":"2024-04-18T10:38:57.437777+0000","last_undegraded":"2024-04-18T10:38:57.437777+0000","last_fullsized":"2024-04-18T10:38:57.437777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:46:28.843001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437898+0000","last_change":"2024-04-18T10:38:47.515633+0000","last_active":"2024-04-18T10:38:57.437898+0000","last_peered":"2024-04-18T10:38:57.437898+0000","last_clean":"2024-04-18T10:38:57.437898+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:38:57.437898+0000","last_undegraded":"2024-04-18T10:38:57.437898+0000","last_fullsized":"2024-04-18T10:38:57.437898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:29:53.701977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595172+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:38:55.595172+0000","last_peered":"2024-04-18T10:38:55.595172+0000","last_clean":"2024-04-18T10:38:55.595172+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:38:55.595172+0000","last_undegraded":"2024-04-18T10:38:55.595172+0000","last_fullsized":"2024-04-18T10:38:55.595172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:17.044947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'2","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437030+0000","last_change":"2024-04-18T10:38:47.515748+0000","last_active":"2024-04-18T10:38:57.437030+0000","last_peered":"2024-04-18T10:38:57.437030+0000","last_clean":"2024-04-18T10:38:57.437030+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:38:57.437030+0000","last_undegraded":"2024-04-18T10:38:57.437030+0000","last_fullsized":"2024-04-18T10:38:57.437030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:10:22.348842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595924+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:38:55.595924+0000","last_peered":"2024-04-18T10:38:55.595924+0000","last_clean":"2024-04-18T10:38:55.595924+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:38:55.595924+0000","last_undegraded":"2024-04-18T10:38:55.595924+0000","last_fullsized":"2024-04-18T10:38:55.595924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:21:57.410343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436669+0000","last_change":"2024-04-18T10:38:48.531482+0000","last_active":"2024-04-18T10:38:57.436669+0000","last_peered":"2024-04-18T10:38:57.436669+0000","last_clean":"2024-04-18T10:38:57.436669+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:38:57.436669+0000","last_undegraded":"2024-04-18T10:38:57.436669+0000","last_fullsized":"2024-04-18T10:38:57.436669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:13:25.170588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599966+0000","last_change":"2024-04-18T10:38:46.523785+0000","last_active":"2024-04-18T10:38:57.599966+0000","last_peered":"2024-04-18T10:38:57.599966+0000","last_clean":"2024-04-18T10:38:57.599966+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:38:57.599966+0000","last_undegraded":"2024-04-18T10:38:57.599966+0000","last_fullsized":"2024-04-18T10:38:57.599966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:07:03.397909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596147+0000","last_change":"2024-04-18T10:38:48.528981+0000","last_active":"2024-04-18T10:38:55.596147+0000","last_peered":"2024-04-18T10:38:55.596147+0000","last_clean":"2024-04-18T10:38:55.596147+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:38:55.596147+0000","last_undegraded":"2024-04-18T10:38:55.596147+0000","last_fullsized":"2024-04-18T10:38:55.596147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:20:44.914726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596456+0000","last_change":"2024-04-18T10:38:48.526211+0000","last_active":"2024-04-18T10:38:55.596456+0000","last_peered":"2024-04-18T10:38:55.596456+0000","last_clean":"2024-04-18T10:38:55.596456+0000","last_became_active":"2024-04-18T10:38:48.523338+0000","last_became_peered":"2024-04-18T10:38:48.523338+0000","last_unstale":"2024-04-18T10:38:55.596456+0000","last_undegraded":"2024-04-18T10:38:55.596456+0000","last_fullsized":"2024-04-18T10:38:55.596456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:08:11.099172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"20'7","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600858+0000","last_change":"2024-04-18T10:38:48.521507+0000","last_active":"2024-04-18T10:38:57.600858+0000","last_peered":"2024-04-18T10:38:57.600858+0000","last_clean":"2024-04-18T10:38:57.600858+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:38:57.600858+0000","last_undegraded":"2024-04-18T10:38:57.600858+0000","last_fullsized":"2024-04-18T10:38:57.600858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:26:29.367671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594655+0000","last_change":"2024-04-18T10:38:48.528936+0000","last_active":"2024-04-18T10:38:55.594655+0000","last_peered":"2024-04-18T10:38:55.594655+0000","last_clean":"2024-04-18T10:38:55.594655+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:38:55.594655+0000","last_undegraded":"2024-04-18T10:38:55.594655+0000","last_fullsized":"2024-04-18T10:38:55.594655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:03:47.761656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597724+0000","last_change":"2024-04-18T10:38:48.528847+0000","last_active":"2024-04-18T10:38:57.597724+0000","last_peered":"2024-04-18T10:38:57.597724+0000","last_clean":"2024-04-18T10:38:57.597724+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:38:57.597724+0000","last_undegraded":"2024-04-18T10:38:57.597724+0000","last_fullsized":"2024-04-18T10:38:57.597724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:52:18.159291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595444+0000","last_change":"2024-04-18T10:38:48.525442+0000","last_active":"2024-04-18T10:38:55.595444+0000","last_peered":"2024-04-18T10:38:55.595444+0000","last_clean":"2024-04-18T10:38:55.595444+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:38:55.595444+0000","last_undegraded":"2024-04-18T10:38:55.595444+0000","last_fullsized":"2024-04-18T10:38:55.595444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:01.154765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599637+0000","last_change":"2024-04-18T10:38:48.529744+0000","last_active":"2024-04-18T10:38:57.599637+0000","last_peered":"2024-04-18T10:38:57.599637+0000","last_clean":"2024-04-18T10:38:57.599637+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:38:57.599637+0000","last_undegraded":"2024-04-18T10:38:57.599637+0000","last_fullsized":"2024-04-18T10:38:57.599637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:07.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437338+0000","last_change":"2024-04-18T10:38:48.530788+0000","last_active":"2024-04-18T10:38:57.437338+0000","last_peered":"2024-04-18T10:38:57.437338+0000","last_clean":"2024-04-18T10:38:57.437338+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:38:57.437338+0000","last_undegraded":"2024-04-18T10:38:57.437338+0000","last_fullsized":"2024-04-18T10:38:57.437338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:34.881473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'19","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.605228+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:38:55.605228+0000","last_peered":"2024-04-18T10:38:55.605228+0000","last_clean":"2024-04-18T10:38:55.605228+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:38:55.605228+0000","last_undegraded":"2024-04-18T10:38:55.605228+0000","last_fullsized":"2024-04-18T10:38:55.605228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:46.735369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5015,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597969+0000","last_change":"2024-04-18T10:38:48.528009+0000","last_active":"2024-04-18T10:38:57.597969+0000","last_peered":"2024-04-18T10:38:57.597969+0000","last_clean":"2024-04-18T10:38:57.597969+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:38:57.597969+0000","last_undegraded":"2024-04-18T10:38:57.597969+0000","last_fullsized":"2024-04-18T10:38:57.597969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:02.092332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596970+0000","last_change":"2024-04-18T10:38:48.523218+0000","last_active":"2024-04-18T10:38:55.596970+0000","last_peered":"2024-04-18T10:38:55.596970+0000","last_clean":"2024-04-18T10:38:55.596970+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:38:55.596970+0000","last_undegraded":"2024-04-18T10:38:55.596970+0000","last_fullsized":"2024-04-18T10:38:55.596970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:15:59.389767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595917+0000","last_change":"2024-04-18T10:38:48.524990+0000","last_active":"2024-04-18T10:38:55.595917+0000","last_peered":"2024-04-18T10:38:55.595917+0000","last_clean":"2024-04-18T10:38:55.595917+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:38:55.595917+0000","last_undegraded":"2024-04-18T10:38:55.595917+0000","last_fullsized":"2024-04-18T10:38:55.595917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:13:40.543145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599402+0000","last_change":"2024-04-18T10:38:48.530631+0000","last_active":"2024-04-18T10:38:57.599402+0000","last_peered":"2024-04-18T10:38:57.599402+0000","last_clean":"2024-04-18T10:38:57.599402+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:38:57.599402+0000","last_undegraded":"2024-04-18T10:38:57.599402+0000","last_fullsized":"2024-04-18T10:38:57.599402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:09:37.349194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596030+0000","last_change":"2024-04-18T10:38:48.526748+0000","last_active":"2024-04-18T10:38:55.596030+0000","last_peered":"2024-04-18T10:38:55.596030+0000","last_clean":"2024-04-18T10:38:55.596030+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:38:55.596030+0000","last_undegraded":"2024-04-18T10:38:55.596030+0000","last_fullsized":"2024-04-18T10:38:55.596030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:11.074933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594692+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:38:55.594692+0000","last_peered":"2024-04-18T10:38:55.594692+0000","last_clean":"2024-04-18T10:38:55.594692+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:38:55.594692+0000","last_undegraded":"2024-04-18T10:38:55.594692+0000","last_fullsized":"2024-04-18T10:38:55.594692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:39:56.234231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600035+0000","last_change":"2024-04-18T10:38:48.522750+0000","last_active":"2024-04-18T10:38:57.600035+0000","last_peered":"2024-04-18T10:38:57.600035+0000","last_clean":"2024-04-18T10:38:57.600035+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:38:57.600035+0000","last_undegraded":"2024-04-18T10:38:57.600035+0000","last_fullsized":"2024-04-18T10:38:57.600035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:51.519415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436960+0000","last_change":"2024-04-18T10:38:46.524444+0000","last_active":"2024-04-18T10:38:57.436960+0000","last_peered":"2024-04-18T10:38:57.436960+0000","last_clean":"2024-04-18T10:38:57.436960+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:38:57.436960+0000","last_undegraded":"2024-04-18T10:38:57.436960+0000","last_fullsized":"2024-04-18T10:38:57.436960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:29:31.257203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595943+0000","last_change":"2024-04-18T10:38:48.524076+0000","last_active":"2024-04-18T10:38:55.595943+0000","last_peered":"2024-04-18T10:38:55.595943+0000","last_clean":"2024-04-18T10:38:55.595943+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:38:55.595943+0000","last_undegraded":"2024-04-18T10:38:55.595943+0000","last_fullsized":"2024-04-18T10:38:55.595943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:58.250235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600703+0000","last_change":"2024-04-18T10:38:46.523417+0000","last_active":"2024-04-18T10:38:57.600703+0000","last_peered":"2024-04-18T10:38:57.600703+0000","last_clean":"2024-04-18T10:38:57.600703+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:38:57.600703+0000","last_undegraded":"2024-04-18T10:38:57.600703+0000","last_fullsized":"2024-04-18T10:38:57.600703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:02:29.079358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594540+0000","last_change":"2024-04-18T10:38:48.528752+0000","last_active":"2024-04-18T10:38:55.594540+0000","last_peered":"2024-04-18T10:38:55.594540+0000","last_clean":"2024-04-18T10:38:55.594540+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:38:55.594540+0000","last_undegraded":"2024-04-18T10:38:55.594540+0000","last_fullsized":"2024-04-18T10:38:55.594540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:31:20.382051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598444+0000","last_change":"2024-04-18T10:38:47.516780+0000","last_active":"2024-04-18T10:38:57.598444+0000","last_peered":"2024-04-18T10:38:57.598444+0000","last_clean":"2024-04-18T10:38:57.598444+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:38:57.598444+0000","last_undegraded":"2024-04-18T10:38:57.598444+0000","last_fullsized":"2024-04-18T10:38:57.598444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:26.639180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436793+0000","last_change":"2024-04-18T10:38:48.537651+0000","last_active":"2024-04-18T10:38:57.436793+0000","last_peered":"2024-04-18T10:38:57.436793+0000","last_clean":"2024-04-18T10:38:57.436793+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:38:57.436793+0000","last_undegraded":"2024-04-18T10:38:57.436793+0000","last_fullsized":"2024-04-18T10:38:57.436793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:18.675030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594950+0000","last_change":"2024-04-18T10:38:48.528245+0000","last_active":"2024-04-18T10:38:55.594950+0000","last_peered":"2024-04-18T10:38:55.594950+0000","last_clean":"2024-04-18T10:38:55.594950+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:38:55.594950+0000","last_undegraded":"2024-04-18T10:38:55.594950+0000","last_fullsized":"2024-04-18T10:38:55.594950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:52.532246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598611+0000","last_change":"2024-04-18T10:38:48.528767+0000","last_active":"2024-04-18T10:38:57.598611+0000","last_peered":"2024-04-18T10:38:57.598611+0000","last_clean":"2024-04-18T10:38:57.598611+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:38:57.598611+0000","last_undegraded":"2024-04-18T10:38:57.598611+0000","last_fullsized":"2024-04-18T10:38:57.598611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:31:30.566152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599462+0000","last_change":"2024-04-18T10:38:48.527940+0000","last_active":"2024-04-18T10:38:57.599462+0000","last_peered":"2024-04-18T10:38:57.599462+0000","last_clean":"2024-04-18T10:38:57.599462+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:38:57.599462+0000","last_undegraded":"2024-04-18T10:38:57.599462+0000","last_fullsized":"2024-04-18T10:38:57.599462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:28.013331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599844+0000","last_change":"2024-04-18T10:38:46.522705+0000","last_active":"2024-04-18T10:38:57.599844+0000","last_peered":"2024-04-18T10:38:57.599844+0000","last_clean":"2024-04-18T10:38:57.599844+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:38:57.599844+0000","last_undegraded":"2024-04-18T10:38:57.599844+0000","last_fullsized":"2024-04-18T10:38:57.599844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:23:44.645859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"36'5","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596305+0000","last_change":"2024-04-18T10:38:48.523093+0000","last_active":"2024-04-18T10:38:55.596305+0000","last_peered":"2024-04-18T10:38:55.596305+0000","last_clean":"2024-04-18T10:38:55.596305+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:38:55.596305+0000","last_undegraded":"2024-04-18T10:38:55.596305+0000","last_fullsized":"2024-04-18T10:38:55.596305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:20.206383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599559+0000","last_change":"2024-04-18T10:38:48.528094+0000","last_active":"2024-04-18T10:38:57.599559+0000","last_peered":"2024-04-18T10:38:57.599559+0000","last_clean":"2024-04-18T10:38:57.599559+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:38:57.599559+0000","last_undegraded":"2024-04-18T10:38:57.599559+0000","last_fullsized":"2024-04-18T10:38:57.599559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:02.429215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"20'4","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594760+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:38:55.594760+0000","last_peered":"2024-04-18T10:38:55.594760+0000","last_clean":"2024-04-18T10:38:55.594760+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:38:55.594760+0000","last_undegraded":"2024-04-18T10:38:55.594760+0000","last_fullsized":"2024-04-18T10:38:55.594760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:47:34.182153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595528+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:38:55.595528+0000","last_peered":"2024-04-18T10:38:55.595528+0000","last_clean":"2024-04-18T10:38:55.595528+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:38:55.595528+0000","last_undegraded":"2024-04-18T10:38:55.595528+0000","last_fullsized":"2024-04-18T10:38:55.595528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:08.173779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595688+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:38:55.595688+0000","last_peered":"2024-04-18T10:38:55.595688+0000","last_clean":"2024-04-18T10:38:55.595688+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:38:55.595688+0000","last_undegraded":"2024-04-18T10:38:55.595688+0000","last_fullsized":"2024-04-18T10:38:55.595688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:04.645176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598384+0000","last_change":"2024-04-18T10:38:48.528656+0000","last_active":"2024-04-18T10:38:57.598384+0000","last_peered":"2024-04-18T10:38:57.598384+0000","last_clean":"2024-04-18T10:38:57.598384+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:38:57.598384+0000","last_undegraded":"2024-04-18T10:38:57.598384+0000","last_fullsized":"2024-04-18T10:38:57.598384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:53.065322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594409+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:38:55.594409+0000","last_peered":"2024-04-18T10:38:55.594409+0000","last_clean":"2024-04-18T10:38:55.594409+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:38:55.594409+0000","last_undegraded":"2024-04-18T10:38:55.594409+0000","last_fullsized":"2024-04-18T10:38:55.594409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:06:10.188847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.438007+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:38:57.438007+0000","last_peered":"2024-04-18T10:38:57.438007+0000","last_clean":"2024-04-18T10:38:57.438007+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:38:57.438007+0000","last_undegraded":"2024-04-18T10:38:57.438007+0000","last_fullsized":"2024-04-18T10:38:57.438007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:39:47.463040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437259+0000","last_change":"2024-04-18T10:38:46.521667+0000","last_active":"2024-04-18T10:38:57.437259+0000","last_peered":"2024-04-18T10:38:57.437259+0000","last_clean":"2024-04-18T10:38:57.437259+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:38:57.437259+0000","last_undegraded":"2024-04-18T10:38:57.437259+0000","last_fullsized":"2024-04-18T10:38:57.437259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:58:33.365320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597694+0000","last_change":"2024-04-18T10:38:48.518724+0000","last_active":"2024-04-18T10:38:57.597694+0000","last_peered":"2024-04-18T10:38:57.597694+0000","last_clean":"2024-04-18T10:38:57.597694+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:38:57.597694+0000","last_undegraded":"2024-04-18T10:38:57.597694+0000","last_fullsized":"2024-04-18T10:38:57.597694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:42.824622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437142+0000","last_change":"2024-04-18T10:38:48.529610+0000","last_active":"2024-04-18T10:38:57.437142+0000","last_peered":"2024-04-18T10:38:57.437142+0000","last_clean":"2024-04-18T10:38:57.437142+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:38:57.437142+0000","last_undegraded":"2024-04-18T10:38:57.437142+0000","last_fullsized":"2024-04-18T10:38:57.437142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:22:33.897416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594876+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:38:55.594876+0000","last_peered":"2024-04-18T10:38:55.594876+0000","last_clean":"2024-04-18T10:38:55.594876+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:38:55.594876+0000","last_undegraded":"2024-04-18T10:38:55.594876+0000","last_fullsized":"2024-04-18T10:38:55.594876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:33.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"20'3","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599757+0000","last_change":"2024-04-18T10:38:47.513344+0000","last_active":"2024-04-18T10:38:57.599757+0000","last_peered":"2024-04-18T10:38:57.599757+0000","last_clean":"2024-04-18T10:38:57.599757+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:38:57.599757+0000","last_undegraded":"2024-04-18T10:38:57.599757+0000","last_fullsized":"2024-04-18T10:38:57.599757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:48.441734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437439+0000","last_change":"2024-04-18T10:38:47.515107+0000","last_active":"2024-04-18T10:38:57.437439+0000","last_peered":"2024-04-18T10:38:57.437439+0000","last_clean":"2024-04-18T10:38:57.437439+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:38:57.437439+0000","last_undegraded":"2024-04-18T10:38:57.437439+0000","last_fullsized":"2024-04-18T10:38:57.437439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:10:14.119655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598526+0000","last_change":"2024-04-18T10:38:48.520896+0000","last_active":"2024-04-18T10:38:57.598526+0000","last_peered":"2024-04-18T10:38:57.598526+0000","last_clean":"2024-04-18T10:38:57.598526+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:38:57.598526+0000","last_undegraded":"2024-04-18T10:38:57.598526+0000","last_fullsized":"2024-04-18T10:38:57.598526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:57:03.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437086+0000","last_change":"2024-04-18T10:38:47.519693+0000","last_active":"2024-04-18T10:38:57.437086+0000","last_peered":"2024-04-18T10:38:57.437086+0000","last_clean":"2024-04-18T10:38:57.437086+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:38:57.437086+0000","last_undegraded":"2024-04-18T10:38:57.437086+0000","last_fullsized":"2024-04-18T10:38:57.437086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:34.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437875+0000","last_change":"2024-04-18T10:38:46.520198+0000","last_active":"2024-04-18T10:38:57.437875+0000","last_peered":"2024-04-18T10:38:57.437875+0000","last_clean":"2024-04-18T10:38:57.437875+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:38:57.437875+0000","last_undegraded":"2024-04-18T10:38:57.437875+0000","last_fullsized":"2024-04-18T10:38:57.437875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:18:11.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596159+0000","last_change":"2024-04-18T10:38:48.522906+0000","last_active":"2024-04-18T10:38:55.596159+0000","last_peered":"2024-04-18T10:38:55.596159+0000","last_clean":"2024-04-18T10:38:55.596159+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:38:55.596159+0000","last_undegraded":"2024-04-18T10:38:55.596159+0000","last_fullsized":"2024-04-18T10:38:55.596159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:14.552416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'115","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436498+0000","last_change":"2024-04-18T10:38:46.507608+0000","last_active":"2024-04-18T10:38:57.436498+0000","last_peered":"2024-04-18T10:38:57.436498+0000","last_clean":"2024-04-18T10:38:57.436498+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:38:57.436498+0000","last_undegraded":"2024-04-18T10:38:57.436498+0000","last_fullsized":"2024-04-18T10:38:57.436498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:46:55.362151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595397+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:38:55.595397+0000","last_peered":"2024-04-18T10:38:55.595397+0000","last_clean":"2024-04-18T10:38:55.595397+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:38:55.595397+0000","last_undegraded":"2024-04-18T10:38:55.595397+0000","last_fullsized":"2024-04-18T10:38:55.595397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:23.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595410+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:38:55.595410+0000","last_peered":"2024-04-18T10:38:55.595410+0000","last_clean":"2024-04-18T10:38:55.595410+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:38:55.595410+0000","last_undegraded":"2024-04-18T10:38:55.595410+0000","last_fullsized":"2024-04-18T10:38:55.595410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:03.109484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594380+0000","last_change":"2024-04-18T10:38:48.529162+0000","last_active":"2024-04-18T10:38:55.594380+0000","last_peered":"2024-04-18T10:38:55.594380+0000","last_clean":"2024-04-18T10:38:55.594380+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:38:55.594380+0000","last_undegraded":"2024-04-18T10:38:55.594380+0000","last_fullsized":"2024-04-18T10:38:55.594380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:18:10.267046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599182+0000","last_change":"2024-04-18T10:38:47.513300+0000","last_active":"2024-04-18T10:38:57.599182+0000","last_peered":"2024-04-18T10:38:57.599182+0000","last_clean":"2024-04-18T10:38:57.599182+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:38:57.599182+0000","last_undegraded":"2024-04-18T10:38:57.599182+0000","last_fullsized":"2024-04-18T10:38:57.599182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:38:14.658997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599902+0000","last_change":"2024-04-18T10:38:46.523777+0000","last_active":"2024-04-18T10:38:57.599902+0000","last_peered":"2024-04-18T10:38:57.599902+0000","last_clean":"2024-04-18T10:38:57.599902+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:38:57.599902+0000","last_undegraded":"2024-04-18T10:38:57.599902+0000","last_fullsized":"2024-04-18T10:38:57.599902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:03:13.518817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595627+0000","last_change":"2024-04-18T10:38:48.526577+0000","last_active":"2024-04-18T10:38:55.595627+0000","last_peered":"2024-04-18T10:38:55.595627+0000","last_clean":"2024-04-18T10:38:55.595627+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:38:55.595627+0000","last_undegraded":"2024-04-18T10:38:55.595627+0000","last_fullsized":"2024-04-18T10:38:55.595627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:34:26.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437526+0000","last_change":"2024-04-18T10:38:47.515422+0000","last_active":"2024-04-18T10:38:57.437526+0000","last_peered":"2024-04-18T10:38:57.437526+0000","last_clean":"2024-04-18T10:38:57.437526+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:38:57.437526+0000","last_undegraded":"2024-04-18T10:38:57.437526+0000","last_fullsized":"2024-04-18T10:38:57.437526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.811949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600090+0000","last_change":"2024-04-18T10:38:47.513292+0000","last_active":"2024-04-18T10:38:57.600090+0000","last_peered":"2024-04-18T10:38:57.600090+0000","last_clean":"2024-04-18T10:38:57.600090+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:38:57.600090+0000","last_undegraded":"2024-04-18T10:38:57.600090+0000","last_fullsized":"2024-04-18T10:38:57.600090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:35.308701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.610178+0000","last_change":"2024-04-18T10:38:48.525344+0000","last_active":"2024-04-18T10:38:55.610178+0000","last_peered":"2024-04-18T10:38:55.610178+0000","last_clean":"2024-04-18T10:38:55.610178+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:38:55.610178+0000","last_undegraded":"2024-04-18T10:38:55.610178+0000","last_fullsized":"2024-04-18T10:38:55.610178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:13:06.871047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437912+0000","last_change":"2024-04-18T10:38:46.521665+0000","last_active":"2024-04-18T10:38:57.437912+0000","last_peered":"2024-04-18T10:38:57.437912+0000","last_clean":"2024-04-18T10:38:57.437912+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:38:57.437912+0000","last_undegraded":"2024-04-18T10:38:57.437912+0000","last_fullsized":"2024-04-18T10:38:57.437912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:14:41.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594641+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:38:55.594641+0000","last_peered":"2024-04-18T10:38:55.594641+0000","last_clean":"2024-04-18T10:38:55.594641+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:38:55.594641+0000","last_undegraded":"2024-04-18T10:38:55.594641+0000","last_fullsized":"2024-04-18T10:38:55.594641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:16.195736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595820+0000","last_change":"2024-04-18T10:38:48.519133+0000","last_active":"2024-04-18T10:38:55.595820+0000","last_peered":"2024-04-18T10:38:55.595820+0000","last_clean":"2024-04-18T10:38:55.595820+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:38:55.595820+0000","last_undegraded":"2024-04-18T10:38:55.595820+0000","last_fullsized":"2024-04-18T10:38:55.595820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:47.684869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600029+0000","last_change":"2024-04-18T10:38:46.523957+0000","last_active":"2024-04-18T10:38:57.600029+0000","last_peered":"2024-04-18T10:38:57.600029+0000","last_clean":"2024-04-18T10:38:57.600029+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:38:57.600029+0000","last_undegraded":"2024-04-18T10:38:57.600029+0000","last_fullsized":"2024-04-18T10:38:57.600029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:49.311603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597695+0000","last_change":"2024-04-18T10:38:48.520854+0000","last_active":"2024-04-18T10:38:57.597695+0000","last_peered":"2024-04-18T10:38:57.597695+0000","last_clean":"2024-04-18T10:38:57.597695+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:38:57.597695+0000","last_undegraded":"2024-04-18T10:38:57.597695+0000","last_fullsized":"2024-04-18T10:38:57.597695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:27.953816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'11","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600211+0000","last_change":"2024-04-18T10:38:48.527898+0000","last_active":"2024-04-18T10:38:57.600211+0000","last_peered":"2024-04-18T10:38:57.600211+0000","last_clean":"2024-04-18T10:38:57.600211+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:38:57.600211+0000","last_undegraded":"2024-04-18T10:38:57.600211+0000","last_fullsized":"2024-04-18T10:38:57.600211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:35:58.649968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598510+0000","last_change":"2024-04-18T10:38:47.514434+0000","last_active":"2024-04-18T10:38:57.598510+0000","last_peered":"2024-04-18T10:38:57.598510+0000","last_clean":"2024-04-18T10:38:57.598510+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:38:57.598510+0000","last_undegraded":"2024-04-18T10:38:57.598510+0000","last_fullsized":"2024-04-18T10:38:57.598510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:22:40.288392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437024+0000","last_change":"2024-04-18T10:38:46.520352+0000","last_active":"2024-04-18T10:38:57.437024+0000","last_peered":"2024-04-18T10:38:57.437024+0000","last_clean":"2024-04-18T10:38:57.437024+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:38:57.437024+0000","last_undegraded":"2024-04-18T10:38:57.437024+0000","last_fullsized":"2024-04-18T10:38:57.437024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:55:53.724349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598060+0000","last_change":"2024-04-18T10:38:48.528181+0000","last_active":"2024-04-18T10:38:57.598060+0000","last_peered":"2024-04-18T10:38:57.598060+0000","last_clean":"2024-04-18T10:38:57.598060+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:38:57.598060+0000","last_undegraded":"2024-04-18T10:38:57.598060+0000","last_fullsized":"2024-04-18T10:38:57.598060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:38.920913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.604724+0000","last_change":"2024-04-18T10:38:48.526382+0000","last_active":"2024-04-18T10:38:55.604724+0000","last_peered":"2024-04-18T10:38:55.604724+0000","last_clean":"2024-04-18T10:38:55.604724+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:38:55.604724+0000","last_undegraded":"2024-04-18T10:38:55.604724+0000","last_fullsized":"2024-04-18T10:38:55.604724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:36:19.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598409+0000","last_change":"2024-04-18T10:38:48.520427+0000","last_active":"2024-04-18T10:38:57.598409+0000","last_peered":"2024-04-18T10:38:57.598409+0000","last_clean":"2024-04-18T10:38:57.598409+0000","last_became_active":"2024-04-18T10:38:48.520005+0000","last_became_peered":"2024-04-18T10:38:48.520005+0000","last_unstale":"2024-04-18T10:38:57.598409+0000","last_undegraded":"2024-04-18T10:38:57.598409+0000","last_fullsized":"2024-04-18T10:38:57.598409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:06.664607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"36'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594905+0000","last_change":"2024-04-18T10:38:48.521841+0000","last_active":"2024-04-18T10:38:55.594905+0000","last_peered":"2024-04-18T10:38:55.594905+0000","last_clean":"2024-04-18T10:38:55.594905+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:38:55.594905+0000","last_undegraded":"2024-04-18T10:38:55.594905+0000","last_fullsized":"2024-04-18T10:38:55.594905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:44:53.826636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595112+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:38:55.595112+0000","last_peered":"2024-04-18T10:38:55.595112+0000","last_clean":"2024-04-18T10:38:55.595112+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:38:55.595112+0000","last_undegraded":"2024-04-18T10:38:55.595112+0000","last_fullsized":"2024-04-18T10:38:55.595112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:44.601528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'5","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600709+0000","last_change":"2024-04-18T10:38:46.523460+0000","last_active":"2024-04-18T10:38:57.600709+0000","last_peered":"2024-04-18T10:38:57.600709+0000","last_clean":"2024-04-18T10:38:57.600709+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:38:57.600709+0000","last_undegraded":"2024-04-18T10:38:57.600709+0000","last_fullsized":"2024-04-18T10:38:57.600709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:33.163273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597490+0000","last_change":"2024-04-18T10:38:47.514386+0000","last_active":"2024-04-18T10:38:57.597490+0000","last_peered":"2024-04-18T10:38:57.597490+0000","last_clean":"2024-04-18T10:38:57.597490+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:38:57.597490+0000","last_undegraded":"2024-04-18T10:38:57.597490+0000","last_fullsized":"2024-04-18T10:38:57.597490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:25.189215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437026+0000","last_change":"2024-04-18T10:38:47.515056+0000","last_active":"2024-04-18T10:38:57.437026+0000","last_peered":"2024-04-18T10:38:57.437026+0000","last_clean":"2024-04-18T10:38:57.437026+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:38:57.437026+0000","last_undegraded":"2024-04-18T10:38:57.437026+0000","last_fullsized":"2024-04-18T10:38:57.437026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:09:39.192070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595328+0000","last_change":"2024-04-18T10:38:48.526620+0000","last_active":"2024-04-18T10:38:55.595328+0000","last_peered":"2024-04-18T10:38:55.595328+0000","last_clean":"2024-04-18T10:38:55.595328+0000","last_became_active":"2024-04-18T10:38:48.526335+0000","last_became_peered":"2024-04-18T10:38:48.526335+0000","last_unstale":"2024-04-18T10:38:55.595328+0000","last_undegraded":"2024-04-18T10:38:55.595328+0000","last_fullsized":"2024-04-18T10:38:55.595328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:30:36.594870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599959+0000","last_change":"2024-04-18T10:38:48.530823+0000","last_active":"2024-04-18T10:38:57.599959+0000","last_peered":"2024-04-18T10:38:57.599959+0000","last_clean":"2024-04-18T10:38:57.599959+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:38:57.599959+0000","last_undegraded":"2024-04-18T10:38:57.599959+0000","last_fullsized":"2024-04-18T10:38:57.599959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:17.039853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.597517+0000","last_change":"2024-04-18T10:38:48.528090+0000","last_active":"2024-04-18T10:38:55.597517+0000","last_peered":"2024-04-18T10:38:55.597517+0000","last_clean":"2024-04-18T10:38:55.597517+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:38:55.597517+0000","last_undegraded":"2024-04-18T10:38:55.597517+0000","last_fullsized":"2024-04-18T10:38:55.597517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:18:27.052176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437482+0000","last_change":"2024-04-18T10:38:47.515405+0000","last_active":"2024-04-18T10:38:57.437482+0000","last_peered":"2024-04-18T10:38:57.437482+0000","last_clean":"2024-04-18T10:38:57.437482+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:38:57.437482+0000","last_undegraded":"2024-04-18T10:38:57.437482+0000","last_fullsized":"2024-04-18T10:38:57.437482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:31.550014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8783,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":49,"num_read_kb":55,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953476,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":372,"kb_used_omap":13,"kb_used_meta":297138,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":380928,"data_stored":153396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":304270073},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]}]},{"osd":2,"up_from":31,"seq":133143986180,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":360,"kb_used_omap":7,"kb_used_meta":297080,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":368640,"data_stored":159267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":304210711},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]}]},{"osd":0,"up_from":29,"seq":124554051589,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302276,"kb_used_data":948,"kb_used_omap":17,"kb_used_meta":301294,"kb_avail":94069564,"statfs":{"total":96636764160,"available":96327233536,"internally_reserved":0,"allocated":970752,"data_stored":748094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":308525370},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":1,"up_from":30,"seq":128849018885,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302188,"kb_used_data":920,"kb_used_omap":6,"kb_used_meta":301241,"kb_avail":94069652,"statfs":{"total":96636764160,"available":96327323648,"internally_reserved":0,"allocated":942080,"data_stored":740687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308471765},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":8208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:39:01.968 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:39:02.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.123+0000 7f2f6e06d700 1 Processor -- start 2024-04-18T10:39:02.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.123+0000 7f2f6e06d700 1 -- start start 2024-04-18T10:39:02.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f6e06d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f6806e050 0x7f2f6806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f6e06d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f680a2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f6e06d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f680a3720 con 0x7f2f68069450 2024-04-18T10:39:02.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f6e06d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6806fd80 con 0x7f2f680a2960 2024-04-18T10:39:02.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f6e06d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6806ea20 con 0x7f2f6806e050 2024-04-18T10:39:02.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f67fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f680a2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f677fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2f68069450 0x7f2f6806f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53358/0 (socket says 172.21.15.31:53358) 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f677fe700 1 -- 172.21.15.31:0/2265768118 learned_addr learned my addr 172.21.15.31:0/2265768118 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f66ffd700 1 --2- 172.21.15.31:0/2265768118 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f6806e050 0x7f2f6806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f667fc700 1 -- 172.21.15.31:0/2265768118 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679215636 0 0) 0x7f2f680a3720 con 0x7f2f68069450 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f667fc700 1 -- 172.21.15.31:0/2265768118 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f54003570 con 0x7f2f68069450 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f67fff700 1 -- 172.21.15.31:0/2265768118 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f6806e050 msgr2=0x7f2f6806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f67fff700 1 --2- 172.21.15.31:0/2265768118 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f6806e050 0x7f2f6806e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f67fff700 1 -- 172.21.15.31:0/2265768118 >> v1:172.21.15.31:6789/0 conn(0x7f2f68069450 legacy=0x7f2f6806f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f67fff700 1 -- 172.21.15.31:0/2265768118 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680a2420 con 0x7f2f680a2960 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f66ffd700 1 --2- 172.21.15.31:0/2265768118 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f6806e050 0x7f2f6806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f67fff700 1 --2- 172.21.15.31:0/2265768118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f680a2db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000d100 tx=0x7f2f6000b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df79213495052e0a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.124+0000 7f2f667fc700 1 -- 172.21.15.31:0/2265768118 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60010070 con 0x7f2f680a2960 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f667fc700 1 -- 172.21.15.31:0/2265768118 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6000b2e0 con 0x7f2f680a2960 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f667fc700 1 -- 172.21.15.31:0/2265768118 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6000dcc0 con 0x7f2f680a2960 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f6e06d700 1 -- 172.21.15.31:0/2265768118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 msgr2=0x7f2f680a2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f6e06d700 1 --2- 172.21.15.31:0/2265768118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f680a2db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f6000d100 tx=0x7f2f6000b990 comp rx=0 tx=0).stop 2024-04-18T10:39:02.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f6e06d700 1 -- 172.21.15.31:0/2265768118 shutdown_connections 2024-04-18T10:39:02.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f6e06d700 1 --2- 172.21.15.31:0/2265768118 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f680a2db0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f6e06d700 1 --2- 172.21.15.31:0/2265768118 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f6806e050 0x7f2f6806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f6e06d700 1 -- 172.21.15.31:0/2265768118 >> 172.21.15.31:0/2265768118 conn(0x7f2f6806cd10 msgr2=0x7f2f68068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:02.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f6e06d700 1 -- 172.21.15.31:0/2265768118 shutdown_connections 2024-04-18T10:39:02.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.125+0000 7f2f6e06d700 1 -- 172.21.15.31:0/2265768118 wait complete. 2024-04-18T10:39:02.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.126+0000 7f2f6e06d700 1 Processor -- start 2024-04-18T10:39:02.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.126+0000 7f2f6e06d700 1 -- start start 2024-04-18T10:39:02.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f6e06d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f68069450 0x7f2f680a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f6e06d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f6806e050 0x7f2f680a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f6e06d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f681364e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f6e06d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680a7780 con 0x7f2f6806e050 2024-04-18T10:39:02.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f6e06d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680a99c0 con 0x7f2f680a2960 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f6e06d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680a79b0 con 0x7f2f68069450 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f66ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f6806e050 0x7f2f680a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f67fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f681364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f66ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f6806e050 0x7f2f680a9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54496/0 (socket says 172.21.15.31:54496) 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f66ffd700 1 -- 172.21.15.31:0/3255064388 learned_addr learned my addr 172.21.15.31:0/3255064388 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f677fe700 1 --2- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f68069450 0x7f2f680a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f67fff700 1 -- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f68069450 msgr2=0x7f2f680a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f67fff700 1 --2- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f68069450 0x7f2f680a8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f67fff700 1 -- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f6806e050 msgr2=0x7f2f680a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f67fff700 1 --2- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f6806e050 0x7f2f680a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f67fff700 1 -- 172.21.15.31:0/3255064388 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58009420 con 0x7f2f680a2960 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f66ffd700 1 --2- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f6806e050 0x7f2f680a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f67fff700 1 --2- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f681364e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f680671e0 tx=0x7f2f6001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.127+0000 7f2f5f7fe700 1 -- 172.21.15.31:0/3255064388 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6000b630 con 0x7f2f680a2960 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.128+0000 7f2f5f7fe700 1 -- 172.21.15.31:0/3255064388 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f60009b70 con 0x7f2f680a2960 2024-04-18T10:39:02.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.128+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6000bc30 con 0x7f2f680a2960 2024-04-18T10:39:02.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.128+0000 7f2f5f7fe700 1 -- 172.21.15.31:0/3255064388 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6001f420 con 0x7f2f680a2960 2024-04-18T10:39:02.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.128+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f680688e0 con 0x7f2f680a2960 2024-04-18T10:39:02.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.128+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f680a7150 con 0x7f2f680a2960 2024-04-18T10:39:02.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.129+0000 7f2f5f7fe700 1 -- 172.21.15.31:0/3255064388 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f2f60003040 con 0x7f2f680a2960 2024-04-18T10:39:02.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.129+0000 7f2f5f7fe700 1 -- 172.21.15.31:0/3255064388 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f2f6005f2b0 con 0x7f2f680a2960 2024-04-18T10:39:02.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.133+0000 7f2f5f7fe700 1 -- 172.21.15.31:0/3255064388 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2f60005f50 con 0x7f2f680a2960 2024-04-18T10:39:02.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.294+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f680a7150 con 0x7f2f48046010 2024-04-18T10:39:02.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.301+0000 7f2f5f7fe700 1 -- 172.21.15.31:0/3255064388 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271464 (unknown 2965378022 0 3166582305) 0x7f2f680a7150 con 0x7f2f48046010 2024-04-18T10:39:02.305 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 >> v1:172.21.15.31:6816/46601 conn(0x7f2f48046010 legacy=0x7f2f480484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 msgr2=0x7f2f681364e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 --2- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f681364e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f680671e0 tx=0x7f2f6001a000 comp rx=0 tx=0).stop 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 shutdown_connections 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 --2- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2f68069450 0x7f2f680a8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 --2- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2f680a2960 0x7f2f681364e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 --2- 172.21.15.31:0/3255064388 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f6806e050 0x7f2f680a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 >> 172.21.15.31:0/3255064388 conn(0x7f2f6806cd10 msgr2=0x7f2f6813e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 shutdown_connections 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.303+0000 7f2f6e06d700 1 -- 172.21.15.31:0/3255064388 wait complete. 2024-04-18T10:39:02.307 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:39:02.316 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-18T10:39:00.415567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599151,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":273,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1199472,"kb_used_data":2600,"kb_used_omap":44,"kb_used_meta":1196755,"kb_avail":376287888,"statfs":{"total":386547056640,"available":385318797312,"internally_reserved":0,"allocated":2662400,"data_stored":1801444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1225477919},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.822265"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598015+0000","last_change":"2024-04-18T10:38:48.515671+0000","last_active":"2024-04-18T10:38:57.598015+0000","last_peered":"2024-04-18T10:38:57.598015+0000","last_clean":"2024-04-18T10:38:57.598015+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:38:57.598015+0000","last_undegraded":"2024-04-18T10:38:57.598015+0000","last_fullsized":"2024-04-18T10:38:57.598015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:55:56.692744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597866+0000","last_change":"2024-04-18T10:38:47.514349+0000","last_active":"2024-04-18T10:38:57.597866+0000","last_peered":"2024-04-18T10:38:57.597866+0000","last_clean":"2024-04-18T10:38:57.597866+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:38:57.597866+0000","last_undegraded":"2024-04-18T10:38:57.597866+0000","last_fullsized":"2024-04-18T10:38:57.597866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:40:55.175836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599562+0000","last_change":"2024-04-18T10:38:46.523814+0000","last_active":"2024-04-18T10:38:57.599562+0000","last_peered":"2024-04-18T10:38:57.599562+0000","last_clean":"2024-04-18T10:38:57.599562+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:38:57.599562+0000","last_undegraded":"2024-04-18T10:38:57.599562+0000","last_fullsized":"2024-04-18T10:38:57.599562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:17.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599621+0000","last_change":"2024-04-18T10:38:46.523213+0000","last_active":"2024-04-18T10:38:57.599621+0000","last_peered":"2024-04-18T10:38:57.599621+0000","last_clean":"2024-04-18T10:38:57.599621+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:38:57.599621+0000","last_undegraded":"2024-04-18T10:38:57.599621+0000","last_fullsized":"2024-04-18T10:38:57.599621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:17.296380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599649+0000","last_change":"2024-04-18T10:38:48.531222+0000","last_active":"2024-04-18T10:38:57.599649+0000","last_peered":"2024-04-18T10:38:57.599649+0000","last_clean":"2024-04-18T10:38:57.599649+0000","last_became_active":"2024-04-18T10:38:48.530921+0000","last_became_peered":"2024-04-18T10:38:48.530921+0000","last_unstale":"2024-04-18T10:38:57.599649+0000","last_undegraded":"2024-04-18T10:38:57.599649+0000","last_fullsized":"2024-04-18T10:38:57.599649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:17:12.634617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595180+0000","last_change":"2024-04-18T10:38:48.523564+0000","last_active":"2024-04-18T10:38:55.595180+0000","last_peered":"2024-04-18T10:38:55.595180+0000","last_clean":"2024-04-18T10:38:55.595180+0000","last_became_active":"2024-04-18T10:38:48.521237+0000","last_became_peered":"2024-04-18T10:38:48.521237+0000","last_unstale":"2024-04-18T10:38:55.595180+0000","last_undegraded":"2024-04-18T10:38:55.595180+0000","last_fullsized":"2024-04-18T10:38:55.595180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:14:15.092963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595560+0000","last_change":"2024-04-18T10:38:48.526481+0000","last_active":"2024-04-18T10:38:55.595560+0000","last_peered":"2024-04-18T10:38:55.595560+0000","last_clean":"2024-04-18T10:38:55.595560+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:38:55.595560+0000","last_undegraded":"2024-04-18T10:38:55.595560+0000","last_fullsized":"2024-04-18T10:38:55.595560+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:52:21.244414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436594+0000","last_change":"2024-04-18T10:38:46.507263+0000","last_active":"2024-04-18T10:38:57.436594+0000","last_peered":"2024-04-18T10:38:57.436594+0000","last_clean":"2024-04-18T10:38:57.436594+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:38:57.436594+0000","last_undegraded":"2024-04-18T10:38:57.436594+0000","last_fullsized":"2024-04-18T10:38:57.436594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:09:47.927239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600773+0000","last_change":"2024-04-18T10:38:48.521319+0000","last_active":"2024-04-18T10:38:57.600773+0000","last_peered":"2024-04-18T10:38:57.600773+0000","last_clean":"2024-04-18T10:38:57.600773+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:38:57.600773+0000","last_undegraded":"2024-04-18T10:38:57.600773+0000","last_fullsized":"2024-04-18T10:38:57.600773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:08:27.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437690+0000","last_change":"2024-04-18T10:38:46.520305+0000","last_active":"2024-04-18T10:38:57.437690+0000","last_peered":"2024-04-18T10:38:57.437690+0000","last_clean":"2024-04-18T10:38:57.437690+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:38:57.437690+0000","last_undegraded":"2024-04-18T10:38:57.437690+0000","last_fullsized":"2024-04-18T10:38:57.437690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.888537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436926+0000","last_change":"2024-04-18T10:38:46.520635+0000","last_active":"2024-04-18T10:38:57.436926+0000","last_peered":"2024-04-18T10:38:57.436926+0000","last_clean":"2024-04-18T10:38:57.436926+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:38:57.436926+0000","last_undegraded":"2024-04-18T10:38:57.436926+0000","last_fullsized":"2024-04-18T10:38:57.436926+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:25.599792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598218+0000","last_change":"2024-04-18T10:38:48.520598+0000","last_active":"2024-04-18T10:38:57.598218+0000","last_peered":"2024-04-18T10:38:57.598218+0000","last_clean":"2024-04-18T10:38:57.598218+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:38:57.598218+0000","last_undegraded":"2024-04-18T10:38:57.598218+0000","last_fullsized":"2024-04-18T10:38:57.598218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:57:15.523949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598014+0000","last_change":"2024-04-18T10:38:48.531599+0000","last_active":"2024-04-18T10:38:57.598014+0000","last_peered":"2024-04-18T10:38:57.598014+0000","last_clean":"2024-04-18T10:38:57.598014+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:38:57.598014+0000","last_undegraded":"2024-04-18T10:38:57.598014+0000","last_fullsized":"2024-04-18T10:38:57.598014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:07:18.483736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436905+0000","last_change":"2024-04-18T10:38:47.515586+0000","last_active":"2024-04-18T10:38:57.436905+0000","last_peered":"2024-04-18T10:38:57.436905+0000","last_clean":"2024-04-18T10:38:57.436905+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:38:57.436905+0000","last_undegraded":"2024-04-18T10:38:57.436905+0000","last_fullsized":"2024-04-18T10:38:57.436905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:38.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599363+0000","last_change":"2024-04-18T10:38:46.523038+0000","last_active":"2024-04-18T10:38:57.599363+0000","last_peered":"2024-04-18T10:38:57.599363+0000","last_clean":"2024-04-18T10:38:57.599363+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:38:57.599363+0000","last_undegraded":"2024-04-18T10:38:57.599363+0000","last_fullsized":"2024-04-18T10:38:57.599363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:47.558311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594519+0000","last_change":"2024-04-18T10:38:48.523774+0000","last_active":"2024-04-18T10:38:55.594519+0000","last_peered":"2024-04-18T10:38:55.594519+0000","last_clean":"2024-04-18T10:38:55.594519+0000","last_became_active":"2024-04-18T10:38:48.518293+0000","last_became_peered":"2024-04-18T10:38:48.518293+0000","last_unstale":"2024-04-18T10:38:55.594519+0000","last_undegraded":"2024-04-18T10:38:55.594519+0000","last_fullsized":"2024-04-18T10:38:55.594519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:51:25.082701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600832+0000","last_change":"2024-04-18T10:38:48.527369+0000","last_active":"2024-04-18T10:38:57.600832+0000","last_peered":"2024-04-18T10:38:57.600832+0000","last_clean":"2024-04-18T10:38:57.600832+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:38:57.600832+0000","last_undegraded":"2024-04-18T10:38:57.600832+0000","last_fullsized":"2024-04-18T10:38:57.600832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:05:08.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599433+0000","last_change":"2024-04-18T10:38:47.514997+0000","last_active":"2024-04-18T10:38:57.599433+0000","last_peered":"2024-04-18T10:38:57.599433+0000","last_clean":"2024-04-18T10:38:57.599433+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:38:57.599433+0000","last_undegraded":"2024-04-18T10:38:57.599433+0000","last_fullsized":"2024-04-18T10:38:57.599433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:28.335154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597802+0000","last_change":"2024-04-18T10:38:48.518698+0000","last_active":"2024-04-18T10:38:57.597802+0000","last_peered":"2024-04-18T10:38:57.597802+0000","last_clean":"2024-04-18T10:38:57.597802+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:38:57.597802+0000","last_undegraded":"2024-04-18T10:38:57.597802+0000","last_fullsized":"2024-04-18T10:38:57.597802+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:42.362882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437375+0000","last_change":"2024-04-18T10:38:48.535465+0000","last_active":"2024-04-18T10:38:57.437375+0000","last_peered":"2024-04-18T10:38:57.437375+0000","last_clean":"2024-04-18T10:38:57.437375+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:38:57.437375+0000","last_undegraded":"2024-04-18T10:38:57.437375+0000","last_fullsized":"2024-04-18T10:38:57.437375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:15:57.026266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436785+0000","last_change":"2024-04-18T10:38:48.536144+0000","last_active":"2024-04-18T10:38:57.436785+0000","last_peered":"2024-04-18T10:38:57.436785+0000","last_clean":"2024-04-18T10:38:57.436785+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:38:57.436785+0000","last_undegraded":"2024-04-18T10:38:57.436785+0000","last_fullsized":"2024-04-18T10:38:57.436785+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:30:36.746569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599270+0000","last_change":"2024-04-18T10:38:46.523917+0000","last_active":"2024-04-18T10:38:57.599270+0000","last_peered":"2024-04-18T10:38:57.599270+0000","last_clean":"2024-04-18T10:38:57.599270+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:38:57.599270+0000","last_undegraded":"2024-04-18T10:38:57.599270+0000","last_fullsized":"2024-04-18T10:38:57.599270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:50:08.234356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594991+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:38:55.594991+0000","last_peered":"2024-04-18T10:38:55.594991+0000","last_clean":"2024-04-18T10:38:55.594991+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:38:55.594991+0000","last_undegraded":"2024-04-18T10:38:55.594991+0000","last_fullsized":"2024-04-18T10:38:55.594991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:36:26.788947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436561+0000","last_change":"2024-04-18T10:38:48.532902+0000","last_active":"2024-04-18T10:38:57.436561+0000","last_peered":"2024-04-18T10:38:57.436561+0000","last_clean":"2024-04-18T10:38:57.436561+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:38:57.436561+0000","last_undegraded":"2024-04-18T10:38:57.436561+0000","last_fullsized":"2024-04-18T10:38:57.436561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:21:05.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437777+0000","last_change":"2024-04-18T10:38:48.538316+0000","last_active":"2024-04-18T10:38:57.437777+0000","last_peered":"2024-04-18T10:38:57.437777+0000","last_clean":"2024-04-18T10:38:57.437777+0000","last_became_active":"2024-04-18T10:38:48.538024+0000","last_became_peered":"2024-04-18T10:38:48.538024+0000","last_unstale":"2024-04-18T10:38:57.437777+0000","last_undegraded":"2024-04-18T10:38:57.437777+0000","last_fullsized":"2024-04-18T10:38:57.437777+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:46:28.843001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437898+0000","last_change":"2024-04-18T10:38:47.515633+0000","last_active":"2024-04-18T10:38:57.437898+0000","last_peered":"2024-04-18T10:38:57.437898+0000","last_clean":"2024-04-18T10:38:57.437898+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:38:57.437898+0000","last_undegraded":"2024-04-18T10:38:57.437898+0000","last_fullsized":"2024-04-18T10:38:57.437898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:29:53.701977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595172+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:38:55.595172+0000","last_peered":"2024-04-18T10:38:55.595172+0000","last_clean":"2024-04-18T10:38:55.595172+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:38:55.595172+0000","last_undegraded":"2024-04-18T10:38:55.595172+0000","last_fullsized":"2024-04-18T10:38:55.595172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:17.044947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'2","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437030+0000","last_change":"2024-04-18T10:38:47.515748+0000","last_active":"2024-04-18T10:38:57.437030+0000","last_peered":"2024-04-18T10:38:57.437030+0000","last_clean":"2024-04-18T10:38:57.437030+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:38:57.437030+0000","last_undegraded":"2024-04-18T10:38:57.437030+0000","last_fullsized":"2024-04-18T10:38:57.437030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:10:22.348842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595924+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:38:55.595924+0000","last_peered":"2024-04-18T10:38:55.595924+0000","last_clean":"2024-04-18T10:38:55.595924+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:38:55.595924+0000","last_undegraded":"2024-04-18T10:38:55.595924+0000","last_fullsized":"2024-04-18T10:38:55.595924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:21:57.410343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436669+0000","last_change":"2024-04-18T10:38:48.531482+0000","last_active":"2024-04-18T10:38:57.436669+0000","last_peered":"2024-04-18T10:38:57.436669+0000","last_clean":"2024-04-18T10:38:57.436669+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:38:57.436669+0000","last_undegraded":"2024-04-18T10:38:57.436669+0000","last_fullsized":"2024-04-18T10:38:57.436669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:13:25.170588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599966+0000","last_change":"2024-04-18T10:38:46.523785+0000","last_active":"2024-04-18T10:38:57.599966+0000","last_peered":"2024-04-18T10:38:57.599966+0000","last_clean":"2024-04-18T10:38:57.599966+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:38:57.599966+0000","last_undegraded":"2024-04-18T10:38:57.599966+0000","last_fullsized":"2024-04-18T10:38:57.599966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:07:03.397909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596147+0000","last_change":"2024-04-18T10:38:48.528981+0000","last_active":"2024-04-18T10:38:55.596147+0000","last_peered":"2024-04-18T10:38:55.596147+0000","last_clean":"2024-04-18T10:38:55.596147+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:38:55.596147+0000","last_undegraded":"2024-04-18T10:38:55.596147+0000","last_fullsized":"2024-04-18T10:38:55.596147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:20:44.914726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596456+0000","last_change":"2024-04-18T10:38:48.526211+0000","last_active":"2024-04-18T10:38:55.596456+0000","last_peered":"2024-04-18T10:38:55.596456+0000","last_clean":"2024-04-18T10:38:55.596456+0000","last_became_active":"2024-04-18T10:38:48.523338+0000","last_became_peered":"2024-04-18T10:38:48.523338+0000","last_unstale":"2024-04-18T10:38:55.596456+0000","last_undegraded":"2024-04-18T10:38:55.596456+0000","last_fullsized":"2024-04-18T10:38:55.596456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:08:11.099172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"20'7","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600858+0000","last_change":"2024-04-18T10:38:48.521507+0000","last_active":"2024-04-18T10:38:57.600858+0000","last_peered":"2024-04-18T10:38:57.600858+0000","last_clean":"2024-04-18T10:38:57.600858+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:38:57.600858+0000","last_undegraded":"2024-04-18T10:38:57.600858+0000","last_fullsized":"2024-04-18T10:38:57.600858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:26:29.367671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594655+0000","last_change":"2024-04-18T10:38:48.528936+0000","last_active":"2024-04-18T10:38:55.594655+0000","last_peered":"2024-04-18T10:38:55.594655+0000","last_clean":"2024-04-18T10:38:55.594655+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:38:55.594655+0000","last_undegraded":"2024-04-18T10:38:55.594655+0000","last_fullsized":"2024-04-18T10:38:55.594655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:03:47.761656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'2","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597724+0000","last_change":"2024-04-18T10:38:48.528847+0000","last_active":"2024-04-18T10:38:57.597724+0000","last_peered":"2024-04-18T10:38:57.597724+0000","last_clean":"2024-04-18T10:38:57.597724+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:38:57.597724+0000","last_undegraded":"2024-04-18T10:38:57.597724+0000","last_fullsized":"2024-04-18T10:38:57.597724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:52:18.159291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595444+0000","last_change":"2024-04-18T10:38:48.525442+0000","last_active":"2024-04-18T10:38:55.595444+0000","last_peered":"2024-04-18T10:38:55.595444+0000","last_clean":"2024-04-18T10:38:55.595444+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:38:55.595444+0000","last_undegraded":"2024-04-18T10:38:55.595444+0000","last_fullsized":"2024-04-18T10:38:55.595444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:01.154765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'4","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599637+0000","last_change":"2024-04-18T10:38:48.529744+0000","last_active":"2024-04-18T10:38:57.599637+0000","last_peered":"2024-04-18T10:38:57.599637+0000","last_clean":"2024-04-18T10:38:57.599637+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:38:57.599637+0000","last_undegraded":"2024-04-18T10:38:57.599637+0000","last_fullsized":"2024-04-18T10:38:57.599637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:07.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437338+0000","last_change":"2024-04-18T10:38:48.530788+0000","last_active":"2024-04-18T10:38:57.437338+0000","last_peered":"2024-04-18T10:38:57.437338+0000","last_clean":"2024-04-18T10:38:57.437338+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:38:57.437338+0000","last_undegraded":"2024-04-18T10:38:57.437338+0000","last_fullsized":"2024-04-18T10:38:57.437338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:34.881473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'19","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.605228+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:38:55.605228+0000","last_peered":"2024-04-18T10:38:55.605228+0000","last_clean":"2024-04-18T10:38:55.605228+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:38:55.605228+0000","last_undegraded":"2024-04-18T10:38:55.605228+0000","last_fullsized":"2024-04-18T10:38:55.605228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:46.735369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5015,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597969+0000","last_change":"2024-04-18T10:38:48.528009+0000","last_active":"2024-04-18T10:38:57.597969+0000","last_peered":"2024-04-18T10:38:57.597969+0000","last_clean":"2024-04-18T10:38:57.597969+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:38:57.597969+0000","last_undegraded":"2024-04-18T10:38:57.597969+0000","last_fullsized":"2024-04-18T10:38:57.597969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:02.092332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'4","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596970+0000","last_change":"2024-04-18T10:38:48.523218+0000","last_active":"2024-04-18T10:38:55.596970+0000","last_peered":"2024-04-18T10:38:55.596970+0000","last_clean":"2024-04-18T10:38:55.596970+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:38:55.596970+0000","last_undegraded":"2024-04-18T10:38:55.596970+0000","last_fullsized":"2024-04-18T10:38:55.596970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:15:59.389767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595917+0000","last_change":"2024-04-18T10:38:48.524990+0000","last_active":"2024-04-18T10:38:55.595917+0000","last_peered":"2024-04-18T10:38:55.595917+0000","last_clean":"2024-04-18T10:38:55.595917+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:38:55.595917+0000","last_undegraded":"2024-04-18T10:38:55.595917+0000","last_fullsized":"2024-04-18T10:38:55.595917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:13:40.543145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'3","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599402+0000","last_change":"2024-04-18T10:38:48.530631+0000","last_active":"2024-04-18T10:38:57.599402+0000","last_peered":"2024-04-18T10:38:57.599402+0000","last_clean":"2024-04-18T10:38:57.599402+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:38:57.599402+0000","last_undegraded":"2024-04-18T10:38:57.599402+0000","last_fullsized":"2024-04-18T10:38:57.599402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:09:37.349194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596030+0000","last_change":"2024-04-18T10:38:48.526748+0000","last_active":"2024-04-18T10:38:55.596030+0000","last_peered":"2024-04-18T10:38:55.596030+0000","last_clean":"2024-04-18T10:38:55.596030+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:38:55.596030+0000","last_undegraded":"2024-04-18T10:38:55.596030+0000","last_fullsized":"2024-04-18T10:38:55.596030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:11.074933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594692+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:38:55.594692+0000","last_peered":"2024-04-18T10:38:55.594692+0000","last_clean":"2024-04-18T10:38:55.594692+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:38:55.594692+0000","last_undegraded":"2024-04-18T10:38:55.594692+0000","last_fullsized":"2024-04-18T10:38:55.594692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:39:56.234231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600035+0000","last_change":"2024-04-18T10:38:48.522750+0000","last_active":"2024-04-18T10:38:57.600035+0000","last_peered":"2024-04-18T10:38:57.600035+0000","last_clean":"2024-04-18T10:38:57.600035+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:38:57.600035+0000","last_undegraded":"2024-04-18T10:38:57.600035+0000","last_fullsized":"2024-04-18T10:38:57.600035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:51.519415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436960+0000","last_change":"2024-04-18T10:38:46.524444+0000","last_active":"2024-04-18T10:38:57.436960+0000","last_peered":"2024-04-18T10:38:57.436960+0000","last_clean":"2024-04-18T10:38:57.436960+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:38:57.436960+0000","last_undegraded":"2024-04-18T10:38:57.436960+0000","last_fullsized":"2024-04-18T10:38:57.436960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:29:31.257203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595943+0000","last_change":"2024-04-18T10:38:48.524076+0000","last_active":"2024-04-18T10:38:55.595943+0000","last_peered":"2024-04-18T10:38:55.595943+0000","last_clean":"2024-04-18T10:38:55.595943+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:38:55.595943+0000","last_undegraded":"2024-04-18T10:38:55.595943+0000","last_fullsized":"2024-04-18T10:38:55.595943+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:58.250235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600703+0000","last_change":"2024-04-18T10:38:46.523417+0000","last_active":"2024-04-18T10:38:57.600703+0000","last_peered":"2024-04-18T10:38:57.600703+0000","last_clean":"2024-04-18T10:38:57.600703+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:38:57.600703+0000","last_undegraded":"2024-04-18T10:38:57.600703+0000","last_fullsized":"2024-04-18T10:38:57.600703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:02:29.079358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594540+0000","last_change":"2024-04-18T10:38:48.528752+0000","last_active":"2024-04-18T10:38:55.594540+0000","last_peered":"2024-04-18T10:38:55.594540+0000","last_clean":"2024-04-18T10:38:55.594540+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:38:55.594540+0000","last_undegraded":"2024-04-18T10:38:55.594540+0000","last_fullsized":"2024-04-18T10:38:55.594540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:31:20.382051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598444+0000","last_change":"2024-04-18T10:38:47.516780+0000","last_active":"2024-04-18T10:38:57.598444+0000","last_peered":"2024-04-18T10:38:57.598444+0000","last_clean":"2024-04-18T10:38:57.598444+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:38:57.598444+0000","last_undegraded":"2024-04-18T10:38:57.598444+0000","last_fullsized":"2024-04-18T10:38:57.598444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:26.639180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436793+0000","last_change":"2024-04-18T10:38:48.537651+0000","last_active":"2024-04-18T10:38:57.436793+0000","last_peered":"2024-04-18T10:38:57.436793+0000","last_clean":"2024-04-18T10:38:57.436793+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:38:57.436793+0000","last_undegraded":"2024-04-18T10:38:57.436793+0000","last_fullsized":"2024-04-18T10:38:57.436793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:18.675030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594950+0000","last_change":"2024-04-18T10:38:48.528245+0000","last_active":"2024-04-18T10:38:55.594950+0000","last_peered":"2024-04-18T10:38:55.594950+0000","last_clean":"2024-04-18T10:38:55.594950+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:38:55.594950+0000","last_undegraded":"2024-04-18T10:38:55.594950+0000","last_fullsized":"2024-04-18T10:38:55.594950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:52.532246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598611+0000","last_change":"2024-04-18T10:38:48.528767+0000","last_active":"2024-04-18T10:38:57.598611+0000","last_peered":"2024-04-18T10:38:57.598611+0000","last_clean":"2024-04-18T10:38:57.598611+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:38:57.598611+0000","last_undegraded":"2024-04-18T10:38:57.598611+0000","last_fullsized":"2024-04-18T10:38:57.598611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:31:30.566152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599462+0000","last_change":"2024-04-18T10:38:48.527940+0000","last_active":"2024-04-18T10:38:57.599462+0000","last_peered":"2024-04-18T10:38:57.599462+0000","last_clean":"2024-04-18T10:38:57.599462+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:38:57.599462+0000","last_undegraded":"2024-04-18T10:38:57.599462+0000","last_fullsized":"2024-04-18T10:38:57.599462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:28.013331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599844+0000","last_change":"2024-04-18T10:38:46.522705+0000","last_active":"2024-04-18T10:38:57.599844+0000","last_peered":"2024-04-18T10:38:57.599844+0000","last_clean":"2024-04-18T10:38:57.599844+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:38:57.599844+0000","last_undegraded":"2024-04-18T10:38:57.599844+0000","last_fullsized":"2024-04-18T10:38:57.599844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:23:44.645859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"36'5","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596305+0000","last_change":"2024-04-18T10:38:48.523093+0000","last_active":"2024-04-18T10:38:55.596305+0000","last_peered":"2024-04-18T10:38:55.596305+0000","last_clean":"2024-04-18T10:38:55.596305+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:38:55.596305+0000","last_undegraded":"2024-04-18T10:38:55.596305+0000","last_fullsized":"2024-04-18T10:38:55.596305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:20.206383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599559+0000","last_change":"2024-04-18T10:38:48.528094+0000","last_active":"2024-04-18T10:38:57.599559+0000","last_peered":"2024-04-18T10:38:57.599559+0000","last_clean":"2024-04-18T10:38:57.599559+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:38:57.599559+0000","last_undegraded":"2024-04-18T10:38:57.599559+0000","last_fullsized":"2024-04-18T10:38:57.599559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:02.429215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"20'4","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594760+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:38:55.594760+0000","last_peered":"2024-04-18T10:38:55.594760+0000","last_clean":"2024-04-18T10:38:55.594760+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:38:55.594760+0000","last_undegraded":"2024-04-18T10:38:55.594760+0000","last_fullsized":"2024-04-18T10:38:55.594760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:47:34.182153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595528+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:38:55.595528+0000","last_peered":"2024-04-18T10:38:55.595528+0000","last_clean":"2024-04-18T10:38:55.595528+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:38:55.595528+0000","last_undegraded":"2024-04-18T10:38:55.595528+0000","last_fullsized":"2024-04-18T10:38:55.595528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:08.173779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'3","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595688+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:38:55.595688+0000","last_peered":"2024-04-18T10:38:55.595688+0000","last_clean":"2024-04-18T10:38:55.595688+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:38:55.595688+0000","last_undegraded":"2024-04-18T10:38:55.595688+0000","last_fullsized":"2024-04-18T10:38:55.595688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:04.645176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598384+0000","last_change":"2024-04-18T10:38:48.528656+0000","last_active":"2024-04-18T10:38:57.598384+0000","last_peered":"2024-04-18T10:38:57.598384+0000","last_clean":"2024-04-18T10:38:57.598384+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:38:57.598384+0000","last_undegraded":"2024-04-18T10:38:57.598384+0000","last_fullsized":"2024-04-18T10:38:57.598384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:53.065322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594409+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:38:55.594409+0000","last_peered":"2024-04-18T10:38:55.594409+0000","last_clean":"2024-04-18T10:38:55.594409+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:38:55.594409+0000","last_undegraded":"2024-04-18T10:38:55.594409+0000","last_fullsized":"2024-04-18T10:38:55.594409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:06:10.188847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.438007+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:38:57.438007+0000","last_peered":"2024-04-18T10:38:57.438007+0000","last_clean":"2024-04-18T10:38:57.438007+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:38:57.438007+0000","last_undegraded":"2024-04-18T10:38:57.438007+0000","last_fullsized":"2024-04-18T10:38:57.438007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:39:47.463040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437259+0000","last_change":"2024-04-18T10:38:46.521667+0000","last_active":"2024-04-18T10:38:57.437259+0000","last_peered":"2024-04-18T10:38:57.437259+0000","last_clean":"2024-04-18T10:38:57.437259+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:38:57.437259+0000","last_undegraded":"2024-04-18T10:38:57.437259+0000","last_fullsized":"2024-04-18T10:38:57.437259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:58:33.365320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'1","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597694+0000","last_change":"2024-04-18T10:38:48.518724+0000","last_active":"2024-04-18T10:38:57.597694+0000","last_peered":"2024-04-18T10:38:57.597694+0000","last_clean":"2024-04-18T10:38:57.597694+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:38:57.597694+0000","last_undegraded":"2024-04-18T10:38:57.597694+0000","last_fullsized":"2024-04-18T10:38:57.597694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:42.824622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437142+0000","last_change":"2024-04-18T10:38:48.529610+0000","last_active":"2024-04-18T10:38:57.437142+0000","last_peered":"2024-04-18T10:38:57.437142+0000","last_clean":"2024-04-18T10:38:57.437142+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:38:57.437142+0000","last_undegraded":"2024-04-18T10:38:57.437142+0000","last_fullsized":"2024-04-18T10:38:57.437142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:22:33.897416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594876+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:38:55.594876+0000","last_peered":"2024-04-18T10:38:55.594876+0000","last_clean":"2024-04-18T10:38:55.594876+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:38:55.594876+0000","last_undegraded":"2024-04-18T10:38:55.594876+0000","last_fullsized":"2024-04-18T10:38:55.594876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:33.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"20'3","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599757+0000","last_change":"2024-04-18T10:38:47.513344+0000","last_active":"2024-04-18T10:38:57.599757+0000","last_peered":"2024-04-18T10:38:57.599757+0000","last_clean":"2024-04-18T10:38:57.599757+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:38:57.599757+0000","last_undegraded":"2024-04-18T10:38:57.599757+0000","last_fullsized":"2024-04-18T10:38:57.599757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:48.441734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437439+0000","last_change":"2024-04-18T10:38:47.515107+0000","last_active":"2024-04-18T10:38:57.437439+0000","last_peered":"2024-04-18T10:38:57.437439+0000","last_clean":"2024-04-18T10:38:57.437439+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:38:57.437439+0000","last_undegraded":"2024-04-18T10:38:57.437439+0000","last_fullsized":"2024-04-18T10:38:57.437439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:10:14.119655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598526+0000","last_change":"2024-04-18T10:38:48.520896+0000","last_active":"2024-04-18T10:38:57.598526+0000","last_peered":"2024-04-18T10:38:57.598526+0000","last_clean":"2024-04-18T10:38:57.598526+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:38:57.598526+0000","last_undegraded":"2024-04-18T10:38:57.598526+0000","last_fullsized":"2024-04-18T10:38:57.598526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:57:03.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'1","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437086+0000","last_change":"2024-04-18T10:38:47.519693+0000","last_active":"2024-04-18T10:38:57.437086+0000","last_peered":"2024-04-18T10:38:57.437086+0000","last_clean":"2024-04-18T10:38:57.437086+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:38:57.437086+0000","last_undegraded":"2024-04-18T10:38:57.437086+0000","last_fullsized":"2024-04-18T10:38:57.437086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:34.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437875+0000","last_change":"2024-04-18T10:38:46.520198+0000","last_active":"2024-04-18T10:38:57.437875+0000","last_peered":"2024-04-18T10:38:57.437875+0000","last_clean":"2024-04-18T10:38:57.437875+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:38:57.437875+0000","last_undegraded":"2024-04-18T10:38:57.437875+0000","last_fullsized":"2024-04-18T10:38:57.437875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:18:11.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.596159+0000","last_change":"2024-04-18T10:38:48.522906+0000","last_active":"2024-04-18T10:38:55.596159+0000","last_peered":"2024-04-18T10:38:55.596159+0000","last_clean":"2024-04-18T10:38:55.596159+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:38:55.596159+0000","last_undegraded":"2024-04-18T10:38:55.596159+0000","last_fullsized":"2024-04-18T10:38:55.596159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:14.552416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'115","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.436498+0000","last_change":"2024-04-18T10:38:46.507608+0000","last_active":"2024-04-18T10:38:57.436498+0000","last_peered":"2024-04-18T10:38:57.436498+0000","last_clean":"2024-04-18T10:38:57.436498+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:38:57.436498+0000","last_undegraded":"2024-04-18T10:38:57.436498+0000","last_fullsized":"2024-04-18T10:38:57.436498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:46:55.362151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595397+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:38:55.595397+0000","last_peered":"2024-04-18T10:38:55.595397+0000","last_clean":"2024-04-18T10:38:55.595397+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:38:55.595397+0000","last_undegraded":"2024-04-18T10:38:55.595397+0000","last_fullsized":"2024-04-18T10:38:55.595397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:23.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595410+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:38:55.595410+0000","last_peered":"2024-04-18T10:38:55.595410+0000","last_clean":"2024-04-18T10:38:55.595410+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:38:55.595410+0000","last_undegraded":"2024-04-18T10:38:55.595410+0000","last_fullsized":"2024-04-18T10:38:55.595410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:03.109484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594380+0000","last_change":"2024-04-18T10:38:48.529162+0000","last_active":"2024-04-18T10:38:55.594380+0000","last_peered":"2024-04-18T10:38:55.594380+0000","last_clean":"2024-04-18T10:38:55.594380+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:38:55.594380+0000","last_undegraded":"2024-04-18T10:38:55.594380+0000","last_fullsized":"2024-04-18T10:38:55.594380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:18:10.267046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'1","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599182+0000","last_change":"2024-04-18T10:38:47.513300+0000","last_active":"2024-04-18T10:38:57.599182+0000","last_peered":"2024-04-18T10:38:57.599182+0000","last_clean":"2024-04-18T10:38:57.599182+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:38:57.599182+0000","last_undegraded":"2024-04-18T10:38:57.599182+0000","last_fullsized":"2024-04-18T10:38:57.599182+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:38:14.658997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599902+0000","last_change":"2024-04-18T10:38:46.523777+0000","last_active":"2024-04-18T10:38:57.599902+0000","last_peered":"2024-04-18T10:38:57.599902+0000","last_clean":"2024-04-18T10:38:57.599902+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:38:57.599902+0000","last_undegraded":"2024-04-18T10:38:57.599902+0000","last_fullsized":"2024-04-18T10:38:57.599902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:03:13.518817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595627+0000","last_change":"2024-04-18T10:38:48.526577+0000","last_active":"2024-04-18T10:38:55.595627+0000","last_peered":"2024-04-18T10:38:55.595627+0000","last_clean":"2024-04-18T10:38:55.595627+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:38:55.595627+0000","last_undegraded":"2024-04-18T10:38:55.595627+0000","last_fullsized":"2024-04-18T10:38:55.595627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:34:26.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437526+0000","last_change":"2024-04-18T10:38:47.515422+0000","last_active":"2024-04-18T10:38:57.437526+0000","last_peered":"2024-04-18T10:38:57.437526+0000","last_clean":"2024-04-18T10:38:57.437526+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:38:57.437526+0000","last_undegraded":"2024-04-18T10:38:57.437526+0000","last_fullsized":"2024-04-18T10:38:57.437526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.811949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600090+0000","last_change":"2024-04-18T10:38:47.513292+0000","last_active":"2024-04-18T10:38:57.600090+0000","last_peered":"2024-04-18T10:38:57.600090+0000","last_clean":"2024-04-18T10:38:57.600090+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:38:57.600090+0000","last_undegraded":"2024-04-18T10:38:57.600090+0000","last_fullsized":"2024-04-18T10:38:57.600090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:35.308701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'4","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.610178+0000","last_change":"2024-04-18T10:38:48.525344+0000","last_active":"2024-04-18T10:38:55.610178+0000","last_peered":"2024-04-18T10:38:55.610178+0000","last_clean":"2024-04-18T10:38:55.610178+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:38:55.610178+0000","last_undegraded":"2024-04-18T10:38:55.610178+0000","last_fullsized":"2024-04-18T10:38:55.610178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:13:06.871047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437912+0000","last_change":"2024-04-18T10:38:46.521665+0000","last_active":"2024-04-18T10:38:57.437912+0000","last_peered":"2024-04-18T10:38:57.437912+0000","last_clean":"2024-04-18T10:38:57.437912+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:38:57.437912+0000","last_undegraded":"2024-04-18T10:38:57.437912+0000","last_fullsized":"2024-04-18T10:38:57.437912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:14:41.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594641+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:38:55.594641+0000","last_peered":"2024-04-18T10:38:55.594641+0000","last_clean":"2024-04-18T10:38:55.594641+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:38:55.594641+0000","last_undegraded":"2024-04-18T10:38:55.594641+0000","last_fullsized":"2024-04-18T10:38:55.594641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:16.195736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595820+0000","last_change":"2024-04-18T10:38:48.519133+0000","last_active":"2024-04-18T10:38:55.595820+0000","last_peered":"2024-04-18T10:38:55.595820+0000","last_clean":"2024-04-18T10:38:55.595820+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:38:55.595820+0000","last_undegraded":"2024-04-18T10:38:55.595820+0000","last_fullsized":"2024-04-18T10:38:55.595820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:47.684869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600029+0000","last_change":"2024-04-18T10:38:46.523957+0000","last_active":"2024-04-18T10:38:57.600029+0000","last_peered":"2024-04-18T10:38:57.600029+0000","last_clean":"2024-04-18T10:38:57.600029+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:38:57.600029+0000","last_undegraded":"2024-04-18T10:38:57.600029+0000","last_fullsized":"2024-04-18T10:38:57.600029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:49.311603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597695+0000","last_change":"2024-04-18T10:38:48.520854+0000","last_active":"2024-04-18T10:38:57.597695+0000","last_peered":"2024-04-18T10:38:57.597695+0000","last_clean":"2024-04-18T10:38:57.597695+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:38:57.597695+0000","last_undegraded":"2024-04-18T10:38:57.597695+0000","last_fullsized":"2024-04-18T10:38:57.597695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:27.953816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'11","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600211+0000","last_change":"2024-04-18T10:38:48.527898+0000","last_active":"2024-04-18T10:38:57.600211+0000","last_peered":"2024-04-18T10:38:57.600211+0000","last_clean":"2024-04-18T10:38:57.600211+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:38:57.600211+0000","last_undegraded":"2024-04-18T10:38:57.600211+0000","last_fullsized":"2024-04-18T10:38:57.600211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:35:58.649968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598510+0000","last_change":"2024-04-18T10:38:47.514434+0000","last_active":"2024-04-18T10:38:57.598510+0000","last_peered":"2024-04-18T10:38:57.598510+0000","last_clean":"2024-04-18T10:38:57.598510+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:38:57.598510+0000","last_undegraded":"2024-04-18T10:38:57.598510+0000","last_fullsized":"2024-04-18T10:38:57.598510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:22:40.288392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437024+0000","last_change":"2024-04-18T10:38:46.520352+0000","last_active":"2024-04-18T10:38:57.437024+0000","last_peered":"2024-04-18T10:38:57.437024+0000","last_clean":"2024-04-18T10:38:57.437024+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:38:57.437024+0000","last_undegraded":"2024-04-18T10:38:57.437024+0000","last_fullsized":"2024-04-18T10:38:57.437024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:55:53.724349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598060+0000","last_change":"2024-04-18T10:38:48.528181+0000","last_active":"2024-04-18T10:38:57.598060+0000","last_peered":"2024-04-18T10:38:57.598060+0000","last_clean":"2024-04-18T10:38:57.598060+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:38:57.598060+0000","last_undegraded":"2024-04-18T10:38:57.598060+0000","last_fullsized":"2024-04-18T10:38:57.598060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:38.920913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.604724+0000","last_change":"2024-04-18T10:38:48.526382+0000","last_active":"2024-04-18T10:38:55.604724+0000","last_peered":"2024-04-18T10:38:55.604724+0000","last_clean":"2024-04-18T10:38:55.604724+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:38:55.604724+0000","last_undegraded":"2024-04-18T10:38:55.604724+0000","last_fullsized":"2024-04-18T10:38:55.604724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:36:19.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.598409+0000","last_change":"2024-04-18T10:38:48.520427+0000","last_active":"2024-04-18T10:38:57.598409+0000","last_peered":"2024-04-18T10:38:57.598409+0000","last_clean":"2024-04-18T10:38:57.598409+0000","last_became_active":"2024-04-18T10:38:48.520005+0000","last_became_peered":"2024-04-18T10:38:48.520005+0000","last_unstale":"2024-04-18T10:38:57.598409+0000","last_undegraded":"2024-04-18T10:38:57.598409+0000","last_fullsized":"2024-04-18T10:38:57.598409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:58:06.664607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"36'2","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.594905+0000","last_change":"2024-04-18T10:38:48.521841+0000","last_active":"2024-04-18T10:38:55.594905+0000","last_peered":"2024-04-18T10:38:55.594905+0000","last_clean":"2024-04-18T10:38:55.594905+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:38:55.594905+0000","last_undegraded":"2024-04-18T10:38:55.594905+0000","last_fullsized":"2024-04-18T10:38:55.594905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:44:53.826636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595112+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:38:55.595112+0000","last_peered":"2024-04-18T10:38:55.595112+0000","last_clean":"2024-04-18T10:38:55.595112+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:38:55.595112+0000","last_undegraded":"2024-04-18T10:38:55.595112+0000","last_fullsized":"2024-04-18T10:38:55.595112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:44.601528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'5","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.600709+0000","last_change":"2024-04-18T10:38:46.523460+0000","last_active":"2024-04-18T10:38:57.600709+0000","last_peered":"2024-04-18T10:38:57.600709+0000","last_clean":"2024-04-18T10:38:57.600709+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:38:57.600709+0000","last_undegraded":"2024-04-18T10:38:57.600709+0000","last_fullsized":"2024-04-18T10:38:57.600709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:33.163273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.597490+0000","last_change":"2024-04-18T10:38:47.514386+0000","last_active":"2024-04-18T10:38:57.597490+0000","last_peered":"2024-04-18T10:38:57.597490+0000","last_clean":"2024-04-18T10:38:57.597490+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:38:57.597490+0000","last_undegraded":"2024-04-18T10:38:57.597490+0000","last_fullsized":"2024-04-18T10:38:57.597490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:25.189215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437026+0000","last_change":"2024-04-18T10:38:47.515056+0000","last_active":"2024-04-18T10:38:57.437026+0000","last_peered":"2024-04-18T10:38:57.437026+0000","last_clean":"2024-04-18T10:38:57.437026+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:38:57.437026+0000","last_undegraded":"2024-04-18T10:38:57.437026+0000","last_fullsized":"2024-04-18T10:38:57.437026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:09:39.192070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.595328+0000","last_change":"2024-04-18T10:38:48.526620+0000","last_active":"2024-04-18T10:38:55.595328+0000","last_peered":"2024-04-18T10:38:55.595328+0000","last_clean":"2024-04-18T10:38:55.595328+0000","last_became_active":"2024-04-18T10:38:48.526335+0000","last_became_peered":"2024-04-18T10:38:48.526335+0000","last_unstale":"2024-04-18T10:38:55.595328+0000","last_undegraded":"2024-04-18T10:38:55.595328+0000","last_fullsized":"2024-04-18T10:38:55.595328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:30:36.594870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.599959+0000","last_change":"2024-04-18T10:38:48.530823+0000","last_active":"2024-04-18T10:38:57.599959+0000","last_peered":"2024-04-18T10:38:57.599959+0000","last_clean":"2024-04-18T10:38:57.599959+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:38:57.599959+0000","last_undegraded":"2024-04-18T10:38:57.599959+0000","last_fullsized":"2024-04-18T10:38:57.599959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:17.039853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-18T10:38:55.597517+0000","last_change":"2024-04-18T10:38:48.528090+0000","last_active":"2024-04-18T10:38:55.597517+0000","last_peered":"2024-04-18T10:38:55.597517+0000","last_clean":"2024-04-18T10:38:55.597517+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:38:55.597517+0000","last_undegraded":"2024-04-18T10:38:55.597517+0000","last_fullsized":"2024-04-18T10:38:55.597517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:18:27.052176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-18T10:38:57.437482+0000","last_change":"2024-04-18T10:38:47.515405+0000","last_active":"2024-04-18T10:38:57.437482+0000","last_peered":"2024-04-18T10:38:57.437482+0000","last_clean":"2024-04-18T10:38:57.437482+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:38:57.437482+0000","last_undegraded":"2024-04-18T10:38:57.437482+0000","last_fullsized":"2024-04-18T10:38:57.437482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:31.550014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8783,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":49,"num_read_kb":55,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953476,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":372,"kb_used_omap":13,"kb_used_meta":297138,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":380928,"data_stored":153396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":304270073},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]}]},{"osd":2,"up_from":31,"seq":133143986180,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":360,"kb_used_omap":7,"kb_used_meta":297080,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":368640,"data_stored":159267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":304210711},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]}]},{"osd":0,"up_from":29,"seq":124554051589,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302276,"kb_used_data":948,"kb_used_omap":17,"kb_used_meta":301294,"kb_avail":94069564,"statfs":{"total":96636764160,"available":96327233536,"internally_reserved":0,"allocated":970752,"data_stored":748094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":308525370},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":1,"up_from":30,"seq":128849018885,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302188,"kb_used_data":920,"kb_used_omap":6,"kb_used_meta":301241,"kb_avail":94069652,"statfs":{"total":96636764160,"available":96327323648,"internally_reserved":0,"allocated":942080,"data_stored":740687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308471765},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":8208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:39:02.320 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T10:39:02.320 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-18T10:39:02.320 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-18T10:39:02.320 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-18T10:39:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f45410ed700 1 Processor -- start 2024-04-18T10:39:02.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f45410ed700 1 -- start start 2024-04-18T10:39:02.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f45410ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c069200 0x7f453c0a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f45410ed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f453c144930 0x7f453c146d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f45410ed700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c13c1b0 con 0x7f453c0a6070 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f45410ed700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c13bfc0 con 0x7f453c144930 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f45410ed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c13c470 con 0x7f453c069200 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f453b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f453c144930 0x7f453c146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f453ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c069200 0x7f453c0a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f453b59e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f453c144930 0x7f453c146d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54510/0 (socket says 172.21.15.31:54510) 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f453ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c069200 0x7f453c0a3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54058/0 (socket says 172.21.15.31:54058) 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f453b59e700 1 -- 172.21.15.31:0/2282821013 learned_addr learned my addr 172.21.15.31:0/2282821013 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f453a59c700 1 --1- 172.21.15.31:0/2282821013 >> v1:172.21.15.31:6789/0 conn(0x7f453c0a6070 0x7f453c13c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53360/0 (socket says 172.21.15.31:53360) 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f453ad9d700 1 -- 172.21.15.31:0/2282821013 >> v2:172.21.15.31:3300/0 conn(0x7f453c144930 msgr2=0x7f453c146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f453ad9d700 1 --2- 172.21.15.31:0/2282821013 >> v2:172.21.15.31:3300/0 conn(0x7f453c144930 0x7f453c146d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f453ad9d700 1 -- 172.21.15.31:0/2282821013 >> v1:172.21.15.31:6789/0 conn(0x7f453c0a6070 legacy=0x7f453c13c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f453ad9d700 1 -- 172.21.15.31:0/2282821013 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c0a4a40 con 0x7f453c069200 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.476+0000 7f4539d9b700 1 -- 172.21.15.31:0/2282821013 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804951228 0 0) 0x7f453c13c1b0 con 0x7f453c0a6070 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f453b59e700 1 --2- 172.21.15.31:0/2282821013 >> v2:172.21.15.31:3300/0 conn(0x7f453c144930 0x7f453c146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f453ad9d700 1 --2- 172.21.15.31:0/2282821013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c069200 0x7f453c0a3e70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45240098e0 tx=0x7f45240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35a6d30fe08238 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f4539d9b700 1 -- 172.21.15.31:0/2282821013 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400b640 con 0x7f453c069200 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f4539d9b700 1 -- 172.21.15.31:0/2282821013 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452400b7a0 con 0x7f453c069200 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f4539d9b700 1 -- 172.21.15.31:0/2282821013 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400bb40 con 0x7f453c069200 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f45410ed700 1 -- 172.21.15.31:0/2282821013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c069200 msgr2=0x7f453c0a3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f45410ed700 1 --2- 172.21.15.31:0/2282821013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c069200 0x7f453c0a3e70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f45240098e0 tx=0x7f45240091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f45410ed700 1 -- 172.21.15.31:0/2282821013 shutdown_connections 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f45410ed700 1 --2- 172.21.15.31:0/2282821013 >> v2:172.21.15.31:3300/0 conn(0x7f453c144930 0x7f453c146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f45410ed700 1 --2- 172.21.15.31:0/2282821013 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c069200 0x7f453c0a3e70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f45410ed700 1 -- 172.21.15.31:0/2282821013 >> 172.21.15.31:0/2282821013 conn(0x7f453c06ae80 msgr2=0x7f453c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f45410ed700 1 -- 172.21.15.31:0/2282821013 shutdown_connections 2024-04-18T10:39:02.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.477+0000 7f45410ed700 1 -- 172.21.15.31:0/2282821013 wait complete. 2024-04-18T10:39:02.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.478+0000 7f45410ed700 1 Processor -- start 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f45410ed700 1 -- start start 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f45410ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f453c069200 0x7f453c13ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f45410ed700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f453c0a6070 0x7f453c13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f45410ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c144930 0x7f453c151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f45410ed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c151660 con 0x7f453c069200 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f45410ed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c13dde0 con 0x7f453c144930 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f45410ed700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f453c13ef80 con 0x7f453c0a6070 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f453ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f453c069200 0x7f453c13ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f453b59e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c144930 0x7f453c151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f453a59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f453c0a6070 0x7f453c13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f453ad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f453c069200 0x7f453c13ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54514/0 (socket says 172.21.15.31:54514) 2024-04-18T10:39:02.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f453ad9d700 1 -- 172.21.15.31:0/3714714203 learned_addr learned my addr 172.21.15.31:0/3714714203 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f453b59e700 1 -- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f453c0a6070 msgr2=0x7f453c13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f453b59e700 1 --2- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f453c0a6070 0x7f453c13fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.479+0000 7f453b59e700 1 -- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f453c069200 msgr2=0x7f453c13ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.480+0000 7f453b59e700 1 --2- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f453c069200 0x7f453c13ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.480+0000 7f453b59e700 1 -- 172.21.15.31:0/3714714203 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534009ae0 con 0x7f453c144930 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.480+0000 7f453ad9d700 1 --2- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f453c069200 0x7f453c13ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.480+0000 7f453b59e700 1 --2- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c144930 0x7f453c151890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4534009e40 tx=0x7f453400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.480+0000 7f4532ffd700 1 -- 172.21.15.31:0/3714714203 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453400c920 con 0x7f453c144930 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.480+0000 7f4532ffd700 1 -- 172.21.15.31:0/3714714203 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453400f040 con 0x7f453c144930 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.480+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4524009420 con 0x7f453c144930 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.480+0000 7f4532ffd700 1 -- 172.21.15.31:0/3714714203 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453400ccf0 con 0x7f453c144930 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.480+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c13d420 con 0x7f453c144930 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.481+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c13df50 con 0x7f453c144930 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.481+0000 7f4532ffd700 1 -- 172.21.15.31:0/3714714203 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f4534014690 con 0x7f453c144930 2024-04-18T10:39:02.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.481+0000 7f4532ffd700 1 -- 172.21.15.31:0/3714714203 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f453405b840 con 0x7f453c144930 2024-04-18T10:39:02.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.485+0000 7f4532ffd700 1 -- 172.21.15.31:0/3714714203 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4534039950 con 0x7f453c144930 2024-04-18T10:39:02.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.677+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f453c0651b0 con 0x7f453c144930 2024-04-18T10:39:02.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.677+0000 7f4532ffd700 1 -- 172.21.15.31:0/3714714203 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f453403d140 con 0x7f453c144930 2024-04-18T10:39:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:39:02.678 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-18T10:39:02.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 >> v1:172.21.15.31:6816/46601 conn(0x7f451c046010 legacy=0x7f451c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c144930 msgr2=0x7f453c151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 --2- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c144930 0x7f453c151890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4534009e40 tx=0x7f453400b040 comp rx=0 tx=0).stop 2024-04-18T10:39:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 shutdown_connections 2024-04-18T10:39:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 --2- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f453c144930 0x7f453c151890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 --2- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f453c069200 0x7f453c13ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 --2- 172.21.15.31:0/3714714203 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f453c0a6070 0x7f453c13fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 >> 172.21.15.31:0/3714714203 conn(0x7f453c06ae80 msgr2=0x7f453c0b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 shutdown_connections 2024-04-18T10:39:02.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.679+0000 7f45410ed700 1 -- 172.21.15.31:0/3714714203 wait complete. 2024-04-18T10:39:02.691 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-18T10:39:02.691 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:39:02.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23dda2700 1 Processor -- start 2024-04-18T10:39:02.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23dda2700 1 -- start start 2024-04-18T10:39:02.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23dda2700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2380ab730 0x7fa23806a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23dda2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 0x7fa23813eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23dda2700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23813e410 con 0x7fa2380b2d90 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23dda2700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23813bdf0 con 0x7fa2380ab730 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23dda2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa238069bd0 con 0x7fa23813e670 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa237fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2380ab730 0x7fa23806a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23d5a1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 0x7fa23813eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23cda0700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa2380b2d90 0x7fa23806a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53372/0 (socket says 172.21.15.31:53372) 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23cda0700 1 -- 172.21.15.31:0/407754531 learned_addr learned my addr 172.21.15.31:0/407754531 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa237fff700 1 -- 172.21.15.31:0/407754531 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 msgr2=0x7fa23813eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa237fff700 1 --2- 172.21.15.31:0/407754531 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 0x7fa23813eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa237fff700 1 -- 172.21.15.31:0/407754531 >> v1:172.21.15.31:6789/0 conn(0x7fa2380b2d90 legacy=0x7fa23806a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa237fff700 1 -- 172.21.15.31:0/407754531 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380692d0 con 0x7fa2380ab730 2024-04-18T10:39:02.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa2377fe700 1 -- 172.21.15.31:0/407754531 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312526428 0 0) 0x7fa23813e410 con 0x7fa2380b2d90 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa23d5a1700 1 --2- 172.21.15.31:0/407754531 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 0x7fa23813eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa237fff700 1 --2- 172.21.15.31:0/407754531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 0x7fa23806a780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa2240098e0 tx=0x7fa2240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c33654c33d593 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa2377fe700 1 -- 172.21.15.31:0/407754531 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400b640 con 0x7fa2380ab730 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa2377fe700 1 -- 172.21.15.31:0/407754531 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22400b7a0 con 0x7fa2380ab730 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.812+0000 7fa2377fe700 1 -- 172.21.15.31:0/407754531 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400bb40 con 0x7fa2380ab730 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.813+0000 7fa23dda2700 1 -- 172.21.15.31:0/407754531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 msgr2=0x7fa23806a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.813+0000 7fa23dda2700 1 --2- 172.21.15.31:0/407754531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 0x7fa23806a780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa2240098e0 tx=0x7fa2240091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.813+0000 7fa23dda2700 1 -- 172.21.15.31:0/407754531 shutdown_connections 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.813+0000 7fa23dda2700 1 --2- 172.21.15.31:0/407754531 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 0x7fa23813eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.813+0000 7fa23dda2700 1 --2- 172.21.15.31:0/407754531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 0x7fa23806a780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.813+0000 7fa23dda2700 1 -- 172.21.15.31:0/407754531 >> 172.21.15.31:0/407754531 conn(0x7fa23806dcb0 msgr2=0x7fa23806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.813+0000 7fa23dda2700 1 -- 172.21.15.31:0/407754531 shutdown_connections 2024-04-18T10:39:02.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.813+0000 7fa23dda2700 1 -- 172.21.15.31:0/407754531 wait complete. 2024-04-18T10:39:02.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.814+0000 7fa23dda2700 1 Processor -- start 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.814+0000 7fa23dda2700 1 -- start start 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.814+0000 7fa23dda2700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 0x7fa238142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.814+0000 7fa23dda2700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2380b2d90 0x7fa238151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.814+0000 7fa23dda2700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 0x7fa238151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.814+0000 7fa23dda2700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa238144730 con 0x7fa2380ab730 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.814+0000 7fa23dda2700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa238145610 con 0x7fa2380b2d90 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.814+0000 7fa23dda2700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa238145d30 con 0x7fa23813e670 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23cda0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 0x7fa238142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23cda0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 0x7fa238142da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54530/0 (socket says 172.21.15.31:54530) 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23cda0700 1 -- 172.21.15.31:0/2660963592 learned_addr learned my addr 172.21.15.31:0/2660963592 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa237fff700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2380b2d90 0x7fa238151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23d5a1700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 0x7fa238151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23cda0700 1 -- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 msgr2=0x7fa238151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23cda0700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 0x7fa238151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23cda0700 1 -- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2380b2d90 msgr2=0x7fa238151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23cda0700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2380b2d90 0x7fa238151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23cda0700 1 -- 172.21.15.31:0/2660963592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230009a20 con 0x7fa2380ab730 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa237fff700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2380b2d90 0x7fa238151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23cda0700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 0x7fa238142da0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c810 tx=0x7fa22c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa234ff9700 1 -- 172.21.15.31:0/2660963592 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c005c00 con 0x7fa2380ab730 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa234ff9700 1 -- 172.21.15.31:0/2660963592 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c005d60 con 0x7fa2380ab730 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa224009420 con 0x7fa2380ab730 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa234ff9700 1 -- 172.21.15.31:0/2660963592 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c007320 con 0x7fa2380ab730 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.815+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23806bd80 con 0x7fa2380ab730 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.816+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2380651b0 con 0x7fa2380ab730 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.816+0000 7fa234ff9700 1 -- 172.21.15.31:0/2660963592 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fa22c01b3b0 con 0x7fa2380ab730 2024-04-18T10:39:02.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.817+0000 7fa234ff9700 1 -- 172.21.15.31:0/2660963592 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fa22c05a5c0 con 0x7fa2380ab730 2024-04-18T10:39:02.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.821+0000 7fa234ff9700 1 -- 172.21.15.31:0/2660963592 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fa22c038840 con 0x7fa2380ab730 2024-04-18T10:39:02.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.986+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa238069040 con 0x7fa2380ab730 2024-04-18T10:39:02.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.986+0000 7fa234ff9700 1 -- 172.21.15.31:0/2660963592 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11635 (secure 0 0 0) 0x7fa22c017070 con 0x7fa2380ab730 2024-04-18T10:39:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:39:02.987 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":41,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:58.600312+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 >> v1:172.21.15.31:6816/46601 conn(0x7fa21c046040 legacy=0x7fa21c0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 msgr2=0x7fa238142da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 0x7fa238142da0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00c810 tx=0x7fa22c007d90 comp rx=0 tx=0).stop 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 shutdown_connections 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa23813e670 0x7fa238151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2380ab730 0x7fa238142da0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 --2- 172.21.15.31:0/2660963592 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa2380b2d90 0x7fa238151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 >> 172.21.15.31:0/2660963592 conn(0x7fa23806dcb0 msgr2=0x7fa23806e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 shutdown_connections 2024-04-18T10:39:02.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:02.988+0000 7fa23dda2700 1 -- 172.21.15.31:0/2660963592 wait complete. 2024-04-18T10:39:03.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:39:03.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:39:03.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e26d69700 1 Processor -- start 2024-04-18T10:39:03.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e26d69700 1 -- start start 2024-04-18T10:39:03.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e26d69700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a24f0 0x7f5e200a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e26d69700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a49a0 0x7f5e20141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e26d69700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e200a3c80 con 0x7f5e200a31e0 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e26d69700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2006da50 con 0x7f5e200a49a0 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e26d69700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2006dd10 con 0x7f5e200a24f0 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e24b05700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a24f0 0x7f5e200a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a49a0 0x7f5e20141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e25306700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5e200a31e0 0x7f5e20144010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53374/0 (socket says 172.21.15.31:53374) 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e25306700 1 -- 172.21.15.31:0/1605539660 learned_addr learned my addr 172.21.15.31:0/1605539660 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e1ffff700 1 -- 172.21.15.31:0/1605539660 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a24f0 msgr2=0x7f5e200a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e1ffff700 1 --2- 172.21.15.31:0/1605539660 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a24f0 0x7f5e200a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e1ffff700 1 -- 172.21.15.31:0/1605539660 >> v1:172.21.15.31:6789/0 conn(0x7f5e200a31e0 legacy=0x7f5e20144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.124+0000 7f5e1f7fe700 1 -- 172.21.15.31:0/1605539660 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549546610 0 0) 0x7f5e200a3c80 con 0x7f5e200a31e0 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e1ffff700 1 -- 172.21.15.31:0/1605539660 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200a3920 con 0x7f5e200a49a0 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e24b05700 1 --2- 172.21.15.31:0/1605539660 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a24f0 0x7f5e200a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e1ffff700 1 --2- 172.21.15.31:0/1605539660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a49a0 0x7f5e20141ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009910 tx=0x7f5e0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcf461c26cae3cdb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e1f7fe700 1 -- 172.21.15.31:0/1605539660 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c00b710 con 0x7f5e200a49a0 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e1f7fe700 1 -- 172.21.15.31:0/1605539660 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c00b870 con 0x7f5e200a49a0 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e1f7fe700 1 -- 172.21.15.31:0/1605539660 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c00bc30 con 0x7f5e200a49a0 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e26d69700 1 -- 172.21.15.31:0/1605539660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a49a0 msgr2=0x7f5e20141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e26d69700 1 --2- 172.21.15.31:0/1605539660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a49a0 0x7f5e20141ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009910 tx=0x7f5e0c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e26d69700 1 -- 172.21.15.31:0/1605539660 shutdown_connections 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e26d69700 1 --2- 172.21.15.31:0/1605539660 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a24f0 0x7f5e200a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e26d69700 1 --2- 172.21.15.31:0/1605539660 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a49a0 0x7f5e20141ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e26d69700 1 -- 172.21.15.31:0/1605539660 >> 172.21.15.31:0/1605539660 conn(0x7f5e20068af0 msgr2=0x7f5e20068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e26d69700 1 -- 172.21.15.31:0/1605539660 shutdown_connections 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.125+0000 7f5e26d69700 1 -- 172.21.15.31:0/1605539660 wait complete. 2024-04-18T10:39:03.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.126+0000 7f5e26d69700 1 Processor -- start 2024-04-18T10:39:03.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e26d69700 1 -- start start 2024-04-18T10:39:03.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e26d69700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a24f0 0x7f5e200a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e26d69700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e200a31e0 0x7f5e2013e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e26d69700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a49a0 0x7f5e20134410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e26d69700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200a6060 con 0x7f5e200a31e0 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e26d69700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2013e730 con 0x7f5e200a24f0 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e26d69700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2013d9c0 con 0x7f5e200a49a0 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e24b05700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a24f0 0x7f5e200a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e25306700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a49a0 0x7f5e20134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e24b05700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a24f0 0x7f5e200a6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54090/0 (socket says 172.21.15.31:54090) 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e200a31e0 0x7f5e2013e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.127+0000 7f5e24b05700 1 -- 172.21.15.31:0/3296711417 learned_addr learned my addr 172.21.15.31:0/3296711417 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e24b05700 1 -- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a49a0 msgr2=0x7f5e20134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e24b05700 1 --2- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a49a0 0x7f5e20134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e24b05700 1 -- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e200a31e0 msgr2=0x7f5e2013e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e24b05700 1 --2- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e200a31e0 0x7f5e2013e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e24b05700 1 -- 172.21.15.31:0/3296711417 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14009420 con 0x7f5e200a24f0 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e25306700 1 --2- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a49a0 0x7f5e20134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e1ffff700 1 --2- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e200a31e0 0x7f5e2013e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e24b05700 1 --2- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a24f0 0x7f5e200a6b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400ec80 tx=0x7f5e140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e1cff9700 1 -- 172.21.15.31:0/3296711417 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400c920 con 0x7f5e200a24f0 2024-04-18T10:39:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e1cff9700 1 -- 172.21.15.31:0/3296711417 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1400ca80 con 0x7f5e200a24f0 2024-04-18T10:39:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c009420 con 0x7f5e200a24f0 2024-04-18T10:39:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e1cff9700 1 -- 172.21.15.31:0/3296711417 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400ce00 con 0x7f5e200a24f0 2024-04-18T10:39:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.128+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e200a5830 con 0x7f5e200a24f0 2024-04-18T10:39:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.129+0000 7f5e1cff9700 1 -- 172.21.15.31:0/3296711417 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f5e14013680 con 0x7f5e200a24f0 2024-04-18T10:39:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.129+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2006f880 con 0x7f5e200a24f0 2024-04-18T10:39:03.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.129+0000 7f5e1cff9700 1 -- 172.21.15.31:0/3296711417 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5e1405b5a0 con 0x7f5e200a24f0 2024-04-18T10:39:03.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.134+0000 7f5e1cff9700 1 -- 172.21.15.31:0/3296711417 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5e14039760 con 0x7f5e200a24f0 2024-04-18T10:39:03.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.296+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e2013e990 con 0x7f5e200a24f0 2024-04-18T10:39:03.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.297+0000 7f5e1cff9700 1 -- 172.21.15.31:0/3296711417 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e1403cf50 con 0x7f5e200a24f0 2024-04-18T10:39:03.297 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:39:03.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 >> v1:172.21.15.31:6816/46601 conn(0x7f5e04046010 legacy=0x7f5e040484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a24f0 msgr2=0x7f5e200a6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 --2- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a24f0 0x7f5e200a6b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400ec80 tx=0x7f5e140091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 shutdown_connections 2024-04-18T10:39:03.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 --2- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5e200a49a0 0x7f5e20134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 --2- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5e200a24f0 0x7f5e200a6b70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 --2- 172.21.15.31:0/3296711417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e200a31e0 0x7f5e2013e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 >> 172.21.15.31:0/3296711417 conn(0x7f5e20068af0 msgr2=0x7f5e200b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:03.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 shutdown_connections 2024-04-18T10:39:03.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.298+0000 7f5e26d69700 1 -- 172.21.15.31:0/3296711417 wait complete. 2024-04-18T10:39:03.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:39:03.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.434+0000 7f1cb791f700 1 Processor -- start 2024-04-18T10:39:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.434+0000 7f1cb791f700 1 -- start start 2024-04-18T10:39:03.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb791f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb791f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb013ead0 0x7f1cb013eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb791f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb00a38e0 con 0x7f1cb006da60 2024-04-18T10:39:03.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb791f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00a4600 con 0x7f1cb013ead0 2024-04-18T10:39:03.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb791f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00a3bc0 con 0x7f1cb0069450 2024-04-18T10:39:03.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb56bb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb4eba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb013ead0 0x7f1cb013eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb5ebc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1cb006da60 0x7f1cb006df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53388/0 (socket says 172.21.15.31:53388) 2024-04-18T10:39:03.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb5ebc700 1 -- 172.21.15.31:0/749296102 learned_addr learned my addr 172.21.15.31:0/749296102 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1ca7fff700 1 -- 172.21.15.31:0/749296102 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209434030 0 0) 0x7f1cb00a38e0 con 0x7f1cb006da60 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1ca7fff700 1 -- 172.21.15.31:0/749296102 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c9c003570 con 0x7f1cb006da60 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb56bb700 1 -- 172.21.15.31:0/749296102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb013ead0 msgr2=0x7f1cb013eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb56bb700 1 --2- 172.21.15.31:0/749296102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb013ead0 0x7f1cb013eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb56bb700 1 -- 172.21.15.31:0/749296102 >> v1:172.21.15.31:6789/0 conn(0x7f1cb006da60 legacy=0x7f1cb006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb56bb700 1 -- 172.21.15.31:0/749296102 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb00a4810 con 0x7f1cb0069450 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.435+0000 7f1cb4eba700 1 --2- 172.21.15.31:0/749296102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb013ead0 0x7f1cb013eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1cb56bb700 1 --2- 172.21.15.31:0/749296102 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00a40c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009940 tx=0x7f1ca00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=565763c2ad50fe88 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1ca7fff700 1 -- 172.21.15.31:0/749296102 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0011630 con 0x7f1cb0069450 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1ca7fff700 1 -- 172.21.15.31:0/749296102 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca0011790 con 0x7f1cb0069450 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1ca7fff700 1 -- 172.21.15.31:0/749296102 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0011b30 con 0x7f1cb0069450 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1cb791f700 1 -- 172.21.15.31:0/749296102 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 msgr2=0x7f1cb00a40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1cb791f700 1 --2- 172.21.15.31:0/749296102 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00a40c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009940 tx=0x7f1ca00091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1cb791f700 1 -- 172.21.15.31:0/749296102 shutdown_connections 2024-04-18T10:39:03.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1cb791f700 1 --2- 172.21.15.31:0/749296102 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00a40c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1cb791f700 1 --2- 172.21.15.31:0/749296102 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb013ead0 0x7f1cb013eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1cb791f700 1 -- 172.21.15.31:0/749296102 >> 172.21.15.31:0/749296102 conn(0x7f1cb006af40 msgr2=0x7f1cb0068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:03.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1cb791f700 1 -- 172.21.15.31:0/749296102 shutdown_connections 2024-04-18T10:39:03.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.436+0000 7f1cb791f700 1 -- 172.21.15.31:0/749296102 wait complete. 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.437+0000 7f1cb791f700 1 Processor -- start 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.437+0000 7f1cb791f700 1 -- start start 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb791f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb791f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb006da60 0x7f1cb00a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb791f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb013ead0 0x7f1cb013d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb791f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00a7b50 con 0x7f1cb013ead0 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb791f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00a7df0 con 0x7f1cb006da60 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb791f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00a9660 con 0x7f1cb0069450 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb4eba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb006da60 0x7f1cb00a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb56bb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb56bb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44214/0 (socket says 172.21.15.31:44214) 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb56bb700 1 -- 172.21.15.31:0/128810016 learned_addr learned my addr 172.21.15.31:0/128810016 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb4eba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb006da60 0x7f1cb00a9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54110/0 (socket says 172.21.15.31:54110) 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb5ebc700 1 --2- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb013ead0 0x7f1cb013d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.438+0000 7f1cb56bb700 1 -- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb006da60 msgr2=0x7f1cb00a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1cb56bb700 1 --2- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb006da60 0x7f1cb00a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1cb56bb700 1 -- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb013ead0 msgr2=0x7f1cb013d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1cb56bb700 1 --2- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb013ead0 0x7f1cb013d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1cb56bb700 1 -- 172.21.15.31:0/128810016 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac009420 con 0x7f1cb0069450 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1cb4eba700 1 --2- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb006da60 0x7f1cb00a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1cb56bb700 1 --2- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00679e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00a4740 tx=0x7f1ca0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1ca57fa700 1 -- 172.21.15.31:0/128810016 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0000d10 con 0x7f1cb0069450 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1ca57fa700 1 -- 172.21.15.31:0/128810016 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca0011900 con 0x7f1cb0069450 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca0009420 con 0x7f1cb0069450 2024-04-18T10:39:03.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1ca57fa700 1 -- 172.21.15.31:0/128810016 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0026430 con 0x7f1cb0069450 2024-04-18T10:39:03.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.439+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb00aa480 con 0x7f1cb0069450 2024-04-18T10:39:03.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.440+0000 7f1ca57fa700 1 -- 172.21.15.31:0/128810016 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f1ca0023030 con 0x7f1cb0069450 2024-04-18T10:39:03.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.440+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb00a94a0 con 0x7f1cb0069450 2024-04-18T10:39:03.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.440+0000 7f1ca57fa700 1 -- 172.21.15.31:0/128810016 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f1ca005c770 con 0x7f1cb0069450 2024-04-18T10:39:03.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.444+0000 7f1ca57fa700 1 -- 172.21.15.31:0/128810016 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f1ca0007ab0 con 0x7f1cb0069450 2024-04-18T10:39:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.611+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1cb0067fe0 con 0x7f1cb0069450 2024-04-18T10:39:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.612+0000 7f1ca57fa700 1 -- 172.21.15.31:0/128810016 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ca0015030 con 0x7f1cb0069450 2024-04-18T10:39:03.611 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:39:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.613+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 >> v1:172.21.15.31:6816/46601 conn(0x7f1c94046040 legacy=0x7f1c940484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.613+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 msgr2=0x7f1cb00679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.613+0000 7f1cb791f700 1 --2- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00679e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00a4740 tx=0x7f1ca0017000 comp rx=0 tx=0).stop 2024-04-18T10:39:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.614+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 shutdown_connections 2024-04-18T10:39:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.614+0000 7f1cb791f700 1 --2- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1cb0069450 0x7f1cb00679e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.614+0000 7f1cb791f700 1 --2- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb013ead0 0x7f1cb013d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.614+0000 7f1cb791f700 1 --2- 172.21.15.31:0/128810016 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1cb006da60 0x7f1cb00a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.614+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 >> 172.21.15.31:0/128810016 conn(0x7f1cb006af40 msgr2=0x7f1cb00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:03.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.614+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 shutdown_connections 2024-04-18T10:39:03.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.614+0000 7f1cb791f700 1 -- 172.21.15.31:0/128810016 wait complete. 2024-04-18T10:39:03.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:39:03.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.749+0000 7f823ea40700 1 Processor -- start 2024-04-18T10:39:03.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.749+0000 7f823ea40700 1 -- start start 2024-04-18T10:39:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823ea40700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8238069450 0x7f823806f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823ea40700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f823806e050 0x7f823806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823ea40700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380a2960 0x7f82380a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823ea40700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82380a3720 con 0x7f823806e050 2024-04-18T10:39:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823ea40700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823806ea20 con 0x7f82380a2960 2024-04-18T10:39:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823ea40700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82380a2420 con 0x7f8238069450 2024-04-18T10:39:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f8237fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8238069450 0x7f823806f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f82377fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f823806e050 0x7f823806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823cfdd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380a2960 0x7f82380a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f8237fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8238069450 0x7f823806f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44228/0 (socket says 172.21.15.31:44228) 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f8237fff700 1 -- 172.21.15.31:0/421585500 learned_addr learned my addr 172.21.15.31:0/421585500 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f82377fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f823806e050 0x7f823806e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54556/0 (socket says 172.21.15.31:54556) 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823cfdd700 1 --2- 172.21.15.31:0/421585500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380a2960 0x7f82380a2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54126/0 (socket says 172.21.15.31:54126) 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823cfdd700 1 -- 172.21.15.31:0/421585500 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8238069450 msgr2=0x7f823806f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823cfdd700 1 --2- 172.21.15.31:0/421585500 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8238069450 0x7f823806f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823cfdd700 1 -- 172.21.15.31:0/421585500 >> v2:172.21.15.31:3300/0 conn(0x7f823806e050 msgr2=0x7f823806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823cfdd700 1 --2- 172.21.15.31:0/421585500 >> v2:172.21.15.31:3300/0 conn(0x7f823806e050 0x7f823806e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823cfdd700 1 -- 172.21.15.31:0/421585500 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823806ee90 con 0x7f82380a2960 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f8237fff700 1 --2- 172.21.15.31:0/421585500 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8238069450 0x7f823806f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f82377fe700 1 --2- 172.21.15.31:0/421585500 >> v2:172.21.15.31:3300/0 conn(0x7f823806e050 0x7f823806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f823cfdd700 1 --2- 172.21.15.31:0/421585500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380a2960 0x7f82380a2dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8230009e60 tx=0x7f8230009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1970e2fb1ec8aaf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.750+0000 7f8236ffd700 1 -- 172.21.15.31:0/421585500 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823000e070 con 0x7f82380a2960 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f8236ffd700 1 -- 172.21.15.31:0/421585500 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823000bab0 con 0x7f82380a2960 2024-04-18T10:39:03.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f8236ffd700 1 -- 172.21.15.31:0/421585500 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823000be70 con 0x7f82380a2960 2024-04-18T10:39:03.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f823ea40700 1 -- 172.21.15.31:0/421585500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380a2960 msgr2=0x7f82380a2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f823ea40700 1 --2- 172.21.15.31:0/421585500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380a2960 0x7f82380a2dd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8230009e60 tx=0x7f8230009780 comp rx=0 tx=0).stop 2024-04-18T10:39:03.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f823ea40700 1 -- 172.21.15.31:0/421585500 shutdown_connections 2024-04-18T10:39:03.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f823ea40700 1 --2- 172.21.15.31:0/421585500 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f82380a2960 0x7f82380a2dd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f823ea40700 1 --2- 172.21.15.31:0/421585500 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8238069450 0x7f823806f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f823ea40700 1 --2- 172.21.15.31:0/421585500 >> v2:172.21.15.31:3300/0 conn(0x7f823806e050 0x7f823806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f823ea40700 1 -- 172.21.15.31:0/421585500 >> 172.21.15.31:0/421585500 conn(0x7f823806cd10 msgr2=0x7f8238068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:03.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f823ea40700 1 -- 172.21.15.31:0/421585500 shutdown_connections 2024-04-18T10:39:03.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.751+0000 7f823ea40700 1 -- 172.21.15.31:0/421585500 wait complete. 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.752+0000 7f823ea40700 1 Processor -- start 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.752+0000 7f823ea40700 1 -- start start 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f823ea40700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8238069450 0x7f82380a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f823ea40700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823806e050 0x7f82381373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f823ea40700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380a2960 0x7f8238137910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f823ea40700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82380a7e30 con 0x7f8238069450 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f823ea40700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82380aaa30 con 0x7f823806e050 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f823ea40700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82380a7b90 con 0x7f82380a2960 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f82377fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823806e050 0x7f82381373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f8237fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8238069450 0x7f82380a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f823cfdd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380a2960 0x7f8238137910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f82377fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823806e050 0x7f82381373d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:54128/0 (socket says 172.21.15.31:54128) 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f82377fe700 1 -- 172.21.15.31:0/3827304568 learned_addr learned my addr 172.21.15.31:0/3827304568 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f8237fff700 1 -- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380a2960 msgr2=0x7f8238137910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f8237fff700 1 --2- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380a2960 0x7f8238137910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f8237fff700 1 -- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823806e050 msgr2=0x7f82381373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f8237fff700 1 --2- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823806e050 0x7f82381373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f8237fff700 1 -- 172.21.15.31:0/3827304568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200094f0 con 0x7f8238069450 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f823cfdd700 1 --2- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380a2960 0x7f8238137910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.753+0000 7f8237fff700 1 --2- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8238069450 0x7f82380a9e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8220006fd0 tx=0x7f8220009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.754+0000 7f822ffff700 1 -- 172.21.15.31:0/3827304568 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000c850 con 0x7f8238069450 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.754+0000 7f822ffff700 1 -- 172.21.15.31:0/3827304568 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822000c9b0 con 0x7f8238069450 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.754+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822800b6d0 con 0x7f8238069450 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.754+0000 7f822ffff700 1 -- 172.21.15.31:0/3827304568 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000cd30 con 0x7f8238069450 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.754+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8230009a20 con 0x7f8238069450 2024-04-18T10:39:03.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.755+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82380651b0 con 0x7f8238069450 2024-04-18T10:39:03.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.755+0000 7f822ffff700 1 -- 172.21.15.31:0/3827304568 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f8220013680 con 0x7f8238069450 2024-04-18T10:39:03.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.756+0000 7f822ffff700 1 -- 172.21.15.31:0/3827304568 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f822005ba90 con 0x7f8238069450 2024-04-18T10:39:03.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.759+0000 7f822ffff700 1 -- 172.21.15.31:0/3827304568 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8220039c90 con 0x7f8238069450 2024-04-18T10:39:03.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.920+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f82380a3f70 con 0x7f8238069450 2024-04-18T10:39:03.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.920+0000 7f822ffff700 1 -- 172.21.15.31:0/3827304568 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8220020030 con 0x7f8238069450 2024-04-18T10:39:03.920 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:39:03.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 >> v1:172.21.15.31:6816/46601 conn(0x7f8218046090 legacy=0x7f8218048540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8238069450 msgr2=0x7f82380a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:03.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 --2- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8238069450 0x7f82380a9e70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8220006fd0 tx=0x7f8220009250 comp rx=0 tx=0).stop 2024-04-18T10:39:03.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 shutdown_connections 2024-04-18T10:39:03.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 --2- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f82380a2960 0x7f8238137910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 --2- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8238069450 0x7f82380a9e70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 --2- 172.21.15.31:0/3827304568 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f823806e050 0x7f82381373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:03.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 >> 172.21.15.31:0/3827304568 conn(0x7f823806cd10 msgr2=0x7f823813ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:03.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 shutdown_connections 2024-04-18T10:39:03.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:03.922+0000 7f823ea40700 1 -- 172.21.15.31:0/3827304568 wait complete. 2024-04-18T10:39:03.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:39:04.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.056+0000 7f426f49c700 1 Processor -- start 2024-04-18T10:39:04.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426f49c700 1 -- start start 2024-04-18T10:39:04.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426f49c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4268063b80 0x7f42680ab350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426f49c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f426813bc80 0x7f4268148c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426f49c700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42680a9fd0 con 0x7f42680aa7f0 2024-04-18T10:39:04.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426f49c700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42680acba0 con 0x7f4268063b80 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426f49c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42680ace40 con 0x7f426813bc80 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426d238700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4268063b80 0x7f42680ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426da39700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f426813bc80 0x7f4268148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426ca37700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f42680aa7f0 0x7f426813b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53404/0 (socket says 172.21.15.31:53404) 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.057+0000 7f426ca37700 1 -- 172.21.15.31:0/601517663 learned_addr learned my addr 172.21.15.31:0/601517663 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f425bfff700 1 -- 172.21.15.31:0/601517663 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642241109 0 0) 0x7f42680a9fd0 con 0x7f42680aa7f0 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f425bfff700 1 -- 172.21.15.31:0/601517663 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4254003570 con 0x7f42680aa7f0 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f426da39700 1 -- 172.21.15.31:0/601517663 >> v2:172.21.15.31:3300/0 conn(0x7f4268063b80 msgr2=0x7f42680ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f426da39700 1 --2- 172.21.15.31:0/601517663 >> v2:172.21.15.31:3300/0 conn(0x7f4268063b80 0x7f42680ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f426da39700 1 -- 172.21.15.31:0/601517663 >> v1:172.21.15.31:6789/0 conn(0x7f42680aa7f0 legacy=0x7f426813b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f426da39700 1 -- 172.21.15.31:0/601517663 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42680ac390 con 0x7f426813bc80 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f426d238700 1 --2- 172.21.15.31:0/601517663 >> v2:172.21.15.31:3300/0 conn(0x7f4268063b80 0x7f42680ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f426da39700 1 --2- 172.21.15.31:0/601517663 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f426813bc80 0x7f4268148c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4260009e60 tx=0x7f4260009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969ad1f9c236064b server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f425bfff700 1 -- 172.21.15.31:0/601517663 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000e070 con 0x7f426813bc80 2024-04-18T10:39:04.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f425bfff700 1 -- 172.21.15.31:0/601517663 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426000bab0 con 0x7f426813bc80 2024-04-18T10:39:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f425bfff700 1 -- 172.21.15.31:0/601517663 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000be70 con 0x7f426813bc80 2024-04-18T10:39:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f426f49c700 1 -- 172.21.15.31:0/601517663 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f426813bc80 msgr2=0x7f4268148c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.058+0000 7f426f49c700 1 --2- 172.21.15.31:0/601517663 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f426813bc80 0x7f4268148c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4260009e60 tx=0x7f4260009780 comp rx=0 tx=0).stop 2024-04-18T10:39:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.059+0000 7f426f49c700 1 -- 172.21.15.31:0/601517663 shutdown_connections 2024-04-18T10:39:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.059+0000 7f426f49c700 1 --2- 172.21.15.31:0/601517663 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f426813bc80 0x7f4268148c10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.059+0000 7f426f49c700 1 --2- 172.21.15.31:0/601517663 >> v2:172.21.15.31:3300/0 conn(0x7f4268063b80 0x7f42680ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.059+0000 7f426f49c700 1 -- 172.21.15.31:0/601517663 >> 172.21.15.31:0/601517663 conn(0x7f42680b1290 msgr2=0x7f42680b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.059+0000 7f426f49c700 1 -- 172.21.15.31:0/601517663 shutdown_connections 2024-04-18T10:39:04.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.059+0000 7f426f49c700 1 -- 172.21.15.31:0/601517663 wait complete. 2024-04-18T10:39:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.060+0000 7f426f49c700 1 Processor -- start 2024-04-18T10:39:04.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.060+0000 7f426f49c700 1 -- start start 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426f49c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4268063b80 0x7f426813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426f49c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42680aa7f0 0x7f4268138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426f49c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f426813bc80 0x7f4268138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426f49c700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426813eeb0 con 0x7f42680aa7f0 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426f49c700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426813da20 con 0x7f426813bc80 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426f49c700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f426813d780 con 0x7f4268063b80 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426ca37700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42680aa7f0 0x7f4268138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426d238700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4268063b80 0x7f426813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426ca37700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42680aa7f0 0x7f4268138540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54576/0 (socket says 172.21.15.31:54576) 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426d238700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4268063b80 0x7f426813cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44264/0 (socket says 172.21.15.31:44264) 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426ca37700 1 -- 172.21.15.31:0/3189548594 learned_addr learned my addr 172.21.15.31:0/3189548594 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426da39700 1 --2- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f426813bc80 0x7f4268138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426d238700 1 -- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f426813bc80 msgr2=0x7f4268138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426d238700 1 --2- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f426813bc80 0x7f4268138a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426d238700 1 -- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42680aa7f0 msgr2=0x7f4268138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426d238700 1 --2- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42680aa7f0 0x7f4268138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426d238700 1 -- 172.21.15.31:0/3189548594 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264009420 con 0x7f4268063b80 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.061+0000 7f426ca37700 1 --2- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42680aa7f0 0x7f4268138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.062+0000 7f426d238700 1 --2- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4268063b80 0x7f426813cf30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f426400ecb0 tx=0x7f42640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.062+0000 7f42597fa700 1 -- 172.21.15.31:0/3189548594 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400c8e0 con 0x7f4268063b80 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.062+0000 7f42597fa700 1 -- 172.21.15.31:0/3189548594 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426400ca40 con 0x7f4268063b80 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.062+0000 7f42597fa700 1 -- 172.21.15.31:0/3189548594 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400cde0 con 0x7f4268063b80 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.062+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4260009a20 con 0x7f4268063b80 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.062+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426813d470 con 0x7f4268063b80 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.063+0000 7f42597fa700 1 -- 172.21.15.31:0/3189548594 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f4264013680 con 0x7f4268063b80 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.063+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42680651b0 con 0x7f4268063b80 2024-04-18T10:39:04.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.063+0000 7f42597fa700 1 -- 172.21.15.31:0/3189548594 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f426405b850 con 0x7f4268063b80 2024-04-18T10:39:04.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.067+0000 7f42597fa700 1 -- 172.21.15.31:0/3189548594 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4264039be0 con 0x7f4268063b80 2024-04-18T10:39:04.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.229+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f426813ab70 con 0x7f4268063b80 2024-04-18T10:39:04.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.229+0000 7f42597fa700 1 -- 172.21.15.31:0/3189548594 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f426403d200 con 0x7f4268063b80 2024-04-18T10:39:04.229 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 >> v1:172.21.15.31:6816/46601 conn(0x7f424c046010 legacy=0x7f424c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4268063b80 msgr2=0x7f426813cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 --2- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4268063b80 0x7f426813cf30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f426400ecb0 tx=0x7f42640091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 shutdown_connections 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 --2- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4268063b80 0x7f426813cf30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 --2- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f426813bc80 0x7f4268138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 --2- 172.21.15.31:0/3189548594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42680aa7f0 0x7f4268138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 >> 172.21.15.31:0/3189548594 conn(0x7f42680b1290 msgr2=0x7f42680adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 shutdown_connections 2024-04-18T10:39:04.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.231+0000 7f426f49c700 1 -- 172.21.15.31:0/3189548594 wait complete. 2024-04-18T10:39:04.243 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:39:04.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.363+0000 7fbd5ca49700 1 Processor -- start 2024-04-18T10:39:04.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.363+0000 7fbd5ca49700 1 -- start start 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5ca49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd580ab350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5ca49700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd5813bc80 0x7fbd58148c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5ca49700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd580a9fd0 con 0x7fbd580aa7f0 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5ca49700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580acba0 con 0x7fbd5813bc80 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5ca49700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580ace40 con 0x7fbd58063b80 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd56d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd5813bc80 0x7fbd58148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd580ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd55d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbd580aa7f0 0x7fbd5813b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53416/0 (socket says 172.21.15.31:53416) 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd55d9b700 1 -- 172.21.15.31:0/394879466 learned_addr learned my addr 172.21.15.31:0/394879466 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5659c700 1 -- 172.21.15.31:0/394879466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd5813bc80 msgr2=0x7fbd58148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5659c700 1 --2- 172.21.15.31:0/394879466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd5813bc80 0x7fbd58148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5659c700 1 -- 172.21.15.31:0/394879466 >> v1:172.21.15.31:6789/0 conn(0x7fbd580aa7f0 legacy=0x7fbd5813b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5559a700 1 -- 172.21.15.31:0/394879466 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240770388 0 0) 0x7fbd580a9fd0 con 0x7fbd580aa7f0 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5659c700 1 -- 172.21.15.31:0/394879466 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580ac390 con 0x7fbd58063b80 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd56d9d700 1 --2- 172.21.15.31:0/394879466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd5813bc80 0x7fbd58148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5659c700 1 --2- 172.21.15.31:0/394879466 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd580ab350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009910 tx=0x7fbd480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f93eb9f6254eb68e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5559a700 1 -- 172.21.15.31:0/394879466 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800b680 con 0x7fbd58063b80 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5559a700 1 -- 172.21.15.31:0/394879466 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4800b7e0 con 0x7fbd58063b80 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.364+0000 7fbd5559a700 1 -- 172.21.15.31:0/394879466 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800bba0 con 0x7fbd58063b80 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.365+0000 7fbd5ca49700 1 -- 172.21.15.31:0/394879466 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 msgr2=0x7fbd580ab350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.365+0000 7fbd5ca49700 1 --2- 172.21.15.31:0/394879466 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd580ab350 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009910 tx=0x7fbd480091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.365+0000 7fbd5ca49700 1 -- 172.21.15.31:0/394879466 shutdown_connections 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.365+0000 7fbd5ca49700 1 --2- 172.21.15.31:0/394879466 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd5813bc80 0x7fbd58148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.365+0000 7fbd5ca49700 1 --2- 172.21.15.31:0/394879466 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd580ab350 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.365+0000 7fbd5ca49700 1 -- 172.21.15.31:0/394879466 >> 172.21.15.31:0/394879466 conn(0x7fbd580b1290 msgr2=0x7fbd580b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:04.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.365+0000 7fbd5ca49700 1 -- 172.21.15.31:0/394879466 shutdown_connections 2024-04-18T10:39:04.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.365+0000 7fbd5ca49700 1 -- 172.21.15.31:0/394879466 wait complete. 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.366+0000 7fbd5ca49700 1 Processor -- start 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.366+0000 7fbd5ca49700 1 -- start start 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.366+0000 7fbd5ca49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd58137060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.366+0000 7fbd5ca49700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd580aa7f0 0x7fbd581375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.366+0000 7fbd5ca49700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5813bc80 0x7fbd58137ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.366+0000 7fbd5ca49700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5813e6c0 con 0x7fbd5813bc80 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.366+0000 7fbd5ca49700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5813e010 con 0x7fbd580aa7f0 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.366+0000 7fbd5ca49700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5813ccd0 con 0x7fbd58063b80 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd58137060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd58137060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44276/0 (socket says 172.21.15.31:44276) 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5659c700 1 -- 172.21.15.31:0/3042356125 learned_addr learned my addr 172.21.15.31:0/3042356125 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd56d9d700 1 --2- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5813bc80 0x7fbd58137ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd55d9b700 1 --2- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd580aa7f0 0x7fbd581375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5659c700 1 -- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd580aa7f0 msgr2=0x7fbd581375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5659c700 1 --2- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd580aa7f0 0x7fbd581375a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5659c700 1 -- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5813bc80 msgr2=0x7fbd58137ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5659c700 1 --2- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5813bc80 0x7fbd58137ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5659c700 1 -- 172.21.15.31:0/3042356125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50009a20 con 0x7fbd58063b80 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5659c700 1 --2- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd58137060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009fb0 tx=0x7fbd48017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd467fc700 1 -- 172.21.15.31:0/3042356125 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800bb60 con 0x7fbd58063b80 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd467fc700 1 -- 172.21.15.31:0/3042356125 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd48000c90 con 0x7fbd58063b80 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd48009420 con 0x7fbd58063b80 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd467fc700 1 -- 172.21.15.31:0/3042356125 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4801a660 con 0x7fbd58063b80 2024-04-18T10:39:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.367+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5813c2c0 con 0x7fbd58063b80 2024-04-18T10:39:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.368+0000 7fbd467fc700 1 -- 172.21.15.31:0/3042356125 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fbd4801a9d0 con 0x7fbd58063b80 2024-04-18T10:39:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.368+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd58144760 con 0x7fbd58063b80 2024-04-18T10:39:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.368+0000 7fbd467fc700 1 -- 172.21.15.31:0/3042356125 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fbd4805ce10 con 0x7fbd58063b80 2024-04-18T10:39:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.372+0000 7fbd467fc700 1 -- 172.21.15.31:0/3042356125 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fbd48001f00 con 0x7fbd58063b80 2024-04-18T10:39:04.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.571+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd580651b0 con 0x7fbd58063b80 2024-04-18T10:39:04.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.572+0000 7fbd467fc700 1 -- 172.21.15.31:0/3042356125 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3664 (secure 0 0 0) 0x7fbd48015070 con 0x7fbd58063b80 2024-04-18T10:39:04.571 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:39:04.571 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":24422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3164763612","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3164763612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6818/18914605","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":18914605}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:38:55.584822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24428":{"gid":24428,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/1866692589","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":1866692589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 >> v1:172.21.15.31:6816/46601 conn(0x7fbd38046010 legacy=0x7fbd380484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 msgr2=0x7fbd58137060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 --2- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd58137060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009fb0 tx=0x7fbd48017000 comp rx=0 tx=0).stop 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 shutdown_connections 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 --2- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fbd58063b80 0x7fbd58137060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 --2- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd5813bc80 0x7fbd58137ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 --2- 172.21.15.31:0/3042356125 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fbd580aa7f0 0x7fbd581375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 >> 172.21.15.31:0/3042356125 conn(0x7fbd580b1290 msgr2=0x7fbd580aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 shutdown_connections 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.574+0000 7fbd5ca49700 1 -- 172.21.15.31:0/3042356125 wait complete. 2024-04-18T10:39:04.574 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-04-18T10:39:04.585 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:39:04.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91d250d700 1 Processor -- start 2024-04-18T10:39:04.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91d250d700 1 -- start start 2024-04-18T10:39:04.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91d250d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc1469f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91d250d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc146f30 0x7f91cc149310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91d250d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0a3790 con 0x7f91cc069200 2024-04-18T10:39:04.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91d250d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0a3b50 con 0x7f91cc144610 2024-04-18T10:39:04.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91d250d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0a45d0 con 0x7f91cc146f30 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91d0aaa700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc146f30 0x7f91cc149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91cb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc1469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91cbfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f91cc069200 0x7f91cc0a3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44540/0 (socket says 172.21.15.31:44540) 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.707+0000 7f91cbfff700 1 -- 172.21.15.31:0/493991173 learned_addr learned my addr 172.21.15.31:0/493991173 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91caffd700 1 -- 172.21.15.31:0/493991173 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701358908 0 0) 0x7f91bc001110 con 0x7f91cc069200 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d0aaa700 1 -- 172.21.15.31:0/493991173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 msgr2=0x7f91cc1469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d0aaa700 1 --2- 172.21.15.31:0/493991173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc1469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d0aaa700 1 -- 172.21.15.31:0/493991173 >> v1:172.21.15.31:6789/0 conn(0x7f91cc069200 legacy=0x7f91cc0a3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d0aaa700 1 -- 172.21.15.31:0/493991173 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc06e070 con 0x7f91cc146f30 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91cb7fe700 1 --2- 172.21.15.31:0/493991173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc1469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d0aaa700 1 --2- 172.21.15.31:0/493991173 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc146f30 0x7f91cc149310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009e90 tx=0x7f91c4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36f95aeefd9d51c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91caffd700 1 -- 172.21.15.31:0/493991173 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c400e070 con 0x7f91cc146f30 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91caffd700 1 -- 172.21.15.31:0/493991173 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c400bc30 con 0x7f91cc146f30 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91caffd700 1 -- 172.21.15.31:0/493991173 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4012430 con 0x7f91cc146f30 2024-04-18T10:39:04.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d250d700 1 -- 172.21.15.31:0/493991173 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc146f30 msgr2=0x7f91cc149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d250d700 1 --2- 172.21.15.31:0/493991173 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc146f30 0x7f91cc149310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009e90 tx=0x7f91c4009780 comp rx=0 tx=0).stop 2024-04-18T10:39:04.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d250d700 1 -- 172.21.15.31:0/493991173 shutdown_connections 2024-04-18T10:39:04.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d250d700 1 --2- 172.21.15.31:0/493991173 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc146f30 0x7f91cc149310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d250d700 1 --2- 172.21.15.31:0/493991173 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc1469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.708+0000 7f91d250d700 1 -- 172.21.15.31:0/493991173 >> 172.21.15.31:0/493991173 conn(0x7f91cc06ae80 msgr2=0x7f91cc068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:04.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.709+0000 7f91d250d700 1 -- 172.21.15.31:0/493991173 shutdown_connections 2024-04-18T10:39:04.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.709+0000 7f91d250d700 1 -- 172.21.15.31:0/493991173 wait complete. 2024-04-18T10:39:04.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.709+0000 7f91d250d700 1 Processor -- start 2024-04-18T10:39:04.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91d250d700 1 -- start start 2024-04-18T10:39:04.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91d250d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc069200 0x7f91cc0970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91d250d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91d250d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc146f30 0x7f91cc142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:04.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91d250d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc09c4c0 con 0x7f91cc146f30 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91d250d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc098730 con 0x7f91cc144610 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91d250d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc098cf0 con 0x7f91cc069200 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91cbfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc069200 0x7f91cc0970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91d0aaa700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc146f30 0x7f91cc142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91cb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91cbfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc069200 0x7f91cc0970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:36590/0 (socket says 172.21.15.31:36590) 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.710+0000 7f91cbfff700 1 -- 172.21.15.31:0/1938180158 learned_addr learned my addr 172.21.15.31:0/1938180158 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91cb7fe700 1 -- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc069200 msgr2=0x7f91cc0970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91cb7fe700 1 --2- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc069200 0x7f91cc0970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91cb7fe700 1 -- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc146f30 msgr2=0x7f91cc142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91cb7fe700 1 --2- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc146f30 0x7f91cc142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91cb7fe700 1 -- 172.21.15.31:0/1938180158 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0009420 con 0x7f91cc144610 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91cbfff700 1 --2- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc069200 0x7f91cc0970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91d0aaa700 1 --2- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc146f30 0x7f91cc142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:04.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91cb7fe700 1 --2- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc142890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91c000ecb0 tx=0x7f91c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:04.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91b3fff700 1 -- 172.21.15.31:0/1938180158 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000c8e0 con 0x7f91cc144610 2024-04-18T10:39:04.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91b3fff700 1 -- 172.21.15.31:0/1938180158 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c000ca40 con 0x7f91cc144610 2024-04-18T10:39:04.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91b3fff700 1 -- 172.21.15.31:0/1938180158 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000cde0 con 0x7f91cc144610 2024-04-18T10:39:04.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c4009a20 con 0x7f91cc144610 2024-04-18T10:39:04.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.711+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc09b300 con 0x7f91cc144610 2024-04-18T10:39:04.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.712+0000 7f91b3fff700 1 -- 172.21.15.31:0/1938180158 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f91c0013680 con 0x7f91cc144610 2024-04-18T10:39:04.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.712+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc0996d0 con 0x7f91cc144610 2024-04-18T10:39:04.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.712+0000 7f91b3fff700 1 -- 172.21.15.31:0/1938180158 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f91c005b480 con 0x7f91cc144610 2024-04-18T10:39:04.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.716+0000 7f91b3fff700 1 -- 172.21.15.31:0/1938180158 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f91c00396a0 con 0x7f91cc144610 2024-04-18T10:39:04.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.882+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91cc098870 con 0x7f91cc144610 2024-04-18T10:39:04.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.883+0000 7f91b3fff700 1 -- 172.21.15.31:0/1938180158 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11635 (secure 0 0 0) 0x7f91c003ce90 con 0x7f91cc144610 2024-04-18T10:39:04.883 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:39:04.883 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":41,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:58.600312+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:39:04.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.884+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 >> v1:172.21.15.31:6816/46601 conn(0x7f91b8046040 legacy=0x7f91b80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.884+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 msgr2=0x7f91cc142890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:04.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.884+0000 7f91d250d700 1 --2- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc142890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91c000ecb0 tx=0x7f91c00091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.885+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 shutdown_connections 2024-04-18T10:39:04.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.885+0000 7f91d250d700 1 --2- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc069200 0x7f91cc0970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.885+0000 7f91d250d700 1 --2- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc146f30 0x7f91cc142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.885+0000 7f91d250d700 1 --2- 172.21.15.31:0/1938180158 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc144610 0x7f91cc142890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:04.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.885+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 >> 172.21.15.31:0/1938180158 conn(0x7f91cc06ae80 msgr2=0x7f91cc1449e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:04.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.885+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 shutdown_connections 2024-04-18T10:39:04.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:04.885+0000 7f91d250d700 1 -- 172.21.15.31:0/1938180158 wait complete. 2024-04-18T10:39:04.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:39:04.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:39:05.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.020+0000 7f34f7b19700 1 Processor -- start 2024-04-18T10:39:05.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.020+0000 7f34f7b19700 1 -- start start 2024-04-18T10:39:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f7b19700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a44f0 0x7f34f00a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f7b19700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a2f90 0x7f34f00a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f7b19700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34f013f7b0 0x7f34f013fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f7b19700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f00a28c0 con 0x7f34f013f7b0 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f7b19700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f00a2b60 con 0x7f34f00a44f0 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f7b19700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f006c890 con 0x7f34f00a2f90 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f58b5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a44f0 0x7f34f00a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f60b6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34f013f7b0 0x7f34f013fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f50b4700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a2f90 0x7f34f00a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f60b6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f34f013f7b0 0x7f34f013fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43324/0 (socket says 172.21.15.31:43324) 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f58b5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a44f0 0x7f34f00a22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56602/0 (socket says 172.21.15.31:56602) 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f60b6700 1 -- 172.21.15.31:0/2219336198 learned_addr learned my addr 172.21.15.31:0/2219336198 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f60b6700 1 -- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a2f90 msgr2=0x7f34f00a33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f60b6700 1 --2- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a2f90 0x7f34f00a33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f60b6700 1 -- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a44f0 msgr2=0x7f34f00a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f60b6700 1 --2- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a44f0 0x7f34f00a22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f60b6700 1 -- 172.21.15.31:0/2219336198 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f00a5c10 con 0x7f34f013f7b0 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.021+0000 7f34f58b5700 1 --2- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a44f0 0x7f34f00a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f60b6700 1 --2- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 0x7f34f013fc20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009f20 tx=0x7f34e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04ac8643a2bdaed server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f48b3700 1 -- 172.21.15.31:0/2219336198 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e800e070 con 0x7f34f013f7b0 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f48b3700 1 -- 172.21.15.31:0/2219336198 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e800b970 con 0x7f34f013f7b0 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f48b3700 1 -- 172.21.15.31:0/2219336198 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80092e0 con 0x7f34f013f7b0 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f7b19700 1 -- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 msgr2=0x7f34f013fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f7b19700 1 --2- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 0x7f34f013fc20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009f20 tx=0x7f34e8009840 comp rx=0 tx=0).stop 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f7b19700 1 -- 172.21.15.31:0/2219336198 shutdown_connections 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f7b19700 1 --2- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 0x7f34f013fc20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f7b19700 1 --2- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a44f0 0x7f34f00a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f7b19700 1 --2- 172.21.15.31:0/2219336198 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a2f90 0x7f34f00a33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f7b19700 1 -- 172.21.15.31:0/2219336198 >> 172.21.15.31:0/2219336198 conn(0x7f34f0068af0 msgr2=0x7f34f0068ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:05.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.022+0000 7f34f7b19700 1 -- 172.21.15.31:0/2219336198 shutdown_connections 2024-04-18T10:39:05.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.023+0000 7f34f7b19700 1 -- 172.21.15.31:0/2219336198 wait complete. 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.024+0000 7f34f7b19700 1 Processor -- start 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.024+0000 7f34f7b19700 1 -- start start 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.024+0000 7f34f7b19700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a2f90 0x7f34f009b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f7b19700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a44f0 0x7f34f0096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f7b19700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 0x7f34f0096fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f7b19700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0097d60 con 0x7f34f013f7b0 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f7b19700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f009a920 con 0x7f34f00a2f90 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f7b19700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34f009ac00 con 0x7f34f00a44f0 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f58b5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a2f90 0x7f34f009b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f58b5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a2f90 0x7f34f009b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56614/0 (socket says 172.21.15.31:56614) 2024-04-18T10:39:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f58b5700 1 -- 172.21.15.31:0/1320294905 learned_addr learned my addr 172.21.15.31:0/1320294905 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f60b6700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 0x7f34f0096fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f50b4700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a44f0 0x7f34f0096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f58b5700 1 -- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a44f0 msgr2=0x7f34f0096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f58b5700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a44f0 0x7f34f0096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f58b5700 1 -- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 msgr2=0x7f34f0096fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f58b5700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 0x7f34f0096fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f58b5700 1 -- 172.21.15.31:0/1320294905 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0009420 con 0x7f34f00a2f90 2024-04-18T10:39:05.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f60b6700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 0x7f34f0096fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f58b5700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a2f90 0x7f34f009b200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34e000ecb0 tx=0x7f34e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34e5ffb700 1 -- 172.21.15.31:0/1320294905 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000c920 con 0x7f34f00a2f90 2024-04-18T10:39:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34e5ffb700 1 -- 172.21.15.31:0/1320294905 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e000ca80 con 0x7f34f00a2f90 2024-04-18T10:39:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34e5ffb700 1 -- 172.21.15.31:0/1320294905 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000ce00 con 0x7f34f00a2f90 2024-04-18T10:39:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.025+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e8009ae0 con 0x7f34f00a2f90 2024-04-18T10:39:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.026+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f00a1ac0 con 0x7f34f00a2f90 2024-04-18T10:39:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.026+0000 7f34e5ffb700 1 -- 172.21.15.31:0/1320294905 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f34e0013680 con 0x7f34f00a2f90 2024-04-18T10:39:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.026+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f00a1cb0 con 0x7f34f00a2f90 2024-04-18T10:39:05.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.027+0000 7f34e5ffb700 1 -- 172.21.15.31:0/1320294905 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f34e005b4c0 con 0x7f34f00a2f90 2024-04-18T10:39:05.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.030+0000 7f34e5ffb700 1 -- 172.21.15.31:0/1320294905 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f34e00396e0 con 0x7f34f00a2f90 2024-04-18T10:39:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.194+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34f0097ea0 con 0x7f34f00a2f90 2024-04-18T10:39:05.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.195+0000 7f34e5ffb700 1 -- 172.21.15.31:0/1320294905 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34e003ced0 con 0x7f34f00a2f90 2024-04-18T10:39:05.194 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:39:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.196+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 >> v1:172.21.15.31:6816/46601 conn(0x7f34d4046010 legacy=0x7f34d40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.196+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a2f90 msgr2=0x7f34f009b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.196+0000 7f34f7b19700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a2f90 0x7f34f009b200 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34e000ecb0 tx=0x7f34e00091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.196+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 shutdown_connections 2024-04-18T10:39:05.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.196+0000 7f34f7b19700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f34f013f7b0 0x7f34f0096fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.196+0000 7f34f7b19700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f34f00a2f90 0x7f34f009b200 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.196+0000 7f34f7b19700 1 --2- 172.21.15.31:0/1320294905 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f34f00a44f0 0x7f34f0096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.196+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 >> 172.21.15.31:0/1320294905 conn(0x7f34f0068af0 msgr2=0x7f34f00a33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.197+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 shutdown_connections 2024-04-18T10:39:05.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.197+0000 7f34f7b19700 1 -- 172.21.15.31:0/1320294905 wait complete. 2024-04-18T10:39:05.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:39:05.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.331+0000 7f8120d7e700 1 Processor -- start 2024-04-18T10:39:05.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f8120d7e700 1 -- start start 2024-04-18T10:39:05.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f8120d7e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c0680f0 0x7f811c0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f8120d7e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f811c069b50 0x7f811c06ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f8120d7e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c069f20 0x7f811c06ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f8120d7e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c0a3430 con 0x7f811c069b50 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f8120d7e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c06a480 con 0x7f811c069f20 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f8120d7e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f811c06a720 con 0x7f811c0680f0 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f811a59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c0680f0 0x7f811c0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f811ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c069f20 0x7f811c06ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f8119d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f811c069b50 0x7f811c06ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f811ad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c069f20 0x7f811c06ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56630/0 (socket says 172.21.15.31:56630) 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f811a59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c0680f0 0x7f811c0a3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:36620/0 (socket says 172.21.15.31:36620) 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.332+0000 7f811ad9d700 1 -- 172.21.15.31:0/3560047157 learned_addr learned my addr 172.21.15.31:0/3560047157 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f8119d9b700 1 -- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c0680f0 msgr2=0x7f811c0a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f8119d9b700 1 --2- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c0680f0 0x7f811c0a3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f8119d9b700 1 -- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c069f20 msgr2=0x7f811c06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:05.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f8119d9b700 1 --2- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c069f20 0x7f811c06ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f8119d9b700 1 -- 172.21.15.31:0/3560047157 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c06aa80 con 0x7f811c069b50 2024-04-18T10:39:05.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f811ad9d700 1 --2- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c069f20 0x7f811c06ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:05.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f8119d9b700 1 --2- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 0x7f811c06ea00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f810c0098e0 tx=0x7f810c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11d95b9962e9b1c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:05.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f811959a700 1 -- 172.21.15.31:0/3560047157 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c011630 con 0x7f811c069b50 2024-04-18T10:39:05.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f811959a700 1 -- 172.21.15.31:0/3560047157 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c011790 con 0x7f811c069b50 2024-04-18T10:39:05.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.333+0000 7f811959a700 1 -- 172.21.15.31:0/3560047157 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c011b30 con 0x7f811c069b50 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.334+0000 7f8120d7e700 1 -- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 msgr2=0x7f811c06ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.334+0000 7f8120d7e700 1 --2- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 0x7f811c06ea00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f810c0098e0 tx=0x7f810c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.334+0000 7f8120d7e700 1 -- 172.21.15.31:0/3560047157 shutdown_connections 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.334+0000 7f8120d7e700 1 --2- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c069f20 0x7f811c06ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.334+0000 7f8120d7e700 1 --2- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c0680f0 0x7f811c0a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.334+0000 7f8120d7e700 1 --2- 172.21.15.31:0/3560047157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 0x7f811c06ea00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.334+0000 7f8120d7e700 1 -- 172.21.15.31:0/3560047157 >> 172.21.15.31:0/3560047157 conn(0x7f811c06dd70 msgr2=0x7f811c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.334+0000 7f8120d7e700 1 -- 172.21.15.31:0/3560047157 shutdown_connections 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.334+0000 7f8120d7e700 1 -- 172.21.15.31:0/3560047157 wait complete. 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f8120d7e700 1 Processor -- start 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f8120d7e700 1 -- start start 2024-04-18T10:39:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f8120d7e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c0680f0 0x7f811c09dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f8120d7e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 0x7f811c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f8120d7e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c069f20 0x7f811c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f8120d7e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c09c320 con 0x7f811c069b50 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f8120d7e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c09eb20 con 0x7f811c0680f0 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f8120d7e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f811c09a210 con 0x7f811c069f20 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f811a59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c0680f0 0x7f811c09dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f811ad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c069f20 0x7f811c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f811a59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c0680f0 0x7f811c09dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56642/0 (socket says 172.21.15.31:56642) 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f811a59c700 1 -- 172.21.15.31:0/3924915224 learned_addr learned my addr 172.21.15.31:0/3924915224 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.335+0000 7f8119d9b700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 0x7f811c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f811a59c700 1 -- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c069f20 msgr2=0x7f811c151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f811a59c700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c069f20 0x7f811c151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f811a59c700 1 -- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 msgr2=0x7f811c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f811a59c700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 0x7f811c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f811a59c700 1 -- 172.21.15.31:0/3924915224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114009ae0 con 0x7f811c0680f0 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f811ad9d700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c069f20 0x7f811c151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f8119d9b700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 0x7f811c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f811a59c700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c0680f0 0x7f811c09dde0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f810400e930 tx=0x7f81040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f81127fc700 1 -- 172.21.15.31:0/3924915224 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104013680 con 0x7f811c0680f0 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f81127fc700 1 -- 172.21.15.31:0/3924915224 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81040137e0 con 0x7f811c0680f0 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f81127fc700 1 -- 172.21.15.31:0/3924915224 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104013b80 con 0x7f811c0680f0 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c009420 con 0x7f811c0680f0 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.336+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c09e840 con 0x7f811c0680f0 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.337+0000 7f81127fc700 1 -- 172.21.15.31:0/3924915224 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f810400c3e0 con 0x7f811c0680f0 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.337+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811c0651b0 con 0x7f811c0680f0 2024-04-18T10:39:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.337+0000 7f81127fc700 1 -- 172.21.15.31:0/3924915224 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f810405b2c0 con 0x7f811c0680f0 2024-04-18T10:39:05.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.341+0000 7f81127fc700 1 -- 172.21.15.31:0/3924915224 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f810403d080 con 0x7f811c0680f0 2024-04-18T10:39:05.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.505+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f811c0aba40 con 0x7f811c0680f0 2024-04-18T10:39:05.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.505+0000 7f81127fc700 1 -- 172.21.15.31:0/3924915224 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f810403b970 con 0x7f811c0680f0 2024-04-18T10:39:05.505 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 >> v1:172.21.15.31:6816/46601 conn(0x7f80fc046010 legacy=0x7f80fc0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c0680f0 msgr2=0x7f811c09dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c0680f0 0x7f811c09dde0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f810400e930 tx=0x7f81040091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 shutdown_connections 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f811c069f20 0x7f811c151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f811c0680f0 0x7f811c09dde0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 --2- 172.21.15.31:0/3924915224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f811c069b50 0x7f811c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 >> 172.21.15.31:0/3924915224 conn(0x7f811c06dd70 msgr2=0x7f811c064920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 shutdown_connections 2024-04-18T10:39:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.507+0000 7f8120d7e700 1 -- 172.21.15.31:0/3924915224 wait complete. 2024-04-18T10:39:05.518 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:39:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.642+0000 7fe19ffbf700 1 Processor -- start 2024-04-18T10:39:05.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19ffbf700 1 -- start start 2024-04-18T10:39:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19ffbf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19ffbf700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe1980a7130 0x7fe1981462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19ffbf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980a3540 con 0x7fe1980a6d60 2024-04-18T10:39:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19ffbf700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980a37e0 con 0x7fe1980a7130 2024-04-18T10:39:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19ffbf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980a5d60 con 0x7fe19806ecf0 2024-04-18T10:39:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19dd5b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19e55c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe1980a7130 0x7fe1981462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19d55a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe1980a6d60 0x7fe198142b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44550/0 (socket says 172.21.15.31:44550) 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19d55a700 1 -- 172.21.15.31:0/1335072470 learned_addr learned my addr 172.21.15.31:0/1335072470 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19e55c700 1 -- 172.21.15.31:0/1335072470 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 msgr2=0x7fe1980a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.643+0000 7fe19e55c700 1 --2- 172.21.15.31:0/1335072470 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19e55c700 1 -- 172.21.15.31:0/1335072470 >> v1:172.21.15.31:6789/0 conn(0x7fe1980a6d60 legacy=0x7fe198142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19e55c700 1 -- 172.21.15.31:0/1335072470 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19806d980 con 0x7fe1980a7130 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19cd59700 1 -- 172.21.15.31:0/1335072470 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576362804 0 0) 0x7fe1980a3540 con 0x7fe1980a6d60 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19e55c700 1 --2- 172.21.15.31:0/1335072470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980a7130 0x7fe1981462a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe190009e60 tx=0x7fe190009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e218ff8e26276b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19cd59700 1 -- 172.21.15.31:0/1335072470 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000e070 con 0x7fe1980a7130 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19cd59700 1 -- 172.21.15.31:0/1335072470 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000bb60 con 0x7fe1980a7130 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19cd59700 1 -- 172.21.15.31:0/1335072470 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190012430 con 0x7fe1980a7130 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19ffbf700 1 -- 172.21.15.31:0/1335072470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980a7130 msgr2=0x7fe1981462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19ffbf700 1 --2- 172.21.15.31:0/1335072470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980a7130 0x7fe1981462a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe190009e60 tx=0x7fe190009780 comp rx=0 tx=0).stop 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19ffbf700 1 -- 172.21.15.31:0/1335072470 shutdown_connections 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19ffbf700 1 --2- 172.21.15.31:0/1335072470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980a7130 0x7fe1981462a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19ffbf700 1 --2- 172.21.15.31:0/1335072470 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.644+0000 7fe19ffbf700 1 -- 172.21.15.31:0/1335072470 >> 172.21.15.31:0/1335072470 conn(0x7fe1980679e0 msgr2=0x7fe198067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:05.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.645+0000 7fe19ffbf700 1 -- 172.21.15.31:0/1335072470 shutdown_connections 2024-04-18T10:39:05.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.645+0000 7fe19ffbf700 1 -- 172.21.15.31:0/1335072470 wait complete. 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.646+0000 7fe19ffbf700 1 Processor -- start 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.646+0000 7fe19ffbf700 1 -- start start 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19ffbf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19ffbf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1980a6d60 0x7fe1980aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19ffbf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980a7130 0x7fe1980a78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19ffbf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980ab200 con 0x7fe1980a7130 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19ffbf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980ab7f0 con 0x7fe1980a6d60 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19ffbf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980a9bd0 con 0x7fe19806ecf0 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19dd5b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19d55a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1980a6d60 0x7fe1980aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19dd5b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:36642/0 (socket says 172.21.15.31:36642) 2024-04-18T10:39:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19dd5b700 1 -- 172.21.15.31:0/2870881107 learned_addr learned my addr 172.21.15.31:0/2870881107 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19e55c700 1 --2- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980a7130 0x7fe1980a78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19dd5b700 1 -- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1980a6d60 msgr2=0x7fe1980aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19dd5b700 1 --2- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1980a6d60 0x7fe1980aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19dd5b700 1 -- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980a7130 msgr2=0x7fe1980a78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19dd5b700 1 --2- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980a7130 0x7fe1980a78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19dd5b700 1 -- 172.21.15.31:0/2870881107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190009a20 con 0x7fe19806ecf0 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19d55a700 1 --2- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1980a6d60 0x7fe1980aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19dd5b700 1 --2- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980ac240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe19400ec80 tx=0x7fe1940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe18dffb700 1 -- 172.21.15.31:0/2870881107 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19400c850 con 0x7fe19806ecf0 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe18dffb700 1 -- 172.21.15.31:0/2870881107 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19400c9b0 con 0x7fe19806ecf0 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1980a9e90 con 0x7fe19806ecf0 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.647+0000 7fe18dffb700 1 -- 172.21.15.31:0/2870881107 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19400cd50 con 0x7fe19806ecf0 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.648+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1980a8be0 con 0x7fe19806ecf0 2024-04-18T10:39:05.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.648+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1980abf60 con 0x7fe19806ecf0 2024-04-18T10:39:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.649+0000 7fe18dffb700 1 -- 172.21.15.31:0/2870881107 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fe194013680 con 0x7fe19806ecf0 2024-04-18T10:39:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.649+0000 7fe18dffb700 1 -- 172.21.15.31:0/2870881107 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fe19405ba60 con 0x7fe19806ecf0 2024-04-18T10:39:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.652+0000 7fe18dffb700 1 -- 172.21.15.31:0/2870881107 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe194039dd0 con 0x7fe19806ecf0 2024-04-18T10:39:05.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.815+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1980651b0 con 0x7fe19806ecf0 2024-04-18T10:39:05.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.815+0000 7fe18dffb700 1 -- 172.21.15.31:0/2870881107 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe194021070 con 0x7fe19806ecf0 2024-04-18T10:39:05.815 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:39:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 >> v1:172.21.15.31:6816/46601 conn(0x7fe17c046090 legacy=0x7fe17c048540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 msgr2=0x7fe1980ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 --2- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980ac240 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe19400ec80 tx=0x7fe1940091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 shutdown_connections 2024-04-18T10:39:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 --2- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe19806ecf0 0x7fe1980ac240 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 --2- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1980a7130 0x7fe1980a78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 --2- 172.21.15.31:0/2870881107 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe1980a6d60 0x7fe1980aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 >> 172.21.15.31:0/2870881107 conn(0x7fe1980679e0 msgr2=0x7fe1980b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 shutdown_connections 2024-04-18T10:39:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.817+0000 7fe19ffbf700 1 -- 172.21.15.31:0/2870881107 wait complete. 2024-04-18T10:39:05.828 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:39:05.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.951+0000 7f3bb2a39700 1 Processor -- start 2024-04-18T10:39:05.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.951+0000 7f3bb2a39700 1 -- start start 2024-04-18T10:39:05.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3bb2a39700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3bac06eaa0 0x7f3bac0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3bb2a39700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3bb2a39700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac0a42d0 con 0x7f3bac069420 2024-04-18T10:39:05.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3bb2a39700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac0a3af0 con 0x7f3bac06eaa0 2024-04-18T10:39:05.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3bb2a39700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0a4520 con 0x7f3bac068af0 2024-04-18T10:39:05.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3babfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3bac06eaa0 0x7f3bac0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3bab7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3bb0fd6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3bac069420 0x7f3bac1485c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44564/0 (socket says 172.21.15.31:44564) 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3bb0fd6700 1 -- 172.21.15.31:0/2594826091 learned_addr learned my addr 172.21.15.31:0/2594826091 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3babfff700 1 -- 172.21.15.31:0/2594826091 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 msgr2=0x7f3bac068ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3babfff700 1 --2- 172.21.15.31:0/2594826091 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac068ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3babfff700 1 -- 172.21.15.31:0/2594826091 >> v1:172.21.15.31:6789/0 conn(0x7f3bac069420 legacy=0x7f3bac1485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3baaffd700 1 -- 172.21.15.31:0/2594826091 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605610138 0 0) 0x7f3bac0a42d0 con 0x7f3bac069420 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3babfff700 1 -- 172.21.15.31:0/2594826091 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0a47c0 con 0x7f3bac06eaa0 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3bab7fe700 1 --2- 172.21.15.31:0/2594826091 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.952+0000 7f3babfff700 1 --2- 172.21.15.31:0/2594826091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac06eaa0 0x7f3bac0b0520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0098e0 tx=0x7f3b9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393fd2a7b53f9a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3baaffd700 1 -- 172.21.15.31:0/2594826091 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00b640 con 0x7f3bac06eaa0 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3baaffd700 1 -- 172.21.15.31:0/2594826091 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c00b7a0 con 0x7f3bac06eaa0 2024-04-18T10:39:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3baaffd700 1 -- 172.21.15.31:0/2594826091 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00bb40 con 0x7f3bac06eaa0 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2594826091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac06eaa0 msgr2=0x7f3bac0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3bb2a39700 1 --2- 172.21.15.31:0/2594826091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac06eaa0 0x7f3bac0b0520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0098e0 tx=0x7f3b9c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2594826091 shutdown_connections 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3bb2a39700 1 --2- 172.21.15.31:0/2594826091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac06eaa0 0x7f3bac0b0520 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3bb2a39700 1 --2- 172.21.15.31:0/2594826091 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac068ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2594826091 >> 172.21.15.31:0/2594826091 conn(0x7f3bac0679e0 msgr2=0x7f3bac067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2594826091 shutdown_connections 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.953+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2594826091 wait complete. 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.954+0000 7f3bb2a39700 1 Processor -- start 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.954+0000 7f3bb2a39700 1 -- start start 2024-04-18T10:39:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bb2a39700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac096f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bb2a39700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac069420 0x7f3bac13f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bb2a39700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3bac06eaa0 0x7f3bac13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bb2a39700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0995c0 con 0x7f3bac069420 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bb2a39700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0a27a0 con 0x7f3bac06eaa0 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bb2a39700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac098950 con 0x7f3bac068af0 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3babfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac096f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3babfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac096f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:36666/0 (socket says 172.21.15.31:36666) 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bab7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac069420 0x7f3bac13f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3babfff700 1 -- 172.21.15.31:0/2568505938 learned_addr learned my addr 172.21.15.31:0/2568505938 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bb0fd6700 1 --2- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3bac06eaa0 0x7f3bac13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bab7fe700 1 -- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 msgr2=0x7f3bac096f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bab7fe700 1 --2- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac096f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bab7fe700 1 -- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3bac06eaa0 msgr2=0x7f3bac13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bab7fe700 1 --2- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3bac06eaa0 0x7f3bac13fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bab7fe700 1 -- 172.21.15.31:0/2568505938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94009420 con 0x7f3bac069420 2024-04-18T10:39:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bb0fd6700 1 --2- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3bac06eaa0 0x7f3bac13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:05.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3bab7fe700 1 --2- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac069420 0x7f3bac13f930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400ecb0 tx=0x7f3b940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:05.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.955+0000 7f3ba3fff700 1 -- 172.21.15.31:0/2568505938 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9400c8e0 con 0x7f3bac069420 2024-04-18T10:39:05.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.956+0000 7f3ba3fff700 1 -- 172.21.15.31:0/2568505938 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9400ca40 con 0x7f3bac069420 2024-04-18T10:39:05.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.956+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c009420 con 0x7f3bac069420 2024-04-18T10:39:05.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.956+0000 7f3ba3fff700 1 -- 172.21.15.31:0/2568505938 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9400cde0 con 0x7f3bac069420 2024-04-18T10:39:05.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.956+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac1403b0 con 0x7f3bac069420 2024-04-18T10:39:05.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.957+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac0651b0 con 0x7f3bac069420 2024-04-18T10:39:05.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.957+0000 7f3ba3fff700 1 -- 172.21.15.31:0/2568505938 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f3b94013680 con 0x7f3bac069420 2024-04-18T10:39:05.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.957+0000 7f3ba3fff700 1 -- 172.21.15.31:0/2568505938 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3b9405b4d0 con 0x7f3bac069420 2024-04-18T10:39:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:05.961+0000 7f3ba3fff700 1 -- 172.21.15.31:0/2568505938 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3b940396f0 con 0x7f3bac069420 2024-04-18T10:39:06.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.124+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bac0a28e0 con 0x7f3bac069420 2024-04-18T10:39:06.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.124+0000 7f3ba3fff700 1 -- 172.21.15.31:0/2568505938 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b9403cee0 con 0x7f3bac069420 2024-04-18T10:39:06.124 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:39:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 >> v1:172.21.15.31:6816/46601 conn(0x7f3b8c046010 legacy=0x7f3b8c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac069420 msgr2=0x7f3bac13f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 --2- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac069420 0x7f3bac13f930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400ecb0 tx=0x7f3b940091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 shutdown_connections 2024-04-18T10:39:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 --2- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3bac068af0 0x7f3bac096f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 --2- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3bac06eaa0 0x7f3bac13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 --2- 172.21.15.31:0/2568505938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3bac069420 0x7f3bac13f930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 >> 172.21.15.31:0/2568505938 conn(0x7f3bac0679e0 msgr2=0x7f3bac064920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 shutdown_connections 2024-04-18T10:39:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.126+0000 7f3bb2a39700 1 -- 172.21.15.31:0/2568505938 wait complete. 2024-04-18T10:39:06.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:39:06.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.258+0000 7f4e68a64700 1 Processor -- start 2024-04-18T10:39:06.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.258+0000 7f4e68a64700 1 -- start start 2024-04-18T10:39:06.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e68a64700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e640680f0 0x7f4e640a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e68a64700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069b50 0x7f4e6406ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e68a64700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069f20 0x7f4e6406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e68a64700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e640a3430 con 0x7f4e640680f0 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e68a64700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6406a480 con 0x7f4e64069f20 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e68a64700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6406a720 con 0x7f4e64069b50 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e6259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e640680f0 0x7f4e640a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e61d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069b50 0x7f4e6406ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e62d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069f20 0x7f4e6406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e6259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4e640680f0 0x7f4e640a3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43408/0 (socket says 172.21.15.31:43408) 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e6259c700 1 -- 172.21.15.31:0/4151114464 learned_addr learned my addr 172.21.15.31:0/4151114464 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.259+0000 7f4e61d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069b50 0x7f4e6406ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:36680/0 (socket says 172.21.15.31:36680) 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e6259c700 1 -- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069b50 msgr2=0x7f4e6406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e6259c700 1 --2- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069b50 0x7f4e6406ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e6259c700 1 -- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069f20 msgr2=0x7f4e6406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e6259c700 1 --2- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069f20 0x7f4e6406ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e6259c700 1 -- 172.21.15.31:0/4151114464 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6406aa80 con 0x7f4e640680f0 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e62d9d700 1 --2- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069f20 0x7f4e6406ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e61d9b700 1 --2- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069b50 0x7f4e6406ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e6259c700 1 --2- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e640680f0 0x7f4e640a3b30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e540099b0 tx=0x7f4e54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2275668389659328 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e6159a700 1 -- 172.21.15.31:0/4151114464 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400b680 con 0x7f4e640680f0 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e6159a700 1 -- 172.21.15.31:0/4151114464 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5400b7e0 con 0x7f4e640680f0 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e6159a700 1 -- 172.21.15.31:0/4151114464 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400bb80 con 0x7f4e640680f0 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e68a64700 1 -- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e640680f0 msgr2=0x7f4e640a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.260+0000 7f4e68a64700 1 --2- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e640680f0 0x7f4e640a3b30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4e540099b0 tx=0x7f4e54009250 comp rx=0 tx=0).stop 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.261+0000 7f4e68a64700 1 -- 172.21.15.31:0/4151114464 shutdown_connections 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.261+0000 7f4e68a64700 1 --2- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069f20 0x7f4e6406ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.261+0000 7f4e68a64700 1 --2- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e640680f0 0x7f4e640a3b30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.261+0000 7f4e68a64700 1 --2- 172.21.15.31:0/4151114464 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069b50 0x7f4e6406ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.261+0000 7f4e68a64700 1 -- 172.21.15.31:0/4151114464 >> 172.21.15.31:0/4151114464 conn(0x7f4e6406dd70 msgr2=0x7f4e640679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.261+0000 7f4e68a64700 1 -- 172.21.15.31:0/4151114464 shutdown_connections 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.261+0000 7f4e68a64700 1 -- 172.21.15.31:0/4151114464 wait complete. 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e68a64700 1 Processor -- start 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e68a64700 1 -- start start 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e68a64700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e640680f0 0x7f4e64098800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e68a64700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069b50 0x7f4e6413e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e68a64700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069f20 0x7f4e6413ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e68a64700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e64098100 con 0x7f4e640680f0 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e68a64700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640ac0a0 con 0x7f4e64069b50 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e68a64700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640ac2d0 con 0x7f4e64069f20 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e61d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069b50 0x7f4e6413e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e61d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069b50 0x7f4e6413e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56684/0 (socket says 172.21.15.31:56684) 2024-04-18T10:39:06.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e61d9b700 1 -- 172.21.15.31:0/2135329066 learned_addr learned my addr 172.21.15.31:0/2135329066 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e6259c700 1 --2- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e640680f0 0x7f4e64098800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.262+0000 7f4e62d9d700 1 --2- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069f20 0x7f4e6413ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e61d9b700 1 -- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069f20 msgr2=0x7f4e6413ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e61d9b700 1 --2- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069f20 0x7f4e6413ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e61d9b700 1 -- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e640680f0 msgr2=0x7f4e64098800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e61d9b700 1 --2- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e640680f0 0x7f4e64098800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e61d9b700 1 -- 172.21.15.31:0/2135329066 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c009420 con 0x7f4e64069b50 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e61d9b700 1 --2- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069b50 0x7f4e6413e900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00ecb0 tx=0x7f4e4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e5a7fc700 1 -- 172.21.15.31:0/2135329066 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00c920 con 0x7f4e64069b50 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e5a7fc700 1 -- 172.21.15.31:0/2135329066 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00ca80 con 0x7f4e64069b50 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e5a7fc700 1 -- 172.21.15.31:0/2135329066 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00ce00 con 0x7f4e64069b50 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c009a20 con 0x7f4e64069b50 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.263+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e540094f0 con 0x7f4e64069b50 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.264+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e640651b0 con 0x7f4e64069b50 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.264+0000 7f4e5a7fc700 1 -- 172.21.15.31:0/2135329066 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f4e4c013680 con 0x7f4e64069b50 2024-04-18T10:39:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.264+0000 7f4e5a7fc700 1 -- 172.21.15.31:0/2135329066 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f4e4c05b3f0 con 0x7f4e64069b50 2024-04-18T10:39:06.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.268+0000 7f4e5a7fc700 1 -- 172.21.15.31:0/2135329066 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4e4c0396d0 con 0x7f4e64069b50 2024-04-18T10:39:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.462+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e640aabe0 con 0x7f4e64069b50 2024-04-18T10:39:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.462+0000 7f4e5a7fc700 1 -- 172.21.15.31:0/2135329066 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3664 (secure 0 0 0) 0x7f4e4c03cec0 con 0x7f4e64069b50 2024-04-18T10:39:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:39:06.463 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":24422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3164763612","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3164763612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6818/18914605","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":18914605}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:38:55.584822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24428":{"gid":24428,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/1866692589","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":1866692589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:39:06.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 >> v1:172.21.15.31:6816/46601 conn(0x7f4e44046010 legacy=0x7f4e440484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069b50 msgr2=0x7f4e6413e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 --2- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069b50 0x7f4e6413e900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00ecb0 tx=0x7f4e4c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 shutdown_connections 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 --2- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f4e64069f20 0x7f4e6413ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 --2- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e640680f0 0x7f4e64098800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 --2- 172.21.15.31:0/2135329066 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f4e64069b50 0x7f4e6413e900 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 >> 172.21.15.31:0/2135329066 conn(0x7f4e6406dd70 msgr2=0x7f4e640ab0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 shutdown_connections 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.464+0000 7f4e68a64700 1 -- 172.21.15.31:0/2135329066 wait complete. 2024-04-18T10:39:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-04-18T10:39:06.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:39:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb59a8b9700 1 Processor -- start 2024-04-18T10:39:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb59a8b9700 1 -- start start 2024-04-18T10:39:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb59a8b9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb5940a3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb59a8b9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb594068540 0x7fb594149640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb59a8b9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5940a3b50 con 0x7fb5940679e0 2024-04-18T10:39:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb59a8b9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940a45d0 con 0x7fb594068540 2024-04-18T10:39:06.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb59a8b9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb59406e070 con 0x7fb594069200 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb593fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb5940a3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb598e56700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb594068540 0x7fb594149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb5937fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb5940679e0 0x7fb594067e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44574/0 (socket says 172.21.15.31:44574) 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.597+0000 7fb5937fe700 1 -- 172.21.15.31:0/1209858920 learned_addr learned my addr 172.21.15.31:0/1209858920 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb598e56700 1 -- 172.21.15.31:0/1209858920 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 msgr2=0x7fb5940a3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb598e56700 1 --2- 172.21.15.31:0/1209858920 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb5940a3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb598e56700 1 -- 172.21.15.31:0/1209858920 >> v1:172.21.15.31:6789/0 conn(0x7fb5940679e0 legacy=0x7fb594067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb598e56700 1 -- 172.21.15.31:0/1209858920 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59406f250 con 0x7fb594068540 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb592ffd700 1 -- 172.21.15.31:0/1209858920 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655346415 0 0) 0x7fb5940a3b50 con 0x7fb5940679e0 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb593fff700 1 --2- 172.21.15.31:0/1209858920 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb5940a3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb598e56700 1 --2- 172.21.15.31:0/1209858920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 0x7fb594149640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009e60 tx=0x7fb58c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcecc05042f32f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb592ffd700 1 -- 172.21.15.31:0/1209858920 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c00e070 con 0x7fb594068540 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb592ffd700 1 -- 172.21.15.31:0/1209858920 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c00bb60 con 0x7fb594068540 2024-04-18T10:39:06.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.598+0000 7fb592ffd700 1 -- 172.21.15.31:0/1209858920 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c012430 con 0x7fb594068540 2024-04-18T10:39:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.599+0000 7fb59a8b9700 1 -- 172.21.15.31:0/1209858920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 msgr2=0x7fb594149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.599+0000 7fb59a8b9700 1 --2- 172.21.15.31:0/1209858920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 0x7fb594149640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009e60 tx=0x7fb58c009780 comp rx=0 tx=0).stop 2024-04-18T10:39:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.599+0000 7fb59a8b9700 1 -- 172.21.15.31:0/1209858920 shutdown_connections 2024-04-18T10:39:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.599+0000 7fb59a8b9700 1 --2- 172.21.15.31:0/1209858920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 0x7fb594149640 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.599+0000 7fb59a8b9700 1 --2- 172.21.15.31:0/1209858920 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb5940a3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.599+0000 7fb59a8b9700 1 -- 172.21.15.31:0/1209858920 >> 172.21.15.31:0/1209858920 conn(0x7fb59406ae80 msgr2=0x7fb594068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.599+0000 7fb59a8b9700 1 -- 172.21.15.31:0/1209858920 shutdown_connections 2024-04-18T10:39:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.599+0000 7fb59a8b9700 1 -- 172.21.15.31:0/1209858920 wait complete. 2024-04-18T10:39:06.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb59a8b9700 1 Processor -- start 2024-04-18T10:39:06.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb59a8b9700 1 -- start start 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb59a8b9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5940679e0 0x7fb594098fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb59a8b9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 0x7fb594140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb59a8b9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb594140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb59a8b9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940adfc0 con 0x7fb594068540 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb59a8b9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb594099500 con 0x7fb5940679e0 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb59a8b9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb594099c40 con 0x7fb594069200 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb598e56700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb594140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb5937fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 0x7fb594140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb598e56700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb594140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:36716/0 (socket says 172.21.15.31:36716) 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb598e56700 1 -- 172.21.15.31:0/3319847134 learned_addr learned my addr 172.21.15.31:0/3319847134 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.600+0000 7fb593fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5940679e0 0x7fb594098fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb5937fe700 1 -- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 msgr2=0x7fb594140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb5937fe700 1 --2- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb594140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb5937fe700 1 -- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5940679e0 msgr2=0x7fb594098fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb5937fe700 1 --2- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5940679e0 0x7fb594098fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb5937fe700 1 -- 172.21.15.31:0/3319847134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584009420 con 0x7fb594068540 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb598e56700 1 --2- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb594140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb593fff700 1 --2- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5940679e0 0x7fb594098fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb5937fe700 1 --2- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 0x7fb594140920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb5880011e0 tx=0x7fb588007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb57bfff700 1 -- 172.21.15.31:0/3319847134 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800cea0 con 0x7fb594068540 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb57bfff700 1 -- 172.21.15.31:0/3319847134 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588005b30 con 0x7fb594068540 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58c009a20 con 0x7fb594068540 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb57bfff700 1 -- 172.21.15.31:0/3319847134 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5880070d0 con 0x7fb594068540 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.601+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb594099960 con 0x7fb594068540 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.602+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5940651b0 con 0x7fb594068540 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.602+0000 7fb57bfff700 1 -- 172.21.15.31:0/3319847134 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fb588007500 con 0x7fb594068540 2024-04-18T10:39:06.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.603+0000 7fb57bfff700 1 -- 172.21.15.31:0/3319847134 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fb58805a4c0 con 0x7fb594068540 2024-04-18T10:39:06.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.606+0000 7fb57bfff700 1 -- 172.21.15.31:0/3319847134 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fb5880386e0 con 0x7fb594068540 2024-04-18T10:39:06.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.774+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5940ae670 con 0x7fb594068540 2024-04-18T10:39:06.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.774+0000 7fb57bfff700 1 -- 172.21.15.31:0/3319847134 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11635 (secure 0 0 0) 0x7fb588017030 con 0x7fb594068540 2024-04-18T10:39:06.774 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:39:06.774 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":41,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:38:58.600312+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:39:06.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 >> v1:172.21.15.31:6816/46601 conn(0x7fb580046010 legacy=0x7fb5800484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 msgr2=0x7fb594140920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 --2- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 0x7fb594140920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb5880011e0 tx=0x7fb588007d10 comp rx=0 tx=0).stop 2024-04-18T10:39:06.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 shutdown_connections 2024-04-18T10:39:06.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 --2- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb594069200 0x7fb594140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 --2- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb5940679e0 0x7fb594098fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 --2- 172.21.15.31:0/3319847134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb594068540 0x7fb594140920 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 >> 172.21.15.31:0/3319847134 conn(0x7fb59406ae80 msgr2=0x7fb594144310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:06.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 shutdown_connections 2024-04-18T10:39:06.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.776+0000 7fb59a8b9700 1 -- 172.21.15.31:0/3319847134 wait complete. 2024-04-18T10:39:06.788 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:39:06.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.908+0000 7f32022dd700 1 Processor -- start 2024-04-18T10:39:06.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.908+0000 7f32022dd700 1 -- start start 2024-04-18T10:39:06.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f32022dd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc0aa8e0 0x7f31fc0a8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f32022dd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc13efd0 0x7f31fc141be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f32022dd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31fc142120 0x7f31fc1425c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f32022dd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc0ab140 con 0x7f31fc142120 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f32022dd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0a8e60 con 0x7f31fc0aa8e0 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f32022dd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc13e660 con 0x7f31fc13efd0 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f320087a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31fc142120 0x7f31fc1425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f31fb7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc13efd0 0x7f31fc141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f320087a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f31fc142120 0x7f31fc1425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43442/0 (socket says 172.21.15.31:43442) 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f320087a700 1 -- 172.21.15.31:0/3435181112 learned_addr learned my addr 172.21.15.31:0/3435181112 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f31fb7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc13efd0 0x7f31fc141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:36724/0 (socket says 172.21.15.31:36724) 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f31fbfff700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc0aa8e0 0x7f31fc0a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f320087a700 1 -- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc13efd0 msgr2=0x7f31fc141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f320087a700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc13efd0 0x7f31fc141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f320087a700 1 -- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc0aa8e0 msgr2=0x7f31fc0a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f320087a700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc0aa8e0 0x7f31fc0a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f320087a700 1 -- 172.21.15.31:0/3435181112 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0a7160 con 0x7f31fc142120 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.909+0000 7f31fb7fe700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc13efd0 0x7f31fc141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f31fbfff700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc0aa8e0 0x7f31fc0a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f320087a700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc142120 0x7f31fc1425c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009f50 tx=0x7f31f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ede8cb12e5d8f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f31faffd700 1 -- 172.21.15.31:0/3435181112 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400e070 con 0x7f31fc142120 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f31faffd700 1 -- 172.21.15.31:0/3435181112 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f400b910 con 0x7f31fc142120 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f31faffd700 1 -- 172.21.15.31:0/3435181112 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f40092e0 con 0x7f31fc142120 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f32022dd700 1 -- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc142120 msgr2=0x7f31fc1425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f32022dd700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc142120 0x7f31fc1425c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009f50 tx=0x7f31f4009840 comp rx=0 tx=0).stop 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f32022dd700 1 -- 172.21.15.31:0/3435181112 shutdown_connections 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f32022dd700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc142120 0x7f31fc1425c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f32022dd700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc0aa8e0 0x7f31fc0a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f32022dd700 1 --2- 172.21.15.31:0/3435181112 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc13efd0 0x7f31fc141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.910+0000 7f32022dd700 1 -- 172.21.15.31:0/3435181112 >> 172.21.15.31:0/3435181112 conn(0x7f31fc069450 msgr2=0x7f31fc063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.911+0000 7f32022dd700 1 -- 172.21.15.31:0/3435181112 shutdown_connections 2024-04-18T10:39:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.911+0000 7f32022dd700 1 -- 172.21.15.31:0/3435181112 wait complete. 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.911+0000 7f32022dd700 1 Processor -- start 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f32022dd700 1 -- start start 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f32022dd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc0aa8e0 0x7f31fc0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f32022dd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc13efd0 0x7f31fc139510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f32022dd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc142120 0x7f31fc139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f32022dd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc14f970 con 0x7f31fc0aa8e0 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f32022dd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc14fc10 con 0x7f31fc13efd0 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f32022dd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0b51b0 con 0x7f31fc142120 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f320087a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc142120 0x7f31fc139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f31fb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc13efd0 0x7f31fc139510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f320087a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc142120 0x7f31fc139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:36734/0 (socket says 172.21.15.31:36734) 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f31fb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc13efd0 0x7f31fc139510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56702/0 (socket says 172.21.15.31:56702) 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f320087a700 1 -- 172.21.15.31:0/1426437147 learned_addr learned my addr 172.21.15.31:0/1426437147 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.912+0000 7f31fbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc0aa8e0 0x7f31fc0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f320087a700 1 -- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc13efd0 msgr2=0x7f31fc139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f320087a700 1 --2- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc13efd0 0x7f31fc139510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f320087a700 1 -- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc0aa8e0 msgr2=0x7f31fc0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f320087a700 1 --2- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc0aa8e0 0x7f31fc0aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f320087a700 1 -- 172.21.15.31:0/1426437147 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec009420 con 0x7f31fc142120 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f31fbfff700 1 --2- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc0aa8e0 0x7f31fc0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f31fb7fe700 1 --2- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc13efd0 0x7f31fc139510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f320087a700 1 --2- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc142120 0x7f31fc139a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0ab280 tx=0x7f31f4018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f31f3fff700 1 -- 172.21.15.31:0/1426437147 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4007ac0 con 0x7f31fc142120 2024-04-18T10:39:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f31f3fff700 1 -- 172.21.15.31:0/1426437147 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f4007c40 con 0x7f31fc142120 2024-04-18T10:39:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e4009420 con 0x7f31fc142120 2024-04-18T10:39:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f31f3fff700 1 -- 172.21.15.31:0/1426437147 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f401d420 con 0x7f31fc142120 2024-04-18T10:39:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.913+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f4009ae0 con 0x7f31fc142120 2024-04-18T10:39:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.914+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc064920 con 0x7f31fc142120 2024-04-18T10:39:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.914+0000 7f31f3fff700 1 -- 172.21.15.31:0/1426437147 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f31f4003040 con 0x7f31fc142120 2024-04-18T10:39:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.914+0000 7f31f3fff700 1 -- 172.21.15.31:0/1426437147 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f31f405c950 con 0x7f31fc142120 2024-04-18T10:39:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:06.918+0000 7f31f3fff700 1 -- 172.21.15.31:0/1426437147 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f31f4028a20 con 0x7f31fc142120 2024-04-18T10:39:07.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.108+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31fc141f00 con 0x7f31fc142120 2024-04-18T10:39:07.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.109+0000 7f31f3fff700 1 -- 172.21.15.31:0/1426437147 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3664 (secure 0 0 0) 0x7f31f4028850 con 0x7f31fc142120 2024-04-18T10:39:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:39:07.109 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":24422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3164763612","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3164763612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6818/18914605","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":18914605}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:38:55.584822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24428":{"gid":24428,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/1866692589","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":1866692589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.110+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 >> v1:172.21.15.31:6816/46601 conn(0x7f31dc046040 legacy=0x7f31dc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.110+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc142120 msgr2=0x7f31fc139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.110+0000 7f32022dd700 1 --2- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc142120 0x7f31fc139a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0ab280 tx=0x7f31f4018000 comp rx=0 tx=0).stop 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.111+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 shutdown_connections 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.111+0000 7f32022dd700 1 --2- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f31fc142120 0x7f31fc139a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.111+0000 7f32022dd700 1 --2- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31fc0aa8e0 0x7f31fc0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.111+0000 7f32022dd700 1 --2- 172.21.15.31:0/1426437147 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f31fc13efd0 0x7f31fc139510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.111+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 >> 172.21.15.31:0/1426437147 conn(0x7f31fc069450 msgr2=0x7f31fc1408a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.111+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 shutdown_connections 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.111+0000 7f32022dd700 1 -- 172.21.15.31:0/1426437147 wait complete. 2024-04-18T10:39:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-04-18T10:39:07.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-18T10:36:08.987612+0000', 'modified': '2024-04-18T10:38:55.584822+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 36, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24428}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_24428': {'gid': 24428, 'name': 'b', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6819/1866692589', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.31:6819', 'nonce': 1866692589}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-18T10:39:07.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-18T10:39:07.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-18T10:39:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.550+0000 7f9e4a954700 1 Processor -- start 2024-04-18T10:39:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.550+0000 7f9e4a954700 1 -- start start 2024-04-18T10:39:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e4a954700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e4406a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e4a954700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4070 0x7f9e440a4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e4a954700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e440696b0 con 0x7f9e440a4da0 2024-04-18T10:39:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e4a954700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44069950 con 0x7f9e440a4070 2024-04-18T10:39:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e4a954700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4406fcc0 con 0x7f9e44068340 2024-04-18T10:39:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4070 0x7f9e440a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e43fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e4406a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e48ef1700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9e440a4da0 0x7f9e4406eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44590/0 (socket says 172.21.15.31:44590) 2024-04-18T10:39:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e48ef1700 1 -- 172.21.15.31:0/917397532 learned_addr learned my addr 172.21.15.31:0/917397532 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:39:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e42ffd700 1 -- 172.21.15.31:0/917397532 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116656828 0 0) 0x7f9e440696b0 con 0x7f9e440a4da0 2024-04-18T10:39:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e42ffd700 1 -- 172.21.15.31:0/917397532 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e30003570 con 0x7f9e440a4da0 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e437fe700 1 -- 172.21.15.31:0/917397532 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 msgr2=0x7f9e4406a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e437fe700 1 --2- 172.21.15.31:0/917397532 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e4406a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e437fe700 1 -- 172.21.15.31:0/917397532 >> v1:172.21.15.31:6789/0 conn(0x7f9e440a4da0 legacy=0x7f9e4406eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e437fe700 1 -- 172.21.15.31:0/917397532 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440b06f0 con 0x7f9e440a4070 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e43fff700 1 --2- 172.21.15.31:0/917397532 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e4406a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e437fe700 1 --2- 172.21.15.31:0/917397532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4070 0x7f9e440a4860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009940 tx=0x7f9e340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3590a464ffefee70 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.551+0000 7f9e42ffd700 1 -- 172.21.15.31:0/917397532 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34011630 con 0x7f9e440a4070 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e42ffd700 1 -- 172.21.15.31:0/917397532 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34011790 con 0x7f9e440a4070 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e42ffd700 1 -- 172.21.15.31:0/917397532 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34011b30 con 0x7f9e440a4070 2024-04-18T10:39:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e4a954700 1 -- 172.21.15.31:0/917397532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4070 msgr2=0x7f9e440a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e4a954700 1 --2- 172.21.15.31:0/917397532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4070 0x7f9e440a4860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009940 tx=0x7f9e340091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e4a954700 1 -- 172.21.15.31:0/917397532 shutdown_connections 2024-04-18T10:39:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e4a954700 1 --2- 172.21.15.31:0/917397532 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e4406a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e4a954700 1 --2- 172.21.15.31:0/917397532 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4070 0x7f9e440a4860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e4a954700 1 -- 172.21.15.31:0/917397532 >> 172.21.15.31:0/917397532 conn(0x7f9e4406bfc0 msgr2=0x7f9e440679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e4a954700 1 -- 172.21.15.31:0/917397532 shutdown_connections 2024-04-18T10:39:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.552+0000 7f9e4a954700 1 -- 172.21.15.31:0/917397532 wait complete. 2024-04-18T10:39:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.553+0000 7f9e4a954700 1 Processor -- start 2024-04-18T10:39:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.554+0000 7f9e4a954700 1 -- start start 2024-04-18T10:39:07.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.554+0000 7f9e4a954700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e44151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.554+0000 7f9e4a954700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440a4070 0x7f9e44152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.554+0000 7f9e4a954700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4da0 0x7f9e4414e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.554+0000 7f9e4a954700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44096e00 con 0x7f9e440a4070 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.554+0000 7f9e4a954700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440970e0 con 0x7f9e440a4da0 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.554+0000 7f9e4a954700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44152a60 con 0x7f9e44068340 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.554+0000 7f9e48ef1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4da0 0x7f9e4414e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440a4070 0x7f9e44152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e43fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e44151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e48ef1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4da0 0x7f9e4414e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56716/0 (socket says 172.21.15.31:56716) 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e48ef1700 1 -- 172.21.15.31:0/2559231614 learned_addr learned my addr 172.21.15.31:0/2559231614 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e43fff700 1 -- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4da0 msgr2=0x7f9e4414e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e43fff700 1 --2- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4da0 0x7f9e4414e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e43fff700 1 -- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440a4070 msgr2=0x7f9e44152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e43fff700 1 --2- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440a4070 0x7f9e44152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e43fff700 1 -- 172.21.15.31:0/2559231614 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c009420 con 0x7f9e44068340 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e437fe700 1 --2- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440a4070 0x7f9e44152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e48ef1700 1 --2- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4da0 0x7f9e4414e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e43fff700 1 --2- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e44151fe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00ec80 tx=0x7f9e2c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e3bfff700 1 -- 172.21.15.31:0/2559231614 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00c850 con 0x7f9e44068340 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e3bfff700 1 -- 172.21.15.31:0/2559231614 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c00c9b0 con 0x7f9e44068340 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e4a954700 1 -- 172.21.15.31:0/2559231614 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e34009420 con 0x7f9e44068340 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e3bfff700 1 -- 172.21.15.31:0/2559231614 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00cd70 con 0x7f9e44068340 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.555+0000 7f9e4a954700 1 -- 172.21.15.31:0/2559231614 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e440afa60 con 0x7f9e44068340 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.556+0000 7f9e3bfff700 1 -- 172.21.15.31:0/2559231614 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f9e2c013680 con 0x7f9e44068340 2024-04-18T10:39:07.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.556+0000 7f9e3bfff700 1 -- 172.21.15.31:0/2559231614 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f9e2c05b3d0 con 0x7f9e44068340 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.559+0000 7f9e53c6db80 1 Processor -- start 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.559+0000 7f9e53c6db80 1 -- start start 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.559+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 0x556570f8d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.559+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fc1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.559+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fc20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.559+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x556570ee47b0 con 0x556570facc10 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.559+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x556570ee2170 con 0x556570f8f150 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.559+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x556570eddf60 con 0x556570f8ea80 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fc1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e48ef1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fc20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fc1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43472/0 (socket says 172.21.15.31:43472) 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e48ef1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fc20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56720/0 (socket says 172.21.15.31:56720) 2024-04-18T10:39:07.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e437fe700 1 -- 172.21.15.31:0/854544176 learned_addr learned my addr 172.21.15.31:0/854544176 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e43fff700 1 --2- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 0x556570f8d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e437fe700 1 -- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 msgr2=0x556570f8d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e437fe700 1 --2- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 0x556570f8d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e437fe700 1 -- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 msgr2=0x556570fc20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e437fe700 1 --2- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fc20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e437fe700 1 -- 172.21.15.31:0/854544176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556570d5a040 con 0x556570facc10 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e48ef1700 1 --2- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fc20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e437fe700 1 --2- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fc1b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9e34013000 tx=0x7f9e34017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83eb37f77fd7f3f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e397fa700 1 -- 172.21.15.31:0/854544176 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3402a070 con 0x556570facc10 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e397fa700 1 -- 172.21.15.31:0/854544176 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34022040 con 0x556570facc10 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.560+0000 7f9e397fa700 1 -- 172.21.15.31:0/854544176 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34011630 con 0x556570facc10 2024-04-18T10:39:07.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 -- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 msgr2=0x556570fc1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fc1b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9e34013000 tx=0x7f9e34017000 comp rx=0 tx=0).stop 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 -- 172.21.15.31:0/854544176 shutdown_connections 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 0x556570f8d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fc20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/854544176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fc1b60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 -- 172.21.15.31:0/854544176 >> 172.21.15.31:0/854544176 conn(0x556570f8c3a0 msgr2=0x556570f8f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 -- 172.21.15.31:0/854544176 shutdown_connections 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 -- 172.21.15.31:0/854544176 wait complete. 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.561+0000 7f9e53c6db80 1 -- start start 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.562+0000 7f9e53c6db80 1 Processor -- start 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 0x556570fab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fabb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x556570e88d70 con 0x556570facc10 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x556570e88a10 con 0x556570f8f150 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x556570dd6290 con 0x556570f8ea80 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e53c6db80 10 client.0 _ll_register_callbacks cb 0x556570e8ae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fabb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fabb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56726/0 (socket says 172.21.15.31:56726) 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e437fe700 1 -- 172.21.15.31:0/3513114202 learned_addr learned my addr 172.21.15.31:0/3513114202 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e48ef1700 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e43fff700 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 0x556570fab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e437fe700 1 -- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 msgr2=0x556570fab650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e437fe700 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 0x556570fab650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e437fe700 1 -- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 msgr2=0x556570fac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e437fe700 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e437fe700 1 -- 172.21.15.31:0/3513114202 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e30003570 con 0x556570f8f150 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e48ef1700 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e437fe700 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fabb90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009f30 tx=0x7f9e3401e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82fcb65fae61e802 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e227fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3301/0 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e227fc700 1 -- 172.21.15.31:0/3513114202 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3402a040 con 0x556570f8f150 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e227fc700 1 -- 172.21.15.31:0/3513114202 <== mon.1 v2:172.21.15.31:3301/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f9e34034070 con 0x556570f8f150 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.563+0000 7f9e53c6db80 1 -- 172.21.15.31:0/3513114202 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556570f07690 con 0x556570f8f150 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e227fc700 1 -- 172.21.15.31:0/3513114202 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e3401be20 con 0x556570f8f150 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e53c6db80 10 client.24631 fetch_fsmap learned FSMap version 18 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e53c6db80 1 -- 172.21.15.31:0/3513114202 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=3+}) v3 -- 0x7f9e440b06f0 con 0x556570f8f150 2024-04-18T10:39:07.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e227fc700 1 -- 172.21.15.31:0/3513114202 <== mon.1 v2:172.21.15.31:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556570f07690 con 0x556570f8f150 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e227fc700 1 -- 172.21.15.31:0/3513114202 <== mon.1 v2:172.21.15.31:3301/0 5 ==== fsmap(e 18) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f9e34025070 con 0x556570f8f150 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e53c6db80 10 client.24631 fetch_fsmap finished waiting for FSMap version 18 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e53c6db80 10 client.24631 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e53c6db80 20 client.24631 populate_metadata read hostname 'smithi031' 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e53c6db80 4 client.24631 mds_command: new command op to 24428 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e53c6db80 1 -- 172.21.15.31:0/3513114202 --> v1:172.21.15.31:6819/1866692589 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556570e800e0 con 0x556570fb39e0 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.564+0000 7f9e227fc700 10 client.24631 ms_handle_connect on v1:172.21.15.31:6819/1866692589 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e227fc700 1 -- 172.21.15.31:0/3513114202 <== mds.0 v1:172.21.15.31:6819/1866692589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (unknown 0 0 610023333) 0x556570e800e0 con 0x556570fb39e0 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e227fc700 10 client.24631 handle_command_reply: tid=0 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 client.24631 shutdown 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 -- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 msgr2=0x556570fabb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fabb90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009f30 tx=0x7f9e3401e070 comp rx=0 tx=0).stop 2024-04-18T10:39:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 -- 172.21.15.31:0/3513114202 shutdown_connections 2024-04-18T10:39:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8ea80 0x556570fab650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e227fc700 0 client.24631 ms_handle_reset on v1:172.21.15.31:6819/1866692589 2024-04-18T10:39:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x556570fac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/3513114202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570fabb90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 -- 172.21.15.31:0/3513114202 >> 172.21.15.31:0/3513114202 conn(0x556570f8c3a0 msgr2=0x556570f89fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 -- 172.21.15.31:0/3513114202 shutdown_connections 2024-04-18T10:39:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 1 -- 172.21.15.31:0/3513114202 wait complete. 2024-04-18T10:39:07.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.565+0000 7f9e53c6db80 20 client.24631 trim_cache size 0 max 16384 2024-04-18T10:39:07.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.582+0000 7f9e53c6db80 1 Processor -- start 2024-04-18T10:39:07.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e53c6db80 1 -- start start 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570f8ea80 0x556570f84bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570f8f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570facc10 0x556570f8fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x556570fb7bf0 con 0x556570f8ea80 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x556570f07690 con 0x556570f8f150 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x556570f86dc0 con 0x556570facc10 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e48ef1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570facc10 0x556570f8fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570f8f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e48ef1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570facc10 0x556570f8fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:36788/0 (socket says 172.21.15.31:36788) 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570f8f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56734/0 (socket says 172.21.15.31:56734) 2024-04-18T10:39:07.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e48ef1700 1 -- 172.21.15.31:0/1047404566 learned_addr learned my addr 172.21.15.31:0/1047404566 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.583+0000 7f9e43fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570f8ea80 0x556570f84bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e48ef1700 1 -- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 msgr2=0x556570f8f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e48ef1700 1 --2- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570f8f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e48ef1700 1 -- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570f8ea80 msgr2=0x556570f84bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e48ef1700 1 --2- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570f8ea80 0x556570f84bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e48ef1700 1 -- 172.21.15.31:0/1047404566 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556570fb7420 con 0x556570facc10 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e43fff700 1 --2- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570f8ea80 0x556570f84bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e437fe700 1 --2- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570f8f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e48ef1700 1 --2- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570facc10 0x556570f8fb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c001460 tx=0x7f9e3c009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95e7faaf8a58aa8a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e39ffb700 1 -- 172.21.15.31:0/1047404566 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c015a30 con 0x556570facc10 2024-04-18T10:39:07.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e39ffb700 1 -- 172.21.15.31:0/1047404566 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c015b90 con 0x556570facc10 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.584+0000 7f9e39ffb700 1 -- 172.21.15.31:0/1047404566 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c01f470 con 0x556570facc10 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 -- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570facc10 msgr2=0x556570f8fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570facc10 0x556570f8fb10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c001460 tx=0x7f9e3c009040 comp rx=0 tx=0).stop 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 -- 172.21.15.31:0/1047404566 shutdown_connections 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570facc10 0x556570f8fb10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570f8ea80 0x556570f84bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/1047404566 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8f150 0x556570f8f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 -- 172.21.15.31:0/1047404566 >> 172.21.15.31:0/1047404566 conn(0x556570f8c3a0 msgr2=0x556570faefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 -- 172.21.15.31:0/1047404566 shutdown_connections 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 -- 172.21.15.31:0/1047404566 wait complete. 2024-04-18T10:39:07.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 -- start start 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.585+0000 7f9e53c6db80 1 Processor -- start 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8ea80 0x556571022ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8f150 0x55657101f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e53c6db80 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x55657101fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x556571022aa0 con 0x556570facc10 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565710238a0 con 0x556570f8ea80 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e53c6db80 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x5565710203c0 con 0x556570f8f150 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e53c6db80 10 client.0 _ll_register_callbacks cb 0x7f9e3c002160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e43fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8ea80 0x556571022ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e43fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8ea80 0x556571022ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:56746/0 (socket says 172.21.15.31:56746) 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e437fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8f150 0x55657101f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:39:07.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e43fff700 1 -- 172.21.15.31:0/2731044493 learned_addr learned my addr 172.21.15.31:0/2731044493 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e437fe700 1 -- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8ea80 msgr2=0x556571022ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e437fe700 1 --2- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8ea80 0x556571022ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e437fe700 1 -- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 msgr2=0x55657101fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e437fe700 1 --2- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x55657101fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e437fe700 1 -- 172.21.15.31:0/2731044493 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e440b06f0 con 0x556570f8f150 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e43fff700 1 --2- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8ea80 0x556571022ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e437fe700 1 --2- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8f150 0x55657101f940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e340096a0 tx=0x7f9e3402e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8938f8ebd2024cc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e227fc700 10 client.0 ms_handle_connect on v2:172.21.15.31:3302/0 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e227fc700 1 -- 172.21.15.31:0/2731044493 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3402a040 con 0x556570f8f150 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e227fc700 1 -- 172.21.15.31:0/2731044493 <== mon.2 v2:172.21.15.31:3302/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f9e34034040 con 0x556570f8f150 2024-04-18T10:39:07.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.586+0000 7f9e53c6db80 1 -- 172.21.15.31:0/2731044493 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e34022040 con 0x556570f8f150 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e227fc700 1 -- 172.21.15.31:0/2731044493 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e34038980 con 0x556570f8f150 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e53c6db80 10 client.24644 fetch_fsmap learned FSMap version 18 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e53c6db80 1 -- 172.21.15.31:0/2731044493 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,fsmap=18,monmap=3+}) v3 -- 0x7f9e3c012950 con 0x556570f8f150 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e227fc700 1 -- 172.21.15.31:0/2731044493 <== mon.2 v2:172.21.15.31:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34022040 con 0x556570f8f150 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e227fc700 1 -- 172.21.15.31:0/2731044493 <== mon.2 v2:172.21.15.31:3302/0 5 ==== fsmap(e 18) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f9e34009970 con 0x556570f8f150 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e53c6db80 10 client.24644 fetch_fsmap finished waiting for FSMap version 18 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e53c6db80 10 client.24644 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e53c6db80 20 client.24644 populate_metadata read hostname 'smithi031' 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e53c6db80 4 client.24644 mds_command: new command op to 24428 tid=0[{"prefix": "status"}] 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e53c6db80 1 -- 172.21.15.31:0/2731044493 --> v1:172.21.15.31:6819/1866692589 -- command(tid 0: {"prefix": "status"}) v1 -- 0x556570d3f100 con 0x556570f8a0d0 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e227fc700 10 client.24644 ms_handle_connect on v1:172.21.15.31:6819/1866692589 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e227fc700 1 -- 172.21.15.31:0/2731044493 <== mds.0 v1:172.21.15.31:6819/1866692589 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (unknown 0 0 1668940517) 0x556570d3f100 con 0x556570f8a0d0 2024-04-18T10:39:07.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e227fc700 10 client.24644 handle_command_reply: tid=0 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e53c6db80 1 client.24644 shutdown 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.587+0000 7f9e53c6db80 1 -- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8f150 msgr2=0x55657101f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8f150 0x55657101f940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e340096a0 tx=0x7f9e3402e000 comp rx=0 tx=0).stop 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e53c6db80 1 -- 172.21.15.31:0/2731044493 shutdown_connections 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x556570facc10 0x55657101fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x556570f8ea80 0x556571022ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e227fc700 0 client.24644 ms_handle_reset on v1:172.21.15.31:6819/1866692589 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e53c6db80 1 --2- 172.21.15.31:0/2731044493 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x556570f8f150 0x55657101f940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e53c6db80 1 -- 172.21.15.31:0/2731044493 >> 172.21.15.31:0/2731044493 conn(0x556570f8c3a0 msgr2=0x556570f8f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e53c6db80 1 -- 172.21.15.31:0/2731044493 shutdown_connections 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e53c6db80 1 -- 172.21.15.31:0/2731044493 wait complete. 2024-04-18T10:39:07.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e53c6db80 20 client.24644 trim_cache size 0 max 16384 2024-04-18T10:39:07.597 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:39:07.597 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "2dc05854-5716-4ea6-add8-fd949f4dd05c", 2024-04-18T10:39:07.597 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-04-18T10:39:07.597 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 24428, 2024-04-18T10:39:07.597 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-04-18T10:39:07.597 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-18T10:39:07.597 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-04-18T10:39:07.597 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 15.004463651, 2024-04-18T10:39:07.597 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 18, 2024-04-18T10:39:07.598 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 41, 2024-04-18T10:39:07.598 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 37, 2024-04-18T10:39:07.598 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 15.098726281999999 2024-04-18T10:39:07.598 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:39:07.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 -- 172.21.15.31:0/2559231614 >> v1:172.21.15.31:6816/46601 conn(0x7f9e24046010 legacy=0x7f9e240484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 -- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 msgr2=0x7f9e44151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:39:07.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 --2- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e44151fe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00ec80 tx=0x7f9e2c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 -- 172.21.15.31:0/2559231614 shutdown_connections 2024-04-18T10:39:07.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 --2- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f9e44068340 0x7f9e44151fe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 --2- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f9e440a4da0 0x7f9e4414e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 --2- 172.21.15.31:0/2559231614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e440a4070 0x7f9e44152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:39:07.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 -- 172.21.15.31:0/2559231614 >> 172.21.15.31:0/2559231614 conn(0x7f9e4406bfc0 msgr2=0x7f9e4406f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:39:07.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 -- 172.21.15.31:0/2559231614 shutdown_connections 2024-04-18T10:39:07.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:39:07.588+0000 7f9e4a954700 1 -- 172.21.15.31:0/2559231614 wait complete. 2024-04-18T10:39:07.600 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:39:07.611 INFO:teuthology.task.print:**** done ceph.restart 2024-04-18T10:39:07.612 INFO:teuthology.run_tasks:Running task install.upgrade... 2024-04-18T10:39:07.702 INFO:teuthology.task.install:project ceph config {'client.0': {'branch': 'quincy'}} overrides {'flavor': 'default', 'sha1': 'a6549451253d26216d353246c0fe6f6d80f3b9cf'} 2024-04-18T10:39:07.702 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2024-04-18T10:39:07.703 INFO:teuthology.task.install:remote ubuntu@smithi040.front.sepia.ceph.com config {'branch': 'quincy', 'flavor': 'default'} 2024-04-18T10:39:07.703 INFO:teuthology.task.install:extra packages: [] 2024-04-18T10:39:07.708 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-18T10:39:07.708 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2024-04-18T10:39:07.708 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2024-04-18T10:39:07.737 INFO:teuthology.orchestra.run.smithi040.stdout:15.2.17-0.el8 2024-04-18T10:39:07.737 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.17-0.el8 2024-04-18T10:39:07.738 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-18T10:39:07.977 INFO:teuthology.task.install:Ceph rpm upgrade from 15.2.17-0.el8 to 17.2.7-872.ge85153d5 2024-04-18T10:39:07.977 INFO:teuthology.task.install.rpm:Host smithi040 is: centos 8 x86_64 2024-04-18T10:39:07.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-18T10:39:08.309 INFO:teuthology.task.install.rpm:Repo base URL: https://4.chacra.ceph.com/r/ceph/quincy/e85153d553ddc8420b6b154a57813a504f51c01a/centos/8/flavors/default/ 2024-04-18T10:39:08.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-04-18T10:39:08.514 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/e85153d553ddc8420b6b154a57813a504f51c01a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/e85153d553ddc8420b6b154a57813a504f51c01a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/e85153d553ddc8420b6b154a57813a504f51c01a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-18T10:39:08.514 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:39:08.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-18T10:39:08.548 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-18T10:39:08.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-18T10:39:08.693 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-18T10:39:08.753 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-04-18T10:39:08.765 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-04-18T10:39:09.040 INFO:teuthology.orchestra.run.smithi040.stdout:71 files removed 2024-04-18T10:39:09.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2024-04-18T10:39:09.840 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 230 kB/s | 78 kB 00:00 2024-04-18T10:39:10.098 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 49 kB/s | 11 kB 00:00 2024-04-18T10:39:10.658 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 2.7 kB/s | 1.4 kB 00:00 2024-04-18T10:39:11.649 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 29 MB/s | 28 MB 00:00 2024-04-18T10:39:17.736 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 10 MB 00:00 2024-04-18T10:39:19.809 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2024-04-18T10:39:20.276 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 7.7 kB 00:00 2024-04-18T10:39:20.894 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - PowerTools 9.5 MB/s | 5.0 MB 00:00 2024-04-18T10:39:22.013 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-18T10:39:23.014 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-04-18T10:39:26.964 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 397 kB/s | 24 kB 00:00 2024-04-18T10:39:30.765 INFO:teuthology.orchestra.run.smithi040.stderr:Package cephadm available, but not installed. 2024-04-18T10:39:30.765 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: cephadm 2024-04-18T10:39:30.770 INFO:teuthology.orchestra.run.smithi040.stderr:Package ceph-mgr-dashboard available, but not installed. 2024-04-18T10:39:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: ceph-mgr-dashboard 2024-04-18T10:39:30.771 INFO:teuthology.orchestra.run.smithi040.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2024-04-18T10:39:30.771 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-04-18T10:39:30.772 INFO:teuthology.orchestra.run.smithi040.stderr:Package ceph-mgr-rook available, but not installed. 2024-04-18T10:39:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: ceph-mgr-rook 2024-04-18T10:39:30.772 INFO:teuthology.orchestra.run.smithi040.stderr:Package ceph-mgr-cephadm available, but not installed. 2024-04-18T10:39:30.772 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: ceph-mgr-cephadm 2024-04-18T10:39:30.775 INFO:teuthology.orchestra.run.smithi040.stderr:Package ceph-volume available, but not installed. 2024-04-18T10:39:30.775 INFO:teuthology.orchestra.run.smithi040.stdout:No match for argument: ceph-volume 2024-04-18T10:39:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:17.2.7-872.ge85153d5.el8 ceph 6.4 k 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:17.2.7-872.ge85153d5.el8 ceph 5.3 M 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:17.2.7-872.ge85153d5.el8 ceph 24 M 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:17.2.7-872.ge85153d5.el8 ceph 876 k 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout: x86_64 2:17.2.7-872.ge85153d5.el8 ceph 162 k 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:17.2.7-872.ge85153d5.el8 ceph 2.3 M 2024-04-18T10:39:30.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:17.2.7-872.ge85153d5.el8 ceph 1.6 M 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:17.2.7-872.ge85153d5.el8 ceph-noarch 240 k 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:17.2.7-872.ge85153d5.el8 ceph 4.0 M 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:17.2.7-872.ge85153d5.el8 ceph 17 M 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:17.2.7-872.ge85153d5.el8 ceph 17 M 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:17.2.7-872.ge85153d5.el8 ceph 24 k 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:17.2.7-872.ge85153d5.el8 ceph 53 M 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:17.2.7-872.ge85153d5.el8 ceph 25 k 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 798 k 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:17.2.7-872.ge85153d5.el8 ceph 130 k 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 3.5 M 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 505 k 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 3.6 M 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:17.2.7-872.ge85153d5.el8 ceph 5.6 M 2024-04-18T10:39:30.897 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:17.2.7-872.ge85153d5.el8 ceph 45 k 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:17.2.7-872.ge85153d5.el8 ceph 117 k 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:17.2.7-872.ge85153d5.el8 ceph 190 k 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:17.2.7-872.ge85153d5.el8 ceph 370 k 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:17.2.7-872.ge85153d5.el8 ceph 358 k 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:17.2.7-872.ge85153d5.el8 ceph 106 k 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:17.2.7-872.ge85153d5.el8 ceph 90 k 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:17.2.7-872.ge85153d5.el8 ceph 3.5 M 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:17.2.7-872.ge85153d5.el8 ceph 175 k 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:17.2.7-872.ge85153d5.el8 ceph 179 k 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-18T10:39:30.898 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-18T10:39:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:Install 2 Packages 2024-04-18T10:39:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 29 Packages 2024-04-18T10:39:30.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:39:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 145 M 2024-04-18T10:39:30.899 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-18T10:39:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:(1/31): ceph-17.2.7-872.ge85153d5.el8.x86_64.rp 49 kB/s | 6.4 kB 00:00 2024-04-18T10:39:31.541 INFO:teuthology.orchestra.run.smithi040.stdout:(2/31): libcephsqlite-17.2.7-872.ge85153d5.el8. 635 kB/s | 179 kB 00:00 2024-04-18T10:39:31.582 INFO:teuthology.orchestra.run.smithi040.stdout:(3/31): thrift-0.13.0-2.el8.x86_64.rpm 5.4 MB/s | 1.7 MB 00:00 2024-04-18T10:39:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:(4/31): ceph-base-17.2.7-872.ge85153d5.el8.x86_ 14 MB/s | 5.3 MB 00:00 2024-04-18T10:39:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:(5/31): ceph-immutable-object-cache-17.2.7-872. 3.2 MB/s | 162 kB 00:00 2024-04-18T10:39:31.967 INFO:teuthology.orchestra.run.smithi040.stdout:(6/31): ceph-mds-17.2.7-872.ge85153d5.el8.x86_6 15 MB/s | 2.3 MB 00:00 2024-04-18T10:39:32.075 INFO:teuthology.orchestra.run.smithi040.stdout:(7/31): ceph-mgr-17.2.7-872.ge85153d5.el8.x86_6 15 MB/s | 1.6 MB 00:00 2024-04-18T10:39:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:(8/31): ceph-fuse-17.2.7-872.ge85153d5.el8.x86_ 1.3 MB/s | 876 kB 00:00 2024-04-18T10:39:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:(9/31): ceph-mon-17.2.7-872.ge85153d5.el8.x86_6 16 MB/s | 4.0 MB 00:00 2024-04-18T10:39:33.393 INFO:teuthology.orchestra.run.smithi040.stdout:(10/31): ceph-radosgw-17.2.7-872.ge85153d5.el8. 16 MB/s | 17 MB 00:01 2024-04-18T10:39:33.451 INFO:teuthology.orchestra.run.smithi040.stdout:(11/31): ceph-selinux-17.2.7-872.ge85153d5.el8. 419 kB/s | 24 kB 00:00 2024-04-18T10:39:35.277 INFO:teuthology.orchestra.run.smithi040.stdout:(12/31): ceph-common-17.2.7-872.ge85153d5.el8.x 6.3 MB/s | 24 MB 00:03 2024-04-18T10:39:35.326 INFO:teuthology.orchestra.run.smithi040.stdout:(13/31): libcephfs-devel-17.2.7-872.ge85153d5.e 501 kB/s | 25 kB 00:00 2024-04-18T10:39:35.577 INFO:teuthology.orchestra.run.smithi040.stdout:(14/31): libcephfs2-17.2.7-872.ge85153d5.el8.x8 3.1 MB/s | 798 kB 00:00 2024-04-18T10:39:35.669 INFO:teuthology.orchestra.run.smithi040.stdout:(15/31): librados-devel-17.2.7-872.ge85153d5.el 1.4 MB/s | 130 kB 00:00 2024-04-18T10:39:36.777 INFO:teuthology.orchestra.run.smithi040.stdout:(16/31): ceph-test-17.2.7-872.ge85153d5.el8.x86 16 MB/s | 53 MB 00:03 2024-04-18T10:39:36.970 INFO:teuthology.orchestra.run.smithi040.stdout:(17/31): ceph-osd-17.2.7-872.ge85153d5.el8.x86_ 3.6 MB/s | 17 MB 00:04 2024-04-18T10:39:37.036 INFO:teuthology.orchestra.run.smithi040.stdout:(18/31): librados2-17.2.7-872.ge85153d5.el8.x86 2.5 MB/s | 3.5 MB 00:01 2024-04-18T10:39:37.070 INFO:teuthology.orchestra.run.smithi040.stdout:(19/31): libradosstriper1-17.2.7-872.ge85153d5. 1.7 MB/s | 505 kB 00:00 2024-04-18T10:39:37.112 INFO:teuthology.orchestra.run.smithi040.stdout:(20/31): python3-ceph-argparse-17.2.7-872.ge851 1.0 MB/s | 45 kB 00:00 2024-04-18T10:39:37.170 INFO:teuthology.orchestra.run.smithi040.stdout:(21/31): python3-ceph-common-17.2.7-872.ge85153 2.0 MB/s | 117 kB 00:00 2024-04-18T10:39:37.237 INFO:teuthology.orchestra.run.smithi040.stdout:(22/31): python3-cephfs-17.2.7-872.ge85153d5.el 2.8 MB/s | 190 kB 00:00 2024-04-18T10:39:37.304 INFO:teuthology.orchestra.run.smithi040.stdout:(23/31): python3-rados-17.2.7-872.ge85153d5.el8 5.4 MB/s | 370 kB 00:00 2024-04-18T10:39:37.372 INFO:teuthology.orchestra.run.smithi040.stdout:(24/31): python3-rbd-17.2.7-872.ge85153d5.el8.x 5.2 MB/s | 358 kB 00:00 2024-04-18T10:39:37.422 INFO:teuthology.orchestra.run.smithi040.stdout:(25/31): python3-rgw-17.2.7-872.ge85153d5.el8.x 2.1 MB/s | 106 kB 00:00 2024-04-18T10:39:37.480 INFO:teuthology.orchestra.run.smithi040.stdout:(26/31): rbd-fuse-17.2.7-872.ge85153d5.el8.x86_ 1.5 MB/s | 90 kB 00:00 2024-04-18T10:39:37.622 INFO:teuthology.orchestra.run.smithi040.stdout:(27/31): librgw2-17.2.7-872.ge85153d5.el8.x86_6 9.5 MB/s | 5.6 MB 00:00 2024-04-18T10:39:37.723 INFO:teuthology.orchestra.run.smithi040.stdout:(28/31): librbd1-17.2.7-872.ge85153d5.el8.x86_6 4.8 MB/s | 3.6 MB 00:00 2024-04-18T10:39:37.748 INFO:teuthology.orchestra.run.smithi040.stdout:(29/31): rbd-nbd-17.2.7-872.ge85153d5.el8.x86_6 1.4 MB/s | 175 kB 00:00 2024-04-18T10:39:37.806 INFO:teuthology.orchestra.run.smithi040.stdout:(30/31): rbd-mirror-17.2.7-872.ge85153d5.el8.x8 11 MB/s | 3.5 MB 00:00 2024-04-18T10:39:37.832 INFO:teuthology.orchestra.run.smithi040.stdout:(31/31): ceph-mgr-modules-core-17.2.7-872.ge851 2.2 MB/s | 240 kB 00:00 2024-04-18T10:39:37.835 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-18T10:39:37.835 INFO:teuthology.orchestra.run.smithi040.stdout:Total 21 MB/s | 145 MB 00:06 2024-04-18T10:39:37.836 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-18T10:39:37.902 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-18T10:39:37.902 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-18T10:39:38.600 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-18T10:39:38.604 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-18T10:39:40.790 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-18T10:39:41.147 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:17.2.7-872.ge85153d5.el8.x86_64 1/1 2024-04-18T10:39:41.405 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:17.2.7-872.ge85153d5.el8.x86_64 1/60 2024-04-18T10:39:41.836 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:17.2.7-872.ge85153d5.el8.x86_64 1/60 2024-04-18T10:39:42.013 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:17.2.7-872.ge85153d5.el8.x86_64 2/60 2024-04-18T10:39:42.149 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:17.2.7-872.ge85153d5.el8.x86_64 2/60 2024-04-18T10:39:42.422 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libcephfs2-2:17.2.7-872.ge85153d5.el8.x86_64 3/60 2024-04-18T10:39:42.508 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:17.2.7-872.ge85153d5.el8.x86_64 3/60 2024-04-18T10:39:42.918 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-rados-2:17.2.7-872.ge85153d5.el8.x86_64 4/60 2024-04-18T10:39:43.749 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/60 2024-04-18T10:39:43.996 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librgw2-2:17.2.7-872.ge85153d5.el8.x86_64 6/60 2024-04-18T10:39:44.074 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:17.2.7-872.ge85153d5.el8.x86_64 6/60 2024-04-18T10:39:44.239 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:17.2.7-872.ge85153d5.el8.x86_64 7/60 2024-04-18T10:39:44.350 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:17.2.7-872.ge85153d5.el8.x86_64 7/60 2024-04-18T10:39:44.513 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libradosstriper1-2:17.2.7-872.ge85153d5.el8.x86_64 8/60 2024-04-18T10:39:44.585 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:17.2.7-872.ge85153d5.el8.x86_64 8/60 2024-04-18T10:39:44.743 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-ceph-argparse-2:17.2.7-872.ge85153d5.el8.x 9/60 2024-04-18T10:39:44.959 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-cephfs-2:17.2.7-872.ge85153d5.el8.x86_64 10/60 2024-04-18T10:39:45.232 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-rgw-2:17.2.7-872.ge85153d5.el8.x86_64 11/60 2024-04-18T10:39:45.450 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-rbd-2:17.2.7-872.ge85153d5.el8.x86_64 12/60 2024-04-18T10:39:45.742 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados-devel-2:17.2.7-872.ge85153d5.el8.x86_64 13/60 2024-04-18T10:39:46.003 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mgr-modules-core-2:17.2.7-872.ge85153d5.el8.n 14/60 2024-04-18T10:39:46.197 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-ceph-common-2:17.2.7-872.ge85153d5.el8.x86 15/60 2024-04-18T10:39:48.828 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 16/60 2024-04-18T10:39:49.096 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 16/60 2024-04-18T10:39:49.775 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 16/60 2024-04-18T10:39:50.169 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-base-2:17.2.7-872.ge85153d5.el8.x86_64 17/60 2024-04-18T10:39:50.236 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:17.2.7-872.ge85153d5.el8.x86_64 17/60 2024-04-18T10:39:50.392 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-selinux-2:17.2.7-872.ge85153d5.el8.x86_64 18/60 2024-04-18T10:40:09.490 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:17.2.7-872.ge85153d5.el8.x86_64 18/60 2024-04-18T10:40:09.707 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mds-2:17.2.7-872.ge85153d5.el8.x86_64 19/60 2024-04-18T10:40:09.864 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:17.2.7-872.ge85153d5.el8.x86_64 19/60 2024-04-18T10:40:10.108 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mgr-2:17.2.7-872.ge85153d5.el8.x86_64 20/60 2024-04-18T10:40:10.519 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:17.2.7-872.ge85153d5.el8.x86_64 20/60 2024-04-18T10:40:10.751 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-mon-2:17.2.7-872.ge85153d5.el8.x86_64 21/60 2024-04-18T10:40:12.688 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:17.2.7-872.ge85153d5.el8.x86_64 21/60 2024-04-18T10:40:12.941 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-osd-2:17.2.7-872.ge85153d5.el8.x86_64 22/60 2024-04-18T10:40:12.952 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:17.2.7-872.ge85153d5.el8.x86_64 22/60 2024-04-18T10:40:14.923 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-2:17.2.7-872.ge85153d5.el8.x86_64 23/60 2024-04-18T10:40:15.216 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-radosgw-2:17.2.7-872.ge85153d5.el8.x86_64 24/60 2024-04-18T10:40:15.320 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-872.ge85153d5.el8.x86_64 24/60 2024-04-18T10:40:15.659 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-immutable-object-cache-2:17.2.7-872.ge85153d5 25/60 2024-04-18T10:40:16.092 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-872.ge85153d5 25/60 2024-04-18T10:40:16.347 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : rbd-mirror-2:17.2.7-872.ge85153d5.el8.x86_64 26/60 2024-04-18T10:40:22.235 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:17.2.7-872.ge85153d5.el8.x86_64 26/60 2024-04-18T10:40:22.512 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-test-2:17.2.7-872.ge85153d5.el8.x86_64 27/60 2024-04-18T10:40:22.717 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libcephfs-devel-2:17.2.7-872.ge85153d5.el8.x86_64 28/60 2024-04-18T10:40:22.942 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : rbd-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 29/60 2024-04-18T10:40:23.235 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : rbd-nbd-2:17.2.7-872.ge85153d5.el8.x86_64 30/60 2024-04-18T10:40:23.418 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : ceph-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 31/60 2024-04-18T10:40:23.522 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-2:15.2.17-0.el8.x86_64 32/60 2024-04-18T10:40:23.767 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-test-2:15.2.17-0.el8.x86_64 33/60 2024-04-18T10:40:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-18T10:40:23.775 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-18T10:40:24.016 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-18T10:40:24.159 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : rbd-nbd-2:15.2.17-0.el8.x86_64 35/60 2024-04-18T10:40:24.166 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-18T10:40:24.166 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-18T10:40:24.326 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-18T10:40:24.475 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : rbd-fuse-2:15.2.17-0.el8.x86_64 37/60 2024-04-18T10:40:24.482 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-18T10:40:24.482 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-18T10:40:24.676 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-18T10:40:24.817 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libcephfs-devel-2:15.2.17-0.el8.x86_64 39/60 2024-04-18T10:40:24.967 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados-devel-2:15.2.17-0.el8.x86_64 40/60 2024-04-18T10:40:24.974 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-18T10:40:24.974 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-18T10:40:25.149 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-18T10:40:25.157 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-18T10:40:25.157 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-18T10:40:25.501 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-18T10:40:25.507 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-18T10:40:25.508 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-18T10:40:25.684 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-18T10:40:25.690 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-18T10:40:25.690 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-18T10:40:25.876 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-18T10:40:25.876 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-04-18T10:40:26.026 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-04-18T10:40:26.052 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-18T10:40:26.052 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-18T10:40:26.352 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-18T10:40:26.353 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-04-18T10:40:26.559 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-04-18T10:40:26.559 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-04-18T10:40:26.759 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-04-18T10:40:26.930 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-cephfs-2:15.2.17-0.el8.x86_64 49/60 2024-04-18T10:40:27.131 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-04-18T10:40:27.131 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-04-18T10:40:27.351 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-04-18T10:40:27.509 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-04-18T10:40:27.509 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-04-18T10:40:27.734 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-04-18T10:40:27.950 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-rados-2:15.2.17-0.el8.x86_64 54/60 2024-04-18T10:40:27.950 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-04-18T10:40:28.176 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-04-18T10:40:28.325 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-fuse-2:15.2.17-0.el8.x86_64 56/60 2024-04-18T10:40:28.444 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 57/60 2024-04-18T10:40:28.612 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-ceph-common-2:15.2.17-0.el8.x86_64 58/60 2024-04-18T10:40:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 59/60 2024-04-18T10:40:28.807 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:15.2.17-0.el8.x86_64 60/60 2024-04-18T10:40:29.567 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 60/60 2024-04-18T10:40:29.567 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:17.2.7-872.ge85153d5.el8.x86_64 1/60 2024-04-18T10:40:29.567 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 2/60 2024-04-18T10:40:29.567 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:17.2.7-872.ge85153d5.el8.x86_64 3/60 2024-04-18T10:40:29.567 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 4/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:17.2.7-872.ge85153d5.el8.x86_64 5/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 6/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 7/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 8/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 9/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 10/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-872.ge85153d5 11/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 12/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:17.2.7-872.ge85153d5.el8.x86_64 13/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 14/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:17.2.7-872.ge85153d5.el8.x86_64 15/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 16/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:17.2.7-872.ge85153d5.el8.x86_64 17/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 18/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:17.2.7-872.ge85153d5.el8.x86_64 19/60 2024-04-18T10:40:29.568 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 20/60 2024-04-18T10:40:29.569 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:17.2.7-872.ge85153d5.el8.x86_64 21/60 2024-04-18T10:40:29.569 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 22/60 2024-04-18T10:40:29.569 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:17.2.7-872.ge85153d5.el8.x86_64 23/60 2024-04-18T10:40:29.569 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 24/60 2024-04-18T10:40:29.569 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:17.2.7-872.ge85153d5.el8.x86_64 25/60 2024-04-18T10:40:29.569 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 26/60 2024-04-18T10:40:29.569 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:17.2.7-872.ge85153d5.el8.x86_64 27/60 2024-04-18T10:40:29.572 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 28/60 2024-04-18T10:40:29.572 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:17.2.7-872.ge85153d5.el8.x86_64 29/60 2024-04-18T10:40:29.572 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 30/60 2024-04-18T10:40:29.572 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:17.2.7-872.ge85153d5.el8.x86_64 31/60 2024-04-18T10:40:29.572 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 32/60 2024-04-18T10:40:29.572 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:17.2.7-872.ge85153d5.el8.x86_64 33/60 2024-04-18T10:40:29.572 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 34/60 2024-04-18T10:40:29.572 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:17.2.7-872.ge85153d5.el8.x86_64 35/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 36/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:17.2.7-872.ge85153d5.el8.x86_64 37/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 38/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:17.2.7-872.ge85153d5.el8.x86_64 39/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 40/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:17.2.7-872.ge85153d5.el8.x 41/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 42/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:17.2.7-872.ge85153d5.el8.x86 43/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 44/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:17.2.7-872.ge85153d5.el8.x86_64 45/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 46/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:17.2.7-872.ge85153d5.el8.x86_64 47/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 48/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:17.2.7-872.ge85153d5.el8.x86_64 49/60 2024-04-18T10:40:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-04-18T10:40:29.574 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:17.2.7-872.ge85153d5.el8.x86_64 51/60 2024-04-18T10:40:29.574 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-04-18T10:40:29.574 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 53/60 2024-04-18T10:40:29.574 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 54/60 2024-04-18T10:40:29.574 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:17.2.7-872.ge85153d5.el8.x86_64 55/60 2024-04-18T10:40:29.574 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 56/60 2024-04-18T10:40:29.574 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:17.2.7-872.ge85153d5.el8.x86_64 57/60 2024-04-18T10:40:29.574 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 58/60 2024-04-18T10:40:29.574 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-872.ge85153d5.el8.n 59/60 2024-04-18T10:40:30.815 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 60/60 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:17.2.7-872.ge85153d5.el8.noarch 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.817 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:17.2.7-872.ge85153d5.el8.x86_64 2024-04-18T10:40:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-18T10:40:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:17.2.7-872.ge85153d5.el8.x86_64 thrift-0.13.0-2.el8.x86_64 2024-04-18T10:40:30.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-18T10:40:30.818 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-18T10:40:30.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-18T10:40:31.298 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-18T10:40:31.324 INFO:teuthology.orchestra.run.smithi040.stdout:17.2.7-872.ge85153d5.el8 2024-04-18T10:40:31.324 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-872.ge85153d5.el8 2024-04-18T10:40:31.324 INFO:teuthology.task.install:The correct ceph version 17.2.7-872.ge85153d5 is installed. 2024-04-18T10:40:31.326 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:40:31.337 INFO:teuthology.task.print:**** done install.upgrade on client.0 2024-04-18T10:40:31.337 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-18T10:40:31.358 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-18T10:40:31.358 INFO:tasks.ceph_fuse:config is {'client.0': {'mounted': False}, 'client.1': {'skip': True}} 2024-04-18T10:40:31.359 INFO:tasks.ceph_fuse:client.0 config is {'mounted': False} 2024-04-18T10:40:31.359 INFO:tasks.ceph_fuse:client.1 config is {'skip': True} 2024-04-18T10:40:31.359 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:40:31.359 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T10:40:31.384 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:40:31.384 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T10:40:31.443 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:40:31.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.579+0000 7fcc8188a700 1 Processor -- start 2024-04-18T10:40:31.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.579+0000 7fcc8188a700 1 -- start start 2024-04-18T10:40:31.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc8188a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0a8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc8188a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 0x7fcc7c149f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc8188a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7c0ab140 con 0x7fcc7c13efd0 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc8188a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c0a8e60 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc8188a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c13e660 con 0x7fcc7c1422f0 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc7b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 0x7fcc7c149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc7a7fc700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcc7c13efd0 0x7fcc7c141be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58074/0 (socket says 172.21.15.31:58074) 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc7a7fc700 1 -- 172.21.15.31:0/4164644025 learned_addr learned my addr 172.21.15.31:0/4164644025 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc7affd700 1 --2- 172.21.15.31:0/4164644025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc79ffb700 1 -- 172.21.15.31:0/4164644025 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873084919 0 0) 0x7fcc7c0ab140 con 0x7fcc7c13efd0 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc7affd700 1 -- 172.21.15.31:0/4164644025 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 msgr2=0x7fcc7c149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:31.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.580+0000 7fcc7affd700 1 --2- 172.21.15.31:0/4164644025 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 0x7fcc7c149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc7affd700 1 -- 172.21.15.31:0/4164644025 >> v1:172.21.15.31:6789/0 conn(0x7fcc7c13efd0 legacy=0x7fcc7c141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc7affd700 1 -- 172.21.15.31:0/4164644025 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c0a7160 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc7b7fe700 1 --2- 172.21.15.31:0/4164644025 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 0x7fcc7c149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc7affd700 1 --2- 172.21.15.31:0/4164644025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0a8920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009910 tx=0x7fcc6c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10c6f63aa985ffd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc79ffb700 1 -- 172.21.15.31:0/4164644025 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00b680 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc79ffb700 1 -- 172.21.15.31:0/4164644025 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c00b7e0 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc79ffb700 1 -- 172.21.15.31:0/4164644025 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00bba0 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc8188a700 1 -- 172.21.15.31:0/4164644025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c0aa8e0 msgr2=0x7fcc7c0a8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc8188a700 1 --2- 172.21.15.31:0/4164644025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0a8920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009910 tx=0x7fcc6c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc8188a700 1 -- 172.21.15.31:0/4164644025 shutdown_connections 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc8188a700 1 --2- 172.21.15.31:0/4164644025 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 0x7fcc7c149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc8188a700 1 --2- 172.21.15.31:0/4164644025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0a8920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.581+0000 7fcc8188a700 1 -- 172.21.15.31:0/4164644025 >> 172.21.15.31:0/4164644025 conn(0x7fcc7c069450 msgr2=0x7fcc7c063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:31.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.582+0000 7fcc8188a700 1 -- 172.21.15.31:0/4164644025 shutdown_connections 2024-04-18T10:40:31.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.582+0000 7fcc8188a700 1 -- 172.21.15.31:0/4164644025 wait complete. 2024-04-18T10:40:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc8188a700 1 Processor -- start 2024-04-18T10:40:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc8188a700 1 -- start start 2024-04-18T10:40:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc8188a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc8188a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c13efd0 0x7fcc7c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc8188a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 0x7fcc7c151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc8188a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c0b11e0 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc8188a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c0ae760 con 0x7fcc7c13efd0 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc8188a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c0af370 con 0x7fcc7c1422f0 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc7affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc7affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43916/0 (socket says 172.21.15.31:43916) 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc7affd700 1 -- 172.21.15.31:0/7870930 learned_addr learned my addr 172.21.15.31:0/7870930 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc7a7fc700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c13efd0 0x7fcc7c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.583+0000 7fcc7b7fe700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 0x7fcc7c151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc7affd700 1 -- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 msgr2=0x7fcc7c151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc7affd700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 0x7fcc7c151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc7affd700 1 -- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c13efd0 msgr2=0x7fcc7c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc7affd700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c13efd0 0x7fcc7c151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc7affd700 1 -- 172.21.15.31:0/7870930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74009a20 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc7a7fc700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c13efd0 0x7fcc7c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:31.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc7affd700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0ae9a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0a8fa0 tx=0x7fcc6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:31.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc72ffd700 1 -- 172.21.15.31:0/7870930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00bb60 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc72ffd700 1 -- 172.21.15.31:0/7870930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c000c90 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c009420 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc72ffd700 1 -- 172.21.15.31:0/7870930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c01a660 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.584+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c0b05c0 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.585+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7c0b1350 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.585+0000 7fcc72ffd700 1 -- 172.21.15.31:0/7870930 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fcc6c01aa10 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.585+0000 7fcc72ffd700 1 -- 172.21.15.31:0/7870930 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7fcc6c05ccb0 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.589+0000 7fcc72ffd700 1 -- 172.21.15.31:0/7870930 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcc6c001f00 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.753+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc7c064920 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.754+0000 7fcc72ffd700 1 -- 172.21.15.31:0/7870930 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+11966 (secure 0 0 0) 0x7fcc6c015070 con 0x7fcc7c0aa8e0 2024-04-18T10:40:31.755 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:40:31.755 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":43,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:39:29.493067+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":42,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":42,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 >> v1:172.21.15.31:6816/46601 conn(0x7fcc5c045ef0 legacy=0x7fcc5c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc7c0aa8e0 msgr2=0x7fcc7c0ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0ae9a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0a8fa0 tx=0x7fcc6c017000 comp rx=0 tx=0).stop 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 shutdown_connections 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc7c1422f0 0x7fcc7c151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc7c0aa8e0 0x7fcc7c0ae9a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 --2- 172.21.15.31:0/7870930 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc7c13efd0 0x7fcc7c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 >> 172.21.15.31:0/7870930 conn(0x7fcc7c069450 msgr2=0x7fcc7c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 shutdown_connections 2024-04-18T10:40:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.756+0000 7fcc8188a700 1 -- 172.21.15.31:0/7870930 wait complete. 2024-04-18T10:40:31.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:40:31.769 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:40:31.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.891+0000 7f51e0e6a700 1 Processor -- start 2024-04-18T10:40:31.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.891+0000 7f51e0e6a700 1 -- start start 2024-04-18T10:40:31.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.891+0000 7f51e0e6a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc0a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.891+0000 7f51e0e6a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069f20 0x7f51dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.891+0000 7f51e0e6a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51dc06a480 con 0x7f51dc069b50 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.891+0000 7f51e0e6a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0a3430 con 0x7f51dc0680f0 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.891+0000 7f51e0e6a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc06a720 con 0x7f51dc069f20 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51dad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069f20 0x7f51dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51da59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc0a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51d9d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f51dc069b50 0x7f51dc06ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58086/0 (socket says 172.21.15.31:58086) 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51d9d9b700 1 -- 172.21.15.31:0/949764842 learned_addr learned my addr 172.21.15.31:0/949764842 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51d959a700 1 -- 172.21.15.31:0/949764842 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898114842 0 0) 0x7f51dc06a480 con 0x7f51dc069b50 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51d959a700 1 -- 172.21.15.31:0/949764842 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c4003570 con 0x7f51dc069b50 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51da59c700 1 -- 172.21.15.31:0/949764842 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069f20 msgr2=0x7f51dc06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51da59c700 1 --2- 172.21.15.31:0/949764842 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069f20 0x7f51dc06f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51da59c700 1 -- 172.21.15.31:0/949764842 >> v1:172.21.15.31:6789/0 conn(0x7f51dc069b50 legacy=0x7f51dc06ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51da59c700 1 -- 172.21.15.31:0/949764842 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc06aa80 con 0x7f51dc0680f0 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51dad9d700 1 --2- 172.21.15.31:0/949764842 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069f20 0x7f51dc06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51da59c700 1 --2- 172.21.15.31:0/949764842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc0a3b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009910 tx=0x7f51cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc4624e051295f4d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51d959a700 1 -- 172.21.15.31:0/949764842 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc011630 con 0x7f51dc0680f0 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51d959a700 1 -- 172.21.15.31:0/949764842 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc011790 con 0x7f51dc0680f0 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.892+0000 7f51d959a700 1 -- 172.21.15.31:0/949764842 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc011b30 con 0x7f51dc0680f0 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.893+0000 7f51e0e6a700 1 -- 172.21.15.31:0/949764842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 msgr2=0x7f51dc0a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.893+0000 7f51e0e6a700 1 --2- 172.21.15.31:0/949764842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc0a3b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009910 tx=0x7f51cc0091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.893+0000 7f51e0e6a700 1 -- 172.21.15.31:0/949764842 shutdown_connections 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.893+0000 7f51e0e6a700 1 --2- 172.21.15.31:0/949764842 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069f20 0x7f51dc06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.893+0000 7f51e0e6a700 1 --2- 172.21.15.31:0/949764842 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc0a3b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.893+0000 7f51e0e6a700 1 -- 172.21.15.31:0/949764842 >> 172.21.15.31:0/949764842 conn(0x7f51dc06dd70 msgr2=0x7f51dc0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:31.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.893+0000 7f51e0e6a700 1 -- 172.21.15.31:0/949764842 shutdown_connections 2024-04-18T10:40:31.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.893+0000 7f51e0e6a700 1 -- 172.21.15.31:0/949764842 wait complete. 2024-04-18T10:40:31.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51e0e6a700 1 Processor -- start 2024-04-18T10:40:31.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51e0e6a700 1 -- start start 2024-04-18T10:40:31.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51e0e6a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc098950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51e0e6a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069b50 0x7f51dc0973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51e0e6a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51dc069f20 0x7f51dc152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:31.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51e0e6a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0ad290 con 0x7f51dc069f20 2024-04-18T10:40:31.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51e0e6a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc097f60 con 0x7f51dc0680f0 2024-04-18T10:40:31.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51e0e6a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0978e0 con 0x7f51dc069b50 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51da59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc098950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51d9d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069b50 0x7f51dc0973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51dad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51dc069f20 0x7f51dc152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51dad9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51dc069f20 0x7f51dc152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43930/0 (socket says 172.21.15.31:43930) 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51da59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc098950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59064/0 (socket says 172.21.15.31:59064) 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.894+0000 7f51dad9d700 1 -- 172.21.15.31:0/4113060179 learned_addr learned my addr 172.21.15.31:0/4113060179 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51d9d9b700 1 -- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 msgr2=0x7f51dc098950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51d9d9b700 1 --2- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc098950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51d9d9b700 1 -- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51dc069f20 msgr2=0x7f51dc152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51d9d9b700 1 --2- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51dc069f20 0x7f51dc152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51d9d9b700 1 -- 172.21.15.31:0/4113060179 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4009a20 con 0x7f51dc069b50 2024-04-18T10:40:31.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51da59c700 1 --2- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc098950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51d9d9b700 1 --2- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069b50 0x7f51dc0973a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51d000c5c0 tx=0x7f51d0007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51ca7fc700 1 -- 172.21.15.31:0/4113060179 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0005b30 con 0x7f51dc069b50 2024-04-18T10:40:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51ca7fc700 1 -- 172.21.15.31:0/4113060179 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0005cb0 con 0x7f51dc069b50 2024-04-18T10:40:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc009420 con 0x7f51dc069b50 2024-04-18T10:40:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51ca7fc700 1 -- 172.21.15.31:0/4113060179 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0007320 con 0x7f51dc069b50 2024-04-18T10:40:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.895+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc0ae840 con 0x7f51dc069b50 2024-04-18T10:40:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.896+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc0651b0 con 0x7f51dc069b50 2024-04-18T10:40:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.896+0000 7f51ca7fc700 1 -- 172.21.15.31:0/4113060179 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f51d001b3b0 con 0x7f51dc069b50 2024-04-18T10:40:31.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.897+0000 7f51ca7fc700 1 -- 172.21.15.31:0/4113060179 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7f51d005a450 con 0x7f51dc069b50 2024-04-18T10:40:31.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:31.900+0000 7f51ca7fc700 1 -- 172.21.15.31:0/4113060179 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f51d00386c0 con 0x7f51dc069b50 2024-04-18T10:40:32.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.065+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51dc0afaa0 con 0x7f51dc069b50 2024-04-18T10:40:32.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.065+0000 7f51ca7fc700 1 -- 172.21.15.31:0/4113060179 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51d0017020 con 0x7f51dc069b50 2024-04-18T10:40:32.066 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:40:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 >> v1:172.21.15.31:6816/46601 conn(0x7f51bc045ef0 legacy=0x7f51bc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069b50 msgr2=0x7f51dc0973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 --2- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069b50 0x7f51dc0973a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51d000c5c0 tx=0x7f51d0007d50 comp rx=0 tx=0).stop 2024-04-18T10:40:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 shutdown_connections 2024-04-18T10:40:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 --2- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51dc069f20 0x7f51dc152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 --2- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f51dc0680f0 0x7f51dc098950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 --2- 172.21.15.31:0/4113060179 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f51dc069b50 0x7f51dc0973a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 >> 172.21.15.31:0/4113060179 conn(0x7f51dc06dd70 msgr2=0x7f51dc0b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:32.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 shutdown_connections 2024-04-18T10:40:32.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.067+0000 7f51e0e6a700 1 -- 172.21.15.31:0/4113060179 wait complete. 2024-04-18T10:40:32.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:40:32.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.201+0000 7fd80b097700 1 Processor -- start 2024-04-18T10:40:32.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.201+0000 7fd80b097700 1 -- start start 2024-04-18T10:40:32.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.202+0000 7fd80b097700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8040680f0 0x7fd8040a4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.202+0000 7fd80b097700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd804144920 0x7fd804146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.202+0000 7fd80b097700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80406fd30 con 0x7fd8040a7110 2024-04-18T10:40:32.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.202+0000 7fd80b097700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80413cf10 con 0x7fd8040680f0 2024-04-18T10:40:32.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.202+0000 7fd80b097700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80413c130 con 0x7fd804144920 2024-04-18T10:40:32.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.202+0000 7fd809634700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd804144920 0x7fd804146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.202+0000 7fd808e33700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8040680f0 0x7fd8040a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.202+0000 7fd803fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd8040a7110 0x7fd80413c800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58094/0 (socket says 172.21.15.31:58094) 2024-04-18T10:40:32.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.202+0000 7fd803fff700 1 -- 172.21.15.31:0/2968552883 learned_addr learned my addr 172.21.15.31:0/2968552883 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd808e33700 1 -- 172.21.15.31:0/2968552883 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd804144920 msgr2=0x7fd804146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd808e33700 1 --2- 172.21.15.31:0/2968552883 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd804144920 0x7fd804146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd808e33700 1 -- 172.21.15.31:0/2968552883 >> v1:172.21.15.31:6789/0 conn(0x7fd8040a7110 legacy=0x7fd80413c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd808e33700 1 -- 172.21.15.31:0/2968552883 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040a4510 con 0x7fd8040680f0 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd809634700 1 --2- 172.21.15.31:0/2968552883 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd804144920 0x7fd804146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd8037fe700 1 -- 172.21.15.31:0/2968552883 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163741729 0 0) 0x7fd80406fd30 con 0x7fd8040a7110 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd808e33700 1 --2- 172.21.15.31:0/2968552883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8040680f0 0x7fd8040a4940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80098e0 tx=0x7fd7f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8f4213303b90af server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd8037fe700 1 -- 172.21.15.31:0/2968552883 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f800b640 con 0x7fd8040680f0 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd8037fe700 1 -- 172.21.15.31:0/2968552883 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f800b7a0 con 0x7fd8040680f0 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.203+0000 7fd8037fe700 1 -- 172.21.15.31:0/2968552883 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f800bb40 con 0x7fd8040680f0 2024-04-18T10:40:32.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.204+0000 7fd80b097700 1 -- 172.21.15.31:0/2968552883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8040680f0 msgr2=0x7fd8040a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.204+0000 7fd80b097700 1 --2- 172.21.15.31:0/2968552883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8040680f0 0x7fd8040a4940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80098e0 tx=0x7fd7f80091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.204+0000 7fd80b097700 1 -- 172.21.15.31:0/2968552883 shutdown_connections 2024-04-18T10:40:32.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.204+0000 7fd80b097700 1 --2- 172.21.15.31:0/2968552883 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd804144920 0x7fd804146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.204+0000 7fd80b097700 1 --2- 172.21.15.31:0/2968552883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8040680f0 0x7fd8040a4940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.204+0000 7fd80b097700 1 -- 172.21.15.31:0/2968552883 >> 172.21.15.31:0/2968552883 conn(0x7fd80406bfc0 msgr2=0x7fd8040679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:32.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.204+0000 7fd80b097700 1 -- 172.21.15.31:0/2968552883 shutdown_connections 2024-04-18T10:40:32.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.204+0000 7fd80b097700 1 -- 172.21.15.31:0/2968552883 wait complete. 2024-04-18T10:40:32.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.205+0000 7fd80b097700 1 Processor -- start 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.205+0000 7fd80b097700 1 -- start start 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.205+0000 7fd80b097700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8040680f0 0x7fd8040a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.205+0000 7fd80b097700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd8040a7110 0x7fd8040a8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.205+0000 7fd80b097700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd804144920 0x7fd80414f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.205+0000 7fd80b097700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040a96a0 con 0x7fd804144920 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.205+0000 7fd80b097700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040b2640 con 0x7fd8040680f0 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.205+0000 7fd80b097700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040a7c30 con 0x7fd8040a7110 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.205+0000 7fd808e33700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8040680f0 0x7fd8040a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd809634700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd804144920 0x7fd80414f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd808e33700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8040680f0 0x7fd8040a9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59094/0 (socket says 172.21.15.31:59094) 2024-04-18T10:40:32.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd808e33700 1 -- 172.21.15.31:0/72445929 learned_addr learned my addr 172.21.15.31:0/72445929 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd803fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd8040a7110 0x7fd8040a8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd808e33700 1 -- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd8040a7110 msgr2=0x7fd8040a8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd808e33700 1 --2- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd8040a7110 0x7fd8040a8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd808e33700 1 -- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd804144920 msgr2=0x7fd80414f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd808e33700 1 --2- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd804144920 0x7fd80414f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd808e33700 1 -- 172.21.15.31:0/72445929 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc009a20 con 0x7fd8040680f0 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd808e33700 1 --2- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8040680f0 0x7fd8040a9d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80093f0 tx=0x7fd7f8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd800ff9700 1 -- 172.21.15.31:0/72445929 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f800b910 con 0x7fd8040680f0 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd800ff9700 1 -- 172.21.15.31:0/72445929 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f800bab0 con 0x7fd8040680f0 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f8009420 con 0x7fd8040680f0 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd800ff9700 1 -- 172.21.15.31:0/72445929 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f801a680 con 0x7fd8040680f0 2024-04-18T10:40:32.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.206+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8040b0830 con 0x7fd8040680f0 2024-04-18T10:40:32.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.207+0000 7fd800ff9700 1 -- 172.21.15.31:0/72445929 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fd7f8025030 con 0x7fd8040680f0 2024-04-18T10:40:32.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.207+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8040651b0 con 0x7fd8040680f0 2024-04-18T10:40:32.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.207+0000 7fd800ff9700 1 -- 172.21.15.31:0/72445929 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7fd7f8023070 con 0x7fd8040680f0 2024-04-18T10:40:32.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.211+0000 7fd800ff9700 1 -- 172.21.15.31:0/72445929 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd7f8002940 con 0x7fd8040680f0 2024-04-18T10:40:32.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.375+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd80413ae40 con 0x7fd8040680f0 2024-04-18T10:40:32.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.375+0000 7fd800ff9700 1 -- 172.21.15.31:0/72445929 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7f8015070 con 0x7fd8040680f0 2024-04-18T10:40:32.376 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:40:32.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 >> v1:172.21.15.31:6816/46601 conn(0x7fd7e8045ef0 legacy=0x7fd7e80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8040680f0 msgr2=0x7fd8040a9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 --2- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8040680f0 0x7fd8040a9d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80093f0 tx=0x7fd7f8017000 comp rx=0 tx=0).stop 2024-04-18T10:40:32.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 shutdown_connections 2024-04-18T10:40:32.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 --2- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd804144920 0x7fd80414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 --2- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd8040680f0 0x7fd8040a9d60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 --2- 172.21.15.31:0/72445929 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd8040a7110 0x7fd8040a8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 >> 172.21.15.31:0/72445929 conn(0x7fd80406bfc0 msgr2=0x7fd8040a4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:32.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 shutdown_connections 2024-04-18T10:40:32.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.377+0000 7fd80b097700 1 -- 172.21.15.31:0/72445929 wait complete. 2024-04-18T10:40:32.389 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:40:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.512+0000 7f23c46ae700 1 Processor -- start 2024-04-18T10:40:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.512+0000 7f23c46ae700 1 -- start start 2024-04-18T10:40:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c46ae700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23bc063950 0x7f23bc06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c46ae700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc06d2c0 0x7f23bc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c46ae700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23bc06e2d0 con 0x7f23bc131170 2024-04-18T10:40:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c46ae700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23bc0acd10 con 0x7f23bc063950 2024-04-18T10:40:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c46ae700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc06e060 con 0x7f23bc06d2c0 2024-04-18T10:40:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c1c49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc06d2c0 0x7f23bc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c244a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23bc063950 0x7f23bc06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c1c49700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc06d2c0 0x7f23bc06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46104/0 (socket says 172.21.15.31:46104) 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c1c49700 1 -- 172.21.15.31:0/4230330503 learned_addr learned my addr 172.21.15.31:0/4230330503 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.513+0000 7f23c2c4b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f23bc131170 0x7f23bc13e6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58102/0 (socket says 172.21.15.31:58102) 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c1c49700 1 -- 172.21.15.31:0/4230330503 >> v2:172.21.15.31:3300/0 conn(0x7f23bc063950 msgr2=0x7f23bc06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c1c49700 1 --2- 172.21.15.31:0/4230330503 >> v2:172.21.15.31:3300/0 conn(0x7f23bc063950 0x7f23bc06e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c1c49700 1 -- 172.21.15.31:0/4230330503 >> v1:172.21.15.31:6789/0 conn(0x7f23bc131170 legacy=0x7f23bc13e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c1c49700 1 -- 172.21.15.31:0/4230330503 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc0abdf0 con 0x7f23bc06d2c0 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c1448700 1 -- 172.21.15.31:0/4230330503 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100835979 0 0) 0x7f23bc06e2d0 con 0x7f23bc131170 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c244a700 1 --2- 172.21.15.31:0/4230330503 >> v2:172.21.15.31:3300/0 conn(0x7f23bc063950 0x7f23bc06e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c1c49700 1 --2- 172.21.15.31:0/4230330503 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc06d2c0 0x7f23bc06d6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0099b0 tx=0x7f23ac009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ce0af5312ac30fa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c1448700 1 -- 172.21.15.31:0/4230330503 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac009ea0 con 0x7f23bc06d2c0 2024-04-18T10:40:32.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c1448700 1 -- 172.21.15.31:0/4230330503 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac00b860 con 0x7f23bc06d2c0 2024-04-18T10:40:32.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.514+0000 7f23c1448700 1 -- 172.21.15.31:0/4230330503 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac00bc00 con 0x7f23bc06d2c0 2024-04-18T10:40:32.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.515+0000 7f23c46ae700 1 -- 172.21.15.31:0/4230330503 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc06d2c0 msgr2=0x7f23bc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.515+0000 7f23c46ae700 1 --2- 172.21.15.31:0/4230330503 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc06d2c0 0x7f23bc06d6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0099b0 tx=0x7f23ac009250 comp rx=0 tx=0).stop 2024-04-18T10:40:32.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.515+0000 7f23c46ae700 1 -- 172.21.15.31:0/4230330503 shutdown_connections 2024-04-18T10:40:32.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.515+0000 7f23c46ae700 1 --2- 172.21.15.31:0/4230330503 >> v2:172.21.15.31:3300/0 conn(0x7f23bc063950 0x7f23bc06e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.515+0000 7f23c46ae700 1 --2- 172.21.15.31:0/4230330503 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc06d2c0 0x7f23bc06d6b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.515+0000 7f23c46ae700 1 -- 172.21.15.31:0/4230330503 >> 172.21.15.31:0/4230330503 conn(0x7f23bc0b1400 msgr2=0x7f23bc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:32.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.515+0000 7f23c46ae700 1 -- 172.21.15.31:0/4230330503 shutdown_connections 2024-04-18T10:40:32.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.515+0000 7f23c46ae700 1 -- 172.21.15.31:0/4230330503 wait complete. 2024-04-18T10:40:32.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c46ae700 1 Processor -- start 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c46ae700 1 -- start start 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c46ae700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc063950 0x7f23bc1323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c46ae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc06d2c0 0x7f23bc130530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c46ae700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23bc131170 0x7f23bc130a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c46ae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc0a9500 con 0x7f23bc06d2c0 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c46ae700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc134620 con 0x7f23bc131170 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c46ae700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23bc130fb0 con 0x7f23bc063950 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c1c49700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc06d2c0 0x7f23bc130530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c244a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc063950 0x7f23bc1323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c1c49700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc06d2c0 0x7f23bc130530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43970/0 (socket says 172.21.15.31:43970) 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c244a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc063950 0x7f23bc1323e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46118/0 (socket says 172.21.15.31:46118) 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c1c49700 1 -- 172.21.15.31:0/905281874 learned_addr learned my addr 172.21.15.31:0/905281874 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:32.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.516+0000 7f23c2c4b700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23bc131170 0x7f23bc130a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c1c49700 1 -- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc063950 msgr2=0x7f23bc1323e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c1c49700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc063950 0x7f23bc1323e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c1c49700 1 -- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23bc131170 msgr2=0x7f23bc130a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c1c49700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23bc131170 0x7f23bc130a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c1c49700 1 -- 172.21.15.31:0/905281874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b8009420 con 0x7f23bc06d2c0 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c244a700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc063950 0x7f23bc1323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c2c4b700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23bc131170 0x7f23bc130a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c1c49700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc06d2c0 0x7f23bc130530 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009290 tx=0x7f23ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23b27fc700 1 -- 172.21.15.31:0/905281874 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac022070 con 0x7f23bc06d2c0 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23b27fc700 1 -- 172.21.15.31:0/905281874 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac011420 con 0x7f23bc06d2c0 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0094f0 con 0x7f23bc06d2c0 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23b27fc700 1 -- 172.21.15.31:0/905281874 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac011800 con 0x7f23bc06d2c0 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.517+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23bc131a50 con 0x7f23bc06d2c0 2024-04-18T10:40:32.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.518+0000 7f23b27fc700 1 -- 172.21.15.31:0/905281874 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f23ac011c30 con 0x7f23bc06d2c0 2024-04-18T10:40:32.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.518+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23bc132a60 con 0x7f23bc06d2c0 2024-04-18T10:40:32.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.518+0000 7f23b27fc700 1 -- 172.21.15.31:0/905281874 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7f23ac0605f0 con 0x7f23bc06d2c0 2024-04-18T10:40:32.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.523+0000 7f23b27fc700 1 -- 172.21.15.31:0/905281874 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f23ac027c90 con 0x7f23bc06d2c0 2024-04-18T10:40:32.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.687+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23bc0651b0 con 0x7f23bc06d2c0 2024-04-18T10:40:32.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.688+0000 7f23b27fc700 1 -- 172.21.15.31:0/905281874 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23ac027c90 con 0x7f23bc06d2c0 2024-04-18T10:40:32.689 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 >> v1:172.21.15.31:6816/46601 conn(0x7f23a0045f20 legacy=0x7f23a00483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc06d2c0 msgr2=0x7f23bc130530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc06d2c0 0x7f23bc130530 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009290 tx=0x7f23ac017000 comp rx=0 tx=0).stop 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 shutdown_connections 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f23bc063950 0x7f23bc1323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f23bc131170 0x7f23bc130a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 --2- 172.21.15.31:0/905281874 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23bc06d2c0 0x7f23bc130530 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 >> 172.21.15.31:0/905281874 conn(0x7f23bc0b1400 msgr2=0x7f23bc13e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 shutdown_connections 2024-04-18T10:40:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.690+0000 7f23c46ae700 1 -- 172.21.15.31:0/905281874 wait complete. 2024-04-18T10:40:32.702 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:40:32.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.824+0000 7f7aba04a700 1 Processor -- start 2024-04-18T10:40:32.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.824+0000 7f7aba04a700 1 -- start start 2024-04-18T10:40:32.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.824+0000 7f7aba04a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab40a5260 0x7f7ab4143b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.824+0000 7f7aba04a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab41440c0 0x7f7ab41464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.824+0000 7f7aba04a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40a3540 con 0x7f7ab406ecf0 2024-04-18T10:40:32.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.824+0000 7f7aba04a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40a7470 con 0x7f7ab40a5260 2024-04-18T10:40:32.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.824+0000 7f7aba04a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40a37e0 con 0x7f7ab41440c0 2024-04-18T10:40:32.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab41440c0 0x7f7ab41464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab2ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab40a5260 0x7f7ab4143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab41440c0 0x7f7ab41464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46130/0 (socket says 172.21.15.31:46130) 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab2ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab40a5260 0x7f7ab4143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59122/0 (socket says 172.21.15.31:59122) 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab37fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7ab406ecf0 0x7f7ab40a6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58110/0 (socket says 172.21.15.31:58110) 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab3fff700 1 -- 172.21.15.31:0/2325134027 learned_addr learned my addr 172.21.15.31:0/2325134027 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab2ffd700 1 -- 172.21.15.31:0/2325134027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab41440c0 msgr2=0x7f7ab41464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab2ffd700 1 --2- 172.21.15.31:0/2325134027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab41440c0 0x7f7ab41464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab2ffd700 1 -- 172.21.15.31:0/2325134027 >> v1:172.21.15.31:6789/0 conn(0x7f7ab406ecf0 legacy=0x7f7ab40a6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab27fc700 1 -- 172.21.15.31:0/2325134027 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273461947 0 0) 0x7f7ab40a3540 con 0x7f7ab406ecf0 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab2ffd700 1 -- 172.21.15.31:0/2325134027 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40a5630 con 0x7f7ab40a5260 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab3fff700 1 --2- 172.21.15.31:0/2325134027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab41440c0 0x7f7ab41464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab2ffd700 1 --2- 172.21.15.31:0/2325134027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab40a5260 0x7f7ab4143b80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800de90 tx=0x7f7aa800d780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f26a97ad9e716b72 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab27fc700 1 -- 172.21.15.31:0/2325134027 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8012070 con 0x7f7ab40a5260 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab27fc700 1 -- 172.21.15.31:0/2325134027 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa800fc30 con 0x7f7ab40a5260 2024-04-18T10:40:32.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.825+0000 7f7ab27fc700 1 -- 172.21.15.31:0/2325134027 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa800aea0 con 0x7f7ab40a5260 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.826+0000 7f7aba04a700 1 -- 172.21.15.31:0/2325134027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab40a5260 msgr2=0x7f7ab4143b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.826+0000 7f7aba04a700 1 --2- 172.21.15.31:0/2325134027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab40a5260 0x7f7ab4143b80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800de90 tx=0x7f7aa800d780 comp rx=0 tx=0).stop 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.826+0000 7f7aba04a700 1 -- 172.21.15.31:0/2325134027 shutdown_connections 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.826+0000 7f7aba04a700 1 --2- 172.21.15.31:0/2325134027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab41440c0 0x7f7ab41464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.826+0000 7f7aba04a700 1 --2- 172.21.15.31:0/2325134027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab40a5260 0x7f7ab4143b80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.826+0000 7f7aba04a700 1 -- 172.21.15.31:0/2325134027 >> 172.21.15.31:0/2325134027 conn(0x7f7ab40679e0 msgr2=0x7f7ab4067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.826+0000 7f7aba04a700 1 -- 172.21.15.31:0/2325134027 shutdown_connections 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.826+0000 7f7aba04a700 1 -- 172.21.15.31:0/2325134027 wait complete. 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.827+0000 7f7aba04a700 1 Processor -- start 2024-04-18T10:40:32.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.827+0000 7f7aba04a700 1 -- start start 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.827+0000 7f7aba04a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab406ecf0 0x7f7ab40a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.827+0000 7f7aba04a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab40a5260 0x7f7ab414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.827+0000 7f7aba04a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ab41440c0 0x7f7ab40a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7aba04a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40a7b40 con 0x7f7ab41440c0 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7aba04a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4143170 con 0x7f7ab406ecf0 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7aba04a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab41428b0 con 0x7f7ab40a5260 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab406ecf0 0x7f7ab40a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab2ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab40a5260 0x7f7ab414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab406ecf0 0x7f7ab40a96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59138/0 (socket says 172.21.15.31:59138) 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab37fe700 1 -- 172.21.15.31:0/2328598460 learned_addr learned my addr 172.21.15.31:0/2328598460 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab2ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab40a5260 0x7f7ab414d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46138/0 (socket says 172.21.15.31:46138) 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab3fff700 1 --2- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ab41440c0 0x7f7ab40a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab2ffd700 1 -- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab406ecf0 msgr2=0x7f7ab40a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab2ffd700 1 --2- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab406ecf0 0x7f7ab40a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab2ffd700 1 -- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ab41440c0 msgr2=0x7f7ab40a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab2ffd700 1 --2- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ab41440c0 0x7f7ab40a7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab2ffd700 1 -- 172.21.15.31:0/2328598460 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac009ae0 con 0x7f7ab40a5260 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab37fe700 1 --2- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab406ecf0 0x7f7ab40a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7ab2ffd700 1 --2- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab40a5260 0x7f7ab414d500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7aa801a000 tx=0x7f7aa801d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7a9b7fe700 1 -- 172.21.15.31:0/2328598460 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8016dd0 con 0x7f7ab40a5260 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7a9b7fe700 1 -- 172.21.15.31:0/2328598460 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa8020430 con 0x7f7ab40a5260 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa800da20 con 0x7f7ab40a5260 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7a9b7fe700 1 -- 172.21.15.31:0/2328598460 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa80207f0 con 0x7f7ab40a5260 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.828+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab41436f0 con 0x7f7ab40a5260 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.829+0000 7f7a9b7fe700 1 -- 172.21.15.31:0/2328598460 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f7aa8020c20 con 0x7f7ab40a5260 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.829+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab414d370 con 0x7f7ab40a5260 2024-04-18T10:40:32.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.830+0000 7f7a9b7fe700 1 -- 172.21.15.31:0/2328598460 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7f7aa8060860 con 0x7f7ab40a5260 2024-04-18T10:40:32.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.833+0000 7f7a9b7fe700 1 -- 172.21.15.31:0/2328598460 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7aa8042520 con 0x7f7ab40a5260 2024-04-18T10:40:32.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.999+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ab40a5b80 con 0x7f7ab40a5260 2024-04-18T10:40:33.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:32.999+0000 7f7a9b7fe700 1 -- 172.21.15.31:0/2328598460 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7aa8042520 con 0x7f7ab40a5260 2024-04-18T10:40:33.000 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:40:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 >> v1:172.21.15.31:6816/46601 conn(0x7f7aa0045f20 legacy=0x7f7aa00483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab40a5260 msgr2=0x7f7ab414d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 --2- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab40a5260 0x7f7ab414d500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7aa801a000 tx=0x7f7aa801d000 comp rx=0 tx=0).stop 2024-04-18T10:40:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 shutdown_connections 2024-04-18T10:40:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 --2- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ab41440c0 0x7f7ab40a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 --2- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7ab406ecf0 0x7f7ab40a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 --2- 172.21.15.31:0/2328598460 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7ab40a5260 0x7f7ab414d500 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 >> 172.21.15.31:0/2328598460 conn(0x7f7ab40679e0 msgr2=0x7f7ab40a4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:33.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 shutdown_connections 2024-04-18T10:40:33.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.001+0000 7f7aba04a700 1 -- 172.21.15.31:0/2328598460 wait complete. 2024-04-18T10:40:33.014 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T10:40:33.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.134+0000 7f66a6044700 1 Processor -- start 2024-04-18T10:40:33.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.134+0000 7f66a6044700 1 -- start start 2024-04-18T10:40:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f66a6044700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a013efd0 0x7f66a0146f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f66a6044700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a0147450 0x7f66a0149830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f66a6044700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a00ab140 con 0x7f66a00aa8e0 2024-04-18T10:40:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f66a6044700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a013e660 con 0x7f66a013efd0 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f66a6044700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00a7160 con 0x7f66a0147450 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f66a00aa8e0 0x7f66a00a8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58124/0 (socket says 172.21.15.31:58124) 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669f7fe700 1 -- 172.21.15.31:0/1741237462 learned_addr learned my addr 172.21.15.31:0/1741237462 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669effd700 1 --2- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a013efd0 0x7f66a0146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669ffff700 1 --2- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a0147450 0x7f66a0149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669e7fc700 1 -- 172.21.15.31:0/1741237462 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322651159 0 0) 0x7f66a00ab140 con 0x7f66a00aa8e0 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669e7fc700 1 -- 172.21.15.31:0/1741237462 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f668c003570 con 0x7f66a00aa8e0 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669ffff700 1 -- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a013efd0 msgr2=0x7f66a0146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669ffff700 1 --2- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a013efd0 0x7f66a0146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669ffff700 1 -- 172.21.15.31:0/1741237462 >> v1:172.21.15.31:6789/0 conn(0x7f66a00aa8e0 legacy=0x7f66a00a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669ffff700 1 -- 172.21.15.31:0/1741237462 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a013e900 con 0x7f66a0147450 2024-04-18T10:40:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.135+0000 7f669effd700 1 --2- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a013efd0 0x7f66a0146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f669ffff700 1 --2- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a0147450 0x7f66a0149830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6698009e90 tx=0x7f6698009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a31ed300ece4f427 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f669e7fc700 1 -- 172.21.15.31:0/1741237462 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800e070 con 0x7f66a0147450 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f669e7fc700 1 -- 172.21.15.31:0/1741237462 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669800bb80 con 0x7f66a0147450 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f669e7fc700 1 -- 172.21.15.31:0/1741237462 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698012430 con 0x7f66a0147450 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f66a6044700 1 -- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a0147450 msgr2=0x7f66a0149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f66a6044700 1 --2- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a0147450 0x7f66a0149830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6698009e90 tx=0x7f6698009780 comp rx=0 tx=0).stop 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f66a6044700 1 -- 172.21.15.31:0/1741237462 shutdown_connections 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f66a6044700 1 --2- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a0147450 0x7f66a0149830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f66a6044700 1 --2- 172.21.15.31:0/1741237462 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a013efd0 0x7f66a0146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f66a6044700 1 -- 172.21.15.31:0/1741237462 >> 172.21.15.31:0/1741237462 conn(0x7f66a0069450 msgr2=0x7f66a0063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f66a6044700 1 -- 172.21.15.31:0/1741237462 shutdown_connections 2024-04-18T10:40:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.136+0000 7f66a6044700 1 -- 172.21.15.31:0/1741237462 wait complete. 2024-04-18T10:40:33.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.137+0000 7f66a6044700 1 Processor -- start 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f66a6044700 1 -- start start 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f66a6044700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00aa8e0 0x7f66a00a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f66a6044700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a013efd0 0x7f66a01407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f66a6044700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a0147450 0x7f66a0151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f66a6044700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0140370 con 0x7f66a00aa8e0 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f66a6044700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0136460 con 0x7f66a0147450 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f66a6044700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66a00a6420 con 0x7f66a013efd0 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00aa8e0 0x7f66a00a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a013efd0 0x7f66a01407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a0147450 0x7f66a0151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00aa8e0 0x7f66a00a5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43998/0 (socket says 172.21.15.31:43998) 2024-04-18T10:40:33.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669f7fe700 1 -- 172.21.15.31:0/484807244 learned_addr learned my addr 172.21.15.31:0/484807244 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669effd700 1 -- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a0147450 msgr2=0x7f66a0151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669effd700 1 --2- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a0147450 0x7f66a0151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669effd700 1 -- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00aa8e0 msgr2=0x7f66a00a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669effd700 1 --2- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00aa8e0 0x7f66a00a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669effd700 1 -- 172.21.15.31:0/484807244 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6688009420 con 0x7f66a013efd0 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.138+0000 7f669ffff700 1 --2- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a0147450 0x7f66a0151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.139+0000 7f669f7fe700 1 --2- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00aa8e0 0x7f66a00a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.139+0000 7f669effd700 1 --2- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a013efd0 0x7f66a01407a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f668800ec80 tx=0x7f66880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.139+0000 7f66977fe700 1 -- 172.21.15.31:0/484807244 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800c850 con 0x7f66a013efd0 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.139+0000 7f66977fe700 1 -- 172.21.15.31:0/484807244 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668800c9b0 con 0x7f66a013efd0 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.139+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6698009a20 con 0x7f66a013efd0 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.139+0000 7f66977fe700 1 -- 172.21.15.31:0/484807244 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668800cd70 con 0x7f66a013efd0 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.139+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a01357d0 con 0x7f66a013efd0 2024-04-18T10:40:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.140+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a01404e0 con 0x7f66a013efd0 2024-04-18T10:40:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.140+0000 7f66977fe700 1 -- 172.21.15.31:0/484807244 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f6688013680 con 0x7f66a013efd0 2024-04-18T10:40:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.140+0000 7f66977fe700 1 -- 172.21.15.31:0/484807244 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7f668805b6a0 con 0x7f66a013efd0 2024-04-18T10:40:33.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.144+0000 7f66977fe700 1 -- 172.21.15.31:0/484807244 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f6688039910 con 0x7f66a013efd0 2024-04-18T10:40:33.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.322+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f66a0064920 con 0x7f66a013efd0 2024-04-18T10:40:33.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.323+0000 7f66977fe700 1 -- 172.21.15.31:0/484807244 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 5 entries v43) v1 ==== 80+0+291 (secure 0 0 0) 0x7f668803d100 con 0x7f66a013efd0 2024-04-18T10:40:33.324 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6819/3321563080 2024-04-19T10:38:52.565121+0000 2024-04-18T10:40:33.324 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2921291208 2024-04-19T10:38:28.389077+0000 2024-04-18T10:40:33.324 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2767636595 2024-04-19T10:38:28.389077+0000 2024-04-18T10:40:33.324 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3252462560 2024-04-19T10:38:28.389077+0000 2024-04-18T10:40:33.324 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6816/39551 2024-04-19T10:38:28.389077+0000 2024-04-18T10:40:33.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.324+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 >> v1:172.21.15.31:6816/46601 conn(0x7f6680045ef0 legacy=0x7f66800483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.324+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a013efd0 msgr2=0x7f66a01407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.324+0000 7f66a6044700 1 --2- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a013efd0 0x7f66a01407a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f668800ec80 tx=0x7f66880091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.324+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 shutdown_connections 2024-04-18T10:40:33.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.324+0000 7f66a6044700 1 --2- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f66a0147450 0x7f66a0151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.324+0000 7f66a6044700 1 --2- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66a00aa8e0 0x7f66a00a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.325+0000 7f66a6044700 1 --2- 172.21.15.31:0/484807244 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f66a013efd0 0x7f66a01407a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.325+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 >> 172.21.15.31:0/484807244 conn(0x7f66a0069450 msgr2=0x7f66a013def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:33.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.325+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 shutdown_connections 2024-04-18T10:40:33.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.325+0000 7f66a6044700 1 -- 172.21.15.31:0/484807244 wait complete. 2024-04-18T10:40:33.326 INFO:teuthology.orchestra.run.smithi031.stderr:listed 5 entries 2024-04-18T10:40:33.337 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:40:33.337 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T10:40:33.360 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:40:33.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.480+0000 7eff6062b700 1 Processor -- start 2024-04-18T10:40:33.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.480+0000 7eff6062b700 1 -- start start 2024-04-18T10:40:33.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.480+0000 7eff6062b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff580a3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.480+0000 7eff6062b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff580684c0 0x7eff581494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff6062b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff580af2f0 con 0x7eff580679e0 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff6062b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5806db90 con 0x7eff580684c0 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff6062b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff580a3e80 con 0x7eff58069200 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5e3c7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff580a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5ebc8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff580684c0 0x7eff581494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5dbc6700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7eff580679e0 0x7eff58067db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58130/0 (socket says 172.21.15.31:58130) 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5dbc6700 1 -- 172.21.15.31:0/3379526928 learned_addr learned my addr 172.21.15.31:0/3379526928 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5ebc8700 1 -- 172.21.15.31:0/3379526928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 msgr2=0x7eff580a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5ebc8700 1 --2- 172.21.15.31:0/3379526928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff580a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5ebc8700 1 -- 172.21.15.31:0/3379526928 >> v1:172.21.15.31:6789/0 conn(0x7eff580679e0 legacy=0x7eff58067db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5ebc8700 1 -- 172.21.15.31:0/3379526928 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff580a25c0 con 0x7eff580684c0 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5d3c5700 1 -- 172.21.15.31:0/3379526928 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902633070 0 0) 0x7eff580af2f0 con 0x7eff580679e0 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5e3c7700 1 --2- 172.21.15.31:0/3379526928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff580a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5ebc8700 1 --2- 172.21.15.31:0/3379526928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580684c0 0x7eff581494c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7eff50009e60 tx=0x7eff50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31be515b44a60d46 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:33.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5d3c5700 1 -- 172.21.15.31:0/3379526928 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5000e070 con 0x7eff580684c0 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5d3c5700 1 -- 172.21.15.31:0/3379526928 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5000bb60 con 0x7eff580684c0 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.481+0000 7eff5d3c5700 1 -- 172.21.15.31:0/3379526928 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50012430 con 0x7eff580684c0 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.482+0000 7eff6062b700 1 -- 172.21.15.31:0/3379526928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580684c0 msgr2=0x7eff581494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.482+0000 7eff6062b700 1 --2- 172.21.15.31:0/3379526928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580684c0 0x7eff581494c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7eff50009e60 tx=0x7eff50009780 comp rx=0 tx=0).stop 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.482+0000 7eff6062b700 1 -- 172.21.15.31:0/3379526928 shutdown_connections 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.482+0000 7eff6062b700 1 --2- 172.21.15.31:0/3379526928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580684c0 0x7eff581494c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.482+0000 7eff6062b700 1 --2- 172.21.15.31:0/3379526928 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff580a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.482+0000 7eff6062b700 1 -- 172.21.15.31:0/3379526928 >> 172.21.15.31:0/3379526928 conn(0x7eff5806cd10 msgr2=0x7eff58068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.482+0000 7eff6062b700 1 -- 172.21.15.31:0/3379526928 shutdown_connections 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.482+0000 7eff6062b700 1 -- 172.21.15.31:0/3379526928 wait complete. 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.483+0000 7eff6062b700 1 Processor -- start 2024-04-18T10:40:33.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.483+0000 7eff6062b700 1 -- start start 2024-04-18T10:40:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.483+0000 7eff6062b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580679e0 0x7eff58099ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.483+0000 7eff6062b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff580684c0 0x7eff580ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.483+0000 7eff6062b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff5809b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.483+0000 7eff6062b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5809a860 con 0x7eff580679e0 2024-04-18T10:40:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.483+0000 7eff6062b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff58098c90 con 0x7eff58069200 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.483+0000 7eff6062b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff58098f30 con 0x7eff580684c0 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5e3c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580679e0 0x7eff58099ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5ebc8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff5809b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5dbc6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff580684c0 0x7eff580ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5e3c7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580679e0 0x7eff58099ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44004/0 (socket says 172.21.15.31:44004) 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5ebc8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff5809b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59168/0 (socket says 172.21.15.31:59168) 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5e3c7700 1 -- 172.21.15.31:0/3741298002 learned_addr learned my addr 172.21.15.31:0/3741298002 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5ebc8700 1 -- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff580684c0 msgr2=0x7eff580ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5ebc8700 1 --2- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff580684c0 0x7eff580ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5ebc8700 1 -- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580679e0 msgr2=0x7eff58099ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5ebc8700 1 --2- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580679e0 0x7eff58099ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5ebc8700 1 -- 172.21.15.31:0/3741298002 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff54009420 con 0x7eff58069200 2024-04-18T10:40:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5e3c7700 1 --2- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580679e0 0x7eff58099ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff5ebc8700 1 --2- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff5809b060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7eff58068a50 tx=0x7eff50019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff4e7fc700 1 -- 172.21.15.31:0/3741298002 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50027470 con 0x7eff58069200 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff4e7fc700 1 -- 172.21.15.31:0/3741298002 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff500275d0 con 0x7eff58069200 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff50009a20 con 0x7eff58069200 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff4e7fc700 1 -- 172.21.15.31:0/3741298002 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50027990 con 0x7eff58069200 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.484+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff58099820 con 0x7eff58069200 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.485+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5806efb0 con 0x7eff58069200 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.485+0000 7eff4e7fc700 1 -- 172.21.15.31:0/3741298002 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7eff50024070 con 0x7eff58069200 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.486+0000 7eff4e7fc700 1 -- 172.21.15.31:0/3741298002 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7eff5005d5e0 con 0x7eff58069200 2024-04-18T10:40:33.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.489+0000 7eff4e7fc700 1 -- 172.21.15.31:0/3741298002 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7eff5001fb10 con 0x7eff58069200 2024-04-18T10:40:33.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.655+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff58099820 con 0x7eff58069200 2024-04-18T10:40:33.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.656+0000 7eff4e7fc700 1 -- 172.21.15.31:0/3741298002 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+11966 (secure 0 0 0) 0x7eff58099820 con 0x7eff58069200 2024-04-18T10:40:33.657 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:40:33.657 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":43,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:39:29.493067+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":42,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":42,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.657+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 >> v1:172.21.15.31:6816/46601 conn(0x7eff3c045ef0 legacy=0x7eff3c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.657+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 msgr2=0x7eff5809b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.657+0000 7eff6062b700 1 --2- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff5809b060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7eff58068a50 tx=0x7eff50019000 comp rx=0 tx=0).stop 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.657+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 shutdown_connections 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.657+0000 7eff6062b700 1 --2- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7eff58069200 0x7eff5809b060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.657+0000 7eff6062b700 1 --2- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff580679e0 0x7eff58099ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.657+0000 7eff6062b700 1 --2- 172.21.15.31:0/3741298002 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7eff580684c0 0x7eff580ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.658+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 >> 172.21.15.31:0/3741298002 conn(0x7eff5806cd10 msgr2=0x7eff58064920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.658+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 shutdown_connections 2024-04-18T10:40:33.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.658+0000 7eff6062b700 1 -- 172.21.15.31:0/3741298002 wait complete. 2024-04-18T10:40:33.670 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:40:33.670 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:40:33.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.792+0000 7f5a1fb6d700 1 Processor -- start 2024-04-18T10:40:33.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.792+0000 7f5a1fb6d700 1 -- start start 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1fb6d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a18069450 0x7f5a180a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1fb6d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a1813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1fb6d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a1813ef60 0x7f5a1806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1fb6d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a180a3ad0 con 0x7f5a1813ef60 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1fb6d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a180a57c0 con 0x7f5a18069450 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1fb6d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a180a59e0 con 0x7f5a180a30c0 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1e10a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a1813ef60 0x7f5a1806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1d108700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a1813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1d909700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a18069450 0x7f5a180a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1e10a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a1813ef60 0x7f5a1806d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44016/0 (socket says 172.21.15.31:44016) 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1d108700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a1813ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46170/0 (socket says 172.21.15.31:46170) 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1d909700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a18069450 0x7f5a180a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59180/0 (socket says 172.21.15.31:59180) 2024-04-18T10:40:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1e10a700 1 -- 172.21.15.31:0/2885041641 learned_addr learned my addr 172.21.15.31:0/2885041641 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1e10a700 1 -- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 msgr2=0x7f5a1813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1e10a700 1 --2- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a1813ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1e10a700 1 -- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a18069450 msgr2=0x7f5a180a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1e10a700 1 --2- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a18069450 0x7f5a180a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1e10a700 1 -- 172.21.15.31:0/2885041641 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a180a4bc0 con 0x7f5a1813ef60 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1d909700 1 --2- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a18069450 0x7f5a180a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1d108700 1 --2- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a1813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.793+0000 7f5a1e10a700 1 --2- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1813ef60 0x7f5a1806d9f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009f50 tx=0x7f5a10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d694d2003038be server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1c907700 1 -- 172.21.15.31:0/2885041641 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000e070 con 0x7f5a1813ef60 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1c907700 1 -- 172.21.15.31:0/2885041641 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1000b910 con 0x7f5a1813ef60 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1c907700 1 -- 172.21.15.31:0/2885041641 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a100092e0 con 0x7f5a1813ef60 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1813ef60 msgr2=0x7f5a1806d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1fb6d700 1 --2- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1813ef60 0x7f5a1806d9f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009f50 tx=0x7f5a10009840 comp rx=0 tx=0).stop 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/2885041641 shutdown_connections 2024-04-18T10:40:33.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1fb6d700 1 --2- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a1813ef60 0x7f5a1806d9f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1fb6d700 1 --2- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a18069450 0x7f5a180a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1fb6d700 1 --2- 172.21.15.31:0/2885041641 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a1813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/2885041641 >> 172.21.15.31:0/2885041641 conn(0x7f5a1806ae80 msgr2=0x7f5a18068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/2885041641 shutdown_connections 2024-04-18T10:40:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.794+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/2885041641 wait complete. 2024-04-18T10:40:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.795+0000 7f5a1fb6d700 1 Processor -- start 2024-04-18T10:40:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.795+0000 7f5a1fb6d700 1 -- start start 2024-04-18T10:40:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1fb6d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a18069450 0x7f5a18098790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1fb6d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a18151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1fb6d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a1813ef60 0x7f5a181515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1fb6d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a18099350 con 0x7f5a18069450 2024-04-18T10:40:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1fb6d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a18097910 con 0x7f5a1813ef60 2024-04-18T10:40:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1fb6d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a18097650 con 0x7f5a180a30c0 2024-04-18T10:40:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1e10a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a1813ef60 0x7f5a181515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d909700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a18069450 0x7f5a18098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d108700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a18151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d108700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a18151060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46186/0 (socket says 172.21.15.31:46186) 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1e10a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a1813ef60 0x7f5a181515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59190/0 (socket says 172.21.15.31:59190) 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d909700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a18069450 0x7f5a18098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44018/0 (socket says 172.21.15.31:44018) 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d108700 1 -- 172.21.15.31:0/296007352 learned_addr learned my addr 172.21.15.31:0/296007352 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d909700 1 -- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 msgr2=0x7f5a18151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d909700 1 --2- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a18151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d909700 1 -- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a1813ef60 msgr2=0x7f5a181515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d909700 1 --2- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a1813ef60 0x7f5a181515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d909700 1 -- 172.21.15.31:0/296007352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08009420 con 0x7f5a18069450 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d108700 1 --2- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a18151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a1d909700 1 --2- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a18069450 0x7f5a18098790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800ec80 tx=0x7f5a080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a0dffb700 1 -- 172.21.15.31:0/296007352 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0800c850 con 0x7f5a18069450 2024-04-18T10:40:33.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.796+0000 7f5a0dffb700 1 -- 172.21.15.31:0/296007352 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0800c9b0 con 0x7f5a18069450 2024-04-18T10:40:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.797+0000 7f5a0dffb700 1 -- 172.21.15.31:0/296007352 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0800cd70 con 0x7f5a18069450 2024-04-18T10:40:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.797+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1400b6d0 con 0x7f5a18069450 2024-04-18T10:40:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.797+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a10009ae0 con 0x7f5a18069450 2024-04-18T10:40:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.798+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a180651b0 con 0x7f5a18069450 2024-04-18T10:40:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.798+0000 7f5a0dffb700 1 -- 172.21.15.31:0/296007352 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f5a08013680 con 0x7f5a18069450 2024-04-18T10:40:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.798+0000 7f5a0dffb700 1 -- 172.21.15.31:0/296007352 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7f5a0805b360 con 0x7f5a18069450 2024-04-18T10:40:33.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.802+0000 7f5a0dffb700 1 -- 172.21.15.31:0/296007352 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5a080395d0 con 0x7f5a18069450 2024-04-18T10:40:33.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.964+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a180997e0 con 0x7f5a18069450 2024-04-18T10:40:33.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.964+0000 7f5a0dffb700 1 -- 172.21.15.31:0/296007352 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a0803cdc0 con 0x7f5a18069450 2024-04-18T10:40:33.965 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:40:33.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 >> v1:172.21.15.31:6816/46601 conn(0x7f59fc045ef0 legacy=0x7f59fc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a18069450 msgr2=0x7f5a18098790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:33.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 --2- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a18069450 0x7f5a18098790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800ec80 tx=0x7f5a080091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 shutdown_connections 2024-04-18T10:40:33.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 --2- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f5a1813ef60 0x7f5a181515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 --2- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a18069450 0x7f5a18098790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 --2- 172.21.15.31:0/296007352 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f5a180a30c0 0x7f5a18151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:33.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 >> 172.21.15.31:0/296007352 conn(0x7f5a1806ae80 msgr2=0x7f5a1806d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:33.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 shutdown_connections 2024-04-18T10:40:33.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:33.966+0000 7f5a1fb6d700 1 -- 172.21.15.31:0/296007352 wait complete. 2024-04-18T10:40:33.978 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:40:34.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.100+0000 7f97d1cac700 1 Processor -- start 2024-04-18T10:40:34.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.100+0000 7f97d1cac700 1 -- start start 2024-04-18T10:40:34.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97d1cac700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f97cc06ecf0 0x7f97cc0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97d1cac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc0a6d60 0x7f97cc142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97d1cac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a7130 0x7f97cc1450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97d1cac700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97cc0a3540 con 0x7f97cc06ecf0 2024-04-18T10:40:34.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97d1cac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0a37e0 con 0x7f97cc0a7130 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97d1cac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0a5d60 con 0x7f97cc0a6d60 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97cb7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f97cc06ecf0 0x7f97cc0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97cbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a7130 0x7f97cc1450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97caffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc0a6d60 0x7f97cc142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97caffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc0a6d60 0x7f97cc142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46190/0 (socket says 172.21.15.31:46190) 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97cb7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f97cc06ecf0 0x7f97cc0a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44026/0 (socket says 172.21.15.31:44026) 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97caffd700 1 -- 172.21.15.31:0/1151924943 learned_addr learned my addr 172.21.15.31:0/1151924943 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97cbfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a7130 0x7f97cc1450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59206/0 (socket says 172.21.15.31:59206) 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97caffd700 1 -- 172.21.15.31:0/1151924943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a7130 msgr2=0x7f97cc1450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97caffd700 1 --2- 172.21.15.31:0/1151924943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a7130 0x7f97cc1450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97caffd700 1 -- 172.21.15.31:0/1151924943 >> v2:172.21.15.31:3300/0 conn(0x7f97cc06ecf0 msgr2=0x7f97cc0a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97caffd700 1 --2- 172.21.15.31:0/1151924943 >> v2:172.21.15.31:3300/0 conn(0x7f97cc06ecf0 0x7f97cc0a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97caffd700 1 -- 172.21.15.31:0/1151924943 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc06d980 con 0x7f97cc0a6d60 2024-04-18T10:40:34.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97cb7fe700 1 --2- 172.21.15.31:0/1151924943 >> v2:172.21.15.31:3300/0 conn(0x7f97cc06ecf0 0x7f97cc0a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97cbfff700 1 --2- 172.21.15.31:0/1151924943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a7130 0x7f97cc1450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.101+0000 7f97caffd700 1 --2- 172.21.15.31:0/1151924943 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc0a6d60 0x7f97cc142b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97b40099b0 tx=0x7f97b4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ac3738460ca44c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97ca7fc700 1 -- 172.21.15.31:0/1151924943 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400b680 con 0x7f97cc0a6d60 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97ca7fc700 1 -- 172.21.15.31:0/1151924943 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b400b7e0 con 0x7f97cc0a6d60 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97ca7fc700 1 -- 172.21.15.31:0/1151924943 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400bb80 con 0x7f97cc0a6d60 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97d1cac700 1 -- 172.21.15.31:0/1151924943 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc0a6d60 msgr2=0x7f97cc142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97d1cac700 1 --2- 172.21.15.31:0/1151924943 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc0a6d60 0x7f97cc142b70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97b40099b0 tx=0x7f97b4009250 comp rx=0 tx=0).stop 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97d1cac700 1 -- 172.21.15.31:0/1151924943 shutdown_connections 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97d1cac700 1 --2- 172.21.15.31:0/1151924943 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a7130 0x7f97cc1450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97d1cac700 1 --2- 172.21.15.31:0/1151924943 >> v2:172.21.15.31:3300/0 conn(0x7f97cc06ecf0 0x7f97cc0a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97d1cac700 1 --2- 172.21.15.31:0/1151924943 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc0a6d60 0x7f97cc142b70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97d1cac700 1 -- 172.21.15.31:0/1151924943 >> 172.21.15.31:0/1151924943 conn(0x7f97cc0679e0 msgr2=0x7f97cc067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97d1cac700 1 -- 172.21.15.31:0/1151924943 shutdown_connections 2024-04-18T10:40:34.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.102+0000 7f97d1cac700 1 -- 172.21.15.31:0/1151924943 wait complete. 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.103+0000 7f97d1cac700 1 Processor -- start 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.103+0000 7f97d1cac700 1 -- start start 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97d1cac700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc06ecf0 0x7f97cc096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97d1cac700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a6d60 0x7f97cc0ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97d1cac700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97cc0a7130 0x7f97cc0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97d1cac700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0af2f0 con 0x7f97cc0a7130 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97d1cac700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc14dd20 con 0x7f97cc0a6d60 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97d1cac700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc0af4f0 con 0x7f97cc06ecf0 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc06ecf0 0x7f97cc096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97caffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a6d60 0x7f97cc0ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97caffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a6d60 0x7f97cc0ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:59210/0 (socket says 172.21.15.31:59210) 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97cb7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc06ecf0 0x7f97cc096a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46206/0 (socket says 172.21.15.31:46206) 2024-04-18T10:40:34.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97caffd700 1 -- 172.21.15.31:0/4031129824 learned_addr learned my addr 172.21.15.31:0/4031129824 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97cbfff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97cc0a7130 0x7f97cc0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97caffd700 1 -- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc06ecf0 msgr2=0x7f97cc096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97caffd700 1 --2- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc06ecf0 0x7f97cc096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97caffd700 1 -- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97cc0a7130 msgr2=0x7f97cc0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97caffd700 1 --2- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97cc0a7130 0x7f97cc0adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97caffd700 1 -- 172.21.15.31:0/4031129824 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc009420 con 0x7f97cc0a6d60 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97cb7fe700 1 --2- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc06ecf0 0x7f97cc096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.104+0000 7f97caffd700 1 --2- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a6d60 0x7f97cc0ae9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009290 tx=0x7f97b4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.105+0000 7f97c37fe700 1 -- 172.21.15.31:0/4031129824 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b400b950 con 0x7f97cc0a6d60 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.105+0000 7f97c37fe700 1 -- 172.21.15.31:0/4031129824 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b400bab0 con 0x7f97cc0a6d60 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.105+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c4009a20 con 0x7f97cc0a6d60 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.105+0000 7f97c37fe700 1 -- 172.21.15.31:0/4031129824 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b401a680 con 0x7f97cc0a6d60 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.105+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b40094f0 con 0x7f97cc0a6d60 2024-04-18T10:40:34.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.106+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97cc0651b0 con 0x7f97cc0a6d60 2024-04-18T10:40:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.106+0000 7f97c37fe700 1 -- 172.21.15.31:0/4031129824 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f97b401aa70 con 0x7f97cc0a6d60 2024-04-18T10:40:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.106+0000 7f97c37fe700 1 -- 172.21.15.31:0/4031129824 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7f97b405cb50 con 0x7f97cc0a6d60 2024-04-18T10:40:34.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.110+0000 7f97c37fe700 1 -- 172.21.15.31:0/4031129824 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f97b401c2a0 con 0x7f97cc0a6d60 2024-04-18T10:40:34.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.269+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97cc141fb0 con 0x7f97cc0a6d60 2024-04-18T10:40:34.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.269+0000 7f97c37fe700 1 -- 172.21.15.31:0/4031129824 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97b4015030 con 0x7f97cc0a6d60 2024-04-18T10:40:34.270 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 >> v1:172.21.15.31:6816/46601 conn(0x7f97ac045ef0 legacy=0x7f97ac0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a6d60 msgr2=0x7f97cc0ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 --2- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a6d60 0x7f97cc0ae9a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009290 tx=0x7f97b4017000 comp rx=0 tx=0).stop 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 shutdown_connections 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 --2- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f97cc06ecf0 0x7f97cc096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 --2- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97cc0a7130 0x7f97cc0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 --2- 172.21.15.31:0/4031129824 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f97cc0a6d60 0x7f97cc0ae9a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 >> 172.21.15.31:0/4031129824 conn(0x7f97cc0679e0 msgr2=0x7f97cc0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 shutdown_connections 2024-04-18T10:40:34.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.271+0000 7f97d1cac700 1 -- 172.21.15.31:0/4031129824 wait complete. 2024-04-18T10:40:34.283 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:40:34.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.405+0000 7fccfb2b5700 1 Processor -- start 2024-04-18T10:40:34.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccfb2b5700 1 -- start start 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccfb2b5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf4069200 0x7fccf40a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccfb2b5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fccf40a6070 0x7fccf413c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccfb2b5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf413cc60 0x7fccf40679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccfb2b5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf413bfc0 con 0x7fccf40a6070 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccfb2b5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf413c1b0 con 0x7fccf4069200 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccfb2b5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf413c470 con 0x7fccf413cc60 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccf9051700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf4069200 0x7fccf40a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccf8850700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fccf40a6070 0x7fccf413c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccf9852700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf413cc60 0x7fccf40679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccf9852700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf413cc60 0x7fccf40679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:42846/0 (socket says 172.21.15.31:42846) 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccf8850700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fccf40a6070 0x7fccf413c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40886/0 (socket says 172.21.15.31:40886) 2024-04-18T10:40:34.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccf9852700 1 -- 172.21.15.31:0/1608128603 learned_addr learned my addr 172.21.15.31:0/1608128603 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.406+0000 7fccf9051700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf4069200 0x7fccf40a3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53910/0 (socket says 172.21.15.31:53910) 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccf8850700 1 -- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf413cc60 msgr2=0x7fccf40679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccf8850700 1 --2- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf413cc60 0x7fccf40679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccf8850700 1 -- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf4069200 msgr2=0x7fccf40a3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccf8850700 1 --2- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf4069200 0x7fccf40a3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccf8850700 1 -- 172.21.15.31:0/1608128603 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf40a4a40 con 0x7fccf40a6070 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccf9051700 1 --2- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf4069200 0x7fccf40a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccf8850700 1 --2- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 0x7fccf413c720 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcce40098e0 tx=0x7fcce40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e078c746b0e8738 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccebfff700 1 -- 172.21.15.31:0/1608128603 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4011630 con 0x7fccf40a6070 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccebfff700 1 -- 172.21.15.31:0/1608128603 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce4011790 con 0x7fccf40a6070 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.407+0000 7fccebfff700 1 -- 172.21.15.31:0/1608128603 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4011b30 con 0x7fccf40a6070 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.408+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 msgr2=0x7fccf413c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.408+0000 7fccfb2b5700 1 --2- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 0x7fccf413c720 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcce40098e0 tx=0x7fcce40091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.408+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1608128603 shutdown_connections 2024-04-18T10:40:34.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.408+0000 7fccfb2b5700 1 --2- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf413cc60 0x7fccf40679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.408+0000 7fccfb2b5700 1 --2- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf4069200 0x7fccf40a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.408+0000 7fccfb2b5700 1 --2- 172.21.15.31:0/1608128603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 0x7fccf413c720 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.408+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1608128603 >> 172.21.15.31:0/1608128603 conn(0x7fccf406ae80 msgr2=0x7fccf4068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:34.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.408+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1608128603 shutdown_connections 2024-04-18T10:40:34.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.408+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1608128603 wait complete. 2024-04-18T10:40:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccfb2b5700 1 Processor -- start 2024-04-18T10:40:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccfb2b5700 1 -- start start 2024-04-18T10:40:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccfb2b5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf4069200 0x7fccf40aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccfb2b5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 0x7fccf414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccfb2b5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf413cc60 0x7fccf414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccfb2b5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf413ff90 con 0x7fccf40a6070 2024-04-18T10:40:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccfb2b5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf414cbe0 con 0x7fccf413cc60 2024-04-18T10:40:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccfb2b5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf40aa890 con 0x7fccf4069200 2024-04-18T10:40:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccf9051700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf4069200 0x7fccf40aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccf8850700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 0x7fccf414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccf9852700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf413cc60 0x7fccf414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccf9051700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf4069200 0x7fccf40aa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:42850/0 (socket says 172.21.15.31:42850) 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.409+0000 7fccf9051700 1 -- 172.21.15.31:0/1481018625 learned_addr learned my addr 172.21.15.31:0/1481018625 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fccf8850700 1 -- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf4069200 msgr2=0x7fccf40aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fccf8850700 1 --2- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf4069200 0x7fccf40aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fccf8850700 1 -- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf413cc60 msgr2=0x7fccf414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fccf8850700 1 --2- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf413cc60 0x7fccf414f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fccf8850700 1 -- 172.21.15.31:0/1481018625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0009420 con 0x7fccf40a6070 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fccf9051700 1 --2- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf4069200 0x7fccf40aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fccf8850700 1 --2- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 0x7fccf414c210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fccf40648a0 tx=0x7fcce4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fcce97fa700 1 -- 172.21.15.31:0/1481018625 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4022070 con 0x7fccf40a6070 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fcce97fa700 1 -- 172.21.15.31:0/1481018625 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce4026410 con 0x7fccf40a6070 2024-04-18T10:40:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce4009420 con 0x7fccf40a6070 2024-04-18T10:40:34.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fcce97fa700 1 -- 172.21.15.31:0/1481018625 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce40267f0 con 0x7fccf40a6070 2024-04-18T10:40:34.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.410+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf414c990 con 0x7fccf40a6070 2024-04-18T10:40:34.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.411+0000 7fcce97fa700 1 -- 172.21.15.31:0/1481018625 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fcce402f3b0 con 0x7fccf40a6070 2024-04-18T10:40:34.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.411+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf40651b0 con 0x7fccf40a6070 2024-04-18T10:40:34.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.411+0000 7fcce97fa700 1 -- 172.21.15.31:0/1481018625 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7fcce40603d0 con 0x7fccf40a6070 2024-04-18T10:40:34.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.415+0000 7fcce97fa700 1 -- 172.21.15.31:0/1481018625 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcce4031e60 con 0x7fccf40a6070 2024-04-18T10:40:34.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.580+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccf40a6570 con 0x7fccf40a6070 2024-04-18T10:40:34.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.581+0000 7fcce97fa700 1 -- 172.21.15.31:0/1481018625 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcce40150a0 con 0x7fccf40a6070 2024-04-18T10:40:34.581 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:40:34.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 >> v1:172.21.15.31:6816/46601 conn(0x7fccd8045ef0 legacy=0x7fccd80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 msgr2=0x7fccf414c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 --2- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 0x7fccf414c210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fccf40648a0 tx=0x7fcce4017000 comp rx=0 tx=0).stop 2024-04-18T10:40:34.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 shutdown_connections 2024-04-18T10:40:34.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 --2- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fccf4069200 0x7fccf40aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 --2- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fccf413cc60 0x7fccf414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 --2- 172.21.15.31:0/1481018625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccf40a6070 0x7fccf414c210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 >> 172.21.15.31:0/1481018625 conn(0x7fccf406ae80 msgr2=0x7fccf40b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:34.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 shutdown_connections 2024-04-18T10:40:34.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.582+0000 7fccfb2b5700 1 -- 172.21.15.31:0/1481018625 wait complete. 2024-04-18T10:40:34.595 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:40:34.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1e0956700 1 Processor -- start 2024-04-18T10:40:34.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1e0956700 1 -- start start 2024-04-18T10:40:34.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1e0956700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc06fa70 0x7fc1dc0a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1e0956700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc1dc0a7920 0x7fc1dc13e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1e0956700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc13ee70 0x7fc1dc0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1e0956700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1dc0a9870 con 0x7fc1dc0a7920 2024-04-18T10:40:34.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1e0956700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0a6de0 con 0x7fc1dc06fa70 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1e0956700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0a8790 con 0x7fc1dc13ee70 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1dad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc13ee70 0x7fc1dc0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc06fa70 0x7fc1dc0a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.717+0000 7fc1d9d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc1dc0a7920 0x7fc1dc13e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc06fa70 0x7fc1dc0a8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53924/0 (socket says 172.21.15.31:53924) 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1da59c700 1 -- 172.21.15.31:0/641603348 learned_addr learned my addr 172.21.15.31:0/641603348 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d9d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc1dc0a7920 0x7fc1dc13e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40902/0 (socket says 172.21.15.31:40902) 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1dad9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc13ee70 0x7fc1dc0a5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:42854/0 (socket says 172.21.15.31:42854) 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d9d9b700 1 -- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc13ee70 msgr2=0x7fc1dc0a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d9d9b700 1 --2- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc13ee70 0x7fc1dc0a5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d9d9b700 1 -- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc06fa70 msgr2=0x7fc1dc0a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d9d9b700 1 --2- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc06fa70 0x7fc1dc0a8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d9d9b700 1 -- 172.21.15.31:0/641603348 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc0aa440 con 0x7fc1dc0a7920 2024-04-18T10:40:34.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1da59c700 1 --2- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc06fa70 0x7fc1dc0a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1dad9d700 1 --2- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc13ee70 0x7fc1dc0a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d9d9b700 1 --2- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 0x7fc1dc13e930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00098e0 tx=0x7fc1d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbd7856195eddb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d959a700 1 -- 172.21.15.31:0/641603348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0011630 con 0x7fc1dc0a7920 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d959a700 1 -- 172.21.15.31:0/641603348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d0011790 con 0x7fc1dc0a7920 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.718+0000 7fc1d959a700 1 -- 172.21.15.31:0/641603348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0011b30 con 0x7fc1dc0a7920 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.719+0000 7fc1e0956700 1 -- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 msgr2=0x7fc1dc13e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.719+0000 7fc1e0956700 1 --2- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 0x7fc1dc13e930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00098e0 tx=0x7fc1d00091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.719+0000 7fc1e0956700 1 -- 172.21.15.31:0/641603348 shutdown_connections 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.719+0000 7fc1e0956700 1 --2- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc13ee70 0x7fc1dc0a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.719+0000 7fc1e0956700 1 --2- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc06fa70 0x7fc1dc0a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.719+0000 7fc1e0956700 1 --2- 172.21.15.31:0/641603348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 0x7fc1dc13e930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.719+0000 7fc1e0956700 1 -- 172.21.15.31:0/641603348 >> 172.21.15.31:0/641603348 conn(0x7fc1dc063970 msgr2=0x7fc1dc06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:34.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.719+0000 7fc1e0956700 1 -- 172.21.15.31:0/641603348 shutdown_connections 2024-04-18T10:40:34.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.719+0000 7fc1e0956700 1 -- 172.21.15.31:0/641603348 wait complete. 2024-04-18T10:40:34.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1e0956700 1 Processor -- start 2024-04-18T10:40:34.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1e0956700 1 -- start start 2024-04-18T10:40:34.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1e0956700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc06fa70 0x7fc1dc0adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1e0956700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 0x7fc1dc13c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1e0956700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc13ee70 0x7fc1dc13cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1e0956700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0afe40 con 0x7fc1dc0a7920 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1e0956700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0ae880 con 0x7fc1dc13ee70 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1e0956700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0aeb20 con 0x7fc1dc06fa70 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc06fa70 0x7fc1dc0adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1d9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 0x7fc1dc13c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1dad9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc13ee70 0x7fc1dc13cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc06fa70 0x7fc1dc0adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:42860/0 (socket says 172.21.15.31:42860) 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1d9d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 0x7fc1dc13c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40904/0 (socket says 172.21.15.31:40904) 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.720+0000 7fc1da59c700 1 -- 172.21.15.31:0/2047239324 learned_addr learned my addr 172.21.15.31:0/2047239324 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1d9d9b700 1 -- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc06fa70 msgr2=0x7fc1dc0adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1d9d9b700 1 --2- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc06fa70 0x7fc1dc0adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1d9d9b700 1 -- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc13ee70 msgr2=0x7fc1dc13cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1d9d9b700 1 --2- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc13ee70 0x7fc1dc13cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1d9d9b700 1 -- 172.21.15.31:0/2047239324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0094f0 con 0x7fc1dc0a7920 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1dad9d700 1 --2- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc13ee70 0x7fc1dc13cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1d9d9b700 1 --2- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 0x7fc1dc13c8a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0016000 tx=0x7fc1d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1ca7fc700 1 -- 172.21.15.31:0/2047239324 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0000d10 con 0x7fc1dc0a7920 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1ca7fc700 1 -- 172.21.15.31:0/2047239324 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d0011b10 con 0x7fc1dc0a7920 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d4009a20 con 0x7fc1dc0a7920 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1ca7fc700 1 -- 172.21.15.31:0/2047239324 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0025640 con 0x7fc1dc0a7920 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.721+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d0009420 con 0x7fc1dc0a7920 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.722+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1dc0651b0 con 0x7fc1dc0a7920 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.722+0000 7fc1ca7fc700 1 -- 172.21.15.31:0/2047239324 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fc1d0025a70 con 0x7fc1dc0a7920 2024-04-18T10:40:34.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.722+0000 7fc1ca7fc700 1 -- 172.21.15.31:0/2047239324 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7fc1d005c8a0 con 0x7fc1dc0a7920 2024-04-18T10:40:34.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.726+0000 7fc1ca7fc700 1 -- 172.21.15.31:0/2047239324 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fc1d000af20 con 0x7fc1dc0a7920 2024-04-18T10:40:34.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.887+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1dc0b1fc0 con 0x7fc1dc0a7920 2024-04-18T10:40:34.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.888+0000 7fc1ca7fc700 1 -- 172.21.15.31:0/2047239324 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1d0015030 con 0x7fc1dc0a7920 2024-04-18T10:40:34.889 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:40:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 >> v1:172.21.15.31:6816/46601 conn(0x7fc1bc045ef0 legacy=0x7fc1bc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 msgr2=0x7fc1dc13c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:34.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 --2- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 0x7fc1dc13c8a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0016000 tx=0x7fc1d0017000 comp rx=0 tx=0).stop 2024-04-18T10:40:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 shutdown_connections 2024-04-18T10:40:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 --2- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc1dc06fa70 0x7fc1dc0adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 --2- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc1dc13ee70 0x7fc1dc13cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 --2- 172.21.15.31:0/2047239324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1dc0a7920 0x7fc1dc13c8a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 >> 172.21.15.31:0/2047239324 conn(0x7fc1dc063970 msgr2=0x7fc1dc13dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 shutdown_connections 2024-04-18T10:40:34.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:34.889+0000 7fc1e0956700 1 -- 172.21.15.31:0/2047239324 wait complete. 2024-04-18T10:40:34.902 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T10:40:35.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.021+0000 7f0554fbf700 1 Processor -- start 2024-04-18T10:40:35.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f0554fbf700 1 -- start start 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f0554fbf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f055006eaa0 0x7f0550068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f0554fbf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4870 0x7f05501495d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f0554fbf700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05500a3bc0 con 0x7f05500a4f60 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f0554fbf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055006a260 con 0x7f055006eaa0 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f0554fbf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f055006a500 con 0x7f05500a4870 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f054ed9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4870 0x7f05501495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f054dd9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f05500a4f60 0x7f0550069030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54286/0 (socket says 172.21.15.31:54286) 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f054e59c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f055006eaa0 0x7f0550068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.022+0000 7f054dd9b700 1 -- 172.21.15.31:0/1011439100 learned_addr learned my addr 172.21.15.31:0/1011439100 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054d59a700 1 -- 172.21.15.31:0/1011439100 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493922718 0 0) 0x7f05500a3bc0 con 0x7f05500a4f60 2024-04-18T10:40:35.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054e59c700 1 -- 172.21.15.31:0/1011439100 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4870 msgr2=0x7f05501495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054e59c700 1 --2- 172.21.15.31:0/1011439100 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4870 0x7f05501495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054e59c700 1 -- 172.21.15.31:0/1011439100 >> v1:172.21.15.31:6789/0 conn(0x7f05500a4f60 legacy=0x7f0550069030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054e59c700 1 -- 172.21.15.31:0/1011439100 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055006f870 con 0x7f055006eaa0 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054ed9d700 1 --2- 172.21.15.31:0/1011439100 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4870 0x7f05501495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054e59c700 1 --2- 172.21.15.31:0/1011439100 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f055006eaa0 0x7f0550068af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0544009910 tx=0x7f05440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=929560a54fa5023e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054d59a700 1 -- 172.21.15.31:0/1011439100 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400b680 con 0x7f055006eaa0 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054d59a700 1 -- 172.21.15.31:0/1011439100 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054400b7e0 con 0x7f055006eaa0 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.023+0000 7f054d59a700 1 -- 172.21.15.31:0/1011439100 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400bba0 con 0x7f055006eaa0 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.024+0000 7f0554fbf700 1 -- 172.21.15.31:0/1011439100 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f055006eaa0 msgr2=0x7f0550068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.024+0000 7f0554fbf700 1 --2- 172.21.15.31:0/1011439100 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f055006eaa0 0x7f0550068af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0544009910 tx=0x7f05440091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.024+0000 7f0554fbf700 1 -- 172.21.15.31:0/1011439100 shutdown_connections 2024-04-18T10:40:35.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.024+0000 7f0554fbf700 1 --2- 172.21.15.31:0/1011439100 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4870 0x7f05501495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:35.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.024+0000 7f0554fbf700 1 --2- 172.21.15.31:0/1011439100 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f055006eaa0 0x7f0550068af0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:35.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.024+0000 7f0554fbf700 1 -- 172.21.15.31:0/1011439100 >> 172.21.15.31:0/1011439100 conn(0x7f05500679e0 msgr2=0x7f0550067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:35.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.024+0000 7f0554fbf700 1 -- 172.21.15.31:0/1011439100 shutdown_connections 2024-04-18T10:40:35.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.024+0000 7f0554fbf700 1 -- 172.21.15.31:0/1011439100 wait complete. 2024-04-18T10:40:35.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f0554fbf700 1 Processor -- start 2024-04-18T10:40:35.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f0554fbf700 1 -- start start 2024-04-18T10:40:35.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f0554fbf700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f055006eaa0 0x7f0550097470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:35.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f0554fbf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05500a4870 0x7f055013f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f0554fbf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4f60 0x7f055013ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f0554fbf700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05500979b0 con 0x7f055006eaa0 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f0554fbf700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0550098470 con 0x7f05500a4870 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f0554fbf700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f05500adfa0 con 0x7f05500a4f60 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f054e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f055006eaa0 0x7f0550097470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f054dd9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05500a4870 0x7f055013f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f054ed9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4f60 0x7f055013ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f054e59c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f055006eaa0 0x7f0550097470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40920/0 (socket says 172.21.15.31:40920) 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.025+0000 7f054e59c700 1 -- 172.21.15.31:0/1079158862 learned_addr learned my addr 172.21.15.31:0/1079158862 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f054dd9b700 1 -- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4f60 msgr2=0x7f055013ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f054dd9b700 1 --2- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4f60 0x7f055013ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f054dd9b700 1 -- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f055006eaa0 msgr2=0x7f0550097470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f054dd9b700 1 --2- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f055006eaa0 0x7f0550097470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f054dd9b700 1 -- 172.21.15.31:0/1079158862 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009a20 con 0x7f05500a4870 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f054e59c700 1 --2- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f055006eaa0 0x7f0550097470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f054dd9b700 1 --2- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05500a4870 0x7f055013f9c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f055006c900 tx=0x7f0540007f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f053e7fc700 1 -- 172.21.15.31:0/1079158862 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400058a0 con 0x7f05500a4870 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f053e7fc700 1 -- 172.21.15.31:0/1079158862 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0540005a00 con 0x7f05500a4870 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0544009420 con 0x7f05500a4870 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f053e7fc700 1 -- 172.21.15.31:0/1079158862 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540005dc0 con 0x7f05500a4870 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.026+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0550141430 con 0x7f05500a4870 2024-04-18T10:40:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.027+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05500651b0 con 0x7f05500a4870 2024-04-18T10:40:35.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.027+0000 7f053e7fc700 1 -- 172.21.15.31:0/1079158862 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f05400074f0 con 0x7f05500a4870 2024-04-18T10:40:35.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.028+0000 7f053e7fc700 1 -- 172.21.15.31:0/1079158862 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7f054005a600 con 0x7f05500a4870 2024-04-18T10:40:35.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.031+0000 7f053e7fc700 1 -- 172.21.15.31:0/1079158862 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f05400388d0 con 0x7f05500a4870 2024-04-18T10:40:35.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.210+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f05500a3900 con 0x7f05500a4870 2024-04-18T10:40:35.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.211+0000 7f053e7fc700 1 -- 172.21.15.31:0/1079158862 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 5 entries v43) v1 ==== 80+0+291 (secure 0 0 0) 0x7f0540017020 con 0x7f05500a4870 2024-04-18T10:40:35.212 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6819/3321563080 2024-04-19T10:38:52.565121+0000 2024-04-18T10:40:35.212 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2921291208 2024-04-19T10:38:28.389077+0000 2024-04-18T10:40:35.212 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2767636595 2024-04-19T10:38:28.389077+0000 2024-04-18T10:40:35.212 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3252462560 2024-04-19T10:38:28.389077+0000 2024-04-18T10:40:35.212 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6816/39551 2024-04-19T10:38:28.389077+0000 2024-04-18T10:40:35.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 >> v1:172.21.15.31:6816/46601 conn(0x7f0530045ef0 legacy=0x7f05300483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:35.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05500a4870 msgr2=0x7f055013f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:35.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 --2- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05500a4870 0x7f055013f9c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f055006c900 tx=0x7f0540007f30 comp rx=0 tx=0).stop 2024-04-18T10:40:35.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 shutdown_connections 2024-04-18T10:40:35.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 --2- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f05500a4f60 0x7f055013ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:35.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 --2- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f055006eaa0 0x7f0550097470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:35.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 --2- 172.21.15.31:0/1079158862 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f05500a4870 0x7f055013f9c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:35.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 >> 172.21.15.31:0/1079158862 conn(0x7f05500679e0 msgr2=0x7f05500b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:35.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 shutdown_connections 2024-04-18T10:40:35.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:35.213+0000 7f0554fbf700 1 -- 172.21.15.31:0/1079158862 wait complete. 2024-04-18T10:40:35.215 INFO:teuthology.orchestra.run.smithi031.stderr:listed 5 entries 2024-04-18T10:40:35.225 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-04-18T10:40:35.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:35.269 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[37421]: fuse finished with error 0 and tester_r 0 2024-04-18T10:40:35.271 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:40:35.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-04-18T10:40:35.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.305 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-18T10:40:35.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.381 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-18T10:40:35.403 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-18T10:40:35.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.404 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-18T10:40:35.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.492 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-18T10:40:35.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.565 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-18T10:40:35.587 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-18T10:40:35.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:40:35.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-18T10:40:35.771 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-18T10:40:35.771 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-18T10:40:35.782 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-18T10:40:35.782 INFO:tasks.ceph_fuse:config is {'client.0': None, 'client.1': {'skip': True}} 2024-04-18T10:40:35.782 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-18T10:40:35.782 INFO:tasks.ceph_fuse:client.1 config is {'skip': True} 2024-04-18T10:40:35.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.783 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-18T10:40:35.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.802 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-18T10:40:35.876 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-18T10:40:35.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:40:35.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.877 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-18T10:40:35.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:35.899 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-18T10:40:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-04-18T10:40:35.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:40:35.974 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-18T10:40:35.974 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-18T10:40:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.107+0000 7f3586f1d700 1 Processor -- start 2024-04-18T10:40:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.107+0000 7f3586f1d700 1 -- start start 2024-04-18T10:40:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f3586f1d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35800a5260 0x7f3580143b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f3586f1d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35801440c0 0x7f35801464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f3586f1d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35800a3540 con 0x7f358006ecf0 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f3586f1d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35800a7470 con 0x7f35801440c0 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f3586f1d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35800a37e0 con 0x7f35800a5260 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f3584cb9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f358006ecf0 0x7f35800a6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54294/0 (socket says 172.21.15.31:54294) 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f3584cb9700 1 -- 172.21.15.31:0/1617672603 learned_addr learned my addr 172.21.15.31:0/1617672603 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f357ffff700 1 --2- 172.21.15.31:0/1617672603 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35800a5260 0x7f3580143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f35854ba700 1 --2- 172.21.15.31:0/1617672603 >> v2:172.21.15.31:3300/0 conn(0x7f35801440c0 0x7f35801464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f357f7fe700 1 -- 172.21.15.31:0/1617672603 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901571875 0 0) 0x7f35800a3540 con 0x7f358006ecf0 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f357f7fe700 1 -- 172.21.15.31:0/1617672603 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3570003570 con 0x7f358006ecf0 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f35854ba700 1 -- 172.21.15.31:0/1617672603 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35800a5260 msgr2=0x7f3580143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f35854ba700 1 --2- 172.21.15.31:0/1617672603 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35800a5260 0x7f3580143b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f35854ba700 1 -- 172.21.15.31:0/1617672603 >> v1:172.21.15.31:6789/0 conn(0x7f358006ecf0 legacy=0x7f35800a6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f35854ba700 1 -- 172.21.15.31:0/1617672603 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35800a5630 con 0x7f35801440c0 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f357ffff700 1 --2- 172.21.15.31:0/1617672603 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35800a5260 0x7f3580143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f35854ba700 1 --2- 172.21.15.31:0/1617672603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35801440c0 0x7f35801464a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3578009e60 tx=0x7f3578009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75643e203b004c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f357f7fe700 1 -- 172.21.15.31:0/1617672603 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357800e070 con 0x7f35801440c0 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f357f7fe700 1 -- 172.21.15.31:0/1617672603 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357800bab0 con 0x7f35801440c0 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.108+0000 7f357f7fe700 1 -- 172.21.15.31:0/1617672603 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357800be70 con 0x7f35801440c0 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.109+0000 7f3586f1d700 1 -- 172.21.15.31:0/1617672603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35801440c0 msgr2=0x7f35801464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.109+0000 7f3586f1d700 1 --2- 172.21.15.31:0/1617672603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35801440c0 0x7f35801464a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3578009e60 tx=0x7f3578009780 comp rx=0 tx=0).stop 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.109+0000 7f3586f1d700 1 -- 172.21.15.31:0/1617672603 shutdown_connections 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.109+0000 7f3586f1d700 1 --2- 172.21.15.31:0/1617672603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35801440c0 0x7f35801464a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.109+0000 7f3586f1d700 1 --2- 172.21.15.31:0/1617672603 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35800a5260 0x7f3580143b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.109+0000 7f3586f1d700 1 -- 172.21.15.31:0/1617672603 >> 172.21.15.31:0/1617672603 conn(0x7f35800679e0 msgr2=0x7f3580067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.109+0000 7f3586f1d700 1 -- 172.21.15.31:0/1617672603 shutdown_connections 2024-04-18T10:40:36.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.109+0000 7f3586f1d700 1 -- 172.21.15.31:0/1617672603 wait complete. 2024-04-18T10:40:36.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.110+0000 7f3586f1d700 1 Processor -- start 2024-04-18T10:40:36.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.111+0000 7f3586f1d700 1 -- start start 2024-04-18T10:40:36.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.111+0000 7f3586f1d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f358006ecf0 0x7f358014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:36.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.111+0000 7f3586f1d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35800a5260 0x7f35800aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.111+0000 7f3586f1d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35801440c0 0x7f35800aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.111+0000 7f3586f1d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35800ab8e0 con 0x7f35800a5260 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.111+0000 7f3586f1d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358014f050 con 0x7f358006ecf0 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.111+0000 7f3586f1d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f358014fa00 con 0x7f35801440c0 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.111+0000 7f3584cb9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f358006ecf0 0x7f358014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f35854ba700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35801440c0 0x7f35800aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f35854ba700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35801440c0 0x7f35800aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:42898/0 (socket says 172.21.15.31:42898) 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f3584cb9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f358006ecf0 0x7f358014f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53964/0 (socket says 172.21.15.31:53964) 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f35854ba700 1 -- 172.21.15.31:0/3749837604 learned_addr learned my addr 172.21.15.31:0/3749837604 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f357ffff700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35800a5260 0x7f35800aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f35854ba700 1 -- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f358006ecf0 msgr2=0x7f358014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f35854ba700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f358006ecf0 0x7f358014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f35854ba700 1 -- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35800a5260 msgr2=0x7f35800aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f35854ba700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35800a5260 0x7f35800aa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f35854ba700 1 -- 172.21.15.31:0/3749837604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c009420 con 0x7f35801440c0 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f357ffff700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35800a5260 0x7f35800aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f3584cb9700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f358006ecf0 0x7f358014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f35854ba700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35801440c0 0x7f35800aab20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35800a78a0 tx=0x7f3578019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f357cff9700 1 -- 172.21.15.31:0/3749837604 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3578012e10 con 0x7f35801440c0 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f357cff9700 1 -- 172.21.15.31:0/3749837604 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3578027470 con 0x7f35801440c0 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3578009a20 con 0x7f35801440c0 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f357cff9700 1 -- 172.21.15.31:0/3749837604 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3578027830 con 0x7f35801440c0 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.112+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35800a92e0 con 0x7f35801440c0 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.113+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358014f1c0 con 0x7f35801440c0 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.113+0000 7f357cff9700 1 -- 172.21.15.31:0/3749837604 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f3578024070 con 0x7f35801440c0 2024-04-18T10:40:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.114+0000 7f357cff9700 1 -- 172.21.15.31:0/3749837604 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7f357805da40 con 0x7f35801440c0 2024-04-18T10:40:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.117+0000 7f357cff9700 1 -- 172.21.15.31:0/3749837604 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f357805fe60 con 0x7f35801440c0 2024-04-18T10:40:36.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.311+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f35800a7650 con 0x7f35801440c0 2024-04-18T10:40:36.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.312+0000 7f357cff9700 1 -- 172.21.15.31:0/3749837604 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f357802c020 con 0x7f35801440c0 2024-04-18T10:40:36.313 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-18T10:40:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 >> v1:172.21.15.31:6816/46601 conn(0x7f3564045ef0 legacy=0x7f35640483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35801440c0 msgr2=0x7f35800aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35801440c0 0x7f35800aab20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35800a78a0 tx=0x7f3578019000 comp rx=0 tx=0).stop 2024-04-18T10:40:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 shutdown_connections 2024-04-18T10:40:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35801440c0 0x7f35800aab20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f358006ecf0 0x7f358014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 --2- 172.21.15.31:0/3749837604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35800a5260 0x7f35800aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 >> 172.21.15.31:0/3749837604 conn(0x7f35800679e0 msgr2=0x7f35800a4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 shutdown_connections 2024-04-18T10:40:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:36.313+0000 7f3586f1d700 1 -- 172.21.15.31:0/3749837604 wait complete. 2024-04-18T10:40:36.326 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-18T10:40:36.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-18T10:40:36.326 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-04-18T10:40:36.326 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-18T10:40:36.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:36.326 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-18T10:40:36.326 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-18T10:40:36.326 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-18T10:40:36.326 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-18T10:40:36.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:36.327 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-04-18T10:40:36.350 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-18T10:40:36.350 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-18T10:40:36.350 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-04-18T10:40:36.350 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-18T10:40:36.350 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-04-18T10:40:36.350 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42333sec preferred_lft 42333sec 2024-04-18T10:40:36.351 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-04-18T10:40:36.352 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-18T10:40:36.352 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-18T10:40:36.352 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-04-18T10:40:36.352 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-04-18T10:40:36.352 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-18T10:40:36.352 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:40:36.352 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:40:36.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-04-18T10:40:36.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-04-18T10:40:36.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-04-18T10:40:36.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-18T10:40:36.353 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:40:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:40:36.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:40:36.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:36.517 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-18T10:40:36.544 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-04-18T10:40:36.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:36.545 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-04-18T10:40:36.607 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-04-18T10:40:36.607 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-18T10:40:36.607 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-18T10:40:36.607 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-18T10:40:36.607 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-18T10:40:36.607 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:40:36.607 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:40:36.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-18T10:40:36.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-18T10:40:36.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-18T10:40:36.608 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:40:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:40:36.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:40:36.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:36.752 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-18T10:40:36.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:36.770 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-04-18T10:40:36.829 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:40:36.829 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:40:36.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:40:36.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-18T10:40:36.829 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:40:36.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:40:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:40:36.963 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-18T10:40:36.963 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:40:36.963 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:40:36.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-18T10:40:36.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-18T10:40:36.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-18T10:40:36.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-18T10:40:36.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-18T10:40:36.964 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:40:37.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:40:37.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:40:37.187 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-18T10:40:37.187 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-18T10:40:37.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-04-18T10:40:37.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-04-18T10:40:37.187 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-18T10:40:37.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-18T10:40:37.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:40:37.324 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-18T10:40:37.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T10:40:37.325 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:37.342 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-18T10:40:37.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-18T10:40:37.345 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:37.401 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-04-18T10:40:37.468 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T10:40:37.526 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-04-18T10:40:37.526 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2024-04-18T10:40:37.527 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-04-18T10:40:37.528 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-04-18T10:40:37.529 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-04-18T10:40:37.529 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-04-18T10:40:37.529 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-04-18T10:40:37.529 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:40:37.529 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:40:37.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:37.530 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-04-18T10:40:37.587 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-18T10:40:37.587 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-18T10:40:37.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-04-18T10:40:37.657 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-04-18T10:40:37.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2024-04-18T10:40:37.713+0000 7fa216549540 -1 init, newargv = 0x55f5b978c9c0 newargc=15 2024-04-18T10:40:37.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[39046]: starting ceph client 2024-04-18T10:40:37.716 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-04-18T10:40:37.716 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/systemd 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpuset 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/memory 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/devices 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/pids 2024-04-18T10:40:37.717 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/freezer 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/rdma 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/hugetlb 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/perf_event 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup/blkio 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-04-18T10:40:37.718 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-04-18T10:40:37.719 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-04-18T10:40:37.719 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-04-18T10:40:37.719 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-04-18T10:40:37.719 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-04-18T10:40:37.719 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-04-18T10:40:37.719 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:40:37.719 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:40:37.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:37.720 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-04-18T10:40:37.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[39046]: starting fuse 2024-04-18T10:40:37.777 INFO:teuthology.orchestra.run.smithi040.stdout:47 2024-04-18T10:40:37.778 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2024-04-18T10:40:37.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-04-18T10:40:37.778 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-04-18T10:40:37.778 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-04-18T10:40:37.778 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-04-18T10:40:37.778 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-04-18T10:40:37.778 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:40:37.778 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-04-18T10:40:37.778 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-18T10:40:37.778 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-04-18T10:40:37.779 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T10:40:37.780 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:40:37.780 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2024-04-18T10:40:37.780 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-04-18T10:40:37.902 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.39046.asok 2024-04-18T10:40:37.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:40:37.912 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39046.asok 2024-04-18T10:40:37.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:37.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39046.asok status 2024-04-18T10:40:38.067 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "e85153d553ddc8420b6b154a57813a504f51c01a", 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 17.2.7-872-ge85153d5 (e85153d553ddc8420b6b154a57813a504f51c01a) quincy (stable)", 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "39046", 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24930, 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-04-18T10:40:38.068 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 24930 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1790064707 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1790064707 2024-04-18T10:40:38.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:40:38.070 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.24930 172.21.15.40:0/1790064707", 2024-04-18T10:40:38.070 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "172.21.15.40:0/1790064707", 2024-04-18T10:40:38.070 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-04-18T10:40:38.070 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 18, 2024-04-18T10:40:38.070 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 43, 2024-04-18T10:40:38.070 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-04-18T10:40:38.070 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-04-18T10:40:38.070 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2024-04-18T10:40:38.070 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-18T10:40:38.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:38.079 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-04-18T10:40:38.079 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:38.097 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-04-18T10:40:38.097 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:38.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:38.098 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:38.165 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:40:38.177 INFO:teuthology.task.print:**** done remount client 2024-04-18T10:40:38.177 INFO:teuthology.run_tasks:Running task exec... 2024-04-18T10:40:38.188 INFO:teuthology.task.exec:Executing custom commands... 2024-04-18T10:40:38.188 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:40:38.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump --format=json-pretty' 2024-04-18T10:40:38.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.319+0000 7f8fb8b87700 1 Processor -- start 2024-04-18T10:40:38.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.319+0000 7f8fb8b87700 1 -- start start 2024-04-18T10:40:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.319+0000 7f8fb8b87700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8fb40a1930 0x7f8fb40a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb8b87700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406fd70 0x7f8fb40a3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb8b87700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb40a00d0 con 0x7f8fb406f980 2024-04-18T10:40:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb8b87700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40a1040 con 0x7f8fb40a1930 2024-04-18T10:40:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb8b87700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb409e790 con 0x7f8fb406fd70 2024-04-18T10:40:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb2d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406fd70 0x7f8fb40a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8fb40a1930 0x7f8fb40a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb1d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8fb406f980 0x7f8fb40a3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54302/0 (socket says 172.21.15.31:54302) 2024-04-18T10:40:38.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8fb40a1930 0x7f8fb40a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40946/0 (socket says 172.21.15.31:40946) 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb1d9b700 1 -- 172.21.15.31:0/3654502129 learned_addr learned my addr 172.21.15.31:0/3654502129 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb2d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406fd70 0x7f8fb40a3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:42912/0 (socket says 172.21.15.31:42912) 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb259c700 1 -- 172.21.15.31:0/3654502129 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406fd70 msgr2=0x7f8fb40a3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb259c700 1 --2- 172.21.15.31:0/3654502129 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406fd70 0x7f8fb40a3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb259c700 1 -- 172.21.15.31:0/3654502129 >> v1:172.21.15.31:6789/0 conn(0x7f8fb406f980 legacy=0x7f8fb40a3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb259c700 1 -- 172.21.15.31:0/3654502129 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb409ea50 con 0x7f8fb40a1930 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb2d9d700 1 --2- 172.21.15.31:0/3654502129 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406fd70 0x7f8fb40a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb159a700 1 -- 172.21.15.31:0/3654502129 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205915887 0 0) 0x7f8fb40a00d0 con 0x7f8fb406f980 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb259c700 1 --2- 172.21.15.31:0/3654502129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb40a1930 0x7f8fb40a0b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40098e0 tx=0x7f8fa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56f96574c33a737 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb159a700 1 -- 172.21.15.31:0/3654502129 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400b640 con 0x7f8fb40a1930 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb159a700 1 -- 172.21.15.31:0/3654502129 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400b7a0 con 0x7f8fb40a1930 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.320+0000 7f8fb159a700 1 -- 172.21.15.31:0/3654502129 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400bb40 con 0x7f8fb40a1930 2024-04-18T10:40:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.321+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3654502129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb40a1930 msgr2=0x7f8fb40a0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.321+0000 7f8fb8b87700 1 --2- 172.21.15.31:0/3654502129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb40a1930 0x7f8fb40a0b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40098e0 tx=0x7f8fa40091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.321+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3654502129 shutdown_connections 2024-04-18T10:40:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.321+0000 7f8fb8b87700 1 --2- 172.21.15.31:0/3654502129 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406fd70 0x7f8fb40a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.321+0000 7f8fb8b87700 1 --2- 172.21.15.31:0/3654502129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb40a1930 0x7f8fb40a0b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.321+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3654502129 >> 172.21.15.31:0/3654502129 conn(0x7f8fb40af030 msgr2=0x7f8fb40af400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.321+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3654502129 shutdown_connections 2024-04-18T10:40:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.321+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3654502129 wait complete. 2024-04-18T10:40:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.322+0000 7f8fb8b87700 1 Processor -- start 2024-04-18T10:40:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.322+0000 7f8fb8b87700 1 -- start start 2024-04-18T10:40:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb8b87700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406f980 0x7f8fb414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb8b87700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fb406fd70 0x7f8fb414e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb8b87700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb40a1930 0x7f8fb414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb8b87700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb414bd10 con 0x7f8fb40a1930 2024-04-18T10:40:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb8b87700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4098610 con 0x7f8fb406fd70 2024-04-18T10:40:38.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb8b87700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40988b0 con 0x7f8fb406f980 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406f980 0x7f8fb414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb259c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406f980 0x7f8fb414b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:42920/0 (socket says 172.21.15.31:42920) 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb259c700 1 -- 172.21.15.31:0/3341043749 learned_addr learned my addr 172.21.15.31:0/3341043749 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb1d9b700 1 --2- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fb406fd70 0x7f8fb414e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.323+0000 7f8fb2d9d700 1 --2- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb40a1930 0x7f8fb414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fb259c700 1 -- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fb406fd70 msgr2=0x7f8fb414e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fb259c700 1 --2- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fb406fd70 0x7f8fb414e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fb259c700 1 -- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb40a1930 msgr2=0x7f8fb414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fb259c700 1 --2- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb40a1930 0x7f8fb414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fb259c700 1 -- 172.21.15.31:0/3341043749 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac009a20 con 0x7f8fb406f980 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fb259c700 1 --2- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406f980 0x7f8fb414b7d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009f80 tx=0x7f8fa4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fa27fc700 1 -- 172.21.15.31:0/3341043749 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400b910 con 0x7f8fb406f980 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fa27fc700 1 -- 172.21.15.31:0/3341043749 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400ba70 con 0x7f8fb406f980 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fa27fc700 1 -- 172.21.15.31:0/3341043749 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4011650 con 0x7f8fb406f980 2024-04-18T10:40:38.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa4009420 con 0x7f8fb406f980 2024-04-18T10:40:38.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.324+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb4141350 con 0x7f8fb406f980 2024-04-18T10:40:38.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.325+0000 7f8fa27fc700 1 -- 172.21.15.31:0/3341043749 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8fa4011a00 con 0x7f8fb406f980 2024-04-18T10:40:38.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.325+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb409f2c0 con 0x7f8fb406f980 2024-04-18T10:40:38.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.325+0000 7f8fa27fc700 1 -- 172.21.15.31:0/3341043749 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7f8fa405c540 con 0x7f8fb406f980 2024-04-18T10:40:38.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.329+0000 7f8fa27fc700 1 -- 172.21.15.31:0/3341043749 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8fa4024560 con 0x7f8fb406f980 2024-04-18T10:40:38.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.523+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json-pretty"} v 0) v1 -- 0x7f8fb405f5f0 con 0x7f8fb406f980 2024-04-18T10:40:38.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.523+0000 7f8fa27fc700 1 -- 172.21.15.31:0/3341043749 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json-pretty"}]=0 dumped fsmap epoch 18 v18) v1 ==== 101+0+7627 (secure 0 0 0) 0x7f8fa4011cb0 con 0x7f8fb406f980 2024-04-18T10:40:38.524 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:40:38.524 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:40:38.524 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 18, 2024-04-18T10:40:38.524 INFO:teuthology.orchestra.run.smithi031.stdout: "default_fscid": 1, 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": { 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": {}, 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "ro_compat": {}, 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "incompat": { 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_1": "base v0.20", 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_2": "client writeable ranges", 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_3": "default file layouts on dirs", 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_4": "dir inode in separate object", 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_5": "mds uses versioned encoding", 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_8": "no anchor table", 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_9": "file layout v2", 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_10": "snaprealm v2" 2024-04-18T10:40:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_flags": { 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_multiple": false, 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "ever_enabled_multiple": true 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "standbys": [ 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 24422, 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "a", 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "rank": -1, 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "incarnation": 0, 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:standby", 2024-04-18T10:40:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "state_seq": 1, 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817/3164763612", 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "addrs": { 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6817", 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3164763612 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "join_fscid": -1, 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "export_targets": [], 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2024-04-18T10:40:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": { 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": {}, 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "ro_compat": {}, 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "incompat": { 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_1": "base v0.20", 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_2": "client writeable ranges", 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_3": "default file layouts on dirs", 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_4": "dir inode in separate object", 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_5": "mds uses versioned encoding", 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_7": "mds uses inline data", 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_8": "no anchor table", 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_9": "file layout v2", 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_10": "snaprealm v2" 2024-04-18T10:40:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 13 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 24425, 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "c", 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "rank": -1, 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "incarnation": 0, 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:standby", 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "state_seq": 1, 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818/18914605", 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "addrs": { 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:40:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6818", 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 18914605 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "join_fscid": -1, 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "export_targets": [], 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": { 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": {}, 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "ro_compat": {}, 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "incompat": { 2024-04-18T10:40:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_1": "base v0.20", 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_2": "client writeable ranges", 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_3": "default file layouts on dirs", 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_4": "dir inode in separate object", 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_5": "mds uses versioned encoding", 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_7": "mds uses inline data", 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_8": "no anchor table", 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_9": "file layout v2", 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_10": "snaprealm v2" 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 14 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-18T10:40:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "filesystems": [ 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap": { 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 18, 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 18, 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "flags_state": { 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "joinable": true, 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_snaps": true, 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_multimds_snaps": true, 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_standby_replay": false 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "ever_allowed_features": 0, 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "explicitly_allowed_features": 0, 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "created": "2024-04-18T10:36:08.987612+0000", 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "modified": "2024-04-18T10:38:55.584822+0000", 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "tableserver": 0, 2024-04-18T10:40:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "root": 0, 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "session_timeout": 60, 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "session_autoclose": 300, 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "required_client_features": {}, 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "max_file_size": 1099511627776, 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "last_failure": 0, 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "last_failure_osd_epoch": 36, 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": { 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": {}, 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "ro_compat": {}, 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "incompat": { 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_1": "base v0.20", 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_2": "client writeable ranges", 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_3": "default file layouts on dirs", 2024-04-18T10:40:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_4": "dir inode in separate object", 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_5": "mds uses versioned encoding", 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_7": "mds uses inline data", 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_8": "no anchor table", 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_9": "file layout v2", 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_10": "snaprealm v2" 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "max_mds": 1, 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "in": [ 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: 0 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-18T10:40:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "up": { 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_0": 24428 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "failed": [], 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "damaged": [], 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "stopped": [ 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: 1 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "info": { 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "gid_24428": { 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 24428, 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "b", 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "rank": 0, 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "incarnation": 15, 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-04-18T10:40:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "state_seq": 4, 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819/1866692589", 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "addrs": { 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:6819", 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1866692589 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "join_fscid": -1, 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "export_targets": [], 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "features": 4540138320759226367, 2024-04-18T10:40:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": { 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "compat": {}, 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "ro_compat": {}, 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "incompat": { 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_1": "base v0.20", 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_2": "client writeable ranges", 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_3": "default file layouts on dirs", 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_4": "dir inode in separate object", 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_5": "mds uses versioned encoding", 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_7": "mds uses inline data", 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_8": "no anchor table", 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_9": "file layout v2", 2024-04-18T10:40:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "feature_10": "snaprealm v2" 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "data_pools": [ 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: 4 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata_pool": 3, 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": true, 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer": "", 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_count_wanted": 0 2024-04-18T10:40:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-04-18T10:40:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 1 2024-04-18T10:40:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-04-18T10:40:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-04-18T10:40:38.539 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:40:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 >> v1:172.21.15.31:6816/46601 conn(0x7f8f94045f70 legacy=0x7f8f94048420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406f980 msgr2=0x7f8fb414b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 --2- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406f980 0x7f8fb414b7d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009f80 tx=0x7f8fa4017000 comp rx=0 tx=0).stop 2024-04-18T10:40:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 shutdown_connections 2024-04-18T10:40:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 --2- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8fb406f980 0x7f8fb414b7d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 --2- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb40a1930 0x7f8fb414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 --2- 172.21.15.31:0/3341043749 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8fb406fd70 0x7f8fb414e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 >> 172.21.15.31:0/3341043749 conn(0x7f8fb40af030 msgr2=0x7f8fb40a37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 shutdown_connections 2024-04-18T10:40:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.525+0000 7f8fb8b87700 1 -- 172.21.15.31:0/3341043749 wait complete. 2024-04-18T10:40:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-04-18T10:40:38.541 DEBUG:teuthology.orchestra.run.smithi031:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs required_client_features cephfs add metric_collect' 2024-04-18T10:40:38.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.661+0000 7fb6bf199700 1 Processor -- start 2024-04-18T10:40:38.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bf199700 1 -- start start 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bf199700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bf199700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6b80a4460 0x7fb6b80a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bf199700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bf199700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b80a4b00 con 0x7fb6b80a4460 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bf199700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b8068cc0 con 0x7fb6b8067c30 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bf199700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b80a0720 con 0x7fb6b80a1270 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6b7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6b80a4460 0x7fb6b80a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bd736700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bcf35700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6b7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb6b80a4460 0x7fb6b80a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40962/0 (socket says 172.21.15.31:40962) 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bd736700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8141aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:42926/0 (socket says 172.21.15.31:42926) 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6bcf35700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53982/0 (socket says 172.21.15.31:53982) 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.662+0000 7fb6b7fff700 1 -- 172.21.15.31:0/3100401020 learned_addr learned my addr 172.21.15.31:0/3100401020 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6bd736700 1 -- 172.21.15.31:0/3100401020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 msgr2=0x7fb6b809f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6bd736700 1 --2- 172.21.15.31:0/3100401020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6bd736700 1 -- 172.21.15.31:0/3100401020 >> v2:172.21.15.31:3300/0 conn(0x7fb6b80a4460 msgr2=0x7fb6b80a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6bd736700 1 --2- 172.21.15.31:0/3100401020 >> v2:172.21.15.31:3300/0 conn(0x7fb6b80a4460 0x7fb6b80a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6bd736700 1 -- 172.21.15.31:0/3100401020 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b80a0400 con 0x7fb6b80a1270 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6b7fff700 1 --2- 172.21.15.31:0/3100401020 >> v2:172.21.15.31:3300/0 conn(0x7fb6b80a4460 0x7fb6b80a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6bd736700 1 --2- 172.21.15.31:0/3100401020 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8141aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009e60 tx=0x7fb6b0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f61f926b4d11242c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6b77fe700 1 -- 172.21.15.31:0/3100401020 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000e070 con 0x7fb6b80a1270 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6b77fe700 1 -- 172.21.15.31:0/3100401020 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b000bab0 con 0x7fb6b80a1270 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6b77fe700 1 -- 172.21.15.31:0/3100401020 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000be70 con 0x7fb6b80a1270 2024-04-18T10:40:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6bf199700 1 -- 172.21.15.31:0/3100401020 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 msgr2=0x7fb6b8141aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.663+0000 7fb6bf199700 1 --2- 172.21.15.31:0/3100401020 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8141aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009e60 tx=0x7fb6b0009780 comp rx=0 tx=0).stop 2024-04-18T10:40:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.664+0000 7fb6bf199700 1 -- 172.21.15.31:0/3100401020 shutdown_connections 2024-04-18T10:40:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.664+0000 7fb6bf199700 1 --2- 172.21.15.31:0/3100401020 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8141aa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.664+0000 7fb6bf199700 1 --2- 172.21.15.31:0/3100401020 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.664+0000 7fb6bf199700 1 --2- 172.21.15.31:0/3100401020 >> v2:172.21.15.31:3300/0 conn(0x7fb6b80a4460 0x7fb6b80a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.664+0000 7fb6bf199700 1 -- 172.21.15.31:0/3100401020 >> 172.21.15.31:0/3100401020 conn(0x7fb6b80b2140 msgr2=0x7fb6b80b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.664+0000 7fb6bf199700 1 -- 172.21.15.31:0/3100401020 shutdown_connections 2024-04-18T10:40:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.664+0000 7fb6bf199700 1 -- 172.21.15.31:0/3100401020 wait complete. 2024-04-18T10:40:38.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.664+0000 7fb6bf199700 1 Processor -- start 2024-04-18T10:40:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bf199700 1 -- start start 2024-04-18T10:40:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bf199700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bf199700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bf199700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80a4460 0x7fb6b8151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bf199700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b809dd10 con 0x7fb6b80a4460 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bf199700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b809c000 con 0x7fb6b8067c30 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bf199700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b809ce20 con 0x7fb6b80a1270 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bcf35700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bcf35700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53984/0 (socket says 172.21.15.31:53984) 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bcf35700 1 -- 172.21.15.31:0/680386875 learned_addr learned my addr 172.21.15.31:0/680386875 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6bd736700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80a4460 0x7fb6b8151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.665+0000 7fb6b7fff700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6bcf35700 1 -- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 msgr2=0x7fb6b8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6bcf35700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6bcf35700 1 -- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80a4460 msgr2=0x7fb6b8151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6bcf35700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80a4460 0x7fb6b8151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6bcf35700 1 -- 172.21.15.31:0/680386875 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a40094f0 con 0x7fb6b8067c30 2024-04-18T10:40:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6bd736700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80a4460 0x7fb6b8151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6b7fff700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6bcf35700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809c450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00ecb0 tx=0x7fb6ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6b4ff9700 1 -- 172.21.15.31:0/680386875 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac00c850 con 0x7fb6b8067c30 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6b4ff9700 1 -- 172.21.15.31:0/680386875 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac00c9b0 con 0x7fb6b8067c30 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b0009a20 con 0x7fb6b8067c30 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6b4ff9700 1 -- 172.21.15.31:0/680386875 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac00cd50 con 0x7fb6b8067c30 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.666+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b806f460 con 0x7fb6b8067c30 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.667+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b809c170 con 0x7fb6b8067c30 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.667+0000 7fb6b4ff9700 1 -- 172.21.15.31:0/680386875 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fb6ac013680 con 0x7fb6b8067c30 2024-04-18T10:40:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.667+0000 7fb6b4ff9700 1 -- 172.21.15.31:0/680386875 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4086+0+0 (secure 0 0 0) 0x7fb6ac05b2e0 con 0x7fb6b8067c30 2024-04-18T10:40:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.671+0000 7fb6b4ff9700 1 -- 172.21.15.31:0/680386875 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fb6b809c170 con 0x7fb6b8067c30 2024-04-18T10:40:38.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:38.866+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs required_client_features", "fs_name": "cephfs", "subop": "add", "val": "metric_collect"} v 0) v1 -- 0x7fb6b809c140 con 0x7fb6b8067c30 2024-04-18T10:40:39.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.523+0000 7fb6b4ff9700 1 -- 172.21.15.31:0/680386875 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs required_client_features", "fs_name": "cephfs", "subop": "add", "val": "metric_collect"}]=0 added feature 'metric_collect' to required_client_features v19) v1 ==== 195+0+0 (secure 0 0 0) 0x7fb6ac0395b0 con 0x7fb6b8067c30 2024-04-18T10:40:39.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 >> v1:172.21.15.31:6816/46601 conn(0x7fb69c045f20 legacy=0x7fb69c0483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:39.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 msgr2=0x7fb6b809c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:39.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809c450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00ecb0 tx=0x7fb6ac0091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:39.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 shutdown_connections 2024-04-18T10:40:39.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6b80a4460 0x7fb6b8151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:39.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb6b8067c30 0x7fb6b809c450 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:39.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 --2- 172.21.15.31:0/680386875 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb6b80a1270 0x7fb6b8151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:39.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 >> 172.21.15.31:0/680386875 conn(0x7fb6b80b2140 msgr2=0x7fb6b80b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:39.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 shutdown_connections 2024-04-18T10:40:39.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:39.526+0000 7fb6bf199700 1 -- 172.21.15.31:0/680386875 wait complete. 2024-04-18T10:40:39.528 INFO:teuthology.orchestra.run.smithi031.stderr:added feature 'metric_collect' to required_client_features 2024-04-18T10:40:39.541 INFO:teuthology.run_tasks:Running task sleep... 2024-04-18T10:40:39.554 INFO:teuthology.task.sleep:Sleeping for 5 seconds 2024-04-18T10:40:44.555 INFO:teuthology.run_tasks:Running task fs.clients_evicted... 2024-04-18T10:40:44.569 INFO:tasks.fs:clients is {'client.0': False, 'client.1': True} 2024-04-18T10:40:44.569 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:40:44.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.704+0000 7f565a33b700 1 Processor -- start 2024-04-18T10:40:44.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.704+0000 7f565a33b700 1 -- start start 2024-04-18T10:40:44.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f565a33b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56540a5e00 0x7f56540a4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:44.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f565a33b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f565413ef90 0x7f5654145760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:44.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f565a33b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565406d870 con 0x7f565413e490 2024-04-18T10:40:44.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f565a33b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565406e2e0 con 0x7f56540a5e00 2024-04-18T10:40:44.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f565a33b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56540a4d10 con 0x7f565413ef90 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f56588d8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f565413ef90 0x7f5654145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f5653fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56540a5e00 0x7f56540a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f56537fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f565413e490 0x7f565413e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56212/0 (socket says 172.21.15.31:56212) 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f56537fe700 1 -- 172.21.15.31:0/1586419214 learned_addr learned my addr 172.21.15.31:0/1586419214 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f5652ffd700 1 -- 172.21.15.31:0/1586419214 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888140567 0 0) 0x7f565406d870 con 0x7f565413e490 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f5652ffd700 1 -- 172.21.15.31:0/1586419214 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f563c003570 con 0x7f565413e490 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f56588d8700 1 -- 172.21.15.31:0/1586419214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56540a5e00 msgr2=0x7f56540a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f56588d8700 1 --2- 172.21.15.31:0/1586419214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56540a5e00 0x7f56540a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f56588d8700 1 -- 172.21.15.31:0/1586419214 >> v1:172.21.15.31:6789/0 conn(0x7f565413e490 legacy=0x7f565413e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f56588d8700 1 -- 172.21.15.31:0/1586419214 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565406e980 con 0x7f565413ef90 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.705+0000 7f5653fff700 1 --2- 172.21.15.31:0/1586419214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56540a5e00 0x7f56540a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f56588d8700 1 --2- 172.21.15.31:0/1586419214 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f565413ef90 0x7f5654145760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f564c00afa0 tx=0x7f564c00a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6949aad1a1b6494d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:44.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f5652ffd700 1 -- 172.21.15.31:0/1586419214 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c00f070 con 0x7f565413ef90 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f5652ffd700 1 -- 172.21.15.31:0/1586419214 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c00a2e0 con 0x7f565413ef90 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f5652ffd700 1 -- 172.21.15.31:0/1586419214 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c00cbb0 con 0x7f565413ef90 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f565a33b700 1 -- 172.21.15.31:0/1586419214 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f565413ef90 msgr2=0x7f5654145760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f565a33b700 1 --2- 172.21.15.31:0/1586419214 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f565413ef90 0x7f5654145760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f564c00afa0 tx=0x7f564c00a890 comp rx=0 tx=0).stop 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f565a33b700 1 -- 172.21.15.31:0/1586419214 shutdown_connections 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f565a33b700 1 --2- 172.21.15.31:0/1586419214 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f565413ef90 0x7f5654145760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f565a33b700 1 --2- 172.21.15.31:0/1586419214 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f56540a5e00 0x7f56540a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f565a33b700 1 -- 172.21.15.31:0/1586419214 >> 172.21.15.31:0/1586419214 conn(0x7f5654069a10 msgr2=0x7f56540679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.706+0000 7f565a33b700 1 -- 172.21.15.31:0/1586419214 shutdown_connections 2024-04-18T10:40:44.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.707+0000 7f565a33b700 1 -- 172.21.15.31:0/1586419214 wait complete. 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.707+0000 7f565a33b700 1 Processor -- start 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f565a33b700 1 -- start start 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f565a33b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56540a5e00 0x7f565409b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f565a33b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f565413e490 0x7f56540acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f565a33b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f565413ef90 0x7f5654151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f565a33b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565409c100 con 0x7f565413ef90 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f565a33b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56540acb20 con 0x7f565413e490 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f565a33b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f565409c380 con 0x7f56540a5e00 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f5653fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56540a5e00 0x7f565409b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f56537fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f565413e490 0x7f56540acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f5653fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56540a5e00 0x7f565409b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50252/0 (socket says 172.21.15.31:50252) 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f56537fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f565413e490 0x7f56540acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42790/0 (socket says 172.21.15.31:42790) 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f5653fff700 1 -- 172.21.15.31:0/2140572047 learned_addr learned my addr 172.21.15.31:0/2140572047 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.708+0000 7f56588d8700 1 --2- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f565413ef90 0x7f5654151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f5653fff700 1 -- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f565413e490 msgr2=0x7f56540acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f5653fff700 1 --2- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f565413e490 0x7f56540acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f5653fff700 1 -- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f565413ef90 msgr2=0x7f5654151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f5653fff700 1 --2- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f565413ef90 0x7f5654151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f5653fff700 1 -- 172.21.15.31:0/2140572047 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5644009420 con 0x7f56540a5e00 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f56537fe700 1 --2- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f565413e490 0x7f56540acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f5653fff700 1 --2- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56540a5e00 0x7f565409b450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f564400ec80 tx=0x7f56440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f563bfff700 1 -- 172.21.15.31:0/2140572047 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400c850 con 0x7f56540a5e00 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f563bfff700 1 -- 172.21.15.31:0/2140572047 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564400c9b0 con 0x7f56540a5e00 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f563bfff700 1 -- 172.21.15.31:0/2140572047 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400cd30 con 0x7f56540a5e00 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c00ab30 con 0x7f56540a5e00 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.709+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56540ad460 con 0x7f56540a5e00 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.710+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5654064920 con 0x7f56540a5e00 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.710+0000 7f563bfff700 1 -- 172.21.15.31:0/2140572047 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f5644013680 con 0x7f56540a5e00 2024-04-18T10:40:44.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.711+0000 7f563bfff700 1 -- 172.21.15.31:0/2140572047 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f564405b410 con 0x7f56540a5e00 2024-04-18T10:40:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.714+0000 7f563bfff700 1 -- 172.21.15.31:0/2140572047 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5644039650 con 0x7f56540a5e00 2024-04-18T10:40:44.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.882+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56540b0280 con 0x7f56540a5e00 2024-04-18T10:40:44.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.883+0000 7f563bfff700 1 -- 172.21.15.31:0/2140572047 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12029 (secure 0 0 0) 0x7f5644021020 con 0x7f56540a5e00 2024-04-18T10:40:44.883 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:40:44.884 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:40:40.522243+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":42,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":42,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2414209880":"2024-04-18T11:40:39.525564+0000","172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:40:44.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 >> v1:172.21.15.31:6816/46601 conn(0x7f5640045f20 legacy=0x7f56400483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:44.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56540a5e00 msgr2=0x7f565409b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:44.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 --2- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56540a5e00 0x7f565409b450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f564400ec80 tx=0x7f56440091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:44.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 shutdown_connections 2024-04-18T10:40:44.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 --2- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f56540a5e00 0x7f565409b450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:44.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 --2- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f565413ef90 0x7f5654151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:44.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 --2- 172.21.15.31:0/2140572047 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f565413e490 0x7f56540acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:44.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 >> 172.21.15.31:0/2140572047 conn(0x7f5654069a10 msgr2=0x7f56540b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:44.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 shutdown_connections 2024-04-18T10:40:44.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:44.884+0000 7f565a33b700 1 -- 172.21.15.31:0/2140572047 wait complete. 2024-04-18T10:40:44.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:40:44.898 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:40:45.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.021+0000 7f021e6d1700 1 Processor -- start 2024-04-18T10:40:45.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.021+0000 7f021e6d1700 1 -- start start 2024-04-18T10:40:45.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021e6d1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02180b1c90 0x7f021806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021e6d1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f0218067dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021e6d1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f0218148550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021e6d1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021806f520 con 0x7f02180b1c90 2024-04-18T10:40:45.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021e6d1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02180a2ca0 con 0x7f0218068310 2024-04-18T10:40:45.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021e6d1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02180a2620 con 0x7f02180679e0 2024-04-18T10:40:45.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f02177fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f0218067dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021cc6e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f0218148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f0217fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02180b1c90 0x7f021806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f02177fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f0218067dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50260/0 (socket says 172.21.15.31:50260) 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f0217fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02180b1c90 0x7f021806efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54554/0 (socket says 172.21.15.31:54554) 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021cc6e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f0218148550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42794/0 (socket says 172.21.15.31:42794) 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f02177fe700 1 -- 172.21.15.31:0/565385698 learned_addr learned my addr 172.21.15.31:0/565385698 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021cc6e700 1 -- 172.21.15.31:0/565385698 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 msgr2=0x7f0218067dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021cc6e700 1 --2- 172.21.15.31:0/565385698 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f0218067dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021cc6e700 1 -- 172.21.15.31:0/565385698 >> v2:172.21.15.31:3300/0 conn(0x7f02180b1c90 msgr2=0x7f021806efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021cc6e700 1 --2- 172.21.15.31:0/565385698 >> v2:172.21.15.31:3300/0 conn(0x7f02180b1c90 0x7f021806efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021cc6e700 1 -- 172.21.15.31:0/565385698 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02180a3cc0 con 0x7f0218068310 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f02177fe700 1 --2- 172.21.15.31:0/565385698 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f0218067dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.022+0000 7f021cc6e700 1 --2- 172.21.15.31:0/565385698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f0218148550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0210009e90 tx=0x7f0210009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260127ad13a3a94a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f0216ffd700 1 -- 172.21.15.31:0/565385698 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000e070 con 0x7f0218068310 2024-04-18T10:40:45.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f0216ffd700 1 -- 172.21.15.31:0/565385698 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021000bbd0 con 0x7f0218068310 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f0216ffd700 1 -- 172.21.15.31:0/565385698 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210012430 con 0x7f0218068310 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f021e6d1700 1 -- 172.21.15.31:0/565385698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 msgr2=0x7f0218148550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f021e6d1700 1 --2- 172.21.15.31:0/565385698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f0218148550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0210009e90 tx=0x7f0210009780 comp rx=0 tx=0).stop 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f021e6d1700 1 -- 172.21.15.31:0/565385698 shutdown_connections 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f021e6d1700 1 --2- 172.21.15.31:0/565385698 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f0218148550 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f021e6d1700 1 --2- 172.21.15.31:0/565385698 >> v2:172.21.15.31:3300/0 conn(0x7f02180b1c90 0x7f021806efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f021e6d1700 1 --2- 172.21.15.31:0/565385698 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f0218067dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f021e6d1700 1 -- 172.21.15.31:0/565385698 >> 172.21.15.31:0/565385698 conn(0x7f021806ab10 msgr2=0x7f021806aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f021e6d1700 1 -- 172.21.15.31:0/565385698 shutdown_connections 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.023+0000 7f021e6d1700 1 -- 172.21.15.31:0/565385698 wait complete. 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.024+0000 7f021e6d1700 1 Processor -- start 2024-04-18T10:40:45.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.024+0000 7f021e6d1700 1 -- start start 2024-04-18T10:40:45.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f021e6d1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f02180990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f021e6d1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f021809a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f021e6d1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02180b1c90 0x7f02180979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f021e6d1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021809a640 con 0x7f02180b1c90 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f021e6d1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0218098630 con 0x7f0218068310 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f021e6d1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0218099920 con 0x7f02180679e0 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f0217fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f02180990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f0217fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f02180990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50264/0 (socket says 172.21.15.31:50264) 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f02177fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f021809a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f0217fff700 1 -- 172.21.15.31:0/1554192208 learned_addr learned my addr 172.21.15.31:0/1554192208 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f021cc6e700 1 --2- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02180b1c90 0x7f02180979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f0217fff700 1 -- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 msgr2=0x7f021809a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f0217fff700 1 --2- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f021809a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f0217fff700 1 -- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02180b1c90 msgr2=0x7f02180979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f0217fff700 1 --2- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02180b1c90 0x7f02180979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f0217fff700 1 -- 172.21.15.31:0/1554192208 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000094f0 con 0x7f02180679e0 2024-04-18T10:40:45.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.025+0000 7f0217fff700 1 --2- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f02180990b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f020800e930 tx=0x7f02080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:45.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.026+0000 7f020ffff700 1 -- 172.21.15.31:0/1554192208 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208013680 con 0x7f02180679e0 2024-04-18T10:40:45.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.026+0000 7f020ffff700 1 -- 172.21.15.31:0/1554192208 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02080137e0 con 0x7f02180679e0 2024-04-18T10:40:45.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.026+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0210009a20 con 0x7f02180679e0 2024-04-18T10:40:45.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.026+0000 7f020ffff700 1 -- 172.21.15.31:0/1554192208 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208013b80 con 0x7f02180679e0 2024-04-18T10:40:45.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.026+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0218097f00 con 0x7f02180679e0 2024-04-18T10:40:45.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.027+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021809a790 con 0x7f02180679e0 2024-04-18T10:40:45.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.027+0000 7f020ffff700 1 -- 172.21.15.31:0/1554192208 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f020800c3e0 con 0x7f02180679e0 2024-04-18T10:40:45.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.027+0000 7f020ffff700 1 -- 172.21.15.31:0/1554192208 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f020805b180 con 0x7f02180679e0 2024-04-18T10:40:45.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.030+0000 7f020ffff700 1 -- 172.21.15.31:0/1554192208 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f021809a790 con 0x7f02180679e0 2024-04-18T10:40:45.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.194+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f021809a790 con 0x7f02180679e0 2024-04-18T10:40:45.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.195+0000 7f020ffff700 1 -- 172.21.15.31:0/1554192208 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f021809a790 con 0x7f02180679e0 2024-04-18T10:40:45.196 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:40:45.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.196+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 >> v1:172.21.15.31:6816/46601 conn(0x7f01f8045ef0 legacy=0x7f01f80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.196+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 msgr2=0x7f02180990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.196+0000 7f021e6d1700 1 --2- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f02180990b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f020800e930 tx=0x7f02080091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.196+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 shutdown_connections 2024-04-18T10:40:45.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.197+0000 7f021e6d1700 1 --2- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f02180679e0 0x7f02180990b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.197+0000 7f021e6d1700 1 --2- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02180b1c90 0x7f02180979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.197+0000 7f021e6d1700 1 --2- 172.21.15.31:0/1554192208 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0218068310 0x7f021809a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.197+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 >> 172.21.15.31:0/1554192208 conn(0x7f021806ab10 msgr2=0x7f02181438b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:45.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.197+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 shutdown_connections 2024-04-18T10:40:45.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.197+0000 7f021e6d1700 1 -- 172.21.15.31:0/1554192208 wait complete. 2024-04-18T10:40:45.209 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:40:45.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7fe5c9700 1 Processor -- start 2024-04-18T10:40:45.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7fe5c9700 1 -- start start 2024-04-18T10:40:45.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7fe5c9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f8063b00 0x7fb7f80ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7fe5c9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7f80aa470 0x7fb7f813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7fe5c9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f80a9d70 con 0x7fb7f813bce0 2024-04-18T10:40:45.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7fe5c9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f80ad970 con 0x7fb7f80aa470 2024-04-18T10:40:45.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7fe5c9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80ac770 con 0x7fb7f8063b00 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7f7fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f8063b00 0x7fb7f80ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7f77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7f80aa470 0x7fb7f813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7f7fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f8063b00 0x7fb7f80ad430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50272/0 (socket says 172.21.15.31:50272) 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7f77fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb7f80aa470 0x7fb7f813b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54568/0 (socket says 172.21.15.31:54568) 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7fcb66700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb7f813bce0 0x7fb7f80adde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56226/0 (socket says 172.21.15.31:56226) 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.332+0000 7fb7f7fff700 1 -- 172.21.15.31:0/2591613944 learned_addr learned my addr 172.21.15.31:0/2591613944 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.333+0000 7fb7f7fff700 1 -- 172.21.15.31:0/2591613944 >> v2:172.21.15.31:3300/0 conn(0x7fb7f80aa470 msgr2=0x7fb7f813b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.333+0000 7fb7f7fff700 1 --2- 172.21.15.31:0/2591613944 >> v2:172.21.15.31:3300/0 conn(0x7fb7f80aa470 0x7fb7f813b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.333+0000 7fb7f7fff700 1 -- 172.21.15.31:0/2591613944 >> v1:172.21.15.31:6789/0 conn(0x7fb7f813bce0 legacy=0x7fb7f80adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.333+0000 7fb7f7fff700 1 -- 172.21.15.31:0/2591613944 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f80aca10 con 0x7fb7f8063b00 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.333+0000 7fb7f77fe700 1 --2- 172.21.15.31:0/2591613944 >> v2:172.21.15.31:3300/0 conn(0x7fb7f80aa470 0x7fb7f813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.333+0000 7fb7f7fff700 1 --2- 172.21.15.31:0/2591613944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f8063b00 0x7fb7f80ad430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80099b0 tx=0x7fb7e8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ab8a8d0b7c629aa server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:45.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.333+0000 7fb7f6ffd700 1 -- 172.21.15.31:0/2591613944 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8009ea0 con 0x7fb7f8063b00 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.333+0000 7fb7f6ffd700 1 -- 172.21.15.31:0/2591613944 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e800b860 con 0x7fb7f8063b00 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.333+0000 7fb7f6ffd700 1 -- 172.21.15.31:0/2591613944 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800bc00 con 0x7fb7f8063b00 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.334+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/2591613944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f8063b00 msgr2=0x7fb7f80ad430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.334+0000 7fb7fe5c9700 1 --2- 172.21.15.31:0/2591613944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f8063b00 0x7fb7f80ad430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80099b0 tx=0x7fb7e8009250 comp rx=0 tx=0).stop 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.334+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/2591613944 shutdown_connections 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.334+0000 7fb7fe5c9700 1 --2- 172.21.15.31:0/2591613944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f8063b00 0x7fb7f80ad430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.334+0000 7fb7fe5c9700 1 --2- 172.21.15.31:0/2591613944 >> v2:172.21.15.31:3300/0 conn(0x7fb7f80aa470 0x7fb7f813b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.334+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/2591613944 >> 172.21.15.31:0/2591613944 conn(0x7fb7f806a390 msgr2=0x7fb7f806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.334+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/2591613944 shutdown_connections 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.334+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/2591613944 wait complete. 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7fe5c9700 1 Processor -- start 2024-04-18T10:40:45.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7fe5c9700 1 -- start start 2024-04-18T10:40:45.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7fe5c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f8063b00 0x7fb7f8140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7fe5c9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f80aa470 0x7fb7f8141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7fe5c9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f813bce0 0x7fb7f8151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7fe5c9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f813f9c0 con 0x7fb7f8063b00 2024-04-18T10:40:45.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7fe5c9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f8141630 con 0x7fb7f80aa470 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7fe5c9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f8141910 con 0x7fb7f813bce0 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7f7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f8063b00 0x7fb7f8140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7f7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f8063b00 0x7fb7f8140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54584/0 (socket says 172.21.15.31:54584) 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7f7fff700 1 -- 172.21.15.31:0/4068289306 learned_addr learned my addr 172.21.15.31:0/4068289306 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7fcb66700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f813bce0 0x7fb7f8151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.335+0000 7fb7f77fe700 1 --2- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f80aa470 0x7fb7f8141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7f7fff700 1 -- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f813bce0 msgr2=0x7fb7f8151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7f7fff700 1 --2- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f813bce0 0x7fb7f8151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7f7fff700 1 -- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f80aa470 msgr2=0x7fb7f8141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7f7fff700 1 --2- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f80aa470 0x7fb7f8141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7f7fff700 1 -- 172.21.15.31:0/4068289306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0009420 con 0x7fb7f8063b00 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7f7fff700 1 --2- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f8063b00 0x7fb7f8140d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80ac8b0 tx=0x7fb7e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:45.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7effff700 1 -- 172.21.15.31:0/4068289306 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8000d10 con 0x7fb7f8063b00 2024-04-18T10:40:45.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7effff700 1 -- 172.21.15.31:0/4068289306 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e800bbe0 con 0x7fb7f8063b00 2024-04-18T10:40:45.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7effff700 1 -- 172.21.15.31:0/4068289306 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8011670 con 0x7fb7f8063b00 2024-04-18T10:40:45.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e80094f0 con 0x7fb7f8063b00 2024-04-18T10:40:45.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.336+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f813f760 con 0x7fb7f8063b00 2024-04-18T10:40:45.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.337+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f80651b0 con 0x7fb7f8063b00 2024-04-18T10:40:45.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.337+0000 7fb7effff700 1 -- 172.21.15.31:0/4068289306 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fb7e8011aa0 con 0x7fb7f8063b00 2024-04-18T10:40:45.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.338+0000 7fb7effff700 1 -- 172.21.15.31:0/4068289306 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fb7e805c8e0 con 0x7fb7f8063b00 2024-04-18T10:40:45.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.341+0000 7fb7effff700 1 -- 172.21.15.31:0/4068289306 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fb7e802ff60 con 0x7fb7f8063b00 2024-04-18T10:40:45.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.505+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7f80ac2d0 con 0x7fb7f8063b00 2024-04-18T10:40:45.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.505+0000 7fb7effff700 1 -- 172.21.15.31:0/4068289306 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb7e8015030 con 0x7fb7f8063b00 2024-04-18T10:40:45.506 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:40:45.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 >> v1:172.21.15.31:6816/46601 conn(0x7fb7d8045ef0 legacy=0x7fb7d80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f8063b00 msgr2=0x7fb7f8140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 --2- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f8063b00 0x7fb7f8140d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80ac8b0 tx=0x7fb7e8017000 comp rx=0 tx=0).stop 2024-04-18T10:40:45.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 shutdown_connections 2024-04-18T10:40:45.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 --2- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fb7f813bce0 0x7fb7f8151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 --2- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7f8063b00 0x7fb7f8140d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 --2- 172.21.15.31:0/4068289306 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fb7f80aa470 0x7fb7f8141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 >> 172.21.15.31:0/4068289306 conn(0x7fb7f806a390 msgr2=0x7fb7f813ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:45.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 shutdown_connections 2024-04-18T10:40:45.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.507+0000 7fb7fe5c9700 1 -- 172.21.15.31:0/4068289306 wait complete. 2024-04-18T10:40:45.520 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:40:45.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.643+0000 7f297f2c6700 1 Processor -- start 2024-04-18T10:40:45.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.643+0000 7f297f2c6700 1 -- start start 2024-04-18T10:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297f2c6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f297806f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297f2c6700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f297806e050 0x7f297806e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297f2c6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 0x7f29780a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297f2c6700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29780a3720 con 0x7f297806e050 2024-04-18T10:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297f2c6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297806ea20 con 0x7f2978069450 2024-04-18T10:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297f2c6700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29780a2420 con 0x7f29780a2960 2024-04-18T10:40:45.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d863700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 0x7f29780a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d062700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f297806f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297c861700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f297806e050 0x7f297806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297c861700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f297806e050 0x7f297806e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54592/0 (socket says 172.21.15.31:54592) 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d863700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 0x7f29780a2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50304/0 (socket says 172.21.15.31:50304) 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297c861700 1 -- 172.21.15.31:0/368901489 learned_addr learned my addr 172.21.15.31:0/368901489 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d062700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f297806f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42824/0 (socket says 172.21.15.31:42824) 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d062700 1 -- 172.21.15.31:0/368901489 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 msgr2=0x7f29780a2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d062700 1 --2- 172.21.15.31:0/368901489 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 0x7f29780a2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d062700 1 -- 172.21.15.31:0/368901489 >> v2:172.21.15.31:3300/0 conn(0x7f297806e050 msgr2=0x7f297806e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d062700 1 --2- 172.21.15.31:0/368901489 >> v2:172.21.15.31:3300/0 conn(0x7f297806e050 0x7f297806e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d062700 1 -- 172.21.15.31:0/368901489 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297806ee90 con 0x7f2978069450 2024-04-18T10:40:45.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297c861700 1 --2- 172.21.15.31:0/368901489 >> v2:172.21.15.31:3300/0 conn(0x7f297806e050 0x7f297806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.644+0000 7f297d062700 1 --2- 172.21.15.31:0/368901489 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f297806f670 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29680098e0 tx=0x7f29680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad51c03fef051179 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f296ffff700 1 -- 172.21.15.31:0/368901489 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968011630 con 0x7f2978069450 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f296ffff700 1 -- 172.21.15.31:0/368901489 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2968011790 con 0x7f2978069450 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f296ffff700 1 -- 172.21.15.31:0/368901489 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968011b30 con 0x7f2978069450 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f297f2c6700 1 -- 172.21.15.31:0/368901489 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 msgr2=0x7f297806f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f297f2c6700 1 --2- 172.21.15.31:0/368901489 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f297806f670 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29680098e0 tx=0x7f29680091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f297f2c6700 1 -- 172.21.15.31:0/368901489 shutdown_connections 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f297f2c6700 1 --2- 172.21.15.31:0/368901489 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 0x7f29780a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f297f2c6700 1 --2- 172.21.15.31:0/368901489 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f297806f670 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f297f2c6700 1 --2- 172.21.15.31:0/368901489 >> v2:172.21.15.31:3300/0 conn(0x7f297806e050 0x7f297806e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f297f2c6700 1 -- 172.21.15.31:0/368901489 >> 172.21.15.31:0/368901489 conn(0x7f297806cd10 msgr2=0x7f2978068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f297f2c6700 1 -- 172.21.15.31:0/368901489 shutdown_connections 2024-04-18T10:40:45.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.645+0000 7f297f2c6700 1 -- 172.21.15.31:0/368901489 wait complete. 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.646+0000 7f297f2c6700 1 Processor -- start 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.646+0000 7f297f2c6700 1 -- start start 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297f2c6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f29780b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297f2c6700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f297806e050 0x7f297813fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297f2c6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 0x7f2978139860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297f2c6700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2978141230 con 0x7f297806e050 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297f2c6700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29781403f0 con 0x7f2978069450 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297f2c6700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f297813c180 con 0x7f29780a2960 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d062700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f29780b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297c861700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f297806e050 0x7f297813fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d062700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f29780b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42840/0 (socket says 172.21.15.31:42840) 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d062700 1 -- 172.21.15.31:0/3551131804 learned_addr learned my addr 172.21.15.31:0/3551131804 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d863700 1 --2- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 0x7f2978139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d062700 1 -- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 msgr2=0x7f2978139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d062700 1 --2- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 0x7f2978139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d062700 1 -- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f297806e050 msgr2=0x7f297813fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d062700 1 --2- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f297806e050 0x7f297813fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d062700 1 -- 172.21.15.31:0/3551131804 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29740094f0 con 0x7f2978069450 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297c861700 1 --2- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f297806e050 0x7f297813fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.647+0000 7f297d062700 1 --2- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f29780b1470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f297806eb60 tx=0x7f2968017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.648+0000 7f296d7fa700 1 -- 172.21.15.31:0/3551131804 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968000d10 con 0x7f2978069450 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.648+0000 7f296d7fa700 1 -- 172.21.15.31:0/3551131804 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2968011b10 con 0x7f2978069450 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.648+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2968009420 con 0x7f2978069450 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.648+0000 7f296d7fa700 1 -- 172.21.15.31:0/3551131804 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968025660 con 0x7f2978069450 2024-04-18T10:40:45.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.648+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29781445a0 con 0x7f2978069450 2024-04-18T10:40:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.649+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29780651b0 con 0x7f2978069450 2024-04-18T10:40:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.649+0000 7f296d7fa700 1 -- 172.21.15.31:0/3551131804 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f2968025a10 con 0x7f2978069450 2024-04-18T10:40:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.649+0000 7f296d7fa700 1 -- 172.21.15.31:0/3551131804 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f296805c840 con 0x7f2978069450 2024-04-18T10:40:45.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.652+0000 7f296d7fa700 1 -- 172.21.15.31:0/3551131804 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2968007e50 con 0x7f2978069450 2024-04-18T10:40:45.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.816+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29780a3f70 con 0x7f2978069450 2024-04-18T10:40:45.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.816+0000 7f296d7fa700 1 -- 172.21.15.31:0/3551131804 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2968015020 con 0x7f2978069450 2024-04-18T10:40:45.817 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:40:45.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 >> v1:172.21.15.31:6816/46601 conn(0x7f295c045ef0 legacy=0x7f295c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 msgr2=0x7f29780b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 --2- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f29780b1470 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f297806eb60 tx=0x7f2968017000 comp rx=0 tx=0).stop 2024-04-18T10:40:45.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 shutdown_connections 2024-04-18T10:40:45.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 --2- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f29780a2960 0x7f2978139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 --2- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2978069450 0x7f29780b1470 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 --2- 172.21.15.31:0/3551131804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f297806e050 0x7f297813fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 >> 172.21.15.31:0/3551131804 conn(0x7f297806cd10 msgr2=0x7f297813ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:45.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 shutdown_connections 2024-04-18T10:40:45.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.818+0000 7f297f2c6700 1 -- 172.21.15.31:0/3551131804 wait complete. 2024-04-18T10:40:45.831 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:40:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.953+0000 7fcfc13ce700 1 Processor -- start 2024-04-18T10:40:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.953+0000 7fcfc13ce700 1 -- start start 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.953+0000 7fcfc13ce700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfbc0b5460 0x7fcfbc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.953+0000 7fcfc13ce700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0a2740 0x7fcfbc0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.953+0000 7fcfc13ce700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc0a1820 con 0x7fcfbc0a5820 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.953+0000 7fcfc13ce700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc0a32c0 con 0x7fcfbc0b5460 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.953+0000 7fcfc13ce700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0a1ae0 con 0x7fcfbc0a2740 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfba7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0a2740 0x7fcfbc0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfbaffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfbc0b5460 0x7fcfbc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfba7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0a2740 0x7fcfbc0a52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42842/0 (socket says 172.21.15.31:42842) 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfba7fc700 1 -- 172.21.15.31:0/4131135892 learned_addr learned my addr 172.21.15.31:0/4131135892 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfbaffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfbc0b5460 0x7fcfbc0a3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54596/0 (socket says 172.21.15.31:54596) 2024-04-18T10:40:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfbaffd700 1 -- 172.21.15.31:0/4131135892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0a2740 msgr2=0x7fcfbc0a52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfbaffd700 1 --2- 172.21.15.31:0/4131135892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0a2740 0x7fcfbc0a52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfbaffd700 1 -- 172.21.15.31:0/4131135892 >> v1:172.21.15.31:6789/0 conn(0x7fcfbc0a5820 legacy=0x7fcfbc13b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfbaffd700 1 -- 172.21.15.31:0/4131135892 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc0a45d0 con 0x7fcfbc0b5460 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfb9ffb700 1 -- 172.21.15.31:0/4131135892 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834937351 0 0) 0x7fcfbc0a1820 con 0x7fcfbc0a5820 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfba7fc700 1 --2- 172.21.15.31:0/4131135892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0a2740 0x7fcfbc0a52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfbaffd700 1 --2- 172.21.15.31:0/4131135892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0b5460 0x7fcfbc0a3a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0098e0 tx=0x7fcfac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bf5e5cb89cede5 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfb9ffb700 1 -- 172.21.15.31:0/4131135892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00b640 con 0x7fcfbc0b5460 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfb9ffb700 1 -- 172.21.15.31:0/4131135892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac00b7a0 con 0x7fcfbc0b5460 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.954+0000 7fcfb9ffb700 1 -- 172.21.15.31:0/4131135892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac00bb40 con 0x7fcfbc0b5460 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.955+0000 7fcfc13ce700 1 -- 172.21.15.31:0/4131135892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0b5460 msgr2=0x7fcfbc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.955+0000 7fcfc13ce700 1 --2- 172.21.15.31:0/4131135892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0b5460 0x7fcfbc0a3a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0098e0 tx=0x7fcfac0091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.955+0000 7fcfc13ce700 1 -- 172.21.15.31:0/4131135892 shutdown_connections 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.955+0000 7fcfc13ce700 1 --2- 172.21.15.31:0/4131135892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0b5460 0x7fcfbc0a3a50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.955+0000 7fcfc13ce700 1 --2- 172.21.15.31:0/4131135892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0a2740 0x7fcfbc0a52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.955+0000 7fcfc13ce700 1 -- 172.21.15.31:0/4131135892 >> 172.21.15.31:0/4131135892 conn(0x7fcfbc068df0 msgr2=0x7fcfbc0691f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.955+0000 7fcfc13ce700 1 -- 172.21.15.31:0/4131135892 shutdown_connections 2024-04-18T10:40:45.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.955+0000 7fcfc13ce700 1 -- 172.21.15.31:0/4131135892 wait complete. 2024-04-18T10:40:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.956+0000 7fcfc13ce700 1 Processor -- start 2024-04-18T10:40:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.956+0000 7fcfc13ce700 1 -- start start 2024-04-18T10:40:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.956+0000 7fcfc13ce700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0a2740 0x7fcfbc09d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.956+0000 7fcfc13ce700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfbc0a5820 0x7fcfbc151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.956+0000 7fcfc13ce700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0b5460 0x7fcfbc151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.956+0000 7fcfc13ce700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc09e360 con 0x7fcfbc0a2740 2024-04-18T10:40:45.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.956+0000 7fcfc13ce700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc09e560 con 0x7fcfbc0b5460 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.956+0000 7fcfc13ce700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0a1440 con 0x7fcfbc0a5820 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfbb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0b5460 0x7fcfbc151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfba7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfbc0a5820 0x7fcfbc151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfba7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfbc0a5820 0x7fcfbc151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50330/0 (socket says 172.21.15.31:50330) 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfbb7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0b5460 0x7fcfbc151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42846/0 (socket says 172.21.15.31:42846) 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfba7fc700 1 -- 172.21.15.31:0/1323796613 learned_addr learned my addr 172.21.15.31:0/1323796613 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfbaffd700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0a2740 0x7fcfbc09d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfba7fc700 1 -- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0b5460 msgr2=0x7fcfbc151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfba7fc700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0b5460 0x7fcfbc151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfba7fc700 1 -- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0a2740 msgr2=0x7fcfbc09d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfba7fc700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0a2740 0x7fcfbc09d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfba7fc700 1 -- 172.21.15.31:0/1323796613 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb00094f0 con 0x7fcfbc0a5820 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfbaffd700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0a2740 0x7fcfbc09d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfbb7fe700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0b5460 0x7fcfbc151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfba7fc700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfbc0a5820 0x7fcfbc151730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000ec50 tx=0x7fcfb0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:45.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfa2ffd700 1 -- 172.21.15.31:0/1323796613 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000c850 con 0x7fcfbc0a5820 2024-04-18T10:40:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfa2ffd700 1 -- 172.21.15.31:0/1323796613 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000c9b0 con 0x7fcfbc0a5820 2024-04-18T10:40:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac009420 con 0x7fcfbc0a5820 2024-04-18T10:40:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfa2ffd700 1 -- 172.21.15.31:0/1323796613 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000cd50 con 0x7fcfbc0a5820 2024-04-18T10:40:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.957+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc0a03e0 con 0x7fcfbc0a5820 2024-04-18T10:40:45.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.958+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc09d740 con 0x7fcfbc0a5820 2024-04-18T10:40:45.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.959+0000 7fcfa2ffd700 1 -- 172.21.15.31:0/1323796613 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fcfb0013680 con 0x7fcfbc0a5820 2024-04-18T10:40:45.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.959+0000 7fcfa2ffd700 1 -- 172.21.15.31:0/1323796613 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fcfb005b7c0 con 0x7fcfbc0a5820 2024-04-18T10:40:45.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:45.962+0000 7fcfa2ffd700 1 -- 172.21.15.31:0/1323796613 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcfb0039c50 con 0x7fcfbc0a5820 2024-04-18T10:40:46.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.125+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcfbc064920 con 0x7fcfbc0a5820 2024-04-18T10:40:46.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.126+0000 7fcfa2ffd700 1 -- 172.21.15.31:0/1323796613 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcfb0021070 con 0x7fcfbc0a5820 2024-04-18T10:40:46.126 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:40:46.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.127+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 >> v1:172.21.15.31:6816/46601 conn(0x7fcfa8045ef0 legacy=0x7fcfa80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:46.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.127+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfbc0a5820 msgr2=0x7fcfbc151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:46.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.127+0000 7fcfc13ce700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfbc0a5820 0x7fcfbc151730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000ec50 tx=0x7fcfb0009250 comp rx=0 tx=0).stop 2024-04-18T10:40:46.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.127+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 shutdown_connections 2024-04-18T10:40:46.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.127+0000 7fcfc13ce700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfbc0b5460 0x7fcfbc151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.127+0000 7fcfc13ce700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfbc0a2740 0x7fcfbc09d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.127+0000 7fcfc13ce700 1 --2- 172.21.15.31:0/1323796613 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfbc0a5820 0x7fcfbc151730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.127+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 >> 172.21.15.31:0/1323796613 conn(0x7fcfbc068df0 msgr2=0x7fcfbc140f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:46.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.128+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 shutdown_connections 2024-04-18T10:40:46.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.128+0000 7fcfc13ce700 1 -- 172.21.15.31:0/1323796613 wait complete. 2024-04-18T10:40:46.140 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:40:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.259+0000 7f1ad7396700 1 Processor -- start 2024-04-18T10:40:46.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.259+0000 7f1ad7396700 1 -- start start 2024-04-18T10:40:46.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.259+0000 7f1ad7396700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ad0068340 0x7f1ad00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:46.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.259+0000 7f1ad7396700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a4990 0x7f1ad013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.259+0000 7f1ad7396700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad01399d0 con 0x7f1ad00a7110 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.259+0000 7f1ad7396700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad00a55b0 con 0x7f1ad0068340 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.259+0000 7f1ad7396700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad013f850 con 0x7f1ad00a4990 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad4931700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a4990 0x7f1ad013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad5132700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ad0068340 0x7f1ad00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad5933700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1ad00a7110 0x7f1ad006ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56256/0 (socket says 172.21.15.31:56256) 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad5933700 1 -- 172.21.15.31:0/1182105502 learned_addr learned my addr 172.21.15.31:0/1182105502 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad4931700 1 -- 172.21.15.31:0/1182105502 >> v2:172.21.15.31:3300/0 conn(0x7f1ad0068340 msgr2=0x7f1ad00a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad4931700 1 --2- 172.21.15.31:0/1182105502 >> v2:172.21.15.31:3300/0 conn(0x7f1ad0068340 0x7f1ad00a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad4931700 1 -- 172.21.15.31:0/1182105502 >> v1:172.21.15.31:6789/0 conn(0x7f1ad00a7110 legacy=0x7f1ad006ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ac7fff700 1 -- 172.21.15.31:0/1182105502 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789439763 0 0) 0x7f1ad01399d0 con 0x7f1ad00a7110 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad4931700 1 -- 172.21.15.31:0/1182105502 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad013fb10 con 0x7f1ad00a4990 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad5132700 1 --2- 172.21.15.31:0/1182105502 >> v2:172.21.15.31:3300/0 conn(0x7f1ad0068340 0x7f1ad00a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ad4931700 1 --2- 172.21.15.31:0/1182105502 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a4990 0x7f1ad013fda0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00098e0 tx=0x7f1ac00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4dea34295e8ef07 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ac7fff700 1 -- 172.21.15.31:0/1182105502 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac000b640 con 0x7f1ad00a4990 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ac7fff700 1 -- 172.21.15.31:0/1182105502 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac000b7a0 con 0x7f1ad00a4990 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.260+0000 7f1ac7fff700 1 -- 172.21.15.31:0/1182105502 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac000bb40 con 0x7f1ad00a4990 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.261+0000 7f1ad7396700 1 -- 172.21.15.31:0/1182105502 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a4990 msgr2=0x7f1ad013fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.261+0000 7f1ad7396700 1 --2- 172.21.15.31:0/1182105502 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a4990 0x7f1ad013fda0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00098e0 tx=0x7f1ac00091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.261+0000 7f1ad7396700 1 -- 172.21.15.31:0/1182105502 shutdown_connections 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.261+0000 7f1ad7396700 1 --2- 172.21.15.31:0/1182105502 >> v2:172.21.15.31:3300/0 conn(0x7f1ad0068340 0x7f1ad00a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.261+0000 7f1ad7396700 1 --2- 172.21.15.31:0/1182105502 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a4990 0x7f1ad013fda0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.261+0000 7f1ad7396700 1 -- 172.21.15.31:0/1182105502 >> 172.21.15.31:0/1182105502 conn(0x7f1ad006bfa0 msgr2=0x7f1ad00679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:46.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.261+0000 7f1ad7396700 1 -- 172.21.15.31:0/1182105502 shutdown_connections 2024-04-18T10:40:46.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.261+0000 7f1ad7396700 1 -- 172.21.15.31:0/1182105502 wait complete. 2024-04-18T10:40:46.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.262+0000 7f1ad7396700 1 Processor -- start 2024-04-18T10:40:46.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.262+0000 7f1ad7396700 1 -- start start 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad7396700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ad0068340 0x7f1ad00add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad7396700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad00a4990 0x7f1ad0151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad7396700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a7110 0x7f1ad0151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad7396700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0151550 con 0x7f1ad00a4990 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad7396700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad00ae390 con 0x7f1ad0068340 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad7396700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad01523f0 con 0x7f1ad00a7110 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad4931700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad00a4990 0x7f1ad0151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad4931700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad00a4990 0x7f1ad0151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54616/0 (socket says 172.21.15.31:54616) 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad4931700 1 -- 172.21.15.31:0/3360234246 learned_addr learned my addr 172.21.15.31:0/3360234246 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:46.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad5933700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a7110 0x7f1ad0151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad5132700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ad0068340 0x7f1ad00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad5933700 1 -- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ad0068340 msgr2=0x7f1ad00add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad5933700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ad0068340 0x7f1ad00add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad5933700 1 -- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad00a4990 msgr2=0x7f1ad0151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad5933700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad00a4990 0x7f1ad0151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad5933700 1 -- 172.21.15.31:0/3360234246 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009420 con 0x7f1ad00a7110 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad4931700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad00a4990 0x7f1ad0151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad5132700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ad0068340 0x7f1ad00add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad5933700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a7110 0x7f1ad0151eb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800cb90 tx=0x7f1ac80018f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ac57fa700 1 -- 172.21.15.31:0/3360234246 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800a780 con 0x7f1ad00a7110 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ac57fa700 1 -- 172.21.15.31:0/3360234246 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac800a8e0 con 0x7f1ad00a7110 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac0009420 con 0x7f1ad00a7110 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ac57fa700 1 -- 172.21.15.31:0/3360234246 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800aca0 con 0x7f1ad00a7110 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.263+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad00aea80 con 0x7f1ad00a7110 2024-04-18T10:40:46.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.264+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad0063690 con 0x7f1ad00a7110 2024-04-18T10:40:46.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.264+0000 7f1ac57fa700 1 -- 172.21.15.31:0/3360234246 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f1ac8007300 con 0x7f1ad00a7110 2024-04-18T10:40:46.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.265+0000 7f1ac57fa700 1 -- 172.21.15.31:0/3360234246 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f1ac805b290 con 0x7f1ad00a7110 2024-04-18T10:40:46.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.268+0000 7f1ac57fa700 1 -- 172.21.15.31:0/3360234246 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f1ac80395b0 con 0x7f1ad00a7110 2024-04-18T10:40:46.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.464+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ad00651b0 con 0x7f1ad00a7110 2024-04-18T10:40:46.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.464+0000 7f1ac57fa700 1 -- 172.21.15.31:0/3360234246 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3693 (secure 0 0 0) 0x7f1ac803cda0 con 0x7f1ad00a7110 2024-04-18T10:40:46.465 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:40:46.465 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":24422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3164763612","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3164763612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6818/18914605","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":18914605}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:40:39.517104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{"feature_14":"metric_collect"},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24428":{"gid":24428,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/1866692589","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":1866692589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:40:46.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 >> v1:172.21.15.31:6816/46601 conn(0x7f1ab4045ef0 legacy=0x7f1ab40483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a7110 msgr2=0x7f1ad0151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a7110 0x7f1ad0151eb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800cb90 tx=0x7f1ac80018f0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 shutdown_connections 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f1ad00a7110 0x7f1ad0151eb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1ad0068340 0x7f1ad00add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 --2- 172.21.15.31:0/3360234246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ad00a4990 0x7f1ad0151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 >> 172.21.15.31:0/3360234246 conn(0x7f1ad006bfa0 msgr2=0x7f1ad013b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 shutdown_connections 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:46.466+0000 7f1ad7396700 1 -- 172.21.15.31:0/3360234246 wait complete. 2024-04-18T10:40:46.468 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-04-18T10:40:46.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-04-18T10:40:46.621 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":24930,"entity":{"name":{"type":"client","num":24930},"addr":{"type":"v1","addr":"172.21.15.40:0","nonce":1790064707}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":8.894850216,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.97966506467415526,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.24930 v1:172.21.15.40:0/1790064707","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000001fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"e85153d553ddc8420b6b154a57813a504f51c01a","ceph_version":"ceph version 17.2.7-872-ge85153d5 (e85153d553ddc8420b6b154a57813a504f51c01a) quincy (stable)","entity_id":"0","hostname":"smithi040","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"39046","root":"/"}}] 2024-04-18T10:40:46.621 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "e85153d553ddc8420b6b154a57813a504f51c01a", "ceph_version": "ceph version 17.2.7-872-ge85153d5 (e85153d553ddc8420b6b154a57813a504f51c01a) quincy (stable)", "client_features": { "feature_bits": "0x00000000001fffff" }, "entity_id": "0", "hostname": "smithi040", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "39046", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.40:0", "nonce": 1790064707, "type": "v1" }, "name": { "num": 24930, "type": "client" } }, "id": 24930, "inst": "client.24930 v1:172.21.15.40:0/1790064707", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9796650646741553 }, "state": "open", "uptime": 8.894850216 } ] 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:40:46.622 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2024-04-18T10:40:46.623 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-04-18T10:40:46.722 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.39046.asok 2024-04-18T10:40:46.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-18T10:40:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:40:46.732 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39046.asok 2024-04-18T10:40:46.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:46.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39046.asok mds_sessions 2024-04-18T10:40:46.892 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-18T10:40:46.892 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 24930, 2024-04-18T10:40:46.892 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-04-18T10:40:46.892 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-04-18T10:40:46.892 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-04-18T10:40:46.892 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 24930 2024-04-18T10:40:46.892 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:40:46.892 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-04-18T10:40:46.892 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1790064707 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.24930 v1:172.21.15.40:0/1790064707", 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "v1:172.21.15.40:0/1790064707", 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "sessions": [ 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": 0, 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "addrs": { 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "addrvec": [ 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-04-18T10:40:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.31:6819", 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1866692589 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: "seq": 0, 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: "cap_gen": 0, 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: "cap_ttl": "2024-04-18T10:41:38.716329+0000", 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: "last_cap_renew_request": "2024-04-18T10:40:38.716329+0000", 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: "cap_renew_seq": 2, 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: "num_caps": 1, 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "open" 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: ], 2024-04-18T10:40:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 19 2024-04-18T10:40:46.895 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-18T10:40:46.902 INFO:tasks.fs:client client.0 has a session with MDS None.0 2024-04-18T10:40:46.902 DEBUG:teuthology.orchestra.run.smithi137:> sudo stdin-killer -- python3 -c ' 2024-04-18T10:40:46.902 DEBUG:teuthology.orchestra.run.smithi137:> import glob 2024-04-18T10:40:46.902 DEBUG:teuthology.orchestra.run.smithi137:> import re 2024-04-18T10:40:46.902 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-18T10:40:46.902 DEBUG:teuthology.orchestra.run.smithi137:> import subprocess 2024-04-18T10:40:46.902 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> def _find_admin_socket(client_name): 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> files = glob.glob(asok_path) 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> # Given a non-glob path, it better be there 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> if "*" not in asok_path: 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> assert(len(files) == 1) 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> return files[0] 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> for f in files: 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> contents = proc_f.read() 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> if mountpoint in contents: 2024-04-18T10:40:46.903 DEBUG:teuthology.orchestra.run.smithi137:> return f 2024-04-18T10:40:46.904 DEBUG:teuthology.orchestra.run.smithi137:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-18T10:40:46.904 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-18T10:40:46.904 DEBUG:teuthology.orchestra.run.smithi137:> print(_find_admin_socket("client.1")) 2024-04-18T10:40:46.904 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-18T10:40:47.001 INFO:teuthology.orchestra.run.smithi137.stdout:/var/run/ceph/ceph-client.1.37350.asok 2024-04-18T10:40:47.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-18T10:40:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-18T10:40:47.011 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37350.asok 2024-04-18T10:40:47.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:40:47.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37350.asok mds_sessions 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 14489, 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: "inst": { 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: "name": { 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "client", 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: "num": 14489 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": { 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.137:0", 2024-04-18T10:40:47.154 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 2414209880 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: "inst_str": "client.14489 v1:172.21.15.137:0/2414209880", 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: "addr_str": "v1:172.21.15.137:0/2414209880", 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: "sessions": [ 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": 0, 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: "addrs": { 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: "addrvec": [ 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: "type": "v1", 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: "addr": "172.21.15.31:6819", 2024-04-18T10:40:47.155 INFO:teuthology.orchestra.run.smithi137.stdout: "nonce": 1866692589 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: "seq": 1, 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_gen": 0, 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_ttl": "2024-04-18T10:41:31.108778+0000", 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: "last_cap_renew_request": "2024-04-18T10:40:31.108778+0000", 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: "cap_renew_seq": 15, 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: "num_caps": 1, 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "open" 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 18 2024-04-18T10:40:47.156 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-18T10:40:47.160 INFO:tasks.fs:confirming client client.1 is blocklisted 2024-04-18T10:40:47.160 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:40:47.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.291+0000 7f60b2e23700 1 Processor -- start 2024-04-18T10:40:47.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.291+0000 7f60b2e23700 1 -- start start 2024-04-18T10:40:47.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b2e23700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac069450 0x7f60ac0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:47.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b2e23700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac13f130 0x7f60ac145900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:47.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b2e23700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac0a59e0 con 0x7f60ac0a30c0 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b2e23700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0a3ad0 con 0x7f60ac069450 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b2e23700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0a57c0 con 0x7f60ac13f130 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b0bbf700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac069450 0x7f60ac0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b13c0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac13f130 0x7f60ac145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60abfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f60ac0a30c0 0x7f60ac13ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56268/0 (socket says 172.21.15.31:56268) 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60abfff700 1 -- 172.21.15.31:0/2445622764 learned_addr learned my addr 172.21.15.31:0/2445622764 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b0bbf700 1 -- 172.21.15.31:0/2445622764 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac13f130 msgr2=0x7f60ac145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60ab7fe700 1 -- 172.21.15.31:0/2445622764 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638245759 0 0) 0x7f60ac0a59e0 con 0x7f60ac0a30c0 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b0bbf700 1 --2- 172.21.15.31:0/2445622764 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac13f130 0x7f60ac145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b0bbf700 1 -- 172.21.15.31:0/2445622764 >> v1:172.21.15.31:6789/0 conn(0x7f60ac0a30c0 legacy=0x7f60ac13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b0bbf700 1 -- 172.21.15.31:0/2445622764 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0a4bc0 con 0x7f60ac069450 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b13c0700 1 --2- 172.21.15.31:0/2445622764 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac13f130 0x7f60ac145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.292+0000 7f60b0bbf700 1 --2- 172.21.15.31:0/2445622764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac069450 0x7f60ac0a2b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009940 tx=0x7f60a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3884226df407dbe server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60ab7fe700 1 -- 172.21.15.31:0/2445622764 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a000b670 con 0x7f60ac069450 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60ab7fe700 1 -- 172.21.15.31:0/2445622764 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a000b7d0 con 0x7f60ac069450 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60ab7fe700 1 -- 172.21.15.31:0/2445622764 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a000bb90 con 0x7f60ac069450 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60b2e23700 1 -- 172.21.15.31:0/2445622764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac069450 msgr2=0x7f60ac0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60b2e23700 1 --2- 172.21.15.31:0/2445622764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac069450 0x7f60ac0a2b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f60a0009940 tx=0x7f60a00091a0 comp rx=0 tx=0).stop 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60b2e23700 1 -- 172.21.15.31:0/2445622764 shutdown_connections 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60b2e23700 1 --2- 172.21.15.31:0/2445622764 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac13f130 0x7f60ac145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60b2e23700 1 --2- 172.21.15.31:0/2445622764 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac069450 0x7f60ac0a2b80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60b2e23700 1 -- 172.21.15.31:0/2445622764 >> 172.21.15.31:0/2445622764 conn(0x7f60ac06ae80 msgr2=0x7f60ac068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60b2e23700 1 -- 172.21.15.31:0/2445622764 shutdown_connections 2024-04-18T10:40:47.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.293+0000 7f60b2e23700 1 -- 172.21.15.31:0/2445622764 wait complete. 2024-04-18T10:40:47.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.294+0000 7f60b2e23700 1 Processor -- start 2024-04-18T10:40:47.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b2e23700 1 -- start start 2024-04-18T10:40:47.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b2e23700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac069450 0x7f60ac0aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b2e23700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac0a30c0 0x7f60ac14cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b2e23700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60ac13f130 0x7f60ac14d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b2e23700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0ad430 con 0x7f60ac13f130 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b2e23700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0a18d0 con 0x7f60ac0a30c0 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b2e23700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0aec30 con 0x7f60ac069450 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b0bbf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac069450 0x7f60ac0aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b0bbf700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac069450 0x7f60ac0aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:50366/0 (socket says 172.21.15.31:50366) 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b0bbf700 1 -- 172.21.15.31:0/104189606 learned_addr learned my addr 172.21.15.31:0/104189606 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60b13c0700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60ac13f130 0x7f60ac14d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.295+0000 7f60abfff700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac0a30c0 0x7f60ac14cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60b0bbf700 1 -- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac0a30c0 msgr2=0x7f60ac14cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60b0bbf700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac0a30c0 0x7f60ac14cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60b0bbf700 1 -- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60ac13f130 msgr2=0x7f60ac14d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60b0bbf700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60ac13f130 0x7f60ac14d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60b0bbf700 1 -- 172.21.15.31:0/104189606 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4009a20 con 0x7f60ac069450 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60b13c0700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60ac13f130 0x7f60ac14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60abfff700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac0a30c0 0x7f60ac14cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60b0bbf700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac069450 0x7f60ac0aca60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f60a0013000 tx=0x7f60a0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60a8ff9700 1 -- 172.21.15.31:0/104189606 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a000ba40 con 0x7f60ac069450 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60a8ff9700 1 -- 172.21.15.31:0/104189606 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a001a420 con 0x7f60ac069450 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a0009420 con 0x7f60ac069450 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60a8ff9700 1 -- 172.21.15.31:0/104189606 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a001a7e0 con 0x7f60ac069450 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.296+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac0abd90 con 0x7f60ac069450 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.297+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac0651b0 con 0x7f60ac069450 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.297+0000 7f60a8ff9700 1 -- 172.21.15.31:0/104189606 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f60a002c070 con 0x7f60ac069450 2024-04-18T10:40:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.297+0000 7f60a8ff9700 1 -- 172.21.15.31:0/104189606 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f60a0064bd0 con 0x7f60ac069450 2024-04-18T10:40:47.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.301+0000 7f60a8ff9700 1 -- 172.21.15.31:0/104189606 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f60a0001d20 con 0x7f60ac069450 2024-04-18T10:40:47.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.467+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60ac06f8f0 con 0x7f60ac069450 2024-04-18T10:40:47.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.467+0000 7f60a8ff9700 1 -- 172.21.15.31:0/104189606 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12029 (secure 0 0 0) 0x7f60a0033020 con 0x7f60ac069450 2024-04-18T10:40:47.468 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:40:47.468 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:40:40.522243+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":42,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":42,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2414209880":"2024-04-18T11:40:39.525564+0000","172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:40:47.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 >> v1:172.21.15.31:6816/46601 conn(0x7f6090045ef0 legacy=0x7f60900483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:47.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac069450 msgr2=0x7f60ac0aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:40:47.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac069450 0x7f60ac0aca60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f60a0013000 tx=0x7f60a0017000 comp rx=0 tx=0).stop 2024-04-18T10:40:47.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 shutdown_connections 2024-04-18T10:40:47.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f60ac069450 0x7f60ac0aca60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:47.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60ac13f130 0x7f60ac14d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:47.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 --2- 172.21.15.31:0/104189606 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f60ac0a30c0 0x7f60ac14cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:40:47.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 >> 172.21.15.31:0/104189606 conn(0x7f60ac06ae80 msgr2=0x7f60ac0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:40:47.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 shutdown_connections 2024-04-18T10:40:47.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:40:47.469+0000 7f60b2e23700 1 -- 172.21.15.31:0/104189606 wait complete. 2024-04-18T10:40:47.482 INFO:teuthology.run_tasks:Running task workunit... 2024-04-18T10:40:47.498 INFO:tasks.workunit:Pulling workunits from ref 08d35a8d8529783882dd092c73c0b27be41c4d86 2024-04-18T10:40:47.498 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-18T10:40:47.498 DEBUG:teuthology.orchestra.run.smithi040:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:47.520 INFO:teuthology.orchestra.run.smithi040.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:47.520 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-18T10:40:47.520 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 2fh/47d Inode: 1 Links: 2 2024-04-18T10:40:47.520 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-18T10:40:47.520 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-18T10:40:47.520 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-18T10:40:47.520 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-18 10:36:08.989653353 +0000 2024-04-18T10:40:47.520 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-18 10:36:30.642873660 +0000 2024-04-18T10:40:47.520 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-04-18T10:40:47.521 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-18T10:40:47.521 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-18T10:40:47.596 INFO:tasks.workunit:timeout=3h 2024-04-18T10:40:47.596 INFO:tasks.workunit:cleanup=True 2024-04-18T10:40:47.597 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08d35a8d8529783882dd092c73c0b27be41c4d86 2024-04-18T10:40:47.658 INFO:tasks.workunit.client.0.smithi040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-18T10:42:01.834 INFO:tasks.workunit.client.0.smithi040.stderr:Note: switching to '08d35a8d8529783882dd092c73c0b27be41c4d86'. 2024-04-18T10:42:01.835 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-18T10:42:01.835 INFO:tasks.workunit.client.0.smithi040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-18T10:42:01.835 INFO:tasks.workunit.client.0.smithi040.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-18T10:42:01.835 INFO:tasks.workunit.client.0.smithi040.stderr:state without impacting any branches by switching back to a branch. 2024-04-18T10:42:01.835 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-18T10:42:01.835 INFO:tasks.workunit.client.0.smithi040.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-18T10:42:01.835 INFO:tasks.workunit.client.0.smithi040.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-18T10:42:01.835 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-18T10:42:01.836 INFO:tasks.workunit.client.0.smithi040.stderr: git switch -c 2024-04-18T10:42:01.836 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-18T10:42:01.836 INFO:tasks.workunit.client.0.smithi040.stderr:Or undo this operation with: 2024-04-18T10:42:01.836 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-18T10:42:01.836 INFO:tasks.workunit.client.0.smithi040.stderr: git switch - 2024-04-18T10:42:01.836 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-18T10:42:01.836 INFO:tasks.workunit.client.0.smithi040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-18T10:42:01.836 INFO:tasks.workunit.client.0.smithi040.stderr: 2024-04-18T10:42:01.836 INFO:tasks.workunit.client.0.smithi040.stderr:HEAD is now at 08d35a8d852 Merge PR #56755 into main 2024-04-18T10:42:01.837 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-18T10:42:01.904 INFO:tasks.workunit.client.0.smithi040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-18T10:42:01.906 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T10:42:01.906 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-18T10:42:02.446 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-18T10:42:02.502 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-18T10:42:02.542 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-18T10:42:02.544 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T10:42:02.544 INFO:tasks.workunit.client.0.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-18T10:42:02.583 INFO:tasks.workunit.client.0.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-18T10:42:02.587 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:42:02.587 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-18T10:42:02.646 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-18T10:42:02.651 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-18T10:42:02.652 DEBUG:teuthology.orchestra.run.smithi040:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08d35a8d8529783882dd092c73c0b27be41c4d86 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-18T10:42:02.716 INFO:tasks.workunit.client.0.smithi040.stderr:+ mkdir -p fsstress 2024-04-18T10:42:02.719 INFO:tasks.workunit.client.0.smithi040.stderr:+ pushd fsstress 2024-04-18T10:42:02.720 INFO:tasks.workunit.client.0.smithi040.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T10:42:02.720 INFO:tasks.workunit.client.0.smithi040.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-18T10:42:03.775 INFO:tasks.workunit.client.0.smithi040.stderr:+ tar xzf ltp-full.tgz 2024-04-18T10:42:38.207 INFO:tasks.workunit.client.0.smithi040.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-18T10:42:38.211 INFO:tasks.workunit.client.0.smithi040.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T10:42:38.212 INFO:tasks.workunit.client.0.smithi040.stderr:+ make 2024-04-18T10:42:38.278 INFO:tasks.workunit.client.0.smithi040.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-18T10:42:38.627 INFO:tasks.workunit.client.0.smithi040.stderr:++ readlink -f fsstress 2024-04-18T10:42:38.629 INFO:tasks.workunit.client.0.smithi040.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-18T10:42:38.629 INFO:tasks.workunit.client.0.smithi040.stderr:+ popd 2024-04-18T10:42:38.630 INFO:tasks.workunit.client.0.smithi040.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-18T10:42:38.630 INFO:tasks.workunit.client.0.smithi040.stderr:+ popd 2024-04-18T10:42:38.631 INFO:tasks.workunit.client.0.smithi040.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-18T10:42:38.631 INFO:tasks.workunit.client.0.smithi040.stderr:++ mktemp -d -p . 2024-04-18T10:42:38.633 INFO:tasks.workunit.client.0.smithi040.stderr:+ T=./tmp.yFWT2uSA5X 2024-04-18T10:42:38.633 INFO:tasks.workunit.client.0.smithi040.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.yFWT2uSA5X -l 1 -n 1000 -p 10 -v 2024-04-18T10:42:38.636 INFO:tasks.workunit.client.0.smithi040.stdout:seed = 1713979398 2024-04-18T10:42:38.641 INFO:tasks.workunit.client.0.smithi040.stdout:1/0: chown . 1016835 1 2024-04-18T10:42:38.641 INFO:tasks.workunit.client.0.smithi040.stdout:1/1: dwrite - no filename 2024-04-18T10:42:38.641 INFO:tasks.workunit.client.0.smithi040.stdout:0/0: symlink l0 0 2024-04-18T10:42:38.641 INFO:tasks.workunit.client.0.smithi040.stdout:0/1: dread - no filename 2024-04-18T10:42:38.641 INFO:tasks.workunit.client.0.smithi040.stdout:0/2: dwrite - no filename 2024-04-18T10:42:38.641 INFO:tasks.workunit.client.0.smithi040.stdout:0/3: dread - no filename 2024-04-18T10:42:38.641 INFO:tasks.workunit.client.0.smithi040.stdout:0/4: dwrite - no filename 2024-04-18T10:42:38.642 INFO:tasks.workunit.client.0.smithi040.stdout:2/0: dread - no filename 2024-04-18T10:42:38.642 INFO:tasks.workunit.client.0.smithi040.stdout:2/1: fdatasync - no filename 2024-04-18T10:42:38.642 INFO:tasks.workunit.client.0.smithi040.stdout:1/2: getdents . 0 2024-04-18T10:42:38.643 INFO:tasks.workunit.client.0.smithi040.stdout:3/0: read - no filename 2024-04-18T10:42:38.644 INFO:tasks.workunit.client.0.smithi040.stdout:3/1: dwrite - no filename 2024-04-18T10:42:38.644 INFO:tasks.workunit.client.0.smithi040.stdout:1/3: getdents . 0 2024-04-18T10:42:38.644 INFO:tasks.workunit.client.0.smithi040.stdout:1/4: truncate - no filename 2024-04-18T10:42:38.644 INFO:tasks.workunit.client.0.smithi040.stdout:1/5: dread - no filename 2024-04-18T10:42:38.644 INFO:tasks.workunit.client.0.smithi040.stdout:1/6: write - no filename 2024-04-18T10:42:38.644 INFO:tasks.workunit.client.0.smithi040.stdout:1/7: chown . 4871083 1 2024-04-18T10:42:38.644 INFO:tasks.workunit.client.0.smithi040.stdout:1/8: read - no filename 2024-04-18T10:42:38.644 INFO:tasks.workunit.client.0.smithi040.stdout:3/2: getdents . 0 2024-04-18T10:42:38.645 INFO:tasks.workunit.client.0.smithi040.stdout:4/0: read - no filename 2024-04-18T10:42:38.645 INFO:tasks.workunit.client.0.smithi040.stdout:4/1: dwrite - no filename 2024-04-18T10:42:38.645 INFO:tasks.workunit.client.0.smithi040.stdout:3/3: dread - no filename 2024-04-18T10:42:38.645 INFO:tasks.workunit.client.0.smithi040.stdout:3/4: fsync - no filename 2024-04-18T10:42:38.645 INFO:tasks.workunit.client.0.smithi040.stdout:3/5: write - no filename 2024-04-18T10:42:38.645 INFO:tasks.workunit.client.0.smithi040.stdout:1/9: creat f0 x:0 0 0 2024-04-18T10:42:38.646 INFO:tasks.workunit.client.0.smithi040.stdout:1/10: write f0 [169426,41974] 0 2024-04-18T10:42:38.646 INFO:tasks.workunit.client.0.smithi040.stdout:3/6: mknod c0 0 2024-04-18T10:42:38.647 INFO:tasks.workunit.client.0.smithi040.stdout:3/7: readlink - no filename 2024-04-18T10:42:38.647 INFO:tasks.workunit.client.0.smithi040.stdout:6/0: link - no file 2024-04-18T10:42:38.647 INFO:tasks.workunit.client.0.smithi040.stdout:6/1: truncate - no filename 2024-04-18T10:42:38.648 INFO:tasks.workunit.client.0.smithi040.stdout:1/11: mkdir d1 0 2024-04-18T10:42:38.649 INFO:tasks.workunit.client.0.smithi040.stdout:3/8: mkdir d1 0 2024-04-18T10:42:38.650 INFO:tasks.workunit.client.0.smithi040.stdout:5/0: mkdir d0 0 2024-04-18T10:42:38.651 INFO:tasks.workunit.client.0.smithi040.stdout:7/0: fsync - no filename 2024-04-18T10:42:38.651 INFO:tasks.workunit.client.0.smithi040.stdout:5/1: chown d0 0 1 2024-04-18T10:42:38.651 INFO:tasks.workunit.client.0.smithi040.stdout:5/2: dwrite - no filename 2024-04-18T10:42:38.651 INFO:tasks.workunit.client.0.smithi040.stdout:6/2: creat f0 x:0 0 0 2024-04-18T10:42:38.652 INFO:tasks.workunit.client.0.smithi040.stdout:3/9: mkdir d1/d2 0 2024-04-18T10:42:38.652 INFO:tasks.workunit.client.0.smithi040.stdout:3/10: write - no filename 2024-04-18T10:42:38.652 INFO:tasks.workunit.client.0.smithi040.stdout:3/11: dread - no filename 2024-04-18T10:42:38.652 INFO:tasks.workunit.client.0.smithi040.stdout:3/12: dread - no filename 2024-04-18T10:42:38.652 INFO:tasks.workunit.client.0.smithi040.stdout:3/13: dread - no filename 2024-04-18T10:42:38.652 INFO:tasks.workunit.client.0.smithi040.stdout:3/14: readlink - no filename 2024-04-18T10:42:38.653 INFO:tasks.workunit.client.0.smithi040.stdout:3/15: read - no filename 2024-04-18T10:42:38.654 INFO:tasks.workunit.client.0.smithi040.stdout:7/1: creat f0 x:0 0 0 2024-04-18T10:42:38.655 INFO:tasks.workunit.client.0.smithi040.stdout:3/16: mknod d1/c3 0 2024-04-18T10:42:38.655 INFO:tasks.workunit.client.0.smithi040.stdout:3/17: dread - no filename 2024-04-18T10:42:38.655 INFO:tasks.workunit.client.0.smithi040.stdout:3/18: readlink - no filename 2024-04-18T10:42:38.655 INFO:tasks.workunit.client.0.smithi040.stdout:3/19: fsync - no filename 2024-04-18T10:42:38.655 INFO:tasks.workunit.client.0.smithi040.stdout:9/0: dwrite - no filename 2024-04-18T10:42:38.655 INFO:tasks.workunit.client.0.smithi040.stdout:7/2: chown f0 1078938 1 2024-04-18T10:42:38.656 INFO:tasks.workunit.client.0.smithi040.stdout:8/0: symlink l0 0 2024-04-18T10:42:38.656 INFO:tasks.workunit.client.0.smithi040.stdout:3/20: chown c0 11064776 1 2024-04-18T10:42:38.657 INFO:tasks.workunit.client.0.smithi040.stdout:9/1: getdents . 0 2024-04-18T10:42:38.657 INFO:tasks.workunit.client.0.smithi040.stdout:3/21: chown d1 5224 1 2024-04-18T10:42:38.657 INFO:tasks.workunit.client.0.smithi040.stdout:3/22: write - no filename 2024-04-18T10:42:38.658 INFO:tasks.workunit.client.0.smithi040.stdout:3/23: fdatasync - no filename 2024-04-18T10:42:38.658 INFO:tasks.workunit.client.0.smithi040.stdout:3/24: dwrite - no filename 2024-04-18T10:42:38.658 INFO:tasks.workunit.client.0.smithi040.stdout:3/25: fsync - no filename 2024-04-18T10:42:38.658 INFO:tasks.workunit.client.0.smithi040.stdout:3/26: fsync - no filename 2024-04-18T10:42:38.658 INFO:tasks.workunit.client.0.smithi040.stdout:3/27: dread - no filename 2024-04-18T10:42:38.658 INFO:tasks.workunit.client.0.smithi040.stdout:3/28: truncate - no filename 2024-04-18T10:42:38.658 INFO:tasks.workunit.client.0.smithi040.stdout:3/29: write - no filename 2024-04-18T10:42:38.658 INFO:tasks.workunit.client.0.smithi040.stdout:8/1: creat f1 x:0 0 0 2024-04-18T10:42:38.659 INFO:tasks.workunit.client.0.smithi040.stdout:7/3: write f0 [255812,23569] 0 2024-04-18T10:42:38.659 INFO:tasks.workunit.client.0.smithi040.stdout:1/12: dwrite f0 [0,4194304] 0 2024-04-18T10:42:38.660 INFO:tasks.workunit.client.0.smithi040.stdout:9/2: symlink l0 0 2024-04-18T10:42:38.660 INFO:tasks.workunit.client.0.smithi040.stdout:9/3: write - no filename 2024-04-18T10:42:38.660 INFO:tasks.workunit.client.0.smithi040.stdout:7/4: chown f0 4 1 2024-04-18T10:42:38.660 INFO:tasks.workunit.client.0.smithi040.stdout:8/2: write f1 [355410,56908] 0 2024-04-18T10:42:38.661 INFO:tasks.workunit.client.0.smithi040.stdout:3/30: creat d1/d2/f4 x:0 0 0 2024-04-18T10:42:38.663 INFO:tasks.workunit.client.0.smithi040.stdout:1/13: mknod d1/c2 0 2024-04-18T10:42:38.667 INFO:tasks.workunit.client.0.smithi040.stdout:3/31: creat d1/d2/f5 x:0 0 0 2024-04-18T10:42:38.668 INFO:tasks.workunit.client.0.smithi040.stdout:9/4: link l0 l1 0 2024-04-18T10:42:38.668 INFO:tasks.workunit.client.0.smithi040.stdout:9/5: fdatasync - no filename 2024-04-18T10:42:38.668 INFO:tasks.workunit.client.0.smithi040.stdout:9/6: fdatasync - no filename 2024-04-18T10:42:38.668 INFO:tasks.workunit.client.0.smithi040.stdout:9/7: write - no filename 2024-04-18T10:42:38.672 INFO:tasks.workunit.client.0.smithi040.stdout:7/5: dwrite f0 [0,4194304] 0 2024-04-18T10:42:38.672 INFO:tasks.workunit.client.0.smithi040.stdout:9/8: mkdir d2 0 2024-04-18T10:42:38.672 INFO:tasks.workunit.client.0.smithi040.stdout:7/6: readlink - no filename 2024-04-18T10:42:38.673 INFO:tasks.workunit.client.0.smithi040.stdout:3/32: creat d1/f6 x:0 0 0 2024-04-18T10:42:38.673 INFO:tasks.workunit.client.0.smithi040.stdout:8/3: dwrite f1 [0,4194304] 0 2024-04-18T10:42:38.674 INFO:tasks.workunit.client.0.smithi040.stdout:7/7: mknod c1 0 2024-04-18T10:42:38.675 INFO:tasks.workunit.client.0.smithi040.stdout:3/33: mkdir d1/d7 0 2024-04-18T10:42:38.676 INFO:tasks.workunit.client.0.smithi040.stdout:3/34: dread - d1/f6 zero size 2024-04-18T10:42:38.676 INFO:tasks.workunit.client.0.smithi040.stdout:9/9: mkdir d2/d3 0 2024-04-18T10:42:38.676 INFO:tasks.workunit.client.0.smithi040.stdout:9/10: chown d2 3390760 1 2024-04-18T10:42:38.676 INFO:tasks.workunit.client.0.smithi040.stdout:9/11: write - no filename 2024-04-18T10:42:38.677 INFO:tasks.workunit.client.0.smithi040.stdout:9/12: dwrite - no filename 2024-04-18T10:42:38.677 INFO:tasks.workunit.client.0.smithi040.stdout:9/13: fsync - no filename 2024-04-18T10:42:38.677 INFO:tasks.workunit.client.0.smithi040.stdout:7/8: mknod c2 0 2024-04-18T10:42:38.681 INFO:tasks.workunit.client.0.smithi040.stdout:3/35: unlink d1/d2/f4 0 2024-04-18T10:42:38.683 INFO:tasks.workunit.client.0.smithi040.stdout:7/9: mknod c3 0 2024-04-18T10:42:38.688 INFO:tasks.workunit.client.0.smithi040.stdout:9/14: rename l0 to d2/l4 0 2024-04-18T10:42:38.689 INFO:tasks.workunit.client.0.smithi040.stdout:7/10: rename c3 to c4 0 2024-04-18T10:42:38.690 INFO:tasks.workunit.client.0.smithi040.stdout:3/36: getdents d1/d7 0 2024-04-18T10:42:38.691 INFO:tasks.workunit.client.0.smithi040.stdout:9/15: creat d2/f5 x:0 0 0 2024-04-18T10:42:38.692 INFO:tasks.workunit.client.0.smithi040.stdout:9/16: write d2/f5 [554245,118726] 0 2024-04-18T10:42:38.693 INFO:tasks.workunit.client.0.smithi040.stdout:3/37: mknod d1/d2/c8 0 2024-04-18T10:42:38.695 INFO:tasks.workunit.client.0.smithi040.stdout:3/38: unlink d1/d2/c8 0 2024-04-18T10:42:38.696 INFO:tasks.workunit.client.0.smithi040.stdout:3/39: dread - d1/d2/f5 zero size 2024-04-18T10:42:38.696 INFO:tasks.workunit.client.0.smithi040.stdout:3/40: dread - d1/d2/f5 zero size 2024-04-18T10:42:38.699 INFO:tasks.workunit.client.0.smithi040.stdout:3/41: link d1/d2/f5 d1/d7/f9 0 2024-04-18T10:42:38.702 INFO:tasks.workunit.client.0.smithi040.stdout:3/42: rename d1/d2/f5 to d1/d7/fa 0 2024-04-18T10:42:38.703 INFO:tasks.workunit.client.0.smithi040.stdout:9/17: dread d2/f5 [0,4194304] 0 2024-04-18T10:42:38.703 INFO:tasks.workunit.client.0.smithi040.stdout:9/18: rename d2/d3 to d2/d3/d6 22 2024-04-18T10:42:38.704 INFO:tasks.workunit.client.0.smithi040.stdout:3/43: unlink d1/d7/f9 0 2024-04-18T10:42:38.705 INFO:tasks.workunit.client.0.smithi040.stdout:9/19: mkdir d2/d7 0 2024-04-18T10:42:38.706 INFO:tasks.workunit.client.0.smithi040.stdout:9/20: chown l1 28691792 1 2024-04-18T10:42:38.708 INFO:tasks.workunit.client.0.smithi040.stdout:9/21: dread d2/f5 [0,4194304] 0 2024-04-18T10:42:38.710 INFO:tasks.workunit.client.0.smithi040.stdout:9/22: creat d2/d7/f8 x:0 0 0 2024-04-18T10:42:38.711 INFO:tasks.workunit.client.0.smithi040.stdout:9/23: dread - d2/d7/f8 zero size 2024-04-18T10:42:38.712 INFO:tasks.workunit.client.0.smithi040.stdout:9/24: mknod d2/c9 0 2024-04-18T10:42:38.712 INFO:tasks.workunit.client.0.smithi040.stdout:9/25: dread - d2/d7/f8 zero size 2024-04-18T10:42:38.714 INFO:tasks.workunit.client.0.smithi040.stdout:9/26: truncate d2/d7/f8 470715 0 2024-04-18T10:42:38.715 INFO:tasks.workunit.client.0.smithi040.stdout:9/27: dread d2/f5 [0,4194304] 0 2024-04-18T10:42:38.716 INFO:tasks.workunit.client.0.smithi040.stdout:9/28: creat d2/d7/fa x:0 0 0 2024-04-18T10:42:38.717 INFO:tasks.workunit.client.0.smithi040.stdout:9/29: read d2/d7/f8 [97166,54578] 0 2024-04-18T10:42:38.718 INFO:tasks.workunit.client.0.smithi040.stdout:9/30: truncate d2/f5 803385 0 2024-04-18T10:42:38.719 INFO:tasks.workunit.client.0.smithi040.stdout:9/31: creat d2/fb x:0 0 0 2024-04-18T10:42:38.720 INFO:tasks.workunit.client.0.smithi040.stdout:9/32: mkdir d2/dc 0 2024-04-18T10:42:38.780 INFO:tasks.workunit.client.0.smithi040.stdout:6/3: getdents . 0 2024-04-18T10:42:38.781 INFO:tasks.workunit.client.0.smithi040.stdout:6/4: truncate f0 806329 0 2024-04-18T10:42:38.781 INFO:tasks.workunit.client.0.smithi040.stdout:6/5: stat f0 0 2024-04-18T10:42:38.783 INFO:tasks.workunit.client.0.smithi040.stdout:6/6: dread f0 [0,4194304] 0 2024-04-18T10:42:38.785 INFO:tasks.workunit.client.0.smithi040.stdout:6/7: mknod c1 0 2024-04-18T10:42:38.786 INFO:tasks.workunit.client.0.smithi040.stdout:6/8: mknod c2 0 2024-04-18T10:42:38.786 INFO:tasks.workunit.client.0.smithi040.stdout:1/14: truncate f0 1443789 0 2024-04-18T10:42:38.788 INFO:tasks.workunit.client.0.smithi040.stdout:6/9: write f0 [670142,31407] 0 2024-04-18T10:42:38.830 INFO:tasks.workunit.client.0.smithi040.stdout:8/4: truncate f1 3666024 0 2024-04-18T10:42:38.833 INFO:tasks.workunit.client.0.smithi040.stdout:9/33: rmdir d2 39 2024-04-18T10:42:38.833 INFO:tasks.workunit.client.0.smithi040.stdout:6/10: dwrite f0 [0,4194304] 0 2024-04-18T10:42:38.834 INFO:tasks.workunit.client.0.smithi040.stdout:8/5: mkdir d2 0 2024-04-18T10:42:38.835 INFO:tasks.workunit.client.0.smithi040.stdout:3/44: fdatasync d1/d7/fa 0 2024-04-18T10:42:38.835 INFO:tasks.workunit.client.0.smithi040.stdout:3/45: readlink - no filename 2024-04-18T10:42:38.836 INFO:tasks.workunit.client.0.smithi040.stdout:1/15: dread f0 [0,4194304] 0 2024-04-18T10:42:38.839 INFO:tasks.workunit.client.0.smithi040.stdout:9/34: rmdir d2/d7 39 2024-04-18T10:42:38.839 INFO:tasks.workunit.client.0.smithi040.stdout:1/16: rmdir d1 39 2024-04-18T10:42:38.840 INFO:tasks.workunit.client.0.smithi040.stdout:7/11: link c4 c5 0 2024-04-18T10:42:38.841 INFO:tasks.workunit.client.0.smithi040.stdout:8/6: symlink d2/l3 0 2024-04-18T10:42:38.842 INFO:tasks.workunit.client.0.smithi040.stdout:7/12: write f0 [521998,87626] 0 2024-04-18T10:42:38.842 INFO:tasks.workunit.client.0.smithi040.stdout:6/11: link c1 c3 0 2024-04-18T10:42:38.842 INFO:tasks.workunit.client.0.smithi040.stdout:1/17: dread f0 [0,4194304] 0 2024-04-18T10:42:38.842 INFO:tasks.workunit.client.0.smithi040.stdout:6/12: read f0 [3449405,77745] 0 2024-04-18T10:42:38.844 INFO:tasks.workunit.client.0.smithi040.stdout:1/18: dread f0 [0,4194304] 0 2024-04-18T10:42:38.845 INFO:tasks.workunit.client.0.smithi040.stdout:9/35: mkdir d2/dd 0 2024-04-18T10:42:38.845 INFO:tasks.workunit.client.0.smithi040.stdout:8/7: dread f1 [0,4194304] 0 2024-04-18T10:42:38.846 INFO:tasks.workunit.client.0.smithi040.stdout:7/13: mkdir d6 0 2024-04-18T10:42:38.847 INFO:tasks.workunit.client.0.smithi040.stdout:1/19: fdatasync f0 0 2024-04-18T10:42:38.848 INFO:tasks.workunit.client.0.smithi040.stdout:9/36: write d2/d7/fa [57881,25286] 0 2024-04-18T10:42:38.850 INFO:tasks.workunit.client.0.smithi040.stdout:8/8: write f1 [3457765,45999] 0 2024-04-18T10:42:38.851 INFO:tasks.workunit.client.0.smithi040.stdout:9/37: mkdir d2/dd/de 0 2024-04-18T10:42:38.853 INFO:tasks.workunit.client.0.smithi040.stdout:8/9: creat d2/f4 x:0 0 0 2024-04-18T10:42:38.853 INFO:tasks.workunit.client.0.smithi040.stdout:7/14: dread f0 [0,4194304] 0 2024-04-18T10:42:38.855 INFO:tasks.workunit.client.0.smithi040.stdout:8/10: truncate f1 4357040 0 2024-04-18T10:42:38.856 INFO:tasks.workunit.client.0.smithi040.stdout:1/20: dwrite f0 [0,4194304] 0 2024-04-18T10:42:38.857 INFO:tasks.workunit.client.0.smithi040.stdout:7/15: mknod d6/c7 0 2024-04-18T10:42:38.857 INFO:tasks.workunit.client.0.smithi040.stdout:8/11: write f1 [2449739,85796] 0 2024-04-18T10:42:38.858 INFO:tasks.workunit.client.0.smithi040.stdout:9/38: dread d2/d7/fa [0,4194304] 0 2024-04-18T10:42:38.859 INFO:tasks.workunit.client.0.smithi040.stdout:7/16: fsync f0 0 2024-04-18T10:42:38.860 INFO:tasks.workunit.client.0.smithi040.stdout:1/21: symlink d1/l3 0 2024-04-18T10:42:38.860 INFO:tasks.workunit.client.0.smithi040.stdout:7/17: chown c1 1 1 2024-04-18T10:42:38.862 INFO:tasks.workunit.client.0.smithi040.stdout:3/46: truncate d1/d7/fa 267585 0 2024-04-18T10:42:38.863 INFO:tasks.workunit.client.0.smithi040.stdout:9/39: symlink d2/dd/de/lf 0 2024-04-18T10:42:38.864 INFO:tasks.workunit.client.0.smithi040.stdout:7/18: chown c5 10898349 1 2024-04-18T10:42:38.866 INFO:tasks.workunit.client.0.smithi040.stdout:7/19: chown c4 32683 1 2024-04-18T10:42:38.866 INFO:tasks.workunit.client.0.smithi040.stdout:6/13: truncate f0 135800 0 2024-04-18T10:42:38.868 INFO:tasks.workunit.client.0.smithi040.stdout:8/12: dwrite d2/f4 [0,4194304] 0 2024-04-18T10:42:38.868 INFO:tasks.workunit.client.0.smithi040.stdout:7/20: fdatasync f0 0 2024-04-18T10:42:38.869 INFO:tasks.workunit.client.0.smithi040.stdout:9/40: creat d2/d3/f10 x:0 0 0 2024-04-18T10:42:38.869 INFO:tasks.workunit.client.0.smithi040.stdout:8/13: stat d2/f4 0 2024-04-18T10:42:38.871 INFO:tasks.workunit.client.0.smithi040.stdout:7/21: mknod d6/c8 0 2024-04-18T10:42:38.871 INFO:tasks.workunit.client.0.smithi040.stdout:1/22: dwrite f0 [0,4194304] 0 2024-04-18T10:42:38.871 INFO:tasks.workunit.client.0.smithi040.stdout:7/22: read f0 [528197,81521] 0 2024-04-18T10:42:38.872 INFO:tasks.workunit.client.0.smithi040.stdout:9/41: unlink d2/c9 0 2024-04-18T10:42:38.874 INFO:tasks.workunit.client.0.smithi040.stdout:1/23: creat d1/f4 x:0 0 0 2024-04-18T10:42:38.875 INFO:tasks.workunit.client.0.smithi040.stdout:9/42: mknod d2/d7/c11 0 2024-04-18T10:42:38.877 INFO:tasks.workunit.client.0.smithi040.stdout:1/24: mknod d1/c5 0 2024-04-18T10:42:38.879 INFO:tasks.workunit.client.0.smithi040.stdout:7/23: truncate f0 2299293 0 2024-04-18T10:42:38.881 INFO:tasks.workunit.client.0.smithi040.stdout:9/43: link d2/d7/fa d2/d3/f12 0 2024-04-18T10:42:38.882 INFO:tasks.workunit.client.0.smithi040.stdout:9/44: dread d2/d3/f12 [0,4194304] 0 2024-04-18T10:42:38.883 INFO:tasks.workunit.client.0.smithi040.stdout:7/24: rename c5 to d6/c9 0 2024-04-18T10:42:38.883 INFO:tasks.workunit.client.0.smithi040.stdout:7/25: stat c1 0 2024-04-18T10:42:38.886 INFO:tasks.workunit.client.0.smithi040.stdout:9/45: chown d2/l4 24086 1 2024-04-18T10:42:38.886 INFO:tasks.workunit.client.0.smithi040.stdout:9/46: readlink d2/l4 0 2024-04-18T10:42:38.888 INFO:tasks.workunit.client.0.smithi040.stdout:9/47: mkdir d2/dd/de/d13 0 2024-04-18T10:42:38.888 INFO:tasks.workunit.client.0.smithi040.stdout:9/48: chown d2/f5 27424 1 2024-04-18T10:42:38.893 INFO:tasks.workunit.client.0.smithi040.stdout:9/49: rmdir d2/dd/de/d13 0 2024-04-18T10:42:38.893 INFO:tasks.workunit.client.0.smithi040.stdout:9/50: stat d2/f5 0 2024-04-18T10:42:38.893 INFO:tasks.workunit.client.0.smithi040.stdout:9/51: dread - d2/fb zero size 2024-04-18T10:42:38.895 INFO:tasks.workunit.client.0.smithi040.stdout:8/14: fsync d2/f4 0 2024-04-18T10:42:38.895 INFO:tasks.workunit.client.0.smithi040.stdout:9/52: creat d2/d7/f14 x:0 0 0 2024-04-18T10:42:38.896 INFO:tasks.workunit.client.0.smithi040.stdout:8/15: chown d2/f4 3 1 2024-04-18T10:42:38.896 INFO:tasks.workunit.client.0.smithi040.stdout:9/53: truncate d2/d3/f10 2785 0 2024-04-18T10:42:38.897 INFO:tasks.workunit.client.0.smithi040.stdout:8/16: mkdir d2/d5 0 2024-04-18T10:42:38.904 INFO:tasks.workunit.client.0.smithi040.stdout:9/54: dwrite d2/d3/f10 [0,4194304] 0 2024-04-18T10:42:38.906 INFO:tasks.workunit.client.0.smithi040.stdout:8/17: dwrite f1 [0,4194304] 0 2024-04-18T10:42:38.907 INFO:tasks.workunit.client.0.smithi040.stdout:7/26: truncate f0 293116 0 2024-04-18T10:42:38.908 INFO:tasks.workunit.client.0.smithi040.stdout:9/55: creat d2/d7/f15 x:0 0 0 2024-04-18T10:42:38.909 INFO:tasks.workunit.client.0.smithi040.stdout:8/18: symlink d2/l6 0 2024-04-18T10:42:38.910 INFO:tasks.workunit.client.0.smithi040.stdout:7/27: creat d6/fa x:0 0 0 2024-04-18T10:42:38.911 INFO:tasks.workunit.client.0.smithi040.stdout:8/19: write d2/f4 [780736,63600] 0 2024-04-18T10:42:38.913 INFO:tasks.workunit.client.0.smithi040.stdout:3/47: dwrite d1/d7/fa [0,4194304] 0 2024-04-18T10:42:38.913 INFO:tasks.workunit.client.0.smithi040.stdout:7/28: mknod d6/cb 0 2024-04-18T10:42:38.913 INFO:tasks.workunit.client.0.smithi040.stdout:8/20: readlink d2/l6 0 2024-04-18T10:42:38.913 INFO:tasks.workunit.client.0.smithi040.stdout:8/21: stat d2/d5 0 2024-04-18T10:42:38.914 INFO:tasks.workunit.client.0.smithi040.stdout:7/29: chown d6/c8 3145 1 2024-04-18T10:42:38.916 INFO:tasks.workunit.client.0.smithi040.stdout:7/30: truncate d6/fa 135016 0 2024-04-18T10:42:38.917 INFO:tasks.workunit.client.0.smithi040.stdout:9/56: link d2/d3/f10 d2/dc/f16 0 2024-04-18T10:42:38.919 INFO:tasks.workunit.client.0.smithi040.stdout:8/22: rename l0 to d2/d5/l7 0 2024-04-18T10:42:38.920 INFO:tasks.workunit.client.0.smithi040.stdout:8/23: chown d2/d5 2 1 2024-04-18T10:42:38.921 INFO:tasks.workunit.client.0.smithi040.stdout:3/48: dwrite d1/f6 [0,4194304] 0 2024-04-18T10:42:38.921 INFO:tasks.workunit.client.0.smithi040.stdout:7/31: creat d6/fc x:0 0 0 2024-04-18T10:42:38.924 INFO:tasks.workunit.client.0.smithi040.stdout:9/57: mknod d2/d3/c17 0 2024-04-18T10:42:38.925 INFO:tasks.workunit.client.0.smithi040.stdout:8/24: mknod d2/c8 0 2024-04-18T10:42:38.926 INFO:tasks.workunit.client.0.smithi040.stdout:3/49: creat d1/fb x:0 0 0 2024-04-18T10:42:38.927 INFO:tasks.workunit.client.0.smithi040.stdout:7/32: unlink c2 0 2024-04-18T10:42:38.929 INFO:tasks.workunit.client.0.smithi040.stdout:8/25: mkdir d2/d5/d9 0 2024-04-18T10:42:38.930 INFO:tasks.workunit.client.0.smithi040.stdout:3/50: symlink d1/d7/lc 0 2024-04-18T10:42:38.936 INFO:tasks.workunit.client.0.smithi040.stdout:7/33: dwrite d6/fa [0,4194304] 0 2024-04-18T10:42:38.939 INFO:tasks.workunit.client.0.smithi040.stdout:8/26: dwrite f1 [0,4194304] 0 2024-04-18T10:42:38.940 INFO:tasks.workunit.client.0.smithi040.stdout:3/51: dread d1/d7/fa [0,4194304] 0 2024-04-18T10:42:38.941 INFO:tasks.workunit.client.0.smithi040.stdout:8/27: write d2/f4 [4452112,99396] 0 2024-04-18T10:42:38.942 INFO:tasks.workunit.client.0.smithi040.stdout:8/28: truncate d2/f4 4871816 0 2024-04-18T10:42:38.943 INFO:tasks.workunit.client.0.smithi040.stdout:3/52: mkdir d1/d2/dd 0 2024-04-18T10:42:38.944 INFO:tasks.workunit.client.0.smithi040.stdout:3/53: write d1/fb [1034659,81715] 0 2024-04-18T10:42:38.944 INFO:tasks.workunit.client.0.smithi040.stdout:8/29: unlink f1 0 2024-04-18T10:42:38.946 INFO:tasks.workunit.client.0.smithi040.stdout:3/54: symlink d1/le 0 2024-04-18T10:42:38.948 INFO:tasks.workunit.client.0.smithi040.stdout:8/30: dread d2/f4 [0,4194304] 0 2024-04-18T10:42:38.948 INFO:tasks.workunit.client.0.smithi040.stdout:8/31: chown d2/l6 1429973 1 2024-04-18T10:42:38.949 INFO:tasks.workunit.client.0.smithi040.stdout:8/32: truncate d2/f4 4962460 0 2024-04-18T10:42:38.953 INFO:tasks.workunit.client.0.smithi040.stdout:8/33: creat d2/d5/d9/fa x:0 0 0 2024-04-18T10:42:38.955 INFO:tasks.workunit.client.0.smithi040.stdout:8/34: creat d2/d5/d9/fb x:0 0 0 2024-04-18T10:42:38.957 INFO:tasks.workunit.client.0.smithi040.stdout:7/34: getdents d6 0 2024-04-18T10:42:38.959 INFO:tasks.workunit.client.0.smithi040.stdout:7/35: symlink d6/ld 0 2024-04-18T10:42:38.964 INFO:tasks.workunit.client.0.smithi040.stdout:7/36: fdatasync f0 0 2024-04-18T10:42:38.965 INFO:tasks.workunit.client.0.smithi040.stdout:8/35: dwrite d2/d5/d9/fa [0,4194304] 0 2024-04-18T10:42:38.967 INFO:tasks.workunit.client.0.smithi040.stdout:9/58: dwrite d2/d3/f12 [0,4194304] 0 2024-04-18T10:42:38.968 INFO:tasks.workunit.client.0.smithi040.stdout:7/37: mknod d6/ce 0 2024-04-18T10:42:38.970 INFO:tasks.workunit.client.0.smithi040.stdout:9/59: symlink d2/d7/l18 0 2024-04-18T10:42:38.970 INFO:tasks.workunit.client.0.smithi040.stdout:7/38: creat d6/ff x:0 0 0 2024-04-18T10:42:38.971 INFO:tasks.workunit.client.0.smithi040.stdout:9/60: write d2/d7/f15 [467596,32853] 0 2024-04-18T10:42:38.971 INFO:tasks.workunit.client.0.smithi040.stdout:8/36: dread d2/d5/d9/fa [0,4194304] 0 2024-04-18T10:42:38.972 INFO:tasks.workunit.client.0.smithi040.stdout:7/39: dread f0 [0,4194304] 0 2024-04-18T10:42:38.973 INFO:tasks.workunit.client.0.smithi040.stdout:8/37: readlink d2/d5/l7 0 2024-04-18T10:42:38.975 INFO:tasks.workunit.client.0.smithi040.stdout:7/40: creat d6/f10 x:0 0 0 2024-04-18T10:42:38.976 INFO:tasks.workunit.client.0.smithi040.stdout:3/55: truncate d1/f6 1993879 0 2024-04-18T10:42:38.976 INFO:tasks.workunit.client.0.smithi040.stdout:7/41: truncate d6/ff 768985 0 2024-04-18T10:42:38.976 INFO:tasks.workunit.client.0.smithi040.stdout:7/42: stat f0 0 2024-04-18T10:42:38.977 INFO:tasks.workunit.client.0.smithi040.stdout:8/38: mknod d2/cc 0 2024-04-18T10:42:38.979 INFO:tasks.workunit.client.0.smithi040.stdout:9/61: creat d2/f19 x:0 0 0 2024-04-18T10:42:38.980 INFO:tasks.workunit.client.0.smithi040.stdout:7/43: mknod d6/c11 0 2024-04-18T10:42:38.983 INFO:tasks.workunit.client.0.smithi040.stdout:8/39: rename d2/cc to d2/d5/cd 0 2024-04-18T10:42:38.984 INFO:tasks.workunit.client.0.smithi040.stdout:9/62: write d2/d3/f10 [3888348,15297] 0 2024-04-18T10:42:38.984 INFO:tasks.workunit.client.0.smithi040.stdout:7/44: mkdir d6/d12 0 2024-04-18T10:42:38.984 INFO:tasks.workunit.client.0.smithi040.stdout:8/40: write d2/d5/d9/fb [67502,77945] 0 2024-04-18T10:42:38.985 INFO:tasks.workunit.client.0.smithi040.stdout:7/45: chown d6/f10 10 1 2024-04-18T10:42:38.985 INFO:tasks.workunit.client.0.smithi040.stdout:8/41: chown d2/d5/l7 15 1 2024-04-18T10:42:38.986 INFO:tasks.workunit.client.0.smithi040.stdout:9/63: creat d2/dc/f1a x:0 0 0 2024-04-18T10:42:38.987 INFO:tasks.workunit.client.0.smithi040.stdout:7/46: mknod d6/d12/c13 0 2024-04-18T10:42:38.989 INFO:tasks.workunit.client.0.smithi040.stdout:7/47: write d6/fa [3435704,75707] 0 2024-04-18T10:42:38.991 INFO:tasks.workunit.client.0.smithi040.stdout:7/48: write d6/fc [697977,64409] 0 2024-04-18T10:42:38.994 INFO:tasks.workunit.client.0.smithi040.stdout:8/42: dwrite d2/d5/d9/fb [0,4194304] 0 2024-04-18T10:42:38.994 INFO:tasks.workunit.client.0.smithi040.stdout:7/49: write d6/f10 [296787,92769] 0 2024-04-18T10:42:38.996 INFO:tasks.workunit.client.0.smithi040.stdout:9/64: dwrite d2/d3/f10 [0,4194304] 0 2024-04-18T10:42:38.996 INFO:tasks.workunit.client.0.smithi040.stdout:7/50: chown d6/d12/c13 483750723 1 2024-04-18T10:42:38.998 INFO:tasks.workunit.client.0.smithi040.stdout:8/43: mknod d2/d5/ce 0 2024-04-18T10:42:38.999 INFO:tasks.workunit.client.0.smithi040.stdout:9/65: creat d2/d7/f1b x:0 0 0 2024-04-18T10:42:39.000 INFO:tasks.workunit.client.0.smithi040.stdout:9/66: chown d2/dc/f1a 5840737 1 2024-04-18T10:42:39.000 INFO:tasks.workunit.client.0.smithi040.stdout:7/51: creat d6/f14 x:0 0 0 2024-04-18T10:42:39.008 INFO:tasks.workunit.client.0.smithi040.stdout:9/67: link d2/d7/f14 d2/d3/f1c 0 2024-04-18T10:42:39.009 INFO:tasks.workunit.client.0.smithi040.stdout:7/52: dwrite d6/ff [0,4194304] 0 2024-04-18T10:42:39.009 INFO:tasks.workunit.client.0.smithi040.stdout:8/44: dwrite d2/f4 [0,4194304] 0 2024-04-18T10:42:39.009 INFO:tasks.workunit.client.0.smithi040.stdout:9/68: dread - d2/fb zero size 2024-04-18T10:42:39.010 INFO:tasks.workunit.client.0.smithi040.stdout:0/5: sync 2024-04-18T10:42:39.011 INFO:tasks.workunit.client.0.smithi040.stdout:0/6: stat l0 0 2024-04-18T10:42:39.013 INFO:tasks.workunit.client.0.smithi040.stdout:9/69: mkdir d2/dd/de/d1d 0 2024-04-18T10:42:39.014 INFO:tasks.workunit.client.0.smithi040.stdout:0/7: rename l0 to l1 0 2024-04-18T10:42:39.014 INFO:tasks.workunit.client.0.smithi040.stdout:0/8: dwrite - no filename 2024-04-18T10:42:39.014 INFO:tasks.workunit.client.0.smithi040.stdout:0/9: dwrite - no filename 2024-04-18T10:42:39.015 INFO:tasks.workunit.client.0.smithi040.stdout:0/10: dread - no filename 2024-04-18T10:42:39.015 INFO:tasks.workunit.client.0.smithi040.stdout:0/11: dread - no filename 2024-04-18T10:42:39.017 INFO:tasks.workunit.client.0.smithi040.stdout:9/70: mknod d2/dc/c1e 0 2024-04-18T10:42:39.018 INFO:tasks.workunit.client.0.smithi040.stdout:0/12: creat f2 x:0 0 0 2024-04-18T10:42:39.018 INFO:tasks.workunit.client.0.smithi040.stdout:9/71: chown d2/dc/c1e 0 1 2024-04-18T10:42:39.018 INFO:tasks.workunit.client.0.smithi040.stdout:8/45: dwrite d2/f4 [0,4194304] 0 2024-04-18T10:42:39.018 INFO:tasks.workunit.client.0.smithi040.stdout:0/13: write f2 [1014768,78905] 0 2024-04-18T10:42:39.019 INFO:tasks.workunit.client.0.smithi040.stdout:0/14: write f2 [596945,23800] 0 2024-04-18T10:42:39.020 INFO:tasks.workunit.client.0.smithi040.stdout:8/46: truncate d2/d5/d9/fb 5025499 0 2024-04-18T10:42:39.024 INFO:tasks.workunit.client.0.smithi040.stdout:9/72: dread d2/d7/f8 [0,4194304] 0 2024-04-18T10:42:39.025 INFO:tasks.workunit.client.0.smithi040.stdout:8/47: mknod d2/d5/d9/cf 0 2024-04-18T10:42:39.026 INFO:tasks.workunit.client.0.smithi040.stdout:9/73: mknod d2/d7/c1f 0 2024-04-18T10:42:39.029 INFO:tasks.workunit.client.0.smithi040.stdout:9/74: rename d2/dc/c1e to d2/dd/de/d1d/c20 0 2024-04-18T10:42:39.030 INFO:tasks.workunit.client.0.smithi040.stdout:9/75: dread d2/d7/f8 [0,4194304] 0 2024-04-18T10:42:39.032 INFO:tasks.workunit.client.0.smithi040.stdout:9/76: creat d2/d3/f21 x:0 0 0 2024-04-18T10:42:39.033 INFO:tasks.workunit.client.0.smithi040.stdout:9/77: write d2/d7/f15 [1257313,28543] 0 2024-04-18T10:42:39.033 INFO:tasks.workunit.client.0.smithi040.stdout:9/78: fdatasync d2/fb 0 2024-04-18T10:42:39.035 INFO:tasks.workunit.client.0.smithi040.stdout:9/79: mkdir d2/d3/d22 0 2024-04-18T10:42:39.042 INFO:tasks.workunit.client.0.smithi040.stdout:9/80: dwrite d2/f5 [0,4194304] 0 2024-04-18T10:42:39.044 INFO:tasks.workunit.client.0.smithi040.stdout:9/81: dread d2/d7/f8 [0,4194304] 0 2024-04-18T10:42:39.123 INFO:tasks.workunit.client.0.smithi040.stdout:0/15: readlink l1 0 2024-04-18T10:42:39.125 INFO:tasks.workunit.client.0.smithi040.stdout:0/16: read f2 [557065,11108] 0 2024-04-18T10:42:39.125 INFO:tasks.workunit.client.0.smithi040.stdout:9/82: symlink d2/d7/l23 0 2024-04-18T10:42:39.125 INFO:tasks.workunit.client.0.smithi040.stdout:0/17: fdatasync f2 0 2024-04-18T10:42:39.125 INFO:tasks.workunit.client.0.smithi040.stdout:9/83: readlink d2/d7/l23 0 2024-04-18T10:42:39.126 INFO:tasks.workunit.client.0.smithi040.stdout:0/18: symlink l3 0 2024-04-18T10:42:39.131 INFO:tasks.workunit.client.0.smithi040.stdout:9/84: dwrite d2/dc/f1a [0,4194304] 0 2024-04-18T10:42:39.132 INFO:tasks.workunit.client.0.smithi040.stdout:0/19: dread f2 [0,4194304] 0 2024-04-18T10:42:39.133 INFO:tasks.workunit.client.0.smithi040.stdout:0/20: truncate f2 1870507 0 2024-04-18T10:42:39.136 INFO:tasks.workunit.client.0.smithi040.stdout:0/21: dread f2 [0,4194304] 0 2024-04-18T10:42:39.136 INFO:tasks.workunit.client.0.smithi040.stdout:9/85: dread d2/dc/f1a [0,4194304] 0 2024-04-18T10:42:39.137 INFO:tasks.workunit.client.0.smithi040.stdout:0/22: write f2 [159952,96728] 0 2024-04-18T10:42:39.138 INFO:tasks.workunit.client.0.smithi040.stdout:9/86: creat d2/dd/f24 x:0 0 0 2024-04-18T10:42:39.141 INFO:tasks.workunit.client.0.smithi040.stdout:4/2: sync 2024-04-18T10:42:39.141 INFO:tasks.workunit.client.0.smithi040.stdout:2/2: sync 2024-04-18T10:42:39.142 INFO:tasks.workunit.client.0.smithi040.stdout:2/3: dread - no filename 2024-04-18T10:42:39.142 INFO:tasks.workunit.client.0.smithi040.stdout:4/3: write - no filename 2024-04-18T10:42:39.142 INFO:tasks.workunit.client.0.smithi040.stdout:2/4: link - no file 2024-04-18T10:42:39.142 INFO:tasks.workunit.client.0.smithi040.stdout:4/4: write - no filename 2024-04-18T10:42:39.142 INFO:tasks.workunit.client.0.smithi040.stdout:2/5: link - no file 2024-04-18T10:42:39.142 INFO:tasks.workunit.client.0.smithi040.stdout:4/5: dread - no filename 2024-04-18T10:42:39.142 INFO:tasks.workunit.client.0.smithi040.stdout:4/6: dwrite - no filename 2024-04-18T10:42:39.142 INFO:tasks.workunit.client.0.smithi040.stdout:9/87: dread d2/dc/f16 [0,4194304] 0 2024-04-18T10:42:39.143 INFO:tasks.workunit.client.0.smithi040.stdout:9/88: write d2/d3/f12 [564236,18591] 0 2024-04-18T10:42:39.143 INFO:tasks.workunit.client.0.smithi040.stdout:0/23: link l1 l4 0 2024-04-18T10:42:39.144 INFO:tasks.workunit.client.0.smithi040.stdout:2/6: mknod c0 0 2024-04-18T10:42:39.144 INFO:tasks.workunit.client.0.smithi040.stdout:0/24: write f2 [1541524,95317] 0 2024-04-18T10:42:39.145 INFO:tasks.workunit.client.0.smithi040.stdout:2/7: chown c0 6 1 2024-04-18T10:42:39.145 INFO:tasks.workunit.client.0.smithi040.stdout:2/8: truncate - no filename 2024-04-18T10:42:39.145 INFO:tasks.workunit.client.0.smithi040.stdout:2/9: dread - no filename 2024-04-18T10:42:39.145 INFO:tasks.workunit.client.0.smithi040.stdout:0/25: truncate f2 1948482 0 2024-04-18T10:42:39.145 INFO:tasks.workunit.client.0.smithi040.stdout:4/7: symlink l0 0 2024-04-18T10:42:39.146 INFO:tasks.workunit.client.0.smithi040.stdout:9/89: mkdir d2/dd/de/d25 0 2024-04-18T10:42:39.148 INFO:tasks.workunit.client.0.smithi040.stdout:4/8: mknod c1 0 2024-04-18T10:42:39.148 INFO:tasks.workunit.client.0.smithi040.stdout:4/9: write - no filename 2024-04-18T10:42:39.148 INFO:tasks.workunit.client.0.smithi040.stdout:4/10: fsync - no filename 2024-04-18T10:42:39.149 INFO:tasks.workunit.client.0.smithi040.stdout:4/11: chown c1 3 1 2024-04-18T10:42:39.149 INFO:tasks.workunit.client.0.smithi040.stdout:4/12: fdatasync - no filename 2024-04-18T10:42:39.149 INFO:tasks.workunit.client.0.smithi040.stdout:2/10: link c0 c1 0 2024-04-18T10:42:39.149 INFO:tasks.workunit.client.0.smithi040.stdout:2/11: fsync - no filename 2024-04-18T10:42:39.153 INFO:tasks.workunit.client.0.smithi040.stdout:0/26: dwrite f2 [0,4194304] 0 2024-04-18T10:42:39.154 INFO:tasks.workunit.client.0.smithi040.stdout:9/90: dread d2/d3/f10 [0,4194304] 0 2024-04-18T10:42:39.157 INFO:tasks.workunit.client.0.smithi040.stdout:0/27: dread f2 [0,4194304] 0 2024-04-18T10:42:39.159 INFO:tasks.workunit.client.0.smithi040.stdout:0/28: mknod c5 0 2024-04-18T10:42:39.161 INFO:tasks.workunit.client.0.smithi040.stdout:9/91: dwrite d2/dc/f1a [0,4194304] 0 2024-04-18T10:42:39.168 INFO:tasks.workunit.client.0.smithi040.stdout:0/29: dwrite f2 [0,4194304] 0 2024-04-18T10:42:39.170 INFO:tasks.workunit.client.0.smithi040.stdout:9/92: dwrite d2/fb [0,4194304] 0 2024-04-18T10:42:39.172 INFO:tasks.workunit.client.0.smithi040.stdout:0/30: rename l4 to l6 0 2024-04-18T10:42:39.173 INFO:tasks.workunit.client.0.smithi040.stdout:9/93: mkdir d2/d7/d26 0 2024-04-18T10:42:39.175 INFO:tasks.workunit.client.0.smithi040.stdout:0/31: unlink l3 0 2024-04-18T10:42:39.176 INFO:tasks.workunit.client.0.smithi040.stdout:9/94: creat d2/d3/f27 x:0 0 0 2024-04-18T10:42:39.180 INFO:tasks.workunit.client.0.smithi040.stdout:9/95: mknod d2/c28 0 2024-04-18T10:42:39.181 INFO:tasks.workunit.client.0.smithi040.stdout:9/96: creat d2/d7/f29 x:0 0 0 2024-04-18T10:42:39.183 INFO:tasks.workunit.client.0.smithi040.stdout:1/25: sync 2024-04-18T10:42:39.183 INFO:tasks.workunit.client.0.smithi040.stdout:5/3: sync 2024-04-18T10:42:39.184 INFO:tasks.workunit.client.0.smithi040.stdout:6/14: sync 2024-04-18T10:42:39.184 INFO:tasks.workunit.client.0.smithi040.stdout:9/97: rename d2/d3/f10 to d2/d7/f2a 0 2024-04-18T10:42:39.185 INFO:tasks.workunit.client.0.smithi040.stdout:6/15: chown c2 34461 1 2024-04-18T10:42:39.185 INFO:tasks.workunit.client.0.smithi040.stdout:6/16: readlink - no filename 2024-04-18T10:42:39.185 INFO:tasks.workunit.client.0.smithi040.stdout:9/98: truncate d2/d7/f29 94110 0 2024-04-18T10:42:39.186 INFO:tasks.workunit.client.0.smithi040.stdout:1/26: creat d1/f6 x:0 0 0 2024-04-18T10:42:39.186 INFO:tasks.workunit.client.0.smithi040.stdout:9/99: stat l1 0 2024-04-18T10:42:39.186 INFO:tasks.workunit.client.0.smithi040.stdout:1/27: fdatasync d1/f4 0 2024-04-18T10:42:39.186 INFO:tasks.workunit.client.0.smithi040.stdout:6/17: chown c3 133707699 1 2024-04-18T10:42:39.186 INFO:tasks.workunit.client.0.smithi040.stdout:9/100: write d2/dc/f1a [2492013,54310] 0 2024-04-18T10:42:39.187 INFO:tasks.workunit.client.0.smithi040.stdout:5/4: creat d0/f1 x:0 0 0 2024-04-18T10:42:39.187 INFO:tasks.workunit.client.0.smithi040.stdout:1/28: write d1/f6 [373014,38277] 0 2024-04-18T10:42:39.190 INFO:tasks.workunit.client.0.smithi040.stdout:6/18: creat f4 x:0 0 0 2024-04-18T10:42:39.191 INFO:tasks.workunit.client.0.smithi040.stdout:0/32: truncate f2 2041171 0 2024-04-18T10:42:39.192 INFO:tasks.workunit.client.0.smithi040.stdout:9/101: write d2/dc/f16 [473630,124363] 0 2024-04-18T10:42:39.193 INFO:tasks.workunit.client.0.smithi040.stdout:6/19: rename c1 to c5 0 2024-04-18T10:42:39.195 INFO:tasks.workunit.client.0.smithi040.stdout:6/20: dread - f4 zero size 2024-04-18T10:42:39.195 INFO:tasks.workunit.client.0.smithi040.stdout:9/102: creat d2/d3/f2b x:0 0 0 2024-04-18T10:42:39.196 INFO:tasks.workunit.client.0.smithi040.stdout:1/29: dwrite f0 [0,4194304] 0 2024-04-18T10:42:39.196 INFO:tasks.workunit.client.0.smithi040.stdout:5/5: dwrite d0/f1 [0,4194304] 0 2024-04-18T10:42:39.207 INFO:tasks.workunit.client.0.smithi040.stdout:9/103: readlink d2/dd/de/lf 0 2024-04-18T10:42:39.207 INFO:tasks.workunit.client.0.smithi040.stdout:5/6: chown d0/f1 4 1 2024-04-18T10:42:39.209 INFO:tasks.workunit.client.0.smithi040.stdout:1/30: symlink d1/l7 0 2024-04-18T10:42:39.210 INFO:tasks.workunit.client.0.smithi040.stdout:6/21: getdents . 0 2024-04-18T10:42:39.214 INFO:tasks.workunit.client.0.smithi040.stdout:6/22: symlink l6 0 2024-04-18T10:42:39.214 INFO:tasks.workunit.client.0.smithi040.stdout:9/104: dwrite d2/d7/f2a [0,4194304] 0 2024-04-18T10:42:39.214 INFO:tasks.workunit.client.0.smithi040.stdout:6/23: dread - f4 zero size 2024-04-18T10:42:39.215 INFO:tasks.workunit.client.0.smithi040.stdout:1/31: dread f0 [0,4194304] 0 2024-04-18T10:42:39.217 INFO:tasks.workunit.client.0.smithi040.stdout:3/56: sync 2024-04-18T10:42:39.217 INFO:tasks.workunit.client.0.smithi040.stdout:7/53: sync 2024-04-18T10:42:39.217 INFO:tasks.workunit.client.0.smithi040.stdout:5/7: link d0/f1 d0/f2 0 2024-04-18T10:42:39.222 INFO:tasks.workunit.client.0.smithi040.stdout:9/105: rmdir d2/dc 39 2024-04-18T10:42:39.224 INFO:tasks.workunit.client.0.smithi040.stdout:9/106: write d2/d7/fa [178927,33479] 0 2024-04-18T10:42:39.224 INFO:tasks.workunit.client.0.smithi040.stdout:1/32: mknod d1/c8 0 2024-04-18T10:42:39.224 INFO:tasks.workunit.client.0.smithi040.stdout:9/107: chown d2/d3/d22 4 1 2024-04-18T10:42:39.224 INFO:tasks.workunit.client.0.smithi040.stdout:1/33: chown d1/l3 124557783 1 2024-04-18T10:42:39.224 INFO:tasks.workunit.client.0.smithi040.stdout:3/57: symlink d1/lf 0 2024-04-18T10:42:39.224 INFO:tasks.workunit.client.0.smithi040.stdout:7/54: symlink d6/d12/l15 0 2024-04-18T10:42:39.225 INFO:tasks.workunit.client.0.smithi040.stdout:5/8: mkdir d0/d3 0 2024-04-18T10:42:39.225 INFO:tasks.workunit.client.0.smithi040.stdout:3/58: dread d1/f6 [0,4194304] 0 2024-04-18T10:42:39.227 INFO:tasks.workunit.client.0.smithi040.stdout:7/55: symlink d6/l16 0 2024-04-18T10:42:39.227 INFO:tasks.workunit.client.0.smithi040.stdout:9/108: dwrite d2/d3/f12 [0,4194304] 0 2024-04-18T10:42:39.229 INFO:tasks.workunit.client.0.smithi040.stdout:7/56: symlink d6/l17 0 2024-04-18T10:42:39.230 INFO:tasks.workunit.client.0.smithi040.stdout:9/109: rmdir d2/d7 39 2024-04-18T10:42:39.231 INFO:tasks.workunit.client.0.smithi040.stdout:5/9: dread d0/f2 [0,4194304] 0 2024-04-18T10:42:39.239 INFO:tasks.workunit.client.0.smithi040.stdout:7/57: unlink d6/fc 0 2024-04-18T10:42:39.240 INFO:tasks.workunit.client.0.smithi040.stdout:1/34: dwrite f0 [0,4194304] 0 2024-04-18T10:42:39.243 INFO:tasks.workunit.client.0.smithi040.stdout:1/35: creat d1/f9 x:0 0 0 2024-04-18T10:42:39.244 INFO:tasks.workunit.client.0.smithi040.stdout:1/36: fsync d1/f6 0 2024-04-18T10:42:39.245 INFO:tasks.workunit.client.0.smithi040.stdout:1/37: write f0 [3281903,125281] 0 2024-04-18T10:42:39.247 INFO:tasks.workunit.client.0.smithi040.stdout:7/58: dwrite d6/fa [0,4194304] 0 2024-04-18T10:42:39.249 INFO:tasks.workunit.client.0.smithi040.stdout:1/38: rename f0 to d1/fa 0 2024-04-18T10:42:39.250 INFO:tasks.workunit.client.0.smithi040.stdout:7/59: creat d6/f18 x:0 0 0 2024-04-18T10:42:39.251 INFO:tasks.workunit.client.0.smithi040.stdout:6/24: getdents . 0 2024-04-18T10:42:39.255 INFO:tasks.workunit.client.0.smithi040.stdout:7/60: rename d6/f10 to d6/d12/f19 0 2024-04-18T10:42:39.255 INFO:tasks.workunit.client.0.smithi040.stdout:5/10: fsync d0/f2 0 2024-04-18T10:42:39.256 INFO:tasks.workunit.client.0.smithi040.stdout:6/25: chown c3 46808262 1 2024-04-18T10:42:39.258 INFO:tasks.workunit.client.0.smithi040.stdout:2/12: sync 2024-04-18T10:42:39.259 INFO:tasks.workunit.client.0.smithi040.stdout:8/48: sync 2024-04-18T10:42:39.259 INFO:tasks.workunit.client.0.smithi040.stdout:4/13: sync 2024-04-18T10:42:39.259 INFO:tasks.workunit.client.0.smithi040.stdout:2/13: readlink - no filename 2024-04-18T10:42:39.259 INFO:tasks.workunit.client.0.smithi040.stdout:4/14: readlink l0 0 2024-04-18T10:42:39.259 INFO:tasks.workunit.client.0.smithi040.stdout:4/15: truncate - no filename 2024-04-18T10:42:39.260 INFO:tasks.workunit.client.0.smithi040.stdout:5/11: symlink d0/l4 0 2024-04-18T10:42:39.261 INFO:tasks.workunit.client.0.smithi040.stdout:6/26: creat f7 x:0 0 0 2024-04-18T10:42:39.261 INFO:tasks.workunit.client.0.smithi040.stdout:6/27: truncate f0 229146 0 2024-04-18T10:42:39.261 INFO:tasks.workunit.client.0.smithi040.stdout:6/28: dread - f4 zero size 2024-04-18T10:42:39.262 INFO:tasks.workunit.client.0.smithi040.stdout:2/14: creat f2 x:0 0 0 2024-04-18T10:42:39.263 INFO:tasks.workunit.client.0.smithi040.stdout:8/49: mkdir d2/d10 0 2024-04-18T10:42:39.263 INFO:tasks.workunit.client.0.smithi040.stdout:6/29: dread f0 [0,4194304] 0 2024-04-18T10:42:39.263 INFO:tasks.workunit.client.0.smithi040.stdout:8/50: chown d2/d10 5 1 2024-04-18T10:42:39.265 INFO:tasks.workunit.client.0.smithi040.stdout:6/30: read - f7 zero size 2024-04-18T10:42:39.267 INFO:tasks.workunit.client.0.smithi040.stdout:6/31: write f7 [753149,86994] 0 2024-04-18T10:42:39.268 INFO:tasks.workunit.client.0.smithi040.stdout:5/12: truncate d0/f1 1536083 0 2024-04-18T10:42:39.270 INFO:tasks.workunit.client.0.smithi040.stdout:8/51: rename d2/d5/d9/fa to d2/f11 0 2024-04-18T10:42:39.270 INFO:tasks.workunit.client.0.smithi040.stdout:6/32: write f7 [195342,24035] 0 2024-04-18T10:42:39.272 INFO:tasks.workunit.client.0.smithi040.stdout:1/39: getdents d1 0 2024-04-18T10:42:39.273 INFO:tasks.workunit.client.0.smithi040.stdout:2/15: dwrite f2 [0,4194304] 0 2024-04-18T10:42:39.274 INFO:tasks.workunit.client.0.smithi040.stdout:1/40: readlink d1/l3 0 2024-04-18T10:42:39.275 INFO:tasks.workunit.client.0.smithi040.stdout:9/110: dwrite d2/d7/f14 [0,4194304] 0 2024-04-18T10:42:39.276 INFO:tasks.workunit.client.0.smithi040.stdout:1/41: dread - d1/f4 zero size 2024-04-18T10:42:39.276 INFO:tasks.workunit.client.0.smithi040.stdout:2/16: write f2 [305809,37004] 0 2024-04-18T10:42:39.276 INFO:tasks.workunit.client.0.smithi040.stdout:6/33: rename c2 to c8 0 2024-04-18T10:42:39.278 INFO:tasks.workunit.client.0.smithi040.stdout:9/111: write d2/dd/f24 [125943,108979] 0 2024-04-18T10:42:39.278 INFO:tasks.workunit.client.0.smithi040.stdout:1/42: chown d1/l3 123205632 1 2024-04-18T10:42:39.279 INFO:tasks.workunit.client.0.smithi040.stdout:6/34: creat f9 x:0 0 0 2024-04-18T10:42:39.284 INFO:tasks.workunit.client.0.smithi040.stdout:7/61: dwrite f0 [0,4194304] 0 2024-04-18T10:42:39.285 INFO:tasks.workunit.client.0.smithi040.stdout:1/43: dread d1/fa [0,4194304] 0 2024-04-18T10:42:39.288 INFO:tasks.workunit.client.0.smithi040.stdout:6/35: rename f9 to fa 0 2024-04-18T10:42:39.288 INFO:tasks.workunit.client.0.smithi040.stdout:6/36: dread - fa zero size 2024-04-18T10:42:39.289 INFO:tasks.workunit.client.0.smithi040.stdout:9/112: creat d2/d7/f2c x:0 0 0 2024-04-18T10:42:39.289 INFO:tasks.workunit.client.0.smithi040.stdout:6/37: chown f7 1911824 1 2024-04-18T10:42:39.289 INFO:tasks.workunit.client.0.smithi040.stdout:9/113: readlink d2/dd/de/lf 0 2024-04-18T10:42:39.292 INFO:tasks.workunit.client.0.smithi040.stdout:7/62: mknod d6/d12/c1a 0 2024-04-18T10:42:39.292 INFO:tasks.workunit.client.0.smithi040.stdout:0/33: sync 2024-04-18T10:42:39.293 INFO:tasks.workunit.client.0.smithi040.stdout:7/63: chown d6/ld 7320104 1 2024-04-18T10:42:39.293 INFO:tasks.workunit.client.0.smithi040.stdout:6/38: mknod cb 0 2024-04-18T10:42:39.294 INFO:tasks.workunit.client.0.smithi040.stdout:7/64: fdatasync d6/f18 0 2024-04-18T10:42:39.296 INFO:tasks.workunit.client.0.smithi040.stdout:8/52: truncate d2/f11 187072 0 2024-04-18T10:42:39.297 INFO:tasks.workunit.client.0.smithi040.stdout:6/39: mknod cc 0 2024-04-18T10:42:39.297 INFO:tasks.workunit.client.0.smithi040.stdout:9/114: dwrite d2/f19 [0,4194304] 0 2024-04-18T10:42:39.298 INFO:tasks.workunit.client.0.smithi040.stdout:8/53: fdatasync d2/f4 0 2024-04-18T10:42:39.298 INFO:tasks.workunit.client.0.smithi040.stdout:0/34: rename l6 to l7 0 2024-04-18T10:42:39.299 INFO:tasks.workunit.client.0.smithi040.stdout:6/40: creat fd x:0 0 0 2024-04-18T10:42:39.300 INFO:tasks.workunit.client.0.smithi040.stdout:0/35: symlink l8 0 2024-04-18T10:42:39.301 INFO:tasks.workunit.client.0.smithi040.stdout:9/115: symlink d2/dd/de/l2d 0 2024-04-18T10:42:39.302 INFO:tasks.workunit.client.0.smithi040.stdout:6/41: mknod ce 0 2024-04-18T10:42:39.304 INFO:tasks.workunit.client.0.smithi040.stdout:7/65: dwrite d6/fa [0,4194304] 0 2024-04-18T10:42:39.305 INFO:tasks.workunit.client.0.smithi040.stdout:9/116: mkdir d2/d3/d22/d2e 0 2024-04-18T10:42:39.305 INFO:tasks.workunit.client.0.smithi040.stdout:0/36: dread f2 [0,4194304] 0 2024-04-18T10:42:39.309 INFO:tasks.workunit.client.0.smithi040.stdout:0/37: creat f9 x:0 0 0 2024-04-18T10:42:39.310 INFO:tasks.workunit.client.0.smithi040.stdout:9/117: symlink d2/d7/d26/l2f 0 2024-04-18T10:42:39.312 INFO:tasks.workunit.client.0.smithi040.stdout:7/66: dwrite d6/fa [4194304,4194304] 0 2024-04-18T10:42:39.312 INFO:tasks.workunit.client.0.smithi040.stdout:0/38: unlink l8 0 2024-04-18T10:42:39.312 INFO:tasks.workunit.client.0.smithi040.stdout:9/118: read d2/d7/f15 [1273915,91468] 0 2024-04-18T10:42:39.315 INFO:tasks.workunit.client.0.smithi040.stdout:7/67: mknod d6/d12/c1b 0 2024-04-18T10:42:39.317 INFO:tasks.workunit.client.0.smithi040.stdout:9/119: write d2/d7/f15 [2265781,56501] 0 2024-04-18T10:42:39.319 INFO:tasks.workunit.client.0.smithi040.stdout:2/17: truncate f2 2559736 0 2024-04-18T10:42:39.323 INFO:tasks.workunit.client.0.smithi040.stdout:7/68: dwrite d6/fa [4194304,4194304] 0 2024-04-18T10:42:39.326 INFO:tasks.workunit.client.0.smithi040.stdout:5/13: dwrite d0/f2 [0,4194304] 0 2024-04-18T10:42:39.327 INFO:tasks.workunit.client.0.smithi040.stdout:3/59: sync 2024-04-18T10:42:39.327 INFO:tasks.workunit.client.0.smithi040.stdout:4/16: sync 2024-04-18T10:42:39.327 INFO:tasks.workunit.client.0.smithi040.stdout:4/17: dread - no filename 2024-04-18T10:42:39.327 INFO:tasks.workunit.client.0.smithi040.stdout:4/18: truncate - no filename 2024-04-18T10:42:39.329 INFO:tasks.workunit.client.0.smithi040.stdout:4/19: mkdir d2 0 2024-04-18T10:42:39.331 INFO:tasks.workunit.client.0.smithi040.stdout:5/14: creat d0/d3/f5 x:0 0 0 2024-04-18T10:42:39.333 INFO:tasks.workunit.client.0.smithi040.stdout:7/69: dwrite d6/d12/f19 [0,4194304] 0 2024-04-18T10:42:39.334 INFO:tasks.workunit.client.0.smithi040.stdout:4/20: mkdir d2/d3 0 2024-04-18T10:42:39.335 INFO:tasks.workunit.client.0.smithi040.stdout:3/60: dread d1/d7/fa [0,4194304] 0 2024-04-18T10:42:39.335 INFO:tasks.workunit.client.0.smithi040.stdout:5/15: mknod d0/c6 0 2024-04-18T10:42:39.338 INFO:tasks.workunit.client.0.smithi040.stdout:4/21: mkdir d2/d3/d4 0 2024-04-18T10:42:39.340 INFO:tasks.workunit.client.0.smithi040.stdout:8/54: truncate d2/f11 1170874 0 2024-04-18T10:42:39.341 INFO:tasks.workunit.client.0.smithi040.stdout:5/16: creat d0/d3/f7 x:0 0 0 2024-04-18T10:42:39.342 INFO:tasks.workunit.client.0.smithi040.stdout:3/61: rename d1/c3 to d1/c10 0 2024-04-18T10:42:39.343 INFO:tasks.workunit.client.0.smithi040.stdout:7/70: dwrite d6/f18 [0,4194304] 0 2024-04-18T10:42:39.345 INFO:tasks.workunit.client.0.smithi040.stdout:0/39: readlink l7 0 2024-04-18T10:42:39.345 INFO:tasks.workunit.client.0.smithi040.stdout:3/62: dread d1/f6 [0,4194304] 0 2024-04-18T10:42:39.348 INFO:tasks.workunit.client.0.smithi040.stdout:5/17: symlink d0/d3/l8 0 2024-04-18T10:42:39.353 INFO:tasks.workunit.client.0.smithi040.stdout:6/42: getdents . 0 2024-04-18T10:42:39.354 INFO:tasks.workunit.client.0.smithi040.stdout:3/63: rmdir d1/d2 39 2024-04-18T10:42:39.354 INFO:tasks.workunit.client.0.smithi040.stdout:5/18: dwrite d0/f1 [0,4194304] 0 2024-04-18T10:42:39.354 INFO:tasks.workunit.client.0.smithi040.stdout:6/43: truncate f0 1002543 0 2024-04-18T10:42:39.356 INFO:tasks.workunit.client.0.smithi040.stdout:5/19: write d0/f1 [1603000,111786] 0 2024-04-18T10:42:39.356 INFO:tasks.workunit.client.0.smithi040.stdout:5/20: chown d0/f1 23 1 2024-04-18T10:42:39.358 INFO:tasks.workunit.client.0.smithi040.stdout:5/21: write d0/d3/f7 [74420,3004] 0 2024-04-18T10:42:39.362 INFO:tasks.workunit.client.0.smithi040.stdout:5/22: truncate d0/d3/f5 856476 0 2024-04-18T10:42:39.364 INFO:tasks.workunit.client.0.smithi040.stdout:7/71: getdents d6 0 2024-04-18T10:42:39.364 INFO:tasks.workunit.client.0.smithi040.stdout:6/44: dwrite f4 [0,4194304] 0 2024-04-18T10:42:39.365 INFO:tasks.workunit.client.0.smithi040.stdout:5/23: mknod d0/c9 0 2024-04-18T10:42:39.366 INFO:tasks.workunit.client.0.smithi040.stdout:2/18: read f2 [1108464,97989] 0 2024-04-18T10:42:39.366 INFO:tasks.workunit.client.0.smithi040.stdout:2/19: rmdir - no directory 2024-04-18T10:42:39.367 INFO:tasks.workunit.client.0.smithi040.stdout:9/120: truncate d2/dd/f24 222496 0 2024-04-18T10:42:39.367 INFO:tasks.workunit.client.0.smithi040.stdout:6/45: mkdir df 0 2024-04-18T10:42:39.368 INFO:tasks.workunit.client.0.smithi040.stdout:5/24: write d0/f1 [1809931,23962] 0 2024-04-18T10:42:39.369 INFO:tasks.workunit.client.0.smithi040.stdout:7/72: mknod d6/d12/c1c 0 2024-04-18T10:42:39.369 INFO:tasks.workunit.client.0.smithi040.stdout:6/46: dread - fd zero size 2024-04-18T10:42:39.369 INFO:tasks.workunit.client.0.smithi040.stdout:3/64: dwrite d1/f6 [0,4194304] 0 2024-04-18T10:42:39.370 INFO:tasks.workunit.client.0.smithi040.stdout:5/25: chown d0/c6 189 1 2024-04-18T10:42:39.370 INFO:tasks.workunit.client.0.smithi040.stdout:6/47: chown fd 314097 1 2024-04-18T10:42:39.371 INFO:tasks.workunit.client.0.smithi040.stdout:2/20: mknod c3 0 2024-04-18T10:42:39.371 INFO:tasks.workunit.client.0.smithi040.stdout:9/121: mknod d2/d3/c30 0 2024-04-18T10:42:39.374 INFO:tasks.workunit.client.0.smithi040.stdout:7/73: dread d6/fa [4194304,4194304] 0 2024-04-18T10:42:39.374 INFO:tasks.workunit.client.0.smithi040.stdout:6/48: write fa [178516,43680] 0 2024-04-18T10:42:39.376 INFO:tasks.workunit.client.0.smithi040.stdout:9/122: mknod d2/d7/d26/c31 0 2024-04-18T10:42:39.377 INFO:tasks.workunit.client.0.smithi040.stdout:5/26: dread d0/d3/f7 [0,4194304] 0 2024-04-18T10:42:39.380 INFO:tasks.workunit.client.0.smithi040.stdout:2/21: dwrite f2 [0,4194304] 0 2024-04-18T10:42:39.382 INFO:tasks.workunit.client.0.smithi040.stdout:6/49: mkdir df/d10 0 2024-04-18T10:42:39.382 INFO:tasks.workunit.client.0.smithi040.stdout:3/65: link d1/lf d1/l11 0 2024-04-18T10:42:39.383 INFO:tasks.workunit.client.0.smithi040.stdout:3/66: write d1/f6 [4680709,71764] 0 2024-04-18T10:42:39.383 INFO:tasks.workunit.client.0.smithi040.stdout:9/123: mkdir d2/d3/d22/d2e/d32 0 2024-04-18T10:42:39.384 INFO:tasks.workunit.client.0.smithi040.stdout:3/67: chown d1/d7/fa 21216 1 2024-04-18T10:42:39.384 INFO:tasks.workunit.client.0.smithi040.stdout:9/124: write d2/d7/fa [341866,23473] 0 2024-04-18T10:42:39.386 INFO:tasks.workunit.client.0.smithi040.stdout:6/50: symlink df/l11 0 2024-04-18T10:42:39.392 INFO:tasks.workunit.client.0.smithi040.stdout:1/44: sync 2024-04-18T10:42:39.405 INFO:tasks.workunit.client.0.smithi040.stdout:7/74: fsync d6/f18 0 2024-04-18T10:42:39.405 INFO:tasks.workunit.client.0.smithi040.stdout:3/68: mkdir d1/d7/d12 0 2024-04-18T10:42:39.406 INFO:tasks.workunit.client.0.smithi040.stdout:4/22: getdents d2/d3 0 2024-04-18T10:42:39.407 INFO:tasks.workunit.client.0.smithi040.stdout:8/55: read d2/f11 [333012,86904] 0 2024-04-18T10:42:39.409 INFO:tasks.workunit.client.0.smithi040.stdout:0/40: sync 2024-04-18T10:42:39.410 INFO:tasks.workunit.client.0.smithi040.stdout:0/41: chown l1 3502 1 2024-04-18T10:42:39.411 INFO:tasks.workunit.client.0.smithi040.stdout:0/42: chown l7 3648 1 2024-04-18T10:42:39.412 INFO:tasks.workunit.client.0.smithi040.stdout:6/51: dwrite f0 [0,4194304] 0 2024-04-18T10:42:39.416 INFO:tasks.workunit.client.0.smithi040.stdout:5/27: truncate d0/f1 1569146 0 2024-04-18T10:42:39.421 INFO:tasks.workunit.client.0.smithi040.stdout:2/22: truncate f2 3603229 0 2024-04-18T10:42:39.493 INFO:tasks.workunit.client.0.smithi040.stdout:0/43: sync 2024-04-18T10:42:39.575 INFO:tasks.workunit.client.0.smithi040.stdout:1/45: mknod d1/cb 0 2024-04-18T10:42:39.577 INFO:tasks.workunit.client.0.smithi040.stdout:5/28: symlink d0/d3/la 0 2024-04-18T10:42:39.579 INFO:tasks.workunit.client.0.smithi040.stdout:9/125: write d2/dd/f24 [347559,111991] 0 2024-04-18T10:42:39.579 INFO:tasks.workunit.client.0.smithi040.stdout:3/69: symlink d1/d2/l13 0 2024-04-18T10:42:39.580 INFO:tasks.workunit.client.0.smithi040.stdout:1/46: rmdir d1 39 2024-04-18T10:42:39.581 INFO:tasks.workunit.client.0.smithi040.stdout:9/126: truncate d2/d3/f21 160377 0 2024-04-18T10:42:39.583 INFO:tasks.workunit.client.0.smithi040.stdout:8/56: creat d2/d10/f12 x:0 0 0 2024-04-18T10:42:39.585 INFO:tasks.workunit.client.0.smithi040.stdout:8/57: readlink d2/d5/l7 0 2024-04-18T10:42:39.585 INFO:tasks.workunit.client.0.smithi040.stdout:5/29: creat d0/d3/fb x:0 0 0 2024-04-18T10:42:39.585 INFO:tasks.workunit.client.0.smithi040.stdout:9/127: dread d2/d3/f21 [0,4194304] 0 2024-04-18T10:42:39.585 INFO:tasks.workunit.client.0.smithi040.stdout:7/75: link d6/l17 d6/d12/l1d 0 2024-04-18T10:42:39.585 INFO:tasks.workunit.client.0.smithi040.stdout:3/70: mknod d1/d7/c14 0 2024-04-18T10:42:39.586 INFO:tasks.workunit.client.0.smithi040.stdout:4/23: link l0 d2/l5 0 2024-04-18T10:42:39.587 INFO:tasks.workunit.client.0.smithi040.stdout:4/24: write - no filename 2024-04-18T10:42:39.587 INFO:tasks.workunit.client.0.smithi040.stdout:4/25: dwrite - no filename 2024-04-18T10:42:39.587 INFO:tasks.workunit.client.0.smithi040.stdout:4/26: dwrite - no filename 2024-04-18T10:42:39.587 INFO:tasks.workunit.client.0.smithi040.stdout:0/44: dwrite f2 [0,4194304] 0 2024-04-18T10:42:39.588 INFO:tasks.workunit.client.0.smithi040.stdout:7/76: chown d6/l16 1 1 2024-04-18T10:42:39.589 INFO:tasks.workunit.client.0.smithi040.stdout:6/52: rmdir df/d10 0 2024-04-18T10:42:39.589 INFO:tasks.workunit.client.0.smithi040.stdout:0/45: chown l7 988364 1 2024-04-18T10:42:39.590 INFO:tasks.workunit.client.0.smithi040.stdout:7/77: write d6/f14 [869813,5105] 0 2024-04-18T10:42:39.590 INFO:tasks.workunit.client.0.smithi040.stdout:8/58: symlink d2/l13 0 2024-04-18T10:42:39.591 INFO:tasks.workunit.client.0.smithi040.stdout:0/46: write f2 [3910063,79655] 0 2024-04-18T10:42:39.592 INFO:tasks.workunit.client.0.smithi040.stdout:5/30: mknod d0/d3/cc 0 2024-04-18T10:42:39.593 INFO:tasks.workunit.client.0.smithi040.stdout:0/47: write f2 [2748205,32492] 0 2024-04-18T10:42:39.594 INFO:tasks.workunit.client.0.smithi040.stdout:3/71: write d1/d7/fa [2630190,41911] 0 2024-04-18T10:42:39.596 INFO:tasks.workunit.client.0.smithi040.stdout:9/128: dwrite d2/f19 [0,4194304] 0 2024-04-18T10:42:39.596 INFO:tasks.workunit.client.0.smithi040.stdout:7/78: dread d6/f14 [0,4194304] 0 2024-04-18T10:42:39.597 INFO:tasks.workunit.client.0.smithi040.stdout:1/47: rename d1/c5 to d1/cc 0 2024-04-18T10:42:39.601 INFO:tasks.workunit.client.0.smithi040.stdout:6/53: creat df/f12 x:0 0 0 2024-04-18T10:42:39.603 INFO:tasks.workunit.client.0.smithi040.stdout:8/59: write d2/f11 [1092015,49804] 0 2024-04-18T10:42:39.605 INFO:tasks.workunit.client.0.smithi040.stdout:5/31: mknod d0/cd 0 2024-04-18T10:42:39.606 INFO:tasks.workunit.client.0.smithi040.stdout:2/23: write f2 [2703579,107301] 0 2024-04-18T10:42:39.607 INFO:tasks.workunit.client.0.smithi040.stdout:0/48: creat fa x:0 0 0 2024-04-18T10:42:39.607 INFO:tasks.workunit.client.0.smithi040.stdout:5/32: dread d0/d3/f7 [0,4194304] 0 2024-04-18T10:42:39.608 INFO:tasks.workunit.client.0.smithi040.stdout:0/49: write f9 [833937,110080] 0 2024-04-18T10:42:39.608 INFO:tasks.workunit.client.0.smithi040.stdout:3/72: unlink c0 0 2024-04-18T10:42:39.609 INFO:tasks.workunit.client.0.smithi040.stdout:0/50: truncate fa 756877 0 2024-04-18T10:42:39.610 INFO:tasks.workunit.client.0.smithi040.stdout:4/27: rename l0 to d2/l6 0 2024-04-18T10:42:39.611 INFO:tasks.workunit.client.0.smithi040.stdout:7/79: mknod d6/c1e 0 2024-04-18T10:42:39.612 INFO:tasks.workunit.client.0.smithi040.stdout:1/48: mknod d1/cd 0 2024-04-18T10:42:39.613 INFO:tasks.workunit.client.0.smithi040.stdout:9/129: mkdir d2/d3/d22/d2e/d33 0 2024-04-18T10:42:39.615 INFO:tasks.workunit.client.0.smithi040.stdout:6/54: creat df/f13 x:0 0 0 2024-04-18T10:42:39.615 INFO:tasks.workunit.client.0.smithi040.stdout:5/33: dwrite d0/d3/fb [0,4194304] 0 2024-04-18T10:42:39.616 INFO:tasks.workunit.client.0.smithi040.stdout:8/60: mkdir d2/d10/d14 0 2024-04-18T10:42:39.618 INFO:tasks.workunit.client.0.smithi040.stdout:3/73: creat d1/d7/f15 x:0 0 0 2024-04-18T10:42:39.619 INFO:tasks.workunit.client.0.smithi040.stdout:0/51: rename c5 to cb 0 2024-04-18T10:42:39.621 INFO:tasks.workunit.client.0.smithi040.stdout:7/80: dread f0 [0,4194304] 0 2024-04-18T10:42:39.622 INFO:tasks.workunit.client.0.smithi040.stdout:5/34: dread d0/f2 [0,4194304] 0 2024-04-18T10:42:39.625 INFO:tasks.workunit.client.0.smithi040.stdout:1/49: dwrite d1/f9 [0,4194304] 0 2024-04-18T10:42:39.625 INFO:tasks.workunit.client.0.smithi040.stdout:8/61: mkdir d2/d15 0 2024-04-18T10:42:39.629 INFO:tasks.workunit.client.0.smithi040.stdout:6/55: rename c8 to df/c14 0 2024-04-18T10:42:39.630 INFO:tasks.workunit.client.0.smithi040.stdout:0/52: rename l7 to lc 0 2024-04-18T10:42:39.630 INFO:tasks.workunit.client.0.smithi040.stdout:3/74: dwrite d1/d7/f15 [0,4194304] 0 2024-04-18T10:42:39.635 INFO:tasks.workunit.client.0.smithi040.stdout:1/50: creat d1/fe x:0 0 0 2024-04-18T10:42:39.636 INFO:tasks.workunit.client.0.smithi040.stdout:3/75: dread d1/f6 [0,4194304] 0 2024-04-18T10:42:39.637 INFO:tasks.workunit.client.0.smithi040.stdout:1/51: chown d1/c2 1843850924 1 2024-04-18T10:42:39.637 INFO:tasks.workunit.client.0.smithi040.stdout:7/81: dwrite f0 [0,4194304] 0 2024-04-18T10:42:39.642 INFO:tasks.workunit.client.0.smithi040.stdout:9/130: rename d2/dd/de/d1d/c20 to d2/d3/d22/c34 0 2024-04-18T10:42:39.643 INFO:tasks.workunit.client.0.smithi040.stdout:8/62: creat d2/d10/d14/f16 x:0 0 0 2024-04-18T10:42:39.644 INFO:tasks.workunit.client.0.smithi040.stdout:8/63: write d2/d10/f12 [253395,104586] 0 2024-04-18T10:42:39.645 INFO:tasks.workunit.client.0.smithi040.stdout:3/76: rename d1/d2/dd to d1/d2/d16 0 2024-04-18T10:42:39.646 INFO:tasks.workunit.client.0.smithi040.stdout:7/82: fdatasync d6/f14 0 2024-04-18T10:42:39.647 INFO:tasks.workunit.client.0.smithi040.stdout:7/83: write d6/ff [1194922,74768] 0 2024-04-18T10:42:39.647 INFO:tasks.workunit.client.0.smithi040.stdout:1/52: mknod d1/cf 0 2024-04-18T10:42:39.651 INFO:tasks.workunit.client.0.smithi040.stdout:9/131: unlink d2/d7/c11 0 2024-04-18T10:42:39.653 INFO:tasks.workunit.client.0.smithi040.stdout:3/77: readlink d1/l11 0 2024-04-18T10:42:39.654 INFO:tasks.workunit.client.0.smithi040.stdout:1/53: dwrite d1/fe [0,4194304] 0 2024-04-18T10:42:39.661 INFO:tasks.workunit.client.0.smithi040.stdout:3/78: creat d1/d2/f17 x:0 0 0 2024-04-18T10:42:39.711 INFO:tasks.workunit.client.0.smithi040.stdout:9/132: sync 2024-04-18T10:42:39.717 INFO:tasks.workunit.client.0.smithi040.stdout:9/133: dwrite d2/d7/f29 [0,4194304] 0 2024-04-18T10:42:39.719 INFO:tasks.workunit.client.0.smithi040.stdout:9/134: rmdir d2/dd/de 39 2024-04-18T10:42:39.722 INFO:tasks.workunit.client.0.smithi040.stdout:9/135: rename d2/d7/d26 to d2/d3/d22/d2e/d35 0 2024-04-18T10:42:39.725 INFO:tasks.workunit.client.0.smithi040.stdout:9/136: dread d2/d3/f12 [0,4194304] 0 2024-04-18T10:42:39.727 INFO:tasks.workunit.client.0.smithi040.stdout:9/137: symlink d2/d7/l36 0 2024-04-18T10:42:39.728 INFO:tasks.workunit.client.0.smithi040.stdout:9/138: write d2/f19 [4659270,32396] 0 2024-04-18T10:42:39.728 INFO:tasks.workunit.client.0.smithi040.stdout:9/139: readlink d2/l4 0 2024-04-18T10:42:39.729 INFO:tasks.workunit.client.0.smithi040.stdout:9/140: read d2/d7/f29 [3979756,100946] 0 2024-04-18T10:42:39.729 INFO:tasks.workunit.client.0.smithi040.stdout:9/141: stat d2/d7/f14 0 2024-04-18T10:42:39.732 INFO:tasks.workunit.client.0.smithi040.stdout:9/142: mknod d2/dd/c37 0 2024-04-18T10:42:39.739 INFO:tasks.workunit.client.0.smithi040.stdout:9/143: dwrite d2/d3/f21 [0,4194304] 0 2024-04-18T10:42:39.741 INFO:tasks.workunit.client.0.smithi040.stdout:9/144: chown d2/dd/de/d1d 14 1 2024-04-18T10:42:39.745 INFO:tasks.workunit.client.0.smithi040.stdout:9/145: dread d2/f5 [0,4194304] 0 2024-04-18T10:42:39.747 INFO:tasks.workunit.client.0.smithi040.stdout:9/146: mknod d2/d3/d22/d2e/d33/c38 0 2024-04-18T10:42:39.751 INFO:tasks.workunit.client.0.smithi040.stdout:9/147: rename d2/d3/f27 to d2/f39 0 2024-04-18T10:42:39.762 INFO:tasks.workunit.client.0.smithi040.stdout:5/35: rmdir d0 39 2024-04-18T10:42:39.764 INFO:tasks.workunit.client.0.smithi040.stdout:5/36: dread d0/d3/f7 [0,4194304] 0 2024-04-18T10:42:39.765 INFO:tasks.workunit.client.0.smithi040.stdout:5/37: symlink d0/le 0 2024-04-18T10:42:39.765 INFO:tasks.workunit.client.0.smithi040.stdout:5/38: readlink d0/le 0 2024-04-18T10:42:39.768 INFO:tasks.workunit.client.0.smithi040.stdout:5/39: mknod d0/d3/cf 0 2024-04-18T10:42:39.768 INFO:tasks.workunit.client.0.smithi040.stdout:5/40: readlink d0/le 0 2024-04-18T10:42:39.768 INFO:tasks.workunit.client.0.smithi040.stdout:4/28: link d2/l6 d2/l7 0 2024-04-18T10:42:39.768 INFO:tasks.workunit.client.0.smithi040.stdout:4/29: dwrite - no filename 2024-04-18T10:42:39.769 INFO:tasks.workunit.client.0.smithi040.stdout:5/41: read d0/f2 [1184619,44000] 0 2024-04-18T10:42:39.769 INFO:tasks.workunit.client.0.smithi040.stdout:3/79: fsync d1/d7/f15 0 2024-04-18T10:42:39.770 INFO:tasks.workunit.client.0.smithi040.stdout:4/30: readlink d2/l7 0 2024-04-18T10:42:39.770 INFO:tasks.workunit.client.0.smithi040.stdout:4/31: dread - no filename 2024-04-18T10:42:39.770 INFO:tasks.workunit.client.0.smithi040.stdout:4/32: chown d2 151905 1 2024-04-18T10:42:39.771 INFO:tasks.workunit.client.0.smithi040.stdout:4/33: stat d2/d3/d4 0 2024-04-18T10:42:39.772 INFO:tasks.workunit.client.0.smithi040.stdout:3/80: mkdir d1/d2/d16/d18 0 2024-04-18T10:42:39.772 INFO:tasks.workunit.client.0.smithi040.stdout:5/42: dread d0/d3/f5 [0,4194304] 0 2024-04-18T10:42:39.772 INFO:tasks.workunit.client.0.smithi040.stdout:4/34: chown d2/d3/d4 40 1 2024-04-18T10:42:39.772 INFO:tasks.workunit.client.0.smithi040.stdout:4/35: dwrite - no filename 2024-04-18T10:42:39.772 INFO:tasks.workunit.client.0.smithi040.stdout:4/36: truncate - no filename 2024-04-18T10:42:39.772 INFO:tasks.workunit.client.0.smithi040.stdout:4/37: dwrite - no filename 2024-04-18T10:42:39.772 INFO:tasks.workunit.client.0.smithi040.stdout:4/38: dread - no filename 2024-04-18T10:42:39.772 INFO:tasks.workunit.client.0.smithi040.stdout:4/39: fdatasync - no filename 2024-04-18T10:42:39.772 INFO:tasks.workunit.client.0.smithi040.stdout:4/40: truncate - no filename 2024-04-18T10:42:39.773 INFO:tasks.workunit.client.0.smithi040.stdout:4/41: chown d2/d3 7906 1 2024-04-18T10:42:39.773 INFO:tasks.workunit.client.0.smithi040.stdout:2/24: truncate f2 1831497 0 2024-04-18T10:42:39.774 INFO:tasks.workunit.client.0.smithi040.stdout:5/43: dread d0/f1 [0,4194304] 0 2024-04-18T10:42:39.774 INFO:tasks.workunit.client.0.smithi040.stdout:3/81: mknod d1/d7/c19 0 2024-04-18T10:42:39.775 INFO:tasks.workunit.client.0.smithi040.stdout:3/82: write d1/fb [1392172,80979] 0 2024-04-18T10:42:39.775 INFO:tasks.workunit.client.0.smithi040.stdout:4/42: readlink d2/l5 0 2024-04-18T10:42:39.775 INFO:tasks.workunit.client.0.smithi040.stdout:4/43: dwrite - no filename 2024-04-18T10:42:39.775 INFO:tasks.workunit.client.0.smithi040.stdout:4/44: dread - no filename 2024-04-18T10:42:39.775 INFO:tasks.workunit.client.0.smithi040.stdout:3/83: stat d1 0 2024-04-18T10:42:39.776 INFO:tasks.workunit.client.0.smithi040.stdout:6/56: getdents df 0 2024-04-18T10:42:39.778 INFO:tasks.workunit.client.0.smithi040.stdout:0/53: getdents . 0 2024-04-18T10:42:39.779 INFO:tasks.workunit.client.0.smithi040.stdout:5/44: creat d0/d3/f10 x:0 0 0 2024-04-18T10:42:39.780 INFO:tasks.workunit.client.0.smithi040.stdout:4/45: creat d2/f8 x:0 0 0 2024-04-18T10:42:39.781 INFO:tasks.workunit.client.0.smithi040.stdout:3/84: dread d1/fb [0,4194304] 0 2024-04-18T10:42:39.781 INFO:tasks.workunit.client.0.smithi040.stdout:4/46: write d2/f8 [246980,45218] 0 2024-04-18T10:42:39.782 INFO:tasks.workunit.client.0.smithi040.stdout:6/57: rmdir df 39 2024-04-18T10:42:39.785 INFO:tasks.workunit.client.0.smithi040.stdout:0/54: readlink lc 0 2024-04-18T10:42:39.787 INFO:tasks.workunit.client.0.smithi040.stdout:0/55: dread fa [0,4194304] 0 2024-04-18T10:42:39.787 INFO:tasks.workunit.client.0.smithi040.stdout:7/84: truncate d6/f14 808870 0 2024-04-18T10:42:39.788 INFO:tasks.workunit.client.0.smithi040.stdout:1/54: rmdir d1 39 2024-04-18T10:42:39.791 INFO:tasks.workunit.client.0.smithi040.stdout:4/47: creat d2/f9 x:0 0 0 2024-04-18T10:42:39.794 INFO:tasks.workunit.client.0.smithi040.stdout:0/56: mkdir dd 0 2024-04-18T10:42:39.794 INFO:tasks.workunit.client.0.smithi040.stdout:0/57: stat cb 0 2024-04-18T10:42:39.794 INFO:tasks.workunit.client.0.smithi040.stdout:8/64: truncate d2/f11 60165 0 2024-04-18T10:42:39.795 INFO:tasks.workunit.client.0.smithi040.stdout:8/65: fsync d2/f4 0 2024-04-18T10:42:39.795 INFO:tasks.workunit.client.0.smithi040.stdout:7/85: creat d6/f1f x:0 0 0 2024-04-18T10:42:39.798 INFO:tasks.workunit.client.0.smithi040.stdout:5/45: link d0/d3/cc d0/d3/c11 0 2024-04-18T10:42:39.799 INFO:tasks.workunit.client.0.smithi040.stdout:5/46: chown d0/le 97566678 1 2024-04-18T10:42:39.799 INFO:tasks.workunit.client.0.smithi040.stdout:7/86: dread d6/f18 [0,4194304] 0 2024-04-18T10:42:39.800 INFO:tasks.workunit.client.0.smithi040.stdout:0/58: rename cb to dd/ce 0 2024-04-18T10:42:39.800 INFO:tasks.workunit.client.0.smithi040.stdout:1/55: dread d1/fa [0,4194304] 0 2024-04-18T10:42:39.801 INFO:tasks.workunit.client.0.smithi040.stdout:1/56: truncate d1/f6 1046177 0 2024-04-18T10:42:39.801 INFO:tasks.workunit.client.0.smithi040.stdout:4/48: creat d2/d3/d4/fa x:0 0 0 2024-04-18T10:42:39.803 INFO:tasks.workunit.client.0.smithi040.stdout:1/57: fdatasync d1/f6 0 2024-04-18T10:42:39.803 INFO:tasks.workunit.client.0.smithi040.stdout:5/47: mkdir d0/d3/d12 0 2024-04-18T10:42:39.805 INFO:tasks.workunit.client.0.smithi040.stdout:5/48: stat d0/d3/cf 0 2024-04-18T10:42:39.807 INFO:tasks.workunit.client.0.smithi040.stdout:4/49: symlink d2/d3/lb 0 2024-04-18T10:42:39.807 INFO:tasks.workunit.client.0.smithi040.stdout:7/87: dread d6/fa [4194304,4194304] 0 2024-04-18T10:42:39.808 INFO:tasks.workunit.client.0.smithi040.stdout:4/50: read - d2/f9 zero size 2024-04-18T10:42:39.808 INFO:tasks.workunit.client.0.smithi040.stdout:0/59: dwrite f2 [0,4194304] 0 2024-04-18T10:42:39.808 INFO:tasks.workunit.client.0.smithi040.stdout:9/148: unlink d2/f39 0 2024-04-18T10:42:39.809 INFO:tasks.workunit.client.0.smithi040.stdout:0/60: write f2 [2371050,117490] 0 2024-04-18T10:42:39.810 INFO:tasks.workunit.client.0.smithi040.stdout:1/58: mknod d1/c10 0 2024-04-18T10:42:39.810 INFO:tasks.workunit.client.0.smithi040.stdout:5/49: fsync d0/f2 0 2024-04-18T10:42:39.811 INFO:tasks.workunit.client.0.smithi040.stdout:5/50: chown d0/f2 4 1 2024-04-18T10:42:39.812 INFO:tasks.workunit.client.0.smithi040.stdout:4/51: dread d2/f8 [0,4194304] 0 2024-04-18T10:42:39.812 INFO:tasks.workunit.client.0.smithi040.stdout:1/59: read d1/f6 [875039,86178] 0 2024-04-18T10:42:39.812 INFO:tasks.workunit.client.0.smithi040.stdout:7/88: creat d6/f20 x:0 0 0 2024-04-18T10:42:39.816 INFO:tasks.workunit.client.0.smithi040.stdout:9/149: creat d2/d3/d22/f3a x:0 0 0 2024-04-18T10:42:39.817 INFO:tasks.workunit.client.0.smithi040.stdout:0/61: mkdir dd/df 0 2024-04-18T10:42:39.818 INFO:tasks.workunit.client.0.smithi040.stdout:1/60: dwrite d1/f9 [0,4194304] 0 2024-04-18T10:42:39.819 INFO:tasks.workunit.client.0.smithi040.stdout:6/58: sync 2024-04-18T10:42:39.819 INFO:tasks.workunit.client.0.smithi040.stdout:4/52: readlink d2/l7 0 2024-04-18T10:42:39.820 INFO:tasks.workunit.client.0.smithi040.stdout:9/150: dread d2/dd/f24 [0,4194304] 0 2024-04-18T10:42:39.821 INFO:tasks.workunit.client.0.smithi040.stdout:5/51: fdatasync d0/d3/f5 0 2024-04-18T10:42:39.827 INFO:tasks.workunit.client.0.smithi040.stdout:0/62: unlink f9 0 2024-04-18T10:42:39.829 INFO:tasks.workunit.client.0.smithi040.stdout:1/61: creat d1/f11 x:0 0 0 2024-04-18T10:42:39.831 INFO:tasks.workunit.client.0.smithi040.stdout:4/53: write d2/f8 [1331436,20906] 0 2024-04-18T10:42:39.831 INFO:tasks.workunit.client.0.smithi040.stdout:1/62: truncate d1/f6 1572422 0 2024-04-18T10:42:39.834 INFO:tasks.workunit.client.0.smithi040.stdout:9/151: symlink d2/d7/l3b 0 2024-04-18T10:42:39.834 INFO:tasks.workunit.client.0.smithi040.stdout:5/52: unlink d0/c6 0 2024-04-18T10:42:39.834 INFO:tasks.workunit.client.0.smithi040.stdout:3/85: dwrite d1/f6 [0,4194304] 0 2024-04-18T10:42:39.835 INFO:tasks.workunit.client.0.smithi040.stdout:0/63: creat dd/f10 x:0 0 0 2024-04-18T10:42:39.836 INFO:tasks.workunit.client.0.smithi040.stdout:6/59: mkdir df/d15 0 2024-04-18T10:42:39.837 INFO:tasks.workunit.client.0.smithi040.stdout:1/63: symlink d1/l12 0 2024-04-18T10:42:39.838 INFO:tasks.workunit.client.0.smithi040.stdout:9/152: creat d2/d3/d22/f3c x:0 0 0 2024-04-18T10:42:39.840 INFO:tasks.workunit.client.0.smithi040.stdout:0/64: symlink dd/l11 0 2024-04-18T10:42:39.843 INFO:tasks.workunit.client.0.smithi040.stdout:4/54: dwrite d2/d3/d4/fa [0,4194304] 0 2024-04-18T10:42:39.844 INFO:tasks.workunit.client.0.smithi040.stdout:4/55: stat d2/l5 0 2024-04-18T10:42:39.846 INFO:tasks.workunit.client.0.smithi040.stdout:1/64: write d1/fa [3733089,27425] 0 2024-04-18T10:42:39.847 INFO:tasks.workunit.client.0.smithi040.stdout:5/53: dwrite d0/d3/f10 [0,4194304] 0 2024-04-18T10:42:39.847 INFO:tasks.workunit.client.0.smithi040.stdout:4/56: write d2/f8 [2047231,86110] 0 2024-04-18T10:42:39.848 INFO:tasks.workunit.client.0.smithi040.stdout:0/65: symlink dd/l12 0 2024-04-18T10:42:39.849 INFO:tasks.workunit.client.0.smithi040.stdout:0/66: write dd/f10 [538877,61242] 0 2024-04-18T10:42:39.850 INFO:tasks.workunit.client.0.smithi040.stdout:0/67: chown lc 19662 1 2024-04-18T10:42:39.851 INFO:tasks.workunit.client.0.smithi040.stdout:9/153: creat d2/d3/d22/d2e/f3d x:0 0 0 2024-04-18T10:42:39.852 INFO:tasks.workunit.client.0.smithi040.stdout:9/154: read - d2/d3/d22/d2e/f3d zero size 2024-04-18T10:42:39.854 INFO:tasks.workunit.client.0.smithi040.stdout:1/65: dwrite d1/fe [0,4194304] 0 2024-04-18T10:42:39.857 INFO:tasks.workunit.client.0.smithi040.stdout:6/60: rmdir df/d15 0 2024-04-18T10:42:39.858 INFO:tasks.workunit.client.0.smithi040.stdout:6/61: write f4 [4564920,82031] 0 2024-04-18T10:42:39.858 INFO:tasks.workunit.client.0.smithi040.stdout:1/66: dread d1/f9 [0,4194304] 0 2024-04-18T10:42:39.859 INFO:tasks.workunit.client.0.smithi040.stdout:7/89: rmdir d6 39 2024-04-18T10:42:39.863 INFO:tasks.workunit.client.0.smithi040.stdout:5/54: creat d0/d3/f13 x:0 0 0 2024-04-18T10:42:39.864 INFO:tasks.workunit.client.0.smithi040.stdout:4/57: mknod d2/d3/cc 0 2024-04-18T10:42:39.866 INFO:tasks.workunit.client.0.smithi040.stdout:3/86: getdents d1/d7 0 2024-04-18T10:42:39.866 INFO:tasks.workunit.client.0.smithi040.stdout:2/25: write f2 [1766914,75882] 0 2024-04-18T10:42:39.870 INFO:tasks.workunit.client.0.smithi040.stdout:6/62: creat df/f16 x:0 0 0 2024-04-18T10:42:39.873 INFO:tasks.workunit.client.0.smithi040.stdout:1/67: creat d1/f13 x:0 0 0 2024-04-18T10:42:39.874 INFO:tasks.workunit.client.0.smithi040.stdout:0/68: creat dd/df/f13 x:0 0 0 2024-04-18T10:42:39.875 INFO:tasks.workunit.client.0.smithi040.stdout:4/58: mkdir d2/d3/d4/dd 0 2024-04-18T10:42:39.878 INFO:tasks.workunit.client.0.smithi040.stdout:2/26: dwrite f2 [0,4194304] 0 2024-04-18T10:42:39.878 INFO:tasks.workunit.client.0.smithi040.stdout:9/155: dwrite d2/d7/fa [4194304,4194304] 0 2024-04-18T10:42:39.880 INFO:tasks.workunit.client.0.smithi040.stdout:9/156: chown d2/d7/f29 57 1 2024-04-18T10:42:39.881 INFO:tasks.workunit.client.0.smithi040.stdout:7/90: rename d6/f18 to d6/d12/f21 0 2024-04-18T10:42:39.883 INFO:tasks.workunit.client.0.smithi040.stdout:0/69: mknod dd/df/c14 0 2024-04-18T10:42:39.889 INFO:tasks.workunit.client.0.smithi040.stdout:3/87: rename d1/fb to d1/f1a 0 2024-04-18T10:42:39.889 INFO:tasks.workunit.client.0.smithi040.stdout:4/59: dwrite d2/f9 [0,4194304] 0 2024-04-18T10:42:39.890 INFO:tasks.workunit.client.0.smithi040.stdout:7/91: creat d6/f22 x:0 0 0 2024-04-18T10:42:39.893 INFO:tasks.workunit.client.0.smithi040.stdout:7/92: dread - d6/f20 zero size 2024-04-18T10:42:39.893 INFO:tasks.workunit.client.0.smithi040.stdout:9/157: dread d2/d7/f15 [0,4194304] 0 2024-04-18T10:42:39.893 INFO:tasks.workunit.client.0.smithi040.stdout:0/70: rename f2 to dd/df/f15 0 2024-04-18T10:42:39.895 INFO:tasks.workunit.client.0.smithi040.stdout:9/158: stat d2/d7/l36 0 2024-04-18T10:42:39.895 INFO:tasks.workunit.client.0.smithi040.stdout:8/66: dwrite d2/f11 [0,4194304] 0 2024-04-18T10:42:39.897 INFO:tasks.workunit.client.0.smithi040.stdout:0/71: truncate dd/df/f13 535901 0 2024-04-18T10:42:39.897 INFO:tasks.workunit.client.0.smithi040.stdout:9/159: fdatasync d2/d3/d22/f3a 0 2024-04-18T10:42:39.897 INFO:tasks.workunit.client.0.smithi040.stdout:8/67: write d2/d10/d14/f16 [665477,76970] 0 2024-04-18T10:42:39.898 INFO:tasks.workunit.client.0.smithi040.stdout:1/68: link d1/cd d1/c14 0 2024-04-18T10:42:39.900 INFO:tasks.workunit.client.0.smithi040.stdout:3/88: mknod d1/d2/c1b 0 2024-04-18T10:42:39.901 INFO:tasks.workunit.client.0.smithi040.stdout:8/68: dread d2/d10/f12 [0,4194304] 0 2024-04-18T10:42:39.902 INFO:tasks.workunit.client.0.smithi040.stdout:7/93: symlink d6/d12/l23 0 2024-04-18T10:42:39.902 INFO:tasks.workunit.client.0.smithi040.stdout:7/94: readlink d6/d12/l15 0 2024-04-18T10:42:39.903 INFO:tasks.workunit.client.0.smithi040.stdout:7/95: write d6/f22 [242197,49631] 0 2024-04-18T10:42:39.903 INFO:tasks.workunit.client.0.smithi040.stdout:6/63: rmdir df 39 2024-04-18T10:42:39.904 INFO:tasks.workunit.client.0.smithi040.stdout:6/64: write f0 [2039404,2492] 0 2024-04-18T10:42:39.905 INFO:tasks.workunit.client.0.smithi040.stdout:0/72: truncate fa 1214769 0 2024-04-18T10:42:39.905 INFO:tasks.workunit.client.0.smithi040.stdout:0/73: chown lc 5856003 1 2024-04-18T10:42:39.906 INFO:tasks.workunit.client.0.smithi040.stdout:0/74: stat dd/df/c14 0 2024-04-18T10:42:39.908 INFO:tasks.workunit.client.0.smithi040.stdout:1/69: creat d1/f15 x:0 0 0 2024-04-18T10:42:39.908 INFO:tasks.workunit.client.0.smithi040.stdout:1/70: fdatasync d1/f6 0 2024-04-18T10:42:39.909 INFO:tasks.workunit.client.0.smithi040.stdout:1/71: dread - d1/f11 zero size 2024-04-18T10:42:39.910 INFO:tasks.workunit.client.0.smithi040.stdout:0/75: dread dd/df/f15 [0,4194304] 0 2024-04-18T10:42:39.910 INFO:tasks.workunit.client.0.smithi040.stdout:1/72: chown d1/c8 30165889 1 2024-04-18T10:42:39.910 INFO:tasks.workunit.client.0.smithi040.stdout:1/73: dread - d1/f13 zero size 2024-04-18T10:42:39.911 INFO:tasks.workunit.client.0.smithi040.stdout:8/69: rename d2/f4 to d2/f17 0 2024-04-18T10:42:39.912 INFO:tasks.workunit.client.0.smithi040.stdout:2/27: getdents . 0 2024-04-18T10:42:39.912 INFO:tasks.workunit.client.0.smithi040.stdout:7/96: creat d6/f24 x:0 0 0 2024-04-18T10:42:39.913 INFO:tasks.workunit.client.0.smithi040.stdout:7/97: write d6/f22 [1215082,109757] 0 2024-04-18T10:42:39.916 INFO:tasks.workunit.client.0.smithi040.stdout:0/76: rename dd/df/c14 to dd/c16 0 2024-04-18T10:42:39.916 INFO:tasks.workunit.client.0.smithi040.stdout:1/74: mkdir d1/d16 0 2024-04-18T10:42:39.917 INFO:tasks.workunit.client.0.smithi040.stdout:0/77: read dd/f10 [540122,13876] 0 2024-04-18T10:42:39.917 INFO:tasks.workunit.client.0.smithi040.stdout:2/28: chown c1 1591040442 1 2024-04-18T10:42:39.920 INFO:tasks.workunit.client.0.smithi040.stdout:6/65: mkdir df/d17 0 2024-04-18T10:42:39.923 INFO:tasks.workunit.client.0.smithi040.stdout:8/70: mkdir d2/d15/d18 0 2024-04-18T10:42:39.924 INFO:tasks.workunit.client.0.smithi040.stdout:0/78: symlink dd/l17 0 2024-04-18T10:42:39.926 INFO:tasks.workunit.client.0.smithi040.stdout:2/29: rename f2 to f4 0 2024-04-18T10:42:39.926 INFO:tasks.workunit.client.0.smithi040.stdout:2/30: stat f4 0 2024-04-18T10:42:39.927 INFO:tasks.workunit.client.0.smithi040.stdout:9/160: getdents d2/d3/d22/d2e 0 2024-04-18T10:42:39.928 INFO:tasks.workunit.client.0.smithi040.stdout:3/89: getdents d1/d2 0 2024-04-18T10:42:39.929 INFO:tasks.workunit.client.0.smithi040.stdout:5/55: sync 2024-04-18T10:42:39.932 INFO:tasks.workunit.client.0.smithi040.stdout:7/98: rename d6/d12 to d6/d25 0 2024-04-18T10:42:39.933 INFO:tasks.workunit.client.0.smithi040.stdout:3/90: dread - d1/d2/f17 zero size 2024-04-18T10:42:39.934 INFO:tasks.workunit.client.0.smithi040.stdout:2/31: symlink l5 0 2024-04-18T10:42:39.938 INFO:tasks.workunit.client.0.smithi040.stdout:6/66: symlink df/d17/l18 0 2024-04-18T10:42:39.940 INFO:tasks.workunit.client.0.smithi040.stdout:2/32: mknod c6 0 2024-04-18T10:42:39.940 INFO:tasks.workunit.client.0.smithi040.stdout:9/161: creat d2/d3/d22/d2e/d32/f3e x:0 0 0 2024-04-18T10:42:39.941 INFO:tasks.workunit.client.0.smithi040.stdout:8/71: rmdir d2 39 2024-04-18T10:42:39.942 INFO:tasks.workunit.client.0.smithi040.stdout:6/67: mkdir df/d17/d19 0 2024-04-18T10:42:39.944 INFO:tasks.workunit.client.0.smithi040.stdout:6/68: dread - df/f12 zero size 2024-04-18T10:42:39.945 INFO:tasks.workunit.client.0.smithi040.stdout:3/91: dwrite d1/d7/f15 [0,4194304] 0 2024-04-18T10:42:39.945 INFO:tasks.workunit.client.0.smithi040.stdout:2/33: symlink l7 0 2024-04-18T10:42:39.945 INFO:tasks.workunit.client.0.smithi040.stdout:6/69: readlink df/d17/l18 0 2024-04-18T10:42:39.946 INFO:tasks.workunit.client.0.smithi040.stdout:5/56: rmdir d0/d3/d12 0 2024-04-18T10:42:39.947 INFO:tasks.workunit.client.0.smithi040.stdout:3/92: dread - d1/d2/f17 zero size 2024-04-18T10:42:39.948 INFO:tasks.workunit.client.0.smithi040.stdout:7/99: link d6/d25/c1a d6/d25/c26 0 2024-04-18T10:42:39.949 INFO:tasks.workunit.client.0.smithi040.stdout:0/79: write fa [1065427,84255] 0 2024-04-18T10:42:39.951 INFO:tasks.workunit.client.0.smithi040.stdout:5/57: fdatasync d0/d3/f7 0 2024-04-18T10:42:39.952 INFO:tasks.workunit.client.0.smithi040.stdout:3/93: write d1/d7/fa [3110454,73336] 0 2024-04-18T10:42:39.952 INFO:tasks.workunit.client.0.smithi040.stdout:7/100: read d6/d25/f21 [972674,79253] 0 2024-04-18T10:42:39.952 INFO:tasks.workunit.client.0.smithi040.stdout:9/162: dwrite d2/d7/f14 [0,4194304] 0 2024-04-18T10:42:39.954 INFO:tasks.workunit.client.0.smithi040.stdout:3/94: chown d1/l11 1 1 2024-04-18T10:42:39.955 INFO:tasks.workunit.client.0.smithi040.stdout:6/70: dread f0 [0,4194304] 0 2024-04-18T10:42:39.956 INFO:tasks.workunit.client.0.smithi040.stdout:0/80: creat dd/f18 x:0 0 0 2024-04-18T10:42:39.959 INFO:tasks.workunit.client.0.smithi040.stdout:6/71: creat df/f1a x:0 0 0 2024-04-18T10:42:39.961 INFO:tasks.workunit.client.0.smithi040.stdout:5/58: dwrite d0/f2 [0,4194304] 0 2024-04-18T10:42:39.961 INFO:tasks.workunit.client.0.smithi040.stdout:9/163: symlink d2/dd/l3f 0 2024-04-18T10:42:39.961 INFO:tasks.workunit.client.0.smithi040.stdout:4/60: sync 2024-04-18T10:42:39.961 INFO:tasks.workunit.client.0.smithi040.stdout:3/95: dread d1/f1a [0,4194304] 0 2024-04-18T10:42:39.962 INFO:tasks.workunit.client.0.smithi040.stdout:0/81: mkdir dd/df/d19 0 2024-04-18T10:42:39.962 INFO:tasks.workunit.client.0.smithi040.stdout:4/61: stat d2/f9 0 2024-04-18T10:42:39.963 INFO:tasks.workunit.client.0.smithi040.stdout:8/72: link d2/l13 d2/d5/l19 0 2024-04-18T10:42:39.965 INFO:tasks.workunit.client.0.smithi040.stdout:4/62: write d2/f9 [765234,92111] 0 2024-04-18T10:42:39.966 INFO:tasks.workunit.client.0.smithi040.stdout:0/82: unlink dd/l11 0 2024-04-18T10:42:39.966 INFO:tasks.workunit.client.0.smithi040.stdout:5/59: dread d0/d3/f5 [0,4194304] 0 2024-04-18T10:42:39.967 INFO:tasks.workunit.client.0.smithi040.stdout:3/96: creat d1/d2/d16/f1c x:0 0 0 2024-04-18T10:42:39.970 INFO:tasks.workunit.client.0.smithi040.stdout:6/72: link df/f12 df/d17/f1b 0 2024-04-18T10:42:39.971 INFO:tasks.workunit.client.0.smithi040.stdout:9/164: rename d2/dd/de/d25 to d2/d3/d22/d2e/d35/d40 0 2024-04-18T10:42:39.974 INFO:tasks.workunit.client.0.smithi040.stdout:8/73: dwrite d2/f11 [4194304,4194304] 0 2024-04-18T10:42:39.974 INFO:tasks.workunit.client.0.smithi040.stdout:9/165: chown d2/c28 22176343 1 2024-04-18T10:42:39.976 INFO:tasks.workunit.client.0.smithi040.stdout:0/83: rename fa to dd/df/d19/f1a 0 2024-04-18T10:42:39.976 INFO:tasks.workunit.client.0.smithi040.stdout:9/166: stat d2/d7/f2a 0 2024-04-18T10:42:39.978 INFO:tasks.workunit.client.0.smithi040.stdout:4/63: dwrite d2/d3/d4/fa [0,4194304] 0 2024-04-18T10:42:39.979 INFO:tasks.workunit.client.0.smithi040.stdout:2/34: truncate f4 2517429 0 2024-04-18T10:42:39.982 INFO:tasks.workunit.client.0.smithi040.stdout:0/84: symlink dd/df/l1b 0 2024-04-18T10:42:39.982 INFO:tasks.workunit.client.0.smithi040.stdout:8/74: dread d2/d10/f12 [0,4194304] 0 2024-04-18T10:42:39.984 INFO:tasks.workunit.client.0.smithi040.stdout:5/60: getdents d0/d3 0 2024-04-18T10:42:39.986 INFO:tasks.workunit.client.0.smithi040.stdout:9/167: dwrite d2/d7/f14 [0,4194304] 0 2024-04-18T10:42:39.987 INFO:tasks.workunit.client.0.smithi040.stdout:5/61: chown d0/d3/fb 1149 1 2024-04-18T10:42:39.988 INFO:tasks.workunit.client.0.smithi040.stdout:4/64: dread d2/d3/d4/fa [0,4194304] 0 2024-04-18T10:42:39.988 INFO:tasks.workunit.client.0.smithi040.stdout:9/168: write d2/d7/f1b [607207,108815] 0 2024-04-18T10:42:39.988 INFO:tasks.workunit.client.0.smithi040.stdout:0/85: symlink dd/l1c 0 2024-04-18T10:42:39.989 INFO:tasks.workunit.client.0.smithi040.stdout:7/101: truncate f0 3690758 0 2024-04-18T10:42:39.989 INFO:tasks.workunit.client.0.smithi040.stdout:9/169: chown d2/f5 221 1 2024-04-18T10:42:39.994 INFO:tasks.workunit.client.0.smithi040.stdout:5/62: rename d0/le to d0/d3/l14 0 2024-04-18T10:42:39.996 INFO:tasks.workunit.client.0.smithi040.stdout:7/102: dwrite d6/f22 [0,4194304] 0 2024-04-18T10:42:39.996 INFO:tasks.workunit.client.0.smithi040.stdout:0/86: creat dd/f1d x:0 0 0 2024-04-18T10:42:40.001 INFO:tasks.workunit.client.0.smithi040.stdout:9/170: rmdir d2/d3/d22 39 2024-04-18T10:42:40.001 INFO:tasks.workunit.client.0.smithi040.stdout:1/75: sync 2024-04-18T10:42:40.003 INFO:tasks.workunit.client.0.smithi040.stdout:4/65: rename d2/d3/lb to d2/d3/d4/dd/le 0 2024-04-18T10:42:40.004 INFO:tasks.workunit.client.0.smithi040.stdout:3/97: truncate d1/f6 2464626 0 2024-04-18T10:42:40.005 INFO:tasks.workunit.client.0.smithi040.stdout:7/103: creat d6/d25/f27 x:0 0 0 2024-04-18T10:42:40.007 INFO:tasks.workunit.client.0.smithi040.stdout:6/73: truncate f7 493771 0 2024-04-18T10:42:40.008 INFO:tasks.workunit.client.0.smithi040.stdout:3/98: write d1/d2/d16/f1c [39224,130318] 0 2024-04-18T10:42:40.008 INFO:tasks.workunit.client.0.smithi040.stdout:1/76: rmdir d1 39 2024-04-18T10:42:40.009 INFO:tasks.workunit.client.0.smithi040.stdout:9/171: dwrite d2/d7/f1b [0,4194304] 0 2024-04-18T10:42:40.009 INFO:tasks.workunit.client.0.smithi040.stdout:3/99: readlink d1/lf 0 2024-04-18T10:42:40.010 INFO:tasks.workunit.client.0.smithi040.stdout:0/87: link dd/df/f15 dd/df/f1e 0 2024-04-18T10:42:40.012 INFO:tasks.workunit.client.0.smithi040.stdout:4/66: dread d2/d3/d4/fa [0,4194304] 0 2024-04-18T10:42:40.014 INFO:tasks.workunit.client.0.smithi040.stdout:4/67: write d2/f9 [3318261,127700] 0 2024-04-18T10:42:40.015 INFO:tasks.workunit.client.0.smithi040.stdout:0/88: mknod dd/c1f 0 2024-04-18T10:42:40.017 INFO:tasks.workunit.client.0.smithi040.stdout:3/100: creat d1/d2/d16/f1d x:0 0 0 2024-04-18T10:42:40.017 INFO:tasks.workunit.client.0.smithi040.stdout:0/89: dread - dd/f1d zero size 2024-04-18T10:42:40.018 INFO:tasks.workunit.client.0.smithi040.stdout:1/77: rename d1/cb to d1/d16/c17 0 2024-04-18T10:42:40.019 INFO:tasks.workunit.client.0.smithi040.stdout:9/172: dwrite d2/fb [4194304,4194304] 0 2024-04-18T10:42:40.021 INFO:tasks.workunit.client.0.smithi040.stdout:3/101: stat d1/c10 0 2024-04-18T10:42:40.022 INFO:tasks.workunit.client.0.smithi040.stdout:4/68: dread d2/f8 [0,4194304] 0 2024-04-18T10:42:40.023 INFO:tasks.workunit.client.0.smithi040.stdout:1/78: rename d1/f9 to d1/f18 0 2024-04-18T10:42:40.024 INFO:tasks.workunit.client.0.smithi040.stdout:0/90: rename dd/c16 to dd/c20 0 2024-04-18T10:42:40.026 INFO:tasks.workunit.client.0.smithi040.stdout:4/69: symlink d2/lf 0 2024-04-18T10:42:40.027 INFO:tasks.workunit.client.0.smithi040.stdout:1/79: mknod d1/c19 0 2024-04-18T10:42:40.028 INFO:tasks.workunit.client.0.smithi040.stdout:4/70: chown d2/l7 218 1 2024-04-18T10:42:40.028 INFO:tasks.workunit.client.0.smithi040.stdout:3/102: mknod d1/d7/d12/c1e 0 2024-04-18T10:42:40.029 INFO:tasks.workunit.client.0.smithi040.stdout:9/173: rename d2/fb to d2/d3/f41 0 2024-04-18T10:42:40.030 INFO:tasks.workunit.client.0.smithi040.stdout:4/71: chown d2/f9 4 1 2024-04-18T10:42:40.031 INFO:tasks.workunit.client.0.smithi040.stdout:3/103: creat d1/d2/f1f x:0 0 0 2024-04-18T10:42:40.032 INFO:tasks.workunit.client.0.smithi040.stdout:4/72: fsync d2/f8 0 2024-04-18T10:42:40.033 INFO:tasks.workunit.client.0.smithi040.stdout:0/91: dwrite dd/f1d [0,4194304] 0 2024-04-18T10:42:40.036 INFO:tasks.workunit.client.0.smithi040.stdout:3/104: symlink d1/l20 0 2024-04-18T10:42:40.037 INFO:tasks.workunit.client.0.smithi040.stdout:4/73: write d2/f8 [2887117,95742] 0 2024-04-18T10:42:40.045 INFO:tasks.workunit.client.0.smithi040.stdout:2/35: read f4 [191176,73773] 0 2024-04-18T10:42:40.047 INFO:tasks.workunit.client.0.smithi040.stdout:1/80: dwrite d1/f13 [0,4194304] 0 2024-04-18T10:42:40.048 INFO:tasks.workunit.client.0.smithi040.stdout:2/36: chown c0 56515 1 2024-04-18T10:42:40.050 INFO:tasks.workunit.client.0.smithi040.stdout:8/75: truncate d2/d5/d9/fb 2463982 0 2024-04-18T10:42:40.051 INFO:tasks.workunit.client.0.smithi040.stdout:9/174: dwrite d2/d3/d22/d2e/f3d [0,4194304] 0 2024-04-18T10:42:40.051 INFO:tasks.workunit.client.0.smithi040.stdout:3/105: rename d1/d7/c14 to d1/d2/d16/c21 0 2024-04-18T10:42:40.055 INFO:tasks.workunit.client.0.smithi040.stdout:1/81: symlink d1/l1a 0 2024-04-18T10:42:40.055 INFO:tasks.workunit.client.0.smithi040.stdout:0/92: dread dd/df/f15 [0,4194304] 0 2024-04-18T10:42:40.055 INFO:tasks.workunit.client.0.smithi040.stdout:5/63: rename d0/d3/l14 to d0/d3/l15 0 2024-04-18T10:42:40.057 INFO:tasks.workunit.client.0.smithi040.stdout:0/93: stat dd/df/l1b 0 2024-04-18T10:42:40.060 INFO:tasks.workunit.client.0.smithi040.stdout:6/74: write df/d17/f1b [946507,23134] 0 2024-04-18T10:42:40.061 INFO:tasks.workunit.client.0.smithi040.stdout:4/74: dwrite d2/d3/d4/fa [0,4194304] 0 2024-04-18T10:42:40.064 INFO:tasks.workunit.client.0.smithi040.stdout:9/175: dread d2/f5 [0,4194304] 0 2024-04-18T10:42:40.064 INFO:tasks.workunit.client.0.smithi040.stdout:6/75: truncate df/f1a 1042723 0 2024-04-18T10:42:40.064 INFO:tasks.workunit.client.0.smithi040.stdout:8/76: unlink d2/d5/l19 0 2024-04-18T10:42:40.066 INFO:tasks.workunit.client.0.smithi040.stdout:0/94: symlink dd/df/l21 0 2024-04-18T10:42:40.067 INFO:tasks.workunit.client.0.smithi040.stdout:5/64: dread d0/f1 [0,4194304] 0 2024-04-18T10:42:40.069 INFO:tasks.workunit.client.0.smithi040.stdout:7/104: dwrite d6/f14 [0,4194304] 0 2024-04-18T10:42:40.071 INFO:tasks.workunit.client.0.smithi040.stdout:1/82: link d1/f18 d1/d16/f1b 0 2024-04-18T10:42:40.072 INFO:tasks.workunit.client.0.smithi040.stdout:4/75: mknod d2/c10 0 2024-04-18T10:42:40.073 INFO:tasks.workunit.client.0.smithi040.stdout:8/77: dread d2/f11 [4194304,4194304] 0 2024-04-18T10:42:40.075 INFO:tasks.workunit.client.0.smithi040.stdout:9/176: write d2/dc/f1a [4047942,105656] 0 2024-04-18T10:42:40.077 INFO:tasks.workunit.client.0.smithi040.stdout:6/76: rename cb to df/d17/c1c 0 2024-04-18T10:42:40.078 INFO:tasks.workunit.client.0.smithi040.stdout:0/95: dwrite dd/df/f13 [0,4194304] 0 2024-04-18T10:42:40.079 INFO:tasks.workunit.client.0.smithi040.stdout:6/77: read f0 [2917080,16783] 0 2024-04-18T10:42:40.081 INFO:tasks.workunit.client.0.smithi040.stdout:5/65: mknod d0/d3/c16 0 2024-04-18T10:42:40.082 INFO:tasks.workunit.client.0.smithi040.stdout:7/105: mkdir d6/d25/d28 0 2024-04-18T10:42:40.084 INFO:tasks.workunit.client.0.smithi040.stdout:1/83: mkdir d1/d1c 0 2024-04-18T10:42:40.085 INFO:tasks.workunit.client.0.smithi040.stdout:4/76: dwrite d2/d3/d4/fa [4194304,4194304] 0 2024-04-18T10:42:40.085 INFO:tasks.workunit.client.0.smithi040.stdout:0/96: dread dd/df/d19/f1a [0,4194304] 0 2024-04-18T10:42:40.086 INFO:tasks.workunit.client.0.smithi040.stdout:4/77: chown d2/l5 2425071 1 2024-04-18T10:42:40.090 INFO:tasks.workunit.client.0.smithi040.stdout:9/177: rename d2/dd/c37 to d2/dc/c42 0 2024-04-18T10:42:40.092 INFO:tasks.workunit.client.0.smithi040.stdout:6/78: creat df/d17/f1d x:0 0 0 2024-04-18T10:42:40.094 INFO:tasks.workunit.client.0.smithi040.stdout:7/106: symlink d6/d25/l29 0 2024-04-18T10:42:40.097 INFO:tasks.workunit.client.0.smithi040.stdout:0/97: dwrite dd/f18 [0,4194304] 0 2024-04-18T10:42:40.100 INFO:tasks.workunit.client.0.smithi040.stdout:4/78: chown d2/d3/d4/dd/le 220592 1 2024-04-18T10:42:40.103 INFO:tasks.workunit.client.0.smithi040.stdout:2/37: dwrite f4 [0,4194304] 0 2024-04-18T10:42:40.105 INFO:tasks.workunit.client.0.smithi040.stdout:4/79: write d2/d3/d4/fa [5213494,124167] 0 2024-04-18T10:42:40.105 INFO:tasks.workunit.client.0.smithi040.stdout:2/38: chown c1 2 1 2024-04-18T10:42:40.107 INFO:tasks.workunit.client.0.smithi040.stdout:6/79: dwrite fa [0,4194304] 0 2024-04-18T10:42:40.109 INFO:tasks.workunit.client.0.smithi040.stdout:7/107: unlink d6/d25/c1c 0 2024-04-18T10:42:40.109 INFO:tasks.workunit.client.0.smithi040.stdout:6/80: chown f0 175822 1 2024-04-18T10:42:40.116 INFO:tasks.workunit.client.0.smithi040.stdout:2/39: dwrite f4 [0,4194304] 0 2024-04-18T10:42:40.120 INFO:tasks.workunit.client.0.smithi040.stdout:0/98: rename dd/f18 to dd/df/d19/f22 0 2024-04-18T10:42:40.120 INFO:tasks.workunit.client.0.smithi040.stdout:2/40: dread f4 [0,4194304] 0 2024-04-18T10:42:40.125 INFO:tasks.workunit.client.0.smithi040.stdout:7/108: unlink d6/ce 0 2024-04-18T10:42:40.126 INFO:tasks.workunit.client.0.smithi040.stdout:7/109: dread - d6/f20 zero size 2024-04-18T10:42:40.131 INFO:tasks.workunit.client.0.smithi040.stdout:2/41: creat f8 x:0 0 0 2024-04-18T10:42:40.131 INFO:tasks.workunit.client.0.smithi040.stdout:2/42: chown c1 225811 1 2024-04-18T10:42:40.132 INFO:tasks.workunit.client.0.smithi040.stdout:7/110: fsync d6/d25/f21 0 2024-04-18T10:42:40.133 INFO:tasks.workunit.client.0.smithi040.stdout:7/111: chown d6/d25/l15 6456 1 2024-04-18T10:42:40.134 INFO:tasks.workunit.client.0.smithi040.stdout:6/81: creat df/d17/d19/f1e x:0 0 0 2024-04-18T10:42:40.134 INFO:tasks.workunit.client.0.smithi040.stdout:6/82: dread - df/f13 zero size 2024-04-18T10:42:40.135 INFO:tasks.workunit.client.0.smithi040.stdout:6/83: dread - df/d17/d19/f1e zero size 2024-04-18T10:42:40.136 INFO:tasks.workunit.client.0.smithi040.stdout:2/43: creat f9 x:0 0 0 2024-04-18T10:42:40.136 INFO:tasks.workunit.client.0.smithi040.stdout:2/44: dread - f8 zero size 2024-04-18T10:42:40.138 INFO:tasks.workunit.client.0.smithi040.stdout:9/178: write d2/d7/f8 [1341575,85379] 0 2024-04-18T10:42:40.139 INFO:tasks.workunit.client.0.smithi040.stdout:5/66: truncate d0/d3/fb 222795 0 2024-04-18T10:42:40.140 INFO:tasks.workunit.client.0.smithi040.stdout:1/84: truncate d1/fa 1769345 0 2024-04-18T10:42:40.141 INFO:tasks.workunit.client.0.smithi040.stdout:4/80: getdents d2/d3/d4/dd 0 2024-04-18T10:42:40.142 INFO:tasks.workunit.client.0.smithi040.stdout:7/112: fsync f0 0 2024-04-18T10:42:40.145 INFO:tasks.workunit.client.0.smithi040.stdout:5/67: creat d0/d3/f17 x:0 0 0 2024-04-18T10:42:40.147 INFO:tasks.workunit.client.0.smithi040.stdout:4/81: rename d2/c10 to d2/d3/d4/dd/c11 0 2024-04-18T10:42:40.148 INFO:tasks.workunit.client.0.smithi040.stdout:4/82: read d2/f9 [3058169,120112] 0 2024-04-18T10:42:40.149 INFO:tasks.workunit.client.0.smithi040.stdout:7/113: dwrite d6/ff [0,4194304] 0 2024-04-18T10:42:40.153 INFO:tasks.workunit.client.0.smithi040.stdout:5/68: chown d0/d3/c11 88 1 2024-04-18T10:42:40.154 INFO:tasks.workunit.client.0.smithi040.stdout:4/83: dread d2/f9 [0,4194304] 0 2024-04-18T10:42:40.157 INFO:tasks.workunit.client.0.smithi040.stdout:7/114: dwrite d6/f14 [0,4194304] 0 2024-04-18T10:42:40.157 INFO:tasks.workunit.client.0.smithi040.stdout:6/84: getdents df/d17/d19 0 2024-04-18T10:42:40.157 INFO:tasks.workunit.client.0.smithi040.stdout:7/115: readlink d6/l16 0 2024-04-18T10:42:40.159 INFO:tasks.workunit.client.0.smithi040.stdout:9/179: link d2/d3/d22/d2e/d35/l2f d2/dd/de/l43 0 2024-04-18T10:42:40.161 INFO:tasks.workunit.client.0.smithi040.stdout:6/85: dread f4 [4194304,4194304] 0 2024-04-18T10:42:40.162 INFO:tasks.workunit.client.0.smithi040.stdout:6/86: chown cc 428 1 2024-04-18T10:42:40.162 INFO:tasks.workunit.client.0.smithi040.stdout:4/84: rmdir d2/d3/d4/dd 39 2024-04-18T10:42:40.163 INFO:tasks.workunit.client.0.smithi040.stdout:9/180: dread d2/d7/f29 [0,4194304] 0 2024-04-18T10:42:40.163 INFO:tasks.workunit.client.0.smithi040.stdout:3/106: write d1/f6 [2628703,43409] 0 2024-04-18T10:42:40.166 INFO:tasks.workunit.client.0.smithi040.stdout:8/78: truncate d2/d5/d9/fb 597740 0 2024-04-18T10:42:40.169 INFO:tasks.workunit.client.0.smithi040.stdout:7/116: rmdir d6 39 2024-04-18T10:42:40.170 INFO:tasks.workunit.client.0.smithi040.stdout:6/87: write f0 [1420022,78045] 0 2024-04-18T10:42:40.171 INFO:tasks.workunit.client.0.smithi040.stdout:4/85: readlink d2/d3/d4/dd/le 0 2024-04-18T10:42:40.171 INFO:tasks.workunit.client.0.smithi040.stdout:4/86: chown d2/d3/d4 0 1 2024-04-18T10:42:40.174 INFO:tasks.workunit.client.0.smithi040.stdout:8/79: symlink d2/d5/d9/l1a 0 2024-04-18T10:42:40.176 INFO:tasks.workunit.client.0.smithi040.stdout:6/88: symlink df/d17/l1f 0 2024-04-18T10:42:40.177 INFO:tasks.workunit.client.0.smithi040.stdout:5/69: link d0/d3/c11 d0/d3/c18 0 2024-04-18T10:42:40.177 INFO:tasks.workunit.client.0.smithi040.stdout:6/89: dread - df/f16 zero size 2024-04-18T10:42:40.179 INFO:tasks.workunit.client.0.smithi040.stdout:3/107: link d1/f6 d1/d7/d12/f22 0 2024-04-18T10:42:40.184 INFO:tasks.workunit.client.0.smithi040.stdout:7/117: mknod d6/d25/c2a 0 2024-04-18T10:42:40.184 INFO:tasks.workunit.client.0.smithi040.stdout:8/80: write d2/f11 [3888827,33455] 0 2024-04-18T10:42:40.185 INFO:tasks.workunit.client.0.smithi040.stdout:1/85: dwrite d1/fa [0,4194304] 0 2024-04-18T10:42:40.187 INFO:tasks.workunit.client.0.smithi040.stdout:1/86: dread - d1/f15 zero size 2024-04-18T10:42:40.187 INFO:tasks.workunit.client.0.smithi040.stdout:5/70: unlink d0/d3/la 0 2024-04-18T10:42:40.189 INFO:tasks.workunit.client.0.smithi040.stdout:5/71: chown d0/d3/c16 369216177 1 2024-04-18T10:42:40.189 INFO:tasks.workunit.client.0.smithi040.stdout:3/108: dwrite d1/d2/f1f [0,4194304] 0 2024-04-18T10:42:40.189 INFO:tasks.workunit.client.0.smithi040.stdout:6/90: rename df/f16 to df/f20 0 2024-04-18T10:42:40.189 INFO:tasks.workunit.client.0.smithi040.stdout:3/109: chown d1/d2 372399 1 2024-04-18T10:42:40.191 INFO:tasks.workunit.client.0.smithi040.stdout:3/110: write d1/d2/d16/f1c [1136094,85485] 0 2024-04-18T10:42:40.193 INFO:tasks.workunit.client.0.smithi040.stdout:4/87: creat d2/d3/d4/f12 x:0 0 0 2024-04-18T10:42:40.194 INFO:tasks.workunit.client.0.smithi040.stdout:4/88: stat d2/l7 0 2024-04-18T10:42:40.194 INFO:tasks.workunit.client.0.smithi040.stdout:4/89: chown d2/d3/d4/dd/le 223568 1 2024-04-18T10:42:40.196 INFO:tasks.workunit.client.0.smithi040.stdout:8/81: mkdir d2/d5/d9/d1b 0 2024-04-18T10:42:40.197 INFO:tasks.workunit.client.0.smithi040.stdout:9/181: truncate d2/d7/f8 1150072 0 2024-04-18T10:42:40.199 INFO:tasks.workunit.client.0.smithi040.stdout:1/87: creat d1/d16/f1d x:0 0 0 2024-04-18T10:42:40.201 INFO:tasks.workunit.client.0.smithi040.stdout:3/111: symlink d1/d2/d16/l23 0 2024-04-18T10:42:40.201 INFO:tasks.workunit.client.0.smithi040.stdout:4/90: mkdir d2/d13 0 2024-04-18T10:42:40.202 INFO:tasks.workunit.client.0.smithi040.stdout:8/82: creat d2/d10/d14/f1c x:0 0 0 2024-04-18T10:42:40.203 INFO:tasks.workunit.client.0.smithi040.stdout:9/182: mkdir d2/d3/d22/d2e/d33/d44 0 2024-04-18T10:42:40.205 INFO:tasks.workunit.client.0.smithi040.stdout:1/88: creat d1/f1e x:0 0 0 2024-04-18T10:42:40.206 INFO:tasks.workunit.client.0.smithi040.stdout:3/112: mknod d1/d2/d16/c24 0 2024-04-18T10:42:40.207 INFO:tasks.workunit.client.0.smithi040.stdout:8/83: symlink d2/d15/d18/l1d 0 2024-04-18T10:42:40.208 INFO:tasks.workunit.client.0.smithi040.stdout:1/89: symlink d1/d16/l1f 0 2024-04-18T10:42:40.209 INFO:tasks.workunit.client.0.smithi040.stdout:3/113: creat d1/d2/d16/f25 x:0 0 0 2024-04-18T10:42:40.210 INFO:tasks.workunit.client.0.smithi040.stdout:2/45: sync 2024-04-18T10:42:40.210 INFO:tasks.workunit.client.0.smithi040.stdout:0/99: sync 2024-04-18T10:42:40.210 INFO:tasks.workunit.client.0.smithi040.stdout:4/91: dwrite d2/d3/d4/fa [0,4194304] 0 2024-04-18T10:42:40.214 INFO:tasks.workunit.client.0.smithi040.stdout:2/46: write f9 [625333,42767] 0 2024-04-18T10:42:40.214 INFO:tasks.workunit.client.0.smithi040.stdout:5/72: rename d0/d3/fb to d0/f19 0 2024-04-18T10:42:40.215 INFO:tasks.workunit.client.0.smithi040.stdout:3/114: mkdir d1/d7/d26 0 2024-04-18T10:42:40.215 INFO:tasks.workunit.client.0.smithi040.stdout:9/183: dread d2/d3/f41 [4194304,4194304] 0 2024-04-18T10:42:40.216 INFO:tasks.workunit.client.0.smithi040.stdout:1/90: symlink d1/d1c/l20 0 2024-04-18T10:42:40.218 INFO:tasks.workunit.client.0.smithi040.stdout:3/115: write d1/d7/f15 [50243,61001] 0 2024-04-18T10:42:40.218 INFO:tasks.workunit.client.0.smithi040.stdout:0/100: creat dd/df/f23 x:0 0 0 2024-04-18T10:42:40.219 INFO:tasks.workunit.client.0.smithi040.stdout:1/91: read d1/f18 [1183016,25711] 0 2024-04-18T10:42:40.221 INFO:tasks.workunit.client.0.smithi040.stdout:2/47: symlink la 0 2024-04-18T10:42:40.221 INFO:tasks.workunit.client.0.smithi040.stdout:8/84: dwrite d2/f11 [0,4194304] 0 2024-04-18T10:42:40.224 INFO:tasks.workunit.client.0.smithi040.stdout:1/92: chown d1/f4 97021831 1 2024-04-18T10:42:40.226 INFO:tasks.workunit.client.0.smithi040.stdout:0/101: unlink dd/l1c 0 2024-04-18T10:42:40.229 INFO:tasks.workunit.client.0.smithi040.stdout:2/48: mkdir db 0 2024-04-18T10:42:40.231 INFO:tasks.workunit.client.0.smithi040.stdout:5/73: dwrite d0/d3/f10 [0,4194304] 0 2024-04-18T10:42:40.232 INFO:tasks.workunit.client.0.smithi040.stdout:1/93: rename d1/f13 to d1/d16/f21 0 2024-04-18T10:42:40.233 INFO:tasks.workunit.client.0.smithi040.stdout:9/184: dwrite d2/d7/f2c [0,4194304] 0 2024-04-18T10:42:40.233 INFO:tasks.workunit.client.0.smithi040.stdout:3/116: mknod d1/d2/d16/d18/c27 0 2024-04-18T10:42:40.236 INFO:tasks.workunit.client.0.smithi040.stdout:7/118: sync 2024-04-18T10:42:40.236 INFO:tasks.workunit.client.0.smithi040.stdout:4/92: getdents d2/d3 0 2024-04-18T10:42:40.242 INFO:tasks.workunit.client.0.smithi040.stdout:5/74: write d0/d3/f7 [954542,103330] 0 2024-04-18T10:42:40.242 INFO:tasks.workunit.client.0.smithi040.stdout:6/91: dwrite f7 [0,4194304] 0 2024-04-18T10:42:40.242 INFO:tasks.workunit.client.0.smithi040.stdout:0/102: rename dd/df/l1b to dd/df/d19/l24 0 2024-04-18T10:42:40.242 INFO:tasks.workunit.client.0.smithi040.stdout:8/85: dread d2/f17 [0,4194304] 0 2024-04-18T10:42:40.244 INFO:tasks.workunit.client.0.smithi040.stdout:7/119: rmdir d6/d25 39 2024-04-18T10:42:40.246 INFO:tasks.workunit.client.0.smithi040.stdout:8/86: chown d2/d5/l7 107 1 2024-04-18T10:42:40.247 INFO:tasks.workunit.client.0.smithi040.stdout:2/49: dwrite f8 [0,4194304] 0 2024-04-18T10:42:40.249 INFO:tasks.workunit.client.0.smithi040.stdout:3/117: dread d1/f6 [0,4194304] 0 2024-04-18T10:42:40.250 INFO:tasks.workunit.client.0.smithi040.stdout:1/94: rename d1/d16/c17 to d1/d16/c22 0 2024-04-18T10:42:40.250 INFO:tasks.workunit.client.0.smithi040.stdout:1/95: dread - d1/f15 zero size 2024-04-18T10:42:40.253 INFO:tasks.workunit.client.0.smithi040.stdout:6/92: rename df/d17/f1d to df/f21 0 2024-04-18T10:42:40.257 INFO:tasks.workunit.client.0.smithi040.stdout:0/103: dwrite dd/df/d19/f22 [0,4194304] 0 2024-04-18T10:42:40.258 INFO:tasks.workunit.client.0.smithi040.stdout:0/104: stat dd/f1d 0 2024-04-18T10:42:40.258 INFO:tasks.workunit.client.0.smithi040.stdout:0/105: chown dd/df/f1e 53316935 1 2024-04-18T10:42:40.259 INFO:tasks.workunit.client.0.smithi040.stdout:8/87: rmdir d2/d5/d9 39 2024-04-18T10:42:40.260 INFO:tasks.workunit.client.0.smithi040.stdout:3/118: rmdir d1/d2 39 2024-04-18T10:42:40.262 INFO:tasks.workunit.client.0.smithi040.stdout:1/96: rename d1/f6 to d1/f23 0 2024-04-18T10:42:40.265 INFO:tasks.workunit.client.0.smithi040.stdout:6/93: creat df/d17/f22 x:0 0 0 2024-04-18T10:42:40.265 INFO:tasks.workunit.client.0.smithi040.stdout:2/50: getdents db 0 2024-04-18T10:42:40.267 INFO:tasks.workunit.client.0.smithi040.stdout:5/75: dread d0/d3/f7 [0,4194304] 0 2024-04-18T10:42:40.268 INFO:tasks.workunit.client.0.smithi040.stdout:1/97: creat d1/d1c/f24 x:0 0 0 2024-04-18T10:42:40.268 INFO:tasks.workunit.client.0.smithi040.stdout:8/88: dread d2/d10/d14/f16 [0,4194304] 0 2024-04-18T10:42:40.269 INFO:tasks.workunit.client.0.smithi040.stdout:6/94: symlink df/l23 0 2024-04-18T10:42:40.269 INFO:tasks.workunit.client.0.smithi040.stdout:1/98: readlink d1/l3 0 2024-04-18T10:42:40.270 INFO:tasks.workunit.client.0.smithi040.stdout:5/76: creat d0/d3/f1a x:0 0 0 2024-04-18T10:42:40.271 INFO:tasks.workunit.client.0.smithi040.stdout:1/99: write d1/d1c/f24 [75321,108171] 0 2024-04-18T10:42:40.271 INFO:tasks.workunit.client.0.smithi040.stdout:2/51: dread f4 [0,4194304] 0 2024-04-18T10:42:40.272 INFO:tasks.workunit.client.0.smithi040.stdout:7/120: write f0 [4659692,97471] 0 2024-04-18T10:42:40.273 INFO:tasks.workunit.client.0.smithi040.stdout:5/77: creat d0/f1b x:0 0 0 2024-04-18T10:42:40.274 INFO:tasks.workunit.client.0.smithi040.stdout:2/52: write f9 [1428297,100113] 0 2024-04-18T10:42:40.275 INFO:tasks.workunit.client.0.smithi040.stdout:6/95: dread df/d17/f1b [0,4194304] 0 2024-04-18T10:42:40.275 INFO:tasks.workunit.client.0.smithi040.stdout:5/78: read d0/f1 [3793565,60838] 0 2024-04-18T10:42:40.276 INFO:tasks.workunit.client.0.smithi040.stdout:8/89: dread d2/d5/d9/fb [0,4194304] 0 2024-04-18T10:42:40.277 INFO:tasks.workunit.client.0.smithi040.stdout:9/185: truncate d2/d3/f12 5362018 0 2024-04-18T10:42:40.278 INFO:tasks.workunit.client.0.smithi040.stdout:1/100: rename d1/cd to d1/d16/c25 0 2024-04-18T10:42:40.280 INFO:tasks.workunit.client.0.smithi040.stdout:2/53: rmdir db 0 2024-04-18T10:42:40.281 INFO:tasks.workunit.client.0.smithi040.stdout:4/93: truncate d2/f8 2730231 0 2024-04-18T10:42:40.282 INFO:tasks.workunit.client.0.smithi040.stdout:5/79: mkdir d0/d1c 0 2024-04-18T10:42:40.283 INFO:tasks.workunit.client.0.smithi040.stdout:6/96: creat df/d17/d19/f24 x:0 0 0 2024-04-18T10:42:40.284 INFO:tasks.workunit.client.0.smithi040.stdout:0/106: write dd/f10 [654279,73751] 0 2024-04-18T10:42:40.284 INFO:tasks.workunit.client.0.smithi040.stdout:8/90: creat d2/d15/d18/f1e x:0 0 0 2024-04-18T10:42:40.286 INFO:tasks.workunit.client.0.smithi040.stdout:7/121: dwrite d6/f24 [0,4194304] 0 2024-04-18T10:42:40.286 INFO:tasks.workunit.client.0.smithi040.stdout:6/97: readlink df/d17/l18 0 2024-04-18T10:42:40.287 INFO:tasks.workunit.client.0.smithi040.stdout:1/101: truncate d1/d16/f1b 44170 0 2024-04-18T10:42:40.287 INFO:tasks.workunit.client.0.smithi040.stdout:2/54: write f4 [666860,113593] 0 2024-04-18T10:42:40.287 INFO:tasks.workunit.client.0.smithi040.stdout:5/80: truncate d0/d3/f10 4463361 0 2024-04-18T10:42:40.287 INFO:tasks.workunit.client.0.smithi040.stdout:4/94: write d2/d3/d4/f12 [497026,16080] 0 2024-04-18T10:42:40.289 INFO:tasks.workunit.client.0.smithi040.stdout:6/98: stat ce 0 2024-04-18T10:42:40.289 INFO:tasks.workunit.client.0.smithi040.stdout:9/186: link d2/d7/f2c d2/d3/d22/f45 0 2024-04-18T10:42:40.289 INFO:tasks.workunit.client.0.smithi040.stdout:2/55: readlink l7 0 2024-04-18T10:42:40.289 INFO:tasks.workunit.client.0.smithi040.stdout:5/81: dread - d0/f1b zero size 2024-04-18T10:42:40.290 INFO:tasks.workunit.client.0.smithi040.stdout:8/91: mknod d2/d10/d14/c1f 0 2024-04-18T10:42:40.291 INFO:tasks.workunit.client.0.smithi040.stdout:8/92: write d2/d15/d18/f1e [254985,2397] 0 2024-04-18T10:42:40.292 INFO:tasks.workunit.client.0.smithi040.stdout:1/102: symlink d1/d16/l26 0 2024-04-18T10:42:40.292 INFO:tasks.workunit.client.0.smithi040.stdout:8/93: read d2/f11 [1620740,98856] 0 2024-04-18T10:42:40.292 INFO:tasks.workunit.client.0.smithi040.stdout:1/103: write d1/f1e [113993,113605] 0 2024-04-18T10:42:40.293 INFO:tasks.workunit.client.0.smithi040.stdout:7/122: symlink d6/l2b 0 2024-04-18T10:42:40.294 INFO:tasks.workunit.client.0.smithi040.stdout:1/104: write d1/f1e [577096,13083] 0 2024-04-18T10:42:40.294 INFO:tasks.workunit.client.0.smithi040.stdout:3/119: sync 2024-04-18T10:42:40.296 INFO:tasks.workunit.client.0.smithi040.stdout:4/95: dread d2/f9 [0,4194304] 0 2024-04-18T10:42:40.297 INFO:tasks.workunit.client.0.smithi040.stdout:2/56: mknod cc 0 2024-04-18T10:42:40.298 INFO:tasks.workunit.client.0.smithi040.stdout:9/187: write d2/d7/f15 [494276,41318] 0 2024-04-18T10:42:40.301 INFO:tasks.workunit.client.0.smithi040.stdout:6/99: rename f0 to df/f25 0 2024-04-18T10:42:40.302 INFO:tasks.workunit.client.0.smithi040.stdout:2/57: dread f9 [0,4194304] 0 2024-04-18T10:42:40.305 INFO:tasks.workunit.client.0.smithi040.stdout:8/94: write d2/f17 [2710763,30123] 0 2024-04-18T10:42:40.306 INFO:tasks.workunit.client.0.smithi040.stdout:7/123: write d6/d25/f21 [106912,83390] 0 2024-04-18T10:42:40.307 INFO:tasks.workunit.client.0.smithi040.stdout:8/95: read d2/d5/d9/fb [540618,67711] 0 2024-04-18T10:42:40.308 INFO:tasks.workunit.client.0.smithi040.stdout:8/96: truncate d2/d15/d18/f1e 675870 0 2024-04-18T10:42:40.309 INFO:tasks.workunit.client.0.smithi040.stdout:3/120: chown d1/d2/d16/c24 20466372 1 2024-04-18T10:42:40.310 INFO:tasks.workunit.client.0.smithi040.stdout:3/121: read - d1/d2/d16/f1d zero size 2024-04-18T10:42:40.313 INFO:tasks.workunit.client.0.smithi040.stdout:9/188: rename d2/d3/d22/d2e/d33 to d2/dc/d46 0 2024-04-18T10:42:40.314 INFO:tasks.workunit.client.0.smithi040.stdout:6/100: symlink df/d17/d19/l26 0 2024-04-18T10:42:40.316 INFO:tasks.workunit.client.0.smithi040.stdout:5/82: creat d0/d1c/f1d x:0 0 0 2024-04-18T10:42:40.317 INFO:tasks.workunit.client.0.smithi040.stdout:9/189: dread d2/f5 [0,4194304] 0 2024-04-18T10:42:40.317 INFO:tasks.workunit.client.0.smithi040.stdout:5/83: truncate d0/d3/f13 847748 0 2024-04-18T10:42:40.319 INFO:tasks.workunit.client.0.smithi040.stdout:8/97: creat d2/d10/f20 x:0 0 0 2024-04-18T10:42:40.320 INFO:tasks.workunit.client.0.smithi040.stdout:3/122: mkdir d1/d7/d28 0 2024-04-18T10:42:40.321 INFO:tasks.workunit.client.0.smithi040.stdout:8/98: dread d2/d10/f12 [0,4194304] 0 2024-04-18T10:42:40.321 INFO:tasks.workunit.client.0.smithi040.stdout:8/99: readlink d2/d5/l7 0 2024-04-18T10:42:40.322 INFO:tasks.workunit.client.0.smithi040.stdout:3/123: write d1/d2/f1f [599771,45748] 0 2024-04-18T10:42:40.322 INFO:tasks.workunit.client.0.smithi040.stdout:3/124: fsync d1/d7/fa 0 2024-04-18T10:42:40.323 INFO:tasks.workunit.client.0.smithi040.stdout:6/101: rename fd to df/f27 0 2024-04-18T10:42:40.323 INFO:tasks.workunit.client.0.smithi040.stdout:3/125: readlink d1/d7/lc 0 2024-04-18T10:42:40.324 INFO:tasks.workunit.client.0.smithi040.stdout:0/107: getdents dd/df/d19 0 2024-04-18T10:42:40.325 INFO:tasks.workunit.client.0.smithi040.stdout:3/126: write d1/d2/f1f [1795277,13091] 0 2024-04-18T10:42:40.326 INFO:tasks.workunit.client.0.smithi040.stdout:7/124: mkdir d6/d25/d28/d2c 0 2024-04-18T10:42:40.332 INFO:tasks.workunit.client.0.smithi040.stdout:4/96: unlink d2/f8 0 2024-04-18T10:42:40.332 INFO:tasks.workunit.client.0.smithi040.stdout:7/125: dwrite d6/f24 [0,4194304] 0 2024-04-18T10:42:40.332 INFO:tasks.workunit.client.0.smithi040.stdout:5/84: rmdir d0 39 2024-04-18T10:42:40.334 INFO:tasks.workunit.client.0.smithi040.stdout:4/97: write d2/d3/d4/f12 [1090343,80045] 0 2024-04-18T10:42:40.338 INFO:tasks.workunit.client.0.smithi040.stdout:8/100: creat d2/d15/d18/f21 x:0 0 0 2024-04-18T10:42:40.338 INFO:tasks.workunit.client.0.smithi040.stdout:1/105: getdents d1/d1c 0 2024-04-18T10:42:40.340 INFO:tasks.workunit.client.0.smithi040.stdout:6/102: creat df/d17/d19/f28 x:0 0 0 2024-04-18T10:42:40.344 INFO:tasks.workunit.client.0.smithi040.stdout:3/127: mkdir d1/d2/d29 0 2024-04-18T10:42:40.345 INFO:tasks.workunit.client.0.smithi040.stdout:9/190: symlink d2/d3/l47 0 2024-04-18T10:42:40.345 INFO:tasks.workunit.client.0.smithi040.stdout:3/128: read - d1/d2/f17 zero size 2024-04-18T10:42:40.348 INFO:tasks.workunit.client.0.smithi040.stdout:5/85: dread - d0/d3/f1a zero size 2024-04-18T10:42:40.348 INFO:tasks.workunit.client.0.smithi040.stdout:2/58: getdents . 0 2024-04-18T10:42:40.349 INFO:tasks.workunit.client.0.smithi040.stdout:1/106: mkdir d1/d16/d27 0 2024-04-18T10:42:40.350 INFO:tasks.workunit.client.0.smithi040.stdout:2/59: chown c6 21599524 1 2024-04-18T10:42:40.350 INFO:tasks.workunit.client.0.smithi040.stdout:5/86: mkdir d0/d1e 0 2024-04-18T10:42:40.351 INFO:tasks.workunit.client.0.smithi040.stdout:3/129: mknod d1/d7/d26/c2a 0 2024-04-18T10:42:40.351 INFO:tasks.workunit.client.0.smithi040.stdout:0/108: dwrite dd/df/f1e [4194304,4194304] 0 2024-04-18T10:42:40.352 INFO:tasks.workunit.client.0.smithi040.stdout:7/126: getdents d6/d25/d28 0 2024-04-18T10:42:40.352 INFO:tasks.workunit.client.0.smithi040.stdout:2/60: write f4 [831139,23177] 0 2024-04-18T10:42:40.353 INFO:tasks.workunit.client.0.smithi040.stdout:5/87: write d0/f1b [244243,122293] 0 2024-04-18T10:42:40.354 INFO:tasks.workunit.client.0.smithi040.stdout:8/101: getdents d2/d15 0 2024-04-18T10:42:40.356 INFO:tasks.workunit.client.0.smithi040.stdout:8/102: write d2/d10/d14/f1c [666958,104748] 0 2024-04-18T10:42:40.359 INFO:tasks.workunit.client.0.smithi040.stdout:9/191: link d2/f19 d2/d3/d22/d2e/d32/f48 0 2024-04-18T10:42:40.360 INFO:tasks.workunit.client.0.smithi040.stdout:2/61: dread f8 [0,4194304] 0 2024-04-18T10:42:40.360 INFO:tasks.workunit.client.0.smithi040.stdout:0/109: unlink dd/l17 0 2024-04-18T10:42:40.362 INFO:tasks.workunit.client.0.smithi040.stdout:7/127: dwrite d6/f20 [0,4194304] 0 2024-04-18T10:42:40.363 INFO:tasks.workunit.client.0.smithi040.stdout:5/88: unlink d0/d3/cf 0 2024-04-18T10:42:40.364 INFO:tasks.workunit.client.0.smithi040.stdout:4/98: write d2/f9 [2515761,126920] 0 2024-04-18T10:42:40.364 INFO:tasks.workunit.client.0.smithi040.stdout:2/62: dread f9 [0,4194304] 0 2024-04-18T10:42:40.367 INFO:tasks.workunit.client.0.smithi040.stdout:8/103: unlink d2/f11 0 2024-04-18T10:42:40.370 INFO:tasks.workunit.client.0.smithi040.stdout:7/128: dread d6/f22 [0,4194304] 0 2024-04-18T10:42:40.372 INFO:tasks.workunit.client.0.smithi040.stdout:2/63: mkdir dd 0 2024-04-18T10:42:40.373 INFO:tasks.workunit.client.0.smithi040.stdout:3/130: rmdir d1/d2/d29 0 2024-04-18T10:42:40.375 INFO:tasks.workunit.client.0.smithi040.stdout:2/64: read f9 [649857,27962] 0 2024-04-18T10:42:40.375 INFO:tasks.workunit.client.0.smithi040.stdout:8/104: unlink d2/d10/d14/f1c 0 2024-04-18T10:42:40.376 INFO:tasks.workunit.client.0.smithi040.stdout:9/192: link d2/d3/f41 d2/dc/f49 0 2024-04-18T10:42:40.376 INFO:tasks.workunit.client.0.smithi040.stdout:5/89: dwrite d0/d3/f13 [0,4194304] 0 2024-04-18T10:42:40.377 INFO:tasks.workunit.client.0.smithi040.stdout:0/110: getdents dd/df/d19 0 2024-04-18T10:42:40.377 INFO:tasks.workunit.client.0.smithi040.stdout:3/131: write d1/d2/f1f [2941741,7787] 0 2024-04-18T10:42:40.377 INFO:tasks.workunit.client.0.smithi040.stdout:2/65: chown f4 193726 1 2024-04-18T10:42:40.378 INFO:tasks.workunit.client.0.smithi040.stdout:6/103: sync 2024-04-18T10:42:40.378 INFO:tasks.workunit.client.0.smithi040.stdout:4/99: dwrite d2/f9 [4194304,4194304] 0 2024-04-18T10:42:40.379 INFO:tasks.workunit.client.0.smithi040.stdout:7/129: mkdir d6/d25/d28/d2c/d2d 0 2024-04-18T10:42:40.380 INFO:tasks.workunit.client.0.smithi040.stdout:4/100: stat d2 0 2024-04-18T10:42:40.381 INFO:tasks.workunit.client.0.smithi040.stdout:9/193: fdatasync d2/d7/f2c 0 2024-04-18T10:42:40.381 INFO:tasks.workunit.client.0.smithi040.stdout:0/111: write dd/df/d19/f22 [4123081,94296] 0 2024-04-18T10:42:40.384 INFO:tasks.workunit.client.0.smithi040.stdout:6/104: creat df/d17/f29 x:0 0 0 2024-04-18T10:42:40.385 INFO:tasks.workunit.client.0.smithi040.stdout:7/130: dread d6/f24 [0,4194304] 0 2024-04-18T10:42:40.385 INFO:tasks.workunit.client.0.smithi040.stdout:1/107: write d1/d16/f1b [955383,89681] 0 2024-04-18T10:42:40.385 INFO:tasks.workunit.client.0.smithi040.stdout:6/105: read - df/d17/d19/f1e zero size 2024-04-18T10:42:40.386 INFO:tasks.workunit.client.0.smithi040.stdout:6/106: write df/d17/f22 [1015584,60537] 0 2024-04-18T10:42:40.404 INFO:tasks.workunit.client.0.smithi040.stdout:3/132: symlink d1/d2/d16/d18/l2b 0 2024-04-18T10:42:40.404 INFO:tasks.workunit.client.0.smithi040.stdout:6/107: dread df/f12 [0,4194304] 0 2024-04-18T10:42:40.404 INFO:tasks.workunit.client.0.smithi040.stdout:2/66: creat dd/fe x:0 0 0 2024-04-18T10:42:40.405 INFO:tasks.workunit.client.0.smithi040.stdout:4/101: mkdir d2/d3/d4/dd/d14 0 2024-04-18T10:42:40.421 INFO:tasks.workunit.client.0.smithi040.stdout:0/112: mknod dd/df/c25 0 2024-04-18T10:42:40.422 INFO:tasks.workunit.client.0.smithi040.stdout:6/108: dread - df/d17/d19/f24 zero size 2024-04-18T10:42:40.422 INFO:tasks.workunit.client.0.smithi040.stdout:7/131: rmdir d6 39 2024-04-18T10:42:40.422 INFO:tasks.workunit.client.0.smithi040.stdout:1/108: rename d1/d16/f1d to d1/d16/d27/f28 0 2024-04-18T10:42:40.423 INFO:tasks.workunit.client.0.smithi040.stdout:6/109: dread - df/f13 zero size 2024-04-18T10:42:40.423 INFO:tasks.workunit.client.0.smithi040.stdout:6/110: stat l6 0 2024-04-18T10:42:40.424 INFO:tasks.workunit.client.0.smithi040.stdout:6/111: rename df/d17/d19 to df/d17/d19/d2a 22 2024-04-18T10:42:40.433 INFO:tasks.workunit.client.0.smithi040.stdout:4/102: stat d2/d3/d4/dd/d14 0 2024-04-18T10:42:40.486 INFO:tasks.workunit.client.0.smithi040.stdout:9/194: sync 2024-04-18T10:42:40.562 INFO:tasks.workunit.client.0.smithi040.stdout:3/133: creat d1/d2/d16/f2c x:0 0 0 2024-04-18T10:42:40.562 INFO:tasks.workunit.client.0.smithi040.stdout:2/67: truncate f9 475391 0 2024-04-18T10:42:40.563 INFO:tasks.workunit.client.0.smithi040.stdout:8/105: getdents d2/d10 0 2024-04-18T10:42:40.565 INFO:tasks.workunit.client.0.smithi040.stdout:0/113: rmdir dd 39 2024-04-18T10:42:40.568 INFO:tasks.workunit.client.0.smithi040.stdout:1/109: creat d1/d16/f29 x:0 0 0 2024-04-18T10:42:40.568 INFO:tasks.workunit.client.0.smithi040.stdout:6/112: symlink df/l2b 0 2024-04-18T10:42:40.570 INFO:tasks.workunit.client.0.smithi040.stdout:8/106: dwrite d2/d15/d18/f21 [0,4194304] 0 2024-04-18T10:42:40.572 INFO:tasks.workunit.client.0.smithi040.stdout:3/134: creat d1/d2/d16/f2d x:0 0 0 2024-04-18T10:42:40.574 INFO:tasks.workunit.client.0.smithi040.stdout:7/132: stat d6/d25/c1a 0 2024-04-18T10:42:40.574 INFO:tasks.workunit.client.0.smithi040.stdout:8/107: dread d2/d15/d18/f21 [0,4194304] 0 2024-04-18T10:42:40.577 INFO:tasks.workunit.client.0.smithi040.stdout:1/110: creat d1/d16/f2a x:0 0 0 2024-04-18T10:42:40.582 INFO:tasks.workunit.client.0.smithi040.stdout:3/135: creat d1/d2/d16/f2e x:0 0 0 2024-04-18T10:42:40.582 INFO:tasks.workunit.client.0.smithi040.stdout:0/114: creat dd/df/f26 x:0 0 0 2024-04-18T10:42:40.584 INFO:tasks.workunit.client.0.smithi040.stdout:8/108: mkdir d2/d22 0 2024-04-18T10:42:40.585 INFO:tasks.workunit.client.0.smithi040.stdout:1/111: mkdir d1/d1c/d2b 0 2024-04-18T10:42:40.585 INFO:tasks.workunit.client.0.smithi040.stdout:6/113: dwrite df/f25 [4194304,4194304] 0 2024-04-18T10:42:40.586 INFO:tasks.workunit.client.0.smithi040.stdout:4/103: rmdir d2/d13 0 2024-04-18T10:42:40.586 INFO:tasks.workunit.client.0.smithi040.stdout:0/115: truncate dd/df/f23 210376 0 2024-04-18T10:42:40.587 INFO:tasks.workunit.client.0.smithi040.stdout:8/109: write d2/d15/d18/f1e [12692,97993] 0 2024-04-18T10:42:40.587 INFO:tasks.workunit.client.0.smithi040.stdout:9/195: creat d2/d3/f4a x:0 0 0 2024-04-18T10:42:40.589 INFO:tasks.workunit.client.0.smithi040.stdout:7/133: symlink d6/d25/d28/d2c/d2d/l2e 0 2024-04-18T10:42:40.589 INFO:tasks.workunit.client.0.smithi040.stdout:9/196: write d2/d7/f1b [1806945,121134] 0 2024-04-18T10:42:40.592 INFO:tasks.workunit.client.0.smithi040.stdout:0/116: dread dd/f10 [0,4194304] 0 2024-04-18T10:42:40.592 INFO:tasks.workunit.client.0.smithi040.stdout:6/114: dread df/d17/f22 [0,4194304] 0 2024-04-18T10:42:40.597 INFO:tasks.workunit.client.0.smithi040.stdout:1/112: rmdir d1/d1c 39 2024-04-18T10:42:40.598 INFO:tasks.workunit.client.0.smithi040.stdout:4/104: symlink d2/d3/l15 0 2024-04-18T10:42:40.598 INFO:tasks.workunit.client.0.smithi040.stdout:0/117: dwrite dd/df/f13 [4194304,4194304] 0 2024-04-18T10:42:40.598 INFO:tasks.workunit.client.0.smithi040.stdout:1/113: read d1/d16/f21 [231184,22640] 0 2024-04-18T10:42:40.601 INFO:tasks.workunit.client.0.smithi040.stdout:3/136: link d1/d7/f15 d1/d7/f2f 0 2024-04-18T10:42:40.601 INFO:tasks.workunit.client.0.smithi040.stdout:7/134: creat d6/d25/d28/f2f x:0 0 0 2024-04-18T10:42:40.602 INFO:tasks.workunit.client.0.smithi040.stdout:3/137: write d1/d2/d16/f2e [512533,106278] 0 2024-04-18T10:42:40.604 INFO:tasks.workunit.client.0.smithi040.stdout:4/105: dread d2/f9 [0,4194304] 0 2024-04-18T10:42:40.604 INFO:tasks.workunit.client.0.smithi040.stdout:6/115: read f4 [981781,73] 0 2024-04-18T10:42:40.608 INFO:tasks.workunit.client.0.smithi040.stdout:4/106: dwrite d2/f9 [4194304,4194304] 0 2024-04-18T10:42:40.610 INFO:tasks.workunit.client.0.smithi040.stdout:4/107: truncate d2/d3/d4/f12 1655941 0 2024-04-18T10:42:40.610 INFO:tasks.workunit.client.0.smithi040.stdout:4/108: fsync d2/d3/d4/fa 0 2024-04-18T10:42:40.611 INFO:tasks.workunit.client.0.smithi040.stdout:8/110: mknod d2/d5/c23 0 2024-04-18T10:42:40.611 INFO:tasks.workunit.client.0.smithi040.stdout:0/118: symlink dd/df/d19/l27 0 2024-04-18T10:42:40.612 INFO:tasks.workunit.client.0.smithi040.stdout:4/109: fsync d2/d3/d4/f12 0 2024-04-18T10:42:40.613 INFO:tasks.workunit.client.0.smithi040.stdout:4/110: write d2/d3/d4/fa [8860647,99862] 0 2024-04-18T10:42:40.614 INFO:tasks.workunit.client.0.smithi040.stdout:4/111: readlink d2/l7 0 2024-04-18T10:42:40.614 INFO:tasks.workunit.client.0.smithi040.stdout:3/138: unlink d1/d7/f2f 0 2024-04-18T10:42:40.615 INFO:tasks.workunit.client.0.smithi040.stdout:3/139: chown d1/lf 26671869 1 2024-04-18T10:42:40.616 INFO:tasks.workunit.client.0.smithi040.stdout:0/119: dread dd/f1d [0,4194304] 0 2024-04-18T10:42:40.617 INFO:tasks.workunit.client.0.smithi040.stdout:7/135: rename d6/c11 to d6/d25/d28/c30 0 2024-04-18T10:42:40.618 INFO:tasks.workunit.client.0.smithi040.stdout:6/116: write df/f12 [1277915,11712] 0 2024-04-18T10:42:40.618 INFO:tasks.workunit.client.0.smithi040.stdout:4/112: dread d2/f9 [0,4194304] 0 2024-04-18T10:42:40.621 INFO:tasks.workunit.client.0.smithi040.stdout:1/114: mknod d1/d1c/c2c 0 2024-04-18T10:42:40.624 INFO:tasks.workunit.client.0.smithi040.stdout:8/111: symlink d2/d10/d14/l24 0 2024-04-18T10:42:40.627 INFO:tasks.workunit.client.0.smithi040.stdout:8/112: dread d2/d15/d18/f1e [0,4194304] 0 2024-04-18T10:42:40.627 INFO:tasks.workunit.client.0.smithi040.stdout:0/120: mkdir dd/df/d19/d28 0 2024-04-18T10:42:40.636 INFO:tasks.workunit.client.0.smithi040.stdout:8/113: chown d2/d15/d18/l1d 20 1 2024-04-18T10:42:40.637 INFO:tasks.workunit.client.0.smithi040.stdout:1/115: mkdir d1/d16/d27/d2d 0 2024-04-18T10:42:40.638 INFO:tasks.workunit.client.0.smithi040.stdout:8/114: readlink d2/d5/d9/l1a 0 2024-04-18T10:42:40.638 INFO:tasks.workunit.client.0.smithi040.stdout:6/117: dread df/d17/f22 [0,4194304] 0 2024-04-18T10:42:40.641 INFO:tasks.workunit.client.0.smithi040.stdout:4/113: symlink d2/d3/d4/dd/d14/l16 0 2024-04-18T10:42:40.642 INFO:tasks.workunit.client.0.smithi040.stdout:0/121: creat dd/df/d19/f29 x:0 0 0 2024-04-18T10:42:40.644 INFO:tasks.workunit.client.0.smithi040.stdout:6/118: mknod df/d17/c2c 0 2024-04-18T10:42:40.644 INFO:tasks.workunit.client.0.smithi040.stdout:0/122: fsync dd/df/d19/f22 0 2024-04-18T10:42:40.645 INFO:tasks.workunit.client.0.smithi040.stdout:1/116: dwrite d1/f1e [0,4194304] 0 2024-04-18T10:42:40.646 INFO:tasks.workunit.client.0.smithi040.stdout:8/115: dread d2/d15/d18/f1e [0,4194304] 0 2024-04-18T10:42:40.647 INFO:tasks.workunit.client.0.smithi040.stdout:0/123: write dd/df/f23 [123728,4807] 0 2024-04-18T10:42:40.647 INFO:tasks.workunit.client.0.smithi040.stdout:6/119: creat df/f2d x:0 0 0 2024-04-18T10:42:40.649 INFO:tasks.workunit.client.0.smithi040.stdout:0/124: dread - dd/df/f26 zero size 2024-04-18T10:42:40.649 INFO:tasks.workunit.client.0.smithi040.stdout:8/116: dread d2/d10/d14/f16 [0,4194304] 0 2024-04-18T10:42:40.649 INFO:tasks.workunit.client.0.smithi040.stdout:1/117: mkdir d1/d16/d27/d2e 0 2024-04-18T10:42:40.650 INFO:tasks.workunit.client.0.smithi040.stdout:0/125: fdatasync dd/df/d19/f22 0 2024-04-18T10:42:40.650 INFO:tasks.workunit.client.0.smithi040.stdout:1/118: read d1/d16/f21 [2754779,48013] 0 2024-04-18T10:42:40.651 INFO:tasks.workunit.client.0.smithi040.stdout:6/120: symlink df/d17/l2e 0 2024-04-18T10:42:40.653 INFO:tasks.workunit.client.0.smithi040.stdout:6/121: stat df/d17/d19/f28 0 2024-04-18T10:42:40.653 INFO:tasks.workunit.client.0.smithi040.stdout:0/126: chown dd/c20 1 1 2024-04-18T10:42:40.654 INFO:tasks.workunit.client.0.smithi040.stdout:1/119: symlink d1/d16/d27/l2f 0 2024-04-18T10:42:40.655 INFO:tasks.workunit.client.0.smithi040.stdout:1/120: chown d1/d1c/c2c 59 1 2024-04-18T10:42:40.655 INFO:tasks.workunit.client.0.smithi040.stdout:0/127: read dd/df/f23 [48882,36661] 0 2024-04-18T10:42:40.656 INFO:tasks.workunit.client.0.smithi040.stdout:6/122: creat df/f2f x:0 0 0 2024-04-18T10:42:40.656 INFO:tasks.workunit.client.0.smithi040.stdout:8/117: dwrite d2/d10/f20 [0,4194304] 0 2024-04-18T10:42:40.657 INFO:tasks.workunit.client.0.smithi040.stdout:6/123: readlink df/l11 0 2024-04-18T10:42:40.659 INFO:tasks.workunit.client.0.smithi040.stdout:6/124: creat df/d17/d19/f30 x:0 0 0 2024-04-18T10:42:40.660 INFO:tasks.workunit.client.0.smithi040.stdout:0/128: dread dd/df/d19/f1a [0,4194304] 0 2024-04-18T10:42:40.660 INFO:tasks.workunit.client.0.smithi040.stdout:1/121: creat d1/f30 x:0 0 0 2024-04-18T10:42:40.661 INFO:tasks.workunit.client.0.smithi040.stdout:1/122: fsync d1/f15 0 2024-04-18T10:42:40.661 INFO:tasks.workunit.client.0.smithi040.stdout:1/123: fdatasync d1/f4 0 2024-04-18T10:42:40.664 INFO:tasks.workunit.client.0.smithi040.stdout:0/129: getdents dd/df/d19/d28 0 2024-04-18T10:42:40.667 INFO:tasks.workunit.client.0.smithi040.stdout:0/130: mknod dd/df/d19/c2a 0 2024-04-18T10:42:40.668 INFO:tasks.workunit.client.0.smithi040.stdout:1/124: dwrite d1/f15 [0,4194304] 0 2024-04-18T10:42:40.670 INFO:tasks.workunit.client.0.smithi040.stdout:0/131: write dd/f10 [398203,69452] 0 2024-04-18T10:42:40.670 INFO:tasks.workunit.client.0.smithi040.stdout:1/125: mknod d1/d1c/c31 0 2024-04-18T10:42:40.672 INFO:tasks.workunit.client.0.smithi040.stdout:0/132: creat dd/df/f2b x:0 0 0 2024-04-18T10:42:40.675 INFO:tasks.workunit.client.0.smithi040.stdout:0/133: symlink dd/df/d19/d28/l2c 0 2024-04-18T10:42:40.675 INFO:tasks.workunit.client.0.smithi040.stdout:0/134: readlink dd/df/d19/l24 0 2024-04-18T10:42:40.677 INFO:tasks.workunit.client.0.smithi040.stdout:0/135: creat dd/df/d19/d28/f2d x:0 0 0 2024-04-18T10:42:40.678 INFO:tasks.workunit.client.0.smithi040.stdout:0/136: write dd/df/d19/f29 [491534,10114] 0 2024-04-18T10:42:40.685 INFO:tasks.workunit.client.0.smithi040.stdout:0/137: dwrite dd/df/f13 [0,4194304] 0 2024-04-18T10:42:40.687 INFO:tasks.workunit.client.0.smithi040.stdout:7/136: sync 2024-04-18T10:42:40.688 INFO:tasks.workunit.client.0.smithi040.stdout:7/137: chown d6/f24 14098 1 2024-04-18T10:42:40.690 INFO:tasks.workunit.client.0.smithi040.stdout:0/138: dread dd/f1d [0,4194304] 0 2024-04-18T10:42:40.695 INFO:tasks.workunit.client.0.smithi040.stdout:7/138: dwrite d6/d25/f19 [4194304,4194304] 0 2024-04-18T10:42:40.698 INFO:tasks.workunit.client.0.smithi040.stdout:7/139: unlink d6/ff 0 2024-04-18T10:42:40.702 INFO:tasks.workunit.client.0.smithi040.stdout:7/140: rename d6/d25/f27 to d6/d25/d28/f31 0 2024-04-18T10:42:40.703 INFO:tasks.workunit.client.0.smithi040.stdout:7/141: fsync d6/f24 0 2024-04-18T10:42:40.706 INFO:tasks.workunit.client.0.smithi040.stdout:7/142: creat d6/f32 x:0 0 0 2024-04-18T10:42:40.707 INFO:tasks.workunit.client.0.smithi040.stdout:7/143: chown d6/d25/c2a 909128 1 2024-04-18T10:42:40.708 INFO:tasks.workunit.client.0.smithi040.stdout:7/144: creat d6/d25/d28/d2c/f33 x:0 0 0 2024-04-18T10:42:40.712 INFO:tasks.workunit.client.0.smithi040.stdout:7/145: rename d6/c7 to d6/d25/d28/d2c/c34 0 2024-04-18T10:42:40.716 INFO:tasks.workunit.client.0.smithi040.stdout:7/146: dread d6/d25/f19 [4194304,4194304] 0 2024-04-18T10:42:40.720 INFO:tasks.workunit.client.0.smithi040.stdout:7/147: symlink d6/d25/d28/d2c/d2d/l35 0 2024-04-18T10:42:40.721 INFO:tasks.workunit.client.0.smithi040.stdout:7/148: chown d6/d25/f21 0 1 2024-04-18T10:42:40.735 INFO:tasks.workunit.client.0.smithi040.stdout:8/118: sync 2024-04-18T10:42:40.741 INFO:tasks.workunit.client.0.smithi040.stdout:5/90: truncate d0/d3/f13 623812 0 2024-04-18T10:42:40.743 INFO:tasks.workunit.client.0.smithi040.stdout:2/68: dread f9 [0,4194304] 0 2024-04-18T10:42:40.746 INFO:tasks.workunit.client.0.smithi040.stdout:2/69: rmdir dd 39 2024-04-18T10:42:40.748 INFO:tasks.workunit.client.0.smithi040.stdout:2/70: unlink c0 0 2024-04-18T10:42:40.749 INFO:tasks.workunit.client.0.smithi040.stdout:1/126: fsync d1/d16/f2a 0 2024-04-18T10:42:40.750 INFO:tasks.workunit.client.0.smithi040.stdout:5/91: dwrite d0/d3/f7 [0,4194304] 0 2024-04-18T10:42:40.751 INFO:tasks.workunit.client.0.smithi040.stdout:2/71: fdatasync f9 0 2024-04-18T10:42:40.752 INFO:tasks.workunit.client.0.smithi040.stdout:2/72: chown f9 191 1 2024-04-18T10:42:40.752 INFO:tasks.workunit.client.0.smithi040.stdout:1/127: dread d1/d1c/f24 [0,4194304] 0 2024-04-18T10:42:40.754 INFO:tasks.workunit.client.0.smithi040.stdout:5/92: rename d0/f2 to d0/d1c/f1f 0 2024-04-18T10:42:40.759 INFO:tasks.workunit.client.0.smithi040.stdout:1/128: mkdir d1/d1c/d2b/d32 0 2024-04-18T10:42:40.759 INFO:tasks.workunit.client.0.smithi040.stdout:1/129: stat d1/fe 0 2024-04-18T10:42:40.759 INFO:tasks.workunit.client.0.smithi040.stdout:5/93: symlink d0/d1e/l20 0 2024-04-18T10:42:40.761 INFO:tasks.workunit.client.0.smithi040.stdout:5/94: write d0/d3/f17 [407472,8466] 0 2024-04-18T10:42:40.761 INFO:tasks.workunit.client.0.smithi040.stdout:5/95: fdatasync d0/d3/f1a 0 2024-04-18T10:42:40.762 INFO:tasks.workunit.client.0.smithi040.stdout:1/130: mknod d1/d16/d27/d2d/c33 0 2024-04-18T10:42:40.762 INFO:tasks.workunit.client.0.smithi040.stdout:6/125: sync 2024-04-18T10:42:40.763 INFO:tasks.workunit.client.0.smithi040.stdout:1/131: chown d1/d1c 167191018 1 2024-04-18T10:42:40.763 INFO:tasks.workunit.client.0.smithi040.stdout:5/96: stat d0/d3/c11 0 2024-04-18T10:42:40.763 INFO:tasks.workunit.client.0.smithi040.stdout:1/132: readlink d1/l12 0 2024-04-18T10:42:40.764 INFO:tasks.workunit.client.0.smithi040.stdout:1/133: chown d1/c2 51925 1 2024-04-18T10:42:40.764 INFO:tasks.workunit.client.0.smithi040.stdout:6/126: creat df/d17/f31 x:0 0 0 2024-04-18T10:42:40.764 INFO:tasks.workunit.client.0.smithi040.stdout:5/97: truncate d0/d3/f17 597192 0 2024-04-18T10:42:40.766 INFO:tasks.workunit.client.0.smithi040.stdout:9/197: truncate d2/d7/f29 1136538 0 2024-04-18T10:42:40.768 INFO:tasks.workunit.client.0.smithi040.stdout:5/98: fdatasync d0/d3/f7 0 2024-04-18T10:42:40.772 INFO:tasks.workunit.client.0.smithi040.stdout:5/99: mkdir d0/d21 0 2024-04-18T10:42:40.773 INFO:tasks.workunit.client.0.smithi040.stdout:5/100: stat d0/d3/f7 0 2024-04-18T10:42:40.775 INFO:tasks.workunit.client.0.smithi040.stdout:3/140: write d1/d7/d12/f22 [1861418,119942] 0 2024-04-18T10:42:40.777 INFO:tasks.workunit.client.0.smithi040.stdout:9/198: link d2/c28 d2/d3/d22/d2e/d35/c4b 0 2024-04-18T10:42:40.778 INFO:tasks.workunit.client.0.smithi040.stdout:5/101: creat d0/d21/f22 x:0 0 0 2024-04-18T10:42:40.778 INFO:tasks.workunit.client.0.smithi040.stdout:5/102: truncate d0/f1b 742369 0 2024-04-18T10:42:40.779 INFO:tasks.workunit.client.0.smithi040.stdout:9/199: creat d2/d3/d22/d2e/d35/f4c x:0 0 0 2024-04-18T10:42:40.781 INFO:tasks.workunit.client.0.smithi040.stdout:9/200: mknod d2/d3/d22/d2e/d35/d40/c4d 0 2024-04-18T10:42:40.799 INFO:tasks.workunit.client.0.smithi040.stdout:4/114: truncate d2/f9 1114871 0 2024-04-18T10:42:40.801 INFO:tasks.workunit.client.0.smithi040.stdout:5/103: dwrite d0/d3/f1a [0,4194304] 0 2024-04-18T10:42:40.802 INFO:tasks.workunit.client.0.smithi040.stdout:4/115: read d2/d3/d4/f12 [1143044,49803] 0 2024-04-18T10:42:40.802 INFO:tasks.workunit.client.0.smithi040.stdout:7/149: rename d6/d25/d28/f31 to d6/d25/d28/f36 0 2024-04-18T10:42:40.803 INFO:tasks.workunit.client.0.smithi040.stdout:8/119: truncate d2/d10/d14/f16 552847 0 2024-04-18T10:42:40.805 INFO:tasks.workunit.client.0.smithi040.stdout:2/73: truncate f9 1082624 0 2024-04-18T10:42:40.807 INFO:tasks.workunit.client.0.smithi040.stdout:6/127: getdents df/d17 0 2024-04-18T10:42:40.808 INFO:tasks.workunit.client.0.smithi040.stdout:1/134: truncate d1/fa 2056626 0 2024-04-18T10:42:40.809 INFO:tasks.workunit.client.0.smithi040.stdout:6/128: dread - df/f21 zero size 2024-04-18T10:42:40.810 INFO:tasks.workunit.client.0.smithi040.stdout:5/104: dread d0/f1 [0,4194304] 0 2024-04-18T10:42:40.813 INFO:tasks.workunit.client.0.smithi040.stdout:8/120: creat d2/d15/f25 x:0 0 0 2024-04-18T10:42:40.813 INFO:tasks.workunit.client.0.smithi040.stdout:4/116: dread d2/d3/d4/fa [4194304,4194304] 0 2024-04-18T10:42:40.813 INFO:tasks.workunit.client.0.smithi040.stdout:7/150: dwrite d6/d25/f21 [0,4194304] 0 2024-04-18T10:42:40.814 INFO:tasks.workunit.client.0.smithi040.stdout:4/117: chown d2/l5 90765 1 2024-04-18T10:42:40.817 INFO:tasks.workunit.client.0.smithi040.stdout:6/129: creat df/d17/d19/f32 x:0 0 0 2024-04-18T10:42:40.818 INFO:tasks.workunit.client.0.smithi040.stdout:6/130: read - df/f20 zero size 2024-04-18T10:42:40.818 INFO:tasks.workunit.client.0.smithi040.stdout:5/105: write d0/d1c/f1f [1393168,126719] 0 2024-04-18T10:42:40.820 INFO:tasks.workunit.client.0.smithi040.stdout:5/106: chown d0/d1c/f1f 2 1 2024-04-18T10:42:40.823 INFO:tasks.workunit.client.0.smithi040.stdout:1/135: dwrite d1/d1c/f24 [0,4194304] 0 2024-04-18T10:42:40.824 INFO:tasks.workunit.client.0.smithi040.stdout:4/118: symlink d2/d3/l17 0 2024-04-18T10:42:40.825 INFO:tasks.workunit.client.0.smithi040.stdout:0/139: sync 2024-04-18T10:42:40.826 INFO:tasks.workunit.client.0.smithi040.stdout:9/201: link d2/d7/f2a d2/d3/f4e 0 2024-04-18T10:42:40.828 INFO:tasks.workunit.client.0.smithi040.stdout:9/202: write d2/d3/d22/f3a [1001298,76653] 0 2024-04-18T10:42:40.830 INFO:tasks.workunit.client.0.smithi040.stdout:5/107: dwrite d0/d3/f17 [0,4194304] 0 2024-04-18T10:42:40.835 INFO:tasks.workunit.client.0.smithi040.stdout:1/136: creat d1/d16/d27/f34 x:0 0 0 2024-04-18T10:42:40.835 INFO:tasks.workunit.client.0.smithi040.stdout:1/137: dread - d1/d16/f29 zero size 2024-04-18T10:42:40.836 INFO:tasks.workunit.client.0.smithi040.stdout:0/140: unlink dd/df/c25 0 2024-04-18T10:42:40.836 INFO:tasks.workunit.client.0.smithi040.stdout:0/141: readlink lc 0 2024-04-18T10:42:40.836 INFO:tasks.workunit.client.0.smithi040.stdout:1/138: write d1/d16/f29 [231122,128796] 0 2024-04-18T10:42:40.837 INFO:tasks.workunit.client.0.smithi040.stdout:9/203: symlink d2/d7/l4f 0 2024-04-18T10:42:40.837 INFO:tasks.workunit.client.0.smithi040.stdout:9/204: read - d2/d3/f2b zero size 2024-04-18T10:42:40.838 INFO:tasks.workunit.client.0.smithi040.stdout:0/142: dread dd/f10 [0,4194304] 0 2024-04-18T10:42:40.838 INFO:tasks.workunit.client.0.smithi040.stdout:9/205: readlink d2/dd/l3f 0 2024-04-18T10:42:40.840 INFO:tasks.workunit.client.0.smithi040.stdout:7/151: rename d6/d25/c2a to d6/c37 0 2024-04-18T10:42:40.842 INFO:tasks.workunit.client.0.smithi040.stdout:1/139: rmdir d1/d1c 39 2024-04-18T10:42:40.843 INFO:tasks.workunit.client.0.smithi040.stdout:9/206: mknod d2/dc/d46/c50 0 2024-04-18T10:42:40.843 INFO:tasks.workunit.client.0.smithi040.stdout:4/119: creat d2/d3/d4/f18 x:0 0 0 2024-04-18T10:42:40.844 INFO:tasks.workunit.client.0.smithi040.stdout:7/152: mkdir d6/d25/d28/d38 0 2024-04-18T10:42:40.845 INFO:tasks.workunit.client.0.smithi040.stdout:0/143: link dd/df/f13 dd/f2e 0 2024-04-18T10:42:40.847 INFO:tasks.workunit.client.0.smithi040.stdout:9/207: write d2/d7/f2a [3840752,46965] 0 2024-04-18T10:42:40.849 INFO:tasks.workunit.client.0.smithi040.stdout:5/108: fdatasync d0/d3/f17 0 2024-04-18T10:42:40.850 INFO:tasks.workunit.client.0.smithi040.stdout:6/131: rmdir df 39 2024-04-18T10:42:40.851 INFO:tasks.workunit.client.0.smithi040.stdout:5/109: write d0/f1 [337732,15891] 0 2024-04-18T10:42:40.851 INFO:tasks.workunit.client.0.smithi040.stdout:9/208: rmdir d2/dd 39 2024-04-18T10:42:40.853 INFO:tasks.workunit.client.0.smithi040.stdout:7/153: rename d6/l17 to d6/d25/d28/d38/l39 0 2024-04-18T10:42:40.854 INFO:tasks.workunit.client.0.smithi040.stdout:8/121: write d2/d5/d9/fb [24219,29798] 0 2024-04-18T10:42:40.854 INFO:tasks.workunit.client.0.smithi040.stdout:0/144: dwrite dd/df/d19/f29 [0,4194304] 0 2024-04-18T10:42:40.855 INFO:tasks.workunit.client.0.smithi040.stdout:5/110: chown d0/d3/f5 18069 1 2024-04-18T10:42:40.857 INFO:tasks.workunit.client.0.smithi040.stdout:9/209: creat d2/d7/f51 x:0 0 0 2024-04-18T10:42:40.858 INFO:tasks.workunit.client.0.smithi040.stdout:7/154: chown d6/d25/d28/c30 1468435745 1 2024-04-18T10:42:40.860 INFO:tasks.workunit.client.0.smithi040.stdout:6/132: creat df/d17/d19/f33 x:0 0 0 2024-04-18T10:42:40.860 INFO:tasks.workunit.client.0.smithi040.stdout:2/74: dwrite f8 [4194304,4194304] 0 2024-04-18T10:42:40.862 INFO:tasks.workunit.client.0.smithi040.stdout:5/111: creat d0/f23 x:0 0 0 2024-04-18T10:42:40.862 INFO:tasks.workunit.client.0.smithi040.stdout:2/75: read f8 [4027355,19289] 0 2024-04-18T10:42:40.863 INFO:tasks.workunit.client.0.smithi040.stdout:6/133: chown df/d17/d19/f30 3202701 1 2024-04-18T10:42:40.864 INFO:tasks.workunit.client.0.smithi040.stdout:8/122: creat d2/d10/f26 x:0 0 0 2024-04-18T10:42:40.864 INFO:tasks.workunit.client.0.smithi040.stdout:0/145: mknod dd/df/c2f 0 2024-04-18T10:42:40.866 INFO:tasks.workunit.client.0.smithi040.stdout:7/155: fdatasync d6/d25/d28/f36 0 2024-04-18T10:42:40.867 INFO:tasks.workunit.client.0.smithi040.stdout:9/210: dwrite d2/d7/f14 [0,4194304] 0 2024-04-18T10:42:40.869 INFO:tasks.workunit.client.0.smithi040.stdout:5/112: dread d0/d3/f1a [0,4194304] 0 2024-04-18T10:42:40.871 INFO:tasks.workunit.client.0.smithi040.stdout:4/120: dread d2/f9 [0,4194304] 0 2024-04-18T10:42:40.873 INFO:tasks.workunit.client.0.smithi040.stdout:6/134: symlink df/l34 0 2024-04-18T10:42:40.873 INFO:tasks.workunit.client.0.smithi040.stdout:6/135: dread - df/d17/d19/f1e zero size 2024-04-18T10:42:40.876 INFO:tasks.workunit.client.0.smithi040.stdout:0/146: creat dd/df/d19/d28/f30 x:0 0 0 2024-04-18T10:42:40.876 INFO:tasks.workunit.client.0.smithi040.stdout:7/156: creat d6/d25/f3a x:0 0 0 2024-04-18T10:42:40.877 INFO:tasks.workunit.client.0.smithi040.stdout:3/141: sync 2024-04-18T10:42:40.878 INFO:tasks.workunit.client.0.smithi040.stdout:3/142: truncate d1/d2/d16/f2c 376620 0 2024-04-18T10:42:40.878 INFO:tasks.workunit.client.0.smithi040.stdout:9/211: creat d2/d3/d22/d2e/d35/d40/f52 x:0 0 0 2024-04-18T10:42:40.879 INFO:tasks.workunit.client.0.smithi040.stdout:3/143: fsync d1/d2/f1f 0 2024-04-18T10:42:40.879 INFO:tasks.workunit.client.0.smithi040.stdout:5/113: rename d0/d3/c16 to d0/d21/c24 0 2024-04-18T10:42:40.881 INFO:tasks.workunit.client.0.smithi040.stdout:2/76: rename dd/fe to dd/ff 0 2024-04-18T10:42:40.883 INFO:tasks.workunit.client.0.smithi040.stdout:6/136: unlink df/d17/l18 0 2024-04-18T10:42:40.885 INFO:tasks.workunit.client.0.smithi040.stdout:8/123: truncate d2/d10/d14/f16 940794 0 2024-04-18T10:42:40.886 INFO:tasks.workunit.client.0.smithi040.stdout:5/114: dwrite d0/d3/f10 [0,4194304] 0 2024-04-18T10:42:40.889 INFO:tasks.workunit.client.0.smithi040.stdout:3/144: creat d1/d7/d12/f30 x:0 0 0 2024-04-18T10:42:40.891 INFO:tasks.workunit.client.0.smithi040.stdout:2/77: creat dd/f10 x:0 0 0 2024-04-18T10:42:40.892 INFO:tasks.workunit.client.0.smithi040.stdout:6/137: truncate f4 2852279 0 2024-04-18T10:42:40.893 INFO:tasks.workunit.client.0.smithi040.stdout:5/115: dwrite d0/d3/f10 [0,4194304] 0 2024-04-18T10:42:40.896 INFO:tasks.workunit.client.0.smithi040.stdout:7/157: symlink d6/l3b 0 2024-04-18T10:42:40.898 INFO:tasks.workunit.client.0.smithi040.stdout:9/212: creat d2/dd/de/f53 x:0 0 0 2024-04-18T10:42:40.899 INFO:tasks.workunit.client.0.smithi040.stdout:3/145: creat d1/d2/f31 x:0 0 0 2024-04-18T10:42:40.901 INFO:tasks.workunit.client.0.smithi040.stdout:6/138: mkdir df/d17/d35 0 2024-04-18T10:42:40.903 INFO:tasks.workunit.client.0.smithi040.stdout:5/116: creat d0/f25 x:0 0 0 2024-04-18T10:42:40.903 INFO:tasks.workunit.client.0.smithi040.stdout:9/213: write d2/f5 [2305123,120103] 0 2024-04-18T10:42:40.903 INFO:tasks.workunit.client.0.smithi040.stdout:5/117: write d0/d1c/f1d [121535,71878] 0 2024-04-18T10:42:40.905 INFO:tasks.workunit.client.0.smithi040.stdout:0/147: getdents dd/df 0 2024-04-18T10:42:40.907 INFO:tasks.workunit.client.0.smithi040.stdout:3/146: rename d1/d2/d16/f2e to d1/d7/d12/f32 0 2024-04-18T10:42:40.911 INFO:tasks.workunit.client.0.smithi040.stdout:5/118: dwrite d0/d3/f10 [0,4194304] 0 2024-04-18T10:42:40.911 INFO:tasks.workunit.client.0.smithi040.stdout:0/148: rename dd/df/d19/f29 to dd/df/d19/f31 0 2024-04-18T10:42:40.912 INFO:tasks.workunit.client.0.smithi040.stdout:0/149: write dd/df/f15 [5788257,84388] 0 2024-04-18T10:42:40.915 INFO:tasks.workunit.client.0.smithi040.stdout:9/214: creat d2/dd/f54 x:0 0 0 2024-04-18T10:42:40.915 INFO:tasks.workunit.client.0.smithi040.stdout:9/215: chown d2/dd 1651 1 2024-04-18T10:42:40.918 INFO:tasks.workunit.client.0.smithi040.stdout:5/119: stat d0/d3/l15 0 2024-04-18T10:42:40.918 INFO:tasks.workunit.client.0.smithi040.stdout:5/120: readlink d0/l4 0 2024-04-18T10:42:40.919 INFO:tasks.workunit.client.0.smithi040.stdout:1/140: sync 2024-04-18T10:42:40.922 INFO:tasks.workunit.client.0.smithi040.stdout:6/139: getdents df/d17/d19 0 2024-04-18T10:42:40.923 INFO:tasks.workunit.client.0.smithi040.stdout:6/140: truncate df/d17/d19/f24 966142 0 2024-04-18T10:42:40.923 INFO:tasks.workunit.client.0.smithi040.stdout:0/150: symlink dd/df/d19/d28/l32 0 2024-04-18T10:42:40.925 INFO:tasks.workunit.client.0.smithi040.stdout:5/121: symlink d0/l26 0 2024-04-18T10:42:40.928 INFO:tasks.workunit.client.0.smithi040.stdout:8/124: write d2/d15/d18/f1e [1278240,59002] 0 2024-04-18T10:42:40.928 INFO:tasks.workunit.client.0.smithi040.stdout:8/125: read d2/d5/d9/fb [244877,104427] 0 2024-04-18T10:42:40.929 INFO:tasks.workunit.client.0.smithi040.stdout:6/141: mknod df/d17/c36 0 2024-04-18T10:42:40.929 INFO:tasks.workunit.client.0.smithi040.stdout:6/142: dread - df/f2d zero size 2024-04-18T10:42:40.930 INFO:tasks.workunit.client.0.smithi040.stdout:0/151: truncate dd/f10 250067 0 2024-04-18T10:42:40.933 INFO:tasks.workunit.client.0.smithi040.stdout:9/216: creat d2/f55 x:0 0 0 2024-04-18T10:42:40.934 INFO:tasks.workunit.client.0.smithi040.stdout:5/122: dread d0/d3/f1a [0,4194304] 0 2024-04-18T10:42:40.935 INFO:tasks.workunit.client.0.smithi040.stdout:6/143: mknod df/c37 0 2024-04-18T10:42:40.936 INFO:tasks.workunit.client.0.smithi040.stdout:9/217: truncate d2/d3/f2b 996546 0 2024-04-18T10:42:40.936 INFO:tasks.workunit.client.0.smithi040.stdout:8/126: rename d2/d10/f20 to d2/d15/d18/f27 0 2024-04-18T10:42:40.938 INFO:tasks.workunit.client.0.smithi040.stdout:5/123: write d0/d1c/f1d [753777,124816] 0 2024-04-18T10:42:40.940 INFO:tasks.workunit.client.0.smithi040.stdout:2/78: dwrite f9 [0,4194304] 0 2024-04-18T10:42:40.940 INFO:tasks.workunit.client.0.smithi040.stdout:6/144: symlink df/l38 0 2024-04-18T10:42:40.943 INFO:tasks.workunit.client.0.smithi040.stdout:0/152: link dd/df/f15 dd/df/d19/d28/f33 0 2024-04-18T10:42:40.946 INFO:tasks.workunit.client.0.smithi040.stdout:4/121: sync 2024-04-18T10:42:40.947 INFO:tasks.workunit.client.0.smithi040.stdout:5/124: mknod d0/d3/c27 0 2024-04-18T10:42:40.948 INFO:tasks.workunit.client.0.smithi040.stdout:2/79: mknod dd/c11 0 2024-04-18T10:42:40.949 INFO:tasks.workunit.client.0.smithi040.stdout:5/125: stat d0/d3/l8 0 2024-04-18T10:42:40.949 INFO:tasks.workunit.client.0.smithi040.stdout:3/147: dwrite d1/d7/f15 [0,4194304] 0 2024-04-18T10:42:40.950 INFO:tasks.workunit.client.0.smithi040.stdout:2/80: dread - dd/ff zero size 2024-04-18T10:42:40.950 INFO:tasks.workunit.client.0.smithi040.stdout:6/145: symlink df/d17/d19/l39 0 2024-04-18T10:42:40.951 INFO:tasks.workunit.client.0.smithi040.stdout:9/218: mknod d2/dc/d46/d44/c56 0 2024-04-18T10:42:40.954 INFO:tasks.workunit.client.0.smithi040.stdout:0/153: symlink dd/df/d19/d28/l34 0 2024-04-18T10:42:40.957 INFO:tasks.workunit.client.0.smithi040.stdout:2/81: symlink dd/l12 0 2024-04-18T10:42:40.959 INFO:tasks.workunit.client.0.smithi040.stdout:3/148: mknod d1/d2/d16/c33 0 2024-04-18T10:42:40.960 INFO:tasks.workunit.client.0.smithi040.stdout:8/127: dwrite d2/d15/d18/f21 [4194304,4194304] 0 2024-04-18T10:42:40.963 INFO:tasks.workunit.client.0.smithi040.stdout:2/82: read - dd/f10 zero size 2024-04-18T10:42:40.968 INFO:tasks.workunit.client.0.smithi040.stdout:2/83: symlink dd/l13 0 2024-04-18T10:42:40.968 INFO:tasks.workunit.client.0.smithi040.stdout:4/122: dwrite d2/d3/d4/f18 [0,4194304] 0 2024-04-18T10:42:40.968 INFO:tasks.workunit.client.0.smithi040.stdout:3/149: truncate d1/d7/f15 4906696 0 2024-04-18T10:42:40.969 INFO:tasks.workunit.client.0.smithi040.stdout:1/141: dwrite d1/fa [0,4194304] 0 2024-04-18T10:42:40.971 INFO:tasks.workunit.client.0.smithi040.stdout:6/146: dread f7 [0,4194304] 0 2024-04-18T10:42:40.972 INFO:tasks.workunit.client.0.smithi040.stdout:5/126: dwrite d0/f23 [0,4194304] 0 2024-04-18T10:42:40.973 INFO:tasks.workunit.client.0.smithi040.stdout:2/84: write f8 [5392187,125878] 0 2024-04-18T10:42:40.973 INFO:tasks.workunit.client.0.smithi040.stdout:3/150: rmdir d1/d7 39 2024-04-18T10:42:40.976 INFO:tasks.workunit.client.0.smithi040.stdout:5/127: write d0/d3/f17 [2266694,56509] 0 2024-04-18T10:42:40.978 INFO:tasks.workunit.client.0.smithi040.stdout:5/128: read d0/f23 [2560247,8220] 0 2024-04-18T10:42:40.978 INFO:tasks.workunit.client.0.smithi040.stdout:8/128: dwrite d2/d15/f25 [0,4194304] 0 2024-04-18T10:42:40.980 INFO:tasks.workunit.client.0.smithi040.stdout:6/147: dread fa [0,4194304] 0 2024-04-18T10:42:40.981 INFO:tasks.workunit.client.0.smithi040.stdout:2/85: unlink f8 0 2024-04-18T10:42:40.986 INFO:tasks.workunit.client.0.smithi040.stdout:7/158: sync 2024-04-18T10:42:40.986 INFO:tasks.workunit.client.0.smithi040.stdout:8/129: dwrite d2/f17 [4194304,4194304] 0 2024-04-18T10:42:40.987 INFO:tasks.workunit.client.0.smithi040.stdout:5/129: mknod d0/d3/c28 0 2024-04-18T10:42:40.988 INFO:tasks.workunit.client.0.smithi040.stdout:8/130: chown d2/d5/d9/cf 292662785 1 2024-04-18T10:42:40.988 INFO:tasks.workunit.client.0.smithi040.stdout:8/131: stat d2/d15/d18/f27 0 2024-04-18T10:42:40.994 INFO:tasks.workunit.client.0.smithi040.stdout:6/148: mknod df/d17/d19/c3a 0 2024-04-18T10:42:40.995 INFO:tasks.workunit.client.0.smithi040.stdout:3/151: symlink d1/d7/l34 0 2024-04-18T10:42:40.996 INFO:tasks.workunit.client.0.smithi040.stdout:3/152: dread - d1/d7/d12/f30 zero size 2024-04-18T10:42:40.996 INFO:tasks.workunit.client.0.smithi040.stdout:1/142: mkdir d1/d1c/d2b/d32/d35 0 2024-04-18T10:42:40.997 INFO:tasks.workunit.client.0.smithi040.stdout:1/143: write d1/fe [3844420,102211] 0 2024-04-18T10:42:40.997 INFO:tasks.workunit.client.0.smithi040.stdout:3/153: truncate d1/d7/d12/f30 929772 0 2024-04-18T10:42:40.998 INFO:tasks.workunit.client.0.smithi040.stdout:3/154: stat d1/d2/f1f 0 2024-04-18T10:42:40.999 INFO:tasks.workunit.client.0.smithi040.stdout:3/155: write d1/d7/d12/f22 [2152594,71084] 0 2024-04-18T10:42:40.999 INFO:tasks.workunit.client.0.smithi040.stdout:5/130: rename d0/d1c/f1f to d0/d1e/f29 0 2024-04-18T10:42:41.000 INFO:tasks.workunit.client.0.smithi040.stdout:8/132: symlink d2/d10/l28 0 2024-04-18T10:42:41.001 INFO:tasks.workunit.client.0.smithi040.stdout:2/86: mkdir dd/d14 0 2024-04-18T10:42:41.002 INFO:tasks.workunit.client.0.smithi040.stdout:6/149: creat df/f3b x:0 0 0 2024-04-18T10:42:41.003 INFO:tasks.workunit.client.0.smithi040.stdout:9/219: dread d2/d7/f2a [0,4194304] 0 2024-04-18T10:42:41.005 INFO:tasks.workunit.client.0.smithi040.stdout:1/144: write d1/f23 [1504425,60574] 0 2024-04-18T10:42:41.007 INFO:tasks.workunit.client.0.smithi040.stdout:3/156: mknod d1/d2/d16/d18/c35 0 2024-04-18T10:42:41.008 INFO:tasks.workunit.client.0.smithi040.stdout:0/154: dwrite dd/f1d [0,4194304] 0 2024-04-18T10:42:41.008 INFO:tasks.workunit.client.0.smithi040.stdout:3/157: fdatasync d1/d7/f15 0 2024-04-18T10:42:41.008 INFO:tasks.workunit.client.0.smithi040.stdout:8/133: unlink d2/d10/d14/l24 0 2024-04-18T10:42:41.009 INFO:tasks.workunit.client.0.smithi040.stdout:0/155: stat dd/c20 0 2024-04-18T10:42:41.009 INFO:tasks.workunit.client.0.smithi040.stdout:2/87: creat dd/f15 x:0 0 0 2024-04-18T10:42:41.012 INFO:tasks.workunit.client.0.smithi040.stdout:6/150: write f7 [4025726,14262] 0 2024-04-18T10:42:41.012 INFO:tasks.workunit.client.0.smithi040.stdout:2/88: fdatasync dd/f10 0 2024-04-18T10:42:41.012 INFO:tasks.workunit.client.0.smithi040.stdout:1/145: mkdir d1/d1c/d2b/d32/d36 0 2024-04-18T10:42:41.014 INFO:tasks.workunit.client.0.smithi040.stdout:3/158: creat d1/d2/d16/f36 x:0 0 0 2024-04-18T10:42:41.014 INFO:tasks.workunit.client.0.smithi040.stdout:1/146: dread - d1/d16/d27/f34 zero size 2024-04-18T10:42:41.017 INFO:tasks.workunit.client.0.smithi040.stdout:3/159: write d1/d2/d16/f36 [544877,53912] 0 2024-04-18T10:42:41.017 INFO:tasks.workunit.client.0.smithi040.stdout:4/123: dwrite d2/f9 [0,4194304] 0 2024-04-18T10:42:41.020 INFO:tasks.workunit.client.0.smithi040.stdout:8/134: fdatasync d2/d15/d18/f21 0 2024-04-18T10:42:41.020 INFO:tasks.workunit.client.0.smithi040.stdout:3/160: creat d1/d2/d16/d18/f37 x:0 0 0 2024-04-18T10:42:41.022 INFO:tasks.workunit.client.0.smithi040.stdout:6/151: rmdir df/d17/d35 0 2024-04-18T10:42:41.024 INFO:tasks.workunit.client.0.smithi040.stdout:8/135: creat d2/d5/d9/f29 x:0 0 0 2024-04-18T10:42:41.026 INFO:tasks.workunit.client.0.smithi040.stdout:3/161: unlink d1/d7/d26/c2a 0 2024-04-18T10:42:41.028 INFO:tasks.workunit.client.0.smithi040.stdout:6/152: symlink df/d17/d19/l3c 0 2024-04-18T10:42:41.029 INFO:tasks.workunit.client.0.smithi040.stdout:1/147: getdents d1 0 2024-04-18T10:42:41.030 INFO:tasks.workunit.client.0.smithi040.stdout:4/124: getdents d2 0 2024-04-18T10:42:41.032 INFO:tasks.workunit.client.0.smithi040.stdout:5/131: getdents d0/d3 0 2024-04-18T10:42:41.033 INFO:tasks.workunit.client.0.smithi040.stdout:8/136: dwrite d2/d10/f26 [0,4194304] 0 2024-04-18T10:42:41.034 INFO:tasks.workunit.client.0.smithi040.stdout:8/137: write d2/d15/d18/f21 [1529094,61981] 0 2024-04-18T10:42:41.036 INFO:tasks.workunit.client.0.smithi040.stdout:1/148: mknod d1/d16/d27/d2d/c37 0 2024-04-18T10:42:41.037 INFO:tasks.workunit.client.0.smithi040.stdout:4/125: rmdir d2/d3/d4/dd 39 2024-04-18T10:42:41.037 INFO:tasks.workunit.client.0.smithi040.stdout:8/138: write d2/d15/d18/f21 [2477653,73164] 0 2024-04-18T10:42:41.039 INFO:tasks.workunit.client.0.smithi040.stdout:6/153: link df/f2d df/d17/f3d 0 2024-04-18T10:42:41.042 INFO:tasks.workunit.client.0.smithi040.stdout:5/132: truncate d0/f19 1095455 0 2024-04-18T10:42:41.044 INFO:tasks.workunit.client.0.smithi040.stdout:8/139: creat d2/f2a x:0 0 0 2024-04-18T10:42:41.046 INFO:tasks.workunit.client.0.smithi040.stdout:7/159: sync 2024-04-18T10:42:41.047 INFO:tasks.workunit.client.0.smithi040.stdout:1/149: rename d1/fe to d1/d1c/d2b/d32/d36/f38 0 2024-04-18T10:42:41.048 INFO:tasks.workunit.client.0.smithi040.stdout:5/133: dwrite d0/f25 [0,4194304] 0 2024-04-18T10:42:41.048 INFO:tasks.workunit.client.0.smithi040.stdout:6/154: write df/f21 [577856,69707] 0 2024-04-18T10:42:41.049 INFO:tasks.workunit.client.0.smithi040.stdout:4/126: mkdir d2/d3/d4/dd/d14/d19 0 2024-04-18T10:42:41.052 INFO:tasks.workunit.client.0.smithi040.stdout:2/89: fsync dd/f15 0 2024-04-18T10:42:41.052 INFO:tasks.workunit.client.0.smithi040.stdout:7/160: mkdir d6/d25/d28/d2c/d3c 0 2024-04-18T10:42:41.053 INFO:tasks.workunit.client.0.smithi040.stdout:9/220: write d2/d3/f41 [5393066,73966] 0 2024-04-18T10:42:41.053 INFO:tasks.workunit.client.0.smithi040.stdout:9/221: chown d2/d7/f1b 8462820 1 2024-04-18T10:42:41.068 INFO:tasks.workunit.client.0.smithi040.stdout:5/134: rmdir d0/d1c 39 2024-04-18T10:42:41.068 INFO:tasks.workunit.client.0.smithi040.stdout:6/155: mknod df/d17/c3e 0 2024-04-18T10:42:41.069 INFO:tasks.workunit.client.0.smithi040.stdout:4/127: mkdir d2/d1a 0 2024-04-18T10:42:41.070 INFO:tasks.workunit.client.0.smithi040.stdout:0/156: write dd/df/d19/d28/f33 [2394891,96085] 0 2024-04-18T10:42:41.070 INFO:tasks.workunit.client.0.smithi040.stdout:3/162: fsync d1/d2/d16/d18/f37 0 2024-04-18T10:42:41.076 INFO:tasks.workunit.client.0.smithi040.stdout:2/90: creat dd/d14/f16 x:0 0 0 2024-04-18T10:42:41.077 INFO:tasks.workunit.client.0.smithi040.stdout:0/157: unlink dd/df/f23 0 2024-04-18T10:42:41.078 INFO:tasks.workunit.client.0.smithi040.stdout:7/161: dwrite d6/f14 [0,4194304] 0 2024-04-18T10:42:41.079 INFO:tasks.workunit.client.0.smithi040.stdout:1/150: fsync d1/f15 0 2024-04-18T10:42:41.079 INFO:tasks.workunit.client.0.smithi040.stdout:4/128: dread d2/d3/d4/f12 [0,4194304] 0 2024-04-18T10:42:41.079 INFO:tasks.workunit.client.0.smithi040.stdout:5/135: dread d0/d3/f7 [0,4194304] 0 2024-04-18T10:42:41.080 INFO:tasks.workunit.client.0.smithi040.stdout:2/91: read - dd/d14/f16 zero size 2024-04-18T10:42:41.081 INFO:tasks.workunit.client.0.smithi040.stdout:9/222: dread d2/dc/f16 [0,4194304] 0 2024-04-18T10:42:41.081 INFO:tasks.workunit.client.0.smithi040.stdout:0/158: dread - dd/df/d19/d28/f30 zero size 2024-04-18T10:42:41.083 INFO:tasks.workunit.client.0.smithi040.stdout:5/136: fdatasync d0/d21/f22 0 2024-04-18T10:42:41.083 INFO:tasks.workunit.client.0.smithi040.stdout:3/163: link d1/d2/d16/d18/l2b d1/d2/d16/l38 0 2024-04-18T10:42:41.083 INFO:tasks.workunit.client.0.smithi040.stdout:2/92: write dd/f10 [553559,92714] 0 2024-04-18T10:42:41.085 INFO:tasks.workunit.client.0.smithi040.stdout:7/162: creat d6/d25/d28/d2c/f3d x:0 0 0 2024-04-18T10:42:41.085 INFO:tasks.workunit.client.0.smithi040.stdout:5/137: readlink d0/d3/l15 0 2024-04-18T10:42:41.085 INFO:tasks.workunit.client.0.smithi040.stdout:3/164: chown d1/d7/l34 59 1 2024-04-18T10:42:41.085 INFO:tasks.workunit.client.0.smithi040.stdout:2/93: read - dd/ff zero size 2024-04-18T10:42:41.086 INFO:tasks.workunit.client.0.smithi040.stdout:5/138: stat d0/f1 0 2024-04-18T10:42:41.086 INFO:tasks.workunit.client.0.smithi040.stdout:1/151: chown d1/d1c/d2b/d32/d36/f38 3026003 1 2024-04-18T10:42:41.087 INFO:tasks.workunit.client.0.smithi040.stdout:2/94: write dd/f15 [796653,76354] 0 2024-04-18T10:42:41.087 INFO:tasks.workunit.client.0.smithi040.stdout:5/139: dread - d0/d21/f22 zero size 2024-04-18T10:42:41.088 INFO:tasks.workunit.client.0.smithi040.stdout:7/163: chown d6/c9 60230 1 2024-04-18T10:42:41.088 INFO:tasks.workunit.client.0.smithi040.stdout:0/159: fdatasync dd/df/d19/f1a 0 2024-04-18T10:42:41.088 INFO:tasks.workunit.client.0.smithi040.stdout:5/140: dread - d0/d21/f22 zero size 2024-04-18T10:42:41.089 INFO:tasks.workunit.client.0.smithi040.stdout:7/164: read d6/f20 [4094099,63494] 0 2024-04-18T10:42:41.090 INFO:tasks.workunit.client.0.smithi040.stdout:3/165: rmdir d1/d2/d16 39 2024-04-18T10:42:41.092 INFO:tasks.workunit.client.0.smithi040.stdout:2/95: rename dd/ff to dd/f17 0 2024-04-18T10:42:41.093 INFO:tasks.workunit.client.0.smithi040.stdout:5/141: mknod d0/d21/c2a 0 2024-04-18T10:42:41.094 INFO:tasks.workunit.client.0.smithi040.stdout:0/160: mknod dd/df/d19/d28/c35 0 2024-04-18T10:42:41.096 INFO:tasks.workunit.client.0.smithi040.stdout:2/96: chown la 30308064 1 2024-04-18T10:42:41.097 INFO:tasks.workunit.client.0.smithi040.stdout:4/129: link d2/d3/d4/dd/c11 d2/c1b 0 2024-04-18T10:42:41.097 INFO:tasks.workunit.client.0.smithi040.stdout:3/166: dread d1/d2/d16/f2c [0,4194304] 0 2024-04-18T10:42:41.098 INFO:tasks.workunit.client.0.smithi040.stdout:5/142: creat d0/d3/f2b x:0 0 0 2024-04-18T10:42:41.098 INFO:tasks.workunit.client.0.smithi040.stdout:1/152: mkdir d1/d16/d27/d2e/d39 0 2024-04-18T10:42:41.099 INFO:tasks.workunit.client.0.smithi040.stdout:0/161: mkdir dd/df/d36 0 2024-04-18T10:42:41.099 INFO:tasks.workunit.client.0.smithi040.stdout:5/143: fsync d0/f1b 0 2024-04-18T10:42:41.102 INFO:tasks.workunit.client.0.smithi040.stdout:7/165: dwrite d6/d25/f19 [4194304,4194304] 0 2024-04-18T10:42:41.102 INFO:tasks.workunit.client.0.smithi040.stdout:2/97: write f9 [3537054,64623] 0 2024-04-18T10:42:41.104 INFO:tasks.workunit.client.0.smithi040.stdout:3/167: dread d1/d7/d12/f30 [0,4194304] 0 2024-04-18T10:42:41.108 INFO:tasks.workunit.client.0.smithi040.stdout:1/153: creat d1/d1c/d2b/d32/d36/f3a x:0 0 0 2024-04-18T10:42:41.109 INFO:tasks.workunit.client.0.smithi040.stdout:5/144: rmdir d0 39 2024-04-18T10:42:41.111 INFO:tasks.workunit.client.0.smithi040.stdout:3/168: symlink d1/d2/d16/d18/l39 0 2024-04-18T10:42:41.115 INFO:tasks.workunit.client.0.smithi040.stdout:7/166: mkdir d6/d3e 0 2024-04-18T10:42:41.116 INFO:tasks.workunit.client.0.smithi040.stdout:5/145: write d0/d3/f7 [63414,129746] 0 2024-04-18T10:42:41.117 INFO:tasks.workunit.client.0.smithi040.stdout:3/169: mkdir d1/d7/d3a 0 2024-04-18T10:42:41.118 INFO:tasks.workunit.client.0.smithi040.stdout:0/162: write dd/f2e [4726123,49877] 0 2024-04-18T10:42:41.118 INFO:tasks.workunit.client.0.smithi040.stdout:4/130: link d2/l7 d2/d3/d4/dd/d14/d19/l1c 0 2024-04-18T10:42:41.120 INFO:tasks.workunit.client.0.smithi040.stdout:0/163: write dd/df/d19/f22 [2642347,74544] 0 2024-04-18T10:42:41.120 INFO:tasks.workunit.client.0.smithi040.stdout:7/167: creat d6/d25/f3f x:0 0 0 2024-04-18T10:42:41.130 INFO:tasks.workunit.client.0.smithi040.stdout:8/140: sync 2024-04-18T10:42:41.135 INFO:tasks.workunit.client.0.smithi040.stdout:1/154: link d1/f23 d1/d16/f3b 0 2024-04-18T10:42:41.136 INFO:tasks.workunit.client.0.smithi040.stdout:5/146: dread d0/d3/f10 [0,4194304] 0 2024-04-18T10:42:41.139 INFO:tasks.workunit.client.0.smithi040.stdout:3/170: dread d1/f1a [0,4194304] 0 2024-04-18T10:42:41.139 INFO:tasks.workunit.client.0.smithi040.stdout:8/141: write d2/d15/d18/f27 [1137869,566] 0 2024-04-18T10:42:41.139 INFO:tasks.workunit.client.0.smithi040.stdout:1/155: write d1/f11 [27297,51255] 0 2024-04-18T10:42:41.141 INFO:tasks.workunit.client.0.smithi040.stdout:4/131: dread d2/d3/d4/f18 [0,4194304] 0 2024-04-18T10:42:41.141 INFO:tasks.workunit.client.0.smithi040.stdout:8/142: stat d2/d5/c23 0 2024-04-18T10:42:41.142 INFO:tasks.workunit.client.0.smithi040.stdout:3/171: stat d1/d2/d16/d18/f37 0 2024-04-18T10:42:41.143 INFO:tasks.workunit.client.0.smithi040.stdout:1/156: truncate d1/d16/f1b 1363288 0 2024-04-18T10:42:41.144 INFO:tasks.workunit.client.0.smithi040.stdout:8/143: mkdir d2/d15/d2b 0 2024-04-18T10:42:41.145 INFO:tasks.workunit.client.0.smithi040.stdout:7/168: dwrite d6/d25/f3a [0,4194304] 0 2024-04-18T10:42:41.146 INFO:tasks.workunit.client.0.smithi040.stdout:4/132: write d2/d3/d4/f18 [1674127,54990] 0 2024-04-18T10:42:41.146 INFO:tasks.workunit.client.0.smithi040.stdout:8/144: mkdir d2/d2c 0 2024-04-18T10:42:41.149 INFO:tasks.workunit.client.0.smithi040.stdout:7/169: write d6/d25/d28/d2c/f33 [138165,69659] 0 2024-04-18T10:42:41.151 INFO:tasks.workunit.client.0.smithi040.stdout:7/170: chown d6/f32 10 1 2024-04-18T10:42:41.153 INFO:tasks.workunit.client.0.smithi040.stdout:3/172: dwrite d1/d2/f17 [0,4194304] 0 2024-04-18T10:42:41.153 INFO:tasks.workunit.client.0.smithi040.stdout:7/171: stat d6/f22 0 2024-04-18T10:42:41.155 INFO:tasks.workunit.client.0.smithi040.stdout:8/145: rename d2/d10/d14/c1f to d2/d5/d9/c2d 0 2024-04-18T10:42:41.157 INFO:tasks.workunit.client.0.smithi040.stdout:3/173: mkdir d1/d2/d16/d18/d3b 0 2024-04-18T10:42:41.158 INFO:tasks.workunit.client.0.smithi040.stdout:7/172: truncate d6/d25/d28/d2c/f3d 441522 0 2024-04-18T10:42:41.158 INFO:tasks.workunit.client.0.smithi040.stdout:4/133: dwrite d2/d3/d4/fa [0,4194304] 0 2024-04-18T10:42:41.159 INFO:tasks.workunit.client.0.smithi040.stdout:3/174: mkdir d1/d2/d3c 0 2024-04-18T10:42:41.161 INFO:tasks.workunit.client.0.smithi040.stdout:7/173: fsync d6/f22 0 2024-04-18T10:42:41.163 INFO:tasks.workunit.client.0.smithi040.stdout:4/134: symlink d2/d3/d4/dd/l1d 0 2024-04-18T10:42:41.163 INFO:tasks.workunit.client.0.smithi040.stdout:8/146: link d2/l3 d2/d5/d9/d1b/l2e 0 2024-04-18T10:42:41.164 INFO:tasks.workunit.client.0.smithi040.stdout:8/147: fsync d2/d15/d18/f27 0 2024-04-18T10:42:41.165 INFO:tasks.workunit.client.0.smithi040.stdout:7/174: rmdir d6/d25/d28/d2c 39 2024-04-18T10:42:41.167 INFO:tasks.workunit.client.0.smithi040.stdout:4/135: dread d2/d3/d4/fa [4194304,4194304] 0 2024-04-18T10:42:41.167 INFO:tasks.workunit.client.0.smithi040.stdout:3/175: creat d1/d7/d3a/f3d x:0 0 0 2024-04-18T10:42:41.168 INFO:tasks.workunit.client.0.smithi040.stdout:8/148: dread d2/d10/f26 [0,4194304] 0 2024-04-18T10:42:41.169 INFO:tasks.workunit.client.0.smithi040.stdout:8/149: stat d2/d2c 0 2024-04-18T10:42:41.170 INFO:tasks.workunit.client.0.smithi040.stdout:3/176: fdatasync d1/d2/d16/f2c 0 2024-04-18T10:42:41.178 INFO:tasks.workunit.client.0.smithi040.stdout:6/156: sync 2024-04-18T10:42:41.193 INFO:tasks.workunit.client.0.smithi040.stdout:6/157: chown df/d17/d19/f33 1 1 2024-04-18T10:42:41.193 INFO:tasks.workunit.client.0.smithi040.stdout:4/136: dwrite d2/d3/d4/f12 [0,4194304] 0 2024-04-18T10:42:41.197 INFO:tasks.workunit.client.0.smithi040.stdout:4/137: chown d2/l6 11 1 2024-04-18T10:42:41.197 INFO:tasks.workunit.client.0.smithi040.stdout:3/177: getdents d1 0 2024-04-18T10:42:41.197 INFO:tasks.workunit.client.0.smithi040.stdout:6/158: mkdir df/d17/d19/d3f 0 2024-04-18T10:42:41.200 INFO:tasks.workunit.client.0.smithi040.stdout:3/178: read - d1/d2/d16/f2d zero size 2024-04-18T10:42:41.200 INFO:tasks.workunit.client.0.smithi040.stdout:1/157: dread d1/d1c/d2b/d32/d36/f38 [0,4194304] 0 2024-04-18T10:42:41.201 INFO:tasks.workunit.client.0.smithi040.stdout:8/150: dwrite d2/d10/d14/f16 [0,4194304] 0 2024-04-18T10:42:41.202 INFO:tasks.workunit.client.0.smithi040.stdout:6/159: creat df/d17/d19/f40 x:0 0 0 2024-04-18T10:42:41.203 INFO:tasks.workunit.client.0.smithi040.stdout:1/158: fdatasync d1/d16/f3b 0 2024-04-18T10:42:41.204 INFO:tasks.workunit.client.0.smithi040.stdout:3/179: symlink d1/d2/d16/d18/l3e 0 2024-04-18T10:42:41.205 INFO:tasks.workunit.client.0.smithi040.stdout:6/160: write df/d17/d19/f30 [410889,43487] 0 2024-04-18T10:42:41.208 INFO:tasks.workunit.client.0.smithi040.stdout:3/180: unlink d1/d2/d16/f1d 0 2024-04-18T10:42:41.209 INFO:tasks.workunit.client.0.smithi040.stdout:4/138: dwrite d2/d3/d4/fa [0,4194304] 0 2024-04-18T10:42:41.209 INFO:tasks.workunit.client.0.smithi040.stdout:6/161: truncate df/d17/d19/f28 566513 0 2024-04-18T10:42:41.209 INFO:tasks.workunit.client.0.smithi040.stdout:1/159: link d1/f15 d1/d16/d27/d2e/f3c 0 2024-04-18T10:42:41.209 INFO:tasks.workunit.client.0.smithi040.stdout:3/181: fdatasync d1/d2/f1f 0 2024-04-18T10:42:41.210 INFO:tasks.workunit.client.0.smithi040.stdout:4/139: chown d2/d3/d4/dd 1 1 2024-04-18T10:42:41.211 INFO:tasks.workunit.client.0.smithi040.stdout:8/151: dread d2/d10/f26 [0,4194304] 0 2024-04-18T10:42:41.212 INFO:tasks.workunit.client.0.smithi040.stdout:6/162: mknod df/d17/d19/c41 0 2024-04-18T10:42:41.214 INFO:tasks.workunit.client.0.smithi040.stdout:4/140: mknod d2/d3/d4/dd/c1e 0 2024-04-18T10:42:41.216 INFO:tasks.workunit.client.0.smithi040.stdout:3/182: creat d1/d2/d16/d18/d3b/f3f x:0 0 0 2024-04-18T10:42:41.217 INFO:tasks.workunit.client.0.smithi040.stdout:6/163: symlink df/d17/d19/l42 0 2024-04-18T10:42:41.218 INFO:tasks.workunit.client.0.smithi040.stdout:8/152: creat d2/d5/d9/d1b/f2f x:0 0 0 2024-04-18T10:42:41.219 INFO:tasks.workunit.client.0.smithi040.stdout:1/160: dwrite d1/d16/d27/f28 [0,4194304] 0 2024-04-18T10:42:41.221 INFO:tasks.workunit.client.0.smithi040.stdout:4/141: mkdir d2/d3/d4/d1f 0 2024-04-18T10:42:41.221 INFO:tasks.workunit.client.0.smithi040.stdout:3/183: truncate d1/d2/d16/f2c 1307526 0 2024-04-18T10:42:41.222 INFO:tasks.workunit.client.0.smithi040.stdout:1/161: write d1/f30 [657611,47663] 0 2024-04-18T10:42:41.222 INFO:tasks.workunit.client.0.smithi040.stdout:4/142: write d2/d3/d4/fa [8484091,12568] 0 2024-04-18T10:42:41.222 INFO:tasks.workunit.client.0.smithi040.stdout:1/162: readlink d1/d16/l26 0 2024-04-18T10:42:41.223 INFO:tasks.workunit.client.0.smithi040.stdout:4/143: chown d2/d3/d4/dd/d14/d19 10233565 1 2024-04-18T10:42:41.223 INFO:tasks.workunit.client.0.smithi040.stdout:4/144: fdatasync d2/f9 0 2024-04-18T10:42:41.224 INFO:tasks.workunit.client.0.smithi040.stdout:4/145: stat d2/d3/d4/f12 0 2024-04-18T10:42:41.225 INFO:tasks.workunit.client.0.smithi040.stdout:8/153: getdents d2/d15/d18 0 2024-04-18T10:42:41.228 INFO:tasks.workunit.client.0.smithi040.stdout:5/147: sync 2024-04-18T10:42:41.228 INFO:tasks.workunit.client.0.smithi040.stdout:0/164: sync 2024-04-18T10:42:41.228 INFO:tasks.workunit.client.0.smithi040.stdout:2/98: sync 2024-04-18T10:42:41.228 INFO:tasks.workunit.client.0.smithi040.stdout:9/223: sync 2024-04-18T10:42:41.233 INFO:tasks.workunit.client.0.smithi040.stdout:8/154: dread d2/d10/f12 [0,4194304] 0 2024-04-18T10:42:41.235 INFO:tasks.workunit.client.0.smithi040.stdout:5/148: stat d0/d3/f5 0 2024-04-18T10:42:41.236 INFO:tasks.workunit.client.0.smithi040.stdout:1/163: dwrite d1/d16/d27/f28 [0,4194304] 0 2024-04-18T10:42:41.237 INFO:tasks.workunit.client.0.smithi040.stdout:0/165: creat dd/f37 x:0 0 0 2024-04-18T10:42:41.238 INFO:tasks.workunit.client.0.smithi040.stdout:4/146: dread d2/d3/d4/f18 [0,4194304] 0 2024-04-18T10:42:41.238 INFO:tasks.workunit.client.0.smithi040.stdout:2/99: unlink l5 0 2024-04-18T10:42:41.240 INFO:tasks.workunit.client.0.smithi040.stdout:4/147: truncate d2/f9 4359513 0 2024-04-18T10:42:41.240 INFO:tasks.workunit.client.0.smithi040.stdout:9/224: symlink d2/d3/d22/d2e/d32/l57 0 2024-04-18T10:42:41.241 INFO:tasks.workunit.client.0.smithi040.stdout:1/164: symlink d1/d16/l3d 0 2024-04-18T10:42:41.244 INFO:tasks.workunit.client.0.smithi040.stdout:5/149: rename d0/c9 to d0/d3/c2c 0 2024-04-18T10:42:41.245 INFO:tasks.workunit.client.0.smithi040.stdout:8/155: truncate d2/d10/f12 133696 0 2024-04-18T10:42:41.247 INFO:tasks.workunit.client.0.smithi040.stdout:9/225: dwrite d2/dc/f1a [0,4194304] 0 2024-04-18T10:42:41.248 INFO:tasks.workunit.client.0.smithi040.stdout:6/164: rmdir df/d17 39 2024-04-18T10:42:41.249 INFO:tasks.workunit.client.0.smithi040.stdout:4/148: rmdir d2/d3/d4/dd/d14/d19 39 2024-04-18T10:42:41.250 INFO:tasks.workunit.client.0.smithi040.stdout:1/165: mkdir d1/d16/d27/d2e/d3e 0 2024-04-18T10:42:41.253 INFO:tasks.workunit.client.0.smithi040.stdout:9/226: creat d2/dd/de/f58 x:0 0 0 2024-04-18T10:42:41.253 INFO:tasks.workunit.client.0.smithi040.stdout:2/100: dwrite dd/f17 [0,4194304] 0 2024-04-18T10:42:41.255 INFO:tasks.workunit.client.0.smithi040.stdout:4/149: symlink d2/l20 0 2024-04-18T10:42:41.257 INFO:tasks.workunit.client.0.smithi040.stdout:8/156: mknod d2/d15/d2b/c30 0 2024-04-18T10:42:41.257 INFO:tasks.workunit.client.0.smithi040.stdout:4/150: chown d2/d3/l15 134656553 1 2024-04-18T10:42:41.258 INFO:tasks.workunit.client.0.smithi040.stdout:1/166: mkdir d1/d16/d27/d3f 0 2024-04-18T10:42:41.259 INFO:tasks.workunit.client.0.smithi040.stdout:2/101: symlink dd/d14/l18 0 2024-04-18T10:42:41.260 INFO:tasks.workunit.client.0.smithi040.stdout:9/227: mknod d2/d3/d22/d2e/d35/d40/c59 0 2024-04-18T10:42:41.261 INFO:tasks.workunit.client.0.smithi040.stdout:1/167: write d1/d16/d27/f34 [983517,43348] 0 2024-04-18T10:42:41.262 INFO:tasks.workunit.client.0.smithi040.stdout:5/150: creat d0/f2d x:0 0 0 2024-04-18T10:42:41.263 INFO:tasks.workunit.client.0.smithi040.stdout:6/165: dwrite df/d17/f1b [0,4194304] 0 2024-04-18T10:42:41.266 INFO:tasks.workunit.client.0.smithi040.stdout:8/157: dread d2/d5/d9/fb [0,4194304] 0 2024-04-18T10:42:41.266 INFO:tasks.workunit.client.0.smithi040.stdout:9/228: rename d2/dc/f16 to d2/d7/f5a 0 2024-04-18T10:42:41.268 INFO:tasks.workunit.client.0.smithi040.stdout:1/168: mknod d1/d16/d27/c40 0 2024-04-18T10:42:41.270 INFO:tasks.workunit.client.0.smithi040.stdout:0/166: dread dd/df/d19/d28/f33 [0,4194304] 0 2024-04-18T10:42:41.272 INFO:tasks.workunit.client.0.smithi040.stdout:8/158: dread - d2/d5/d9/d1b/f2f zero size 2024-04-18T10:42:41.272 INFO:tasks.workunit.client.0.smithi040.stdout:1/169: creat d1/d16/f41 x:0 0 0 2024-04-18T10:42:41.273 INFO:tasks.workunit.client.0.smithi040.stdout:2/102: dwrite dd/f15 [0,4194304] 0 2024-04-18T10:42:41.275 INFO:tasks.workunit.client.0.smithi040.stdout:4/151: dwrite d2/d3/d4/f18 [0,4194304] 0 2024-04-18T10:42:41.276 INFO:tasks.workunit.client.0.smithi040.stdout:2/103: write f9 [5023665,32605] 0 2024-04-18T10:42:41.277 INFO:tasks.workunit.client.0.smithi040.stdout:0/167: unlink dd/df/d19/d28/l34 0 2024-04-18T10:42:41.278 INFO:tasks.workunit.client.0.smithi040.stdout:0/168: dread - dd/df/f26 zero size 2024-04-18T10:42:41.281 INFO:tasks.workunit.client.0.smithi040.stdout:1/170: mknod d1/d1c/d2b/d32/d35/c42 0 2024-04-18T10:42:41.283 INFO:tasks.workunit.client.0.smithi040.stdout:0/169: creat dd/df/d19/d28/f38 x:0 0 0 2024-04-18T10:42:41.284 INFO:tasks.workunit.client.0.smithi040.stdout:0/170: write dd/df/f13 [462692,13092] 0 2024-04-18T10:42:41.284 INFO:tasks.workunit.client.0.smithi040.stdout:4/152: mkdir d2/d3/d4/d21 0 2024-04-18T10:42:41.285 INFO:tasks.workunit.client.0.smithi040.stdout:0/171: stat dd/f1d 0 2024-04-18T10:42:41.285 INFO:tasks.workunit.client.0.smithi040.stdout:1/171: rmdir d1/d1c/d2b/d32 39 2024-04-18T10:42:41.286 INFO:tasks.workunit.client.0.smithi040.stdout:0/172: truncate dd/df/f2b 320799 0 2024-04-18T10:42:41.288 INFO:tasks.workunit.client.0.smithi040.stdout:4/153: creat d2/d3/d4/dd/f22 x:0 0 0 2024-04-18T10:42:41.291 INFO:tasks.workunit.client.0.smithi040.stdout:0/173: unlink dd/c20 0 2024-04-18T10:42:41.291 INFO:tasks.workunit.client.0.smithi040.stdout:0/174: stat dd/l12 0 2024-04-18T10:42:41.292 INFO:tasks.workunit.client.0.smithi040.stdout:9/229: rename d2/d3/d22/d2e/d32 to d2/d5b 0 2024-04-18T10:42:41.296 INFO:tasks.workunit.client.0.smithi040.stdout:4/154: getdents d2/d3/d4/d1f 0 2024-04-18T10:42:41.296 INFO:tasks.workunit.client.0.smithi040.stdout:4/155: chown d2/d3/cc 2083535186 1 2024-04-18T10:42:41.298 INFO:tasks.workunit.client.0.smithi040.stdout:4/156: write d2/d3/d4/fa [3051662,119936] 0 2024-04-18T10:42:41.300 INFO:tasks.workunit.client.0.smithi040.stdout:9/230: link d2/d7/f15 d2/d3/d22/d2e/d35/f5c 0 2024-04-18T10:42:41.301 INFO:tasks.workunit.client.0.smithi040.stdout:1/172: getdents d1/d16/d27/d2d 0 2024-04-18T10:42:41.303 INFO:tasks.workunit.client.0.smithi040.stdout:0/175: rmdir dd/df/d36 0 2024-04-18T10:42:41.304 INFO:tasks.workunit.client.0.smithi040.stdout:2/104: rmdir dd/d14 39 2024-04-18T10:42:41.304 INFO:tasks.workunit.client.0.smithi040.stdout:0/176: write dd/f1d [3264236,57766] 0 2024-04-18T10:42:41.305 INFO:tasks.workunit.client.0.smithi040.stdout:9/231: symlink d2/d3/d22/d2e/l5d 0 2024-04-18T10:42:41.305 INFO:tasks.workunit.client.0.smithi040.stdout:1/173: dread d1/f15 [0,4194304] 0 2024-04-18T10:42:41.306 INFO:tasks.workunit.client.0.smithi040.stdout:9/232: write d2/d3/f1c [1617272,77664] 0 2024-04-18T10:42:41.308 INFO:tasks.workunit.client.0.smithi040.stdout:4/157: mkdir d2/d3/d4/d23 0 2024-04-18T10:42:41.311 INFO:tasks.workunit.client.0.smithi040.stdout:0/177: creat dd/df/d19/d28/f39 x:0 0 0 2024-04-18T10:42:41.311 INFO:tasks.workunit.client.0.smithi040.stdout:6/166: write df/f2d [278694,75278] 0 2024-04-18T10:42:41.313 INFO:tasks.workunit.client.0.smithi040.stdout:2/105: read f4 [3861738,105262] 0 2024-04-18T10:42:41.324 INFO:tasks.workunit.client.0.smithi040.stdout:7/175: sync 2024-04-18T10:42:41.337 INFO:tasks.workunit.client.0.smithi040.stdout:4/158: dwrite d2/d3/d4/f12 [0,4194304] 0 2024-04-18T10:42:41.337 INFO:tasks.workunit.client.0.smithi040.stdout:9/233: creat d2/d3/d22/d2e/d35/d40/f5e x:0 0 0 2024-04-18T10:42:41.338 INFO:tasks.workunit.client.0.smithi040.stdout:8/159: write d2/d5/d9/fb [39170,30474] 0 2024-04-18T10:42:41.339 INFO:tasks.workunit.client.0.smithi040.stdout:0/178: mkdir dd/df/d19/d28/d3a 0 2024-04-18T10:42:41.342 INFO:tasks.workunit.client.0.smithi040.stdout:8/160: chown d2/d15/d18/f21 1054 1 2024-04-18T10:42:41.346 INFO:tasks.workunit.client.0.smithi040.stdout:2/106: dread dd/f15 [0,4194304] 0 2024-04-18T10:42:41.346 INFO:tasks.workunit.client.0.smithi040.stdout:6/167: creat df/f43 x:0 0 0 2024-04-18T10:42:41.347 INFO:tasks.workunit.client.0.smithi040.stdout:9/234: dwrite d2/f55 [0,4194304] 0 2024-04-18T10:42:41.348 INFO:tasks.workunit.client.0.smithi040.stdout:0/179: rename dd/df/c2f to dd/df/d19/d28/d3a/c3b 0 2024-04-18T10:42:41.348 INFO:tasks.workunit.client.0.smithi040.stdout:6/168: truncate df/d17/f3d 1133403 0 2024-04-18T10:42:41.349 INFO:tasks.workunit.client.0.smithi040.stdout:9/235: dread - d2/dd/de/f58 zero size 2024-04-18T10:42:41.349 INFO:tasks.workunit.client.0.smithi040.stdout:6/169: stat df/f2f 0 2024-04-18T10:42:41.350 INFO:tasks.workunit.client.0.smithi040.stdout:8/161: chown d2/d10/f12 53982095 1 2024-04-18T10:42:41.351 INFO:tasks.workunit.client.0.smithi040.stdout:4/159: mknod d2/d3/d4/dd/d14/c24 0 2024-04-18T10:42:41.351 INFO:tasks.workunit.client.0.smithi040.stdout:8/162: fsync d2/d15/d18/f1e 0 2024-04-18T10:42:41.352 INFO:tasks.workunit.client.0.smithi040.stdout:2/107: dread dd/f10 [0,4194304] 0 2024-04-18T10:42:41.353 INFO:tasks.workunit.client.0.smithi040.stdout:4/160: write d2/d3/d4/fa [9568400,113991] 0 2024-04-18T10:42:41.355 INFO:tasks.workunit.client.0.smithi040.stdout:8/163: creat d2/f31 x:0 0 0 2024-04-18T10:42:41.357 INFO:tasks.workunit.client.0.smithi040.stdout:9/236: dwrite d2/d3/d22/f3a [0,4194304] 0 2024-04-18T10:42:41.358 INFO:tasks.workunit.client.0.smithi040.stdout:2/108: fsync dd/d14/f16 0 2024-04-18T10:42:41.359 INFO:tasks.workunit.client.0.smithi040.stdout:0/180: link dd/df/d19/l24 dd/df/d19/d28/d3a/l3c 0 2024-04-18T10:42:41.360 INFO:tasks.workunit.client.0.smithi040.stdout:2/109: write f9 [4685568,130192] 0 2024-04-18T10:42:41.360 INFO:tasks.workunit.client.0.smithi040.stdout:9/237: rmdir d2/dd/de 39 2024-04-18T10:42:41.361 INFO:tasks.workunit.client.0.smithi040.stdout:9/238: readlink l1 0 2024-04-18T10:42:41.365 INFO:tasks.workunit.client.0.smithi040.stdout:9/239: mkdir d2/dc/d46/d5f 0 2024-04-18T10:42:41.366 INFO:tasks.workunit.client.0.smithi040.stdout:8/164: dwrite d2/d5/d9/f29 [0,4194304] 0 2024-04-18T10:42:41.370 INFO:tasks.workunit.client.0.smithi040.stdout:2/110: dread f9 [0,4194304] 0 2024-04-18T10:42:41.372 INFO:tasks.workunit.client.0.smithi040.stdout:9/240: dread d2/d3/f2b [0,4194304] 0 2024-04-18T10:42:41.372 INFO:tasks.workunit.client.0.smithi040.stdout:0/181: dwrite dd/df/d19/d28/f2d [0,4194304] 0 2024-04-18T10:42:41.373 INFO:tasks.workunit.client.0.smithi040.stdout:5/151: sync 2024-04-18T10:42:41.373 INFO:tasks.workunit.client.0.smithi040.stdout:3/184: sync 2024-04-18T10:42:41.376 INFO:tasks.workunit.client.0.smithi040.stdout:9/241: chown d2/d3/d22/d2e/d35/d40/f52 654474 1 2024-04-18T10:42:41.377 INFO:tasks.workunit.client.0.smithi040.stdout:6/170: dread f4 [0,4194304] 0 2024-04-18T10:42:41.377 INFO:tasks.workunit.client.0.smithi040.stdout:0/182: mknod dd/df/d19/d28/d3a/c3d 0 2024-04-18T10:42:41.378 INFO:tasks.workunit.client.0.smithi040.stdout:8/165: dwrite d2/d10/d14/f16 [0,4194304] 0 2024-04-18T10:42:41.379 INFO:tasks.workunit.client.0.smithi040.stdout:9/242: write d2/d3/f4a [131013,11181] 0 2024-04-18T10:42:41.382 INFO:tasks.workunit.client.0.smithi040.stdout:8/166: stat d2/d15/d2b 0 2024-04-18T10:42:41.382 INFO:tasks.workunit.client.0.smithi040.stdout:7/176: truncate d6/d25/f19 6808423 0 2024-04-18T10:42:41.383 INFO:tasks.workunit.client.0.smithi040.stdout:0/183: mkdir dd/df/d19/d3e 0 2024-04-18T10:42:41.384 INFO:tasks.workunit.client.0.smithi040.stdout:4/161: dread d2/d3/d4/fa [8388608,4194304] 0 2024-04-18T10:42:41.385 INFO:tasks.workunit.client.0.smithi040.stdout:9/243: creat d2/dc/f60 x:0 0 0 2024-04-18T10:42:41.385 INFO:tasks.workunit.client.0.smithi040.stdout:5/152: dread d0/f23 [0,4194304] 0 2024-04-18T10:42:41.386 INFO:tasks.workunit.client.0.smithi040.stdout:6/171: symlink df/d17/d19/d3f/l44 0 2024-04-18T10:42:41.387 INFO:tasks.workunit.client.0.smithi040.stdout:3/185: dwrite d1/d2/d16/f1c [0,4194304] 0 2024-04-18T10:42:41.391 INFO:tasks.workunit.client.0.smithi040.stdout:5/153: mknod d0/c2e 0 2024-04-18T10:42:41.392 INFO:tasks.workunit.client.0.smithi040.stdout:6/172: mknod df/d17/c45 0 2024-04-18T10:42:41.393 INFO:tasks.workunit.client.0.smithi040.stdout:5/154: write d0/d21/f22 [77661,102310] 0 2024-04-18T10:42:41.394 INFO:tasks.workunit.client.0.smithi040.stdout:7/177: dwrite d6/f1f [0,4194304] 0 2024-04-18T10:42:41.395 INFO:tasks.workunit.client.0.smithi040.stdout:5/155: stat d0/d3/f5 0 2024-04-18T10:42:41.398 INFO:tasks.workunit.client.0.smithi040.stdout:4/162: creat d2/d3/d4/f25 x:0 0 0 2024-04-18T10:42:41.399 INFO:tasks.workunit.client.0.smithi040.stdout:3/186: creat d1/d2/d16/f40 x:0 0 0 2024-04-18T10:42:41.401 INFO:tasks.workunit.client.0.smithi040.stdout:0/184: rename dd/df/d19/d28/d3a/c3b to dd/df/d19/c3f 0 2024-04-18T10:42:41.403 INFO:tasks.workunit.client.0.smithi040.stdout:6/173: creat df/d17/f46 x:0 0 0 2024-04-18T10:42:41.406 INFO:tasks.workunit.client.0.smithi040.stdout:9/244: rename d2/dc/f49 to d2/dd/de/f61 0 2024-04-18T10:42:41.407 INFO:tasks.workunit.client.0.smithi040.stdout:0/185: creat dd/df/f40 x:0 0 0 2024-04-18T10:42:41.408 INFO:tasks.workunit.client.0.smithi040.stdout:5/156: symlink d0/l2f 0 2024-04-18T10:42:41.410 INFO:tasks.workunit.client.0.smithi040.stdout:4/163: link d2/d3/d4/dd/f22 d2/f26 0 2024-04-18T10:42:41.415 INFO:tasks.workunit.client.0.smithi040.stdout:0/186: creat dd/df/d19/d28/d3a/f41 x:0 0 0 2024-04-18T10:42:41.415 INFO:tasks.workunit.client.0.smithi040.stdout:5/157: symlink d0/d21/l30 0 2024-04-18T10:42:41.417 INFO:tasks.workunit.client.0.smithi040.stdout:5/158: mknod d0/d1e/c31 0 2024-04-18T10:42:41.417 INFO:tasks.workunit.client.0.smithi040.stdout:4/164: dwrite d2/d3/d4/f18 [0,4194304] 0 2024-04-18T10:42:41.419 INFO:tasks.workunit.client.0.smithi040.stdout:7/178: rename d6/d25/l15 to d6/d25/d28/l40 0 2024-04-18T10:42:41.419 INFO:tasks.workunit.client.0.smithi040.stdout:2/111: truncate dd/f17 1433433 0 2024-04-18T10:42:41.443 INFO:tasks.workunit.client.0.smithi040.stdout:0/187: mkdir dd/df/d19/d28/d3a/d42 0 2024-04-18T10:42:41.445 INFO:tasks.workunit.client.0.smithi040.stdout:8/167: dread d2/d15/d18/f21 [0,4194304] 0 2024-04-18T10:42:41.446 INFO:tasks.workunit.client.0.smithi040.stdout:0/188: write dd/df/d19/f22 [4083462,114649] 0 2024-04-18T10:42:41.448 INFO:tasks.workunit.client.0.smithi040.stdout:6/174: write df/f12 [4696710,64608] 0 2024-04-18T10:42:41.452 INFO:tasks.workunit.client.0.smithi040.stdout:5/159: dwrite d0/f1 [0,4194304] 0 2024-04-18T10:42:41.454 INFO:tasks.workunit.client.0.smithi040.stdout:1/174: sync 2024-04-18T10:42:41.457 INFO:tasks.workunit.client.0.smithi040.stdout:8/168: dwrite d2/d10/d14/f16 [0,4194304] 0 2024-04-18T10:42:41.457 INFO:tasks.workunit.client.0.smithi040.stdout:5/160: chown d0/d3/f1a 4523580 1 2024-04-18T10:42:41.458 INFO:tasks.workunit.client.0.smithi040.stdout:9/245: dwrite d2/f19 [0,4194304] 0 2024-04-18T10:42:41.460 INFO:tasks.workunit.client.0.smithi040.stdout:6/175: dwrite df/d17/d19/f32 [0,4194304] 0 2024-04-18T10:42:41.468 INFO:tasks.workunit.client.0.smithi040.stdout:6/176: dwrite df/f1a [0,4194304] 0 2024-04-18T10:42:41.472 INFO:tasks.workunit.client.0.smithi040.stdout:3/187: sync 2024-04-18T10:42:41.473 INFO:tasks.workunit.client.0.smithi040.stdout:3/188: write d1/d2/d16/f36 [232691,115702] 0 2024-04-18T10:42:41.474 INFO:tasks.workunit.client.0.smithi040.stdout:3/189: read d1/d2/d16/f1c [4032225,63615] 0 2024-04-18T10:42:41.475 INFO:tasks.workunit.client.0.smithi040.stdout:3/190: write d1/f6 [3602838,66369] 0 2024-04-18T10:42:41.643 INFO:tasks.workunit.client.0.smithi040.stdout:4/165: symlink d2/d3/d4/d21/l27 0 2024-04-18T10:42:41.644 INFO:tasks.workunit.client.0.smithi040.stdout:0/189: symlink dd/l43 0 2024-04-18T10:42:41.646 INFO:tasks.workunit.client.0.smithi040.stdout:1/175: symlink d1/d16/l43 0 2024-04-18T10:42:41.648 INFO:tasks.workunit.client.0.smithi040.stdout:8/169: rmdir d2 39 2024-04-18T10:42:41.649 INFO:tasks.workunit.client.0.smithi040.stdout:0/190: dread dd/f1d [0,4194304] 0 2024-04-18T10:42:41.650 INFO:tasks.workunit.client.0.smithi040.stdout:5/161: mknod d0/d3/c32 0 2024-04-18T10:42:41.653 INFO:tasks.workunit.client.0.smithi040.stdout:6/177: creat df/d17/f47 x:0 0 0 2024-04-18T10:42:41.653 INFO:tasks.workunit.client.0.smithi040.stdout:1/176: dwrite d1/f11 [0,4194304] 0 2024-04-18T10:42:41.654 INFO:tasks.workunit.client.0.smithi040.stdout:6/178: write df/d17/f31 [837377,5078] 0 2024-04-18T10:42:41.657 INFO:tasks.workunit.client.0.smithi040.stdout:2/112: write dd/f17 [260887,21757] 0 2024-04-18T10:42:41.657 INFO:tasks.workunit.client.0.smithi040.stdout:7/179: getdents d6/d25/d28/d2c/d3c 0 2024-04-18T10:42:41.658 INFO:tasks.workunit.client.0.smithi040.stdout:7/180: stat d6/l16 0 2024-04-18T10:42:41.658 INFO:tasks.workunit.client.0.smithi040.stdout:6/179: dread fa [0,4194304] 0 2024-04-18T10:42:41.659 INFO:tasks.workunit.client.0.smithi040.stdout:6/180: write df/d17/d19/f30 [1265280,46150] 0 2024-04-18T10:42:41.660 INFO:tasks.workunit.client.0.smithi040.stdout:4/166: mkdir d2/d3/d4/d21/d28 0 2024-04-18T10:42:41.663 INFO:tasks.workunit.client.0.smithi040.stdout:8/170: fsync d2/d15/d18/f1e 0 2024-04-18T10:42:41.664 INFO:tasks.workunit.client.0.smithi040.stdout:8/171: write d2/d15/f25 [2416163,50910] 0 2024-04-18T10:42:41.664 INFO:tasks.workunit.client.0.smithi040.stdout:5/162: mknod d0/d1e/c33 0 2024-04-18T10:42:41.667 INFO:tasks.workunit.client.0.smithi040.stdout:3/191: mknod d1/d2/d3c/c41 0 2024-04-18T10:42:41.668 INFO:tasks.workunit.client.0.smithi040.stdout:0/191: dwrite dd/df/d19/d28/f33 [4194304,4194304] 0 2024-04-18T10:42:41.669 INFO:tasks.workunit.client.0.smithi040.stdout:2/113: rename la to dd/d14/l19 0 2024-04-18T10:42:41.670 INFO:tasks.workunit.client.0.smithi040.stdout:2/114: read - dd/d14/f16 zero size 2024-04-18T10:42:41.670 INFO:tasks.workunit.client.0.smithi040.stdout:2/115: rename dd/d14 to dd/d14/d1a 22 2024-04-18T10:42:41.671 INFO:tasks.workunit.client.0.smithi040.stdout:6/181: symlink df/d17/l48 0 2024-04-18T10:42:41.671 INFO:tasks.workunit.client.0.smithi040.stdout:2/116: truncate dd/f10 1394619 0 2024-04-18T10:42:41.677 INFO:tasks.workunit.client.0.smithi040.stdout:8/172: rmdir d2/d15/d18 39 2024-04-18T10:42:41.678 INFO:tasks.workunit.client.0.smithi040.stdout:8/173: chown d2/f31 22361 1 2024-04-18T10:42:41.678 INFO:tasks.workunit.client.0.smithi040.stdout:1/177: mknod d1/d16/d27/d2e/d3e/c44 0 2024-04-18T10:42:41.679 INFO:tasks.workunit.client.0.smithi040.stdout:8/174: dread d2/d5/d9/fb [0,4194304] 0 2024-04-18T10:42:41.679 INFO:tasks.workunit.client.0.smithi040.stdout:0/192: creat dd/df/f44 x:0 0 0 2024-04-18T10:42:41.680 INFO:tasks.workunit.client.0.smithi040.stdout:0/193: read dd/df/f15 [4959357,53258] 0 2024-04-18T10:42:41.681 INFO:tasks.workunit.client.0.smithi040.stdout:4/167: mkdir d2/d3/d4/d1f/d29 0 2024-04-18T10:42:41.682 INFO:tasks.workunit.client.0.smithi040.stdout:4/168: readlink d2/d3/d4/dd/d14/l16 0 2024-04-18T10:42:41.682 INFO:tasks.workunit.client.0.smithi040.stdout:9/246: link d2/d3/d22/d2e/d35/l2f d2/dd/de/l62 0 2024-04-18T10:42:41.684 INFO:tasks.workunit.client.0.smithi040.stdout:8/175: dread d2/d15/f25 [0,4194304] 0 2024-04-18T10:42:41.685 INFO:tasks.workunit.client.0.smithi040.stdout:7/181: link d6/d25/c26 d6/d3e/c41 0 2024-04-18T10:42:41.686 INFO:tasks.workunit.client.0.smithi040.stdout:7/182: write d6/d25/f21 [1716393,112619] 0 2024-04-18T10:42:41.689 INFO:tasks.workunit.client.0.smithi040.stdout:5/163: creat d0/f34 x:0 0 0 2024-04-18T10:42:41.690 INFO:tasks.workunit.client.0.smithi040.stdout:5/164: dread d0/d3/f5 [0,4194304] 0 2024-04-18T10:42:41.691 INFO:tasks.workunit.client.0.smithi040.stdout:9/247: creat d2/d3/d22/d2e/f63 x:0 0 0 2024-04-18T10:42:41.692 INFO:tasks.workunit.client.0.smithi040.stdout:4/169: rename d2/d3/l17 to d2/d3/d4/d23/l2a 0 2024-04-18T10:42:41.696 INFO:tasks.workunit.client.0.smithi040.stdout:5/165: dwrite d0/f1 [4194304,4194304] 0 2024-04-18T10:42:41.699 INFO:tasks.workunit.client.0.smithi040.stdout:2/117: creat dd/f1b x:0 0 0 2024-04-18T10:42:41.701 INFO:tasks.workunit.client.0.smithi040.stdout:9/248: fsync d2/d7/f15 0 2024-04-18T10:42:41.708 INFO:tasks.workunit.client.0.smithi040.stdout:9/249: mknod d2/dc/d46/c64 0 2024-04-18T10:42:41.711 INFO:tasks.workunit.client.0.smithi040.stdout:8/176: link d2/d15/d18/f27 d2/d10/f32 0 2024-04-18T10:42:41.714 INFO:tasks.workunit.client.0.smithi040.stdout:7/183: creat d6/d25/d28/f42 x:0 0 0 2024-04-18T10:42:41.714 INFO:tasks.workunit.client.0.smithi040.stdout:9/250: dwrite d2/d3/f4a [0,4194304] 0 2024-04-18T10:42:41.715 INFO:tasks.workunit.client.0.smithi040.stdout:2/118: symlink dd/l1c 0 2024-04-18T10:42:41.715 INFO:tasks.workunit.client.0.smithi040.stdout:2/119: chown f4 140050847 1 2024-04-18T10:42:41.721 INFO:tasks.workunit.client.0.smithi040.stdout:9/251: dwrite d2/f55 [0,4194304] 0 2024-04-18T10:42:41.722 INFO:tasks.workunit.client.0.smithi040.stdout:2/120: mknod dd/d14/c1d 0 2024-04-18T10:42:41.722 INFO:tasks.workunit.client.0.smithi040.stdout:9/252: dread - d2/dd/de/f53 zero size 2024-04-18T10:42:41.723 INFO:tasks.workunit.client.0.smithi040.stdout:4/170: link d2/d3/d4/dd/d14/l16 d2/d3/d4/l2b 0 2024-04-18T10:42:41.729 INFO:tasks.workunit.client.0.smithi040.stdout:8/177: link d2/d5/ce d2/d15/d2b/c33 0 2024-04-18T10:42:41.730 INFO:tasks.workunit.client.0.smithi040.stdout:7/184: link d6/d25/l23 d6/d25/d28/d38/l43 0 2024-04-18T10:42:41.732 INFO:tasks.workunit.client.0.smithi040.stdout:2/121: mknod dd/c1e 0 2024-04-18T10:42:41.734 INFO:tasks.workunit.client.0.smithi040.stdout:8/178: dread d2/d10/f26 [0,4194304] 0 2024-04-18T10:42:41.735 INFO:tasks.workunit.client.0.smithi040.stdout:2/122: unlink dd/c11 0 2024-04-18T10:42:41.736 INFO:tasks.workunit.client.0.smithi040.stdout:8/179: readlink d2/d15/d18/l1d 0 2024-04-18T10:42:41.737 INFO:tasks.workunit.client.0.smithi040.stdout:3/192: sync 2024-04-18T10:42:41.737 INFO:tasks.workunit.client.0.smithi040.stdout:7/185: dwrite d6/f32 [0,4194304] 0 2024-04-18T10:42:41.738 INFO:tasks.workunit.client.0.smithi040.stdout:8/180: chown d2/d10/f12 671 1 2024-04-18T10:42:41.739 INFO:tasks.workunit.client.0.smithi040.stdout:3/193: dread - d1/d2/f31 zero size 2024-04-18T10:42:41.742 INFO:tasks.workunit.client.0.smithi040.stdout:2/123: dread dd/f15 [0,4194304] 0 2024-04-18T10:42:41.742 INFO:tasks.workunit.client.0.smithi040.stdout:3/194: mknod d1/d2/d16/d18/d3b/c42 0 2024-04-18T10:42:41.746 INFO:tasks.workunit.client.0.smithi040.stdout:7/186: dwrite d6/d25/d28/d2c/f3d [0,4194304] 0 2024-04-18T10:42:41.750 INFO:tasks.workunit.client.0.smithi040.stdout:7/187: dread d6/d25/d28/d2c/f3d [0,4194304] 0 2024-04-18T10:42:41.751 INFO:tasks.workunit.client.0.smithi040.stdout:2/124: link dd/l13 dd/l1f 0 2024-04-18T10:42:41.753 INFO:tasks.workunit.client.0.smithi040.stdout:3/195: link d1/d2/d16/d18/l39 d1/d7/d26/l43 0 2024-04-18T10:42:41.756 INFO:tasks.workunit.client.0.smithi040.stdout:3/196: mknod d1/d2/d16/d18/d3b/c44 0 2024-04-18T10:42:41.757 INFO:tasks.workunit.client.0.smithi040.stdout:7/188: dwrite d6/f14 [0,4194304] 0 2024-04-18T10:42:41.763 INFO:tasks.workunit.client.0.smithi040.stdout:2/125: link c1 dd/c20 0 2024-04-18T10:42:41.764 INFO:tasks.workunit.client.0.smithi040.stdout:3/197: dwrite d1/d2/d16/f36 [0,4194304] 0 2024-04-18T10:42:41.765 INFO:tasks.workunit.client.0.smithi040.stdout:3/198: stat d1/d7/d12/f32 0 2024-04-18T10:42:41.771 INFO:tasks.workunit.client.0.smithi040.stdout:1/178: sync 2024-04-18T10:42:41.771 INFO:tasks.workunit.client.0.smithi040.stdout:6/182: sync 2024-04-18T10:42:41.771 INFO:tasks.workunit.client.0.smithi040.stdout:3/199: dwrite d1/f6 [0,4194304] 0 2024-04-18T10:42:41.772 INFO:tasks.workunit.client.0.smithi040.stdout:1/179: fdatasync d1/d16/f29 0 2024-04-18T10:42:41.774 INFO:tasks.workunit.client.0.smithi040.stdout:3/200: mknod d1/d7/c45 0 2024-04-18T10:42:41.777 INFO:tasks.workunit.client.0.smithi040.stdout:3/201: unlink d1/d2/d16/d18/l3e 0 2024-04-18T10:42:41.780 INFO:tasks.workunit.client.0.smithi040.stdout:1/180: getdents d1/d16/d27/d2d 0 2024-04-18T10:42:41.782 INFO:tasks.workunit.client.0.smithi040.stdout:6/183: getdents df/d17/d19 0 2024-04-18T10:42:41.784 INFO:tasks.workunit.client.0.smithi040.stdout:6/184: write df/f3b [931705,84172] 0 2024-04-18T10:42:41.785 INFO:tasks.workunit.client.0.smithi040.stdout:3/202: dwrite d1/d2/f31 [0,4194304] 0 2024-04-18T10:42:41.786 INFO:tasks.workunit.client.0.smithi040.stdout:1/181: symlink d1/d1c/d2b/d32/l45 0 2024-04-18T10:42:41.790 INFO:tasks.workunit.client.0.smithi040.stdout:3/203: creat d1/d2/d16/d18/f46 x:0 0 0 2024-04-18T10:42:41.792 INFO:tasks.workunit.client.0.smithi040.stdout:1/182: rename d1/d16/d27/f28 to d1/d16/d27/d2e/d39/f46 0 2024-04-18T10:42:41.792 INFO:tasks.workunit.client.0.smithi040.stdout:3/204: write d1/d7/f15 [1504475,80516] 0 2024-04-18T10:42:41.793 INFO:tasks.workunit.client.0.smithi040.stdout:6/185: dwrite df/d17/d19/f28 [0,4194304] 0 2024-04-18T10:42:41.794 INFO:tasks.workunit.client.0.smithi040.stdout:3/205: dread - d1/d2/d16/f25 zero size 2024-04-18T10:42:41.795 INFO:tasks.workunit.client.0.smithi040.stdout:3/206: stat d1/d2/d16/f1c 0 2024-04-18T10:42:41.797 INFO:tasks.workunit.client.0.smithi040.stdout:1/183: creat d1/d16/d27/f47 x:0 0 0 2024-04-18T10:42:41.798 INFO:tasks.workunit.client.0.smithi040.stdout:6/186: creat df/d17/f49 x:0 0 0 2024-04-18T10:42:41.799 INFO:tasks.workunit.client.0.smithi040.stdout:3/207: mknod d1/d2/d16/c47 0 2024-04-18T10:42:41.799 INFO:tasks.workunit.client.0.smithi040.stdout:7/189: dread d6/d25/f21 [0,4194304] 0 2024-04-18T10:42:41.800 INFO:tasks.workunit.client.0.smithi040.stdout:6/187: fsync df/d17/f22 0 2024-04-18T10:42:41.804 INFO:tasks.workunit.client.0.smithi040.stdout:6/188: symlink df/d17/d19/d3f/l4a 0 2024-04-18T10:42:41.804 INFO:tasks.workunit.client.0.smithi040.stdout:4/171: sync 2024-04-18T10:42:41.804 INFO:tasks.workunit.client.0.smithi040.stdout:6/189: chown df/d17/d19/f33 296736857 1 2024-04-18T10:42:41.807 INFO:tasks.workunit.client.0.smithi040.stdout:1/184: link d1/d16/d27/c40 d1/d16/d27/d2e/d3e/c48 0 2024-04-18T10:42:41.807 INFO:tasks.workunit.client.0.smithi040.stdout:4/172: read d2/f9 [2969506,65279] 0 2024-04-18T10:42:41.809 INFO:tasks.workunit.client.0.smithi040.stdout:7/190: creat d6/f44 x:0 0 0 2024-04-18T10:42:41.812 INFO:tasks.workunit.client.0.smithi040.stdout:4/173: creat d2/f2c x:0 0 0 2024-04-18T10:42:41.812 INFO:tasks.workunit.client.0.smithi040.stdout:4/174: stat d2/d3/d4/d21 0 2024-04-18T10:42:41.813 INFO:tasks.workunit.client.0.smithi040.stdout:7/191: rmdir d6/d25/d28/d2c/d2d 39 2024-04-18T10:42:41.814 INFO:tasks.workunit.client.0.smithi040.stdout:7/192: dread - d6/d25/f3f zero size 2024-04-18T10:42:41.815 INFO:tasks.workunit.client.0.smithi040.stdout:4/175: rmdir d2/d3/d4/d1f 39 2024-04-18T10:42:41.816 INFO:tasks.workunit.client.0.smithi040.stdout:4/176: dread - d2/d3/d4/dd/f22 zero size 2024-04-18T10:42:41.817 INFO:tasks.workunit.client.0.smithi040.stdout:7/193: readlink d6/d25/d28/d38/l43 0 2024-04-18T10:42:41.820 INFO:tasks.workunit.client.0.smithi040.stdout:7/194: dread d6/d25/f21 [0,4194304] 0 2024-04-18T10:42:41.821 INFO:tasks.workunit.client.0.smithi040.stdout:1/185: rename d1/c19 to d1/d1c/d2b/c49 0 2024-04-18T10:42:41.821 INFO:tasks.workunit.client.0.smithi040.stdout:7/195: write d6/f24 [3039561,57516] 0 2024-04-18T10:42:41.822 INFO:tasks.workunit.client.0.smithi040.stdout:4/177: symlink d2/d3/l2d 0 2024-04-18T10:42:41.823 INFO:tasks.workunit.client.0.smithi040.stdout:6/190: dread f7 [0,4194304] 0 2024-04-18T10:42:41.823 INFO:tasks.workunit.client.0.smithi040.stdout:4/178: chown d2/d3/d4/f12 620113 1 2024-04-18T10:42:41.827 INFO:tasks.workunit.client.0.smithi040.stdout:7/196: symlink d6/d3e/l45 0 2024-04-18T10:42:41.828 INFO:tasks.workunit.client.0.smithi040.stdout:6/191: mkdir df/d4b 0 2024-04-18T10:42:41.829 INFO:tasks.workunit.client.0.smithi040.stdout:6/192: readlink df/d17/l2e 0 2024-04-18T10:42:41.829 INFO:tasks.workunit.client.0.smithi040.stdout:6/193: fsync df/d17/d19/f32 0 2024-04-18T10:42:41.830 INFO:tasks.workunit.client.0.smithi040.stdout:7/197: creat d6/d25/f46 x:0 0 0 2024-04-18T10:42:41.831 INFO:tasks.workunit.client.0.smithi040.stdout:7/198: write d6/f44 [1011068,107380] 0 2024-04-18T10:42:41.834 INFO:tasks.workunit.client.0.smithi040.stdout:7/199: truncate d6/f20 3052082 0 2024-04-18T10:42:41.835 INFO:tasks.workunit.client.0.smithi040.stdout:7/200: read f0 [1535867,106466] 0 2024-04-18T10:42:41.836 INFO:tasks.workunit.client.0.smithi040.stdout:7/201: write d6/d25/f46 [261394,45857] 0 2024-04-18T10:42:41.838 INFO:tasks.workunit.client.0.smithi040.stdout:7/202: readlink d6/d25/d28/d38/l43 0 2024-04-18T10:42:41.841 INFO:tasks.workunit.client.0.smithi040.stdout:7/203: mkdir d6/d25/d28/d2c/d2d/d47 0 2024-04-18T10:42:41.844 INFO:tasks.workunit.client.0.smithi040.stdout:7/204: rename d6/d25/f21 to d6/d25/d28/d2c/d2d/d47/f48 0 2024-04-18T10:42:41.846 INFO:tasks.workunit.client.0.smithi040.stdout:7/205: getdents d6/d25/d28/d2c/d3c 0 2024-04-18T10:42:41.846 INFO:tasks.workunit.client.0.smithi040.stdout:2/126: sync 2024-04-18T10:42:41.857 INFO:tasks.workunit.client.0.smithi040.stdout:7/206: dread f0 [0,4194304] 0 2024-04-18T10:42:41.860 INFO:tasks.workunit.client.0.smithi040.stdout:7/207: creat d6/d25/d28/d2c/d3c/f49 x:0 0 0 2024-04-18T10:42:41.863 INFO:tasks.workunit.client.0.smithi040.stdout:7/208: rename d6/f24 to d6/d25/f4a 0 2024-04-18T10:42:41.864 INFO:tasks.workunit.client.0.smithi040.stdout:3/208: sync 2024-04-18T10:42:41.871 INFO:tasks.workunit.client.0.smithi040.stdout:3/209: dwrite d1/d2/d16/f36 [0,4194304] 0 2024-04-18T10:42:41.875 INFO:tasks.workunit.client.0.smithi040.stdout:3/210: unlink d1/d2/d16/d18/l2b 0 2024-04-18T10:42:41.876 INFO:tasks.workunit.client.0.smithi040.stdout:3/211: read d1/d2/f17 [3029197,715] 0 2024-04-18T10:42:41.881 INFO:tasks.workunit.client.0.smithi040.stdout:5/166: getdents d0/d3 0 2024-04-18T10:42:41.885 INFO:tasks.workunit.client.0.smithi040.stdout:7/209: dread d6/fa [4194304,4194304] 0 2024-04-18T10:42:41.888 INFO:tasks.workunit.client.0.smithi040.stdout:7/210: creat d6/d25/d28/f4b x:0 0 0 2024-04-18T10:42:41.889 INFO:tasks.workunit.client.0.smithi040.stdout:7/211: rmdir d6/d3e 39 2024-04-18T10:42:41.892 INFO:tasks.workunit.client.0.smithi040.stdout:0/194: getdents dd/df 0 2024-04-18T10:42:41.893 INFO:tasks.workunit.client.0.smithi040.stdout:0/195: creat dd/df/d19/f45 x:0 0 0 2024-04-18T10:42:41.895 INFO:tasks.workunit.client.0.smithi040.stdout:7/212: rename f0 to d6/d25/d28/d2c/f4c 0 2024-04-18T10:42:41.896 INFO:tasks.workunit.client.0.smithi040.stdout:0/196: mkdir dd/df/d19/d28/d3a/d46 0 2024-04-18T10:42:41.897 INFO:tasks.workunit.client.0.smithi040.stdout:7/213: write d6/d25/d28/d2c/f3d [751181,115768] 0 2024-04-18T10:42:41.897 INFO:tasks.workunit.client.0.smithi040.stdout:0/197: fdatasync dd/f1d 0 2024-04-18T10:42:41.898 INFO:tasks.workunit.client.0.smithi040.stdout:0/198: write dd/df/d19/d28/d3a/f41 [721644,9016] 0 2024-04-18T10:42:41.903 INFO:tasks.workunit.client.0.smithi040.stdout:0/199: mknod dd/df/d19/d28/d3a/d42/c47 0 2024-04-18T10:42:41.903 INFO:tasks.workunit.client.0.smithi040.stdout:0/200: chown dd/df/d19/f1a 1 1 2024-04-18T10:42:41.905 INFO:tasks.workunit.client.0.smithi040.stdout:0/201: mknod dd/df/d19/d28/c48 0 2024-04-18T10:42:41.906 INFO:tasks.workunit.client.0.smithi040.stdout:8/181: truncate d2/d15/d18/f27 3437561 0 2024-04-18T10:42:41.907 INFO:tasks.workunit.client.0.smithi040.stdout:8/182: fsync d2/d5/d9/f29 0 2024-04-18T10:42:41.908 INFO:tasks.workunit.client.0.smithi040.stdout:0/202: rename dd/df/d19/d28/f39 to dd/f49 0 2024-04-18T10:42:41.913 INFO:tasks.workunit.client.0.smithi040.stdout:9/253: truncate d2/f19 2229237 0 2024-04-18T10:42:41.924 INFO:tasks.workunit.client.0.smithi040.stdout:4/179: write d2/f26 [1043616,19727] 0 2024-04-18T10:42:41.929 INFO:tasks.workunit.client.0.smithi040.stdout:1/186: symlink d1/d1c/l4a 0 2024-04-18T10:42:41.930 INFO:tasks.workunit.client.0.smithi040.stdout:4/180: creat d2/d3/d4/f2e x:0 0 0 2024-04-18T10:42:41.930 INFO:tasks.workunit.client.0.smithi040.stdout:6/194: truncate f7 3349834 0 2024-04-18T10:42:41.932 INFO:tasks.workunit.client.0.smithi040.stdout:4/181: write d2/d3/d4/f12 [4016125,2594] 0 2024-04-18T10:42:41.934 INFO:tasks.workunit.client.0.smithi040.stdout:6/195: rmdir df/d17/d19/d3f 39 2024-04-18T10:42:41.934 INFO:tasks.workunit.client.0.smithi040.stdout:6/196: dread - df/f13 zero size 2024-04-18T10:42:41.937 INFO:tasks.workunit.client.0.smithi040.stdout:1/187: rename d1/d16/l1f to d1/d1c/d2b/d32/d35/l4b 0 2024-04-18T10:42:41.938 INFO:tasks.workunit.client.0.smithi040.stdout:4/182: write d2/d3/d4/fa [7277343,113981] 0 2024-04-18T10:42:41.940 INFO:tasks.workunit.client.0.smithi040.stdout:6/197: symlink df/d17/d19/d3f/l4c 0 2024-04-18T10:42:41.942 INFO:tasks.workunit.client.0.smithi040.stdout:1/188: symlink d1/d16/d27/l4c 0 2024-04-18T10:42:41.943 INFO:tasks.workunit.client.0.smithi040.stdout:2/127: dwrite f4 [0,4194304] 0 2024-04-18T10:42:41.943 INFO:tasks.workunit.client.0.smithi040.stdout:1/189: chown d1/d1c/f24 36735 1 2024-04-18T10:42:41.944 INFO:tasks.workunit.client.0.smithi040.stdout:4/183: mkdir d2/d3/d2f 0 2024-04-18T10:42:41.945 INFO:tasks.workunit.client.0.smithi040.stdout:3/212: truncate d1/d2/f17 4121808 0 2024-04-18T10:42:41.946 INFO:tasks.workunit.client.0.smithi040.stdout:5/167: truncate d0/d3/f17 2641236 0 2024-04-18T10:42:41.946 INFO:tasks.workunit.client.0.smithi040.stdout:2/128: fsync f9 0 2024-04-18T10:42:41.947 INFO:tasks.workunit.client.0.smithi040.stdout:1/190: mkdir d1/d1c/d2b/d32/d36/d4d 0 2024-04-18T10:42:41.951 INFO:tasks.workunit.client.0.smithi040.stdout:5/168: dwrite d0/f1 [4194304,4194304] 0 2024-04-18T10:42:41.951 INFO:tasks.workunit.client.0.smithi040.stdout:4/184: dread d2/f26 [0,4194304] 0 2024-04-18T10:42:41.952 INFO:tasks.workunit.client.0.smithi040.stdout:4/185: read d2/f26 [339419,119235] 0 2024-04-18T10:42:41.957 INFO:tasks.workunit.client.0.smithi040.stdout:6/198: creat df/f4d x:0 0 0 2024-04-18T10:42:41.957 INFO:tasks.workunit.client.0.smithi040.stdout:2/129: chown dd/d14/l19 14596 1 2024-04-18T10:42:41.960 INFO:tasks.workunit.client.0.smithi040.stdout:4/186: dread d2/d3/d4/fa [4194304,4194304] 0 2024-04-18T10:42:41.965 INFO:tasks.workunit.client.0.smithi040.stdout:1/191: dwrite d1/d16/f21 [0,4194304] 0 2024-04-18T10:42:41.966 INFO:tasks.workunit.client.0.smithi040.stdout:2/130: dwrite dd/f1b [0,4194304] 0 2024-04-18T10:42:41.967 INFO:tasks.workunit.client.0.smithi040.stdout:6/199: read f7 [12021,76929] 0 2024-04-18T10:42:41.969 INFO:tasks.workunit.client.0.smithi040.stdout:6/200: write df/f2d [1625156,113884] 0 2024-04-18T10:42:41.970 INFO:tasks.workunit.client.0.smithi040.stdout:7/214: link d6/f20 d6/d25/d28/d2c/f4d 0 2024-04-18T10:42:41.970 INFO:tasks.workunit.client.0.smithi040.stdout:5/169: creat d0/f35 x:0 0 0 2024-04-18T10:42:41.971 INFO:tasks.workunit.client.0.smithi040.stdout:7/215: dread - d6/d25/d28/f4b zero size 2024-04-18T10:42:41.972 INFO:tasks.workunit.client.0.smithi040.stdout:8/183: sync 2024-04-18T10:42:41.972 INFO:tasks.workunit.client.0.smithi040.stdout:9/254: sync 2024-04-18T10:42:41.972 INFO:tasks.workunit.client.0.smithi040.stdout:0/203: sync 2024-04-18T10:42:41.973 INFO:tasks.workunit.client.0.smithi040.stdout:9/255: stat d2/dd 0 2024-04-18T10:42:41.973 INFO:tasks.workunit.client.0.smithi040.stdout:2/131: dread f4 [0,4194304] 0 2024-04-18T10:42:41.973 INFO:tasks.workunit.client.0.smithi040.stdout:0/204: dread - dd/df/f44 zero size 2024-04-18T10:42:41.979 INFO:tasks.workunit.client.0.smithi040.stdout:8/184: rmdir d2/d15/d18 39 2024-04-18T10:42:41.983 INFO:tasks.workunit.client.0.smithi040.stdout:1/192: stat d1/d1c/d2b/d32/d35/l4b 0 2024-04-18T10:42:41.986 INFO:tasks.workunit.client.0.smithi040.stdout:0/205: symlink dd/df/d19/d28/d3a/d42/l4a 0 2024-04-18T10:42:41.988 INFO:tasks.workunit.client.0.smithi040.stdout:0/206: dread dd/df/f2b [0,4194304] 0 2024-04-18T10:42:41.988 INFO:tasks.workunit.client.0.smithi040.stdout:4/187: rename d2/l7 to d2/d3/d4/l30 0 2024-04-18T10:42:41.989 INFO:tasks.workunit.client.0.smithi040.stdout:6/201: mknod df/d4b/c4e 0 2024-04-18T10:42:41.993 INFO:tasks.workunit.client.0.smithi040.stdout:6/202: dread df/f3b [0,4194304] 0 2024-04-18T10:42:41.994 INFO:tasks.workunit.client.0.smithi040.stdout:6/203: write df/f13 [573494,71159] 0 2024-04-18T10:42:41.996 INFO:tasks.workunit.client.0.smithi040.stdout:0/207: write dd/df/d19/f31 [1854332,104274] 0 2024-04-18T10:42:41.997 INFO:tasks.workunit.client.0.smithi040.stdout:3/213: sync 2024-04-18T10:42:42.000 INFO:tasks.workunit.client.0.smithi040.stdout:7/216: creat d6/d25/d28/f4e x:0 0 0 2024-04-18T10:42:42.001 INFO:tasks.workunit.client.0.smithi040.stdout:8/185: mknod d2/d5/c34 0 2024-04-18T10:42:42.003 INFO:tasks.workunit.client.0.smithi040.stdout:5/170: dwrite d0/d3/f13 [0,4194304] 0 2024-04-18T10:42:42.004 INFO:tasks.workunit.client.0.smithi040.stdout:1/193: fsync d1/f15 0 2024-04-18T10:42:42.007 INFO:tasks.workunit.client.0.smithi040.stdout:4/188: mkdir d2/d3/d4/dd/d14/d31 0 2024-04-18T10:42:42.008 INFO:tasks.workunit.client.0.smithi040.stdout:4/189: chown d2/d3/d4/dd/f22 3787 1 2024-04-18T10:42:42.008 INFO:tasks.workunit.client.0.smithi040.stdout:9/256: truncate d2/d3/f1c 2401276 0 2024-04-18T10:42:42.009 INFO:tasks.workunit.client.0.smithi040.stdout:4/190: chown d2/d3/d4/fa 181949863 1 2024-04-18T10:42:42.009 INFO:tasks.workunit.client.0.smithi040.stdout:0/208: symlink dd/df/l4b 0 2024-04-18T10:42:42.014 INFO:tasks.workunit.client.0.smithi040.stdout:7/217: readlink d6/d25/d28/d38/l39 0 2024-04-18T10:42:42.015 INFO:tasks.workunit.client.0.smithi040.stdout:0/209: dwrite dd/df/d19/f45 [0,4194304] 0 2024-04-18T10:42:42.015 INFO:tasks.workunit.client.0.smithi040.stdout:2/132: link cc dd/d14/c21 0 2024-04-18T10:42:42.018 INFO:tasks.workunit.client.0.smithi040.stdout:1/194: rename d1/d16/d27/f47 to d1/d1c/d2b/d32/f4e 0 2024-04-18T10:42:42.022 INFO:tasks.workunit.client.0.smithi040.stdout:7/218: dwrite d6/f14 [0,4194304] 0 2024-04-18T10:42:42.022 INFO:tasks.workunit.client.0.smithi040.stdout:6/204: dread df/f25 [4194304,4194304] 0 2024-04-18T10:42:42.024 INFO:tasks.workunit.client.0.smithi040.stdout:4/191: rmdir d2/d3/d4/d23 39 2024-04-18T10:42:42.024 INFO:tasks.workunit.client.0.smithi040.stdout:8/186: mkdir d2/d5/d35 0 2024-04-18T10:42:42.025 INFO:tasks.workunit.client.0.smithi040.stdout:2/133: creat dd/d14/f22 x:0 0 0 2024-04-18T10:42:42.025 INFO:tasks.workunit.client.0.smithi040.stdout:2/134: fsync f9 0 2024-04-18T10:42:42.025 INFO:tasks.workunit.client.0.smithi040.stdout:0/210: creat dd/df/d19/d28/f4c x:0 0 0 2024-04-18T10:42:42.026 INFO:tasks.workunit.client.0.smithi040.stdout:3/214: creat d1/d2/f48 x:0 0 0 2024-04-18T10:42:42.027 INFO:tasks.workunit.client.0.smithi040.stdout:0/211: fdatasync dd/df/d19/d28/f38 0 2024-04-18T10:42:42.029 INFO:tasks.workunit.client.0.smithi040.stdout:2/135: dread dd/f10 [0,4194304] 0 2024-04-18T10:42:42.030 INFO:tasks.workunit.client.0.smithi040.stdout:2/136: dread - dd/d14/f16 zero size 2024-04-18T10:42:42.030 INFO:tasks.workunit.client.0.smithi040.stdout:4/192: fsync d2/d3/d4/dd/f22 0 2024-04-18T10:42:42.031 INFO:tasks.workunit.client.0.smithi040.stdout:2/137: fdatasync dd/d14/f22 0 2024-04-18T10:42:42.031 INFO:tasks.workunit.client.0.smithi040.stdout:4/193: read d2/d3/d4/dd/f22 [354644,11659] 0 2024-04-18T10:42:42.032 INFO:tasks.workunit.client.0.smithi040.stdout:3/215: rmdir d1/d2/d3c 39 2024-04-18T10:42:42.035 INFO:tasks.workunit.client.0.smithi040.stdout:5/171: getdents d0 0 2024-04-18T10:42:42.035 INFO:tasks.workunit.client.0.smithi040.stdout:5/172: chown d0/d3 13416 1 2024-04-18T10:42:42.037 INFO:tasks.workunit.client.0.smithi040.stdout:0/212: creat dd/df/d19/d28/d3a/f4d x:0 0 0 2024-04-18T10:42:42.038 INFO:tasks.workunit.client.0.smithi040.stdout:2/138: chown c6 776958969 1 2024-04-18T10:42:42.040 INFO:tasks.workunit.client.0.smithi040.stdout:4/194: unlink d2/d3/d4/f18 0 2024-04-18T10:42:42.041 INFO:tasks.workunit.client.0.smithi040.stdout:3/216: fsync d1/d7/d12/f32 0 2024-04-18T10:42:42.042 INFO:tasks.workunit.client.0.smithi040.stdout:6/205: rename df/l38 to df/l4f 0 2024-04-18T10:42:42.043 INFO:tasks.workunit.client.0.smithi040.stdout:6/206: truncate df/d17/d19/f1e 907274 0 2024-04-18T10:42:42.045 INFO:tasks.workunit.client.0.smithi040.stdout:2/139: mknod dd/d14/c23 0 2024-04-18T10:42:42.047 INFO:tasks.workunit.client.0.smithi040.stdout:4/195: write d2/d3/d4/fa [5336649,5113] 0 2024-04-18T10:42:42.049 INFO:tasks.workunit.client.0.smithi040.stdout:0/213: dwrite dd/df/f1e [4194304,4194304] 0 2024-04-18T10:42:42.049 INFO:tasks.workunit.client.0.smithi040.stdout:4/196: truncate d2/d3/d4/f25 911860 0 2024-04-18T10:42:42.050 INFO:tasks.workunit.client.0.smithi040.stdout:5/173: link d0/f1b d0/d3/f36 0 2024-04-18T10:42:42.052 INFO:tasks.workunit.client.0.smithi040.stdout:2/140: unlink f4 0 2024-04-18T10:42:42.053 INFO:tasks.workunit.client.0.smithi040.stdout:1/195: write d1/f23 [276150,5930] 0 2024-04-18T10:42:42.057 INFO:tasks.workunit.client.0.smithi040.stdout:5/174: chown d0/d21/c24 9 1 2024-04-18T10:42:42.058 INFO:tasks.workunit.client.0.smithi040.stdout:2/141: symlink dd/d14/l24 0 2024-04-18T10:42:42.058 INFO:tasks.workunit.client.0.smithi040.stdout:1/196: readlink d1/d1c/d2b/d32/d35/l4b 0 2024-04-18T10:42:42.060 INFO:tasks.workunit.client.0.smithi040.stdout:6/207: link c3 df/d17/d19/c50 0 2024-04-18T10:42:42.061 INFO:tasks.workunit.client.0.smithi040.stdout:3/217: link d1/le d1/d2/d16/l49 0 2024-04-18T10:42:42.062 INFO:tasks.workunit.client.0.smithi040.stdout:5/175: symlink d0/d3/l37 0 2024-04-18T10:42:42.063 INFO:tasks.workunit.client.0.smithi040.stdout:9/257: dwrite d2/d7/fa [0,4194304] 0 2024-04-18T10:42:42.064 INFO:tasks.workunit.client.0.smithi040.stdout:7/219: sync 2024-04-18T10:42:42.065 INFO:tasks.workunit.client.0.smithi040.stdout:2/142: write dd/d14/f16 [105898,62534] 0 2024-04-18T10:42:42.066 INFO:tasks.workunit.client.0.smithi040.stdout:8/187: dwrite d2/d10/f12 [0,4194304] 0 2024-04-18T10:42:42.066 INFO:tasks.workunit.client.0.smithi040.stdout:4/197: dwrite d2/d3/d4/f2e [0,4194304] 0 2024-04-18T10:42:42.067 INFO:tasks.workunit.client.0.smithi040.stdout:1/197: fdatasync d1/d1c/d2b/d32/d36/f38 0 2024-04-18T10:42:42.068 INFO:tasks.workunit.client.0.smithi040.stdout:3/218: symlink d1/d7/d3a/l4a 0 2024-04-18T10:42:42.068 INFO:tasks.workunit.client.0.smithi040.stdout:4/198: stat d2/f26 0 2024-04-18T10:42:42.069 INFO:tasks.workunit.client.0.smithi040.stdout:7/220: write d6/d25/d28/f42 [500354,35208] 0 2024-04-18T10:42:42.069 INFO:tasks.workunit.client.0.smithi040.stdout:2/143: chown dd/d14/c23 375436288 1 2024-04-18T10:42:42.072 INFO:tasks.workunit.client.0.smithi040.stdout:1/198: write d1/d16/f1b [1751820,30109] 0 2024-04-18T10:42:42.072 INFO:tasks.workunit.client.0.smithi040.stdout:3/219: chown d1/d7/d12/c1e 410347 1 2024-04-18T10:42:42.074 INFO:tasks.workunit.client.0.smithi040.stdout:1/199: write d1/d16/f21 [4424001,24579] 0 2024-04-18T10:42:42.075 INFO:tasks.workunit.client.0.smithi040.stdout:7/221: rmdir d6/d25/d28 39 2024-04-18T10:42:42.076 INFO:tasks.workunit.client.0.smithi040.stdout:1/200: write d1/d16/f1b [735335,16659] 0 2024-04-18T10:42:42.079 INFO:tasks.workunit.client.0.smithi040.stdout:8/188: dwrite d2/d15/d18/f1e [0,4194304] 0 2024-04-18T10:42:42.079 INFO:tasks.workunit.client.0.smithi040.stdout:9/258: link d2/d7/fa d2/d3/f65 0 2024-04-18T10:42:42.081 INFO:tasks.workunit.client.0.smithi040.stdout:8/189: chown d2/d5/c23 23820843 1 2024-04-18T10:42:42.082 INFO:tasks.workunit.client.0.smithi040.stdout:5/176: link d0/d3/f17 d0/d3/f38 0 2024-04-18T10:42:42.082 INFO:tasks.workunit.client.0.smithi040.stdout:7/222: dread d6/f14 [0,4194304] 0 2024-04-18T10:42:42.090 INFO:tasks.workunit.client.0.smithi040.stdout:1/201: creat d1/d16/d27/d2e/d39/f4f x:0 0 0 2024-04-18T10:42:42.091 INFO:tasks.workunit.client.0.smithi040.stdout:9/259: symlink d2/d3/d22/d2e/l66 0 2024-04-18T10:42:42.092 INFO:tasks.workunit.client.0.smithi040.stdout:0/214: dread dd/f2e [4194304,4194304] 0 2024-04-18T10:42:42.094 INFO:tasks.workunit.client.0.smithi040.stdout:7/223: dread d6/f44 [0,4194304] 0 2024-04-18T10:42:42.097 INFO:tasks.workunit.client.0.smithi040.stdout:4/199: creat d2/d3/d4/dd/d14/f32 x:0 0 0 2024-04-18T10:42:42.101 INFO:tasks.workunit.client.0.smithi040.stdout:4/200: fsync d2/d3/d4/f2e 0 2024-04-18T10:42:42.102 INFO:tasks.workunit.client.0.smithi040.stdout:8/190: mknod d2/d2c/c36 0 2024-04-18T10:42:42.104 INFO:tasks.workunit.client.0.smithi040.stdout:0/215: mkdir dd/df/d4e 0 2024-04-18T10:42:42.104 INFO:tasks.workunit.client.0.smithi040.stdout:6/208: write f4 [2533410,77972] 0 2024-04-18T10:42:42.104 INFO:tasks.workunit.client.0.smithi040.stdout:1/202: dwrite d1/d16/d27/d2e/d39/f46 [0,4194304] 0 2024-04-18T10:42:42.105 INFO:tasks.workunit.client.0.smithi040.stdout:1/203: fsync d1/d16/f3b 0 2024-04-18T10:42:42.108 INFO:tasks.workunit.client.0.smithi040.stdout:2/144: getdents dd/d14 0 2024-04-18T10:42:42.109 INFO:tasks.workunit.client.0.smithi040.stdout:7/224: dread d6/f14 [0,4194304] 0 2024-04-18T10:42:42.129 INFO:tasks.workunit.client.0.smithi040.stdout:7/225: read - d6/d25/f3f zero size 2024-04-18T10:42:42.130 INFO:tasks.workunit.client.0.smithi040.stdout:6/209: creat df/d4b/f51 x:0 0 0 2024-04-18T10:42:42.131 INFO:tasks.workunit.client.0.smithi040.stdout:3/220: write d1/d2/d16/d18/d3b/f3f [331586,25614] 0 2024-04-18T10:42:42.131 INFO:tasks.workunit.client.0.smithi040.stdout:5/177: link d0/d3/f38 d0/f39 0 2024-04-18T10:42:42.132 INFO:tasks.workunit.client.0.smithi040.stdout:7/226: write d6/d25/f3a [2290918,51233] 0 2024-04-18T10:42:42.133 INFO:tasks.workunit.client.0.smithi040.stdout:6/210: dread - df/d17/f47 zero size 2024-04-18T10:42:42.133 INFO:tasks.workunit.client.0.smithi040.stdout:9/260: write d2/d7/f8 [770449,95582] 0 2024-04-18T10:42:42.134 INFO:tasks.workunit.client.0.smithi040.stdout:2/145: dwrite dd/d14/f22 [0,4194304] 0 2024-04-18T10:42:42.135 INFO:tasks.workunit.client.0.smithi040.stdout:6/211: readlink df/d17/l1f 0 2024-04-18T10:42:42.135 INFO:tasks.workunit.client.0.smithi040.stdout:3/221: symlink d1/d7/l4b 0 2024-04-18T10:42:42.136 INFO:tasks.workunit.client.0.smithi040.stdout:8/191: rmdir d2/d5/d35 0 2024-04-18T10:42:42.137 INFO:tasks.workunit.client.0.smithi040.stdout:4/201: creat d2/d3/d4/d1f/d29/f33 x:0 0 0 2024-04-18T10:42:42.142 INFO:tasks.workunit.client.0.smithi040.stdout:6/212: mknod df/d17/c52 0 2024-04-18T10:42:42.144 INFO:tasks.workunit.client.0.smithi040.stdout:3/222: rename d1/d2/c1b to d1/d7/c4c 0 2024-04-18T10:42:42.145 INFO:tasks.workunit.client.0.smithi040.stdout:8/192: creat d2/d5/d9/f37 x:0 0 0 2024-04-18T10:42:42.146 INFO:tasks.workunit.client.0.smithi040.stdout:4/202: stat d2/c1b 0 2024-04-18T10:42:42.146 INFO:tasks.workunit.client.0.smithi040.stdout:8/193: chown d2/d5/d9/d1b 2 1 2024-04-18T10:42:42.147 INFO:tasks.workunit.client.0.smithi040.stdout:8/194: write d2/f17 [1085165,119785] 0 2024-04-18T10:42:42.147 INFO:tasks.workunit.client.0.smithi040.stdout:5/178: creat d0/d21/f3a x:0 0 0 2024-04-18T10:42:42.148 INFO:tasks.workunit.client.0.smithi040.stdout:2/146: symlink dd/l25 0 2024-04-18T10:42:42.148 INFO:tasks.workunit.client.0.smithi040.stdout:2/147: fsync dd/d14/f16 0 2024-04-18T10:42:42.149 INFO:tasks.workunit.client.0.smithi040.stdout:9/261: unlink d2/d3/f1c 0 2024-04-18T10:42:42.150 INFO:tasks.workunit.client.0.smithi040.stdout:6/213: unlink df/f21 0 2024-04-18T10:42:42.153 INFO:tasks.workunit.client.0.smithi040.stdout:8/195: stat d2/l13 0 2024-04-18T10:42:42.155 INFO:tasks.workunit.client.0.smithi040.stdout:4/203: dwrite d2/d3/d4/dd/f22 [0,4194304] 0 2024-04-18T10:42:42.155 INFO:tasks.workunit.client.0.smithi040.stdout:2/148: unlink dd/f10 0 2024-04-18T10:42:42.158 INFO:tasks.workunit.client.0.smithi040.stdout:3/223: dwrite d1/d2/d16/f2d [0,4194304] 0 2024-04-18T10:42:42.162 INFO:tasks.workunit.client.0.smithi040.stdout:4/204: dwrite d2/d3/d4/dd/f22 [0,4194304] 0 2024-04-18T10:42:42.163 INFO:tasks.workunit.client.0.smithi040.stdout:4/205: write d2/d3/d4/f2e [1926187,130456] 0 2024-04-18T10:42:42.163 INFO:tasks.workunit.client.0.smithi040.stdout:5/179: mkdir d0/d3b 0 2024-04-18T10:42:42.170 INFO:tasks.workunit.client.0.smithi040.stdout:7/227: link d6/d25/l23 d6/d25/d28/d38/l4f 0 2024-04-18T10:42:42.171 INFO:tasks.workunit.client.0.smithi040.stdout:8/196: getdents d2/d15/d18 0 2024-04-18T10:42:42.173 INFO:tasks.workunit.client.0.smithi040.stdout:0/216: sync 2024-04-18T10:42:42.173 INFO:tasks.workunit.client.0.smithi040.stdout:2/149: symlink dd/l26 0 2024-04-18T10:42:42.175 INFO:tasks.workunit.client.0.smithi040.stdout:3/224: mknod d1/d2/d16/c4d 0 2024-04-18T10:42:42.176 INFO:tasks.workunit.client.0.smithi040.stdout:5/180: symlink d0/d3b/l3c 0 2024-04-18T10:42:42.177 INFO:tasks.workunit.client.0.smithi040.stdout:4/206: symlink d2/d3/d2f/l34 0 2024-04-18T10:42:42.178 INFO:tasks.workunit.client.0.smithi040.stdout:6/214: getdents df/d4b 0 2024-04-18T10:42:42.179 INFO:tasks.workunit.client.0.smithi040.stdout:0/217: unlink dd/df/d19/d28/d3a/d42/c47 0 2024-04-18T10:42:42.181 INFO:tasks.workunit.client.0.smithi040.stdout:2/150: rename cc to dd/d14/c27 0 2024-04-18T10:42:42.181 INFO:tasks.workunit.client.0.smithi040.stdout:0/218: truncate dd/f49 549456 0 2024-04-18T10:42:42.181 INFO:tasks.workunit.client.0.smithi040.stdout:7/228: mkdir d6/d50 0 2024-04-18T10:42:42.182 INFO:tasks.workunit.client.0.smithi040.stdout:3/225: dwrite d1/f6 [0,4194304] 0 2024-04-18T10:42:42.182 INFO:tasks.workunit.client.0.smithi040.stdout:7/229: write d6/d25/f3a [360123,124778] 0 2024-04-18T10:42:42.183 INFO:tasks.workunit.client.0.smithi040.stdout:4/207: readlink d2/d3/d4/dd/d14/l16 0 2024-04-18T10:42:42.184 INFO:tasks.workunit.client.0.smithi040.stdout:4/208: stat d2/d3/d4/dd/d14/f32 0 2024-04-18T10:42:42.185 INFO:tasks.workunit.client.0.smithi040.stdout:6/215: mkdir df/d17/d19/d3f/d53 0 2024-04-18T10:42:42.185 INFO:tasks.workunit.client.0.smithi040.stdout:2/151: read f9 [1922341,108749] 0 2024-04-18T10:42:42.186 INFO:tasks.workunit.client.0.smithi040.stdout:5/181: symlink d0/d1c/l3d 0 2024-04-18T10:42:42.186 INFO:tasks.workunit.client.0.smithi040.stdout:0/219: symlink dd/df/d19/d28/d3a/l4f 0 2024-04-18T10:42:42.189 INFO:tasks.workunit.client.0.smithi040.stdout:7/230: creat d6/d25/d28/d2c/d3c/f51 x:0 0 0 2024-04-18T10:42:42.190 INFO:tasks.workunit.client.0.smithi040.stdout:3/226: dread d1/d2/d16/f1c [0,4194304] 0 2024-04-18T10:42:42.191 INFO:tasks.workunit.client.0.smithi040.stdout:6/216: symlink df/d4b/l54 0 2024-04-18T10:42:42.193 INFO:tasks.workunit.client.0.smithi040.stdout:6/217: read - df/d17/d19/f40 zero size 2024-04-18T10:42:42.194 INFO:tasks.workunit.client.0.smithi040.stdout:2/152: rmdir dd/d14 39 2024-04-18T10:42:42.197 INFO:tasks.workunit.client.0.smithi040.stdout:7/231: dwrite d6/d25/d28/f36 [0,4194304] 0 2024-04-18T10:42:42.199 INFO:tasks.workunit.client.0.smithi040.stdout:9/262: truncate d2/d7/f2a 3644346 0 2024-04-18T10:42:42.201 INFO:tasks.workunit.client.0.smithi040.stdout:2/153: dread dd/f1b [0,4194304] 0 2024-04-18T10:42:42.204 INFO:tasks.workunit.client.0.smithi040.stdout:3/227: dwrite d1/d2/d16/f25 [0,4194304] 0 2024-04-18T10:42:42.204 INFO:tasks.workunit.client.0.smithi040.stdout:0/220: creat dd/df/d4e/f50 x:0 0 0 2024-04-18T10:42:42.204 INFO:tasks.workunit.client.0.smithi040.stdout:5/182: read d0/d3/f17 [1807996,21131] 0 2024-04-18T10:42:42.209 INFO:tasks.workunit.client.0.smithi040.stdout:1/204: sync 2024-04-18T10:42:42.210 INFO:tasks.workunit.client.0.smithi040.stdout:9/263: symlink d2/d5b/l67 0 2024-04-18T10:42:42.214 INFO:tasks.workunit.client.0.smithi040.stdout:8/197: write d2/d15/d18/f27 [4255954,13981] 0 2024-04-18T10:42:42.214 INFO:tasks.workunit.client.0.smithi040.stdout:8/198: chown d2/d5/d9/f29 26 1 2024-04-18T10:42:42.214 INFO:tasks.workunit.client.0.smithi040.stdout:8/199: truncate d2/f2a 503076 0 2024-04-18T10:42:42.214 INFO:tasks.workunit.client.0.smithi040.stdout:5/183: symlink d0/d3b/l3e 0 2024-04-18T10:42:42.215 INFO:tasks.workunit.client.0.smithi040.stdout:1/205: dread d1/d16/d27/f34 [0,4194304] 0 2024-04-18T10:42:42.216 INFO:tasks.workunit.client.0.smithi040.stdout:3/228: mkdir d1/d2/d4e 0 2024-04-18T10:42:42.219 INFO:tasks.workunit.client.0.smithi040.stdout:5/184: mkdir d0/d3b/d3f 0 2024-04-18T10:42:42.219 INFO:tasks.workunit.client.0.smithi040.stdout:2/154: dwrite dd/f1b [0,4194304] 0 2024-04-18T10:42:42.220 INFO:tasks.workunit.client.0.smithi040.stdout:8/200: creat d2/d22/f38 x:0 0 0 2024-04-18T10:42:42.220 INFO:tasks.workunit.client.0.smithi040.stdout:5/185: readlink d0/d3b/l3c 0 2024-04-18T10:42:42.221 INFO:tasks.workunit.client.0.smithi040.stdout:1/206: creat d1/d1c/d2b/d32/d36/f50 x:0 0 0 2024-04-18T10:42:42.221 INFO:tasks.workunit.client.0.smithi040.stdout:4/209: write d2/f9 [3561223,59518] 0 2024-04-18T10:42:42.222 INFO:tasks.workunit.client.0.smithi040.stdout:2/155: unlink dd/l1c 0 2024-04-18T10:42:42.222 INFO:tasks.workunit.client.0.smithi040.stdout:0/221: dwrite dd/df/f13 [0,4194304] 0 2024-04-18T10:42:42.222 INFO:tasks.workunit.client.0.smithi040.stdout:5/186: read d0/d3/f13 [1065507,19015] 0 2024-04-18T10:42:42.225 INFO:tasks.workunit.client.0.smithi040.stdout:5/187: fsync d0/d21/f3a 0 2024-04-18T10:42:42.225 INFO:tasks.workunit.client.0.smithi040.stdout:7/232: fdatasync d6/d25/d28/f36 0 2024-04-18T10:42:42.226 INFO:tasks.workunit.client.0.smithi040.stdout:4/210: write d2/d3/d4/dd/d14/f32 [1028249,22934] 0 2024-04-18T10:42:42.228 INFO:tasks.workunit.client.0.smithi040.stdout:7/233: dread - d6/d25/d28/f4e zero size 2024-04-18T10:42:42.228 INFO:tasks.workunit.client.0.smithi040.stdout:8/201: mknod d2/d22/c39 0 2024-04-18T10:42:42.229 INFO:tasks.workunit.client.0.smithi040.stdout:4/211: write d2/d3/d4/dd/f22 [3687244,17752] 0 2024-04-18T10:42:42.232 INFO:tasks.workunit.client.0.smithi040.stdout:4/212: stat d2/d3/l2d 0 2024-04-18T10:42:42.232 INFO:tasks.workunit.client.0.smithi040.stdout:1/207: dwrite d1/d16/d27/d2e/d39/f4f [0,4194304] 0 2024-04-18T10:42:42.233 INFO:tasks.workunit.client.0.smithi040.stdout:4/213: write d2/d3/d4/dd/f22 [1823153,80884] 0 2024-04-18T10:42:42.235 INFO:tasks.workunit.client.0.smithi040.stdout:5/188: fsync d0/f35 0 2024-04-18T10:42:42.238 INFO:tasks.workunit.client.0.smithi040.stdout:0/222: creat dd/df/d19/d28/d3a/f51 x:0 0 0 2024-04-18T10:42:42.239 INFO:tasks.workunit.client.0.smithi040.stdout:4/214: write d2/d3/d4/f12 [4860787,81740] 0 2024-04-18T10:42:42.240 INFO:tasks.workunit.client.0.smithi040.stdout:6/218: dread df/d17/f1b [0,4194304] 0 2024-04-18T10:42:42.240 INFO:tasks.workunit.client.0.smithi040.stdout:7/234: dwrite d6/d25/d28/d2c/d3c/f51 [0,4194304] 0 2024-04-18T10:42:42.242 INFO:tasks.workunit.client.0.smithi040.stdout:3/229: getdents d1/d2/d16 0 2024-04-18T10:42:42.243 INFO:tasks.workunit.client.0.smithi040.stdout:4/215: write d2/d3/d4/dd/d14/f32 [1123087,33250] 0 2024-04-18T10:42:42.245 INFO:tasks.workunit.client.0.smithi040.stdout:2/156: creat dd/f28 x:0 0 0 2024-04-18T10:42:42.249 INFO:tasks.workunit.client.0.smithi040.stdout:7/235: creat d6/d25/d28/d2c/d2d/d47/f52 x:0 0 0 2024-04-18T10:42:42.249 INFO:tasks.workunit.client.0.smithi040.stdout:5/189: dwrite d0/d3/f10 [0,4194304] 0 2024-04-18T10:42:42.261 INFO:tasks.workunit.client.0.smithi040.stdout:1/208: dread d1/d16/f29 [0,4194304] 0 2024-04-18T10:42:42.262 INFO:tasks.workunit.client.0.smithi040.stdout:8/202: link d2/d5/d9/d1b/l2e d2/d10/d14/l3a 0 2024-04-18T10:42:42.262 INFO:tasks.workunit.client.0.smithi040.stdout:9/264: dread d2/d7/f14 [0,4194304] 0 2024-04-18T10:42:42.262 INFO:tasks.workunit.client.0.smithi040.stdout:6/219: creat df/f55 x:0 0 0 2024-04-18T10:42:42.263 INFO:tasks.workunit.client.0.smithi040.stdout:1/209: fsync d1/d16/f3b 0 2024-04-18T10:42:42.264 INFO:tasks.workunit.client.0.smithi040.stdout:4/216: getdents d2 0 2024-04-18T10:42:42.265 INFO:tasks.workunit.client.0.smithi040.stdout:8/203: write d2/d5/d9/f37 [697632,83214] 0 2024-04-18T10:42:42.265 INFO:tasks.workunit.client.0.smithi040.stdout:9/265: write d2/dd/de/f58 [311754,24855] 0 2024-04-18T10:42:42.266 INFO:tasks.workunit.client.0.smithi040.stdout:5/190: creat d0/d3b/d3f/f40 x:0 0 0 2024-04-18T10:42:42.267 INFO:tasks.workunit.client.0.smithi040.stdout:5/191: chown d0/d1c 60 1 2024-04-18T10:42:42.267 INFO:tasks.workunit.client.0.smithi040.stdout:6/220: creat df/d17/f56 x:0 0 0 2024-04-18T10:42:42.272 INFO:tasks.workunit.client.0.smithi040.stdout:7/236: creat d6/d25/f53 x:0 0 0 2024-04-18T10:42:42.273 INFO:tasks.workunit.client.0.smithi040.stdout:8/204: creat d2/d2c/f3b x:0 0 0 2024-04-18T10:42:42.274 INFO:tasks.workunit.client.0.smithi040.stdout:9/266: creat d2/d3/d22/d2e/d35/d40/f68 x:0 0 0 2024-04-18T10:42:42.275 INFO:tasks.workunit.client.0.smithi040.stdout:9/267: stat d2/d7/f2c 0 2024-04-18T10:42:42.277 INFO:tasks.workunit.client.0.smithi040.stdout:7/237: dread d6/d25/d28/f36 [0,4194304] 0 2024-04-18T10:42:42.278 INFO:tasks.workunit.client.0.smithi040.stdout:1/210: rename d1/c10 to d1/d16/d27/c51 0 2024-04-18T10:42:42.280 INFO:tasks.workunit.client.0.smithi040.stdout:8/205: mkdir d2/d5/d9/d3c 0 2024-04-18T10:42:42.289 INFO:tasks.workunit.client.0.smithi040.stdout:8/206: fsync d2/d10/f12 0 2024-04-18T10:42:42.289 INFO:tasks.workunit.client.0.smithi040.stdout:7/238: dwrite d6/d25/f3f [0,4194304] 0 2024-04-18T10:42:42.289 INFO:tasks.workunit.client.0.smithi040.stdout:6/221: mknod df/d17/d19/d3f/d53/c57 0 2024-04-18T10:42:42.289 INFO:tasks.workunit.client.0.smithi040.stdout:2/157: link dd/l1f dd/l29 0 2024-04-18T10:42:42.289 INFO:tasks.workunit.client.0.smithi040.stdout:0/223: write dd/f10 [1078872,88442] 0 2024-04-18T10:42:42.290 INFO:tasks.workunit.client.0.smithi040.stdout:8/207: dwrite d2/f31 [0,4194304] 0 2024-04-18T10:42:42.292 INFO:tasks.workunit.client.0.smithi040.stdout:4/217: dread d2/f9 [0,4194304] 0 2024-04-18T10:42:42.292 INFO:tasks.workunit.client.0.smithi040.stdout:0/224: creat dd/df/d19/d28/d3a/d42/f52 x:0 0 0 2024-04-18T10:42:42.293 INFO:tasks.workunit.client.0.smithi040.stdout:5/192: write d0/d3/f1a [1909467,60848] 0 2024-04-18T10:42:42.293 INFO:tasks.workunit.client.0.smithi040.stdout:5/193: stat d0/d21/f3a 0 2024-04-18T10:42:42.295 INFO:tasks.workunit.client.0.smithi040.stdout:9/268: getdents d2/dc/d46/d44 0 2024-04-18T10:42:42.297 INFO:tasks.workunit.client.0.smithi040.stdout:8/208: mknod d2/d5/d9/c3d 0 2024-04-18T10:42:42.300 INFO:tasks.workunit.client.0.smithi040.stdout:5/194: creat d0/d3b/d3f/f41 x:0 0 0 2024-04-18T10:42:42.303 INFO:tasks.workunit.client.0.smithi040.stdout:6/222: link df/d17/c45 df/d17/d19/c58 0 2024-04-18T10:42:42.304 INFO:tasks.workunit.client.0.smithi040.stdout:9/269: link d2/dd/f54 d2/dc/d46/f69 0 2024-04-18T10:42:42.304 INFO:tasks.workunit.client.0.smithi040.stdout:2/158: link dd/l25 dd/l2a 0 2024-04-18T10:42:42.305 INFO:tasks.workunit.client.0.smithi040.stdout:4/218: dwrite d2/f9 [0,4194304] 0 2024-04-18T10:42:42.306 INFO:tasks.workunit.client.0.smithi040.stdout:1/211: symlink d1/d16/d27/d2e/d39/l52 0 2024-04-18T10:42:42.306 INFO:tasks.workunit.client.0.smithi040.stdout:3/230: sync 2024-04-18T10:42:42.308 INFO:tasks.workunit.client.0.smithi040.stdout:1/212: stat d1/d16/d27/d2d/c37 0 2024-04-18T10:42:42.309 INFO:tasks.workunit.client.0.smithi040.stdout:7/239: write d6/f22 [4726425,98861] 0 2024-04-18T10:42:42.310 INFO:tasks.workunit.client.0.smithi040.stdout:0/225: getdents dd/df/d19 0 2024-04-18T10:42:42.310 INFO:tasks.workunit.client.0.smithi040.stdout:5/195: dread d0/d3/f10 [0,4194304] 0 2024-04-18T10:42:42.311 INFO:tasks.workunit.client.0.smithi040.stdout:7/240: write d6/f1f [3000297,110861] 0 2024-04-18T10:42:42.312 INFO:tasks.workunit.client.0.smithi040.stdout:6/223: rename df/f25 to df/d17/d19/d3f/f59 0 2024-04-18T10:42:42.314 INFO:tasks.workunit.client.0.smithi040.stdout:4/219: creat d2/d3/d2f/f35 x:0 0 0 2024-04-18T10:42:42.314 INFO:tasks.workunit.client.0.smithi040.stdout:6/224: stat df/d17/f47 0 2024-04-18T10:42:42.317 INFO:tasks.workunit.client.0.smithi040.stdout:6/225: stat df/d17/d19/d3f/f59 0 2024-04-18T10:42:42.317 INFO:tasks.workunit.client.0.smithi040.stdout:2/159: dwrite dd/d14/f16 [0,4194304] 0 2024-04-18T10:42:42.320 INFO:tasks.workunit.client.0.smithi040.stdout:0/226: creat dd/df/d19/d28/f53 x:0 0 0 2024-04-18T10:42:42.322 INFO:tasks.workunit.client.0.smithi040.stdout:3/231: rename d1/d7/fa to d1/f4f 0 2024-04-18T10:42:42.325 INFO:tasks.workunit.client.0.smithi040.stdout:4/220: creat d2/d3/f36 x:0 0 0 2024-04-18T10:42:42.327 INFO:tasks.workunit.client.0.smithi040.stdout:1/213: creat d1/d1c/d2b/d32/f53 x:0 0 0 2024-04-18T10:42:42.328 INFO:tasks.workunit.client.0.smithi040.stdout:6/226: mknod df/d17/d19/d3f/c5a 0 2024-04-18T10:42:42.329 INFO:tasks.workunit.client.0.smithi040.stdout:2/160: mkdir dd/d14/d2b 0 2024-04-18T10:42:42.330 INFO:tasks.workunit.client.0.smithi040.stdout:5/196: write d0/f39 [2258787,34966] 0 2024-04-18T10:42:42.333 INFO:tasks.workunit.client.0.smithi040.stdout:8/209: dread d2/d5/d9/f29 [0,4194304] 0 2024-04-18T10:42:42.336 INFO:tasks.workunit.client.0.smithi040.stdout:7/241: rename d6/d25/f19 to d6/d50/f54 0 2024-04-18T10:42:42.337 INFO:tasks.workunit.client.0.smithi040.stdout:4/221: dwrite d2/f2c [0,4194304] 0 2024-04-18T10:42:42.337 INFO:tasks.workunit.client.0.smithi040.stdout:9/270: dwrite d2/d7/f2c [0,4194304] 0 2024-04-18T10:42:42.341 INFO:tasks.workunit.client.0.smithi040.stdout:3/232: chown d1/d2/d16/c24 30891 1 2024-04-18T10:42:42.341 INFO:tasks.workunit.client.0.smithi040.stdout:2/161: mkdir dd/d2c 0 2024-04-18T10:42:42.344 INFO:tasks.workunit.client.0.smithi040.stdout:7/242: chown d6/d3e/l45 6 1 2024-04-18T10:42:42.345 INFO:tasks.workunit.client.0.smithi040.stdout:1/214: dwrite d1/f30 [0,4194304] 0 2024-04-18T10:42:42.345 INFO:tasks.workunit.client.0.smithi040.stdout:8/210: rename d2/d15/d2b/c30 to d2/d10/c3e 0 2024-04-18T10:42:42.345 INFO:tasks.workunit.client.0.smithi040.stdout:4/222: mknod d2/c37 0 2024-04-18T10:42:42.346 INFO:tasks.workunit.client.0.smithi040.stdout:5/197: dread d0/d1e/f29 [4194304,4194304] 0 2024-04-18T10:42:42.347 INFO:tasks.workunit.client.0.smithi040.stdout:8/211: write d2/d10/f32 [4182530,130078] 0 2024-04-18T10:42:42.348 INFO:tasks.workunit.client.0.smithi040.stdout:6/227: creat df/f5b x:0 0 0 2024-04-18T10:42:42.349 INFO:tasks.workunit.client.0.smithi040.stdout:4/223: write d2/d3/d4/fa [9114305,106323] 0 2024-04-18T10:42:42.350 INFO:tasks.workunit.client.0.smithi040.stdout:9/271: creat d2/d3/d22/f6a x:0 0 0 2024-04-18T10:42:42.352 INFO:tasks.workunit.client.0.smithi040.stdout:8/212: write d2/d10/d14/f16 [3539509,30511] 0 2024-04-18T10:42:42.353 INFO:tasks.workunit.client.0.smithi040.stdout:4/224: write d2/f2c [1356376,44589] 0 2024-04-18T10:42:42.353 INFO:tasks.workunit.client.0.smithi040.stdout:2/162: stat dd/l25 0 2024-04-18T10:42:42.353 INFO:tasks.workunit.client.0.smithi040.stdout:6/228: write df/d17/f3d [1984393,89980] 0 2024-04-18T10:42:42.353 INFO:tasks.workunit.client.0.smithi040.stdout:7/243: mkdir d6/d25/d28/d2c/d2d/d47/d55 0 2024-04-18T10:42:42.354 INFO:tasks.workunit.client.0.smithi040.stdout:3/233: write d1/d7/d3a/f3d [198030,94896] 0 2024-04-18T10:42:42.354 INFO:tasks.workunit.client.0.smithi040.stdout:9/272: write d2/d3/f4a [2966921,2668] 0 2024-04-18T10:42:42.357 INFO:tasks.workunit.client.0.smithi040.stdout:6/229: write df/f2f [627167,5809] 0 2024-04-18T10:42:42.358 INFO:tasks.workunit.client.0.smithi040.stdout:8/213: write d2/d15/d18/f1e [697597,122644] 0 2024-04-18T10:42:42.360 INFO:tasks.workunit.client.0.smithi040.stdout:2/163: unlink dd/d14/c23 0 2024-04-18T10:42:42.360 INFO:tasks.workunit.client.0.smithi040.stdout:3/234: truncate d1/d2/f1f 4338763 0 2024-04-18T10:42:42.361 INFO:tasks.workunit.client.0.smithi040.stdout:1/215: dwrite d1/d1c/d2b/d32/d36/f50 [0,4194304] 0 2024-04-18T10:42:42.362 INFO:tasks.workunit.client.0.smithi040.stdout:4/225: creat d2/d3/f38 x:0 0 0 2024-04-18T10:42:42.362 INFO:tasks.workunit.client.0.smithi040.stdout:5/198: dwrite d0/d3/f2b [0,4194304] 0 2024-04-18T10:42:42.363 INFO:tasks.workunit.client.0.smithi040.stdout:8/214: write d2/f31 [3309634,68162] 0 2024-04-18T10:42:42.363 INFO:tasks.workunit.client.0.smithi040.stdout:9/273: fsync d2/d7/f14 0 2024-04-18T10:42:42.365 INFO:tasks.workunit.client.0.smithi040.stdout:6/230: creat df/d17/d19/d3f/f5c x:0 0 0 2024-04-18T10:42:42.366 INFO:tasks.workunit.client.0.smithi040.stdout:5/199: read - d0/d21/f3a zero size 2024-04-18T10:42:42.366 INFO:tasks.workunit.client.0.smithi040.stdout:0/227: sync 2024-04-18T10:42:42.367 INFO:tasks.workunit.client.0.smithi040.stdout:1/216: creat d1/d16/f54 x:0 0 0 2024-04-18T10:42:42.367 INFO:tasks.workunit.client.0.smithi040.stdout:2/164: mknod dd/c2d 0 2024-04-18T10:42:42.369 INFO:tasks.workunit.client.0.smithi040.stdout:7/244: read d6/f20 [1446092,28162] 0 2024-04-18T10:42:42.370 INFO:tasks.workunit.client.0.smithi040.stdout:0/228: write dd/df/d19/d28/f38 [304554,55647] 0 2024-04-18T10:42:42.373 INFO:tasks.workunit.client.0.smithi040.stdout:7/245: read - d6/d25/d28/f2f zero size 2024-04-18T10:42:42.373 INFO:tasks.workunit.client.0.smithi040.stdout:5/200: mkdir d0/d21/d42 0 2024-04-18T10:42:42.374 INFO:tasks.workunit.client.0.smithi040.stdout:7/246: chown c4 0 1 2024-04-18T10:42:42.374 INFO:tasks.workunit.client.0.smithi040.stdout:4/226: rename d2/d3/d4/fa to d2/d3/d4/dd/d14/d19/f39 0 2024-04-18T10:42:42.376 INFO:tasks.workunit.client.0.smithi040.stdout:8/215: truncate d2/d5/d9/fb 784682 0 2024-04-18T10:42:42.378 INFO:tasks.workunit.client.0.smithi040.stdout:9/274: dwrite d2/dd/de/f53 [0,4194304] 0 2024-04-18T10:42:42.378 INFO:tasks.workunit.client.0.smithi040.stdout:1/217: truncate d1/f23 1788400 0 2024-04-18T10:42:42.379 INFO:tasks.workunit.client.0.smithi040.stdout:8/216: fdatasync d2/f2a 0 2024-04-18T10:42:42.379 INFO:tasks.workunit.client.0.smithi040.stdout:2/165: dwrite dd/f28 [0,4194304] 0 2024-04-18T10:42:42.380 INFO:tasks.workunit.client.0.smithi040.stdout:5/201: read d0/d3/f1a [422611,59408] 0 2024-04-18T10:42:42.381 INFO:tasks.workunit.client.0.smithi040.stdout:8/217: chown d2/d5/c34 63711 1 2024-04-18T10:42:42.381 INFO:tasks.workunit.client.0.smithi040.stdout:8/218: chown d2/d10/f26 2222794 1 2024-04-18T10:42:42.386 INFO:tasks.workunit.client.0.smithi040.stdout:1/218: write d1/f11 [1245585,126590] 0 2024-04-18T10:42:42.388 INFO:tasks.workunit.client.0.smithi040.stdout:5/202: symlink d0/d21/l43 0 2024-04-18T10:42:42.391 INFO:tasks.workunit.client.0.smithi040.stdout:8/219: symlink d2/l3f 0 2024-04-18T10:42:42.392 INFO:tasks.workunit.client.0.smithi040.stdout:8/220: truncate d2/d5/d9/d1b/f2f 455750 0 2024-04-18T10:42:42.393 INFO:tasks.workunit.client.0.smithi040.stdout:1/219: creat d1/d16/d27/d2e/f55 x:0 0 0 2024-04-18T10:42:42.394 INFO:tasks.workunit.client.0.smithi040.stdout:9/275: read d2/d7/f2a [2302731,57045] 0 2024-04-18T10:42:42.394 INFO:tasks.workunit.client.0.smithi040.stdout:2/166: creat dd/d14/d2b/f2e x:0 0 0 2024-04-18T10:42:42.395 INFO:tasks.workunit.client.0.smithi040.stdout:9/276: stat d2/dc/f1a 0 2024-04-18T10:42:42.397 INFO:tasks.workunit.client.0.smithi040.stdout:8/221: mkdir d2/d15/d2b/d40 0 2024-04-18T10:42:42.398 INFO:tasks.workunit.client.0.smithi040.stdout:8/222: fsync d2/d5/d9/f37 0 2024-04-18T10:42:42.398 INFO:tasks.workunit.client.0.smithi040.stdout:1/220: stat d1/d16/d27/c51 0 2024-04-18T10:42:42.399 INFO:tasks.workunit.client.0.smithi040.stdout:8/223: truncate d2/d2c/f3b 416910 0 2024-04-18T10:42:42.400 INFO:tasks.workunit.client.0.smithi040.stdout:7/247: getdents d6/d3e 0 2024-04-18T10:42:42.402 INFO:tasks.workunit.client.0.smithi040.stdout:9/277: rename d2/dd/de/d1d to d2/dc/d46/d6b 0 2024-04-18T10:42:42.403 INFO:tasks.workunit.client.0.smithi040.stdout:1/221: creat d1/d1c/f56 x:0 0 0 2024-04-18T10:42:42.405 INFO:tasks.workunit.client.0.smithi040.stdout:1/222: chown d1/d16/d27/d2e/d39/l52 37452 1 2024-04-18T10:42:42.406 INFO:tasks.workunit.client.0.smithi040.stdout:7/248: dwrite d6/d25/f3a [0,4194304] 0 2024-04-18T10:42:42.407 INFO:tasks.workunit.client.0.smithi040.stdout:7/249: write d6/f22 [4936153,64827] 0 2024-04-18T10:42:42.408 INFO:tasks.workunit.client.0.smithi040.stdout:9/278: creat d2/dd/de/f6c x:0 0 0 2024-04-18T10:42:42.411 INFO:tasks.workunit.client.0.smithi040.stdout:8/224: unlink d2/d10/f32 0 2024-04-18T10:42:42.413 INFO:tasks.workunit.client.0.smithi040.stdout:7/250: dread d6/f22 [4194304,4194304] 0 2024-04-18T10:42:42.414 INFO:tasks.workunit.client.0.smithi040.stdout:1/223: symlink d1/d16/d27/d2e/l57 0 2024-04-18T10:42:42.415 INFO:tasks.workunit.client.0.smithi040.stdout:1/224: write d1/d16/f41 [746434,34073] 0 2024-04-18T10:42:42.415 INFO:tasks.workunit.client.0.smithi040.stdout:6/231: rmdir df 39 2024-04-18T10:42:42.417 INFO:tasks.workunit.client.0.smithi040.stdout:8/225: creat d2/f41 x:0 0 0 2024-04-18T10:42:42.418 INFO:tasks.workunit.client.0.smithi040.stdout:7/251: creat d6/d25/d28/d2c/d3c/f56 x:0 0 0 2024-04-18T10:42:42.418 INFO:tasks.workunit.client.0.smithi040.stdout:7/252: chown c4 73 1 2024-04-18T10:42:42.419 INFO:tasks.workunit.client.0.smithi040.stdout:7/253: chown d6/d25/d28/d2c/d2d/l35 121022383 1 2024-04-18T10:42:42.420 INFO:tasks.workunit.client.0.smithi040.stdout:7/254: chown d6/d25/f46 25 1 2024-04-18T10:42:42.420 INFO:tasks.workunit.client.0.smithi040.stdout:4/227: rmdir d2/d3 39 2024-04-18T10:42:42.423 INFO:tasks.workunit.client.0.smithi040.stdout:6/232: unlink df/d17/f49 0 2024-04-18T10:42:42.424 INFO:tasks.workunit.client.0.smithi040.stdout:3/235: truncate d1/f4f 653091 0 2024-04-18T10:42:42.425 INFO:tasks.workunit.client.0.smithi040.stdout:6/233: readlink df/d17/d19/d3f/l44 0 2024-04-18T10:42:42.426 INFO:tasks.workunit.client.0.smithi040.stdout:1/225: unlink d1/d16/f54 0 2024-04-18T10:42:42.427 INFO:tasks.workunit.client.0.smithi040.stdout:7/255: dwrite d6/d25/d28/f4e [0,4194304] 0 2024-04-18T10:42:42.428 INFO:tasks.workunit.client.0.smithi040.stdout:0/229: truncate dd/df/f15 7512383 0 2024-04-18T10:42:42.431 INFO:tasks.workunit.client.0.smithi040.stdout:4/228: symlink d2/d3/d4/d1f/l3a 0 2024-04-18T10:42:42.432 INFO:tasks.workunit.client.0.smithi040.stdout:6/234: rename df/d17/l1f to df/d17/l5d 0 2024-04-18T10:42:42.432 INFO:tasks.workunit.client.0.smithi040.stdout:6/235: chown df/d17/d19/f40 351168 1 2024-04-18T10:42:42.434 INFO:tasks.workunit.client.0.smithi040.stdout:7/256: creat d6/d25/d28/d2c/d2d/f57 x:0 0 0 2024-04-18T10:42:42.435 INFO:tasks.workunit.client.0.smithi040.stdout:5/203: write d0/f19 [620673,120366] 0 2024-04-18T10:42:42.438 INFO:tasks.workunit.client.0.smithi040.stdout:1/226: creat d1/d16/d27/d3f/f58 x:0 0 0 2024-04-18T10:42:42.439 INFO:tasks.workunit.client.0.smithi040.stdout:2/167: truncate dd/d14/f22 4045244 0 2024-04-18T10:42:42.440 INFO:tasks.workunit.client.0.smithi040.stdout:0/230: mknod dd/df/d19/d28/d3a/d46/c54 0 2024-04-18T10:42:42.440 INFO:tasks.workunit.client.0.smithi040.stdout:2/168: truncate dd/f1b 4344126 0 2024-04-18T10:42:42.443 INFO:tasks.workunit.client.0.smithi040.stdout:1/227: creat d1/d1c/d2b/d32/d36/f59 x:0 0 0 2024-04-18T10:42:42.464 INFO:tasks.workunit.client.0.smithi040.stdout:9/279: sync 2024-04-18T10:42:42.471 INFO:tasks.workunit.client.0.smithi040.stdout:7/257: mkdir d6/d25/d28/d2c/d2d/d47/d55/d58 0 2024-04-18T10:42:42.472 INFO:tasks.workunit.client.0.smithi040.stdout:1/228: fsync d1/f11 0 2024-04-18T10:42:42.472 INFO:tasks.workunit.client.0.smithi040.stdout:0/231: unlink dd/f10 0 2024-04-18T10:42:42.473 INFO:tasks.workunit.client.0.smithi040.stdout:3/236: link d1/d2/f17 d1/d7/d3a/f50 0 2024-04-18T10:42:42.474 INFO:tasks.workunit.client.0.smithi040.stdout:6/236: dwrite df/d17/f1b [4194304,4194304] 0 2024-04-18T10:42:42.476 INFO:tasks.workunit.client.0.smithi040.stdout:4/229: rename d2/d3/d4/d23/l2a to d2/d3/d4/d1f/l3b 0 2024-04-18T10:42:42.478 INFO:tasks.workunit.client.0.smithi040.stdout:6/237: write df/d17/d19/f33 [97490,123201] 0 2024-04-18T10:42:42.478 INFO:tasks.workunit.client.0.smithi040.stdout:7/258: dread d6/d25/d28/d2c/f33 [0,4194304] 0 2024-04-18T10:42:42.479 INFO:tasks.workunit.client.0.smithi040.stdout:4/230: write d2/d3/d4/f12 [5276289,21923] 0 2024-04-18T10:42:42.485 INFO:tasks.workunit.client.0.smithi040.stdout:8/226: dwrite d2/d15/d18/f27 [0,4194304] 0 2024-04-18T10:42:42.485 INFO:tasks.workunit.client.0.smithi040.stdout:7/259: dread d6/f14 [0,4194304] 0 2024-04-18T10:42:42.486 INFO:tasks.workunit.client.0.smithi040.stdout:4/231: dread d2/f9 [0,4194304] 0 2024-04-18T10:42:42.486 INFO:tasks.workunit.client.0.smithi040.stdout:8/227: chown d2/c8 2259 1 2024-04-18T10:42:42.487 INFO:tasks.workunit.client.0.smithi040.stdout:7/260: chown d6/d25/d28/d2c/d2d/f57 0 1 2024-04-18T10:42:42.490 INFO:tasks.workunit.client.0.smithi040.stdout:8/228: write d2/d15/d18/f27 [4029689,105095] 0 2024-04-18T10:42:42.490 INFO:tasks.workunit.client.0.smithi040.stdout:5/204: sync 2024-04-18T10:42:42.490 INFO:tasks.workunit.client.0.smithi040.stdout:5/205: chown d0/d3/f13 2608469 1 2024-04-18T10:42:42.726 INFO:tasks.workunit.client.0.smithi040.stdout:9/280: mknod d2/dc/d46/c6d 0 2024-04-18T10:42:42.728 INFO:tasks.workunit.client.0.smithi040.stdout:3/237: symlink d1/d7/d3a/l51 0 2024-04-18T10:42:42.729 INFO:tasks.workunit.client.0.smithi040.stdout:1/229: mknod d1/d16/d27/d2e/d3e/c5a 0 2024-04-18T10:42:42.733 INFO:tasks.workunit.client.0.smithi040.stdout:1/230: dread d1/d16/d27/d2e/d39/f4f [0,4194304] 0 2024-04-18T10:42:42.734 INFO:tasks.workunit.client.0.smithi040.stdout:6/238: creat df/d17/d19/d3f/d53/f5e x:0 0 0 2024-04-18T10:42:42.735 INFO:tasks.workunit.client.0.smithi040.stdout:6/239: write df/d4b/f51 [546584,52651] 0 2024-04-18T10:42:42.735 INFO:tasks.workunit.client.0.smithi040.stdout:6/240: stat l6 0 2024-04-18T10:42:42.736 INFO:tasks.workunit.client.0.smithi040.stdout:6/241: write df/d17/f31 [229772,97086] 0 2024-04-18T10:42:42.737 INFO:tasks.workunit.client.0.smithi040.stdout:6/242: write df/f13 [1118321,3336] 0 2024-04-18T10:42:42.738 INFO:tasks.workunit.client.0.smithi040.stdout:7/261: creat d6/d25/d28/d2c/d2d/d47/f59 x:0 0 0 2024-04-18T10:42:42.741 INFO:tasks.workunit.client.0.smithi040.stdout:9/281: unlink d2/d7/f2c 0 2024-04-18T10:42:42.742 INFO:tasks.workunit.client.0.smithi040.stdout:9/282: dread - d2/dc/d46/f69 zero size 2024-04-18T10:42:42.742 INFO:tasks.workunit.client.0.smithi040.stdout:3/238: creat d1/d7/d3a/f52 x:0 0 0 2024-04-18T10:42:42.743 INFO:tasks.workunit.client.0.smithi040.stdout:2/169: dread dd/d14/f22 [0,4194304] 0 2024-04-18T10:42:42.744 INFO:tasks.workunit.client.0.smithi040.stdout:9/283: fdatasync d2/d3/d22/d2e/d35/d40/f5e 0 2024-04-18T10:42:42.748 INFO:tasks.workunit.client.0.smithi040.stdout:7/262: dread d6/d25/d28/d2c/f4c [0,4194304] 0 2024-04-18T10:42:42.750 INFO:tasks.workunit.client.0.smithi040.stdout:7/263: read d6/d25/d28/d2c/f3d [1331246,76296] 0 2024-04-18T10:42:42.750 INFO:tasks.workunit.client.0.smithi040.stdout:3/239: stat d1/c10 0 2024-04-18T10:42:42.756 INFO:tasks.workunit.client.0.smithi040.stdout:4/232: rename d2/d3/d4/dd/d14/c24 to d2/c3c 0 2024-04-18T10:42:42.757 INFO:tasks.workunit.client.0.smithi040.stdout:4/233: read - d2/d3/f38 zero size 2024-04-18T10:42:42.758 INFO:tasks.workunit.client.0.smithi040.stdout:0/232: getdents dd/df/d19/d28/d3a/d42 0 2024-04-18T10:42:42.762 INFO:tasks.workunit.client.0.smithi040.stdout:8/229: rename d2/d2c/c36 to d2/d22/c42 0 2024-04-18T10:42:42.763 INFO:tasks.workunit.client.0.smithi040.stdout:4/234: dwrite d2/d3/f38 [0,4194304] 0 2024-04-18T10:42:42.764 INFO:tasks.workunit.client.0.smithi040.stdout:8/230: write d2/f2a [701616,102944] 0 2024-04-18T10:42:42.764 INFO:tasks.workunit.client.0.smithi040.stdout:2/170: rmdir dd/d2c 0 2024-04-18T10:42:42.765 INFO:tasks.workunit.client.0.smithi040.stdout:0/233: dread dd/df/f2b [0,4194304] 0 2024-04-18T10:42:42.766 INFO:tasks.workunit.client.0.smithi040.stdout:2/171: read - dd/d14/d2b/f2e zero size 2024-04-18T10:42:42.766 INFO:tasks.workunit.client.0.smithi040.stdout:8/231: write d2/d5/d9/f29 [4503396,8700] 0 2024-04-18T10:42:42.767 INFO:tasks.workunit.client.0.smithi040.stdout:9/284: creat d2/d3/f6e x:0 0 0 2024-04-18T10:42:42.767 INFO:tasks.workunit.client.0.smithi040.stdout:2/172: chown dd/d14/d2b 110 1 2024-04-18T10:42:42.770 INFO:tasks.workunit.client.0.smithi040.stdout:0/234: truncate dd/df/d19/d28/d3a/d42/f52 958504 0 2024-04-18T10:42:42.770 INFO:tasks.workunit.client.0.smithi040.stdout:9/285: mkdir d2/d5b/d6f 0 2024-04-18T10:42:42.772 INFO:tasks.workunit.client.0.smithi040.stdout:5/206: rename d0/f34 to d0/d21/f44 0 2024-04-18T10:42:42.773 INFO:tasks.workunit.client.0.smithi040.stdout:0/235: dread - dd/df/d19/d28/f53 zero size 2024-04-18T10:42:42.773 INFO:tasks.workunit.client.0.smithi040.stdout:1/231: sync 2024-04-18T10:42:42.774 INFO:tasks.workunit.client.0.smithi040.stdout:8/232: dwrite d2/f2a [0,4194304] 0 2024-04-18T10:42:42.774 INFO:tasks.workunit.client.0.smithi040.stdout:5/207: chown d0/d3b/d3f 1146 1 2024-04-18T10:42:42.774 INFO:tasks.workunit.client.0.smithi040.stdout:4/235: mknod d2/c3d 0 2024-04-18T10:42:42.775 INFO:tasks.workunit.client.0.smithi040.stdout:0/236: readlink dd/df/l4b 0 2024-04-18T10:42:42.775 INFO:tasks.workunit.client.0.smithi040.stdout:1/232: chown d1/d16/d27 0 1 2024-04-18T10:42:42.776 INFO:tasks.workunit.client.0.smithi040.stdout:8/233: chown d2/d15 771 1 2024-04-18T10:42:42.776 INFO:tasks.workunit.client.0.smithi040.stdout:2/173: dread dd/f28 [0,4194304] 0 2024-04-18T10:42:42.777 INFO:tasks.workunit.client.0.smithi040.stdout:9/286: mkdir d2/d3/d70 0 2024-04-18T10:42:42.778 INFO:tasks.workunit.client.0.smithi040.stdout:9/287: chown d2/dc 511 1 2024-04-18T10:42:42.779 INFO:tasks.workunit.client.0.smithi040.stdout:5/208: truncate d0/f23 5100140 0 2024-04-18T10:42:42.780 INFO:tasks.workunit.client.0.smithi040.stdout:4/236: stat d2/d3/d4/l30 0 2024-04-18T10:42:42.781 INFO:tasks.workunit.client.0.smithi040.stdout:4/237: write d2/d3/d4/f25 [376985,98790] 0 2024-04-18T10:42:42.782 INFO:tasks.workunit.client.0.smithi040.stdout:0/237: creat dd/df/d4e/f55 x:0 0 0 2024-04-18T10:42:42.782 INFO:tasks.workunit.client.0.smithi040.stdout:5/209: dread d0/f23 [4194304,4194304] 0 2024-04-18T10:42:42.783 INFO:tasks.workunit.client.0.smithi040.stdout:2/174: write dd/f28 [2647838,80721] 0 2024-04-18T10:42:42.785 INFO:tasks.workunit.client.0.smithi040.stdout:2/175: write dd/d14/d2b/f2e [242994,75498] 0 2024-04-18T10:42:42.788 INFO:tasks.workunit.client.0.smithi040.stdout:4/238: dwrite d2/d3/f38 [0,4194304] 0 2024-04-18T10:42:42.788 INFO:tasks.workunit.client.0.smithi040.stdout:6/243: rename df/d17/d19/d3f/c5a to df/d17/d19/c5f 0 2024-04-18T10:42:42.790 INFO:tasks.workunit.client.0.smithi040.stdout:4/239: dread - d2/d3/d4/d1f/d29/f33 zero size 2024-04-18T10:42:42.791 INFO:tasks.workunit.client.0.smithi040.stdout:0/238: rmdir dd/df/d19 39 2024-04-18T10:42:42.792 INFO:tasks.workunit.client.0.smithi040.stdout:4/240: write d2/d3/d2f/f35 [935059,50016] 0 2024-04-18T10:42:42.793 INFO:tasks.workunit.client.0.smithi040.stdout:4/241: write d2/d3/d4/f25 [482642,38692] 0 2024-04-18T10:42:42.793 INFO:tasks.workunit.client.0.smithi040.stdout:8/234: mknod d2/d5/d9/d3c/c43 0 2024-04-18T10:42:42.797 INFO:tasks.workunit.client.0.smithi040.stdout:8/235: dread d2/d15/d18/f1e [0,4194304] 0 2024-04-18T10:42:42.798 INFO:tasks.workunit.client.0.smithi040.stdout:2/176: mkdir dd/d14/d2f 0 2024-04-18T10:42:42.799 INFO:tasks.workunit.client.0.smithi040.stdout:8/236: write d2/d10/d14/f16 [5138956,115724] 0 2024-04-18T10:42:42.800 INFO:tasks.workunit.client.0.smithi040.stdout:9/288: dread d2/d3/f21 [0,4194304] 0 2024-04-18T10:42:42.800 INFO:tasks.workunit.client.0.smithi040.stdout:8/237: read d2/d5/d9/f37 [377524,40996] 0 2024-04-18T10:42:42.801 INFO:tasks.workunit.client.0.smithi040.stdout:3/240: rename d1/d2/d16/f1c to d1/d7/f53 0 2024-04-18T10:42:42.801 INFO:tasks.workunit.client.0.smithi040.stdout:8/238: chown d2/l3f 9 1 2024-04-18T10:42:42.801 INFO:tasks.workunit.client.0.smithi040.stdout:9/289: chown d2/dc/d46/c38 1889630 1 2024-04-18T10:42:42.802 INFO:tasks.workunit.client.0.smithi040.stdout:8/239: read d2/d5/d9/f29 [1850375,9704] 0 2024-04-18T10:42:42.806 INFO:tasks.workunit.client.0.smithi040.stdout:4/242: symlink d2/d3/d4/dd/d14/d19/l3e 0 2024-04-18T10:42:42.807 INFO:tasks.workunit.client.0.smithi040.stdout:0/239: dwrite dd/f49 [0,4194304] 0 2024-04-18T10:42:42.810 INFO:tasks.workunit.client.0.smithi040.stdout:9/290: unlink d2/d3/d22/d2e/d35/d40/f52 0 2024-04-18T10:42:42.811 INFO:tasks.workunit.client.0.smithi040.stdout:9/291: chown d2/d3/d22/d2e/f3d 23296742 1 2024-04-18T10:42:42.812 INFO:tasks.workunit.client.0.smithi040.stdout:8/240: unlink d2/l6 0 2024-04-18T10:42:42.815 INFO:tasks.workunit.client.0.smithi040.stdout:6/244: creat df/f60 x:0 0 0 2024-04-18T10:42:42.815 INFO:tasks.workunit.client.0.smithi040.stdout:6/245: dread - df/f4d zero size 2024-04-18T10:42:42.815 INFO:tasks.workunit.client.0.smithi040.stdout:2/177: symlink dd/d14/d2f/l30 0 2024-04-18T10:42:42.816 INFO:tasks.workunit.client.0.smithi040.stdout:3/241: symlink d1/d7/d28/l54 0 2024-04-18T10:42:42.821 INFO:tasks.workunit.client.0.smithi040.stdout:8/241: creat d2/d5/d9/f44 x:0 0 0 2024-04-18T10:42:42.821 INFO:tasks.workunit.client.0.smithi040.stdout:6/246: dwrite df/d17/d19/d3f/f5c [0,4194304] 0 2024-04-18T10:42:42.822 INFO:tasks.workunit.client.0.smithi040.stdout:2/178: symlink dd/d14/d2f/l31 0 2024-04-18T10:42:42.826 INFO:tasks.workunit.client.0.smithi040.stdout:0/240: mknod dd/df/d19/d28/d3a/d46/c56 0 2024-04-18T10:42:42.827 INFO:tasks.workunit.client.0.smithi040.stdout:6/247: dread df/d17/d19/f1e [0,4194304] 0 2024-04-18T10:42:42.829 INFO:tasks.workunit.client.0.smithi040.stdout:6/248: write df/d17/d19/f33 [1034553,119699] 0 2024-04-18T10:42:42.830 INFO:tasks.workunit.client.0.smithi040.stdout:3/242: creat d1/d2/d3c/f55 x:0 0 0 2024-04-18T10:42:42.833 INFO:tasks.workunit.client.0.smithi040.stdout:0/241: dwrite dd/df/f40 [0,4194304] 0 2024-04-18T10:42:42.834 INFO:tasks.workunit.client.0.smithi040.stdout:9/292: dread d2/dd/de/f61 [4194304,4194304] 0 2024-04-18T10:42:42.839 INFO:tasks.workunit.client.0.smithi040.stdout:0/242: dwrite dd/df/f13 [4194304,4194304] 0 2024-04-18T10:42:42.840 INFO:tasks.workunit.client.0.smithi040.stdout:2/179: link dd/l25 dd/d14/d2b/l32 0 2024-04-18T10:42:42.841 INFO:tasks.workunit.client.0.smithi040.stdout:3/243: symlink d1/d2/d4e/l56 0 2024-04-18T10:42:42.842 INFO:tasks.workunit.client.0.smithi040.stdout:8/242: link d2/d10/d14/l3a d2/l45 0 2024-04-18T10:42:42.844 INFO:tasks.workunit.client.0.smithi040.stdout:0/243: unlink dd/df/d19/f1a 0 2024-04-18T10:42:42.847 INFO:tasks.workunit.client.0.smithi040.stdout:2/180: fdatasync dd/d14/f22 0 2024-04-18T10:42:42.849 INFO:tasks.workunit.client.0.smithi040.stdout:8/243: symlink d2/d15/d18/l46 0 2024-04-18T10:42:42.851 INFO:tasks.workunit.client.0.smithi040.stdout:2/181: readlink dd/l2a 0 2024-04-18T10:42:42.852 INFO:tasks.workunit.client.0.smithi040.stdout:8/244: creat d2/d10/d14/f47 x:0 0 0 2024-04-18T10:42:42.854 INFO:tasks.workunit.client.0.smithi040.stdout:8/245: write d2/f41 [656150,69802] 0 2024-04-18T10:42:42.857 INFO:tasks.workunit.client.0.smithi040.stdout:2/182: dwrite dd/f1b [0,4194304] 0 2024-04-18T10:42:42.857 INFO:tasks.workunit.client.0.smithi040.stdout:8/246: symlink d2/d10/l48 0 2024-04-18T10:42:42.858 INFO:tasks.workunit.client.0.smithi040.stdout:7/264: truncate d6/d25/d28/d2c/f33 265772 0 2024-04-18T10:42:42.858 INFO:tasks.workunit.client.0.smithi040.stdout:8/247: write d2/f31 [4518750,64583] 0 2024-04-18T10:42:42.859 INFO:tasks.workunit.client.0.smithi040.stdout:2/183: write dd/d14/f16 [90711,63170] 0 2024-04-18T10:42:42.860 INFO:tasks.workunit.client.0.smithi040.stdout:8/248: fsync d2/d15/d18/f27 0 2024-04-18T10:42:42.868 INFO:tasks.workunit.client.0.smithi040.stdout:8/249: mkdir d2/d22/d49 0 2024-04-18T10:42:42.873 INFO:tasks.workunit.client.0.smithi040.stdout:2/184: read dd/f17 [1199917,70401] 0 2024-04-18T10:42:42.874 INFO:tasks.workunit.client.0.smithi040.stdout:2/185: creat dd/d14/d2f/f33 x:0 0 0 2024-04-18T10:42:42.876 INFO:tasks.workunit.client.0.smithi040.stdout:2/186: symlink dd/d14/l34 0 2024-04-18T10:42:42.877 INFO:tasks.workunit.client.0.smithi040.stdout:2/187: stat dd 0 2024-04-18T10:42:42.877 INFO:tasks.workunit.client.0.smithi040.stdout:1/233: truncate d1/d1c/f24 2390158 0 2024-04-18T10:42:42.879 INFO:tasks.workunit.client.0.smithi040.stdout:5/210: write d0/f1b [1601321,123953] 0 2024-04-18T10:42:42.881 INFO:tasks.workunit.client.0.smithi040.stdout:1/234: getdents d1/d16 0 2024-04-18T10:42:42.883 INFO:tasks.workunit.client.0.smithi040.stdout:4/243: rename d2/d3/d4/dd/d14/d19 to d2/d3/d4/d21/d28/d3f 0 2024-04-18T10:42:42.886 INFO:tasks.workunit.client.0.smithi040.stdout:6/249: rename df/f1a to df/d17/f61 0 2024-04-18T10:42:42.888 INFO:tasks.workunit.client.0.smithi040.stdout:6/250: stat df/d17/f31 0 2024-04-18T10:42:42.892 INFO:tasks.workunit.client.0.smithi040.stdout:7/265: rename d6/d25/d28/d38 to d6/d25/d28/d2c/d2d/d47/d55/d58/d5a 0 2024-04-18T10:42:42.892 INFO:tasks.workunit.client.0.smithi040.stdout:6/251: stat df/d17/d19/d3f/d53/f5e 0 2024-04-18T10:42:42.893 INFO:tasks.workunit.client.0.smithi040.stdout:1/235: dread d1/f18 [0,4194304] 0 2024-04-18T10:42:42.894 INFO:tasks.workunit.client.0.smithi040.stdout:4/244: dwrite d2/f2c [0,4194304] 0 2024-04-18T10:42:42.894 INFO:tasks.workunit.client.0.smithi040.stdout:5/211: dwrite d0/f2d [0,4194304] 0 2024-04-18T10:42:42.895 INFO:tasks.workunit.client.0.smithi040.stdout:7/266: dread - d6/d25/d28/f2f zero size 2024-04-18T10:42:42.895 INFO:tasks.workunit.client.0.smithi040.stdout:8/250: rename d2/d5/d9/l1a to d2/d15/d18/l4a 0 2024-04-18T10:42:42.898 INFO:tasks.workunit.client.0.smithi040.stdout:3/244: sync 2024-04-18T10:42:42.899 INFO:tasks.workunit.client.0.smithi040.stdout:7/267: readlink d6/l16 0 2024-04-18T10:42:42.900 INFO:tasks.workunit.client.0.smithi040.stdout:1/236: mknod d1/d16/d27/d3f/c5b 0 2024-04-18T10:42:42.900 INFO:tasks.workunit.client.0.smithi040.stdout:4/245: write d2/d3/f38 [3694634,64837] 0 2024-04-18T10:42:42.902 INFO:tasks.workunit.client.0.smithi040.stdout:2/188: rename dd/f1b to dd/d14/d2b/f35 0 2024-04-18T10:42:42.903 INFO:tasks.workunit.client.0.smithi040.stdout:3/245: write d1/d7/d12/f32 [1412185,91433] 0 2024-04-18T10:42:42.904 INFO:tasks.workunit.client.0.smithi040.stdout:8/251: mknod d2/d15/d18/c4b 0 2024-04-18T10:42:42.904 INFO:tasks.workunit.client.0.smithi040.stdout:6/252: dwrite df/f4d [0,4194304] 0 2024-04-18T10:42:42.906 INFO:tasks.workunit.client.0.smithi040.stdout:6/253: stat f4 0 2024-04-18T10:42:42.911 INFO:tasks.workunit.client.0.smithi040.stdout:7/268: rename d6/c9 to d6/d3e/c5b 0 2024-04-18T10:42:42.913 INFO:tasks.workunit.client.0.smithi040.stdout:4/246: dwrite d2/d3/f36 [0,4194304] 0 2024-04-18T10:42:42.914 INFO:tasks.workunit.client.0.smithi040.stdout:8/252: mkdir d2/d4c 0 2024-04-18T10:42:42.915 INFO:tasks.workunit.client.0.smithi040.stdout:3/246: mkdir d1/d2/d4e/d57 0 2024-04-18T10:42:42.915 INFO:tasks.workunit.client.0.smithi040.stdout:2/189: dwrite f9 [0,4194304] 0 2024-04-18T10:42:42.916 INFO:tasks.workunit.client.0.smithi040.stdout:6/254: mkdir df/d4b/d62 0 2024-04-18T10:42:42.916 INFO:tasks.workunit.client.0.smithi040.stdout:0/244: write dd/df/d19/d28/f33 [7101781,6036] 0 2024-04-18T10:42:42.917 INFO:tasks.workunit.client.0.smithi040.stdout:6/255: readlink l6 0 2024-04-18T10:42:42.918 INFO:tasks.workunit.client.0.smithi040.stdout:9/293: dwrite d2/d5b/f48 [0,4194304] 0 2024-04-18T10:42:42.920 INFO:tasks.workunit.client.0.smithi040.stdout:6/256: write df/f13 [481880,15048] 0 2024-04-18T10:42:42.930 INFO:tasks.workunit.client.0.smithi040.stdout:0/245: rmdir dd/df/d19/d28 39 2024-04-18T10:42:42.930 INFO:tasks.workunit.client.0.smithi040.stdout:0/246: chown dd/df/f1e 6750524 1 2024-04-18T10:42:42.935 INFO:tasks.workunit.client.0.smithi040.stdout:8/253: symlink d2/d5/l4d 0 2024-04-18T10:42:42.936 INFO:tasks.workunit.client.0.smithi040.stdout:9/294: fdatasync d2/dd/f54 0 2024-04-18T10:42:42.937 INFO:tasks.workunit.client.0.smithi040.stdout:9/295: write d2/f5 [4587604,86044] 0 2024-04-18T10:42:42.937 INFO:tasks.workunit.client.0.smithi040.stdout:6/257: mkdir df/d4b/d63 0 2024-04-18T10:42:42.938 INFO:tasks.workunit.client.0.smithi040.stdout:6/258: fsync df/d17/f3d 0 2024-04-18T10:42:42.939 INFO:tasks.workunit.client.0.smithi040.stdout:0/247: mknod dd/df/d4e/c57 0 2024-04-18T10:42:42.941 INFO:tasks.workunit.client.0.smithi040.stdout:8/254: readlink d2/d5/d9/d1b/l2e 0 2024-04-18T10:42:42.943 INFO:tasks.workunit.client.0.smithi040.stdout:2/190: creat dd/f36 x:0 0 0 2024-04-18T10:42:42.945 INFO:tasks.workunit.client.0.smithi040.stdout:4/247: link d2/d3/d4/dd/c1e d2/d3/d4/d21/d28/c40 0 2024-04-18T10:42:42.947 INFO:tasks.workunit.client.0.smithi040.stdout:9/296: dread - d2/d3/d22/d2e/f63 zero size 2024-04-18T10:42:42.947 INFO:tasks.workunit.client.0.smithi040.stdout:2/191: mkdir dd/d14/d2f/d37 0 2024-04-18T10:42:42.948 INFO:tasks.workunit.client.0.smithi040.stdout:0/248: creat dd/df/d19/d28/d3a/d42/f58 x:0 0 0 2024-04-18T10:42:42.948 INFO:tasks.workunit.client.0.smithi040.stdout:8/255: dwrite d2/f17 [0,4194304] 0 2024-04-18T10:42:42.949 INFO:tasks.workunit.client.0.smithi040.stdout:4/248: mkdir d2/d3/d41 0 2024-04-18T10:42:42.949 INFO:tasks.workunit.client.0.smithi040.stdout:9/297: read - d2/dc/f60 zero size 2024-04-18T10:42:42.952 INFO:tasks.workunit.client.0.smithi040.stdout:6/259: getdents df 0 2024-04-18T10:42:42.952 INFO:tasks.workunit.client.0.smithi040.stdout:8/256: write d2/d15/d18/f27 [1062178,56469] 0 2024-04-18T10:42:42.953 INFO:tasks.workunit.client.0.smithi040.stdout:4/249: unlink d2/d3/f36 0 2024-04-18T10:42:42.953 INFO:tasks.workunit.client.0.smithi040.stdout:6/260: fsync df/d17/f47 0 2024-04-18T10:42:42.954 INFO:tasks.workunit.client.0.smithi040.stdout:0/249: creat dd/df/d19/d28/d3a/d42/f59 x:0 0 0 2024-04-18T10:42:42.956 INFO:tasks.workunit.client.0.smithi040.stdout:9/298: mkdir d2/d3/d22/d2e/d35/d40/d71 0 2024-04-18T10:42:42.958 INFO:tasks.workunit.client.0.smithi040.stdout:2/192: truncate dd/d14/f22 3906934 0 2024-04-18T10:42:42.960 INFO:tasks.workunit.client.0.smithi040.stdout:0/250: mknod dd/df/d19/d28/c5a 0 2024-04-18T10:42:42.962 INFO:tasks.workunit.client.0.smithi040.stdout:8/257: dwrite d2/d22/f38 [0,4194304] 0 2024-04-18T10:42:42.963 INFO:tasks.workunit.client.0.smithi040.stdout:4/250: creat d2/d3/d4/dd/d14/f42 x:0 0 0 2024-04-18T10:42:42.963 INFO:tasks.workunit.client.0.smithi040.stdout:0/251: stat dd/df/d19/d28/l32 0 2024-04-18T10:42:42.964 INFO:tasks.workunit.client.0.smithi040.stdout:8/258: read d2/f31 [301235,115290] 0 2024-04-18T10:42:42.964 INFO:tasks.workunit.client.0.smithi040.stdout:6/261: rename df/d17/d19/d3f/l4a to df/d17/d19/l64 0 2024-04-18T10:42:42.966 INFO:tasks.workunit.client.0.smithi040.stdout:2/193: mkdir dd/d14/d2f/d37/d38 0 2024-04-18T10:42:42.967 INFO:tasks.workunit.client.0.smithi040.stdout:6/262: fdatasync df/d17/f47 0 2024-04-18T10:42:42.967 INFO:tasks.workunit.client.0.smithi040.stdout:0/252: fsync dd/df/d19/f22 0 2024-04-18T10:42:42.970 INFO:tasks.workunit.client.0.smithi040.stdout:6/263: readlink df/d17/l48 0 2024-04-18T10:42:42.970 INFO:tasks.workunit.client.0.smithi040.stdout:9/299: dwrite d2/d3/d22/d2e/d35/f4c [0,4194304] 0 2024-04-18T10:42:42.972 INFO:tasks.workunit.client.0.smithi040.stdout:5/212: dread d0/f23 [0,4194304] 0 2024-04-18T10:42:42.973 INFO:tasks.workunit.client.0.smithi040.stdout:4/251: unlink d2/d3/d4/dd/l1d 0 2024-04-18T10:42:42.973 INFO:tasks.workunit.client.0.smithi040.stdout:7/269: sync 2024-04-18T10:42:42.977 INFO:tasks.workunit.client.0.smithi040.stdout:0/253: mkdir dd/df/d19/d28/d3a/d5b 0 2024-04-18T10:42:42.978 INFO:tasks.workunit.client.0.smithi040.stdout:0/254: chown dd/df/d19/d28/d3a 1710622 1 2024-04-18T10:42:42.979 INFO:tasks.workunit.client.0.smithi040.stdout:6/264: creat df/d4b/f65 x:0 0 0 2024-04-18T10:42:42.980 INFO:tasks.workunit.client.0.smithi040.stdout:6/265: write df/f60 [548116,61536] 0 2024-04-18T10:42:42.981 INFO:tasks.workunit.client.0.smithi040.stdout:2/194: rename dd/d14/c1d to dd/d14/d2f/d37/d38/c39 0 2024-04-18T10:42:42.984 INFO:tasks.workunit.client.0.smithi040.stdout:5/213: creat d0/d3b/d3f/f45 x:0 0 0 2024-04-18T10:42:42.985 INFO:tasks.workunit.client.0.smithi040.stdout:7/270: mkdir d6/d25/d28/d2c/d2d/d47/d5c 0 2024-04-18T10:42:42.987 INFO:tasks.workunit.client.0.smithi040.stdout:0/255: creat dd/df/d4e/f5c x:0 0 0 2024-04-18T10:42:42.990 INFO:tasks.workunit.client.0.smithi040.stdout:9/300: mknod d2/d5b/d6f/c72 0 2024-04-18T10:42:42.991 INFO:tasks.workunit.client.0.smithi040.stdout:5/214: rmdir d0/d3b 39 2024-04-18T10:42:42.991 INFO:tasks.workunit.client.0.smithi040.stdout:1/237: dread d1/d1c/f24 [0,4194304] 0 2024-04-18T10:42:42.991 INFO:tasks.workunit.client.0.smithi040.stdout:3/247: truncate d1/d7/f15 4874516 0 2024-04-18T10:42:42.993 INFO:tasks.workunit.client.0.smithi040.stdout:7/271: creat d6/d50/f5d x:0 0 0 2024-04-18T10:42:42.994 INFO:tasks.workunit.client.0.smithi040.stdout:0/256: creat dd/df/d19/d28/d3a/d46/f5d x:0 0 0 2024-04-18T10:42:42.995 INFO:tasks.workunit.client.0.smithi040.stdout:2/195: dread dd/d14/d2b/f35 [0,4194304] 0 2024-04-18T10:42:42.997 INFO:tasks.workunit.client.0.smithi040.stdout:2/196: chown dd/f17 286232 1 2024-04-18T10:42:42.998 INFO:tasks.workunit.client.0.smithi040.stdout:7/272: readlink d6/d25/l23 0 2024-04-18T10:42:42.999 INFO:tasks.workunit.client.0.smithi040.stdout:5/215: symlink d0/d3b/l46 0 2024-04-18T10:42:43.000 INFO:tasks.workunit.client.0.smithi040.stdout:1/238: dwrite d1/d16/f41 [0,4194304] 0 2024-04-18T10:42:43.002 INFO:tasks.workunit.client.0.smithi040.stdout:4/252: dread d2/d3/d4/d21/d28/d3f/f39 [0,4194304] 0 2024-04-18T10:42:43.003 INFO:tasks.workunit.client.0.smithi040.stdout:9/301: link d2/d3/d22/d2e/f3d d2/dc/f73 0 2024-04-18T10:42:43.004 INFO:tasks.workunit.client.0.smithi040.stdout:0/257: dread dd/f49 [0,4194304] 0 2024-04-18T10:42:43.005 INFO:tasks.workunit.client.0.smithi040.stdout:2/197: rmdir dd/d14/d2f/d37 39 2024-04-18T10:42:43.010 INFO:tasks.workunit.client.0.smithi040.stdout:5/216: dwrite d0/f35 [0,4194304] 0 2024-04-18T10:42:43.010 INFO:tasks.workunit.client.0.smithi040.stdout:7/273: symlink d6/d25/d28/l5e 0 2024-04-18T10:42:43.013 INFO:tasks.workunit.client.0.smithi040.stdout:3/248: getdents d1/d7 0 2024-04-18T10:42:43.015 INFO:tasks.workunit.client.0.smithi040.stdout:2/198: unlink dd/d14/d2f/f33 0 2024-04-18T10:42:43.015 INFO:tasks.workunit.client.0.smithi040.stdout:4/253: dwrite d2/d3/d4/d21/d28/d3f/f39 [0,4194304] 0 2024-04-18T10:42:43.017 INFO:tasks.workunit.client.0.smithi040.stdout:1/239: link d1/d16/f41 d1/d16/d27/d2d/f5c 0 2024-04-18T10:42:43.019 INFO:tasks.workunit.client.0.smithi040.stdout:9/302: creat d2/d3/d70/f74 x:0 0 0 2024-04-18T10:42:43.020 INFO:tasks.workunit.client.0.smithi040.stdout:9/303: readlink d2/d7/l18 0 2024-04-18T10:42:43.021 INFO:tasks.workunit.client.0.smithi040.stdout:9/304: stat d2/dd/de/f6c 0 2024-04-18T10:42:43.021 INFO:tasks.workunit.client.0.smithi040.stdout:7/274: fdatasync d6/f22 0 2024-04-18T10:42:43.022 INFO:tasks.workunit.client.0.smithi040.stdout:5/217: mkdir d0/d3/d47 0 2024-04-18T10:42:43.023 INFO:tasks.workunit.client.0.smithi040.stdout:8/259: dwrite d2/d15/d18/f1e [4194304,4194304] 0 2024-04-18T10:42:43.024 INFO:tasks.workunit.client.0.smithi040.stdout:5/218: chown d0/d21/l30 217621 1 2024-04-18T10:42:43.025 INFO:tasks.workunit.client.0.smithi040.stdout:3/249: mkdir d1/d2/d4e/d58 0 2024-04-18T10:42:43.025 INFO:tasks.workunit.client.0.smithi040.stdout:6/266: write df/d17/f22 [416483,65037] 0 2024-04-18T10:42:43.027 INFO:tasks.workunit.client.0.smithi040.stdout:5/219: dread - d0/d3b/d3f/f45 zero size 2024-04-18T10:42:43.029 INFO:tasks.workunit.client.0.smithi040.stdout:1/240: creat d1/d1c/d2b/d32/d35/f5d x:0 0 0 2024-04-18T10:42:43.031 INFO:tasks.workunit.client.0.smithi040.stdout:7/275: dwrite d6/d25/d28/f4b [0,4194304] 0 2024-04-18T10:42:43.032 INFO:tasks.workunit.client.0.smithi040.stdout:7/276: readlink d6/l3b 0 2024-04-18T10:42:43.036 INFO:tasks.workunit.client.0.smithi040.stdout:8/260: fsync d2/d15/f25 0 2024-04-18T10:42:43.037 INFO:tasks.workunit.client.0.smithi040.stdout:9/305: truncate d2/d7/f14 1727619 0 2024-04-18T10:42:43.040 INFO:tasks.workunit.client.0.smithi040.stdout:3/250: symlink d1/d7/d26/l59 0 2024-04-18T10:42:43.047 INFO:tasks.workunit.client.0.smithi040.stdout:8/261: symlink d2/d5/d9/d3c/l4e 0 2024-04-18T10:42:43.048 INFO:tasks.workunit.client.0.smithi040.stdout:2/199: creat dd/d14/d2f/f3a x:0 0 0 2024-04-18T10:42:43.048 INFO:tasks.workunit.client.0.smithi040.stdout:8/262: write d2/d15/d18/f1e [1382434,17527] 0 2024-04-18T10:42:43.050 INFO:tasks.workunit.client.0.smithi040.stdout:8/263: write d2/d10/d14/f16 [6237148,99533] 0 2024-04-18T10:42:43.051 INFO:tasks.workunit.client.0.smithi040.stdout:8/264: write d2/f41 [715414,18954] 0 2024-04-18T10:42:43.053 INFO:tasks.workunit.client.0.smithi040.stdout:4/254: write d2/f9 [1150069,13035] 0 2024-04-18T10:42:43.054 INFO:tasks.workunit.client.0.smithi040.stdout:3/251: fsync d1/f4f 0 2024-04-18T10:42:43.058 INFO:tasks.workunit.client.0.smithi040.stdout:5/220: rename d0/d3/f17 to d0/f48 0 2024-04-18T10:42:43.059 INFO:tasks.workunit.client.0.smithi040.stdout:1/241: creat d1/d1c/d2b/f5e x:0 0 0 2024-04-18T10:42:43.060 INFO:tasks.workunit.client.0.smithi040.stdout:6/267: dread df/d17/d19/f28 [0,4194304] 0 2024-04-18T10:42:43.060 INFO:tasks.workunit.client.0.smithi040.stdout:0/258: truncate dd/df/d19/f45 3252694 0 2024-04-18T10:42:43.064 INFO:tasks.workunit.client.0.smithi040.stdout:9/306: dread d2/f55 [0,4194304] 0 2024-04-18T10:42:43.064 INFO:tasks.workunit.client.0.smithi040.stdout:9/307: readlink d2/d5b/l57 0 2024-04-18T10:42:43.066 INFO:tasks.workunit.client.0.smithi040.stdout:1/242: readlink d1/l7 0 2024-04-18T10:42:43.070 INFO:tasks.workunit.client.0.smithi040.stdout:4/255: mknod d2/d3/d4/dd/d14/c43 0 2024-04-18T10:42:43.071 INFO:tasks.workunit.client.0.smithi040.stdout:0/259: rename dd/df/d19/d28/d3a/l4f to dd/df/d4e/l5e 0 2024-04-18T10:42:43.072 INFO:tasks.workunit.client.0.smithi040.stdout:7/277: dwrite d6/f44 [0,4194304] 0 2024-04-18T10:42:43.072 INFO:tasks.workunit.client.0.smithi040.stdout:3/252: symlink d1/l5a 0 2024-04-18T10:42:43.073 INFO:tasks.workunit.client.0.smithi040.stdout:9/308: mkdir d2/dc/d46/d6b/d75 0 2024-04-18T10:42:43.074 INFO:tasks.workunit.client.0.smithi040.stdout:0/260: write dd/df/d19/d28/d3a/d46/f5d [809407,118679] 0 2024-04-18T10:42:43.077 INFO:tasks.workunit.client.0.smithi040.stdout:1/243: mknod d1/d16/d27/d2e/d3e/c5f 0 2024-04-18T10:42:43.077 INFO:tasks.workunit.client.0.smithi040.stdout:0/261: write dd/df/d4e/f50 [1041859,15726] 0 2024-04-18T10:42:43.080 INFO:tasks.workunit.client.0.smithi040.stdout:2/200: dwrite dd/d14/d2b/f35 [4194304,4194304] 0 2024-04-18T10:42:43.080 INFO:tasks.workunit.client.0.smithi040.stdout:0/262: truncate dd/df/d19/d28/d3a/f4d 415845 0 2024-04-18T10:42:43.081 INFO:tasks.workunit.client.0.smithi040.stdout:2/201: dread - dd/d14/d2f/f3a zero size 2024-04-18T10:42:43.082 INFO:tasks.workunit.client.0.smithi040.stdout:4/256: creat d2/d3/d4/dd/f44 x:0 0 0 2024-04-18T10:42:43.086 INFO:tasks.workunit.client.0.smithi040.stdout:9/309: creat d2/d3/d22/d2e/f76 x:0 0 0 2024-04-18T10:42:43.088 INFO:tasks.workunit.client.0.smithi040.stdout:6/268: rmdir df/d4b/d62 0 2024-04-18T10:42:43.088 INFO:tasks.workunit.client.0.smithi040.stdout:6/269: chown df/d17/d19/d3f/d53 584199 1 2024-04-18T10:42:43.089 INFO:tasks.workunit.client.0.smithi040.stdout:1/244: mknod d1/d1c/d2b/d32/d35/c60 0 2024-04-18T10:42:43.090 INFO:tasks.workunit.client.0.smithi040.stdout:0/263: mknod dd/df/d19/d28/d3a/c5f 0 2024-04-18T10:42:43.091 INFO:tasks.workunit.client.0.smithi040.stdout:8/265: truncate d2/f17 7559416 0 2024-04-18T10:42:43.092 INFO:tasks.workunit.client.0.smithi040.stdout:6/270: dread df/d4b/f51 [0,4194304] 0 2024-04-18T10:42:43.093 INFO:tasks.workunit.client.0.smithi040.stdout:2/202: mknod dd/d14/d2b/c3b 0 2024-04-18T10:42:43.093 INFO:tasks.workunit.client.0.smithi040.stdout:8/266: write d2/d10/f12 [2141329,22598] 0 2024-04-18T10:42:43.093 INFO:tasks.workunit.client.0.smithi040.stdout:8/267: chown d2/d5/l7 3406 1 2024-04-18T10:42:43.096 INFO:tasks.workunit.client.0.smithi040.stdout:7/278: unlink d6/d25/d28/l40 0 2024-04-18T10:42:43.097 INFO:tasks.workunit.client.0.smithi040.stdout:5/221: truncate d0/f23 4440787 0 2024-04-18T10:42:43.102 INFO:tasks.workunit.client.0.smithi040.stdout:8/268: dwrite d2/d10/d14/f47 [0,4194304] 0 2024-04-18T10:42:43.103 INFO:tasks.workunit.client.0.smithi040.stdout:1/245: symlink d1/d16/d27/d3f/l61 0 2024-04-18T10:42:43.103 INFO:tasks.workunit.client.0.smithi040.stdout:8/269: truncate d2/d2c/f3b 467571 0 2024-04-18T10:42:43.103 INFO:tasks.workunit.client.0.smithi040.stdout:0/264: creat dd/df/d19/d28/d3a/f60 x:0 0 0 2024-04-18T10:42:43.103 INFO:tasks.workunit.client.0.smithi040.stdout:6/271: mknod df/d17/c66 0 2024-04-18T10:42:43.104 INFO:tasks.workunit.client.0.smithi040.stdout:6/272: chown ce 228 1 2024-04-18T10:42:43.104 INFO:tasks.workunit.client.0.smithi040.stdout:0/265: fsync dd/df/f15 0 2024-04-18T10:42:43.105 INFO:tasks.workunit.client.0.smithi040.stdout:0/266: dread - dd/df/f44 zero size 2024-04-18T10:42:43.105 INFO:tasks.workunit.client.0.smithi040.stdout:3/253: mknod d1/d2/c5b 0 2024-04-18T10:42:43.107 INFO:tasks.workunit.client.0.smithi040.stdout:0/267: chown dd/df/d19/d28/d3a/d46/c56 0 1 2024-04-18T10:42:43.108 INFO:tasks.workunit.client.0.smithi040.stdout:7/279: write d6/d25/d28/d2c/f4c [4840713,68476] 0 2024-04-18T10:42:43.111 INFO:tasks.workunit.client.0.smithi040.stdout:0/268: write dd/df/d19/d28/d3a/f60 [614364,46682] 0 2024-04-18T10:42:43.111 INFO:tasks.workunit.client.0.smithi040.stdout:7/280: truncate d6/d25/f53 543060 0 2024-04-18T10:42:43.113 INFO:tasks.workunit.client.0.smithi040.stdout:4/257: creat d2/d3/d4/dd/d14/f45 x:0 0 0 2024-04-18T10:42:43.113 INFO:tasks.workunit.client.0.smithi040.stdout:3/254: symlink d1/d2/d4e/l5c 0 2024-04-18T10:42:43.113 INFO:tasks.workunit.client.0.smithi040.stdout:6/273: dwrite df/f60 [0,4194304] 0 2024-04-18T10:42:43.114 INFO:tasks.workunit.client.0.smithi040.stdout:1/246: creat d1/d1c/d2b/d32/d36/d4d/f62 x:0 0 0 2024-04-18T10:42:43.120 INFO:tasks.workunit.client.0.smithi040.stdout:5/222: dwrite d0/d21/f44 [0,4194304] 0 2024-04-18T10:42:43.121 INFO:tasks.workunit.client.0.smithi040.stdout:1/247: dread d1/d16/f29 [0,4194304] 0 2024-04-18T10:42:43.125 INFO:tasks.workunit.client.0.smithi040.stdout:6/274: dwrite df/d17/f46 [0,4194304] 0 2024-04-18T10:42:43.126 INFO:tasks.workunit.client.0.smithi040.stdout:4/258: dwrite d2/d3/d4/dd/d14/f42 [0,4194304] 0 2024-04-18T10:42:43.127 INFO:tasks.workunit.client.0.smithi040.stdout:6/275: chown df/l2b 304079788 1 2024-04-18T10:42:43.127 INFO:tasks.workunit.client.0.smithi040.stdout:8/270: getdents d2/d15/d2b 0 2024-04-18T10:42:43.128 INFO:tasks.workunit.client.0.smithi040.stdout:3/255: unlink d1/d7/d12/c1e 0 2024-04-18T10:42:43.129 INFO:tasks.workunit.client.0.smithi040.stdout:2/203: link l7 dd/d14/d2f/l3c 0 2024-04-18T10:42:43.129 INFO:tasks.workunit.client.0.smithi040.stdout:7/281: creat d6/d25/d28/d2c/d2d/d47/d5c/f5f x:0 0 0 2024-04-18T10:42:43.130 INFO:tasks.workunit.client.0.smithi040.stdout:5/223: mknod d0/d1c/c49 0 2024-04-18T10:42:43.131 INFO:tasks.workunit.client.0.smithi040.stdout:7/282: write d6/d25/d28/d2c/d3c/f56 [705435,54541] 0 2024-04-18T10:42:43.132 INFO:tasks.workunit.client.0.smithi040.stdout:9/310: truncate d2/d3/f12 4875175 0 2024-04-18T10:42:43.134 INFO:tasks.workunit.client.0.smithi040.stdout:1/248: unlink d1/d16/d27/d2e/d39/l52 0 2024-04-18T10:42:43.136 INFO:tasks.workunit.client.0.smithi040.stdout:6/276: creat df/f67 x:0 0 0 2024-04-18T10:42:43.138 INFO:tasks.workunit.client.0.smithi040.stdout:4/259: creat d2/d3/d2f/f46 x:0 0 0 2024-04-18T10:42:43.140 INFO:tasks.workunit.client.0.smithi040.stdout:8/271: creat d2/d5/d9/d1b/f4f x:0 0 0 2024-04-18T10:42:43.141 INFO:tasks.workunit.client.0.smithi040.stdout:2/204: fsync dd/f17 0 2024-04-18T10:42:43.142 INFO:tasks.workunit.client.0.smithi040.stdout:2/205: write dd/f28 [5239375,113630] 0 2024-04-18T10:42:43.143 INFO:tasks.workunit.client.0.smithi040.stdout:5/224: rename d0/d1c/f1d to d0/d3/d47/f4a 0 2024-04-18T10:42:43.144 INFO:tasks.workunit.client.0.smithi040.stdout:9/311: mknod d2/dc/d46/c77 0 2024-04-18T10:42:43.145 INFO:tasks.workunit.client.0.smithi040.stdout:1/249: truncate d1/d16/d27/d2e/f3c 1708330 0 2024-04-18T10:42:43.147 INFO:tasks.workunit.client.0.smithi040.stdout:8/272: dwrite d2/d10/f12 [0,4194304] 0 2024-04-18T10:42:43.149 INFO:tasks.workunit.client.0.smithi040.stdout:5/225: dread d0/d21/f44 [0,4194304] 0 2024-04-18T10:42:43.150 INFO:tasks.workunit.client.0.smithi040.stdout:8/273: write d2/d5/d9/f37 [638318,123275] 0 2024-04-18T10:42:43.152 INFO:tasks.workunit.client.0.smithi040.stdout:8/274: write d2/f41 [1459735,26380] 0 2024-04-18T10:42:43.153 INFO:tasks.workunit.client.0.smithi040.stdout:8/275: fsync d2/d2c/f3b 0 2024-04-18T10:42:43.154 INFO:tasks.workunit.client.0.smithi040.stdout:8/276: stat d2/d15/d2b 0 2024-04-18T10:42:43.154 INFO:tasks.workunit.client.0.smithi040.stdout:4/260: mkdir d2/d3/d41/d47 0 2024-04-18T10:42:43.155 INFO:tasks.workunit.client.0.smithi040.stdout:3/256: dwrite d1/d2/d16/f25 [0,4194304] 0 2024-04-18T10:42:43.156 INFO:tasks.workunit.client.0.smithi040.stdout:4/261: write d2/f2c [3597903,94083] 0 2024-04-18T10:42:43.157 INFO:tasks.workunit.client.0.smithi040.stdout:1/250: creat d1/d16/d27/d2d/f63 x:0 0 0 2024-04-18T10:42:43.158 INFO:tasks.workunit.client.0.smithi040.stdout:4/262: write d2/d3/d4/dd/d14/f32 [1058169,67414] 0 2024-04-18T10:42:43.159 INFO:tasks.workunit.client.0.smithi040.stdout:4/263: write d2/d3/d4/dd/d14/f32 [462135,93697] 0 2024-04-18T10:42:43.160 INFO:tasks.workunit.client.0.smithi040.stdout:5/226: fsync d0/d3/f1a 0 2024-04-18T10:42:43.163 INFO:tasks.workunit.client.0.smithi040.stdout:9/312: creat d2/d3/d22/d2e/d35/d40/d71/f78 x:0 0 0 2024-04-18T10:42:43.164 INFO:tasks.workunit.client.0.smithi040.stdout:8/277: creat d2/d5/d9/d3c/f50 x:0 0 0 2024-04-18T10:42:43.166 INFO:tasks.workunit.client.0.smithi040.stdout:1/251: creat d1/d1c/d2b/d32/f64 x:0 0 0 2024-04-18T10:42:43.166 INFO:tasks.workunit.client.0.smithi040.stdout:9/313: dread d2/dd/de/f58 [0,4194304] 0 2024-04-18T10:42:43.168 INFO:tasks.workunit.client.0.smithi040.stdout:4/264: unlink d2/d3/d4/l30 0 2024-04-18T10:42:43.169 INFO:tasks.workunit.client.0.smithi040.stdout:5/227: rename d0/d21/c2a to d0/d3b/d3f/c4b 0 2024-04-18T10:42:43.170 INFO:tasks.workunit.client.0.smithi040.stdout:3/257: creat d1/d2/d4e/d58/f5d x:0 0 0 2024-04-18T10:42:43.171 INFO:tasks.workunit.client.0.smithi040.stdout:1/252: chown d1/cc 177527 1 2024-04-18T10:42:43.173 INFO:tasks.workunit.client.0.smithi040.stdout:9/314: unlink d2/dc/d46/c50 0 2024-04-18T10:42:43.173 INFO:tasks.workunit.client.0.smithi040.stdout:4/265: creat d2/d3/d4/dd/f48 x:0 0 0 2024-04-18T10:42:43.175 INFO:tasks.workunit.client.0.smithi040.stdout:5/228: creat d0/d1e/f4c x:0 0 0 2024-04-18T10:42:43.177 INFO:tasks.workunit.client.0.smithi040.stdout:9/315: unlink d2/d7/f2a 0 2024-04-18T10:42:43.177 INFO:tasks.workunit.client.0.smithi040.stdout:3/258: read d1/d7/d3a/f50 [523716,65911] 0 2024-04-18T10:42:43.178 INFO:tasks.workunit.client.0.smithi040.stdout:9/316: dread - d2/dc/f60 zero size 2024-04-18T10:42:43.180 INFO:tasks.workunit.client.0.smithi040.stdout:4/266: dwrite d2/d3/d4/dd/f22 [0,4194304] 0 2024-04-18T10:42:43.181 INFO:tasks.workunit.client.0.smithi040.stdout:4/267: chown d2/d3/d4/dd/d14/d31 354944 1 2024-04-18T10:42:43.181 INFO:tasks.workunit.client.0.smithi040.stdout:5/229: symlink d0/d3/l4d 0 2024-04-18T10:42:43.184 INFO:tasks.workunit.client.0.smithi040.stdout:6/277: fdatasync df/f55 0 2024-04-18T10:42:43.187 INFO:tasks.workunit.client.0.smithi040.stdout:3/259: symlink d1/l5e 0 2024-04-18T10:42:43.192 INFO:tasks.workunit.client.0.smithi040.stdout:4/268: rename d2/d3/d4/dd/d14 to d2/d3/d4/d1f/d29/d49 0 2024-04-18T10:42:43.192 INFO:tasks.workunit.client.0.smithi040.stdout:1/253: getdents d1/d16/d27/d3f 0 2024-04-18T10:42:43.196 INFO:tasks.workunit.client.0.smithi040.stdout:1/254: mknod d1/d16/d27/d2e/d39/c65 0 2024-04-18T10:42:43.197 INFO:tasks.workunit.client.0.smithi040.stdout:3/260: symlink d1/d2/d16/d18/l5f 0 2024-04-18T10:42:43.197 INFO:tasks.workunit.client.0.smithi040.stdout:0/269: sync 2024-04-18T10:42:43.198 INFO:tasks.workunit.client.0.smithi040.stdout:1/255: read d1/d16/f1b [1039707,58499] 0 2024-04-18T10:42:43.200 INFO:tasks.workunit.client.0.smithi040.stdout:4/269: dwrite d2/d3/f38 [4194304,4194304] 0 2024-04-18T10:42:43.200 INFO:tasks.workunit.client.0.smithi040.stdout:6/278: link df/f2f df/d4b/f68 0 2024-04-18T10:42:43.200 INFO:tasks.workunit.client.0.smithi040.stdout:3/261: fsync d1/d7/d12/f32 0 2024-04-18T10:42:43.201 INFO:tasks.workunit.client.0.smithi040.stdout:1/256: readlink d1/d16/l43 0 2024-04-18T10:42:43.203 INFO:tasks.workunit.client.0.smithi040.stdout:8/278: truncate d2/f17 2003979 0 2024-04-18T10:42:43.205 INFO:tasks.workunit.client.0.smithi040.stdout:1/257: chown d1/c14 25892 1 2024-04-18T10:42:43.206 INFO:tasks.workunit.client.0.smithi040.stdout:3/262: stat d1/lf 0 2024-04-18T10:42:43.207 INFO:tasks.workunit.client.0.smithi040.stdout:3/263: readlink d1/d2/d16/d18/l5f 0 2024-04-18T10:42:43.210 INFO:tasks.workunit.client.0.smithi040.stdout:6/279: symlink df/d17/d19/d3f/d53/l69 0 2024-04-18T10:42:43.211 INFO:tasks.workunit.client.0.smithi040.stdout:0/270: symlink dd/df/d19/d28/d3a/d5b/l61 0 2024-04-18T10:42:43.212 INFO:tasks.workunit.client.0.smithi040.stdout:0/271: stat dd/df/d19/d28/c35 0 2024-04-18T10:42:43.213 INFO:tasks.workunit.client.0.smithi040.stdout:1/258: creat d1/d1c/d2b/d32/d35/f66 x:0 0 0 2024-04-18T10:42:43.215 INFO:tasks.workunit.client.0.smithi040.stdout:4/270: mkdir d2/d3/d4/d4a 0 2024-04-18T10:42:43.215 INFO:tasks.workunit.client.0.smithi040.stdout:7/283: sync 2024-04-18T10:42:43.215 INFO:tasks.workunit.client.0.smithi040.stdout:2/206: sync 2024-04-18T10:42:43.216 INFO:tasks.workunit.client.0.smithi040.stdout:8/279: mknod d2/d22/d49/c51 0 2024-04-18T10:42:43.218 INFO:tasks.workunit.client.0.smithi040.stdout:6/280: mkdir df/d4b/d6a 0 2024-04-18T10:42:43.218 INFO:tasks.workunit.client.0.smithi040.stdout:4/271: truncate d2/d3/d4/d1f/d29/f33 852548 0 2024-04-18T10:42:43.219 INFO:tasks.workunit.client.0.smithi040.stdout:6/281: write df/d17/d19/f40 [932049,97138] 0 2024-04-18T10:42:43.220 INFO:tasks.workunit.client.0.smithi040.stdout:0/272: mkdir dd/d62 0 2024-04-18T10:42:43.221 INFO:tasks.workunit.client.0.smithi040.stdout:1/259: mkdir d1/d1c/d2b/d32/d36/d4d/d67 0 2024-04-18T10:42:43.224 INFO:tasks.workunit.client.0.smithi040.stdout:7/284: creat d6/d25/d28/d2c/d2d/d47/d55/d58/f60 x:0 0 0 2024-04-18T10:42:43.224 INFO:tasks.workunit.client.0.smithi040.stdout:2/207: chown dd/l13 108708566 1 2024-04-18T10:42:43.226 INFO:tasks.workunit.client.0.smithi040.stdout:8/280: creat d2/d5/d9/d3c/f52 x:0 0 0 2024-04-18T10:42:43.231 INFO:tasks.workunit.client.0.smithi040.stdout:3/264: dread d1/d7/f53 [0,4194304] 0 2024-04-18T10:42:43.231 INFO:tasks.workunit.client.0.smithi040.stdout:4/272: mknod d2/d3/d4/d1f/c4b 0 2024-04-18T10:42:43.231 INFO:tasks.workunit.client.0.smithi040.stdout:6/282: dwrite df/d17/d19/d3f/f5c [0,4194304] 0 2024-04-18T10:42:43.231 INFO:tasks.workunit.client.0.smithi040.stdout:0/273: dwrite dd/df/d19/d28/d3a/d42/f58 [0,4194304] 0 2024-04-18T10:42:43.234 INFO:tasks.workunit.client.0.smithi040.stdout:0/274: write dd/f37 [1040533,24891] 0 2024-04-18T10:42:43.235 INFO:tasks.workunit.client.0.smithi040.stdout:3/265: chown d1/d7/d3a/l51 778490 1 2024-04-18T10:42:43.237 INFO:tasks.workunit.client.0.smithi040.stdout:3/266: dread - d1/d2/d4e/d58/f5d zero size 2024-04-18T10:42:43.239 INFO:tasks.workunit.client.0.smithi040.stdout:5/230: dwrite d0/f23 [4194304,4194304] 0 2024-04-18T10:42:43.240 INFO:tasks.workunit.client.0.smithi040.stdout:7/285: symlink d6/d25/d28/d2c/d2d/l61 0 2024-04-18T10:42:43.241 INFO:tasks.workunit.client.0.smithi040.stdout:8/281: rename d2/d5/c34 to d2/d5/d9/c53 0 2024-04-18T10:42:43.246 INFO:tasks.workunit.client.0.smithi040.stdout:6/283: mknod df/d17/d19/d3f/d53/c6b 0 2024-04-18T10:42:43.247 INFO:tasks.workunit.client.0.smithi040.stdout:1/260: symlink d1/d1c/d2b/l68 0 2024-04-18T10:42:43.250 INFO:tasks.workunit.client.0.smithi040.stdout:0/275: creat dd/df/d4e/f63 x:0 0 0 2024-04-18T10:42:43.250 INFO:tasks.workunit.client.0.smithi040.stdout:6/284: dread df/d17/d19/f40 [0,4194304] 0 2024-04-18T10:42:43.251 INFO:tasks.workunit.client.0.smithi040.stdout:2/208: truncate dd/d14/f22 3799427 0 2024-04-18T10:42:43.253 INFO:tasks.workunit.client.0.smithi040.stdout:3/267: readlink d1/d2/d16/d18/l39 0 2024-04-18T10:42:43.253 INFO:tasks.workunit.client.0.smithi040.stdout:2/209: write dd/d14/d2b/f35 [7128735,32690] 0 2024-04-18T10:42:43.257 INFO:tasks.workunit.client.0.smithi040.stdout:8/282: creat d2/d15/d2b/f54 x:0 0 0 2024-04-18T10:42:43.260 INFO:tasks.workunit.client.0.smithi040.stdout:1/261: stat d1/fa 0 2024-04-18T10:42:43.263 INFO:tasks.workunit.client.0.smithi040.stdout:0/276: rename dd/df/d19/d28/f38 to dd/df/d19/d28/d3a/f64 0 2024-04-18T10:42:43.264 INFO:tasks.workunit.client.0.smithi040.stdout:2/210: mknod dd/d14/d2b/c3d 0 2024-04-18T10:42:43.266 INFO:tasks.workunit.client.0.smithi040.stdout:2/211: write dd/d14/f16 [4721731,75312] 0 2024-04-18T10:42:43.267 INFO:tasks.workunit.client.0.smithi040.stdout:1/262: rmdir d1 39 2024-04-18T10:42:43.268 INFO:tasks.workunit.client.0.smithi040.stdout:4/273: link d2/lf d2/d3/d4/d21/d28/d3f/l4c 0 2024-04-18T10:42:43.269 INFO:tasks.workunit.client.0.smithi040.stdout:4/274: chown d2/d3/d41/d47 192859948 1 2024-04-18T10:42:43.269 INFO:tasks.workunit.client.0.smithi040.stdout:6/285: mknod df/d17/d19/c6c 0 2024-04-18T10:42:43.270 INFO:tasks.workunit.client.0.smithi040.stdout:3/268: dwrite d1/d2/d16/f2d [0,4194304] 0 2024-04-18T10:42:43.271 INFO:tasks.workunit.client.0.smithi040.stdout:6/286: write df/d17/f56 [1007312,69817] 0 2024-04-18T10:42:43.272 INFO:tasks.workunit.client.0.smithi040.stdout:5/231: rename d0/d1e to d0/d4e 0 2024-04-18T10:42:43.276 INFO:tasks.workunit.client.0.smithi040.stdout:0/277: symlink dd/df/d19/d28/d3a/d42/l65 0 2024-04-18T10:42:43.279 INFO:tasks.workunit.client.0.smithi040.stdout:3/269: dread d1/d2/d16/f25 [0,4194304] 0 2024-04-18T10:42:43.280 INFO:tasks.workunit.client.0.smithi040.stdout:6/287: dwrite df/d17/d19/f33 [0,4194304] 0 2024-04-18T10:42:43.286 INFO:tasks.workunit.client.0.smithi040.stdout:5/232: rename d0/f23 to d0/d21/d42/f4f 0 2024-04-18T10:42:43.286 INFO:tasks.workunit.client.0.smithi040.stdout:9/317: dwrite d2/d3/f12 [0,4194304] 0 2024-04-18T10:42:43.289 INFO:tasks.workunit.client.0.smithi040.stdout:2/212: dread dd/f15 [0,4194304] 0 2024-04-18T10:42:43.290 INFO:tasks.workunit.client.0.smithi040.stdout:6/288: mknod df/d17/c6d 0 2024-04-18T10:42:43.290 INFO:tasks.workunit.client.0.smithi040.stdout:5/233: dread d0/d3/f5 [0,4194304] 0 2024-04-18T10:42:43.291 INFO:tasks.workunit.client.0.smithi040.stdout:6/289: chown df/d17/d19/f28 585748 1 2024-04-18T10:42:43.291 INFO:tasks.workunit.client.0.smithi040.stdout:4/275: chown d2/d3/d4/d21/d28/d3f/l4c 462 1 2024-04-18T10:42:43.291 INFO:tasks.workunit.client.0.smithi040.stdout:7/286: write d6/d25/d28/d2c/f33 [119128,5114] 0 2024-04-18T10:42:43.295 INFO:tasks.workunit.client.0.smithi040.stdout:1/263: dread d1/d1c/d2b/d32/d36/f38 [0,4194304] 0 2024-04-18T10:42:43.295 INFO:tasks.workunit.client.0.smithi040.stdout:1/264: dread - d1/d1c/d2b/d32/d36/f3a zero size 2024-04-18T10:42:43.298 INFO:tasks.workunit.client.0.smithi040.stdout:9/318: creat d2/d3/d70/f79 x:0 0 0 2024-04-18T10:42:43.299 INFO:tasks.workunit.client.0.smithi040.stdout:9/319: chown d2/d5b/l57 474692 1 2024-04-18T10:42:43.299 INFO:tasks.workunit.client.0.smithi040.stdout:2/213: mknod dd/d14/c3e 0 2024-04-18T10:42:43.299 INFO:tasks.workunit.client.0.smithi040.stdout:5/234: symlink d0/d3/l50 0 2024-04-18T10:42:43.309 INFO:tasks.workunit.client.0.smithi040.stdout:2/214: read dd/d14/d2b/f2e [198974,14272] 0 2024-04-18T10:42:43.310 INFO:tasks.workunit.client.0.smithi040.stdout:0/278: creat dd/df/d19/f66 x:0 0 0 2024-04-18T10:42:43.311 INFO:tasks.workunit.client.0.smithi040.stdout:4/276: symlink d2/d3/d4/d1f/d29/d49/l4d 0 2024-04-18T10:42:43.311 INFO:tasks.workunit.client.0.smithi040.stdout:4/277: readlink d2/lf 0 2024-04-18T10:42:43.312 INFO:tasks.workunit.client.0.smithi040.stdout:0/279: write dd/df/d4e/f5c [875925,18703] 0 2024-04-18T10:42:43.312 INFO:tasks.workunit.client.0.smithi040.stdout:5/235: symlink d0/d21/d42/l51 0 2024-04-18T10:42:43.315 INFO:tasks.workunit.client.0.smithi040.stdout:7/287: rename d6/d25/d28/d2c/d3c/f56 to d6/d25/f62 0 2024-04-18T10:42:43.315 INFO:tasks.workunit.client.0.smithi040.stdout:0/280: fsync dd/df/d4e/f55 0 2024-04-18T10:42:43.316 INFO:tasks.workunit.client.0.smithi040.stdout:1/265: creat d1/f69 x:0 0 0 2024-04-18T10:42:43.318 INFO:tasks.workunit.client.0.smithi040.stdout:2/215: dread dd/f15 [0,4194304] 0 2024-04-18T10:42:43.318 INFO:tasks.workunit.client.0.smithi040.stdout:5/236: write d0/d21/d42/f4f [3052732,97961] 0 2024-04-18T10:42:43.319 INFO:tasks.workunit.client.0.smithi040.stdout:3/270: getdents d1/d7 0 2024-04-18T10:42:43.319 INFO:tasks.workunit.client.0.smithi040.stdout:4/278: dread d2/f2c [0,4194304] 0 2024-04-18T10:42:43.320 INFO:tasks.workunit.client.0.smithi040.stdout:9/320: dread d2/d7/f8 [0,4194304] 0 2024-04-18T10:42:43.320 INFO:tasks.workunit.client.0.smithi040.stdout:0/281: mknod dd/df/d4e/c67 0 2024-04-18T10:42:43.321 INFO:tasks.workunit.client.0.smithi040.stdout:5/237: mkdir d0/d1c/d52 0 2024-04-18T10:42:43.322 INFO:tasks.workunit.client.0.smithi040.stdout:9/321: chown d2/dc/d46/c77 22 1 2024-04-18T10:42:43.325 INFO:tasks.workunit.client.0.smithi040.stdout:5/238: creat d0/d1c/f53 x:0 0 0 2024-04-18T10:42:43.327 INFO:tasks.workunit.client.0.smithi040.stdout:0/282: dread dd/df/d19/d28/d3a/d42/f52 [0,4194304] 0 2024-04-18T10:42:43.328 INFO:tasks.workunit.client.0.smithi040.stdout:9/322: creat d2/d3/d22/d2e/d35/d40/d71/f7a x:0 0 0 2024-04-18T10:42:43.329 INFO:tasks.workunit.client.0.smithi040.stdout:2/216: dread dd/f17 [0,4194304] 0 2024-04-18T10:42:43.329 INFO:tasks.workunit.client.0.smithi040.stdout:4/279: dwrite d2/d3/d2f/f46 [0,4194304] 0 2024-04-18T10:42:43.330 INFO:tasks.workunit.client.0.smithi040.stdout:5/239: chown d0/f1 390 1 2024-04-18T10:42:43.331 INFO:tasks.workunit.client.0.smithi040.stdout:8/283: sync 2024-04-18T10:42:43.333 INFO:tasks.workunit.client.0.smithi040.stdout:8/284: chown d2/d22 156352 1 2024-04-18T10:42:43.334 INFO:tasks.workunit.client.0.smithi040.stdout:8/285: readlink d2/d15/d18/l46 0 2024-04-18T10:42:43.334 INFO:tasks.workunit.client.0.smithi040.stdout:0/283: dread dd/df/d4e/f5c [0,4194304] 0 2024-04-18T10:42:43.340 INFO:tasks.workunit.client.0.smithi040.stdout:8/286: symlink d2/d22/d49/l55 0 2024-04-18T10:42:43.341 INFO:tasks.workunit.client.0.smithi040.stdout:7/288: dwrite d6/f14 [4194304,4194304] 0 2024-04-18T10:42:43.341 INFO:tasks.workunit.client.0.smithi040.stdout:1/266: dread d1/f18 [0,4194304] 0 2024-04-18T10:42:43.343 INFO:tasks.workunit.client.0.smithi040.stdout:0/284: creat dd/df/d19/d28/f68 x:0 0 0 2024-04-18T10:42:43.343 INFO:tasks.workunit.client.0.smithi040.stdout:9/323: getdents d2/dd 0 2024-04-18T10:42:43.346 INFO:tasks.workunit.client.0.smithi040.stdout:3/271: dwrite d1/d7/f53 [4194304,4194304] 0 2024-04-18T10:42:43.346 INFO:tasks.workunit.client.0.smithi040.stdout:1/267: fdatasync d1/d1c/d2b/d32/f53 0 2024-04-18T10:42:43.346 INFO:tasks.workunit.client.0.smithi040.stdout:8/287: creat d2/d15/d18/f56 x:0 0 0 2024-04-18T10:42:43.349 INFO:tasks.workunit.client.0.smithi040.stdout:0/285: rmdir dd/df/d4e 39 2024-04-18T10:42:43.349 INFO:tasks.workunit.client.0.smithi040.stdout:3/272: write d1/d2/d3c/f55 [817580,123764] 0 2024-04-18T10:42:43.353 INFO:tasks.workunit.client.0.smithi040.stdout:1/268: chown d1/d16/d27/d3f/c5b 18031 1 2024-04-18T10:42:43.354 INFO:tasks.workunit.client.0.smithi040.stdout:7/289: dwrite d6/fa [0,4194304] 0 2024-04-18T10:42:43.356 INFO:tasks.workunit.client.0.smithi040.stdout:4/280: truncate d2/f2c 2472461 0 2024-04-18T10:42:43.358 INFO:tasks.workunit.client.0.smithi040.stdout:8/288: rename d2/d5/d9/d1b/f2f to d2/d15/d2b/f57 0 2024-04-18T10:42:43.358 INFO:tasks.workunit.client.0.smithi040.stdout:6/290: sync 2024-04-18T10:42:43.358 INFO:tasks.workunit.client.0.smithi040.stdout:5/240: dread d0/f1 [4194304,4194304] 0 2024-04-18T10:42:43.358 INFO:tasks.workunit.client.0.smithi040.stdout:3/273: mkdir d1/d2/d4e/d60 0 2024-04-18T10:42:43.359 INFO:tasks.workunit.client.0.smithi040.stdout:2/217: truncate dd/d14/d2b/f35 6079939 0 2024-04-18T10:42:43.360 INFO:tasks.workunit.client.0.smithi040.stdout:0/286: dwrite dd/df/d19/d28/f53 [0,4194304] 0 2024-04-18T10:42:43.362 INFO:tasks.workunit.client.0.smithi040.stdout:0/287: fdatasync dd/df/f13 0 2024-04-18T10:42:43.362 INFO:tasks.workunit.client.0.smithi040.stdout:1/269: creat d1/d16/d27/d2e/d3e/f6a x:0 0 0 2024-04-18T10:42:43.375 INFO:tasks.workunit.client.0.smithi040.stdout:7/290: mkdir d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d63 0 2024-04-18T10:42:43.376 INFO:tasks.workunit.client.0.smithi040.stdout:6/291: fsync df/f43 0 2024-04-18T10:42:43.376 INFO:tasks.workunit.client.0.smithi040.stdout:5/241: symlink d0/d3b/d3f/l54 0 2024-04-18T10:42:43.379 INFO:tasks.workunit.client.0.smithi040.stdout:1/270: creat d1/d1c/d2b/d32/d36/f6b x:0 0 0 2024-04-18T10:42:43.380 INFO:tasks.workunit.client.0.smithi040.stdout:6/292: readlink df/d17/d19/d3f/d53/l69 0 2024-04-18T10:42:43.381 INFO:tasks.workunit.client.0.smithi040.stdout:5/242: unlink d0/c2e 0 2024-04-18T10:42:43.382 INFO:tasks.workunit.client.0.smithi040.stdout:4/281: dwrite d2/d3/d4/f12 [0,4194304] 0 2024-04-18T10:42:43.384 INFO:tasks.workunit.client.0.smithi040.stdout:6/293: fdatasync df/d17/f31 0 2024-04-18T10:42:43.386 INFO:tasks.workunit.client.0.smithi040.stdout:3/274: dwrite d1/d7/d12/f32 [0,4194304] 0 2024-04-18T10:42:43.388 INFO:tasks.workunit.client.0.smithi040.stdout:6/294: dread - df/d17/f47 zero size 2024-04-18T10:42:43.390 INFO:tasks.workunit.client.0.smithi040.stdout:1/271: unlink d1/f1e 0 2024-04-18T10:42:43.391 INFO:tasks.workunit.client.0.smithi040.stdout:5/243: fsync d0/d3/f10 0 2024-04-18T10:42:43.393 INFO:tasks.workunit.client.0.smithi040.stdout:7/291: dwrite d6/d50/f5d [0,4194304] 0 2024-04-18T10:42:43.395 INFO:tasks.workunit.client.0.smithi040.stdout:0/288: dwrite dd/df/d4e/f5c [0,4194304] 0 2024-04-18T10:42:43.395 INFO:tasks.workunit.client.0.smithi040.stdout:4/282: stat d2/d3/d4/d1f/l3b 0 2024-04-18T10:42:43.395 INFO:tasks.workunit.client.0.smithi040.stdout:9/324: dread d2/d3/d22/f3a [0,4194304] 0 2024-04-18T10:42:43.401 INFO:tasks.workunit.client.0.smithi040.stdout:7/292: truncate d6/d25/d28/d2c/d2d/d47/d55/d58/f60 465583 0 2024-04-18T10:42:43.402 INFO:tasks.workunit.client.0.smithi040.stdout:3/275: rename d1/d2/d16/d18/f46 to d1/d7/d28/f61 0 2024-04-18T10:42:43.403 INFO:tasks.workunit.client.0.smithi040.stdout:5/244: creat d0/d21/d42/f55 x:0 0 0 2024-04-18T10:42:43.404 INFO:tasks.workunit.client.0.smithi040.stdout:2/218: truncate dd/f28 290981 0 2024-04-18T10:42:43.405 INFO:tasks.workunit.client.0.smithi040.stdout:9/325: dwrite d2/dc/f60 [0,4194304] 0 2024-04-18T10:42:43.406 INFO:tasks.workunit.client.0.smithi040.stdout:4/283: creat d2/d3/f4e x:0 0 0 2024-04-18T10:42:43.409 INFO:tasks.workunit.client.0.smithi040.stdout:1/272: dwrite d1/d1c/d2b/d32/d36/f6b [0,4194304] 0 2024-04-18T10:42:43.410 INFO:tasks.workunit.client.0.smithi040.stdout:4/284: fsync d2/d3/d4/d1f/d29/d49/f32 0 2024-04-18T10:42:43.412 INFO:tasks.workunit.client.0.smithi040.stdout:2/219: dread dd/f15 [0,4194304] 0 2024-04-18T10:42:43.413 INFO:tasks.workunit.client.0.smithi040.stdout:3/276: read - d1/d2/d16/f40 zero size 2024-04-18T10:42:43.415 INFO:tasks.workunit.client.0.smithi040.stdout:5/245: symlink d0/d4e/l56 0 2024-04-18T10:42:43.415 INFO:tasks.workunit.client.0.smithi040.stdout:8/289: sync 2024-04-18T10:42:43.416 INFO:tasks.workunit.client.0.smithi040.stdout:8/290: write d2/f2a [1083628,23696] 0 2024-04-18T10:42:43.419 INFO:tasks.workunit.client.0.smithi040.stdout:4/285: dread d2/d3/d2f/f35 [0,4194304] 0 2024-04-18T10:42:43.422 INFO:tasks.workunit.client.0.smithi040.stdout:3/277: mkdir d1/d2/d4e/d58/d62 0 2024-04-18T10:42:43.423 INFO:tasks.workunit.client.0.smithi040.stdout:2/220: read dd/d14/f22 [2436179,63442] 0 2024-04-18T10:42:43.426 INFO:tasks.workunit.client.0.smithi040.stdout:5/246: symlink d0/d1c/d52/l57 0 2024-04-18T10:42:43.427 INFO:tasks.workunit.client.0.smithi040.stdout:9/326: dread d2/d7/f14 [0,4194304] 0 2024-04-18T10:42:43.427 INFO:tasks.workunit.client.0.smithi040.stdout:8/291: truncate d2/d5/d9/fb 559330 0 2024-04-18T10:42:43.428 INFO:tasks.workunit.client.0.smithi040.stdout:4/286: getdents d2/d3/d41/d47 0 2024-04-18T10:42:43.429 INFO:tasks.workunit.client.0.smithi040.stdout:3/278: creat d1/d2/d4e/d57/f63 x:0 0 0 2024-04-18T10:42:43.430 INFO:tasks.workunit.client.0.smithi040.stdout:3/279: fdatasync d1/d2/f31 0 2024-04-18T10:42:43.431 INFO:tasks.workunit.client.0.smithi040.stdout:5/247: rename d0/d21/d42/l51 to d0/d4e/l58 0 2024-04-18T10:42:43.434 INFO:tasks.workunit.client.0.smithi040.stdout:3/280: mknod d1/d7/c64 0 2024-04-18T10:42:43.436 INFO:tasks.workunit.client.0.smithi040.stdout:4/287: rmdir d2/d3/d4/d4a 0 2024-04-18T10:42:43.436 INFO:tasks.workunit.client.0.smithi040.stdout:4/288: chown d2/d3/d4/d21/d28/d3f/l4c 0 1 2024-04-18T10:42:43.437 INFO:tasks.workunit.client.0.smithi040.stdout:4/289: chown d2/d3/d4/d1f/d29/d49/f32 181 1 2024-04-18T10:42:43.438 INFO:tasks.workunit.client.0.smithi040.stdout:3/281: unlink d1/d2/d16/d18/f37 0 2024-04-18T10:42:43.439 INFO:tasks.workunit.client.0.smithi040.stdout:5/248: dread d0/d21/f22 [0,4194304] 0 2024-04-18T10:42:43.440 INFO:tasks.workunit.client.0.smithi040.stdout:5/249: write d0/f1b [1719672,83457] 0 2024-04-18T10:42:43.446 INFO:tasks.workunit.client.0.smithi040.stdout:3/282: link d1/d2/d4e/d57/f63 d1/d2/d16/d18/f65 0 2024-04-18T10:42:43.449 INFO:tasks.workunit.client.0.smithi040.stdout:3/283: stat d1/f6 0 2024-04-18T10:42:43.450 INFO:tasks.workunit.client.0.smithi040.stdout:2/221: read dd/f28 [82777,115875] 0 2024-04-18T10:42:43.451 INFO:tasks.workunit.client.0.smithi040.stdout:6/295: dwrite df/d4b/f68 [0,4194304] 0 2024-04-18T10:42:43.452 INFO:tasks.workunit.client.0.smithi040.stdout:3/284: write d1/d2/d16/d18/d3b/f3f [1278027,32936] 0 2024-04-18T10:42:43.453 INFO:tasks.workunit.client.0.smithi040.stdout:6/296: fsync df/d17/f56 0 2024-04-18T10:42:43.454 INFO:tasks.workunit.client.0.smithi040.stdout:0/289: truncate dd/df/d19/d28/f2d 670841 0 2024-04-18T10:42:43.458 INFO:tasks.workunit.client.0.smithi040.stdout:7/293: dwrite d6/f20 [0,4194304] 0 2024-04-18T10:42:43.461 INFO:tasks.workunit.client.0.smithi040.stdout:2/222: rename l7 to dd/l3f 0 2024-04-18T10:42:43.461 INFO:tasks.workunit.client.0.smithi040.stdout:7/294: write d6/d25/d28/d2c/d2d/f57 [583467,111596] 0 2024-04-18T10:42:43.462 INFO:tasks.workunit.client.0.smithi040.stdout:3/285: dwrite d1/d2/f48 [0,4194304] 0 2024-04-18T10:42:43.463 INFO:tasks.workunit.client.0.smithi040.stdout:0/290: symlink dd/df/d19/l69 0 2024-04-18T10:42:43.464 INFO:tasks.workunit.client.0.smithi040.stdout:1/273: truncate d1/f18 914290 0 2024-04-18T10:42:43.469 INFO:tasks.workunit.client.0.smithi040.stdout:6/297: rename df/d17/d19 to df/d4b/d6e 0 2024-04-18T10:42:43.470 INFO:tasks.workunit.client.0.smithi040.stdout:6/298: stat df/d17/c3e 0 2024-04-18T10:42:43.470 INFO:tasks.workunit.client.0.smithi040.stdout:6/299: chown df/f2f 89 1 2024-04-18T10:42:43.470 INFO:tasks.workunit.client.0.smithi040.stdout:3/286: mknod d1/d2/d4e/d58/c66 0 2024-04-18T10:42:43.488 INFO:tasks.workunit.client.0.smithi040.stdout:6/300: chown df/f4d 466435044 1 2024-04-18T10:42:43.489 INFO:tasks.workunit.client.0.smithi040.stdout:4/290: truncate d2/d3/d4/dd/f22 2845522 0 2024-04-18T10:42:43.490 INFO:tasks.workunit.client.0.smithi040.stdout:2/223: read dd/d14/d2b/f35 [317528,34985] 0 2024-04-18T10:42:43.491 INFO:tasks.workunit.client.0.smithi040.stdout:3/287: truncate d1/d2/d4e/d58/f5d 958223 0 2024-04-18T10:42:43.492 INFO:tasks.workunit.client.0.smithi040.stdout:4/291: chown d2/d3/d4/d21/d28/d3f/f39 128764 1 2024-04-18T10:42:43.492 INFO:tasks.workunit.client.0.smithi040.stdout:9/327: dwrite d2/d3/f4e [4194304,4194304] 0 2024-04-18T10:42:43.493 INFO:tasks.workunit.client.0.smithi040.stdout:9/328: fsync d2/d3/d70/f79 0 2024-04-18T10:42:43.494 INFO:tasks.workunit.client.0.smithi040.stdout:9/329: read d2/d7/f8 [281355,51072] 0 2024-04-18T10:42:43.508 INFO:tasks.workunit.client.0.smithi040.stdout:8/292: sync 2024-04-18T10:42:43.514 INFO:tasks.workunit.client.0.smithi040.stdout:8/293: dwrite d2/d15/d18/f56 [0,4194304] 0 2024-04-18T10:42:43.516 INFO:tasks.workunit.client.0.smithi040.stdout:8/294: dread d2/d2c/f3b [0,4194304] 0 2024-04-18T10:42:43.540 INFO:tasks.workunit.client.0.smithi040.stdout:5/250: sync 2024-04-18T10:42:43.649 INFO:tasks.workunit.client.0.smithi040.stdout:1/274: creat d1/d16/d27/d2d/f6c x:0 0 0 2024-04-18T10:42:43.653 INFO:tasks.workunit.client.0.smithi040.stdout:3/288: fdatasync d1/d7/d28/f61 0 2024-04-18T10:42:43.655 INFO:tasks.workunit.client.0.smithi040.stdout:4/292: mkdir d2/d3/d4/dd/d4f 0 2024-04-18T10:42:43.656 INFO:tasks.workunit.client.0.smithi040.stdout:4/293: read - d2/d3/d4/dd/f44 zero size 2024-04-18T10:42:43.659 INFO:tasks.workunit.client.0.smithi040.stdout:5/251: creat d0/d21/d42/f59 x:0 0 0 2024-04-18T10:42:43.662 INFO:tasks.workunit.client.0.smithi040.stdout:1/275: mknod d1/d1c/d2b/d32/c6d 0 2024-04-18T10:42:43.664 INFO:tasks.workunit.client.0.smithi040.stdout:4/294: symlink d2/d3/d4/d21/l50 0 2024-04-18T10:42:43.665 INFO:tasks.workunit.client.0.smithi040.stdout:0/291: getdents dd/df/d19/d28/d3a/d46 0 2024-04-18T10:42:43.667 INFO:tasks.workunit.client.0.smithi040.stdout:1/276: chown d1/f15 5242 1 2024-04-18T10:42:43.667 INFO:tasks.workunit.client.0.smithi040.stdout:8/295: creat d2/d15/f58 x:0 0 0 2024-04-18T10:42:43.669 INFO:tasks.workunit.client.0.smithi040.stdout:4/295: rename d2/d3/d4/f25 to d2/d3/d4/d23/f51 0 2024-04-18T10:42:43.670 INFO:tasks.workunit.client.0.smithi040.stdout:5/252: link d0/f2d d0/d1c/f5a 0 2024-04-18T10:42:43.671 INFO:tasks.workunit.client.0.smithi040.stdout:5/253: truncate d0/d3/f5 865235 0 2024-04-18T10:42:43.672 INFO:tasks.workunit.client.0.smithi040.stdout:1/277: symlink d1/d1c/l6e 0 2024-04-18T10:42:43.673 INFO:tasks.workunit.client.0.smithi040.stdout:1/278: write d1/d16/f29 [97572,82525] 0 2024-04-18T10:42:43.673 INFO:tasks.workunit.client.0.smithi040.stdout:1/279: stat d1 0 2024-04-18T10:42:43.675 INFO:tasks.workunit.client.0.smithi040.stdout:5/254: dread d0/d21/f44 [0,4194304] 0 2024-04-18T10:42:43.678 INFO:tasks.workunit.client.0.smithi040.stdout:1/280: symlink d1/d16/d27/d2d/l6f 0 2024-04-18T10:42:43.678 INFO:tasks.workunit.client.0.smithi040.stdout:1/281: chown d1/d1c/d2b/d32/d35/c42 271 1 2024-04-18T10:42:43.680 INFO:tasks.workunit.client.0.smithi040.stdout:0/292: rename dd/df/d19/c2a to dd/df/d19/c6a 0 2024-04-18T10:42:43.681 INFO:tasks.workunit.client.0.smithi040.stdout:4/296: link c1 d2/d3/d41/d47/c52 0 2024-04-18T10:42:43.682 INFO:tasks.workunit.client.0.smithi040.stdout:0/293: chown dd/df/d19/d28/d3a/f41 523400 1 2024-04-18T10:42:43.682 INFO:tasks.workunit.client.0.smithi040.stdout:1/282: dread d1/d1c/d2b/d32/d36/f38 [0,4194304] 0 2024-04-18T10:42:43.686 INFO:tasks.workunit.client.0.smithi040.stdout:0/294: creat dd/f6b x:0 0 0 2024-04-18T10:42:43.687 INFO:tasks.workunit.client.0.smithi040.stdout:0/295: truncate dd/df/f15 7723774 0 2024-04-18T10:42:43.688 INFO:tasks.workunit.client.0.smithi040.stdout:4/297: unlink d2/d3/d4/d1f/d29/f33 0 2024-04-18T10:42:43.688 INFO:tasks.workunit.client.0.smithi040.stdout:0/296: chown dd/l43 162 1 2024-04-18T10:42:43.689 INFO:tasks.workunit.client.0.smithi040.stdout:1/283: creat d1/d16/d27/d3f/f70 x:0 0 0 2024-04-18T10:42:43.689 INFO:tasks.workunit.client.0.smithi040.stdout:8/296: link d2/d5/d9/c2d d2/d5/d9/d3c/c59 0 2024-04-18T10:42:43.690 INFO:tasks.workunit.client.0.smithi040.stdout:1/284: write d1/d1c/d2b/d32/d36/f3a [673665,115214] 0 2024-04-18T10:42:43.691 INFO:tasks.workunit.client.0.smithi040.stdout:3/289: sync 2024-04-18T10:42:43.691 INFO:tasks.workunit.client.0.smithi040.stdout:0/297: fsync dd/f1d 0 2024-04-18T10:42:43.693 INFO:tasks.workunit.client.0.smithi040.stdout:0/298: fsync dd/df/d4e/f50 0 2024-04-18T10:42:43.693 INFO:tasks.workunit.client.0.smithi040.stdout:8/297: truncate d2/d10/f26 2725622 0 2024-04-18T10:42:43.695 INFO:tasks.workunit.client.0.smithi040.stdout:0/299: write dd/df/d19/d28/d3a/d42/f59 [1042044,2163] 0 2024-04-18T10:42:43.697 INFO:tasks.workunit.client.0.smithi040.stdout:1/285: dwrite d1/d1c/d2b/d32/d36/f6b [0,4194304] 0 2024-04-18T10:42:43.698 INFO:tasks.workunit.client.0.smithi040.stdout:1/286: read - d1/d16/d27/d2e/f55 zero size 2024-04-18T10:42:43.698 INFO:tasks.workunit.client.0.smithi040.stdout:3/290: rename d1/d2/d4e/d60 to d1/d7/d67 0 2024-04-18T10:42:43.709 INFO:tasks.workunit.client.0.smithi040.stdout:0/300: link dd/df/d19/d28/d3a/l3c dd/df/d19/d28/d3a/d5b/l6c 0 2024-04-18T10:42:43.740 INFO:tasks.workunit.client.0.smithi040.stdout:8/298: sync 2024-04-18T10:42:43.744 INFO:tasks.workunit.client.0.smithi040.stdout:8/299: rename d2/d15/d18 to d2/d5/d9/d3c/d5a 0 2024-04-18T10:42:43.745 INFO:tasks.workunit.client.0.smithi040.stdout:8/300: chown d2/d10/d14/f16 39902839 1 2024-04-18T10:42:43.747 INFO:tasks.workunit.client.0.smithi040.stdout:8/301: creat d2/f5b x:0 0 0 2024-04-18T10:42:43.749 INFO:tasks.workunit.client.0.smithi040.stdout:8/302: rmdir d2/d2c 39 2024-04-18T10:42:43.752 INFO:tasks.workunit.client.0.smithi040.stdout:8/303: symlink d2/d15/l5c 0 2024-04-18T10:42:43.755 INFO:tasks.workunit.client.0.smithi040.stdout:8/304: symlink d2/d5/l5d 0 2024-04-18T10:42:43.757 INFO:tasks.workunit.client.0.smithi040.stdout:8/305: truncate d2/d2c/f3b 876740 0 2024-04-18T10:42:43.760 INFO:tasks.workunit.client.0.smithi040.stdout:8/306: creat d2/f5e x:0 0 0 2024-04-18T10:42:43.762 INFO:tasks.workunit.client.0.smithi040.stdout:8/307: creat d2/d5/d9/f5f x:0 0 0 2024-04-18T10:42:43.764 INFO:tasks.workunit.client.0.smithi040.stdout:8/308: symlink d2/d22/l60 0 2024-04-18T10:42:43.769 INFO:tasks.workunit.client.0.smithi040.stdout:7/295: truncate d6/d25/f3a 1291628 0 2024-04-18T10:42:43.771 INFO:tasks.workunit.client.0.smithi040.stdout:4/298: getdents d2/d3/d4/dd 0 2024-04-18T10:42:43.776 INFO:tasks.workunit.client.0.smithi040.stdout:1/287: fdatasync d1/f18 0 2024-04-18T10:42:43.777 INFO:tasks.workunit.client.0.smithi040.stdout:9/330: truncate d2/d3/d22/d2e/d35/f4c 1206626 0 2024-04-18T10:42:43.777 INFO:tasks.workunit.client.0.smithi040.stdout:4/299: write d2/d3/d2f/f46 [3357702,49365] 0 2024-04-18T10:42:43.778 INFO:tasks.workunit.client.0.smithi040.stdout:6/301: dwrite f7 [0,4194304] 0 2024-04-18T10:42:43.779 INFO:tasks.workunit.client.0.smithi040.stdout:1/288: chown d1/d16/d27/d2d 467211 1 2024-04-18T10:42:43.780 INFO:tasks.workunit.client.0.smithi040.stdout:2/224: dwrite dd/d14/d2b/f2e [0,4194304] 0 2024-04-18T10:42:43.782 INFO:tasks.workunit.client.0.smithi040.stdout:2/225: stat dd/d14/l19 0 2024-04-18T10:42:43.783 INFO:tasks.workunit.client.0.smithi040.stdout:9/331: creat d2/d3/d22/d2e/f7b x:0 0 0 2024-04-18T10:42:43.785 INFO:tasks.workunit.client.0.smithi040.stdout:9/332: dread - d2/d3/d22/d2e/d35/d40/f68 zero size 2024-04-18T10:42:43.785 INFO:tasks.workunit.client.0.smithi040.stdout:6/302: dread f7 [0,4194304] 0 2024-04-18T10:42:43.792 INFO:tasks.workunit.client.0.smithi040.stdout:5/255: truncate d0/d3/f7 114258 0 2024-04-18T10:42:43.793 INFO:tasks.workunit.client.0.smithi040.stdout:5/256: fsync d0/f35 0 2024-04-18T10:42:43.795 INFO:tasks.workunit.client.0.smithi040.stdout:7/296: dread d6/d25/f3f [0,4194304] 0 2024-04-18T10:42:43.798 INFO:tasks.workunit.client.0.smithi040.stdout:5/257: mknod d0/d1c/c5b 0 2024-04-18T10:42:43.799 INFO:tasks.workunit.client.0.smithi040.stdout:7/297: mkdir d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d64 0 2024-04-18T10:42:43.801 INFO:tasks.workunit.client.0.smithi040.stdout:7/298: readlink d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/l43 0 2024-04-18T10:42:43.802 INFO:tasks.workunit.client.0.smithi040.stdout:7/299: write d6/d25/d28/d2c/d2d/f57 [92629,62083] 0 2024-04-18T10:42:43.802 INFO:tasks.workunit.client.0.smithi040.stdout:7/300: read d6/f20 [3725433,110537] 0 2024-04-18T10:42:43.803 INFO:tasks.workunit.client.0.smithi040.stdout:3/291: write d1/f1a [112212,14715] 0 2024-04-18T10:42:43.803 INFO:tasks.workunit.client.0.smithi040.stdout:5/258: getdents d0/d3b/d3f 0 2024-04-18T10:42:43.807 INFO:tasks.workunit.client.0.smithi040.stdout:3/292: symlink d1/d7/d12/l68 0 2024-04-18T10:42:43.808 INFO:tasks.workunit.client.0.smithi040.stdout:3/293: stat d1/d7/c64 0 2024-04-18T10:42:43.810 INFO:tasks.workunit.client.0.smithi040.stdout:3/294: write d1/f1a [232499,103379] 0 2024-04-18T10:42:43.811 INFO:tasks.workunit.client.0.smithi040.stdout:7/301: dwrite d6/d25/d28/d2c/d2d/f57 [0,4194304] 0 2024-04-18T10:42:43.815 INFO:tasks.workunit.client.0.smithi040.stdout:5/259: rename d0/d4e/l58 to d0/l5c 0 2024-04-18T10:42:43.815 INFO:tasks.workunit.client.0.smithi040.stdout:8/309: getdents d2/d5 0 2024-04-18T10:42:43.815 INFO:tasks.workunit.client.0.smithi040.stdout:3/295: mknod d1/d2/d16/d18/d3b/c69 0 2024-04-18T10:42:43.815 INFO:tasks.workunit.client.0.smithi040.stdout:7/302: creat d6/d25/d28/d2c/d2d/d47/f65 x:0 0 0 2024-04-18T10:42:43.816 INFO:tasks.workunit.client.0.smithi040.stdout:5/260: mkdir d0/d1c/d52/d5d 0 2024-04-18T10:42:43.817 INFO:tasks.workunit.client.0.smithi040.stdout:8/310: mknod d2/d5/d9/d3c/c61 0 2024-04-18T10:42:43.819 INFO:tasks.workunit.client.0.smithi040.stdout:3/296: dread d1/d7/d3a/f3d [0,4194304] 0 2024-04-18T10:42:43.822 INFO:tasks.workunit.client.0.smithi040.stdout:5/261: creat d0/d4e/f5e x:0 0 0 2024-04-18T10:42:43.822 INFO:tasks.workunit.client.0.smithi040.stdout:0/301: write dd/df/d19/d28/f2d [582087,10279] 0 2024-04-18T10:42:43.823 INFO:tasks.workunit.client.0.smithi040.stdout:8/311: chown d2/d5/d9/fb 1 1 2024-04-18T10:42:43.825 INFO:tasks.workunit.client.0.smithi040.stdout:3/297: creat d1/d2/d3c/f6a x:0 0 0 2024-04-18T10:42:43.827 INFO:tasks.workunit.client.0.smithi040.stdout:5/262: mknod d0/d1c/d52/c5f 0 2024-04-18T10:42:43.828 INFO:tasks.workunit.client.0.smithi040.stdout:0/302: creat dd/df/d19/d28/f6d x:0 0 0 2024-04-18T10:42:43.830 INFO:tasks.workunit.client.0.smithi040.stdout:7/303: creat d6/d25/d28/f66 x:0 0 0 2024-04-18T10:42:43.833 INFO:tasks.workunit.client.0.smithi040.stdout:1/289: dwrite d1/f18 [0,4194304] 0 2024-04-18T10:42:43.833 INFO:tasks.workunit.client.0.smithi040.stdout:9/333: write d2/dc/f73 [4388233,80862] 0 2024-04-18T10:42:43.835 INFO:tasks.workunit.client.0.smithi040.stdout:8/312: symlink d2/d4c/l62 0 2024-04-18T10:42:43.837 INFO:tasks.workunit.client.0.smithi040.stdout:6/303: write df/d4b/d6e/f33 [4766948,76174] 0 2024-04-18T10:42:43.837 INFO:tasks.workunit.client.0.smithi040.stdout:9/334: chown d2/dd/de 126 1 2024-04-18T10:42:43.843 INFO:tasks.workunit.client.0.smithi040.stdout:8/313: readlink d2/d5/d9/d3c/l4e 0 2024-04-18T10:42:43.844 INFO:tasks.workunit.client.0.smithi040.stdout:0/303: rename dd/df/d19/d28/d3a/f60 to dd/df/d19/d28/f6e 0 2024-04-18T10:42:43.844 INFO:tasks.workunit.client.0.smithi040.stdout:3/298: dwrite d1/d2/d16/d18/d3b/f3f [0,4194304] 0 2024-04-18T10:42:43.845 INFO:tasks.workunit.client.0.smithi040.stdout:5/263: dwrite d0/f19 [0,4194304] 0 2024-04-18T10:42:43.845 INFO:tasks.workunit.client.0.smithi040.stdout:7/304: truncate d6/d25/d28/d2c/d3c/f49 766345 0 2024-04-18T10:42:43.848 INFO:tasks.workunit.client.0.smithi040.stdout:2/226: dwrite dd/d14/d2b/f35 [0,4194304] 0 2024-04-18T10:42:43.849 INFO:tasks.workunit.client.0.smithi040.stdout:4/300: dwrite d2/f2c [0,4194304] 0 2024-04-18T10:42:43.850 INFO:tasks.workunit.client.0.smithi040.stdout:7/305: fdatasync d6/d25/f46 0 2024-04-18T10:42:43.854 INFO:tasks.workunit.client.0.smithi040.stdout:5/264: truncate d0/d4e/f4c 305382 0 2024-04-18T10:42:43.855 INFO:tasks.workunit.client.0.smithi040.stdout:7/306: unlink d6/cb 0 2024-04-18T10:42:43.859 INFO:tasks.workunit.client.0.smithi040.stdout:6/304: dwrite df/f12 [0,4194304] 0 2024-04-18T10:42:43.860 INFO:tasks.workunit.client.0.smithi040.stdout:0/304: dread dd/df/d19/d28/d3a/d42/f58 [0,4194304] 0 2024-04-18T10:42:43.862 INFO:tasks.workunit.client.0.smithi040.stdout:2/227: dwrite dd/d14/d2b/f2e [0,4194304] 0 2024-04-18T10:42:43.862 INFO:tasks.workunit.client.0.smithi040.stdout:0/305: fdatasync dd/df/d19/d28/f4c 0 2024-04-18T10:42:43.867 INFO:tasks.workunit.client.0.smithi040.stdout:6/305: mknod df/d4b/c6f 0 2024-04-18T10:42:43.868 INFO:tasks.workunit.client.0.smithi040.stdout:4/301: creat d2/d3/d41/d47/f53 x:0 0 0 2024-04-18T10:42:43.870 INFO:tasks.workunit.client.0.smithi040.stdout:5/265: creat d0/d1c/d52/d5d/f60 x:0 0 0 2024-04-18T10:42:43.871 INFO:tasks.workunit.client.0.smithi040.stdout:0/306: fsync dd/df/f2b 0 2024-04-18T10:42:43.873 INFO:tasks.workunit.client.0.smithi040.stdout:6/306: write f7 [3851347,128344] 0 2024-04-18T10:42:43.874 INFO:tasks.workunit.client.0.smithi040.stdout:5/266: mknod d0/d21/c61 0 2024-04-18T10:42:43.875 INFO:tasks.workunit.client.0.smithi040.stdout:2/228: dwrite dd/f15 [0,4194304] 0 2024-04-18T10:42:43.876 INFO:tasks.workunit.client.0.smithi040.stdout:0/307: getdents dd/df/d19/d3e 0 2024-04-18T10:42:43.876 INFO:tasks.workunit.client.0.smithi040.stdout:4/302: creat d2/f54 x:0 0 0 2024-04-18T10:42:43.878 INFO:tasks.workunit.client.0.smithi040.stdout:4/303: chown d2/d3/l2d 243827955 1 2024-04-18T10:42:43.879 INFO:tasks.workunit.client.0.smithi040.stdout:4/304: write d2/f2c [1783035,87330] 0 2024-04-18T10:42:43.879 INFO:tasks.workunit.client.0.smithi040.stdout:5/267: rename d0/f48 to d0/d3b/d3f/f62 0 2024-04-18T10:42:43.884 INFO:tasks.workunit.client.0.smithi040.stdout:4/305: dwrite d2/d3/d4/f2e [0,4194304] 0 2024-04-18T10:42:43.885 INFO:tasks.workunit.client.0.smithi040.stdout:4/306: fsync d2/d3/d4/dd/f44 0 2024-04-18T10:42:43.891 INFO:tasks.workunit.client.0.smithi040.stdout:2/229: symlink dd/d14/d2f/l40 0 2024-04-18T10:42:43.891 INFO:tasks.workunit.client.0.smithi040.stdout:1/290: dread d1/d16/d27/d2e/d39/f46 [0,4194304] 0 2024-04-18T10:42:43.891 INFO:tasks.workunit.client.0.smithi040.stdout:9/335: write d2/dc/d46/f69 [731848,85772] 0 2024-04-18T10:42:43.893 INFO:tasks.workunit.client.0.smithi040.stdout:4/307: dwrite d2/d3/d4/d21/d28/d3f/f39 [8388608,4194304] 0 2024-04-18T10:42:43.898 INFO:tasks.workunit.client.0.smithi040.stdout:9/336: rename d2/d5b/l67 to d2/d3/d22/d2e/d35/d40/l7c 0 2024-04-18T10:42:43.900 INFO:tasks.workunit.client.0.smithi040.stdout:4/308: symlink d2/d3/d4/dd/d4f/l55 0 2024-04-18T10:42:43.901 INFO:tasks.workunit.client.0.smithi040.stdout:1/291: dwrite d1/d1c/f24 [0,4194304] 0 2024-04-18T10:42:43.902 INFO:tasks.workunit.client.0.smithi040.stdout:9/337: fsync d2/d3/d22/d2e/d35/d40/d71/f7a 0 2024-04-18T10:42:43.902 INFO:tasks.workunit.client.0.smithi040.stdout:4/309: chown d2/d3/d4/dd/f44 305733798 1 2024-04-18T10:42:43.903 INFO:tasks.workunit.client.0.smithi040.stdout:8/314: dread d2/f31 [0,4194304] 0 2024-04-18T10:42:43.904 INFO:tasks.workunit.client.0.smithi040.stdout:1/292: symlink d1/d16/l71 0 2024-04-18T10:42:43.905 INFO:tasks.workunit.client.0.smithi040.stdout:9/338: truncate d2/d3/d22/d2e/d35/d40/f68 519651 0 2024-04-18T10:42:43.905 INFO:tasks.workunit.client.0.smithi040.stdout:8/315: rmdir d2/d22/d49 39 2024-04-18T10:42:43.906 INFO:tasks.workunit.client.0.smithi040.stdout:8/316: stat d2/l13 0 2024-04-18T10:42:43.908 INFO:tasks.workunit.client.0.smithi040.stdout:8/317: fdatasync d2/d5/d9/d1b/f4f 0 2024-04-18T10:42:43.910 INFO:tasks.workunit.client.0.smithi040.stdout:1/293: truncate d1/d1c/d2b/d32/d36/d4d/f62 24772 0 2024-04-18T10:42:43.910 INFO:tasks.workunit.client.0.smithi040.stdout:4/310: dwrite d2/d3/f38 [4194304,4194304] 0 2024-04-18T10:42:43.910 INFO:tasks.workunit.client.0.smithi040.stdout:9/339: rename d2/dc/d46/c77 to d2/d3/d70/c7d 0 2024-04-18T10:42:43.914 INFO:tasks.workunit.client.0.smithi040.stdout:8/318: dread d2/d10/f12 [0,4194304] 0 2024-04-18T10:42:43.915 INFO:tasks.workunit.client.0.smithi040.stdout:4/311: dread d2/f2c [0,4194304] 0 2024-04-18T10:42:43.915 INFO:tasks.workunit.client.0.smithi040.stdout:8/319: chown d2/d5/d9/d1b/f4f 2 1 2024-04-18T10:42:43.915 INFO:tasks.workunit.client.0.smithi040.stdout:1/294: read d1/d16/f41 [3510961,61090] 0 2024-04-18T10:42:43.916 INFO:tasks.workunit.client.0.smithi040.stdout:1/295: dread - d1/d16/d27/d2d/f63 zero size 2024-04-18T10:42:43.917 INFO:tasks.workunit.client.0.smithi040.stdout:4/312: creat d2/d3/d2f/f56 x:0 0 0 2024-04-18T10:42:43.918 INFO:tasks.workunit.client.0.smithi040.stdout:1/296: chown d1/l12 0 1 2024-04-18T10:42:43.919 INFO:tasks.workunit.client.0.smithi040.stdout:1/297: write d1/d16/f3b [120343,57003] 0 2024-04-18T10:42:43.921 INFO:tasks.workunit.client.0.smithi040.stdout:4/313: rename d2/d3/d4/d1f/c4b to d2/d3/d4/d21/d28/c57 0 2024-04-18T10:42:43.923 INFO:tasks.workunit.client.0.smithi040.stdout:1/298: mknod d1/d1c/d2b/d32/c72 0 2024-04-18T10:42:43.925 INFO:tasks.workunit.client.0.smithi040.stdout:1/299: mknod d1/d1c/d2b/d32/d35/c73 0 2024-04-18T10:42:43.926 INFO:tasks.workunit.client.0.smithi040.stdout:1/300: dread - d1/d1c/d2b/d32/d35/f66 zero size 2024-04-18T10:42:43.933 INFO:tasks.workunit.client.0.smithi040.stdout:7/307: sync 2024-04-18T10:42:43.945 INFO:tasks.workunit.client.0.smithi040.stdout:4/314: fdatasync d2/d3/d4/d21/d28/d3f/f39 0 2024-04-18T10:42:43.946 INFO:tasks.workunit.client.0.smithi040.stdout:3/299: truncate d1/d7/f53 5876693 0 2024-04-18T10:42:43.947 INFO:tasks.workunit.client.0.smithi040.stdout:7/308: fsync d6/d50/f5d 0 2024-04-18T10:42:43.949 INFO:tasks.workunit.client.0.smithi040.stdout:6/307: truncate df/d4b/d6e/f33 4272626 0 2024-04-18T10:42:43.949 INFO:tasks.workunit.client.0.smithi040.stdout:0/308: write dd/df/d19/f45 [2420802,8783] 0 2024-04-18T10:42:43.950 INFO:tasks.workunit.client.0.smithi040.stdout:6/308: fsync df/f4d 0 2024-04-18T10:42:43.952 INFO:tasks.workunit.client.0.smithi040.stdout:1/301: mknod d1/d1c/d2b/d32/d36/d4d/c74 0 2024-04-18T10:42:43.958 INFO:tasks.workunit.client.0.smithi040.stdout:3/300: dwrite d1/d2/d4e/d58/f5d [0,4194304] 0 2024-04-18T10:42:43.958 INFO:tasks.workunit.client.0.smithi040.stdout:7/309: mkdir d6/d25/d67 0 2024-04-18T10:42:43.960 INFO:tasks.workunit.client.0.smithi040.stdout:2/230: dread f9 [0,4194304] 0 2024-04-18T10:42:43.961 INFO:tasks.workunit.client.0.smithi040.stdout:3/301: chown d1/d7/l4b 17757 1 2024-04-18T10:42:43.961 INFO:tasks.workunit.client.0.smithi040.stdout:2/231: chown dd/d14 945014 1 2024-04-18T10:42:43.961 INFO:tasks.workunit.client.0.smithi040.stdout:7/310: write d6/f14 [8763515,62965] 0 2024-04-18T10:42:43.962 INFO:tasks.workunit.client.0.smithi040.stdout:0/309: rename dd/df/d19/d28/d3a/d5b/l61 to dd/df/d19/d28/d3a/d46/l6f 0 2024-04-18T10:42:43.963 INFO:tasks.workunit.client.0.smithi040.stdout:8/320: dread d2/d5/d9/d3c/d5a/f27 [0,4194304] 0 2024-04-18T10:42:43.964 INFO:tasks.workunit.client.0.smithi040.stdout:6/309: symlink df/d4b/d6e/l70 0 2024-04-18T10:42:43.964 INFO:tasks.workunit.client.0.smithi040.stdout:1/302: dwrite d1/d16/f1b [0,4194304] 0 2024-04-18T10:42:43.964 INFO:tasks.workunit.client.0.smithi040.stdout:3/302: chown d1/d7/d12/f22 433493 1 2024-04-18T10:42:43.964 INFO:tasks.workunit.client.0.smithi040.stdout:8/321: chown d2/l45 5928621 1 2024-04-18T10:42:43.965 INFO:tasks.workunit.client.0.smithi040.stdout:0/310: chown dd/df/d4e/f50 75456432 1 2024-04-18T10:42:43.967 INFO:tasks.workunit.client.0.smithi040.stdout:4/315: truncate d2/f9 4182296 0 2024-04-18T10:42:43.967 INFO:tasks.workunit.client.0.smithi040.stdout:4/316: stat d2/d3/d4/dd/f44 0 2024-04-18T10:42:43.970 INFO:tasks.workunit.client.0.smithi040.stdout:6/310: chown df/f5b 1 1 2024-04-18T10:42:43.971 INFO:tasks.workunit.client.0.smithi040.stdout:7/311: fdatasync d6/d25/d28/d2c/f3d 0 2024-04-18T10:42:43.975 INFO:tasks.workunit.client.0.smithi040.stdout:5/268: sync 2024-04-18T10:42:43.979 INFO:tasks.workunit.client.0.smithi040.stdout:0/311: dread dd/df/d19/d28/d3a/f41 [0,4194304] 0 2024-04-18T10:42:43.979 INFO:tasks.workunit.client.0.smithi040.stdout:8/322: mkdir d2/d5/d9/d63 0 2024-04-18T10:42:43.980 INFO:tasks.workunit.client.0.smithi040.stdout:4/317: creat d2/d3/d4/d21/f58 x:0 0 0 2024-04-18T10:42:43.980 INFO:tasks.workunit.client.0.smithi040.stdout:6/311: unlink df/d4b/l54 0 2024-04-18T10:42:43.980 INFO:tasks.workunit.client.0.smithi040.stdout:7/312: symlink d6/d25/d28/d2c/d2d/d47/l68 0 2024-04-18T10:42:43.981 INFO:tasks.workunit.client.0.smithi040.stdout:3/303: mkdir d1/d2/d4e/d58/d62/d6b 0 2024-04-18T10:42:43.983 INFO:tasks.workunit.client.0.smithi040.stdout:2/232: rename dd/d14/d2b/f35 to dd/d14/d2f/f41 0 2024-04-18T10:42:43.984 INFO:tasks.workunit.client.0.smithi040.stdout:7/313: unlink d6/f20 0 2024-04-18T10:42:43.985 INFO:tasks.workunit.client.0.smithi040.stdout:2/233: write dd/d14/d2b/f2e [1326616,12966] 0 2024-04-18T10:42:43.988 INFO:tasks.workunit.client.0.smithi040.stdout:5/269: dwrite d0/d4e/f4c [0,4194304] 0 2024-04-18T10:42:43.990 INFO:tasks.workunit.client.0.smithi040.stdout:2/234: dread dd/f17 [0,4194304] 0 2024-04-18T10:42:43.990 INFO:tasks.workunit.client.0.smithi040.stdout:6/312: rename df/d4b/d6e/c3a to df/d4b/d6a/c71 0 2024-04-18T10:42:43.991 INFO:tasks.workunit.client.0.smithi040.stdout:3/304: creat d1/d2/d4e/d58/f6c x:0 0 0 2024-04-18T10:42:43.993 INFO:tasks.workunit.client.0.smithi040.stdout:8/323: creat d2/d5/d9/d63/f64 x:0 0 0 2024-04-18T10:42:43.995 INFO:tasks.workunit.client.0.smithi040.stdout:7/314: creat d6/d3e/f69 x:0 0 0 2024-04-18T10:42:43.996 INFO:tasks.workunit.client.0.smithi040.stdout:0/312: symlink dd/df/d19/d3e/l70 0 2024-04-18T10:42:43.997 INFO:tasks.workunit.client.0.smithi040.stdout:4/318: dread d2/d3/d4/d21/d28/d3f/f39 [4194304,4194304] 0 2024-04-18T10:42:43.998 INFO:tasks.workunit.client.0.smithi040.stdout:4/319: fdatasync d2/d3/f38 0 2024-04-18T10:42:43.999 INFO:tasks.workunit.client.0.smithi040.stdout:2/235: rename dd/l1f to dd/d14/l42 0 2024-04-18T10:42:44.002 INFO:tasks.workunit.client.0.smithi040.stdout:3/305: unlink d1/d2/d16/d18/d3b/c69 0 2024-04-18T10:42:44.004 INFO:tasks.workunit.client.0.smithi040.stdout:3/306: chown d1/d7/d3a/f3d 184 1 2024-04-18T10:42:44.004 INFO:tasks.workunit.client.0.smithi040.stdout:7/315: mkdir d6/d25/d28/d2c/d3c/d6a 0 2024-04-18T10:42:44.006 INFO:tasks.workunit.client.0.smithi040.stdout:2/236: dwrite dd/d14/f16 [0,4194304] 0 2024-04-18T10:42:44.007 INFO:tasks.workunit.client.0.smithi040.stdout:0/313: rename dd/df/d19/d28/d3a/d46/c56 to dd/df/d19/d28/d3a/d46/c71 0 2024-04-18T10:42:44.009 INFO:tasks.workunit.client.0.smithi040.stdout:4/320: rmdir d2/d3/d41/d47 39 2024-04-18T10:42:44.010 INFO:tasks.workunit.client.0.smithi040.stdout:5/270: dread d0/f2d [0,4194304] 0 2024-04-18T10:42:44.011 INFO:tasks.workunit.client.0.smithi040.stdout:4/321: write d2/d3/f4e [1022330,76012] 0 2024-04-18T10:42:44.012 INFO:tasks.workunit.client.0.smithi040.stdout:5/271: write d0/d3/f10 [2537530,95287] 0 2024-04-18T10:42:44.014 INFO:tasks.workunit.client.0.smithi040.stdout:0/314: dwrite dd/df/d19/f22 [0,4194304] 0 2024-04-18T10:42:44.016 INFO:tasks.workunit.client.0.smithi040.stdout:7/316: mkdir d6/d25/d28/d2c/d2d/d47/d5c/d6b 0 2024-04-18T10:42:44.017 INFO:tasks.workunit.client.0.smithi040.stdout:9/340: sync 2024-04-18T10:42:44.018 INFO:tasks.workunit.client.0.smithi040.stdout:5/272: dread d0/d4e/f4c [0,4194304] 0 2024-04-18T10:42:44.022 INFO:tasks.workunit.client.0.smithi040.stdout:4/322: creat d2/d3/f59 x:0 0 0 2024-04-18T10:42:44.022 INFO:tasks.workunit.client.0.smithi040.stdout:5/273: truncate d0/d3b/d3f/f41 484628 0 2024-04-18T10:42:44.022 INFO:tasks.workunit.client.0.smithi040.stdout:0/315: dwrite dd/df/d19/d28/d3a/f51 [0,4194304] 0 2024-04-18T10:42:44.024 INFO:tasks.workunit.client.0.smithi040.stdout:4/323: write d2/d3/d2f/f46 [5202226,57450] 0 2024-04-18T10:42:44.025 INFO:tasks.workunit.client.0.smithi040.stdout:6/313: truncate df/d17/f1b 2437209 0 2024-04-18T10:42:44.030 INFO:tasks.workunit.client.0.smithi040.stdout:9/341: unlink d2/d3/d22/d2e/d35/d40/d71/f7a 0 2024-04-18T10:42:44.031 INFO:tasks.workunit.client.0.smithi040.stdout:8/324: link d2/d22/d49/l55 d2/d5/d9/d1b/l65 0 2024-04-18T10:42:44.033 INFO:tasks.workunit.client.0.smithi040.stdout:3/307: link d1/d2/d16/d18/l39 d1/d2/d4e/l6d 0 2024-04-18T10:42:44.033 INFO:tasks.workunit.client.0.smithi040.stdout:3/308: chown d1/d2/d16/d18/d3b 316578 1 2024-04-18T10:42:44.035 INFO:tasks.workunit.client.0.smithi040.stdout:3/309: write d1/d2/d16/f2d [2591506,98557] 0 2024-04-18T10:42:44.035 INFO:tasks.workunit.client.0.smithi040.stdout:2/237: rename dd/l2a to dd/d14/d2f/d37/l43 0 2024-04-18T10:42:44.037 INFO:tasks.workunit.client.0.smithi040.stdout:8/325: unlink d2/d15/f25 0 2024-04-18T10:42:44.038 INFO:tasks.workunit.client.0.smithi040.stdout:4/324: mknod d2/d3/d4/c5a 0 2024-04-18T10:42:44.039 INFO:tasks.workunit.client.0.smithi040.stdout:6/314: symlink df/d4b/d6e/l72 0 2024-04-18T10:42:44.040 INFO:tasks.workunit.client.0.smithi040.stdout:6/315: write df/f2f [2611788,107494] 0 2024-04-18T10:42:44.041 INFO:tasks.workunit.client.0.smithi040.stdout:2/238: dwrite dd/f15 [0,4194304] 0 2024-04-18T10:42:44.043 INFO:tasks.workunit.client.0.smithi040.stdout:2/239: write dd/d14/f16 [4570717,30729] 0 2024-04-18T10:42:44.044 INFO:tasks.workunit.client.0.smithi040.stdout:2/240: write dd/f36 [1015282,84369] 0 2024-04-18T10:42:44.046 INFO:tasks.workunit.client.0.smithi040.stdout:0/316: rename dd/df/d19/d28/f30 to dd/df/d19/d28/d3a/d42/f72 0 2024-04-18T10:42:44.046 INFO:tasks.workunit.client.0.smithi040.stdout:0/317: chown dd/df/d19/d28/d3a/f51 6236 1 2024-04-18T10:42:44.047 INFO:tasks.workunit.client.0.smithi040.stdout:0/318: write dd/df/d19/d28/f4c [190252,38024] 0 2024-04-18T10:42:44.049 INFO:tasks.workunit.client.0.smithi040.stdout:0/319: write dd/df/d19/d28/d3a/f51 [184123,130295] 0 2024-04-18T10:42:44.052 INFO:tasks.workunit.client.0.smithi040.stdout:8/326: readlink d2/d5/d9/d1b/l65 0 2024-04-18T10:42:44.053 INFO:tasks.workunit.client.0.smithi040.stdout:7/317: getdents d6/d25/d28 0 2024-04-18T10:42:44.055 INFO:tasks.workunit.client.0.smithi040.stdout:4/325: write d2/d3/d4/d23/f51 [572491,66189] 0 2024-04-18T10:42:44.057 INFO:tasks.workunit.client.0.smithi040.stdout:6/316: symlink df/d4b/l73 0 2024-04-18T10:42:44.057 INFO:tasks.workunit.client.0.smithi040.stdout:6/317: fsync df/f55 0 2024-04-18T10:42:44.058 INFO:tasks.workunit.client.0.smithi040.stdout:9/342: write d2/dd/f24 [160421,40441] 0 2024-04-18T10:42:44.059 INFO:tasks.workunit.client.0.smithi040.stdout:2/241: mkdir dd/d14/d44 0 2024-04-18T10:42:44.061 INFO:tasks.workunit.client.0.smithi040.stdout:3/310: symlink d1/d2/d16/l6e 0 2024-04-18T10:42:44.063 INFO:tasks.workunit.client.0.smithi040.stdout:5/274: getdents d0/d4e 0 2024-04-18T10:42:44.067 INFO:tasks.workunit.client.0.smithi040.stdout:6/318: unlink df/d4b/d6e/d3f/d53/c6b 0 2024-04-18T10:42:44.068 INFO:tasks.workunit.client.0.smithi040.stdout:3/311: dwrite d1/d2/f48 [0,4194304] 0 2024-04-18T10:42:44.068 INFO:tasks.workunit.client.0.smithi040.stdout:9/343: mknod d2/dc/d46/d6b/c7e 0 2024-04-18T10:42:44.069 INFO:tasks.workunit.client.0.smithi040.stdout:3/312: read - d1/d2/d16/d18/f65 zero size 2024-04-18T10:42:44.070 INFO:tasks.workunit.client.0.smithi040.stdout:8/327: mkdir d2/d15/d66 0 2024-04-18T10:42:44.072 INFO:tasks.workunit.client.0.smithi040.stdout:8/328: dread - d2/d15/f58 zero size 2024-04-18T10:42:44.072 INFO:tasks.workunit.client.0.smithi040.stdout:7/318: mkdir d6/d25/d28/d2c/d2d/d47/d55/d58/d6c 0 2024-04-18T10:42:44.074 INFO:tasks.workunit.client.0.smithi040.stdout:4/326: fdatasync d2/f9 0 2024-04-18T10:42:44.075 INFO:tasks.workunit.client.0.smithi040.stdout:7/319: read d6/d25/d28/f36 [2281017,14420] 0 2024-04-18T10:42:44.076 INFO:tasks.workunit.client.0.smithi040.stdout:9/344: dwrite d2/d3/f65 [0,4194304] 0 2024-04-18T10:42:44.077 INFO:tasks.workunit.client.0.smithi040.stdout:4/327: stat d2/d3/d4/d1f/d29 0 2024-04-18T10:42:44.077 INFO:tasks.workunit.client.0.smithi040.stdout:7/320: chown d6/f32 111329235 1 2024-04-18T10:42:44.078 INFO:tasks.workunit.client.0.smithi040.stdout:9/345: chown d2/d7/f14 155456 1 2024-04-18T10:42:44.081 INFO:tasks.workunit.client.0.smithi040.stdout:8/329: dwrite d2/d10/d14/f47 [0,4194304] 0 2024-04-18T10:42:44.081 INFO:tasks.workunit.client.0.smithi040.stdout:3/313: rmdir d1/d2/d4e/d58 39 2024-04-18T10:42:44.084 INFO:tasks.workunit.client.0.smithi040.stdout:6/319: dread df/d17/f1b [0,4194304] 0 2024-04-18T10:42:44.086 INFO:tasks.workunit.client.0.smithi040.stdout:2/242: creat dd/f45 x:0 0 0 2024-04-18T10:42:44.087 INFO:tasks.workunit.client.0.smithi040.stdout:3/314: read d1/d2/f17 [2792631,3503] 0 2024-04-18T10:42:44.087 INFO:tasks.workunit.client.0.smithi040.stdout:4/328: mknod d2/d3/d2f/c5b 0 2024-04-18T10:42:44.088 INFO:tasks.workunit.client.0.smithi040.stdout:9/346: mkdir d2/dd/de/d7f 0 2024-04-18T10:42:44.090 INFO:tasks.workunit.client.0.smithi040.stdout:5/275: dread d0/d21/d42/f4f [4194304,4194304] 0 2024-04-18T10:42:44.090 INFO:tasks.workunit.client.0.smithi040.stdout:1/303: sync 2024-04-18T10:42:44.091 INFO:tasks.workunit.client.0.smithi040.stdout:7/321: creat d6/d25/d28/d2c/d3c/f6d x:0 0 0 2024-04-18T10:42:44.092 INFO:tasks.workunit.client.0.smithi040.stdout:6/320: symlink df/d4b/d6e/l74 0 2024-04-18T10:42:44.093 INFO:tasks.workunit.client.0.smithi040.stdout:2/243: mkdir dd/d14/d44/d46 0 2024-04-18T10:42:44.094 INFO:tasks.workunit.client.0.smithi040.stdout:8/330: rename d2/d10/f12 to d2/f67 0 2024-04-18T10:42:44.095 INFO:tasks.workunit.client.0.smithi040.stdout:7/322: fdatasync d6/d25/d28/d2c/d2d/f57 0 2024-04-18T10:42:44.096 INFO:tasks.workunit.client.0.smithi040.stdout:6/321: write df/d4b/d6e/f30 [1877412,87011] 0 2024-04-18T10:42:44.099 INFO:tasks.workunit.client.0.smithi040.stdout:2/244: creat dd/d14/f47 x:0 0 0 2024-04-18T10:42:44.101 INFO:tasks.workunit.client.0.smithi040.stdout:4/329: dwrite d2/d3/d41/d47/f53 [0,4194304] 0 2024-04-18T10:42:44.101 INFO:tasks.workunit.client.0.smithi040.stdout:8/331: mkdir d2/d5/d9/d3c/d68 0 2024-04-18T10:42:44.103 INFO:tasks.workunit.client.0.smithi040.stdout:6/322: creat df/d4b/d6e/d3f/f75 x:0 0 0 2024-04-18T10:42:44.103 INFO:tasks.workunit.client.0.smithi040.stdout:3/315: link d1/d2/d16/d18/d3b/c44 d1/d2/d4e/d58/d62/c6f 0 2024-04-18T10:42:44.105 INFO:tasks.workunit.client.0.smithi040.stdout:2/245: unlink dd/d14/f16 0 2024-04-18T10:42:44.105 INFO:tasks.workunit.client.0.smithi040.stdout:4/330: write d2/f54 [212578,81581] 0 2024-04-18T10:42:44.108 INFO:tasks.workunit.client.0.smithi040.stdout:5/276: dwrite d0/d4e/f29 [4194304,4194304] 0 2024-04-18T10:42:44.108 INFO:tasks.workunit.client.0.smithi040.stdout:1/304: dwrite d1/fa [0,4194304] 0 2024-04-18T10:42:44.109 INFO:tasks.workunit.client.0.smithi040.stdout:3/316: mknod d1/d2/d4e/d57/c70 0 2024-04-18T10:42:44.111 INFO:tasks.workunit.client.0.smithi040.stdout:5/277: write d0/d3/f2b [3409831,3358] 0 2024-04-18T10:42:44.113 INFO:tasks.workunit.client.0.smithi040.stdout:8/332: rename d2/d5/d9/d3c/d5a/f1e to d2/d5/d9/d3c/d68/f69 0 2024-04-18T10:42:44.117 INFO:tasks.workunit.client.0.smithi040.stdout:6/323: dread df/d4b/d6e/f40 [0,4194304] 0 2024-04-18T10:42:44.117 INFO:tasks.workunit.client.0.smithi040.stdout:2/246: dwrite dd/d14/d2f/f3a [0,4194304] 0 2024-04-18T10:42:44.118 INFO:tasks.workunit.client.0.smithi040.stdout:1/305: mkdir d1/d16/d27/d3f/d75 0 2024-04-18T10:42:44.119 INFO:tasks.workunit.client.0.smithi040.stdout:2/247: fsync dd/f36 0 2024-04-18T10:42:44.119 INFO:tasks.workunit.client.0.smithi040.stdout:1/306: chown d1/f69 185 1 2024-04-18T10:42:44.125 INFO:tasks.workunit.client.0.smithi040.stdout:3/317: mknod d1/d2/d16/d18/d3b/c71 0 2024-04-18T10:42:44.126 INFO:tasks.workunit.client.0.smithi040.stdout:3/318: chown d1/d2/d3c/f55 7832639 1 2024-04-18T10:42:44.127 INFO:tasks.workunit.client.0.smithi040.stdout:9/347: truncate d2/dc/d46/f69 283401 0 2024-04-18T10:42:44.128 INFO:tasks.workunit.client.0.smithi040.stdout:0/320: sync 2024-04-18T10:42:44.128 INFO:tasks.workunit.client.0.smithi040.stdout:8/333: mkdir d2/d10/d6a 0 2024-04-18T10:42:44.129 INFO:tasks.workunit.client.0.smithi040.stdout:8/334: stat d2/f5e 0 2024-04-18T10:42:44.131 INFO:tasks.workunit.client.0.smithi040.stdout:5/278: rename d0/d1c/d52/c5f to d0/d3b/d3f/c63 0 2024-04-18T10:42:44.133 INFO:tasks.workunit.client.0.smithi040.stdout:3/319: dwrite d1/d7/d3a/f52 [0,4194304] 0 2024-04-18T10:42:44.136 INFO:tasks.workunit.client.0.smithi040.stdout:2/248: mknod dd/d14/d2f/d37/c48 0 2024-04-18T10:42:44.137 INFO:tasks.workunit.client.0.smithi040.stdout:1/307: unlink d1/d16/d27/f34 0 2024-04-18T10:42:44.138 INFO:tasks.workunit.client.0.smithi040.stdout:1/308: dread - d1/f69 zero size 2024-04-18T10:42:44.140 INFO:tasks.workunit.client.0.smithi040.stdout:0/321: mknod dd/df/d19/d28/d3a/d5b/c73 0 2024-04-18T10:42:44.141 INFO:tasks.workunit.client.0.smithi040.stdout:0/322: fsync dd/f37 0 2024-04-18T10:42:44.141 INFO:tasks.workunit.client.0.smithi040.stdout:7/323: sync 2024-04-18T10:42:44.142 INFO:tasks.workunit.client.0.smithi040.stdout:2/249: dwrite dd/f15 [0,4194304] 0 2024-04-18T10:42:44.143 INFO:tasks.workunit.client.0.smithi040.stdout:9/348: rename d2/dc/d46/d6b to d2/d5b/d6f/d80 0 2024-04-18T10:42:44.145 INFO:tasks.workunit.client.0.smithi040.stdout:4/331: rename d2/l6 to d2/l5c 0 2024-04-18T10:42:44.146 INFO:tasks.workunit.client.0.smithi040.stdout:5/279: rename d0/d3/l50 to d0/d3/l64 0 2024-04-18T10:42:44.147 INFO:tasks.workunit.client.0.smithi040.stdout:6/324: mkdir df/d76 0 2024-04-18T10:42:44.147 INFO:tasks.workunit.client.0.smithi040.stdout:6/325: chown cc 6 1 2024-04-18T10:42:44.149 INFO:tasks.workunit.client.0.smithi040.stdout:8/335: truncate d2/d10/f26 1314682 0 2024-04-18T10:42:44.149 INFO:tasks.workunit.client.0.smithi040.stdout:8/336: readlink d2/d10/d14/l3a 0 2024-04-18T10:42:44.150 INFO:tasks.workunit.client.0.smithi040.stdout:1/309: mknod d1/d1c/d2b/d32/d35/c76 0 2024-04-18T10:42:44.154 INFO:tasks.workunit.client.0.smithi040.stdout:0/323: rename dd/df/d19/d28/f6d to dd/d62/f74 0 2024-04-18T10:42:44.156 INFO:tasks.workunit.client.0.smithi040.stdout:3/320: truncate d1/d7/f53 5132819 0 2024-04-18T10:42:44.156 INFO:tasks.workunit.client.0.smithi040.stdout:0/324: write dd/f2e [7890597,100569] 0 2024-04-18T10:42:44.157 INFO:tasks.workunit.client.0.smithi040.stdout:6/326: truncate df/f43 521050 0 2024-04-18T10:42:44.157 INFO:tasks.workunit.client.0.smithi040.stdout:8/337: unlink d2/d5/d9/f5f 0 2024-04-18T10:42:44.158 INFO:tasks.workunit.client.0.smithi040.stdout:7/324: dwrite d6/d25/f62 [0,4194304] 0 2024-04-18T10:42:44.161 INFO:tasks.workunit.client.0.smithi040.stdout:8/338: read d2/d5/d9/d3c/d68/f69 [5812840,52073] 0 2024-04-18T10:42:44.170 INFO:tasks.workunit.client.0.smithi040.stdout:0/325: mkdir dd/df/d19/d3e/d75 0 2024-04-18T10:42:44.170 INFO:tasks.workunit.client.0.smithi040.stdout:7/325: dread d6/fa [4194304,4194304] 0 2024-04-18T10:42:44.171 INFO:tasks.workunit.client.0.smithi040.stdout:3/321: creat d1/d2/d4e/d58/f72 x:0 0 0 2024-04-18T10:42:44.175 INFO:tasks.workunit.client.0.smithi040.stdout:6/327: unlink df/f5b 0 2024-04-18T10:42:44.177 INFO:tasks.workunit.client.0.smithi040.stdout:0/326: creat dd/d62/f76 x:0 0 0 2024-04-18T10:42:44.178 INFO:tasks.workunit.client.0.smithi040.stdout:0/327: chown dd/df/d19/d28/d3a 32951 1 2024-04-18T10:42:44.178 INFO:tasks.workunit.client.0.smithi040.stdout:7/326: creat d6/d50/f6e x:0 0 0 2024-04-18T10:42:44.181 INFO:tasks.workunit.client.0.smithi040.stdout:2/250: dread dd/d14/f22 [0,4194304] 0 2024-04-18T10:42:44.181 INFO:tasks.workunit.client.0.smithi040.stdout:3/322: mknod d1/d2/d16/d18/d3b/c73 0 2024-04-18T10:42:44.182 INFO:tasks.workunit.client.0.smithi040.stdout:8/339: mknod d2/d15/c6b 0 2024-04-18T10:42:44.184 INFO:tasks.workunit.client.0.smithi040.stdout:3/323: write d1/d7/d28/f61 [509206,65674] 0 2024-04-18T10:42:44.184 INFO:tasks.workunit.client.0.smithi040.stdout:4/332: rename d2/d3/d4/d23/f51 to d2/d3/d41/f5d 0 2024-04-18T10:42:44.186 INFO:tasks.workunit.client.0.smithi040.stdout:0/328: dwrite dd/d62/f76 [0,4194304] 0 2024-04-18T10:42:44.188 INFO:tasks.workunit.client.0.smithi040.stdout:6/328: dread - df/d4b/d6e/d3f/d53/f5e zero size 2024-04-18T10:42:44.189 INFO:tasks.workunit.client.0.smithi040.stdout:9/349: truncate d2/d3/f41 2091801 0 2024-04-18T10:42:44.189 INFO:tasks.workunit.client.0.smithi040.stdout:1/310: getdents d1/d1c/d2b/d32 0 2024-04-18T10:42:44.190 INFO:tasks.workunit.client.0.smithi040.stdout:7/327: unlink d6/d25/d28/c30 0 2024-04-18T10:42:44.197 INFO:tasks.workunit.client.0.smithi040.stdout:0/329: mkdir dd/df/d19/d3e/d77 0 2024-04-18T10:42:44.200 INFO:tasks.workunit.client.0.smithi040.stdout:5/280: sync 2024-04-18T10:42:44.200 INFO:tasks.workunit.client.0.smithi040.stdout:9/350: rmdir d2/dc/d46/d44 39 2024-04-18T10:42:44.201 INFO:tasks.workunit.client.0.smithi040.stdout:6/329: mknod df/d4b/d6e/d3f/c77 0 2024-04-18T10:42:44.203 INFO:tasks.workunit.client.0.smithi040.stdout:2/251: mkdir dd/d14/d44/d46/d49 0 2024-04-18T10:42:44.206 INFO:tasks.workunit.client.0.smithi040.stdout:0/330: symlink dd/df/d19/d28/d3a/d46/l78 0 2024-04-18T10:42:44.207 INFO:tasks.workunit.client.0.smithi040.stdout:0/331: truncate dd/df/d19/f22 4437009 0 2024-04-18T10:42:44.209 INFO:tasks.workunit.client.0.smithi040.stdout:9/351: creat d2/d3/d70/f81 x:0 0 0 2024-04-18T10:42:44.209 INFO:tasks.workunit.client.0.smithi040.stdout:4/333: dread d2/d3/d2f/f46 [0,4194304] 0 2024-04-18T10:42:44.209 INFO:tasks.workunit.client.0.smithi040.stdout:0/332: write dd/df/d4e/f5c [2661390,22103] 0 2024-04-18T10:42:44.211 INFO:tasks.workunit.client.0.smithi040.stdout:9/352: chown d2/d3/d22/d2e/l5d 1536752 1 2024-04-18T10:42:44.211 INFO:tasks.workunit.client.0.smithi040.stdout:9/353: chown d2/dc/d46 447 1 2024-04-18T10:42:44.213 INFO:tasks.workunit.client.0.smithi040.stdout:8/340: creat d2/f6c x:0 0 0 2024-04-18T10:42:44.213 INFO:tasks.workunit.client.0.smithi040.stdout:2/252: mkdir dd/d14/d4a 0 2024-04-18T10:42:44.215 INFO:tasks.workunit.client.0.smithi040.stdout:3/324: rename d1/d2/d3c/f55 to d1/f74 0 2024-04-18T10:42:44.217 INFO:tasks.workunit.client.0.smithi040.stdout:1/311: creat d1/f77 x:0 0 0 2024-04-18T10:42:44.219 INFO:tasks.workunit.client.0.smithi040.stdout:4/334: dwrite d2/d3/f4e [0,4194304] 0 2024-04-18T10:42:44.220 INFO:tasks.workunit.client.0.smithi040.stdout:0/333: dwrite dd/df/d4e/f5c [0,4194304] 0 2024-04-18T10:42:44.221 INFO:tasks.workunit.client.0.smithi040.stdout:0/334: dread - dd/df/d19/d28/f68 zero size 2024-04-18T10:42:44.227 INFO:tasks.workunit.client.0.smithi040.stdout:8/341: mknod d2/d2c/c6d 0 2024-04-18T10:42:44.229 INFO:tasks.workunit.client.0.smithi040.stdout:0/335: dwrite dd/df/d19/d28/d3a/d42/f59 [0,4194304] 0 2024-04-18T10:42:44.229 INFO:tasks.workunit.client.0.smithi040.stdout:2/253: creat dd/d14/d2f/d37/f4b x:0 0 0 2024-04-18T10:42:44.230 INFO:tasks.workunit.client.0.smithi040.stdout:2/254: fdatasync dd/d14/f47 0 2024-04-18T10:42:44.231 INFO:tasks.workunit.client.0.smithi040.stdout:3/325: symlink d1/d2/d16/d18/d3b/l75 0 2024-04-18T10:42:44.232 INFO:tasks.workunit.client.0.smithi040.stdout:2/255: truncate dd/d14/f47 248873 0 2024-04-18T10:42:44.233 INFO:tasks.workunit.client.0.smithi040.stdout:2/256: truncate dd/f36 1524003 0 2024-04-18T10:42:44.234 INFO:tasks.workunit.client.0.smithi040.stdout:4/335: unlink d2/d3/l15 0 2024-04-18T10:42:44.235 INFO:tasks.workunit.client.0.smithi040.stdout:4/336: fdatasync d2/d3/d4/d1f/d29/d49/f42 0 2024-04-18T10:42:44.236 INFO:tasks.workunit.client.0.smithi040.stdout:4/337: dread - d2/d3/d4/dd/f48 zero size 2024-04-18T10:42:44.236 INFO:tasks.workunit.client.0.smithi040.stdout:2/257: dread f9 [0,4194304] 0 2024-04-18T10:42:44.236 INFO:tasks.workunit.client.0.smithi040.stdout:4/338: fsync d2/d3/d4/dd/f44 0 2024-04-18T10:42:44.237 INFO:tasks.workunit.client.0.smithi040.stdout:6/330: write df/d4b/d6e/f33 [4879597,46419] 0 2024-04-18T10:42:44.238 INFO:tasks.workunit.client.0.smithi040.stdout:5/281: truncate d0/d21/d42/f4f 7330436 0 2024-04-18T10:42:44.238 INFO:tasks.workunit.client.0.smithi040.stdout:4/339: fsync d2/d3/d4/d21/f58 0 2024-04-18T10:42:44.239 INFO:tasks.workunit.client.0.smithi040.stdout:1/312: rename d1/c14 to d1/d16/d27/c78 0 2024-04-18T10:42:44.240 INFO:tasks.workunit.client.0.smithi040.stdout:2/258: fsync f9 0 2024-04-18T10:42:44.241 INFO:tasks.workunit.client.0.smithi040.stdout:2/259: chown f9 126 1 2024-04-18T10:42:44.241 INFO:tasks.workunit.client.0.smithi040.stdout:9/354: creat d2/f82 x:0 0 0 2024-04-18T10:42:44.242 INFO:tasks.workunit.client.0.smithi040.stdout:0/336: mknod dd/df/c79 0 2024-04-18T10:42:44.243 INFO:tasks.workunit.client.0.smithi040.stdout:0/337: write dd/df/d19/d28/f53 [1823628,111379] 0 2024-04-18T10:42:44.244 INFO:tasks.workunit.client.0.smithi040.stdout:5/282: creat d0/d3b/d3f/f65 x:0 0 0 2024-04-18T10:42:44.245 INFO:tasks.workunit.client.0.smithi040.stdout:7/328: rename d6/l3b to d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/l6f 0 2024-04-18T10:42:44.246 INFO:tasks.workunit.client.0.smithi040.stdout:1/313: symlink d1/d16/l79 0 2024-04-18T10:42:44.246 INFO:tasks.workunit.client.0.smithi040.stdout:7/329: chown d6/d25/f62 1 1 2024-04-18T10:42:44.247 INFO:tasks.workunit.client.0.smithi040.stdout:9/355: symlink d2/d3/d70/l83 0 2024-04-18T10:42:44.248 INFO:tasks.workunit.client.0.smithi040.stdout:1/314: write d1/d1c/d2b/d32/d36/f3a [42791,104474] 0 2024-04-18T10:42:44.251 INFO:tasks.workunit.client.0.smithi040.stdout:8/342: rename d2/d15/d66 to d2/d22/d49/d6e 0 2024-04-18T10:42:44.253 INFO:tasks.workunit.client.0.smithi040.stdout:9/356: creat d2/d3/d22/d2e/d35/d40/d71/f84 x:0 0 0 2024-04-18T10:42:44.254 INFO:tasks.workunit.client.0.smithi040.stdout:5/283: rename d0/d3/c2c to d0/d4e/c66 0 2024-04-18T10:42:44.255 INFO:tasks.workunit.client.0.smithi040.stdout:7/330: symlink d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d64/l70 0 2024-04-18T10:42:44.255 INFO:tasks.workunit.client.0.smithi040.stdout:1/315: dwrite d1/d16/f21 [0,4194304] 0 2024-04-18T10:42:44.255 INFO:tasks.workunit.client.0.smithi040.stdout:5/284: fsync d0/f19 0 2024-04-18T10:42:44.256 INFO:tasks.workunit.client.0.smithi040.stdout:8/343: unlink d2/d5/l5d 0 2024-04-18T10:42:44.258 INFO:tasks.workunit.client.0.smithi040.stdout:8/344: stat d2/f67 0 2024-04-18T10:42:44.258 INFO:tasks.workunit.client.0.smithi040.stdout:5/285: chown d0/d1c/c49 451 1 2024-04-18T10:42:44.258 INFO:tasks.workunit.client.0.smithi040.stdout:5/286: readlink d0/d4e/l56 0 2024-04-18T10:42:44.258 INFO:tasks.workunit.client.0.smithi040.stdout:8/345: dread - d2/f6c zero size 2024-04-18T10:42:44.259 INFO:tasks.workunit.client.0.smithi040.stdout:9/357: mkdir d2/d3/d22/d2e/d35/d40/d85 0 2024-04-18T10:42:44.260 INFO:tasks.workunit.client.0.smithi040.stdout:7/331: symlink d6/d3e/l71 0 2024-04-18T10:42:44.262 INFO:tasks.workunit.client.0.smithi040.stdout:5/287: unlink d0/d21/d42/f59 0 2024-04-18T10:42:44.265 INFO:tasks.workunit.client.0.smithi040.stdout:1/316: dwrite d1/d1c/d2b/d32/d36/f59 [0,4194304] 0 2024-04-18T10:42:44.265 INFO:tasks.workunit.client.0.smithi040.stdout:5/288: read d0/d3/f2b [1888494,11037] 0 2024-04-18T10:42:44.268 INFO:tasks.workunit.client.0.smithi040.stdout:4/340: dread d2/f26 [0,4194304] 0 2024-04-18T10:42:44.269 INFO:tasks.workunit.client.0.smithi040.stdout:7/332: creat d6/d25/d28/d2c/d2d/d47/f72 x:0 0 0 2024-04-18T10:42:44.275 INFO:tasks.workunit.client.0.smithi040.stdout:7/333: dwrite d6/d25/d28/d2c/d2d/d47/f65 [0,4194304] 0 2024-04-18T10:42:44.275 INFO:tasks.workunit.client.0.smithi040.stdout:0/338: dread dd/df/f40 [0,4194304] 0 2024-04-18T10:42:44.275 INFO:tasks.workunit.client.0.smithi040.stdout:3/326: sync 2024-04-18T10:42:44.277 INFO:tasks.workunit.client.0.smithi040.stdout:0/339: write dd/df/f44 [512845,92320] 0 2024-04-18T10:42:44.277 INFO:tasks.workunit.client.0.smithi040.stdout:6/331: write df/d4b/d6e/f1e [841268,94494] 0 2024-04-18T10:42:44.280 INFO:tasks.workunit.client.0.smithi040.stdout:1/317: creat d1/d1c/d2b/d32/d36/d4d/d67/f7a x:0 0 0 2024-04-18T10:42:44.284 INFO:tasks.workunit.client.0.smithi040.stdout:4/341: mknod d2/d3/d4/c5e 0 2024-04-18T10:42:44.286 INFO:tasks.workunit.client.0.smithi040.stdout:7/334: mkdir d6/d3e/d73 0 2024-04-18T10:42:44.287 INFO:tasks.workunit.client.0.smithi040.stdout:3/327: creat d1/d7/d67/f76 x:0 0 0 2024-04-18T10:42:44.288 INFO:tasks.workunit.client.0.smithi040.stdout:2/260: dwrite dd/d14/f22 [0,4194304] 0 2024-04-18T10:42:44.288 INFO:tasks.workunit.client.0.smithi040.stdout:9/358: getdents d2/dc/d46 0 2024-04-18T10:42:44.291 INFO:tasks.workunit.client.0.smithi040.stdout:0/340: mkdir dd/df/d19/d28/d7a 0 2024-04-18T10:42:44.293 INFO:tasks.workunit.client.0.smithi040.stdout:1/318: rmdir d1/d16/d27/d2e 39 2024-04-18T10:42:44.295 INFO:tasks.workunit.client.0.smithi040.stdout:4/342: fsync d2/f26 0 2024-04-18T10:42:44.297 INFO:tasks.workunit.client.0.smithi040.stdout:6/332: creat df/d76/f78 x:0 0 0 2024-04-18T10:42:44.298 INFO:tasks.workunit.client.0.smithi040.stdout:9/359: dwrite d2/d3/d22/d2e/d35/d40/f68 [0,4194304] 0 2024-04-18T10:42:44.299 INFO:tasks.workunit.client.0.smithi040.stdout:0/341: dread dd/df/d4e/f5c [0,4194304] 0 2024-04-18T10:42:44.299 INFO:tasks.workunit.client.0.smithi040.stdout:7/335: symlink d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d64/l74 0 2024-04-18T10:42:44.301 INFO:tasks.workunit.client.0.smithi040.stdout:2/261: stat dd/d14/l42 0 2024-04-18T10:42:44.302 INFO:tasks.workunit.client.0.smithi040.stdout:9/360: read - d2/d3/d22/d2e/d35/d40/d71/f78 zero size 2024-04-18T10:42:44.302 INFO:tasks.workunit.client.0.smithi040.stdout:3/328: symlink d1/d2/d16/d18/d3b/l77 0 2024-04-18T10:42:44.302 INFO:tasks.workunit.client.0.smithi040.stdout:2/262: read dd/f17 [124680,78346] 0 2024-04-18T10:42:44.303 INFO:tasks.workunit.client.0.smithi040.stdout:3/329: chown d1/d2/d4e 6385167 1 2024-04-18T10:42:44.304 INFO:tasks.workunit.client.0.smithi040.stdout:2/263: fdatasync dd/d14/f47 0 2024-04-18T10:42:44.305 INFO:tasks.workunit.client.0.smithi040.stdout:4/343: dwrite d2/d3/d4/d21/d28/d3f/f39 [4194304,4194304] 0 2024-04-18T10:42:44.305 INFO:tasks.workunit.client.0.smithi040.stdout:3/330: read d1/d7/d3a/f3d [18772,22346] 0 2024-04-18T10:42:44.307 INFO:tasks.workunit.client.0.smithi040.stdout:1/319: write d1/f23 [145384,57714] 0 2024-04-18T10:42:44.311 INFO:tasks.workunit.client.0.smithi040.stdout:5/289: write d0/d4e/f4c [4501698,25782] 0 2024-04-18T10:42:44.313 INFO:tasks.workunit.client.0.smithi040.stdout:8/346: rmdir d2/d22/d49/d6e 0 2024-04-18T10:42:44.313 INFO:tasks.workunit.client.0.smithi040.stdout:5/290: write d0/f35 [4404479,126328] 0 2024-04-18T10:42:44.314 INFO:tasks.workunit.client.0.smithi040.stdout:9/361: mkdir d2/dc/d46/d86 0 2024-04-18T10:42:44.315 INFO:tasks.workunit.client.0.smithi040.stdout:1/320: dwrite d1/d1c/f24 [4194304,4194304] 0 2024-04-18T10:42:44.316 INFO:tasks.workunit.client.0.smithi040.stdout:8/347: write d2/d10/d14/f16 [4451398,81992] 0 2024-04-18T10:42:44.317 INFO:tasks.workunit.client.0.smithi040.stdout:1/321: write d1/d16/f3b [377776,125555] 0 2024-04-18T10:42:44.318 INFO:tasks.workunit.client.0.smithi040.stdout:1/322: chown d1/d1c/c31 1147221 1 2024-04-18T10:42:44.318 INFO:tasks.workunit.client.0.smithi040.stdout:1/323: chown d1/d16/f21 3640 1 2024-04-18T10:42:44.321 INFO:tasks.workunit.client.0.smithi040.stdout:2/264: rename dd/d14/d44/d46 to dd/d14/d44/d4c 0 2024-04-18T10:42:44.326 INFO:tasks.workunit.client.0.smithi040.stdout:3/331: mknod d1/d7/d12/c78 0 2024-04-18T10:42:44.328 INFO:tasks.workunit.client.0.smithi040.stdout:6/333: mknod df/d4b/d6e/c79 0 2024-04-18T10:42:44.329 INFO:tasks.workunit.client.0.smithi040.stdout:0/342: symlink dd/df/d19/l7b 0 2024-04-18T10:42:44.329 INFO:tasks.workunit.client.0.smithi040.stdout:7/336: dread d6/d25/f3a [0,4194304] 0 2024-04-18T10:42:44.330 INFO:tasks.workunit.client.0.smithi040.stdout:5/291: mkdir d0/d3b/d67 0 2024-04-18T10:42:44.330 INFO:tasks.workunit.client.0.smithi040.stdout:0/343: fdatasync dd/df/d19/d28/f68 0 2024-04-18T10:42:44.331 INFO:tasks.workunit.client.0.smithi040.stdout:9/362: write d2/d7/f5a [5469213,36216] 0 2024-04-18T10:42:44.332 INFO:tasks.workunit.client.0.smithi040.stdout:0/344: truncate dd/df/f40 4413154 0 2024-04-18T10:42:44.333 INFO:tasks.workunit.client.0.smithi040.stdout:9/363: chown d2/d3/f4a 0 1 2024-04-18T10:42:44.334 INFO:tasks.workunit.client.0.smithi040.stdout:1/324: stat d1/d16/d27/d2e/d39/f46 0 2024-04-18T10:42:44.335 INFO:tasks.workunit.client.0.smithi040.stdout:5/292: dread d0/f19 [0,4194304] 0 2024-04-18T10:42:44.335 INFO:tasks.workunit.client.0.smithi040.stdout:2/265: unlink dd/l29 0 2024-04-18T10:42:44.336 INFO:tasks.workunit.client.0.smithi040.stdout:2/266: chown dd/d14/d2f/l40 7 1 2024-04-18T10:42:44.336 INFO:tasks.workunit.client.0.smithi040.stdout:3/332: rmdir d1/d7/d67 39 2024-04-18T10:42:44.338 INFO:tasks.workunit.client.0.smithi040.stdout:4/344: link d2/d3/d4/dd/f22 d2/d3/d4/dd/d4f/f5f 0 2024-04-18T10:42:44.339 INFO:tasks.workunit.client.0.smithi040.stdout:7/337: dread - d6/d25/d28/f2f zero size 2024-04-18T10:42:44.341 INFO:tasks.workunit.client.0.smithi040.stdout:8/348: creat d2/d5/d9/d3c/f6f x:0 0 0 2024-04-18T10:42:44.343 INFO:tasks.workunit.client.0.smithi040.stdout:9/364: rmdir d2/d3/d22 39 2024-04-18T10:42:44.346 INFO:tasks.workunit.client.0.smithi040.stdout:1/325: rename d1/d16/d27 to d1/d1c/d7b 0 2024-04-18T10:42:44.346 INFO:tasks.workunit.client.0.smithi040.stdout:1/326: chown d1/d1c/f56 0 1 2024-04-18T10:42:44.350 INFO:tasks.workunit.client.0.smithi040.stdout:4/345: unlink d2/d3/d41/d47/f53 0 2024-04-18T10:42:44.351 INFO:tasks.workunit.client.0.smithi040.stdout:6/334: symlink df/l7a 0 2024-04-18T10:42:44.353 INFO:tasks.workunit.client.0.smithi040.stdout:7/338: unlink d6/d50/f5d 0 2024-04-18T10:42:44.359 INFO:tasks.workunit.client.0.smithi040.stdout:1/327: dread d1/d16/f41 [0,4194304] 0 2024-04-18T10:42:44.360 INFO:tasks.workunit.client.0.smithi040.stdout:6/335: symlink df/d76/l7b 0 2024-04-18T10:42:44.361 INFO:tasks.workunit.client.0.smithi040.stdout:8/349: creat d2/d10/d6a/f70 x:0 0 0 2024-04-18T10:42:44.362 INFO:tasks.workunit.client.0.smithi040.stdout:0/345: rmdir dd/df/d19/d28/d7a 0 2024-04-18T10:42:44.364 INFO:tasks.workunit.client.0.smithi040.stdout:9/365: chown d2/d3/d22/f6a 77 1 2024-04-18T10:42:44.366 INFO:tasks.workunit.client.0.smithi040.stdout:7/339: mknod d6/d25/c75 0 2024-04-18T10:42:44.366 INFO:tasks.workunit.client.0.smithi040.stdout:0/346: dread - dd/df/d4e/f63 zero size 2024-04-18T10:42:44.367 INFO:tasks.workunit.client.0.smithi040.stdout:9/366: fsync d2/f82 0 2024-04-18T10:42:44.367 INFO:tasks.workunit.client.0.smithi040.stdout:2/267: getdents dd/d14/d2f 0 2024-04-18T10:42:44.369 INFO:tasks.workunit.client.0.smithi040.stdout:3/333: dwrite d1/d7/d12/f30 [0,4194304] 0 2024-04-18T10:42:44.370 INFO:tasks.workunit.client.0.smithi040.stdout:8/350: write d2/d15/d2b/f57 [904458,57937] 0 2024-04-18T10:42:44.372 INFO:tasks.workunit.client.0.smithi040.stdout:6/336: creat df/d4b/d63/f7c x:0 0 0 2024-04-18T10:42:44.372 INFO:tasks.workunit.client.0.smithi040.stdout:1/328: dwrite d1/f69 [0,4194304] 0 2024-04-18T10:42:44.374 INFO:tasks.workunit.client.0.smithi040.stdout:5/293: truncate d0/f25 3430137 0 2024-04-18T10:42:44.376 INFO:tasks.workunit.client.0.smithi040.stdout:4/346: rename d2/l5 to d2/d3/d4/d1f/d29/d49/l60 0 2024-04-18T10:42:44.378 INFO:tasks.workunit.client.0.smithi040.stdout:9/367: unlink d2/d3/d70/f79 0 2024-04-18T10:42:44.380 INFO:tasks.workunit.client.0.smithi040.stdout:0/347: symlink dd/df/d19/d28/d3a/d42/l7c 0 2024-04-18T10:42:44.382 INFO:tasks.workunit.client.0.smithi040.stdout:6/337: fsync df/d17/f46 0 2024-04-18T10:42:44.383 INFO:tasks.workunit.client.0.smithi040.stdout:7/340: truncate d6/d50/f54 4430357 0 2024-04-18T10:42:44.383 INFO:tasks.workunit.client.0.smithi040.stdout:9/368: read d2/dc/f60 [2790154,94518] 0 2024-04-18T10:42:44.385 INFO:tasks.workunit.client.0.smithi040.stdout:2/268: mknod dd/d14/d44/d4c/d49/c4d 0 2024-04-18T10:42:44.386 INFO:tasks.workunit.client.0.smithi040.stdout:4/347: dread d2/d3/d41/f5d [0,4194304] 0 2024-04-18T10:42:44.387 INFO:tasks.workunit.client.0.smithi040.stdout:8/351: creat d2/d15/d2b/d40/f71 x:0 0 0 2024-04-18T10:42:44.389 INFO:tasks.workunit.client.0.smithi040.stdout:6/338: creat df/d4b/d6e/d3f/d53/f7d x:0 0 0 2024-04-18T10:42:44.390 INFO:tasks.workunit.client.0.smithi040.stdout:0/348: dread dd/df/d4e/f50 [0,4194304] 0 2024-04-18T10:42:44.391 INFO:tasks.workunit.client.0.smithi040.stdout:3/334: rename d1/d2/d4e/d58/d62/c6f to d1/d2/d4e/d58/d62/d6b/c79 0 2024-04-18T10:42:44.393 INFO:tasks.workunit.client.0.smithi040.stdout:2/269: chown dd/d14/d2f/l3c 6 1 2024-04-18T10:42:44.394 INFO:tasks.workunit.client.0.smithi040.stdout:2/270: readlink dd/d14/l18 0 2024-04-18T10:42:44.394 INFO:tasks.workunit.client.0.smithi040.stdout:8/352: mknod d2/d5/d9/d63/c72 0 2024-04-18T10:42:44.395 INFO:tasks.workunit.client.0.smithi040.stdout:8/353: chown d2/d4c/l62 0 1 2024-04-18T10:42:44.396 INFO:tasks.workunit.client.0.smithi040.stdout:6/339: dread df/d4b/d6e/f30 [0,4194304] 0 2024-04-18T10:42:44.400 INFO:tasks.workunit.client.0.smithi040.stdout:7/341: creat d6/d3e/d73/f76 x:0 0 0 2024-04-18T10:42:44.402 INFO:tasks.workunit.client.0.smithi040.stdout:0/349: rmdir dd/df/d19/d28 39 2024-04-18T10:42:44.405 INFO:tasks.workunit.client.0.smithi040.stdout:8/354: symlink d2/d5/d9/d3c/d68/l73 0 2024-04-18T10:42:44.407 INFO:tasks.workunit.client.0.smithi040.stdout:7/342: fdatasync d6/d25/f4a 0 2024-04-18T10:42:44.408 INFO:tasks.workunit.client.0.smithi040.stdout:7/343: chown d6/d3e/d73 6709 1 2024-04-18T10:42:44.409 INFO:tasks.workunit.client.0.smithi040.stdout:0/350: creat dd/df/d4e/f7d x:0 0 0 2024-04-18T10:42:44.410 INFO:tasks.workunit.client.0.smithi040.stdout:8/355: dread d2/d10/d14/f47 [0,4194304] 0 2024-04-18T10:42:44.412 INFO:tasks.workunit.client.0.smithi040.stdout:5/294: dread d0/d3/f13 [0,4194304] 0 2024-04-18T10:42:44.414 INFO:tasks.workunit.client.0.smithi040.stdout:3/335: creat d1/f7a x:0 0 0 2024-04-18T10:42:44.415 INFO:tasks.workunit.client.0.smithi040.stdout:7/344: mknod d6/d50/c77 0 2024-04-18T10:42:44.416 INFO:tasks.workunit.client.0.smithi040.stdout:4/348: getdents d2/d3/d4/d1f/d29/d49 0 2024-04-18T10:42:44.418 INFO:tasks.workunit.client.0.smithi040.stdout:4/349: fsync d2/d3/d4/d21/d28/d3f/f39 0 2024-04-18T10:42:44.419 INFO:tasks.workunit.client.0.smithi040.stdout:8/356: mknod d2/d5/d9/c74 0 2024-04-18T10:42:44.420 INFO:tasks.workunit.client.0.smithi040.stdout:5/295: write d0/d21/f22 [891281,111240] 0 2024-04-18T10:42:44.422 INFO:tasks.workunit.client.0.smithi040.stdout:9/369: link d2/d3/d22/d2e/d35/c4b d2/d3/d22/c87 0 2024-04-18T10:42:44.423 INFO:tasks.workunit.client.0.smithi040.stdout:0/351: dread dd/df/d19/d28/d3a/d42/f59 [0,4194304] 0 2024-04-18T10:42:44.423 INFO:tasks.workunit.client.0.smithi040.stdout:9/370: chown d2/d7/f5a 829350 1 2024-04-18T10:42:44.425 INFO:tasks.workunit.client.0.smithi040.stdout:2/271: link dd/d14/d2b/c3b dd/c4e 0 2024-04-18T10:42:44.425 INFO:tasks.workunit.client.0.smithi040.stdout:2/272: write dd/f36 [99833,12550] 0 2024-04-18T10:42:44.426 INFO:tasks.workunit.client.0.smithi040.stdout:2/273: write dd/f17 [1334267,52450] 0 2024-04-18T10:42:44.427 INFO:tasks.workunit.client.0.smithi040.stdout:2/274: fdatasync dd/d14/d2b/f2e 0 2024-04-18T10:42:44.428 INFO:tasks.workunit.client.0.smithi040.stdout:6/340: getdents df/d4b/d6e/d3f 0 2024-04-18T10:42:44.428 INFO:tasks.workunit.client.0.smithi040.stdout:2/275: read dd/f15 [687625,66932] 0 2024-04-18T10:42:44.430 INFO:tasks.workunit.client.0.smithi040.stdout:8/357: unlink d2/d5/d9/f37 0 2024-04-18T10:42:44.432 INFO:tasks.workunit.client.0.smithi040.stdout:3/336: fsync d1/f4f 0 2024-04-18T10:42:44.433 INFO:tasks.workunit.client.0.smithi040.stdout:9/371: stat d2/d7/f51 0 2024-04-18T10:42:44.434 INFO:tasks.workunit.client.0.smithi040.stdout:9/372: dread - d2/d3/d22/d2e/f7b zero size 2024-04-18T10:42:44.436 INFO:tasks.workunit.client.0.smithi040.stdout:7/345: unlink d6/d25/c1a 0 2024-04-18T10:42:44.437 INFO:tasks.workunit.client.0.smithi040.stdout:0/352: creat dd/df/d19/d3e/f7e x:0 0 0 2024-04-18T10:42:44.439 INFO:tasks.workunit.client.0.smithi040.stdout:6/341: mkdir df/d4b/d7e 0 2024-04-18T10:42:44.441 INFO:tasks.workunit.client.0.smithi040.stdout:2/276: creat dd/d14/d2f/f4f x:0 0 0 2024-04-18T10:42:44.443 INFO:tasks.workunit.client.0.smithi040.stdout:2/277: rename dd/d14 to dd/d14/d50 22 2024-04-18T10:42:44.445 INFO:tasks.workunit.client.0.smithi040.stdout:5/296: dwrite d0/d3/f13 [0,4194304] 0 2024-04-18T10:42:44.447 INFO:tasks.workunit.client.0.smithi040.stdout:3/337: truncate d1/d7/d67/f76 508055 0 2024-04-18T10:42:44.447 INFO:tasks.workunit.client.0.smithi040.stdout:0/353: dwrite dd/df/d19/d28/d3a/f4d [0,4194304] 0 2024-04-18T10:42:44.447 INFO:tasks.workunit.client.0.smithi040.stdout:9/373: truncate d2/d7/f1b 4272116 0 2024-04-18T10:42:44.447 INFO:tasks.workunit.client.0.smithi040.stdout:4/350: link d2/d3/d4/dd/d4f/f5f d2/d3/d4/d1f/d29/d49/d31/f61 0 2024-04-18T10:42:44.450 INFO:tasks.workunit.client.0.smithi040.stdout:0/354: readlink dd/df/d19/d28/l32 0 2024-04-18T10:42:44.450 INFO:tasks.workunit.client.0.smithi040.stdout:5/297: chown d0/d21/f44 1584389 1 2024-04-18T10:42:44.452 INFO:tasks.workunit.client.0.smithi040.stdout:5/298: stat d0/d3/c27 0 2024-04-18T10:42:44.452 INFO:tasks.workunit.client.0.smithi040.stdout:6/342: rmdir df 39 2024-04-18T10:42:44.454 INFO:tasks.workunit.client.0.smithi040.stdout:3/338: mkdir d1/d7/d12/d7b 0 2024-04-18T10:42:44.457 INFO:tasks.workunit.client.0.smithi040.stdout:2/278: dwrite dd/d14/f22 [0,4194304] 0 2024-04-18T10:42:44.461 INFO:tasks.workunit.client.0.smithi040.stdout:4/351: dwrite d2/d3/d4/d1f/d29/d49/f32 [0,4194304] 0 2024-04-18T10:42:44.463 INFO:tasks.workunit.client.0.smithi040.stdout:5/299: dwrite d0/d3/f5 [0,4194304] 0 2024-04-18T10:42:44.467 INFO:tasks.workunit.client.0.smithi040.stdout:0/355: rename dd/df/d19/d28/d3a/f41 to dd/d62/f7f 0 2024-04-18T10:42:44.467 INFO:tasks.workunit.client.0.smithi040.stdout:1/329: sync 2024-04-18T10:42:44.472 INFO:tasks.workunit.client.0.smithi040.stdout:9/374: creat d2/d5b/d6f/d80/d75/f88 x:0 0 0 2024-04-18T10:42:44.473 INFO:tasks.workunit.client.0.smithi040.stdout:9/375: chown d2/d3/f4a 101479880 1 2024-04-18T10:42:44.474 INFO:tasks.workunit.client.0.smithi040.stdout:4/352: read d2/d3/d4/d1f/d29/d49/d31/f61 [1695287,91647] 0 2024-04-18T10:42:44.475 INFO:tasks.workunit.client.0.smithi040.stdout:4/353: chown d2/d3/d4/d1f/l3b 3255972 1 2024-04-18T10:42:44.475 INFO:tasks.workunit.client.0.smithi040.stdout:8/358: link d2/d15/d2b/c33 d2/c75 0 2024-04-18T10:42:44.477 INFO:tasks.workunit.client.0.smithi040.stdout:0/356: rename dd/df/d19/d28/c5a to dd/c80 0 2024-04-18T10:42:44.479 INFO:tasks.workunit.client.0.smithi040.stdout:5/300: creat d0/d3b/d67/f68 x:0 0 0 2024-04-18T10:42:44.479 INFO:tasks.workunit.client.0.smithi040.stdout:0/357: truncate dd/d62/f74 958653 0 2024-04-18T10:42:44.480 INFO:tasks.workunit.client.0.smithi040.stdout:3/339: creat d1/d2/d4e/f7c x:0 0 0 2024-04-18T10:42:44.480 INFO:tasks.workunit.client.0.smithi040.stdout:4/354: dread d2/d3/d4/d21/d28/d3f/f39 [4194304,4194304] 0 2024-04-18T10:42:44.480 INFO:tasks.workunit.client.0.smithi040.stdout:8/359: symlink d2/d5/d9/d63/l76 0 2024-04-18T10:42:44.482 INFO:tasks.workunit.client.0.smithi040.stdout:1/330: rename d1/d1c/d7b/c51 to d1/d1c/d2b/d32/c7c 0 2024-04-18T10:42:44.483 INFO:tasks.workunit.client.0.smithi040.stdout:9/376: symlink d2/d7/l89 0 2024-04-18T10:42:44.484 INFO:tasks.workunit.client.0.smithi040.stdout:6/343: getdents df/d4b/d63 0 2024-04-18T10:42:44.484 INFO:tasks.workunit.client.0.smithi040.stdout:1/331: dread - d1/d1c/d7b/d2d/f6c zero size 2024-04-18T10:42:44.485 INFO:tasks.workunit.client.0.smithi040.stdout:0/358: creat dd/df/d19/d28/d3a/d42/f81 x:0 0 0 2024-04-18T10:42:44.491 INFO:tasks.workunit.client.0.smithi040.stdout:3/340: mknod d1/d7/d28/c7d 0 2024-04-18T10:42:44.492 INFO:tasks.workunit.client.0.smithi040.stdout:7/346: dread d6/d25/d28/d2c/f4d [0,4194304] 0 2024-04-18T10:42:44.492 INFO:tasks.workunit.client.0.smithi040.stdout:4/355: mkdir d2/d3/d41/d62 0 2024-04-18T10:42:44.493 INFO:tasks.workunit.client.0.smithi040.stdout:6/344: write df/d4b/d6e/d3f/f5c [3417173,93339] 0 2024-04-18T10:42:44.493 INFO:tasks.workunit.client.0.smithi040.stdout:5/301: dread d0/f1 [4194304,4194304] 0 2024-04-18T10:42:44.494 INFO:tasks.workunit.client.0.smithi040.stdout:0/359: chown dd/df/d19/l27 111 1 2024-04-18T10:42:44.495 INFO:tasks.workunit.client.0.smithi040.stdout:4/356: fsync d2/d3/d4/d21/f58 0 2024-04-18T10:42:44.495 INFO:tasks.workunit.client.0.smithi040.stdout:8/360: rename d2/d15/d2b/f54 to d2/d15/f77 0 2024-04-18T10:42:44.496 INFO:tasks.workunit.client.0.smithi040.stdout:1/332: creat d1/d1c/d2b/d32/d36/f7d x:0 0 0 2024-04-18T10:42:44.497 INFO:tasks.workunit.client.0.smithi040.stdout:3/341: symlink d1/d2/d4e/d58/d62/d6b/l7e 0 2024-04-18T10:42:44.498 INFO:tasks.workunit.client.0.smithi040.stdout:9/377: rename d2/dc/f60 to d2/d3/d22/d2e/d35/d40/d85/f8a 0 2024-04-18T10:42:44.499 INFO:tasks.workunit.client.0.smithi040.stdout:0/360: symlink dd/df/d19/d28/d3a/d42/l82 0 2024-04-18T10:42:44.501 INFO:tasks.workunit.client.0.smithi040.stdout:8/361: rmdir d2/d15/d2b/d40 39 2024-04-18T10:42:44.501 INFO:tasks.workunit.client.0.smithi040.stdout:6/345: dread df/d17/f1b [0,4194304] 0 2024-04-18T10:42:44.502 INFO:tasks.workunit.client.0.smithi040.stdout:4/357: fsync d2/d3/d4/dd/d4f/f5f 0 2024-04-18T10:42:44.503 INFO:tasks.workunit.client.0.smithi040.stdout:9/378: write d2/d3/d22/d2e/f7b [718714,47830] 0 2024-04-18T10:42:44.503 INFO:tasks.workunit.client.0.smithi040.stdout:3/342: mknod d1/d2/d4e/d57/c7f 0 2024-04-18T10:42:44.505 INFO:tasks.workunit.client.0.smithi040.stdout:6/346: mknod df/d17/c7f 0 2024-04-18T10:42:44.506 INFO:tasks.workunit.client.0.smithi040.stdout:5/302: dwrite d0/d1c/d52/d5d/f60 [0,4194304] 0 2024-04-18T10:42:44.512 INFO:tasks.workunit.client.0.smithi040.stdout:3/343: unlink d1/f7a 0 2024-04-18T10:42:44.513 INFO:tasks.workunit.client.0.smithi040.stdout:5/303: dwrite d0/d21/f22 [0,4194304] 0 2024-04-18T10:42:44.513 INFO:tasks.workunit.client.0.smithi040.stdout:2/279: write dd/f28 [128213,94197] 0 2024-04-18T10:42:44.514 INFO:tasks.workunit.client.0.smithi040.stdout:9/379: chown d2/d7/f15 7359361 1 2024-04-18T10:42:44.515 INFO:tasks.workunit.client.0.smithi040.stdout:4/358: creat d2/d3/d4/d23/f63 x:0 0 0 2024-04-18T10:42:44.516 INFO:tasks.workunit.client.0.smithi040.stdout:8/362: truncate d2/d5/d9/f29 1265228 0 2024-04-18T10:42:44.517 INFO:tasks.workunit.client.0.smithi040.stdout:6/347: creat df/d76/f80 x:0 0 0 2024-04-18T10:42:44.519 INFO:tasks.workunit.client.0.smithi040.stdout:6/348: write df/d76/f78 [791451,27395] 0 2024-04-18T10:42:44.520 INFO:tasks.workunit.client.0.smithi040.stdout:6/349: stat df/d4b/c4e 0 2024-04-18T10:42:44.520 INFO:tasks.workunit.client.0.smithi040.stdout:9/380: dwrite d2/d3/f65 [0,4194304] 0 2024-04-18T10:42:44.526 INFO:tasks.workunit.client.0.smithi040.stdout:9/381: dread d2/d3/f65 [0,4194304] 0 2024-04-18T10:42:44.527 INFO:tasks.workunit.client.0.smithi040.stdout:7/347: dwrite d6/d25/d28/d2c/d2d/f57 [0,4194304] 0 2024-04-18T10:42:44.528 INFO:tasks.workunit.client.0.smithi040.stdout:2/280: unlink dd/l26 0 2024-04-18T10:42:44.533 INFO:tasks.workunit.client.0.smithi040.stdout:5/304: creat d0/d1c/d52/d5d/f69 x:0 0 0 2024-04-18T10:42:44.534 INFO:tasks.workunit.client.0.smithi040.stdout:9/382: dwrite d2/d3/d70/f81 [0,4194304] 0 2024-04-18T10:42:44.534 INFO:tasks.workunit.client.0.smithi040.stdout:4/359: creat d2/d3/d4/d1f/d29/f64 x:0 0 0 2024-04-18T10:42:44.535 INFO:tasks.workunit.client.0.smithi040.stdout:7/348: dread d6/d25/d28/d2c/d2d/f57 [0,4194304] 0 2024-04-18T10:42:44.536 INFO:tasks.workunit.client.0.smithi040.stdout:5/305: chown d0/d3/d47/f4a 5578119 1 2024-04-18T10:42:44.537 INFO:tasks.workunit.client.0.smithi040.stdout:9/383: fsync d2/d5b/d6f/d80/d75/f88 0 2024-04-18T10:42:44.537 INFO:tasks.workunit.client.0.smithi040.stdout:4/360: write d2/d3/d4/dd/f48 [40181,11687] 0 2024-04-18T10:42:44.538 INFO:tasks.workunit.client.0.smithi040.stdout:9/384: fsync d2/d3/f4a 0 2024-04-18T10:42:44.539 INFO:tasks.workunit.client.0.smithi040.stdout:6/350: creat df/d4b/d6e/d3f/d53/f81 x:0 0 0 2024-04-18T10:42:44.541 INFO:tasks.workunit.client.0.smithi040.stdout:0/361: getdents dd/df/d4e 0 2024-04-18T10:42:44.542 INFO:tasks.workunit.client.0.smithi040.stdout:3/344: mknod d1/d2/c80 0 2024-04-18T10:42:44.542 INFO:tasks.workunit.client.0.smithi040.stdout:0/362: readlink dd/df/d19/l7b 0 2024-04-18T10:42:44.543 INFO:tasks.workunit.client.0.smithi040.stdout:5/306: dwrite d0/d3/f13 [0,4194304] 0 2024-04-18T10:42:44.545 INFO:tasks.workunit.client.0.smithi040.stdout:2/281: unlink dd/d14/d2f/f41 0 2024-04-18T10:42:44.548 INFO:tasks.workunit.client.0.smithi040.stdout:8/363: mkdir d2/d15/d78 0 2024-04-18T10:42:44.548 INFO:tasks.workunit.client.0.smithi040.stdout:3/345: dwrite d1/d2/f31 [0,4194304] 0 2024-04-18T10:42:44.549 INFO:tasks.workunit.client.0.smithi040.stdout:7/349: write d6/d25/f46 [1141298,98464] 0 2024-04-18T10:42:44.551 INFO:tasks.workunit.client.0.smithi040.stdout:9/385: rmdir d2/d3/d70 39 2024-04-18T10:42:44.552 INFO:tasks.workunit.client.0.smithi040.stdout:9/386: chown d2/d5b/l57 1931102 1 2024-04-18T10:42:44.554 INFO:tasks.workunit.client.0.smithi040.stdout:6/351: unlink f7 0 2024-04-18T10:42:44.555 INFO:tasks.workunit.client.0.smithi040.stdout:6/352: write df/d4b/d6e/f33 [4990852,5615] 0 2024-04-18T10:42:44.556 INFO:tasks.workunit.client.0.smithi040.stdout:9/387: dread d2/d3/f12 [0,4194304] 0 2024-04-18T10:42:44.556 INFO:tasks.workunit.client.0.smithi040.stdout:4/361: rename d2/d3/d41/f5d to d2/d3/d4/d1f/d29/d49/f65 0 2024-04-18T10:42:44.559 INFO:tasks.workunit.client.0.smithi040.stdout:0/363: rmdir dd/d62 39 2024-04-18T10:42:44.563 INFO:tasks.workunit.client.0.smithi040.stdout:2/282: mknod dd/d14/d2b/c51 0 2024-04-18T10:42:44.565 INFO:tasks.workunit.client.0.smithi040.stdout:7/350: chown d6/d25/f3f 5 1 2024-04-18T10:42:44.567 INFO:tasks.workunit.client.0.smithi040.stdout:6/353: symlink df/d4b/d6e/d3f/d53/l82 0 2024-04-18T10:42:44.567 INFO:tasks.workunit.client.0.smithi040.stdout:7/351: readlink d6/d25/d28/d2c/d2d/d47/l68 0 2024-04-18T10:42:44.568 INFO:tasks.workunit.client.0.smithi040.stdout:5/307: dwrite d0/d1c/f5a [0,4194304] 0 2024-04-18T10:42:44.568 INFO:tasks.workunit.client.0.smithi040.stdout:9/388: rmdir d2/d5b/d6f/d80/d75 39 2024-04-18T10:42:44.568 INFO:tasks.workunit.client.0.smithi040.stdout:6/354: write df/f67 [720011,34055] 0 2024-04-18T10:42:44.570 INFO:tasks.workunit.client.0.smithi040.stdout:2/283: mkdir dd/d14/d44/d4c/d52 0 2024-04-18T10:42:44.570 INFO:tasks.workunit.client.0.smithi040.stdout:5/308: chown d0/d3b/l3c 202213 1 2024-04-18T10:42:44.571 INFO:tasks.workunit.client.0.smithi040.stdout:2/284: write dd/f17 [820678,131010] 0 2024-04-18T10:42:44.574 INFO:tasks.workunit.client.0.smithi040.stdout:7/352: creat d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d63/f78 x:0 0 0 2024-04-18T10:42:44.576 INFO:tasks.workunit.client.0.smithi040.stdout:9/389: creat d2/d5b/d6f/d80/f8b x:0 0 0 2024-04-18T10:42:44.578 INFO:tasks.workunit.client.0.smithi040.stdout:2/285: rename dd/d14/d2f/l30 to dd/d14/d44/d4c/d49/l53 0 2024-04-18T10:42:44.579 INFO:tasks.workunit.client.0.smithi040.stdout:1/333: truncate d1/d1c/d7b/d2e/d39/f46 1798269 0 2024-04-18T10:42:44.581 INFO:tasks.workunit.client.0.smithi040.stdout:7/353: dwrite d6/f1f [0,4194304] 0 2024-04-18T10:42:44.583 INFO:tasks.workunit.client.0.smithi040.stdout:7/354: dread - d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d63/f78 zero size 2024-04-18T10:42:44.583 INFO:tasks.workunit.client.0.smithi040.stdout:9/390: write d2/d3/d70/f74 [212873,8180] 0 2024-04-18T10:42:44.584 INFO:tasks.workunit.client.0.smithi040.stdout:5/309: link d0/l26 d0/d4e/l6a 0 2024-04-18T10:42:44.584 INFO:tasks.workunit.client.0.smithi040.stdout:7/355: chown d6/d25/d28 7805476 1 2024-04-18T10:42:44.584 INFO:tasks.workunit.client.0.smithi040.stdout:7/356: fsync d6/f44 0 2024-04-18T10:42:44.585 INFO:tasks.workunit.client.0.smithi040.stdout:1/334: mkdir d1/d1c/d2b/d32/d7e 0 2024-04-18T10:42:44.586 INFO:tasks.workunit.client.0.smithi040.stdout:2/286: mkdir dd/d14/d4a/d54 0 2024-04-18T10:42:44.587 INFO:tasks.workunit.client.0.smithi040.stdout:6/355: dread df/f2d [0,4194304] 0 2024-04-18T10:42:44.588 INFO:tasks.workunit.client.0.smithi040.stdout:9/391: truncate d2/d3/d22/f3c 1020507 0 2024-04-18T10:42:44.590 INFO:tasks.workunit.client.0.smithi040.stdout:5/310: mkdir d0/d3/d6b 0 2024-04-18T10:42:44.591 INFO:tasks.workunit.client.0.smithi040.stdout:5/311: readlink d0/d3b/d3f/l54 0 2024-04-18T10:42:44.592 INFO:tasks.workunit.client.0.smithi040.stdout:5/312: readlink d0/d3/l37 0 2024-04-18T10:42:44.595 INFO:tasks.workunit.client.0.smithi040.stdout:7/357: getdents d6/d25/d28/d2c/d2d/d47/d5c/d6b 0 2024-04-18T10:42:44.595 INFO:tasks.workunit.client.0.smithi040.stdout:2/287: chown dd/d14/l42 222 1 2024-04-18T10:42:44.595 INFO:tasks.workunit.client.0.smithi040.stdout:6/356: dwrite df/f2d [0,4194304] 0 2024-04-18T10:42:44.599 INFO:tasks.workunit.client.0.smithi040.stdout:1/335: creat d1/f7f x:0 0 0 2024-04-18T10:42:44.600 INFO:tasks.workunit.client.0.smithi040.stdout:7/358: mkdir d6/d50/d79 0 2024-04-18T10:42:44.601 INFO:tasks.workunit.client.0.smithi040.stdout:3/346: write d1/f4f [214045,94144] 0 2024-04-18T10:42:44.602 INFO:tasks.workunit.client.0.smithi040.stdout:5/313: getdents d0/d3/d6b 0 2024-04-18T10:42:44.602 INFO:tasks.workunit.client.0.smithi040.stdout:9/392: dread d2/d3/d22/f3a [0,4194304] 0 2024-04-18T10:42:44.604 INFO:tasks.workunit.client.0.smithi040.stdout:5/314: read d0/d3/f5 [1185126,101762] 0 2024-04-18T10:42:44.605 INFO:tasks.workunit.client.0.smithi040.stdout:2/288: dwrite dd/d14/f47 [0,4194304] 0 2024-04-18T10:42:44.606 INFO:tasks.workunit.client.0.smithi040.stdout:0/364: truncate dd/df/f1e 7321769 0 2024-04-18T10:42:44.607 INFO:tasks.workunit.client.0.smithi040.stdout:2/289: write dd/d14/f22 [1768750,115602] 0 2024-04-18T10:42:44.611 INFO:tasks.workunit.client.0.smithi040.stdout:9/393: dread d2/d7/fa [0,4194304] 0 2024-04-18T10:42:44.612 INFO:tasks.workunit.client.0.smithi040.stdout:6/357: getdents df/d4b 0 2024-04-18T10:42:44.613 INFO:tasks.workunit.client.0.smithi040.stdout:9/394: chown d2/d3/d22/f3a 7330 1 2024-04-18T10:42:44.613 INFO:tasks.workunit.client.0.smithi040.stdout:6/358: chown df/d17/f1b 30 1 2024-04-18T10:42:44.615 INFO:tasks.workunit.client.0.smithi040.stdout:7/359: creat d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/f7a x:0 0 0 2024-04-18T10:42:44.616 INFO:tasks.workunit.client.0.smithi040.stdout:5/315: creat d0/d21/d42/f6c x:0 0 0 2024-04-18T10:42:44.620 INFO:tasks.workunit.client.0.smithi040.stdout:0/365: readlink dd/df/d19/d28/d3a/d46/l6f 0 2024-04-18T10:42:44.625 INFO:tasks.workunit.client.0.smithi040.stdout:2/290: creat dd/d14/d4a/d54/f55 x:0 0 0 2024-04-18T10:42:44.630 INFO:tasks.workunit.client.0.smithi040.stdout:6/359: link df/d4b/d6e/f24 df/d4b/d7e/f83 0 2024-04-18T10:42:44.631 INFO:tasks.workunit.client.0.smithi040.stdout:7/360: symlink d6/l7b 0 2024-04-18T10:42:44.632 INFO:tasks.workunit.client.0.smithi040.stdout:3/347: write d1/d2/d16/d18/f65 [425567,10631] 0 2024-04-18T10:42:44.633 INFO:tasks.workunit.client.0.smithi040.stdout:2/291: readlink dd/d14/d2b/l32 0 2024-04-18T10:42:44.636 INFO:tasks.workunit.client.0.smithi040.stdout:6/360: creat df/d76/f84 x:0 0 0 2024-04-18T10:42:44.636 INFO:tasks.workunit.client.0.smithi040.stdout:1/336: dread d1/d1c/d2b/d32/d36/f6b [0,4194304] 0 2024-04-18T10:42:44.636 INFO:tasks.workunit.client.0.smithi040.stdout:8/364: sync 2024-04-18T10:42:44.636 INFO:tasks.workunit.client.0.smithi040.stdout:4/362: sync 2024-04-18T10:42:44.639 INFO:tasks.workunit.client.0.smithi040.stdout:8/365: write d2/f5b [668811,49012] 0 2024-04-18T10:42:44.639 INFO:tasks.workunit.client.0.smithi040.stdout:6/361: write df/d17/f31 [482021,29469] 0 2024-04-18T10:42:44.640 INFO:tasks.workunit.client.0.smithi040.stdout:7/361: dwrite d6/f14 [8388608,4194304] 0 2024-04-18T10:42:44.641 INFO:tasks.workunit.client.0.smithi040.stdout:0/366: rename dd/c1f to dd/df/c83 0 2024-04-18T10:42:44.642 INFO:tasks.workunit.client.0.smithi040.stdout:9/395: write d2/d3/d22/d2e/d35/f4c [146021,81795] 0 2024-04-18T10:42:44.642 INFO:tasks.workunit.client.0.smithi040.stdout:2/292: truncate dd/f15 3547086 0 2024-04-18T10:42:44.642 INFO:tasks.workunit.client.0.smithi040.stdout:5/316: link d0/d3b/d3f/c63 d0/d21/d42/c6d 0 2024-04-18T10:42:44.643 INFO:tasks.workunit.client.0.smithi040.stdout:2/293: fsync dd/f28 0 2024-04-18T10:42:44.643 INFO:tasks.workunit.client.0.smithi040.stdout:4/363: creat d2/d3/d4/d1f/f66 x:0 0 0 2024-04-18T10:42:44.644 INFO:tasks.workunit.client.0.smithi040.stdout:1/337: symlink d1/d1c/d7b/d3f/l80 0 2024-04-18T10:42:44.645 INFO:tasks.workunit.client.0.smithi040.stdout:8/366: mkdir d2/d22/d49/d79 0 2024-04-18T10:42:44.647 INFO:tasks.workunit.client.0.smithi040.stdout:6/362: write df/d4b/d6e/f24 [783502,18355] 0 2024-04-18T10:42:44.650 INFO:tasks.workunit.client.0.smithi040.stdout:9/396: chown d2/d7/f29 21656664 1 2024-04-18T10:42:44.651 INFO:tasks.workunit.client.0.smithi040.stdout:1/338: mknod d1/d1c/c81 0 2024-04-18T10:42:44.652 INFO:tasks.workunit.client.0.smithi040.stdout:8/367: creat d2/d5/d9/d3c/d68/f7a x:0 0 0 2024-04-18T10:42:44.653 INFO:tasks.workunit.client.0.smithi040.stdout:6/363: mknod df/d76/c85 0 2024-04-18T10:42:44.654 INFO:tasks.workunit.client.0.smithi040.stdout:5/317: dwrite d0/d3/f1a [0,4194304] 0 2024-04-18T10:42:44.655 INFO:tasks.workunit.client.0.smithi040.stdout:2/294: dwrite dd/f17 [0,4194304] 0 2024-04-18T10:42:44.662 INFO:tasks.workunit.client.0.smithi040.stdout:5/318: dread d0/d3/f7 [0,4194304] 0 2024-04-18T10:42:44.665 INFO:tasks.workunit.client.0.smithi040.stdout:2/295: dwrite dd/d14/d2f/f4f [0,4194304] 0 2024-04-18T10:42:44.666 INFO:tasks.workunit.client.0.smithi040.stdout:2/296: chown dd/d14/d2b/f2e 11468533 1 2024-04-18T10:42:44.671 INFO:tasks.workunit.client.0.smithi040.stdout:1/339: link d1/c8 d1/d1c/d2b/d32/d35/c82 0 2024-04-18T10:42:44.671 INFO:tasks.workunit.client.0.smithi040.stdout:2/297: dwrite dd/d14/d2f/f4f [0,4194304] 0 2024-04-18T10:42:44.672 INFO:tasks.workunit.client.0.smithi040.stdout:1/340: chown d1/d16/l3d 3425465 1 2024-04-18T10:42:44.674 INFO:tasks.workunit.client.0.smithi040.stdout:9/397: rename d2/d3/d22/d2e/d35/d40/d85/f8a to d2/d3/f8c 0 2024-04-18T10:42:44.674 INFO:tasks.workunit.client.0.smithi040.stdout:1/341: write d1/d1c/d2b/d32/d36/d4d/f62 [1071986,59454] 0 2024-04-18T10:42:44.676 INFO:tasks.workunit.client.0.smithi040.stdout:8/368: getdents d2/d10/d6a 0 2024-04-18T10:42:44.681 INFO:tasks.workunit.client.0.smithi040.stdout:2/298: creat dd/f56 x:0 0 0 2024-04-18T10:42:44.682 INFO:tasks.workunit.client.0.smithi040.stdout:5/319: getdents d0/d1c/d52/d5d 0 2024-04-18T10:42:44.684 INFO:tasks.workunit.client.0.smithi040.stdout:3/348: sync 2024-04-18T10:42:44.686 INFO:tasks.workunit.client.0.smithi040.stdout:7/362: dread d6/d50/f54 [0,4194304] 0 2024-04-18T10:42:44.686 INFO:tasks.workunit.client.0.smithi040.stdout:0/367: dwrite dd/df/f2b [0,4194304] 0 2024-04-18T10:42:44.686 INFO:tasks.workunit.client.0.smithi040.stdout:8/369: truncate d2/d5/d9/f29 868431 0 2024-04-18T10:42:44.688 INFO:tasks.workunit.client.0.smithi040.stdout:1/342: dwrite d1/fa [0,4194304] 0 2024-04-18T10:42:44.691 INFO:tasks.workunit.client.0.smithi040.stdout:4/364: write d2/d3/d4/dd/f22 [2807753,37888] 0 2024-04-18T10:42:44.692 INFO:tasks.workunit.client.0.smithi040.stdout:7/363: readlink d6/d25/d28/d2c/d2d/l2e 0 2024-04-18T10:42:44.692 INFO:tasks.workunit.client.0.smithi040.stdout:9/398: dread d2/f55 [0,4194304] 0 2024-04-18T10:42:44.695 INFO:tasks.workunit.client.0.smithi040.stdout:8/370: fsync d2/d15/d2b/d40/f71 0 2024-04-18T10:42:44.695 INFO:tasks.workunit.client.0.smithi040.stdout:4/365: dread - d2/d3/d4/dd/f44 zero size 2024-04-18T10:42:44.695 INFO:tasks.workunit.client.0.smithi040.stdout:9/399: fsync d2/dd/de/f6c 0 2024-04-18T10:42:44.698 INFO:tasks.workunit.client.0.smithi040.stdout:3/349: dwrite d1/d7/d12/f22 [4194304,4194304] 0 2024-04-18T10:42:44.698 INFO:tasks.workunit.client.0.smithi040.stdout:5/320: link d0/d3/c18 d0/d4e/c6e 0 2024-04-18T10:42:44.699 INFO:tasks.workunit.client.0.smithi040.stdout:6/364: truncate df/d4b/d6e/f28 1701829 0 2024-04-18T10:42:44.706 INFO:tasks.workunit.client.0.smithi040.stdout:8/371: creat d2/d5/d9/d3c/d5a/f7b x:0 0 0 2024-04-18T10:42:44.708 INFO:tasks.workunit.client.0.smithi040.stdout:7/364: dread d6/d25/f3f [0,4194304] 0 2024-04-18T10:42:44.708 INFO:tasks.workunit.client.0.smithi040.stdout:5/321: creat d0/d3b/d3f/f6f x:0 0 0 2024-04-18T10:42:44.709 INFO:tasks.workunit.client.0.smithi040.stdout:3/350: mkdir d1/d7/d28/d81 0 2024-04-18T10:42:44.710 INFO:tasks.workunit.client.0.smithi040.stdout:3/351: readlink d1/d7/d28/l54 0 2024-04-18T10:42:44.710 INFO:tasks.workunit.client.0.smithi040.stdout:6/365: write df/f55 [466007,64692] 0 2024-04-18T10:42:44.712 INFO:tasks.workunit.client.0.smithi040.stdout:1/343: creat d1/d1c/d7b/f83 x:0 0 0 2024-04-18T10:42:44.713 INFO:tasks.workunit.client.0.smithi040.stdout:0/368: rename dd/df/d19/c6a to dd/c84 0 2024-04-18T10:42:44.715 INFO:tasks.workunit.client.0.smithi040.stdout:9/400: mkdir d2/dc/d46/d44/d8d 0 2024-04-18T10:42:44.716 INFO:tasks.workunit.client.0.smithi040.stdout:8/372: symlink d2/d22/d49/d79/l7c 0 2024-04-18T10:42:44.717 INFO:tasks.workunit.client.0.smithi040.stdout:8/373: write d2/d10/d6a/f70 [1046049,5027] 0 2024-04-18T10:42:44.718 INFO:tasks.workunit.client.0.smithi040.stdout:7/365: rename d6/l2b to d6/d50/l7c 0 2024-04-18T10:42:44.718 INFO:tasks.workunit.client.0.smithi040.stdout:8/374: write d2/f2a [4331993,22983] 0 2024-04-18T10:42:44.719 INFO:tasks.workunit.client.0.smithi040.stdout:1/344: mkdir d1/d1c/d7b/d3f/d75/d84 0 2024-04-18T10:42:44.720 INFO:tasks.workunit.client.0.smithi040.stdout:8/375: fdatasync d2/d15/d2b/d40/f71 0 2024-04-18T10:42:44.721 INFO:tasks.workunit.client.0.smithi040.stdout:0/369: creat dd/df/d19/d3e/d77/f85 x:0 0 0 2024-04-18T10:42:44.721 INFO:tasks.workunit.client.0.smithi040.stdout:8/376: write d2/f2a [3371420,79482] 0 2024-04-18T10:42:44.722 INFO:tasks.workunit.client.0.smithi040.stdout:0/370: dread - dd/f6b zero size 2024-04-18T10:42:44.722 INFO:tasks.workunit.client.0.smithi040.stdout:7/366: creat d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/f7d x:0 0 0 2024-04-18T10:42:44.725 INFO:tasks.workunit.client.0.smithi040.stdout:6/366: rename df/l34 to df/l86 0 2024-04-18T10:42:44.734 INFO:tasks.workunit.client.0.smithi040.stdout:2/299: truncate dd/d14/f22 3014574 0 2024-04-18T10:42:44.735 INFO:tasks.workunit.client.0.smithi040.stdout:1/345: dwrite d1/d1c/d2b/d32/d36/d4d/f62 [0,4194304] 0 2024-04-18T10:42:44.735 INFO:tasks.workunit.client.0.smithi040.stdout:6/367: rename df/d17/f61 to df/d4b/f87 0 2024-04-18T10:42:44.735 INFO:tasks.workunit.client.0.smithi040.stdout:9/401: dread d2/d3/d22/d2e/d35/f4c [0,4194304] 0 2024-04-18T10:42:44.736 INFO:tasks.workunit.client.0.smithi040.stdout:6/368: stat df/d76 0 2024-04-18T10:42:44.737 INFO:tasks.workunit.client.0.smithi040.stdout:8/377: dwrite d2/d15/d2b/d40/f71 [0,4194304] 0 2024-04-18T10:42:44.738 INFO:tasks.workunit.client.0.smithi040.stdout:1/346: truncate d1/f77 664252 0 2024-04-18T10:42:44.741 INFO:tasks.workunit.client.0.smithi040.stdout:7/367: dwrite d6/d25/d28/d2c/d2d/d47/f48 [0,4194304] 0 2024-04-18T10:42:44.743 INFO:tasks.workunit.client.0.smithi040.stdout:2/300: dread dd/d14/f47 [0,4194304] 0 2024-04-18T10:42:44.744 INFO:tasks.workunit.client.0.smithi040.stdout:3/352: dread d1/d2/f17 [0,4194304] 0 2024-04-18T10:42:44.746 INFO:tasks.workunit.client.0.smithi040.stdout:4/366: dread d2/d3/d4/d1f/d29/d49/f42 [0,4194304] 0 2024-04-18T10:42:44.746 INFO:tasks.workunit.client.0.smithi040.stdout:5/322: write d0/d3/f2b [1821651,91698] 0 2024-04-18T10:42:44.747 INFO:tasks.workunit.client.0.smithi040.stdout:5/323: dread - d0/d3b/d3f/f40 zero size 2024-04-18T10:42:44.748 INFO:tasks.workunit.client.0.smithi040.stdout:9/402: symlink d2/dc/d46/d44/l8e 0 2024-04-18T10:42:44.748 INFO:tasks.workunit.client.0.smithi040.stdout:5/324: write d0/d1c/f53 [1037883,42945] 0 2024-04-18T10:42:44.749 INFO:tasks.workunit.client.0.smithi040.stdout:5/325: fdatasync d0/f2d 0 2024-04-18T10:42:44.750 INFO:tasks.workunit.client.0.smithi040.stdout:8/378: write d2/d15/f77 [798995,124600] 0 2024-04-18T10:42:44.750 INFO:tasks.workunit.client.0.smithi040.stdout:4/367: dread d2/f26 [0,4194304] 0 2024-04-18T10:42:44.751 INFO:tasks.workunit.client.0.smithi040.stdout:1/347: mkdir d1/d1c/d7b/d2e/d3e/d85 0 2024-04-18T10:42:44.757 INFO:tasks.workunit.client.0.smithi040.stdout:2/301: creat dd/d14/d2f/d37/d38/f57 x:0 0 0 2024-04-18T10:42:44.758 INFO:tasks.workunit.client.0.smithi040.stdout:3/353: creat d1/d7/d26/f82 x:0 0 0 2024-04-18T10:42:44.761 INFO:tasks.workunit.client.0.smithi040.stdout:5/326: rmdir d0/d3b/d3f 39 2024-04-18T10:42:44.763 INFO:tasks.workunit.client.0.smithi040.stdout:8/379: write d2/d5/d9/d3c/d5a/f27 [413368,96861] 0 2024-04-18T10:42:44.764 INFO:tasks.workunit.client.0.smithi040.stdout:8/380: write d2/d2c/f3b [584598,68356] 0 2024-04-18T10:42:44.767 INFO:tasks.workunit.client.0.smithi040.stdout:2/302: symlink dd/d14/d44/d4c/d49/l58 0 2024-04-18T10:42:44.769 INFO:tasks.workunit.client.0.smithi040.stdout:3/354: chown d1/l11 231096 1 2024-04-18T10:42:44.771 INFO:tasks.workunit.client.0.smithi040.stdout:8/381: dwrite d2/d5/d9/d3c/d5a/f7b [0,4194304] 0 2024-04-18T10:42:44.772 INFO:tasks.workunit.client.0.smithi040.stdout:5/327: mkdir d0/d21/d42/d70 0 2024-04-18T10:42:44.773 INFO:tasks.workunit.client.0.smithi040.stdout:4/368: getdents d2/d1a 0 2024-04-18T10:42:44.778 INFO:tasks.workunit.client.0.smithi040.stdout:2/303: rmdir dd/d14/d44/d4c/d49 39 2024-04-18T10:42:44.779 INFO:tasks.workunit.client.0.smithi040.stdout:5/328: symlink d0/d21/l71 0 2024-04-18T10:42:44.780 INFO:tasks.workunit.client.0.smithi040.stdout:6/369: dread df/f60 [0,4194304] 0 2024-04-18T10:42:44.780 INFO:tasks.workunit.client.0.smithi040.stdout:8/382: dwrite d2/d5/d9/d3c/d68/f7a [0,4194304] 0 2024-04-18T10:42:44.781 INFO:tasks.workunit.client.0.smithi040.stdout:0/371: truncate dd/d62/f76 631597 0 2024-04-18T10:42:44.783 INFO:tasks.workunit.client.0.smithi040.stdout:0/372: dread - dd/df/d19/d28/f68 zero size 2024-04-18T10:42:44.783 INFO:tasks.workunit.client.0.smithi040.stdout:4/369: dwrite d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:44.784 INFO:tasks.workunit.client.0.smithi040.stdout:1/348: getdents d1/d1c/d7b/d3f 0 2024-04-18T10:42:44.786 INFO:tasks.workunit.client.0.smithi040.stdout:0/373: fdatasync dd/df/d4e/f50 0 2024-04-18T10:42:44.787 INFO:tasks.workunit.client.0.smithi040.stdout:5/329: mkdir d0/d3b/d3f/d72 0 2024-04-18T10:42:44.790 INFO:tasks.workunit.client.0.smithi040.stdout:0/374: dread - dd/df/d19/d3e/d77/f85 zero size 2024-04-18T10:42:44.790 INFO:tasks.workunit.client.0.smithi040.stdout:4/370: read d2/d3/d4/dd/f48 [21323,127849] 0 2024-04-18T10:42:44.790 INFO:tasks.workunit.client.0.smithi040.stdout:5/330: fdatasync d0/d1c/d52/d5d/f60 0 2024-04-18T10:42:44.790 INFO:tasks.workunit.client.0.smithi040.stdout:1/349: creat d1/d1c/d2b/d32/d35/f86 x:0 0 0 2024-04-18T10:42:44.791 INFO:tasks.workunit.client.0.smithi040.stdout:8/383: dwrite d2/d10/d6a/f70 [0,4194304] 0 2024-04-18T10:42:44.793 INFO:tasks.workunit.client.0.smithi040.stdout:5/331: dread - d0/d3b/d67/f68 zero size 2024-04-18T10:42:44.793 INFO:tasks.workunit.client.0.smithi040.stdout:1/350: dread - d1/d1c/d7b/f83 zero size 2024-04-18T10:42:44.795 INFO:tasks.workunit.client.0.smithi040.stdout:4/371: unlink d2/l20 0 2024-04-18T10:42:44.797 INFO:tasks.workunit.client.0.smithi040.stdout:7/368: truncate d6/d25/d28/d2c/d3c/f49 579282 0 2024-04-18T10:42:44.799 INFO:tasks.workunit.client.0.smithi040.stdout:9/403: truncate d2/d3/f21 3432725 0 2024-04-18T10:42:44.799 INFO:tasks.workunit.client.0.smithi040.stdout:8/384: mknod d2/d10/d14/c7d 0 2024-04-18T10:42:44.801 INFO:tasks.workunit.client.0.smithi040.stdout:4/372: unlink d2/d3/f38 0 2024-04-18T10:42:44.803 INFO:tasks.workunit.client.0.smithi040.stdout:8/385: dread - d2/d5/d9/d3c/f52 zero size 2024-04-18T10:42:44.804 INFO:tasks.workunit.client.0.smithi040.stdout:7/369: write d6/d25/d28/d2c/d2d/d47/f72 [747385,38910] 0 2024-04-18T10:42:44.805 INFO:tasks.workunit.client.0.smithi040.stdout:5/332: dwrite d0/d3/f36 [0,4194304] 0 2024-04-18T10:42:44.806 INFO:tasks.workunit.client.0.smithi040.stdout:0/375: dwrite dd/df/d19/d28/d3a/d46/f5d [0,4194304] 0 2024-04-18T10:42:44.806 INFO:tasks.workunit.client.0.smithi040.stdout:9/404: chown d2/d7/l23 1024151 1 2024-04-18T10:42:44.807 INFO:tasks.workunit.client.0.smithi040.stdout:0/376: readlink dd/df/d19/l27 0 2024-04-18T10:42:44.809 INFO:tasks.workunit.client.0.smithi040.stdout:5/333: write d0/d21/f44 [3815971,130653] 0 2024-04-18T10:42:44.809 INFO:tasks.workunit.client.0.smithi040.stdout:9/405: creat d2/d3/d70/f8f x:0 0 0 2024-04-18T10:42:44.811 INFO:tasks.workunit.client.0.smithi040.stdout:7/370: mkdir d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d64/d7e 0 2024-04-18T10:42:44.812 INFO:tasks.workunit.client.0.smithi040.stdout:8/386: truncate d2/d10/f26 1292086 0 2024-04-18T10:42:44.812 INFO:tasks.workunit.client.0.smithi040.stdout:4/373: dread d2/d3/d4/d1f/d29/d49/f42 [0,4194304] 0 2024-04-18T10:42:44.813 INFO:tasks.workunit.client.0.smithi040.stdout:7/371: read - d6/d25/d28/d2c/d2d/d47/f59 zero size 2024-04-18T10:42:44.813 INFO:tasks.workunit.client.0.smithi040.stdout:5/334: creat d0/d3b/d67/f73 x:0 0 0 2024-04-18T10:42:44.814 INFO:tasks.workunit.client.0.smithi040.stdout:0/377: truncate dd/df/d19/d28/d3a/d42/f52 696658 0 2024-04-18T10:42:44.815 INFO:tasks.workunit.client.0.smithi040.stdout:5/335: mknod d0/d1c/d52/c74 0 2024-04-18T10:42:44.816 INFO:tasks.workunit.client.0.smithi040.stdout:0/378: stat dd/df/d19/d28/d3a/f64 0 2024-04-18T10:42:44.816 INFO:tasks.workunit.client.0.smithi040.stdout:7/372: write d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/f7d [536992,4126] 0 2024-04-18T10:42:44.819 INFO:tasks.workunit.client.0.smithi040.stdout:4/374: rename d2/d3/l2d to d2/d3/d4/d1f/d29/l67 0 2024-04-18T10:42:44.820 INFO:tasks.workunit.client.0.smithi040.stdout:9/406: getdents d2/dc/d46 0 2024-04-18T10:42:44.820 INFO:tasks.workunit.client.0.smithi040.stdout:5/336: creat d0/d1c/f75 x:0 0 0 2024-04-18T10:42:44.820 INFO:tasks.workunit.client.0.smithi040.stdout:7/373: readlink d6/d25/l23 0 2024-04-18T10:42:44.820 INFO:tasks.workunit.client.0.smithi040.stdout:0/379: rmdir dd/df/d19/d28/d3a 39 2024-04-18T10:42:44.821 INFO:tasks.workunit.client.0.smithi040.stdout:5/337: chown d0/d21/d42/f55 502 1 2024-04-18T10:42:44.822 INFO:tasks.workunit.client.0.smithi040.stdout:4/375: creat d2/d3/f68 x:0 0 0 2024-04-18T10:42:44.824 INFO:tasks.workunit.client.0.smithi040.stdout:0/380: symlink dd/df/d19/d28/d3a/l86 0 2024-04-18T10:42:44.824 INFO:tasks.workunit.client.0.smithi040.stdout:9/407: truncate d2/d3/d22/d2e/d35/d40/d71/f78 501034 0 2024-04-18T10:42:44.825 INFO:tasks.workunit.client.0.smithi040.stdout:4/376: creat d2/d3/d4/dd/f69 x:0 0 0 2024-04-18T10:42:44.826 INFO:tasks.workunit.client.0.smithi040.stdout:7/374: symlink d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d64/d7e/l7f 0 2024-04-18T10:42:44.827 INFO:tasks.workunit.client.0.smithi040.stdout:9/408: write d2/dc/f1a [251035,130756] 0 2024-04-18T10:42:44.827 INFO:tasks.workunit.client.0.smithi040.stdout:4/377: chown d2/d3/d4 71820521 1 2024-04-18T10:42:44.829 INFO:tasks.workunit.client.0.smithi040.stdout:7/375: fsync d6/f22 0 2024-04-18T10:42:44.830 INFO:tasks.workunit.client.0.smithi040.stdout:0/381: creat dd/df/d19/f87 x:0 0 0 2024-04-18T10:42:44.832 INFO:tasks.workunit.client.0.smithi040.stdout:5/338: dwrite d0/d3/f10 [4194304,4194304] 0 2024-04-18T10:42:44.833 INFO:tasks.workunit.client.0.smithi040.stdout:4/378: mknod d2/d3/d4/d1f/d29/d49/c6a 0 2024-04-18T10:42:44.833 INFO:tasks.workunit.client.0.smithi040.stdout:0/382: fdatasync dd/df/d19/d28/d3a/d42/f81 0 2024-04-18T10:42:44.833 INFO:tasks.workunit.client.0.smithi040.stdout:4/379: chown d2/f9 59494666 1 2024-04-18T10:42:44.834 INFO:tasks.workunit.client.0.smithi040.stdout:5/339: mkdir d0/d21/d42/d76 0 2024-04-18T10:42:44.835 INFO:tasks.workunit.client.0.smithi040.stdout:9/409: link d2/d3/c17 d2/c90 0 2024-04-18T10:42:44.854 INFO:tasks.workunit.client.0.smithi040.stdout:1/351: dread d1/d1c/d2b/d32/d36/f50 [0,4194304] 0 2024-04-18T10:42:44.855 INFO:tasks.workunit.client.0.smithi040.stdout:1/352: fdatasync d1/f15 0 2024-04-18T10:42:44.856 INFO:tasks.workunit.client.0.smithi040.stdout:1/353: read - d1/f7f zero size 2024-04-18T10:42:44.860 INFO:tasks.workunit.client.0.smithi040.stdout:1/354: rename d1/d1c/d2b/d32/c7c to d1/d1c/d2b/d32/d36/d4d/c87 0 2024-04-18T10:42:44.862 INFO:tasks.workunit.client.0.smithi040.stdout:1/355: creat d1/d1c/d7b/d2e/f88 x:0 0 0 2024-04-18T10:42:44.866 INFO:tasks.workunit.client.0.smithi040.stdout:3/355: sync 2024-04-18T10:42:44.869 INFO:tasks.workunit.client.0.smithi040.stdout:3/356: creat d1/d2/d3c/f83 x:0 0 0 2024-04-18T10:42:44.869 INFO:tasks.workunit.client.0.smithi040.stdout:1/356: dwrite d1/d1c/d7b/d2d/f63 [0,4194304] 0 2024-04-18T10:42:44.870 INFO:tasks.workunit.client.0.smithi040.stdout:2/304: truncate dd/d14/f22 2808254 0 2024-04-18T10:42:44.874 INFO:tasks.workunit.client.0.smithi040.stdout:7/376: dread d6/f32 [0,4194304] 0 2024-04-18T10:42:44.879 INFO:tasks.workunit.client.0.smithi040.stdout:1/357: mknod d1/d1c/d7b/c89 0 2024-04-18T10:42:44.881 INFO:tasks.workunit.client.0.smithi040.stdout:1/358: truncate d1/d1c/d7b/d2e/d3e/f6a 256695 0 2024-04-18T10:42:44.881 INFO:tasks.workunit.client.0.smithi040.stdout:2/305: rename dd/d14/d44/d4c/d49/c4d to dd/d14/d2f/d37/d38/c59 0 2024-04-18T10:42:44.881 INFO:tasks.workunit.client.0.smithi040.stdout:7/377: dread d6/d25/f53 [0,4194304] 0 2024-04-18T10:42:44.882 INFO:tasks.workunit.client.0.smithi040.stdout:3/357: creat d1/d2/d4e/f84 x:0 0 0 2024-04-18T10:42:44.883 INFO:tasks.workunit.client.0.smithi040.stdout:1/359: truncate d1/d1c/d2b/f5e 462802 0 2024-04-18T10:42:44.884 INFO:tasks.workunit.client.0.smithi040.stdout:1/360: write d1/d16/f2a [447982,9455] 0 2024-04-18T10:42:44.885 INFO:tasks.workunit.client.0.smithi040.stdout:1/361: truncate d1/f7f 700765 0 2024-04-18T10:42:44.886 INFO:tasks.workunit.client.0.smithi040.stdout:1/362: truncate d1/d1c/d7b/d2d/f6c 170753 0 2024-04-18T10:42:44.891 INFO:tasks.workunit.client.0.smithi040.stdout:9/410: write d2/dd/f54 [743952,99026] 0 2024-04-18T10:42:44.891 INFO:tasks.workunit.client.0.smithi040.stdout:6/370: sync 2024-04-18T10:42:44.896 INFO:tasks.workunit.client.0.smithi040.stdout:9/411: write d2/dc/d46/f69 [193153,53156] 0 2024-04-18T10:42:44.897 INFO:tasks.workunit.client.0.smithi040.stdout:6/371: fsync df/d4b/f51 0 2024-04-18T10:42:44.899 INFO:tasks.workunit.client.0.smithi040.stdout:8/387: write d2/d10/f26 [532107,110259] 0 2024-04-18T10:42:44.899 INFO:tasks.workunit.client.0.smithi040.stdout:1/363: dwrite d1/d16/f41 [0,4194304] 0 2024-04-18T10:42:44.901 INFO:tasks.workunit.client.0.smithi040.stdout:5/340: dwrite d0/d3/f36 [4194304,4194304] 0 2024-04-18T10:42:44.902 INFO:tasks.workunit.client.0.smithi040.stdout:1/364: write d1/f69 [2343500,21685] 0 2024-04-18T10:42:44.904 INFO:tasks.workunit.client.0.smithi040.stdout:3/358: dread d1/d2/d4e/d58/f5d [0,4194304] 0 2024-04-18T10:42:44.904 INFO:tasks.workunit.client.0.smithi040.stdout:7/378: dread d6/d25/d28/f4e [0,4194304] 0 2024-04-18T10:42:44.905 INFO:tasks.workunit.client.0.smithi040.stdout:3/359: write d1/d7/d12/f32 [3769488,50169] 0 2024-04-18T10:42:44.906 INFO:tasks.workunit.client.0.smithi040.stdout:7/379: chown d6/ld 18 1 2024-04-18T10:42:44.906 INFO:tasks.workunit.client.0.smithi040.stdout:9/412: symlink d2/dc/d46/d44/l91 0 2024-04-18T10:42:44.908 INFO:tasks.workunit.client.0.smithi040.stdout:6/372: creat df/d4b/d7e/f88 x:0 0 0 2024-04-18T10:42:44.913 INFO:tasks.workunit.client.0.smithi040.stdout:1/365: mknod d1/d1c/d7b/d3f/c8a 0 2024-04-18T10:42:44.913 INFO:tasks.workunit.client.0.smithi040.stdout:8/388: mknod d2/d15/d2b/c7e 0 2024-04-18T10:42:44.915 INFO:tasks.workunit.client.0.smithi040.stdout:8/389: chown d2/d10/d14/l3a 96121 1 2024-04-18T10:42:44.915 INFO:tasks.workunit.client.0.smithi040.stdout:1/366: truncate d1/d1c/d2b/d32/d36/f7d 27800 0 2024-04-18T10:42:44.916 INFO:tasks.workunit.client.0.smithi040.stdout:8/390: chown d2/d5/d9/d3c/d68/f69 86883933 1 2024-04-18T10:42:44.916 INFO:tasks.workunit.client.0.smithi040.stdout:6/373: creat df/d4b/d6a/f89 x:0 0 0 2024-04-18T10:42:44.918 INFO:tasks.workunit.client.0.smithi040.stdout:3/360: creat d1/d7/d28/d81/f85 x:0 0 0 2024-04-18T10:42:44.919 INFO:tasks.workunit.client.0.smithi040.stdout:7/380: dread d6/d25/d28/d2c/f33 [0,4194304] 0 2024-04-18T10:42:44.922 INFO:tasks.workunit.client.0.smithi040.stdout:9/413: link d2/d7/l89 d2/dc/d46/d44/d8d/l92 0 2024-04-18T10:42:44.924 INFO:tasks.workunit.client.0.smithi040.stdout:3/361: mknod d1/d2/d4e/c86 0 2024-04-18T10:42:44.924 INFO:tasks.workunit.client.0.smithi040.stdout:8/391: creat d2/d15/d2b/f7f x:0 0 0 2024-04-18T10:42:44.926 INFO:tasks.workunit.client.0.smithi040.stdout:0/383: sync 2024-04-18T10:42:44.926 INFO:tasks.workunit.client.0.smithi040.stdout:4/380: sync 2024-04-18T10:42:44.927 INFO:tasks.workunit.client.0.smithi040.stdout:7/381: dwrite d6/d25/d28/f2f [0,4194304] 0 2024-04-18T10:42:44.927 INFO:tasks.workunit.client.0.smithi040.stdout:9/414: mknod d2/d3/d22/d2e/d35/d40/d71/c93 0 2024-04-18T10:42:44.929 INFO:tasks.workunit.client.0.smithi040.stdout:3/362: mknod d1/d2/d16/d18/c87 0 2024-04-18T10:42:44.929 INFO:tasks.workunit.client.0.smithi040.stdout:8/392: mkdir d2/d22/d80 0 2024-04-18T10:42:44.932 INFO:tasks.workunit.client.0.smithi040.stdout:0/384: rmdir dd 39 2024-04-18T10:42:44.936 INFO:tasks.workunit.client.0.smithi040.stdout:3/363: rename d1/d2/l13 to d1/d7/d26/l88 0 2024-04-18T10:42:44.940 INFO:tasks.workunit.client.0.smithi040.stdout:9/415: symlink d2/dd/de/d7f/l94 0 2024-04-18T10:42:44.940 INFO:tasks.workunit.client.0.smithi040.stdout:5/341: dwrite d0/d3/f5 [0,4194304] 0 2024-04-18T10:42:44.942 INFO:tasks.workunit.client.0.smithi040.stdout:5/342: write d0/d1c/d52/d5d/f60 [3539464,81213] 0 2024-04-18T10:42:44.942 INFO:tasks.workunit.client.0.smithi040.stdout:2/306: sync 2024-04-18T10:42:44.942 INFO:tasks.workunit.client.0.smithi040.stdout:4/381: truncate d2/d3/d4/d21/d28/d3f/f39 9668929 0 2024-04-18T10:42:44.943 INFO:tasks.workunit.client.0.smithi040.stdout:5/343: fdatasync d0/d1c/f53 0 2024-04-18T10:42:44.943 INFO:tasks.workunit.client.0.smithi040.stdout:2/307: fdatasync f9 0 2024-04-18T10:42:44.944 INFO:tasks.workunit.client.0.smithi040.stdout:8/393: rename d2/d22/l60 to d2/d5/d9/d1b/l81 0 2024-04-18T10:42:44.946 INFO:tasks.workunit.client.0.smithi040.stdout:4/382: dread - d2/d3/d4/d1f/d29/f64 zero size 2024-04-18T10:42:44.946 INFO:tasks.workunit.client.0.smithi040.stdout:5/344: dread - d0/d21/f3a zero size 2024-04-18T10:42:44.947 INFO:tasks.workunit.client.0.smithi040.stdout:9/416: dread d2/d3/f65 [0,4194304] 0 2024-04-18T10:42:44.947 INFO:tasks.workunit.client.0.smithi040.stdout:0/385: mknod dd/df/d19/d28/d3a/c88 0 2024-04-18T10:42:44.947 INFO:tasks.workunit.client.0.smithi040.stdout:8/394: write d2/d15/d2b/f57 [1799906,67016] 0 2024-04-18T10:42:44.949 INFO:tasks.workunit.client.0.smithi040.stdout:3/364: mknod d1/d2/c89 0 2024-04-18T10:42:44.950 INFO:tasks.workunit.client.0.smithi040.stdout:4/383: stat d2/d3/d4/d1f/l3a 0 2024-04-18T10:42:44.952 INFO:tasks.workunit.client.0.smithi040.stdout:6/374: dread df/f4d [0,4194304] 0 2024-04-18T10:42:44.952 INFO:tasks.workunit.client.0.smithi040.stdout:2/308: creat dd/d14/d4a/f5a x:0 0 0 2024-04-18T10:42:44.952 INFO:tasks.workunit.client.0.smithi040.stdout:3/365: chown d1/d2/d4e/d58 1319391723 1 2024-04-18T10:42:44.955 INFO:tasks.workunit.client.0.smithi040.stdout:9/417: creat d2/dd/f95 x:0 0 0 2024-04-18T10:42:44.956 INFO:tasks.workunit.client.0.smithi040.stdout:3/366: fsync d1/d7/d3a/f52 0 2024-04-18T10:42:44.957 INFO:tasks.workunit.client.0.smithi040.stdout:2/309: write dd/f36 [1012503,13866] 0 2024-04-18T10:42:44.957 INFO:tasks.workunit.client.0.smithi040.stdout:1/367: dwrite d1/d1c/d7b/d2e/d39/f4f [0,4194304] 0 2024-04-18T10:42:44.960 INFO:tasks.workunit.client.0.smithi040.stdout:2/310: readlink dd/l3f 0 2024-04-18T10:42:44.961 INFO:tasks.workunit.client.0.smithi040.stdout:9/418: stat d2/d3/d22/d2e/d35/d40/c59 0 2024-04-18T10:42:44.961 INFO:tasks.workunit.client.0.smithi040.stdout:1/368: stat d1/d1c/d7b/l2f 0 2024-04-18T10:42:44.964 INFO:tasks.workunit.client.0.smithi040.stdout:0/386: link dd/df/d19/d28/d3a/d42/l65 dd/df/d19/d3e/l89 0 2024-04-18T10:42:44.965 INFO:tasks.workunit.client.0.smithi040.stdout:8/395: dwrite d2/f5b [0,4194304] 0 2024-04-18T10:42:44.966 INFO:tasks.workunit.client.0.smithi040.stdout:9/419: fdatasync d2/d3/d22/d2e/f63 0 2024-04-18T10:42:44.967 INFO:tasks.workunit.client.0.smithi040.stdout:3/367: symlink d1/d7/l8a 0 2024-04-18T10:42:44.968 INFO:tasks.workunit.client.0.smithi040.stdout:8/396: dread - d2/d5/d9/d3c/f6f zero size 2024-04-18T10:42:44.968 INFO:tasks.workunit.client.0.smithi040.stdout:7/382: dread d6/d25/d28/d2c/f4c [0,4194304] 0 2024-04-18T10:42:44.969 INFO:tasks.workunit.client.0.smithi040.stdout:2/311: write dd/d14/f47 [2866851,115117] 0 2024-04-18T10:42:44.970 INFO:tasks.workunit.client.0.smithi040.stdout:4/384: dwrite d2/d3/d4/d1f/f66 [0,4194304] 0 2024-04-18T10:42:44.980 INFO:tasks.workunit.client.0.smithi040.stdout:9/420: mknod d2/d5b/c96 0 2024-04-18T10:42:44.981 INFO:tasks.workunit.client.0.smithi040.stdout:1/369: fdatasync d1/d1c/d7b/d2e/d39/f46 0 2024-04-18T10:42:44.982 INFO:tasks.workunit.client.0.smithi040.stdout:3/368: write d1/d2/d16/d18/f65 [858355,11526] 0 2024-04-18T10:42:44.982 INFO:tasks.workunit.client.0.smithi040.stdout:2/312: stat dd/d14/d2b/c3d 0 2024-04-18T10:42:44.984 INFO:tasks.workunit.client.0.smithi040.stdout:7/383: chown d6/d25/l29 79 1 2024-04-18T10:42:44.984 INFO:tasks.workunit.client.0.smithi040.stdout:9/421: write d2/dc/f1a [1097508,49503] 0 2024-04-18T10:42:44.986 INFO:tasks.workunit.client.0.smithi040.stdout:8/397: creat d2/d15/f82 x:0 0 0 2024-04-18T10:42:44.987 INFO:tasks.workunit.client.0.smithi040.stdout:2/313: truncate f9 4698485 0 2024-04-18T10:42:44.988 INFO:tasks.workunit.client.0.smithi040.stdout:8/398: dread - d2/f5e zero size 2024-04-18T10:42:44.988 INFO:tasks.workunit.client.0.smithi040.stdout:3/369: truncate d1/d2/d4e/f84 291236 0 2024-04-18T10:42:44.989 INFO:tasks.workunit.client.0.smithi040.stdout:1/370: truncate d1/d1c/d2b/d32/d35/f5d 434072 0 2024-04-18T10:42:44.992 INFO:tasks.workunit.client.0.smithi040.stdout:6/375: dwrite df/d17/f1b [0,4194304] 0 2024-04-18T10:42:44.992 INFO:tasks.workunit.client.0.smithi040.stdout:4/385: dread d2/d3/d4/dd/f22 [0,4194304] 0 2024-04-18T10:42:44.992 INFO:tasks.workunit.client.0.smithi040.stdout:5/345: dread d0/f35 [0,4194304] 0 2024-04-18T10:42:44.993 INFO:tasks.workunit.client.0.smithi040.stdout:2/314: mkdir dd/d14/d2f/d37/d5b 0 2024-04-18T10:42:44.995 INFO:tasks.workunit.client.0.smithi040.stdout:2/315: chown dd/d14 20056398 1 2024-04-18T10:42:44.996 INFO:tasks.workunit.client.0.smithi040.stdout:7/384: rename d6/d3e/c41 to d6/d25/d28/d2c/d2d/d47/c80 0 2024-04-18T10:42:44.996 INFO:tasks.workunit.client.0.smithi040.stdout:4/386: dread - d2/d3/d4/d23/f63 zero size 2024-04-18T10:42:44.997 INFO:tasks.workunit.client.0.smithi040.stdout:8/399: symlink d2/d5/d9/d3c/d68/l83 0 2024-04-18T10:42:44.998 INFO:tasks.workunit.client.0.smithi040.stdout:1/371: creat d1/d1c/d7b/d2e/f8b x:0 0 0 2024-04-18T10:42:45.000 INFO:tasks.workunit.client.0.smithi040.stdout:3/370: dread d1/d2/d4e/d58/f5d [0,4194304] 0 2024-04-18T10:42:45.000 INFO:tasks.workunit.client.0.smithi040.stdout:6/376: mkdir df/d4b/d6e/d3f/d53/d8a 0 2024-04-18T10:42:45.001 INFO:tasks.workunit.client.0.smithi040.stdout:6/377: read - df/d4b/d6e/d3f/d53/f81 zero size 2024-04-18T10:42:45.002 INFO:tasks.workunit.client.0.smithi040.stdout:1/372: creat d1/d1c/d2b/d32/d36/f8c x:0 0 0 2024-04-18T10:42:45.003 INFO:tasks.workunit.client.0.smithi040.stdout:7/385: rename d6/d3e/l71 to d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/l81 0 2024-04-18T10:42:45.008 INFO:tasks.workunit.client.0.smithi040.stdout:9/422: truncate d2/f55 2277743 0 2024-04-18T10:42:45.008 INFO:tasks.workunit.client.0.smithi040.stdout:1/373: symlink d1/d1c/d2b/d32/d36/d4d/l8d 0 2024-04-18T10:42:45.009 INFO:tasks.workunit.client.0.smithi040.stdout:5/346: link d0/d3b/d3f/l54 d0/d3b/d3f/d72/l77 0 2024-04-18T10:42:45.010 INFO:tasks.workunit.client.0.smithi040.stdout:6/378: getdents df/d4b/d63 0 2024-04-18T10:42:45.011 INFO:tasks.workunit.client.0.smithi040.stdout:7/386: mknod d6/d25/d28/d2c/c82 0 2024-04-18T10:42:45.012 INFO:tasks.workunit.client.0.smithi040.stdout:2/316: getdents dd/d14/d44 0 2024-04-18T10:42:45.013 INFO:tasks.workunit.client.0.smithi040.stdout:9/423: dread d2/dd/f54 [0,4194304] 0 2024-04-18T10:42:45.014 INFO:tasks.workunit.client.0.smithi040.stdout:5/347: write d0/d4e/f29 [8708273,112085] 0 2024-04-18T10:42:45.015 INFO:tasks.workunit.client.0.smithi040.stdout:6/379: mknod df/d4b/c8b 0 2024-04-18T10:42:45.016 INFO:tasks.workunit.client.0.smithi040.stdout:6/380: readlink df/d4b/d6e/d3f/l44 0 2024-04-18T10:42:45.020 INFO:tasks.workunit.client.0.smithi040.stdout:1/374: getdents d1/d1c/d7b/d3f/d75/d84 0 2024-04-18T10:42:45.022 INFO:tasks.workunit.client.0.smithi040.stdout:3/371: truncate d1/d2/d4e/f84 153735 0 2024-04-18T10:42:45.023 INFO:tasks.workunit.client.0.smithi040.stdout:3/372: write d1/d2/d16/f2d [3365158,62016] 0 2024-04-18T10:42:45.023 INFO:tasks.workunit.client.0.smithi040.stdout:6/381: rmdir df/d4b/d6e/d3f/d53 39 2024-04-18T10:42:45.024 INFO:tasks.workunit.client.0.smithi040.stdout:6/382: chown df/d76/l7b 845 1 2024-04-18T10:42:45.024 INFO:tasks.workunit.client.0.smithi040.stdout:3/373: fsync d1/d2/d4e/d58/f72 0 2024-04-18T10:42:45.028 INFO:tasks.workunit.client.0.smithi040.stdout:2/317: creat dd/d14/d44/d4c/f5c x:0 0 0 2024-04-18T10:42:45.032 INFO:tasks.workunit.client.0.smithi040.stdout:7/387: dread d6/f22 [0,4194304] 0 2024-04-18T10:42:45.033 INFO:tasks.workunit.client.0.smithi040.stdout:5/348: rmdir d0/d21/d42/d70 0 2024-04-18T10:42:45.034 INFO:tasks.workunit.client.0.smithi040.stdout:9/424: dwrite d2/dd/de/f58 [0,4194304] 0 2024-04-18T10:42:45.034 INFO:tasks.workunit.client.0.smithi040.stdout:6/383: write df/d4b/f51 [677323,65683] 0 2024-04-18T10:42:45.039 INFO:tasks.workunit.client.0.smithi040.stdout:2/318: dwrite dd/f36 [0,4194304] 0 2024-04-18T10:42:45.041 INFO:tasks.workunit.client.0.smithi040.stdout:3/374: getdents d1/d2/d16/d18 0 2024-04-18T10:42:45.044 INFO:tasks.workunit.client.0.smithi040.stdout:9/425: mkdir d2/d3/d97 0 2024-04-18T10:42:45.044 INFO:tasks.workunit.client.0.smithi040.stdout:5/349: dwrite d0/f35 [4194304,4194304] 0 2024-04-18T10:42:45.049 INFO:tasks.workunit.client.0.smithi040.stdout:9/426: unlink d2/d7/f15 0 2024-04-18T10:42:45.049 INFO:tasks.workunit.client.0.smithi040.stdout:6/384: dwrite df/d4b/d6e/d3f/f59 [4194304,4194304] 0 2024-04-18T10:42:45.050 INFO:tasks.workunit.client.0.smithi040.stdout:0/387: sync 2024-04-18T10:42:45.051 INFO:tasks.workunit.client.0.smithi040.stdout:5/350: mkdir d0/d78 0 2024-04-18T10:42:45.051 INFO:tasks.workunit.client.0.smithi040.stdout:2/319: truncate dd/f15 3180719 0 2024-04-18T10:42:45.052 INFO:tasks.workunit.client.0.smithi040.stdout:3/375: creat d1/f8b x:0 0 0 2024-04-18T10:42:45.053 INFO:tasks.workunit.client.0.smithi040.stdout:5/351: read - d0/d1c/d52/d5d/f69 zero size 2024-04-18T10:42:45.054 INFO:tasks.workunit.client.0.smithi040.stdout:6/385: creat df/d4b/d7e/f8c x:0 0 0 2024-04-18T10:42:45.055 INFO:tasks.workunit.client.0.smithi040.stdout:2/320: unlink dd/d14/d2f/d37/l43 0 2024-04-18T10:42:45.055 INFO:tasks.workunit.client.0.smithi040.stdout:3/376: fdatasync d1/d7/d12/f30 0 2024-04-18T10:42:45.059 INFO:tasks.workunit.client.0.smithi040.stdout:2/321: symlink dd/d14/d4a/l5d 0 2024-04-18T10:42:45.060 INFO:tasks.workunit.client.0.smithi040.stdout:0/388: dwrite dd/df/d4e/f55 [0,4194304] 0 2024-04-18T10:42:45.063 INFO:tasks.workunit.client.0.smithi040.stdout:2/322: write dd/d14/f47 [4699016,39778] 0 2024-04-18T10:42:45.064 INFO:tasks.workunit.client.0.smithi040.stdout:3/377: truncate d1/d7/d3a/f52 2049991 0 2024-04-18T10:42:45.066 INFO:tasks.workunit.client.0.smithi040.stdout:0/389: mknod dd/d62/c8a 0 2024-04-18T10:42:45.067 INFO:tasks.workunit.client.0.smithi040.stdout:5/352: dwrite d0/d3b/d67/f68 [0,4194304] 0 2024-04-18T10:42:45.067 INFO:tasks.workunit.client.0.smithi040.stdout:2/323: dread - dd/d14/d4a/d54/f55 zero size 2024-04-18T10:42:45.068 INFO:tasks.workunit.client.0.smithi040.stdout:6/386: dwrite df/d17/f22 [0,4194304] 0 2024-04-18T10:42:45.068 INFO:tasks.workunit.client.0.smithi040.stdout:4/387: sync 2024-04-18T10:42:45.072 INFO:tasks.workunit.client.0.smithi040.stdout:5/353: dread d0/f1 [8388608,4194304] 0 2024-04-18T10:42:45.072 INFO:tasks.workunit.client.0.smithi040.stdout:0/390: symlink dd/df/d19/l8b 0 2024-04-18T10:42:45.073 INFO:tasks.workunit.client.0.smithi040.stdout:3/378: dread d1/d2/d16/f2c [0,4194304] 0 2024-04-18T10:42:45.073 INFO:tasks.workunit.client.0.smithi040.stdout:4/388: symlink d2/d3/d4/d21/l6b 0 2024-04-18T10:42:45.074 INFO:tasks.workunit.client.0.smithi040.stdout:2/324: symlink dd/d14/d44/d4c/d52/l5e 0 2024-04-18T10:42:45.075 INFO:tasks.workunit.client.0.smithi040.stdout:0/391: read - dd/df/d4e/f7d zero size 2024-04-18T10:42:45.077 INFO:tasks.workunit.client.0.smithi040.stdout:5/354: symlink d0/l79 0 2024-04-18T10:42:45.077 INFO:tasks.workunit.client.0.smithi040.stdout:7/388: write d6/d25/d28/d2c/f3d [2277399,113464] 0 2024-04-18T10:42:45.078 INFO:tasks.workunit.client.0.smithi040.stdout:6/387: dwrite df/d4b/d6e/f33 [0,4194304] 0 2024-04-18T10:42:45.080 INFO:tasks.workunit.client.0.smithi040.stdout:4/389: mkdir d2/d3/d4/d21/d28/d3f/d6c 0 2024-04-18T10:42:45.082 INFO:tasks.workunit.client.0.smithi040.stdout:3/379: truncate d1/d2/d16/f25 3276303 0 2024-04-18T10:42:45.084 INFO:tasks.workunit.client.0.smithi040.stdout:3/380: chown d1/d7/d3a/l51 322518 1 2024-04-18T10:42:45.084 INFO:tasks.workunit.client.0.smithi040.stdout:2/325: dwrite dd/d14/d44/d4c/f5c [0,4194304] 0 2024-04-18T10:42:45.087 INFO:tasks.workunit.client.0.smithi040.stdout:2/326: read - dd/d14/d2f/d37/d38/f57 zero size 2024-04-18T10:42:45.089 INFO:tasks.workunit.client.0.smithi040.stdout:4/390: dwrite d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:45.093 INFO:tasks.workunit.client.0.smithi040.stdout:9/427: truncate d2/d3/d22/f3c 793320 0 2024-04-18T10:42:45.093 INFO:tasks.workunit.client.0.smithi040.stdout:9/428: read - d2/f82 zero size 2024-04-18T10:42:45.096 INFO:tasks.workunit.client.0.smithi040.stdout:0/392: creat dd/df/d19/f8c x:0 0 0 2024-04-18T10:42:45.101 INFO:tasks.workunit.client.0.smithi040.stdout:2/327: mkdir dd/d14/d44/d5f 0 2024-04-18T10:42:45.102 INFO:tasks.workunit.client.0.smithi040.stdout:5/355: creat d0/d3b/d3f/d72/f7a x:0 0 0 2024-04-18T10:42:45.103 INFO:tasks.workunit.client.0.smithi040.stdout:5/356: write d0/d3/f36 [7278120,23455] 0 2024-04-18T10:42:45.105 INFO:tasks.workunit.client.0.smithi040.stdout:9/429: creat d2/dd/f98 x:0 0 0 2024-04-18T10:42:45.107 INFO:tasks.workunit.client.0.smithi040.stdout:2/328: mkdir dd/d14/d60 0 2024-04-18T10:42:45.109 INFO:tasks.workunit.client.0.smithi040.stdout:1/375: sync 2024-04-18T10:42:45.109 INFO:tasks.workunit.client.0.smithi040.stdout:8/400: sync 2024-04-18T10:42:45.109 INFO:tasks.workunit.client.0.smithi040.stdout:7/389: rmdir d6/d25/d28/d2c/d3c/d6a 0 2024-04-18T10:42:45.109 INFO:tasks.workunit.client.0.smithi040.stdout:2/329: write dd/d14/d44/d4c/f5c [2877526,61796] 0 2024-04-18T10:42:45.110 INFO:tasks.workunit.client.0.smithi040.stdout:5/357: dwrite d0/d3/f13 [4194304,4194304] 0 2024-04-18T10:42:45.110 INFO:tasks.workunit.client.0.smithi040.stdout:9/430: symlink d2/dd/de/l99 0 2024-04-18T10:42:45.112 INFO:tasks.workunit.client.0.smithi040.stdout:0/393: mkdir dd/df/d19/d8d 0 2024-04-18T10:42:45.113 INFO:tasks.workunit.client.0.smithi040.stdout:7/390: symlink d6/d25/d28/d2c/d2d/d47/d55/d58/l83 0 2024-04-18T10:42:45.122 INFO:tasks.workunit.client.0.smithi040.stdout:0/394: creat dd/df/d19/d3e/d77/f8e x:0 0 0 2024-04-18T10:42:45.126 INFO:tasks.workunit.client.0.smithi040.stdout:1/376: dread d1/d1c/d2b/d32/d36/f50 [0,4194304] 0 2024-04-18T10:42:45.128 INFO:tasks.workunit.client.0.smithi040.stdout:0/395: mkdir dd/df/d19/d28/d3a/d5b/d8f 0 2024-04-18T10:42:45.129 INFO:tasks.workunit.client.0.smithi040.stdout:3/381: truncate d1/d7/d12/f30 2211832 0 2024-04-18T10:42:45.130 INFO:tasks.workunit.client.0.smithi040.stdout:9/431: dwrite d2/f82 [0,4194304] 0 2024-04-18T10:42:45.130 INFO:tasks.workunit.client.0.smithi040.stdout:6/388: fsync df/d4b/d6e/f33 0 2024-04-18T10:42:45.130 INFO:tasks.workunit.client.0.smithi040.stdout:2/330: dwrite dd/f56 [0,4194304] 0 2024-04-18T10:42:45.136 INFO:tasks.workunit.client.0.smithi040.stdout:7/391: dwrite d6/d3e/d73/f76 [0,4194304] 0 2024-04-18T10:42:45.139 INFO:tasks.workunit.client.0.smithi040.stdout:0/396: creat dd/df/d19/d3e/d77/f90 x:0 0 0 2024-04-18T10:42:45.141 INFO:tasks.workunit.client.0.smithi040.stdout:7/392: write d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/f7a [492589,86712] 0 2024-04-18T10:42:45.142 INFO:tasks.workunit.client.0.smithi040.stdout:3/382: creat d1/d2/d4e/d58/d62/d6b/f8c x:0 0 0 2024-04-18T10:42:45.143 INFO:tasks.workunit.client.0.smithi040.stdout:9/432: dwrite d2/d3/d22/d2e/f76 [0,4194304] 0 2024-04-18T10:42:45.150 INFO:tasks.workunit.client.0.smithi040.stdout:6/389: dwrite df/f27 [0,4194304] 0 2024-04-18T10:42:45.152 INFO:tasks.workunit.client.0.smithi040.stdout:1/377: link d1/d1c/d7b/d3f/f70 d1/d1c/d2b/d32/d36/d4d/d67/f8e 0 2024-04-18T10:42:45.153 INFO:tasks.workunit.client.0.smithi040.stdout:9/433: dwrite d2/dd/de/f58 [4194304,4194304] 0 2024-04-18T10:42:45.155 INFO:tasks.workunit.client.0.smithi040.stdout:3/383: symlink d1/d2/d16/d18/d3b/l8d 0 2024-04-18T10:42:45.156 INFO:tasks.workunit.client.0.smithi040.stdout:3/384: chown d1/d2/f17 358 1 2024-04-18T10:42:45.157 INFO:tasks.workunit.client.0.smithi040.stdout:3/385: stat d1 0 2024-04-18T10:42:45.158 INFO:tasks.workunit.client.0.smithi040.stdout:1/378: dread d1/d1c/d7b/d2d/f63 [0,4194304] 0 2024-04-18T10:42:45.159 INFO:tasks.workunit.client.0.smithi040.stdout:1/379: chown d1/d1c/f56 5236841 1 2024-04-18T10:42:45.166 INFO:tasks.workunit.client.0.smithi040.stdout:7/393: mknod d6/d50/d79/c84 0 2024-04-18T10:42:45.168 INFO:tasks.workunit.client.0.smithi040.stdout:4/391: dread d2/f9 [0,4194304] 0 2024-04-18T10:42:45.168 INFO:tasks.workunit.client.0.smithi040.stdout:8/401: sync 2024-04-18T10:42:45.170 INFO:tasks.workunit.client.0.smithi040.stdout:2/331: rmdir dd 39 2024-04-18T10:42:45.171 INFO:tasks.workunit.client.0.smithi040.stdout:3/386: truncate d1/d7/d3a/f50 4225481 0 2024-04-18T10:42:45.171 INFO:tasks.workunit.client.0.smithi040.stdout:4/392: dread d2/d3/d4/dd/d4f/f5f [0,4194304] 0 2024-04-18T10:42:45.208 INFO:tasks.workunit.client.0.smithi040.stdout:3/387: mkdir d1/d2/d4e/d58/d8e 0 2024-04-18T10:42:45.209 INFO:tasks.workunit.client.0.smithi040.stdout:7/394: dwrite d6/d25/f62 [4194304,4194304] 0 2024-04-18T10:42:45.209 INFO:tasks.workunit.client.0.smithi040.stdout:1/380: link d1/d1c/d2b/d32/d36/d4d/d67/f8e d1/d1c/d7b/d3f/d75/d84/f8f 0 2024-04-18T10:42:45.210 INFO:tasks.workunit.client.0.smithi040.stdout:8/402: mknod d2/d22/c84 0 2024-04-18T10:42:45.211 INFO:tasks.workunit.client.0.smithi040.stdout:9/434: rename d2/d3/d70/f74 to d2/d3/d22/d2e/d35/d40/f9a 0 2024-04-18T10:42:45.212 INFO:tasks.workunit.client.0.smithi040.stdout:0/397: dread dd/df/d19/f45 [0,4194304] 0 2024-04-18T10:42:45.215 INFO:tasks.workunit.client.0.smithi040.stdout:0/398: chown dd/df/d4e/f7d 19335 1 2024-04-18T10:42:45.217 INFO:tasks.workunit.client.0.smithi040.stdout:1/381: mknod d1/d1c/c90 0 2024-04-18T10:42:45.219 INFO:tasks.workunit.client.0.smithi040.stdout:9/435: mknod d2/d3/d22/d2e/c9b 0 2024-04-18T10:42:45.222 INFO:tasks.workunit.client.0.smithi040.stdout:0/399: mkdir dd/d91 0 2024-04-18T10:42:45.223 INFO:tasks.workunit.client.0.smithi040.stdout:8/403: creat d2/d22/f85 x:0 0 0 2024-04-18T10:42:45.224 INFO:tasks.workunit.client.0.smithi040.stdout:2/332: dwrite dd/d14/d2f/d37/d38/f57 [0,4194304] 0 2024-04-18T10:42:45.225 INFO:tasks.workunit.client.0.smithi040.stdout:7/395: dwrite d6/f1f [0,4194304] 0 2024-04-18T10:42:45.225 INFO:tasks.workunit.client.0.smithi040.stdout:3/388: getdents d1/d7/d67 0 2024-04-18T10:42:45.226 INFO:tasks.workunit.client.0.smithi040.stdout:5/358: sync 2024-04-18T10:42:45.227 INFO:tasks.workunit.client.0.smithi040.stdout:6/390: dwrite df/d4b/d6e/f28 [0,4194304] 0 2024-04-18T10:42:45.227 INFO:tasks.workunit.client.0.smithi040.stdout:0/400: mknod dd/df/d4e/c92 0 2024-04-18T10:42:45.228 INFO:tasks.workunit.client.0.smithi040.stdout:1/382: truncate d1/d1c/d2b/d32/d36/f7d 434555 0 2024-04-18T10:42:45.229 INFO:tasks.workunit.client.0.smithi040.stdout:0/401: fdatasync dd/df/d4e/f55 0 2024-04-18T10:42:45.230 INFO:tasks.workunit.client.0.smithi040.stdout:8/404: symlink d2/d5/d9/d3c/l86 0 2024-04-18T10:42:45.231 INFO:tasks.workunit.client.0.smithi040.stdout:2/333: mkdir dd/d61 0 2024-04-18T10:42:45.233 INFO:tasks.workunit.client.0.smithi040.stdout:8/405: read - d2/d5/d9/d63/f64 zero size 2024-04-18T10:42:45.233 INFO:tasks.workunit.client.0.smithi040.stdout:5/359: rmdir d0/d1c/d52 39 2024-04-18T10:42:45.236 INFO:tasks.workunit.client.0.smithi040.stdout:1/383: rmdir d1/d1c/d2b 39 2024-04-18T10:42:45.236 INFO:tasks.workunit.client.0.smithi040.stdout:9/436: dwrite d2/d3/d22/d2e/d35/d40/d71/f78 [0,4194304] 0 2024-04-18T10:42:45.238 INFO:tasks.workunit.client.0.smithi040.stdout:3/389: truncate d1/d7/d3a/f52 1068896 0 2024-04-18T10:42:45.238 INFO:tasks.workunit.client.0.smithi040.stdout:0/402: symlink dd/df/d19/d28/d3a/d5b/l93 0 2024-04-18T10:42:45.240 INFO:tasks.workunit.client.0.smithi040.stdout:2/334: dwrite dd/d14/d44/d4c/f5c [0,4194304] 0 2024-04-18T10:42:45.240 INFO:tasks.workunit.client.0.smithi040.stdout:0/403: truncate dd/df/d19/d3e/f7e 389207 0 2024-04-18T10:42:45.241 INFO:tasks.workunit.client.0.smithi040.stdout:8/406: creat d2/d22/d49/f87 x:0 0 0 2024-04-18T10:42:45.242 INFO:tasks.workunit.client.0.smithi040.stdout:8/407: chown d2/d22/d49 224 1 2024-04-18T10:42:45.252 INFO:tasks.workunit.client.0.smithi040.stdout:6/391: creat df/d4b/d6e/f8d x:0 0 0 2024-04-18T10:42:45.252 INFO:tasks.workunit.client.0.smithi040.stdout:5/360: mkdir d0/d3/d6b/d7b 0 2024-04-18T10:42:45.252 INFO:tasks.workunit.client.0.smithi040.stdout:0/404: write dd/df/d19/d28/d3a/d46/f5d [409778,86325] 0 2024-04-18T10:42:45.252 INFO:tasks.workunit.client.0.smithi040.stdout:8/408: fdatasync d2/f6c 0 2024-04-18T10:42:45.253 INFO:tasks.workunit.client.0.smithi040.stdout:3/390: unlink d1/d2/d16/c21 0 2024-04-18T10:42:45.254 INFO:tasks.workunit.client.0.smithi040.stdout:1/384: dread - d1/d1c/d2b/d32/d36/d4d/d67/f7a zero size 2024-04-18T10:42:45.255 INFO:tasks.workunit.client.0.smithi040.stdout:6/392: creat df/d17/f8e x:0 0 0 2024-04-18T10:42:45.257 INFO:tasks.workunit.client.0.smithi040.stdout:3/391: readlink d1/d2/d16/d18/d3b/l8d 0 2024-04-18T10:42:45.258 INFO:tasks.workunit.client.0.smithi040.stdout:6/393: readlink df/d4b/d6e/d3f/l44 0 2024-04-18T10:42:45.258 INFO:tasks.workunit.client.0.smithi040.stdout:2/335: dwrite dd/f45 [0,4194304] 0 2024-04-18T10:42:45.259 INFO:tasks.workunit.client.0.smithi040.stdout:8/409: rename d2/d10/f26 to d2/d5/d9/d3c/d68/f88 0 2024-04-18T10:42:45.259 INFO:tasks.workunit.client.0.smithi040.stdout:5/361: truncate d0/d1c/d52/d5d/f69 969911 0 2024-04-18T10:42:45.260 INFO:tasks.workunit.client.0.smithi040.stdout:3/392: truncate d1/d2/d16/f40 193266 0 2024-04-18T10:42:45.261 INFO:tasks.workunit.client.0.smithi040.stdout:1/385: unlink d1/d16/f21 0 2024-04-18T10:42:45.264 INFO:tasks.workunit.client.0.smithi040.stdout:2/336: rmdir dd/d14/d44/d4c/d49 39 2024-04-18T10:42:45.264 INFO:tasks.workunit.client.0.smithi040.stdout:1/386: dread d1/f7f [0,4194304] 0 2024-04-18T10:42:45.265 INFO:tasks.workunit.client.0.smithi040.stdout:8/410: symlink d2/d5/d9/d3c/d68/l89 0 2024-04-18T10:42:45.266 INFO:tasks.workunit.client.0.smithi040.stdout:6/394: dread df/d4b/d6e/f33 [0,4194304] 0 2024-04-18T10:42:45.267 INFO:tasks.workunit.client.0.smithi040.stdout:4/393: sync 2024-04-18T10:42:45.270 INFO:tasks.workunit.client.0.smithi040.stdout:4/394: dread - d2/d3/d4/d21/f58 zero size 2024-04-18T10:42:45.270 INFO:tasks.workunit.client.0.smithi040.stdout:1/387: creat d1/d1c/d7b/d2d/f91 x:0 0 0 2024-04-18T10:42:45.271 INFO:tasks.workunit.client.0.smithi040.stdout:3/393: dwrite d1/d7/d67/f76 [0,4194304] 0 2024-04-18T10:42:45.272 INFO:tasks.workunit.client.0.smithi040.stdout:8/411: unlink d2/d15/d2b/c7e 0 2024-04-18T10:42:45.273 INFO:tasks.workunit.client.0.smithi040.stdout:3/394: chown d1/d2/d4e/d58 116215884 1 2024-04-18T10:42:45.275 INFO:tasks.workunit.client.0.smithi040.stdout:8/412: write d2/d10/d6a/f70 [4087343,32261] 0 2024-04-18T10:42:45.276 INFO:tasks.workunit.client.0.smithi040.stdout:3/395: write d1/f8b [384958,130968] 0 2024-04-18T10:42:45.276 INFO:tasks.workunit.client.0.smithi040.stdout:6/395: creat df/d4b/d6e/d3f/d53/f8f x:0 0 0 2024-04-18T10:42:45.277 INFO:tasks.workunit.client.0.smithi040.stdout:2/337: dwrite dd/d14/d4a/d54/f55 [0,4194304] 0 2024-04-18T10:42:45.279 INFO:tasks.workunit.client.0.smithi040.stdout:6/396: fsync df/f55 0 2024-04-18T10:42:45.282 INFO:tasks.workunit.client.0.smithi040.stdout:2/338: chown dd/d14/d2f/d37/f4b 9968 1 2024-04-18T10:42:45.282 INFO:tasks.workunit.client.0.smithi040.stdout:8/413: mknod d2/d5/d9/d1b/c8a 0 2024-04-18T10:42:45.283 INFO:tasks.workunit.client.0.smithi040.stdout:6/397: chown df/d4b/d6e/f32 11365209 1 2024-04-18T10:42:45.283 INFO:tasks.workunit.client.0.smithi040.stdout:3/396: truncate d1/d2/d4e/d58/f5d 4818920 0 2024-04-18T10:42:45.285 INFO:tasks.workunit.client.0.smithi040.stdout:4/395: dwrite d2/d3/d4/dd/f48 [0,4194304] 0 2024-04-18T10:42:45.286 INFO:tasks.workunit.client.0.smithi040.stdout:6/398: rename df/d4b/d6a to df/d4b/d6a/d90 22 2024-04-18T10:42:45.286 INFO:tasks.workunit.client.0.smithi040.stdout:8/414: chown d2/d5/d9/d3c/c61 0 1 2024-04-18T10:42:45.287 INFO:tasks.workunit.client.0.smithi040.stdout:3/397: chown d1/d2/d4e/d58/f6c 284976802 1 2024-04-18T10:42:45.290 INFO:tasks.workunit.client.0.smithi040.stdout:8/415: readlink d2/d5/d9/d3c/d68/l73 0 2024-04-18T10:42:45.290 INFO:tasks.workunit.client.0.smithi040.stdout:6/399: mkdir df/d76/d91 0 2024-04-18T10:42:45.293 INFO:tasks.workunit.client.0.smithi040.stdout:8/416: truncate d2/d22/f85 1020198 0 2024-04-18T10:42:45.293 INFO:tasks.workunit.client.0.smithi040.stdout:7/396: sync 2024-04-18T10:42:45.293 INFO:tasks.workunit.client.0.smithi040.stdout:2/339: dwrite dd/f45 [0,4194304] 0 2024-04-18T10:42:45.294 INFO:tasks.workunit.client.0.smithi040.stdout:4/396: rename d2/d3/d4/d21/d28/d3f/d6c to d2/d3/d4/dd/d6d 0 2024-04-18T10:42:45.296 INFO:tasks.workunit.client.0.smithi040.stdout:4/397: chown d2/d3/d2f/f35 0 1 2024-04-18T10:42:45.299 INFO:tasks.workunit.client.0.smithi040.stdout:2/340: dread dd/d14/d44/d4c/f5c [0,4194304] 0 2024-04-18T10:42:45.300 INFO:tasks.workunit.client.0.smithi040.stdout:6/400: creat df/d76/d91/f92 x:0 0 0 2024-04-18T10:42:45.301 INFO:tasks.workunit.client.0.smithi040.stdout:7/397: rename d6/d50/c77 to d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/c85 0 2024-04-18T10:42:45.302 INFO:tasks.workunit.client.0.smithi040.stdout:7/398: fsync d6/d25/f46 0 2024-04-18T10:42:45.302 INFO:tasks.workunit.client.0.smithi040.stdout:0/405: dread dd/df/f2b [0,4194304] 0 2024-04-18T10:42:45.305 INFO:tasks.workunit.client.0.smithi040.stdout:2/341: creat dd/d14/d2f/d37/f62 x:0 0 0 2024-04-18T10:42:45.307 INFO:tasks.workunit.client.0.smithi040.stdout:6/401: rename df/d17 to df/d4b/d6a/d93 0 2024-04-18T10:42:45.310 INFO:tasks.workunit.client.0.smithi040.stdout:7/399: unlink d6/d25/f53 0 2024-04-18T10:42:45.312 INFO:tasks.workunit.client.0.smithi040.stdout:0/406: link dd/df/d19/f8c dd/df/d19/d8d/f94 0 2024-04-18T10:42:45.313 INFO:tasks.workunit.client.0.smithi040.stdout:7/400: chown d6/d25/d67 15830 1 2024-04-18T10:42:45.313 INFO:tasks.workunit.client.0.smithi040.stdout:2/342: mkdir dd/d14/d44/d4c/d63 0 2024-04-18T10:42:45.316 INFO:tasks.workunit.client.0.smithi040.stdout:0/407: symlink dd/df/d19/l95 0 2024-04-18T10:42:45.316 INFO:tasks.workunit.client.0.smithi040.stdout:2/343: write dd/d14/d2f/f3a [227615,104950] 0 2024-04-18T10:42:45.318 INFO:tasks.workunit.client.0.smithi040.stdout:4/398: dwrite d2/d3/d4/d1f/d29/d49/f65 [0,4194304] 0 2024-04-18T10:42:45.318 INFO:tasks.workunit.client.0.smithi040.stdout:7/401: creat d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d63/f86 x:0 0 0 2024-04-18T10:42:45.319 INFO:tasks.workunit.client.0.smithi040.stdout:0/408: read dd/df/d19/f31 [1642178,38820] 0 2024-04-18T10:42:45.327 INFO:tasks.workunit.client.0.smithi040.stdout:1/388: dwrite d1/d1c/d7b/d3f/f70 [0,4194304] 0 2024-04-18T10:42:45.329 INFO:tasks.workunit.client.0.smithi040.stdout:7/402: creat d6/d25/d28/f87 x:0 0 0 2024-04-18T10:42:45.334 INFO:tasks.workunit.client.0.smithi040.stdout:1/389: dwrite d1/d1c/d7b/d2e/d39/f4f [0,4194304] 0 2024-04-18T10:42:45.334 INFO:tasks.workunit.client.0.smithi040.stdout:0/409: mknod dd/df/d19/d8d/c96 0 2024-04-18T10:42:45.335 INFO:tasks.workunit.client.0.smithi040.stdout:3/398: dread d1/d2/d16/d18/d3b/f3f [0,4194304] 0 2024-04-18T10:42:45.339 INFO:tasks.workunit.client.0.smithi040.stdout:1/390: unlink d1/d1c/d2b/d32/d36/f3a 0 2024-04-18T10:42:45.341 INFO:tasks.workunit.client.0.smithi040.stdout:8/417: truncate d2/d5/d9/d3c/d68/f88 1141165 0 2024-04-18T10:42:45.346 INFO:tasks.workunit.client.0.smithi040.stdout:8/418: chown d2/f41 73353372 1 2024-04-18T10:42:45.346 INFO:tasks.workunit.client.0.smithi040.stdout:7/403: dwrite d6/d25/d28/f66 [0,4194304] 0 2024-04-18T10:42:45.348 INFO:tasks.workunit.client.0.smithi040.stdout:2/344: getdents dd/d14/d44/d4c 0 2024-04-18T10:42:45.349 INFO:tasks.workunit.client.0.smithi040.stdout:7/404: dwrite d6/f1f [0,4194304] 0 2024-04-18T10:42:45.353 INFO:tasks.workunit.client.0.smithi040.stdout:0/410: link dd/df/d19/d28/l2c dd/df/d19/d28/d3a/d42/l97 0 2024-04-18T10:42:45.354 INFO:tasks.workunit.client.0.smithi040.stdout:4/399: write d2/d3/d4/d1f/d29/d49/d31/f61 [3855437,53698] 0 2024-04-18T10:42:45.354 INFO:tasks.workunit.client.0.smithi040.stdout:0/411: chown dd/df/d19/d28/f68 12 1 2024-04-18T10:42:45.355 INFO:tasks.workunit.client.0.smithi040.stdout:4/400: chown d2/f9 3332 1 2024-04-18T10:42:45.355 INFO:tasks.workunit.client.0.smithi040.stdout:4/401: fdatasync d2/d3/d4/d21/f58 0 2024-04-18T10:42:45.356 INFO:tasks.workunit.client.0.smithi040.stdout:7/405: creat d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/f88 x:0 0 0 2024-04-18T10:42:45.358 INFO:tasks.workunit.client.0.smithi040.stdout:0/412: mknod dd/d62/c98 0 2024-04-18T10:42:45.359 INFO:tasks.workunit.client.0.smithi040.stdout:8/419: creat d2/d5/f8b x:0 0 0 2024-04-18T10:42:45.359 INFO:tasks.workunit.client.0.smithi040.stdout:0/413: dread - dd/df/d19/f66 zero size 2024-04-18T10:42:45.359 INFO:tasks.workunit.client.0.smithi040.stdout:5/362: sync 2024-04-18T10:42:45.359 INFO:tasks.workunit.client.0.smithi040.stdout:9/437: sync 2024-04-18T10:42:45.362 INFO:tasks.workunit.client.0.smithi040.stdout:8/420: fdatasync d2/d5/d9/d3c/d68/f7a 0 2024-04-18T10:42:45.362 INFO:tasks.workunit.client.0.smithi040.stdout:0/414: truncate dd/f49 4406070 0 2024-04-18T10:42:45.363 INFO:tasks.workunit.client.0.smithi040.stdout:5/363: write d0/f1 [8449325,97599] 0 2024-04-18T10:42:45.364 INFO:tasks.workunit.client.0.smithi040.stdout:7/406: dwrite d6/d25/f46 [0,4194304] 0 2024-04-18T10:42:45.365 INFO:tasks.workunit.client.0.smithi040.stdout:9/438: creat d2/d3/d22/d2e/d35/d40/d85/f9c x:0 0 0 2024-04-18T10:42:45.365 INFO:tasks.workunit.client.0.smithi040.stdout:0/415: chown dd/df/d19/d28/d3a/d42/f58 2136 1 2024-04-18T10:42:45.366 INFO:tasks.workunit.client.0.smithi040.stdout:9/439: fdatasync d2/d7/f51 0 2024-04-18T10:42:45.366 INFO:tasks.workunit.client.0.smithi040.stdout:8/421: creat d2/d10/d14/f8c x:0 0 0 2024-04-18T10:42:45.366 INFO:tasks.workunit.client.0.smithi040.stdout:8/422: readlink d2/d4c/l62 0 2024-04-18T10:42:45.368 INFO:tasks.workunit.client.0.smithi040.stdout:0/416: write dd/df/d19/f31 [1220560,124778] 0 2024-04-18T10:42:45.371 INFO:tasks.workunit.client.0.smithi040.stdout:9/440: rename d2/d3/d22/d2e/d35/d40/f9a to d2/dd/de/d7f/f9d 0 2024-04-18T10:42:45.374 INFO:tasks.workunit.client.0.smithi040.stdout:0/417: mknod dd/df/c99 0 2024-04-18T10:42:45.375 INFO:tasks.workunit.client.0.smithi040.stdout:9/441: mknod d2/d5b/c9e 0 2024-04-18T10:42:45.376 INFO:tasks.workunit.client.0.smithi040.stdout:9/442: read d2/d7/f5a [402199,7391] 0 2024-04-18T10:42:45.377 INFO:tasks.workunit.client.0.smithi040.stdout:6/402: sync 2024-04-18T10:42:45.377 INFO:tasks.workunit.client.0.smithi040.stdout:9/443: dread - d2/dd/f95 zero size 2024-04-18T10:42:45.378 INFO:tasks.workunit.client.0.smithi040.stdout:9/444: write d2/d3/d22/f6a [723490,42793] 0 2024-04-18T10:42:45.380 INFO:tasks.workunit.client.0.smithi040.stdout:6/403: rmdir df/d76/d91 39 2024-04-18T10:42:45.381 INFO:tasks.workunit.client.0.smithi040.stdout:6/404: chown df/f43 167 1 2024-04-18T10:42:45.386 INFO:tasks.workunit.client.0.smithi040.stdout:6/405: rename df/d4b/d6e/d3f/d53/f81 to df/d4b/f94 0 2024-04-18T10:42:45.386 INFO:tasks.workunit.client.0.smithi040.stdout:0/418: link dd/df/d19/d28/d3a/l3c dd/df/d19/d3e/l9a 0 2024-04-18T10:42:45.387 INFO:tasks.workunit.client.0.smithi040.stdout:1/391: write d1/d1c/d7b/d2e/d39/f46 [1063561,55727] 0 2024-04-18T10:42:45.387 INFO:tasks.workunit.client.0.smithi040.stdout:9/445: mknod d2/d7/c9f 0 2024-04-18T10:42:45.390 INFO:tasks.workunit.client.0.smithi040.stdout:5/364: dread d0/f39 [0,4194304] 0 2024-04-18T10:42:45.390 INFO:tasks.workunit.client.0.smithi040.stdout:2/345: truncate dd/d14/d2f/d37/d38/f57 191808 0 2024-04-18T10:42:45.390 INFO:tasks.workunit.client.0.smithi040.stdout:0/419: chown dd/df/d19/d28/d3a/d42/l82 1205 1 2024-04-18T10:42:45.391 INFO:tasks.workunit.client.0.smithi040.stdout:6/406: write df/f13 [1387108,246] 0 2024-04-18T10:42:45.391 INFO:tasks.workunit.client.0.smithi040.stdout:4/402: truncate d2/d3/d2f/f46 324042 0 2024-04-18T10:42:45.392 INFO:tasks.workunit.client.0.smithi040.stdout:1/392: write d1/d1c/d7b/d3f/d75/d84/f8f [1583498,130703] 0 2024-04-18T10:42:45.392 INFO:tasks.workunit.client.0.smithi040.stdout:0/420: chown dd/df/d4e 51 1 2024-04-18T10:42:45.393 INFO:tasks.workunit.client.0.smithi040.stdout:3/399: dwrite d1/d7/d3a/f50 [0,4194304] 0 2024-04-18T10:42:45.394 INFO:tasks.workunit.client.0.smithi040.stdout:9/446: creat d2/d3/d22/d2e/d35/d40/d71/fa0 x:0 0 0 2024-04-18T10:42:45.395 INFO:tasks.workunit.client.0.smithi040.stdout:1/393: chown d1/d1c/d7b/d2d/c37 38538 1 2024-04-18T10:42:45.410 INFO:tasks.workunit.client.0.smithi040.stdout:3/400: mknod d1/d7/d28/c8f 0 2024-04-18T10:42:45.411 INFO:tasks.workunit.client.0.smithi040.stdout:7/407: truncate d6/f14 6217233 0 2024-04-18T10:42:45.413 INFO:tasks.workunit.client.0.smithi040.stdout:3/401: stat d1/d7/d3a/f3d 0 2024-04-18T10:42:45.416 INFO:tasks.workunit.client.0.smithi040.stdout:7/408: dread - d6/d25/d28/d2c/d2d/d47/f59 zero size 2024-04-18T10:42:45.416 INFO:tasks.workunit.client.0.smithi040.stdout:6/407: dwrite df/d4b/d6e/f8d [0,4194304] 0 2024-04-18T10:42:45.417 INFO:tasks.workunit.client.0.smithi040.stdout:0/421: mknod dd/df/d19/d28/c9b 0 2024-04-18T10:42:45.418 INFO:tasks.workunit.client.0.smithi040.stdout:4/403: truncate d2/d3/d4/d21/d28/d3f/f39 8785149 0 2024-04-18T10:42:45.419 INFO:tasks.workunit.client.0.smithi040.stdout:1/394: write d1/f11 [3130411,84444] 0 2024-04-18T10:42:45.421 INFO:tasks.workunit.client.0.smithi040.stdout:7/409: dread - d6/d25/d28/f87 zero size 2024-04-18T10:42:45.421 INFO:tasks.workunit.client.0.smithi040.stdout:3/402: read d1/d2/d16/f2d [2271845,96928] 0 2024-04-18T10:42:45.423 INFO:tasks.workunit.client.0.smithi040.stdout:0/422: chown dd/df/d19/d28/c9b 3965 1 2024-04-18T10:42:45.423 INFO:tasks.workunit.client.0.smithi040.stdout:8/423: dwrite d2/f17 [0,4194304] 0 2024-04-18T10:42:45.424 INFO:tasks.workunit.client.0.smithi040.stdout:7/410: chown d6/d25/d28/d2c/c82 11036002 1 2024-04-18T10:42:45.424 INFO:tasks.workunit.client.0.smithi040.stdout:8/424: fsync d2/d22/d49/f87 0 2024-04-18T10:42:45.428 INFO:tasks.workunit.client.0.smithi040.stdout:4/404: mknod d2/d3/d4/d1f/d29/c6e 0 2024-04-18T10:42:45.428 INFO:tasks.workunit.client.0.smithi040.stdout:2/346: write dd/f15 [2501921,5828] 0 2024-04-18T10:42:45.429 INFO:tasks.workunit.client.0.smithi040.stdout:1/395: mkdir d1/d16/d92 0 2024-04-18T10:42:45.431 INFO:tasks.workunit.client.0.smithi040.stdout:9/447: dwrite d2/d3/f2b [0,4194304] 0 2024-04-18T10:42:45.432 INFO:tasks.workunit.client.0.smithi040.stdout:9/448: stat d2/dd/de/f53 0 2024-04-18T10:42:45.433 INFO:tasks.workunit.client.0.smithi040.stdout:7/411: truncate d6/fa 5293614 0 2024-04-18T10:42:45.434 INFO:tasks.workunit.client.0.smithi040.stdout:6/408: mkdir df/d4b/d6e/d3f/d53/d8a/d95 0 2024-04-18T10:42:45.435 INFO:tasks.workunit.client.0.smithi040.stdout:4/405: mkdir d2/d3/d41/d47/d6f 0 2024-04-18T10:42:45.436 INFO:tasks.workunit.client.0.smithi040.stdout:4/406: write d2/d3/f68 [769954,19796] 0 2024-04-18T10:42:45.438 INFO:tasks.workunit.client.0.smithi040.stdout:1/396: creat d1/d1c/d7b/d2e/f93 x:0 0 0 2024-04-18T10:42:45.440 INFO:tasks.workunit.client.0.smithi040.stdout:0/423: truncate dd/f37 683932 0 2024-04-18T10:42:45.441 INFO:tasks.workunit.client.0.smithi040.stdout:8/425: creat d2/d15/d78/f8d x:0 0 0 2024-04-18T10:42:45.444 INFO:tasks.workunit.client.0.smithi040.stdout:7/412: write d6/d25/d28/d2c/f33 [1283608,3988] 0 2024-04-18T10:42:45.446 INFO:tasks.workunit.client.0.smithi040.stdout:4/407: mkdir d2/d3/d4/dd/d6d/d70 0 2024-04-18T10:42:45.448 INFO:tasks.workunit.client.0.smithi040.stdout:9/449: unlink d2/d7/c1f 0 2024-04-18T10:42:45.448 INFO:tasks.workunit.client.0.smithi040.stdout:8/426: dwrite d2/d22/f38 [0,4194304] 0 2024-04-18T10:42:45.451 INFO:tasks.workunit.client.0.smithi040.stdout:6/409: mknod df/c96 0 2024-04-18T10:42:45.453 INFO:tasks.workunit.client.0.smithi040.stdout:4/408: dread d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:45.456 INFO:tasks.workunit.client.0.smithi040.stdout:8/427: dwrite d2/f6c [0,4194304] 0 2024-04-18T10:42:45.458 INFO:tasks.workunit.client.0.smithi040.stdout:0/424: rename dd/df/d19/d3e/l89 to dd/df/d19/d28/d3a/d5b/l9c 0 2024-04-18T10:42:45.459 INFO:tasks.workunit.client.0.smithi040.stdout:0/425: readlink dd/df/d19/l7b 0 2024-04-18T10:42:45.460 INFO:tasks.workunit.client.0.smithi040.stdout:7/413: dwrite d6/d25/d28/d2c/f4c [0,4194304] 0 2024-04-18T10:42:45.460 INFO:tasks.workunit.client.0.smithi040.stdout:1/397: creat d1/d1c/f94 x:0 0 0 2024-04-18T10:42:45.464 INFO:tasks.workunit.client.0.smithi040.stdout:6/410: symlink df/d4b/d6a/d93/l97 0 2024-04-18T10:42:45.470 INFO:tasks.workunit.client.0.smithi040.stdout:9/450: symlink d2/dc/d46/d86/la1 0 2024-04-18T10:42:45.471 INFO:tasks.workunit.client.0.smithi040.stdout:9/451: chown d2/f82 0 1 2024-04-18T10:42:45.471 INFO:tasks.workunit.client.0.smithi040.stdout:0/426: creat dd/df/d19/d28/d3a/f9d x:0 0 0 2024-04-18T10:42:45.473 INFO:tasks.workunit.client.0.smithi040.stdout:3/403: dwrite d1/d7/f15 [0,4194304] 0 2024-04-18T10:42:45.473 INFO:tasks.workunit.client.0.smithi040.stdout:4/409: dread d2/d3/d4/f12 [4194304,4194304] 0 2024-04-18T10:42:45.475 INFO:tasks.workunit.client.0.smithi040.stdout:1/398: rename d1/d1c/d2b/d32/d36/f6b to d1/d1c/d7b/d3f/d75/f95 0 2024-04-18T10:42:45.476 INFO:tasks.workunit.client.0.smithi040.stdout:2/347: truncate dd/f45 4191355 0 2024-04-18T10:42:45.477 INFO:tasks.workunit.client.0.smithi040.stdout:8/428: symlink d2/d22/l8e 0 2024-04-18T10:42:45.480 INFO:tasks.workunit.client.0.smithi040.stdout:0/427: dread dd/df/d19/d28/d3a/f64 [0,4194304] 0 2024-04-18T10:42:45.481 INFO:tasks.workunit.client.0.smithi040.stdout:1/399: dwrite d1/f11 [0,4194304] 0 2024-04-18T10:42:45.483 INFO:tasks.workunit.client.0.smithi040.stdout:9/452: mknod d2/d7/ca2 0 2024-04-18T10:42:45.485 INFO:tasks.workunit.client.0.smithi040.stdout:8/429: creat d2/d22/d49/f8f x:0 0 0 2024-04-18T10:42:45.485 INFO:tasks.workunit.client.0.smithi040.stdout:8/430: fdatasync d2/f5e 0 2024-04-18T10:42:45.486 INFO:tasks.workunit.client.0.smithi040.stdout:4/410: symlink d2/d3/d4/d1f/d29/d49/l71 0 2024-04-18T10:42:45.488 INFO:tasks.workunit.client.0.smithi040.stdout:3/404: link d1/d7/d12/l68 d1/d2/d3c/l90 0 2024-04-18T10:42:45.489 INFO:tasks.workunit.client.0.smithi040.stdout:5/365: sync 2024-04-18T10:42:45.489 INFO:tasks.workunit.client.0.smithi040.stdout:6/411: getdents df/d4b/d7e 0 2024-04-18T10:42:45.490 INFO:tasks.workunit.client.0.smithi040.stdout:0/428: read dd/df/f15 [6872390,50534] 0 2024-04-18T10:42:45.490 INFO:tasks.workunit.client.0.smithi040.stdout:5/366: fdatasync d0/d3b/d67/f73 0 2024-04-18T10:42:45.490 INFO:tasks.workunit.client.0.smithi040.stdout:0/429: chown dd/f49 0 1 2024-04-18T10:42:45.491 INFO:tasks.workunit.client.0.smithi040.stdout:8/431: mknod d2/d5/d9/d63/c90 0 2024-04-18T10:42:45.496 INFO:tasks.workunit.client.0.smithi040.stdout:1/400: truncate d1/d1c/d2b/d32/d36/f38 3787610 0 2024-04-18T10:42:45.496 INFO:tasks.workunit.client.0.smithi040.stdout:0/430: dread - dd/f6b zero size 2024-04-18T10:42:45.496 INFO:tasks.workunit.client.0.smithi040.stdout:3/405: mkdir d1/d2/d16/d18/d91 0 2024-04-18T10:42:45.498 INFO:tasks.workunit.client.0.smithi040.stdout:6/412: creat df/d4b/d6e/d3f/d53/d8a/d95/f98 x:0 0 0 2024-04-18T10:42:45.500 INFO:tasks.workunit.client.0.smithi040.stdout:0/431: mknod dd/df/d4e/c9e 0 2024-04-18T10:42:45.503 INFO:tasks.workunit.client.0.smithi040.stdout:8/432: dread d2/f17 [0,4194304] 0 2024-04-18T10:42:45.504 INFO:tasks.workunit.client.0.smithi040.stdout:6/413: mkdir df/d4b/d99 0 2024-04-18T10:42:45.505 INFO:tasks.workunit.client.0.smithi040.stdout:1/401: dwrite d1/d16/f2a [0,4194304] 0 2024-04-18T10:42:45.507 INFO:tasks.workunit.client.0.smithi040.stdout:8/433: truncate d2/d15/d2b/f7f 79622 0 2024-04-18T10:42:45.507 INFO:tasks.workunit.client.0.smithi040.stdout:7/414: dread d6/d25/d28/d2c/f3d [0,4194304] 0 2024-04-18T10:42:45.508 INFO:tasks.workunit.client.0.smithi040.stdout:0/432: unlink dd/df/d19/d8d/f94 0 2024-04-18T10:42:45.509 INFO:tasks.workunit.client.0.smithi040.stdout:8/434: dread - d2/d5/f8b zero size 2024-04-18T10:42:45.511 INFO:tasks.workunit.client.0.smithi040.stdout:1/402: symlink d1/d1c/d2b/l96 0 2024-04-18T10:42:45.512 INFO:tasks.workunit.client.0.smithi040.stdout:0/433: write dd/df/d19/d28/d3a/f9d [750831,455] 0 2024-04-18T10:42:45.515 INFO:tasks.workunit.client.0.smithi040.stdout:6/414: dwrite df/d4b/d6e/f1e [0,4194304] 0 2024-04-18T10:42:45.516 INFO:tasks.workunit.client.0.smithi040.stdout:2/348: dread dd/d14/f22 [0,4194304] 0 2024-04-18T10:42:45.517 INFO:tasks.workunit.client.0.smithi040.stdout:8/435: rename d2/d5/d9/d63/c90 to d2/d5/d9/d3c/c91 0 2024-04-18T10:42:45.518 INFO:tasks.workunit.client.0.smithi040.stdout:7/415: truncate d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/f88 421363 0 2024-04-18T10:42:45.519 INFO:tasks.workunit.client.0.smithi040.stdout:6/415: truncate df/d76/f80 286159 0 2024-04-18T10:42:45.523 INFO:tasks.workunit.client.0.smithi040.stdout:0/434: dwrite dd/df/d19/d3e/f7e [0,4194304] 0 2024-04-18T10:42:45.524 INFO:tasks.workunit.client.0.smithi040.stdout:9/453: truncate d2/dc/f73 2045660 0 2024-04-18T10:42:45.526 INFO:tasks.workunit.client.0.smithi040.stdout:6/416: write df/d4b/f87 [1529134,29285] 0 2024-04-18T10:42:45.529 INFO:tasks.workunit.client.0.smithi040.stdout:0/435: mknod dd/df/d4e/c9f 0 2024-04-18T10:42:45.529 INFO:tasks.workunit.client.0.smithi040.stdout:7/416: dwrite d6/d25/d28/d2c/d2d/d47/f59 [0,4194304] 0 2024-04-18T10:42:45.534 INFO:tasks.workunit.client.0.smithi040.stdout:8/436: creat d2/d15/d2b/f92 x:0 0 0 2024-04-18T10:42:45.534 INFO:tasks.workunit.client.0.smithi040.stdout:1/403: getdents d1/d1c/d7b/d3f/d75/d84 0 2024-04-18T10:42:45.535 INFO:tasks.workunit.client.0.smithi040.stdout:3/406: truncate d1/f4f 316635 0 2024-04-18T10:42:45.537 INFO:tasks.workunit.client.0.smithi040.stdout:6/417: mknod df/d4b/c9a 0 2024-04-18T10:42:45.538 INFO:tasks.workunit.client.0.smithi040.stdout:6/418: dread - df/d4b/d6e/d3f/d53/f7d zero size 2024-04-18T10:42:45.539 INFO:tasks.workunit.client.0.smithi040.stdout:0/436: mknod dd/df/d19/d3e/ca0 0 2024-04-18T10:42:45.540 INFO:tasks.workunit.client.0.smithi040.stdout:8/437: symlink d2/d10/d6a/l93 0 2024-04-18T10:42:45.541 INFO:tasks.workunit.client.0.smithi040.stdout:1/404: symlink d1/d1c/d2b/d32/d35/l97 0 2024-04-18T10:42:45.542 INFO:tasks.workunit.client.0.smithi040.stdout:3/407: creat d1/d2/d4e/d58/d62/d6b/f92 x:0 0 0 2024-04-18T10:42:45.544 INFO:tasks.workunit.client.0.smithi040.stdout:0/437: mknod dd/df/d19/d3e/ca1 0 2024-04-18T10:42:45.544 INFO:tasks.workunit.client.0.smithi040.stdout:2/349: write dd/d14/f22 [2551052,113122] 0 2024-04-18T10:42:45.545 INFO:tasks.workunit.client.0.smithi040.stdout:7/417: dwrite d6/f32 [0,4194304] 0 2024-04-18T10:42:45.547 INFO:tasks.workunit.client.0.smithi040.stdout:8/438: mkdir d2/d5/d9/d3c/d5a/d94 0 2024-04-18T10:42:45.548 INFO:tasks.workunit.client.0.smithi040.stdout:8/439: chown d2/d10/d6a/l93 240 1 2024-04-18T10:42:45.549 INFO:tasks.workunit.client.0.smithi040.stdout:6/419: creat df/d76/d91/f9b x:0 0 0 2024-04-18T10:42:45.561 INFO:tasks.workunit.client.0.smithi040.stdout:0/438: creat dd/df/d19/d3e/d77/fa2 x:0 0 0 2024-04-18T10:42:45.562 INFO:tasks.workunit.client.0.smithi040.stdout:8/440: creat d2/d5/d9/d3c/f95 x:0 0 0 2024-04-18T10:42:45.562 INFO:tasks.workunit.client.0.smithi040.stdout:3/408: dwrite d1/d2/d4e/d58/f6c [0,4194304] 0 2024-04-18T10:42:45.563 INFO:tasks.workunit.client.0.smithi040.stdout:2/350: rename dd/l25 to dd/d14/d2f/d37/l64 0 2024-04-18T10:42:45.564 INFO:tasks.workunit.client.0.smithi040.stdout:9/454: dread d2/d3/f41 [0,4194304] 0 2024-04-18T10:42:45.564 INFO:tasks.workunit.client.0.smithi040.stdout:6/420: read df/d4b/d6e/f32 [3510847,101885] 0 2024-04-18T10:42:45.565 INFO:tasks.workunit.client.0.smithi040.stdout:2/351: fsync dd/d14/d2b/f2e 0 2024-04-18T10:42:45.566 INFO:tasks.workunit.client.0.smithi040.stdout:6/421: readlink df/d4b/d6e/d3f/d53/l69 0 2024-04-18T10:42:45.567 INFO:tasks.workunit.client.0.smithi040.stdout:2/352: write dd/f15 [1514544,46050] 0 2024-04-18T10:42:45.567 INFO:tasks.workunit.client.0.smithi040.stdout:0/439: mkdir dd/da3 0 2024-04-18T10:42:45.569 INFO:tasks.workunit.client.0.smithi040.stdout:9/455: fdatasync d2/d3/f65 0 2024-04-18T10:42:45.572 INFO:tasks.workunit.client.0.smithi040.stdout:3/409: dread d1/d2/d4e/d58/f6c [0,4194304] 0 2024-04-18T10:42:45.572 INFO:tasks.workunit.client.0.smithi040.stdout:9/456: chown d2/dc/d46/f69 111903368 1 2024-04-18T10:42:45.573 INFO:tasks.workunit.client.0.smithi040.stdout:0/440: rename dd/df/d4e/f63 to dd/df/d4e/fa4 0 2024-04-18T10:42:45.574 INFO:tasks.workunit.client.0.smithi040.stdout:1/405: dwrite d1/d1c/d7b/d2d/f63 [0,4194304] 0 2024-04-18T10:42:45.575 INFO:tasks.workunit.client.0.smithi040.stdout:9/457: chown d2/d7/fa 5644589 1 2024-04-18T10:42:45.577 INFO:tasks.workunit.client.0.smithi040.stdout:4/411: sync 2024-04-18T10:42:45.577 INFO:tasks.workunit.client.0.smithi040.stdout:5/367: sync 2024-04-18T10:42:45.579 INFO:tasks.workunit.client.0.smithi040.stdout:8/441: rename d2/d5/d9/d3c/d5a/f7b to d2/d5/f96 0 2024-04-18T10:42:45.580 INFO:tasks.workunit.client.0.smithi040.stdout:2/353: rmdir dd/d14/d60 0 2024-04-18T10:42:45.581 INFO:tasks.workunit.client.0.smithi040.stdout:0/441: mkdir dd/df/d19/d3e/da5 0 2024-04-18T10:42:45.582 INFO:tasks.workunit.client.0.smithi040.stdout:1/406: dread d1/d16/f29 [0,4194304] 0 2024-04-18T10:42:45.582 INFO:tasks.workunit.client.0.smithi040.stdout:1/407: readlink d1/d1c/d2b/l96 0 2024-04-18T10:42:45.584 INFO:tasks.workunit.client.0.smithi040.stdout:9/458: truncate d2/d7/f5a 6489601 0 2024-04-18T10:42:45.585 INFO:tasks.workunit.client.0.smithi040.stdout:3/410: truncate d1/d7/f53 4885504 0 2024-04-18T10:42:45.586 INFO:tasks.workunit.client.0.smithi040.stdout:5/368: creat d0/d3/d6b/f7c x:0 0 0 2024-04-18T10:42:45.587 INFO:tasks.workunit.client.0.smithi040.stdout:4/412: mknod d2/d3/d4/dd/c72 0 2024-04-18T10:42:45.588 INFO:tasks.workunit.client.0.smithi040.stdout:2/354: stat dd/d14/d2b/c3b 0 2024-04-18T10:42:45.589 INFO:tasks.workunit.client.0.smithi040.stdout:6/422: link df/d4b/d6a/d93/l2e df/d4b/d6e/d3f/d53/d8a/d95/l9c 0 2024-04-18T10:42:45.590 INFO:tasks.workunit.client.0.smithi040.stdout:2/355: write dd/f28 [887617,118687] 0 2024-04-18T10:42:45.591 INFO:tasks.workunit.client.0.smithi040.stdout:4/413: rmdir d2/d3/d4/dd/d4f 39 2024-04-18T10:42:45.593 INFO:tasks.workunit.client.0.smithi040.stdout:9/459: dread d2/dc/d46/f69 [0,4194304] 0 2024-04-18T10:42:45.595 INFO:tasks.workunit.client.0.smithi040.stdout:4/414: dread d2/d3/d4/dd/f48 [0,4194304] 0 2024-04-18T10:42:45.599 INFO:tasks.workunit.client.0.smithi040.stdout:1/408: creat d1/d1c/d7b/f98 x:0 0 0 2024-04-18T10:42:45.600 INFO:tasks.workunit.client.0.smithi040.stdout:5/369: link d0/d1c/d52/d5d/f69 d0/d21/d42/f7d 0 2024-04-18T10:42:45.602 INFO:tasks.workunit.client.0.smithi040.stdout:9/460: readlink d2/dd/de/l62 0 2024-04-18T10:42:45.602 INFO:tasks.workunit.client.0.smithi040.stdout:7/418: sync 2024-04-18T10:42:45.605 INFO:tasks.workunit.client.0.smithi040.stdout:4/415: readlink d2/d3/d4/d1f/d29/d49/l60 0 2024-04-18T10:42:45.608 INFO:tasks.workunit.client.0.smithi040.stdout:1/409: unlink d1/d1c/d2b/d32/d35/f86 0 2024-04-18T10:42:45.608 INFO:tasks.workunit.client.0.smithi040.stdout:7/419: dwrite d6/d25/d28/d2c/d2d/d47/f48 [0,4194304] 0 2024-04-18T10:42:45.609 INFO:tasks.workunit.client.0.smithi040.stdout:7/420: readlink d6/ld 0 2024-04-18T10:42:45.610 INFO:tasks.workunit.client.0.smithi040.stdout:7/421: chown d6/d25/d28/d2c/d3c 57565 1 2024-04-18T10:42:45.611 INFO:tasks.workunit.client.0.smithi040.stdout:5/370: unlink d0/d1c/d52/l57 0 2024-04-18T10:42:45.611 INFO:tasks.workunit.client.0.smithi040.stdout:6/423: dread df/d4b/d6e/d3f/f5c [0,4194304] 0 2024-04-18T10:42:45.613 INFO:tasks.workunit.client.0.smithi040.stdout:9/461: symlink d2/dc/d46/d86/la3 0 2024-04-18T10:42:45.613 INFO:tasks.workunit.client.0.smithi040.stdout:8/442: truncate d2/d2c/f3b 130472 0 2024-04-18T10:42:45.614 INFO:tasks.workunit.client.0.smithi040.stdout:6/424: write df/d4b/d6e/d3f/d53/f7d [828984,5513] 0 2024-04-18T10:42:45.615 INFO:tasks.workunit.client.0.smithi040.stdout:0/442: write dd/df/d19/d28/d3a/d42/f52 [1650260,114590] 0 2024-04-18T10:42:45.616 INFO:tasks.workunit.client.0.smithi040.stdout:3/411: truncate d1/d7/d12/f32 2700075 0 2024-04-18T10:42:45.617 INFO:tasks.workunit.client.0.smithi040.stdout:3/412: readlink d1/l5e 0 2024-04-18T10:42:45.619 INFO:tasks.workunit.client.0.smithi040.stdout:3/413: chown d1/d7/d67/f76 9796580 1 2024-04-18T10:42:45.619 INFO:tasks.workunit.client.0.smithi040.stdout:7/422: dwrite d6/d25/d28/d2c/f33 [0,4194304] 0 2024-04-18T10:42:45.619 INFO:tasks.workunit.client.0.smithi040.stdout:1/410: creat d1/d1c/d7b/d3f/d75/d84/f99 x:0 0 0 2024-04-18T10:42:45.620 INFO:tasks.workunit.client.0.smithi040.stdout:2/356: link c3 dd/d14/c65 0 2024-04-18T10:42:45.620 INFO:tasks.workunit.client.0.smithi040.stdout:3/414: fsync d1/d7/f15 0 2024-04-18T10:42:45.622 INFO:tasks.workunit.client.0.smithi040.stdout:5/371: unlink d0/d3b/d3f/f6f 0 2024-04-18T10:42:45.622 INFO:tasks.workunit.client.0.smithi040.stdout:2/357: write dd/d14/d4a/d54/f55 [1991530,64903] 0 2024-04-18T10:42:45.623 INFO:tasks.workunit.client.0.smithi040.stdout:8/443: mkdir d2/d4c/d97 0 2024-04-18T10:42:45.626 INFO:tasks.workunit.client.0.smithi040.stdout:6/425: chown df/d4b/d6a/d93/c45 114 1 2024-04-18T10:42:45.627 INFO:tasks.workunit.client.0.smithi040.stdout:0/443: rmdir dd/df/d4e 39 2024-04-18T10:42:45.628 INFO:tasks.workunit.client.0.smithi040.stdout:3/415: dread d1/d2/d4e/d57/f63 [0,4194304] 0 2024-04-18T10:42:45.631 INFO:tasks.workunit.client.0.smithi040.stdout:5/372: chown d0/d3b/d3f/l54 628 1 2024-04-18T10:42:45.633 INFO:tasks.workunit.client.0.smithi040.stdout:7/423: unlink d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/f7a 0 2024-04-18T10:42:45.634 INFO:tasks.workunit.client.0.smithi040.stdout:4/416: creat d2/d3/d4/d1f/d29/d49/f73 x:0 0 0 2024-04-18T10:42:45.634 INFO:tasks.workunit.client.0.smithi040.stdout:8/444: mknod d2/d15/d2b/d40/c98 0 2024-04-18T10:42:45.635 INFO:tasks.workunit.client.0.smithi040.stdout:4/417: write d2/f26 [442921,89451] 0 2024-04-18T10:42:45.638 INFO:tasks.workunit.client.0.smithi040.stdout:1/411: mknod d1/d1c/d2b/c9a 0 2024-04-18T10:42:45.640 INFO:tasks.workunit.client.0.smithi040.stdout:1/412: chown d1/d1c/d7b/d3f/d75/d84/f99 5 1 2024-04-18T10:42:45.642 INFO:tasks.workunit.client.0.smithi040.stdout:4/418: dwrite d2/d3/d4/f2e [0,4194304] 0 2024-04-18T10:42:45.643 INFO:tasks.workunit.client.0.smithi040.stdout:4/419: write d2/d3/f4e [1655075,17714] 0 2024-04-18T10:42:45.643 INFO:tasks.workunit.client.0.smithi040.stdout:5/373: mknod d0/d3/d6b/c7e 0 2024-04-18T10:42:45.646 INFO:tasks.workunit.client.0.smithi040.stdout:7/424: symlink d6/d3e/l89 0 2024-04-18T10:42:45.647 INFO:tasks.workunit.client.0.smithi040.stdout:7/425: chown d6/d25/d28/f87 177618290 1 2024-04-18T10:42:45.647 INFO:tasks.workunit.client.0.smithi040.stdout:2/358: getdents dd/d14/d2f/d37/d5b 0 2024-04-18T10:42:45.653 INFO:tasks.workunit.client.0.smithi040.stdout:7/426: dwrite d6/d25/d28/d2c/d2d/d47/f59 [0,4194304] 0 2024-04-18T10:42:45.654 INFO:tasks.workunit.client.0.smithi040.stdout:1/413: rmdir d1/d1c/d2b/d32/d36 39 2024-04-18T10:42:45.656 INFO:tasks.workunit.client.0.smithi040.stdout:1/414: write d1/d1c/d7b/d3f/d75/d84/f8f [3148416,100216] 0 2024-04-18T10:42:45.657 INFO:tasks.workunit.client.0.smithi040.stdout:4/420: mknod d2/d3/d4/d1f/d29/c74 0 2024-04-18T10:42:45.658 INFO:tasks.workunit.client.0.smithi040.stdout:5/374: chown d0/d4e/c66 234337102 1 2024-04-18T10:42:45.658 INFO:tasks.workunit.client.0.smithi040.stdout:4/421: write d2/d3/d4/d23/f63 [265637,11716] 0 2024-04-18T10:42:45.660 INFO:tasks.workunit.client.0.smithi040.stdout:2/359: symlink dd/d14/d2f/l66 0 2024-04-18T10:42:45.662 INFO:tasks.workunit.client.0.smithi040.stdout:9/462: rename d2/d3/d22/d2e/d35/c4b to d2/d7/ca4 0 2024-04-18T10:42:45.663 INFO:tasks.workunit.client.0.smithi040.stdout:9/463: chown d2/dc/d46/d44/c56 2 1 2024-04-18T10:42:45.667 INFO:tasks.workunit.client.0.smithi040.stdout:0/444: link dd/df/d4e/fa4 dd/df/d19/d28/d3a/d5b/fa6 0 2024-04-18T10:42:45.668 INFO:tasks.workunit.client.0.smithi040.stdout:7/427: mkdir d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/d8a 0 2024-04-18T10:42:45.671 INFO:tasks.workunit.client.0.smithi040.stdout:2/360: mknod dd/d14/d44/c67 0 2024-04-18T10:42:45.671 INFO:tasks.workunit.client.0.smithi040.stdout:2/361: fdatasync dd/d14/d2b/f2e 0 2024-04-18T10:42:45.672 INFO:tasks.workunit.client.0.smithi040.stdout:9/464: creat d2/d3/d22/d2e/d35/d40/fa5 x:0 0 0 2024-04-18T10:42:45.674 INFO:tasks.workunit.client.0.smithi040.stdout:0/445: creat dd/df/d19/d28/d3a/fa7 x:0 0 0 2024-04-18T10:42:45.677 INFO:tasks.workunit.client.0.smithi040.stdout:7/428: mknod d6/d25/d28/d2c/d2d/d47/d5c/d6b/c8b 0 2024-04-18T10:42:45.677 INFO:tasks.workunit.client.0.smithi040.stdout:3/416: dwrite d1/d7/d12/f30 [0,4194304] 0 2024-04-18T10:42:45.679 INFO:tasks.workunit.client.0.smithi040.stdout:3/417: fsync d1/d7/d12/f22 0 2024-04-18T10:42:45.683 INFO:tasks.workunit.client.0.smithi040.stdout:1/415: rename d1/d1c/d7b/d3f to d1/d9b 0 2024-04-18T10:42:45.684 INFO:tasks.workunit.client.0.smithi040.stdout:8/445: truncate d2/d10/d6a/f70 3966423 0 2024-04-18T10:42:45.685 INFO:tasks.workunit.client.0.smithi040.stdout:0/446: write dd/df/d19/d28/d3a/d5b/fa6 [960575,20525] 0 2024-04-18T10:42:45.686 INFO:tasks.workunit.client.0.smithi040.stdout:6/426: truncate df/f12 2713790 0 2024-04-18T10:42:45.687 INFO:tasks.workunit.client.0.smithi040.stdout:2/362: creat dd/d61/f68 x:0 0 0 2024-04-18T10:42:45.688 INFO:tasks.workunit.client.0.smithi040.stdout:9/465: symlink d2/d5b/d6f/d80/d75/la6 0 2024-04-18T10:42:45.688 INFO:tasks.workunit.client.0.smithi040.stdout:5/375: getdents d0/d3b/d3f/d72 0 2024-04-18T10:42:45.689 INFO:tasks.workunit.client.0.smithi040.stdout:5/376: chown d0/d21 123 1 2024-04-18T10:42:45.690 INFO:tasks.workunit.client.0.smithi040.stdout:7/429: symlink d6/d25/d28/d2c/d2d/d47/d5c/d6b/l8c 0 2024-04-18T10:42:45.690 INFO:tasks.workunit.client.0.smithi040.stdout:3/418: symlink d1/d7/d26/l93 0 2024-04-18T10:42:45.693 INFO:tasks.workunit.client.0.smithi040.stdout:6/427: symlink df/d4b/d63/l9d 0 2024-04-18T10:42:45.693 INFO:tasks.workunit.client.0.smithi040.stdout:9/466: read d2/f19 [3663138,39595] 0 2024-04-18T10:42:45.694 INFO:tasks.workunit.client.0.smithi040.stdout:5/377: mknod d0/d3/d6b/c7f 0 2024-04-18T10:42:45.694 INFO:tasks.workunit.client.0.smithi040.stdout:6/428: chown df/d4b/d7e 0 1 2024-04-18T10:42:45.701 INFO:tasks.workunit.client.0.smithi040.stdout:9/467: dread - d2/d5b/f3e zero size 2024-04-18T10:42:45.704 INFO:tasks.workunit.client.0.smithi040.stdout:5/378: dwrite d0/d3b/d3f/f65 [0,4194304] 0 2024-04-18T10:42:45.706 INFO:tasks.workunit.client.0.smithi040.stdout:0/447: creat dd/df/d19/d28/fa8 x:0 0 0 2024-04-18T10:42:45.706 INFO:tasks.workunit.client.0.smithi040.stdout:3/419: dwrite d1/d7/d3a/f3d [0,4194304] 0 2024-04-18T10:42:45.708 INFO:tasks.workunit.client.0.smithi040.stdout:0/448: chown dd/df/d19/d28/d3a/d42/f72 129035 1 2024-04-18T10:42:45.712 INFO:tasks.workunit.client.0.smithi040.stdout:1/416: dread d1/f30 [0,4194304] 0 2024-04-18T10:42:45.713 INFO:tasks.workunit.client.0.smithi040.stdout:9/468: dread d2/d7/f8 [0,4194304] 0 2024-04-18T10:42:45.718 INFO:tasks.workunit.client.0.smithi040.stdout:1/417: dwrite d1/d1c/d7b/f83 [0,4194304] 0 2024-04-18T10:42:45.719 INFO:tasks.workunit.client.0.smithi040.stdout:3/420: symlink d1/d2/d4e/d58/d62/l94 0 2024-04-18T10:42:45.721 INFO:tasks.workunit.client.0.smithi040.stdout:3/421: fsync d1/d2/d4e/d58/d62/d6b/f8c 0 2024-04-18T10:42:45.722 INFO:tasks.workunit.client.0.smithi040.stdout:8/446: write d2/d5/d9/f29 [322376,53375] 0 2024-04-18T10:42:45.724 INFO:tasks.workunit.client.0.smithi040.stdout:5/379: symlink d0/d1c/l80 0 2024-04-18T10:42:45.724 INFO:tasks.workunit.client.0.smithi040.stdout:8/447: fdatasync d2/d10/d14/f8c 0 2024-04-18T10:42:45.726 INFO:tasks.workunit.client.0.smithi040.stdout:1/418: dwrite d1/f77 [0,4194304] 0 2024-04-18T10:42:45.726 INFO:tasks.workunit.client.0.smithi040.stdout:0/449: creat dd/df/d19/d3e/da5/fa9 x:0 0 0 2024-04-18T10:42:45.729 INFO:tasks.workunit.client.0.smithi040.stdout:6/429: getdents df/d4b/d6a/d93 0 2024-04-18T10:42:45.729 INFO:tasks.workunit.client.0.smithi040.stdout:1/419: read d1/d1c/d7b/f83 [2232187,97899] 0 2024-04-18T10:42:45.729 INFO:tasks.workunit.client.0.smithi040.stdout:0/450: chown dd/df/d19/f45 55 1 2024-04-18T10:42:45.729 INFO:tasks.workunit.client.0.smithi040.stdout:3/422: mkdir d1/d7/d12/d95 0 2024-04-18T10:42:45.731 INFO:tasks.workunit.client.0.smithi040.stdout:6/430: dread - df/d4b/d7e/f88 zero size 2024-04-18T10:42:45.734 INFO:tasks.workunit.client.0.smithi040.stdout:8/448: dwrite d2/d22/f38 [0,4194304] 0 2024-04-18T10:42:45.735 INFO:tasks.workunit.client.0.smithi040.stdout:4/422: sync 2024-04-18T10:42:45.737 INFO:tasks.workunit.client.0.smithi040.stdout:8/449: stat d2/d5/d9/cf 0 2024-04-18T10:42:45.738 INFO:tasks.workunit.client.0.smithi040.stdout:3/423: dwrite d1/f1a [0,4194304] 0 2024-04-18T10:42:45.740 INFO:tasks.workunit.client.0.smithi040.stdout:5/380: creat d0/d78/f81 x:0 0 0 2024-04-18T10:42:45.747 INFO:tasks.workunit.client.0.smithi040.stdout:6/431: creat df/d4b/d99/f9e x:0 0 0 2024-04-18T10:42:45.750 INFO:tasks.workunit.client.0.smithi040.stdout:3/424: dwrite d1/d7/d12/f30 [0,4194304] 0 2024-04-18T10:42:45.750 INFO:tasks.workunit.client.0.smithi040.stdout:4/423: creat d2/d3/d41/d47/d6f/f75 x:0 0 0 2024-04-18T10:42:45.750 INFO:tasks.workunit.client.0.smithi040.stdout:1/420: dwrite d1/d1c/d2b/d32/d36/d4d/d67/f7a [0,4194304] 0 2024-04-18T10:42:45.752 INFO:tasks.workunit.client.0.smithi040.stdout:1/421: chown d1/d9b/d75/f95 993 1 2024-04-18T10:42:45.753 INFO:tasks.workunit.client.0.smithi040.stdout:7/430: truncate d6/d25/d28/f4b 4096934 0 2024-04-18T10:42:45.754 INFO:tasks.workunit.client.0.smithi040.stdout:8/450: link d2/d5/d9/c74 d2/d15/d78/c99 0 2024-04-18T10:42:45.755 INFO:tasks.workunit.client.0.smithi040.stdout:1/422: truncate d1/d1c/d7b/f83 4739322 0 2024-04-18T10:42:45.755 INFO:tasks.workunit.client.0.smithi040.stdout:3/425: readlink d1/d2/d16/l38 0 2024-04-18T10:42:45.756 INFO:tasks.workunit.client.0.smithi040.stdout:3/426: stat d1/d2/d16/d18/d3b/c73 0 2024-04-18T10:42:45.756 INFO:tasks.workunit.client.0.smithi040.stdout:8/451: truncate d2/f67 5035404 0 2024-04-18T10:42:45.757 INFO:tasks.workunit.client.0.smithi040.stdout:4/424: creat d2/d3/d41/d47/f76 x:0 0 0 2024-04-18T10:42:45.759 INFO:tasks.workunit.client.0.smithi040.stdout:7/431: rmdir d6/d50/d79 39 2024-04-18T10:42:45.761 INFO:tasks.workunit.client.0.smithi040.stdout:3/427: dread d1/d2/d16/d18/d3b/f3f [0,4194304] 0 2024-04-18T10:42:45.762 INFO:tasks.workunit.client.0.smithi040.stdout:1/423: creat d1/d9b/f9c x:0 0 0 2024-04-18T10:42:45.762 INFO:tasks.workunit.client.0.smithi040.stdout:4/425: mknod d2/d3/d4/d23/c77 0 2024-04-18T10:42:45.763 INFO:tasks.workunit.client.0.smithi040.stdout:9/469: dread d2/f82 [0,4194304] 0 2024-04-18T10:42:45.763 INFO:tasks.workunit.client.0.smithi040.stdout:3/428: stat d1/d2/d16/d18/c27 0 2024-04-18T10:42:45.764 INFO:tasks.workunit.client.0.smithi040.stdout:9/470: stat d2/d3/f6e 0 2024-04-18T10:42:45.765 INFO:tasks.workunit.client.0.smithi040.stdout:7/432: mknod d6/d25/d28/d2c/c8d 0 2024-04-18T10:42:45.767 INFO:tasks.workunit.client.0.smithi040.stdout:1/424: creat d1/d1c/f9d x:0 0 0 2024-04-18T10:42:45.768 INFO:tasks.workunit.client.0.smithi040.stdout:3/429: rename d1/d7/d26/l93 to d1/d2/d16/d18/d3b/l96 0 2024-04-18T10:42:45.769 INFO:tasks.workunit.client.0.smithi040.stdout:1/425: fsync d1/d16/f29 0 2024-04-18T10:42:45.772 INFO:tasks.workunit.client.0.smithi040.stdout:3/430: creat d1/d7/d26/f97 x:0 0 0 2024-04-18T10:42:45.772 INFO:tasks.workunit.client.0.smithi040.stdout:9/471: dwrite d2/d5b/d6f/d80/d75/f88 [0,4194304] 0 2024-04-18T10:42:45.773 INFO:tasks.workunit.client.0.smithi040.stdout:1/426: mkdir d1/d1c/d7b/d2e/d9e 0 2024-04-18T10:42:45.774 INFO:tasks.workunit.client.0.smithi040.stdout:3/431: chown d1/l20 91 1 2024-04-18T10:42:45.775 INFO:tasks.workunit.client.0.smithi040.stdout:8/452: dread d2/f31 [0,4194304] 0 2024-04-18T10:42:45.776 INFO:tasks.workunit.client.0.smithi040.stdout:9/472: dread - d2/d3/d22/d2e/d35/d40/d85/f9c zero size 2024-04-18T10:42:45.776 INFO:tasks.workunit.client.0.smithi040.stdout:1/427: rmdir d1/d1c/d2b/d32/d36/d4d/d67 39 2024-04-18T10:42:45.776 INFO:tasks.workunit.client.0.smithi040.stdout:2/363: sync 2024-04-18T10:42:45.777 INFO:tasks.workunit.client.0.smithi040.stdout:8/453: fdatasync d2/d15/d2b/f92 0 2024-04-18T10:42:45.778 INFO:tasks.workunit.client.0.smithi040.stdout:2/364: stat dd/d14/d2f/d37/d5b 0 2024-04-18T10:42:45.778 INFO:tasks.workunit.client.0.smithi040.stdout:1/428: write d1/f4 [201060,17260] 0 2024-04-18T10:42:45.779 INFO:tasks.workunit.client.0.smithi040.stdout:9/473: dread d2/d3/f41 [0,4194304] 0 2024-04-18T10:42:45.780 INFO:tasks.workunit.client.0.smithi040.stdout:2/365: symlink dd/d14/d4a/l69 0 2024-04-18T10:42:45.782 INFO:tasks.workunit.client.0.smithi040.stdout:9/474: truncate d2/dd/de/f61 1071598 0 2024-04-18T10:42:45.785 INFO:tasks.workunit.client.0.smithi040.stdout:2/366: getdents dd/d14/d2f 0 2024-04-18T10:42:45.786 INFO:tasks.workunit.client.0.smithi040.stdout:9/475: creat d2/d3/d22/d2e/d35/d40/d71/fa7 x:0 0 0 2024-04-18T10:42:45.787 INFO:tasks.workunit.client.0.smithi040.stdout:9/476: chown d2/dd/de 23040510 1 2024-04-18T10:42:45.789 INFO:tasks.workunit.client.0.smithi040.stdout:1/429: dwrite d1/d1c/d2b/d32/d36/f50 [4194304,4194304] 0 2024-04-18T10:42:45.791 INFO:tasks.workunit.client.0.smithi040.stdout:9/477: write d2/dd/f95 [492798,27058] 0 2024-04-18T10:42:45.793 INFO:tasks.workunit.client.0.smithi040.stdout:6/432: truncate df/f27 2636395 0 2024-04-18T10:42:45.794 INFO:tasks.workunit.client.0.smithi040.stdout:1/430: creat d1/d1c/d7b/d2e/d3e/f9f x:0 0 0 2024-04-18T10:42:45.795 INFO:tasks.workunit.client.0.smithi040.stdout:0/451: dwrite dd/df/d19/d28/f33 [4194304,4194304] 0 2024-04-18T10:42:45.797 INFO:tasks.workunit.client.0.smithi040.stdout:9/478: write d2/d3/d22/d2e/d35/d40/d71/f84 [639225,90378] 0 2024-04-18T10:42:45.798 INFO:tasks.workunit.client.0.smithi040.stdout:7/433: write d6/d25/d28/d2c/d3c/f49 [1405493,74352] 0 2024-04-18T10:42:45.798 INFO:tasks.workunit.client.0.smithi040.stdout:0/452: fdatasync dd/df/d19/d3e/d77/f90 0 2024-04-18T10:42:45.801 INFO:tasks.workunit.client.0.smithi040.stdout:3/432: write d1/d2/d4e/d57/f63 [277192,9107] 0 2024-04-18T10:42:45.802 INFO:tasks.workunit.client.0.smithi040.stdout:3/433: chown d1/f74 2341479 1 2024-04-18T10:42:45.804 INFO:tasks.workunit.client.0.smithi040.stdout:1/431: dwrite d1/d1c/d2b/d32/f64 [0,4194304] 0 2024-04-18T10:42:45.809 INFO:tasks.workunit.client.0.smithi040.stdout:7/434: rmdir d6/d25/d67 0 2024-04-18T10:42:45.811 INFO:tasks.workunit.client.0.smithi040.stdout:3/434: dwrite d1/d7/d26/f97 [0,4194304] 0 2024-04-18T10:42:45.812 INFO:tasks.workunit.client.0.smithi040.stdout:3/435: write d1/d7/d12/f22 [7360017,69404] 0 2024-04-18T10:42:45.815 INFO:tasks.workunit.client.0.smithi040.stdout:7/435: mknod d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/d8a/c8e 0 2024-04-18T10:42:45.815 INFO:tasks.workunit.client.0.smithi040.stdout:3/436: dread - d1/d2/d4e/f7c zero size 2024-04-18T10:42:45.817 INFO:tasks.workunit.client.0.smithi040.stdout:3/437: readlink d1/d2/d16/d18/d3b/l77 0 2024-04-18T10:42:45.820 INFO:tasks.workunit.client.0.smithi040.stdout:2/367: dread dd/d14/d2b/f2e [0,4194304] 0 2024-04-18T10:42:45.823 INFO:tasks.workunit.client.0.smithi040.stdout:2/368: chown dd/d14/d2f/d37/d38/f57 33916 1 2024-04-18T10:42:45.823 INFO:tasks.workunit.client.0.smithi040.stdout:5/381: sync 2024-04-18T10:42:45.824 INFO:tasks.workunit.client.0.smithi040.stdout:7/436: dwrite d6/d25/d28/d2c/d2d/d47/d5c/f5f [0,4194304] 0 2024-04-18T10:42:45.825 INFO:tasks.workunit.client.0.smithi040.stdout:7/437: chown d6/f44 8862810 1 2024-04-18T10:42:45.826 INFO:tasks.workunit.client.0.smithi040.stdout:2/369: write dd/d14/d2f/d37/f62 [345956,114958] 0 2024-04-18T10:42:45.827 INFO:tasks.workunit.client.0.smithi040.stdout:8/454: dread d2/d10/d6a/f70 [0,4194304] 0 2024-04-18T10:42:45.828 INFO:tasks.workunit.client.0.smithi040.stdout:8/455: readlink d2/d10/d14/l3a 0 2024-04-18T10:42:45.829 INFO:tasks.workunit.client.0.smithi040.stdout:7/438: mknod d6/d25/c8f 0 2024-04-18T10:42:45.831 INFO:tasks.workunit.client.0.smithi040.stdout:1/432: dread d1/d1c/d2b/d32/d36/f38 [0,4194304] 0 2024-04-18T10:42:45.832 INFO:tasks.workunit.client.0.smithi040.stdout:8/456: creat d2/d22/d49/f9a x:0 0 0 2024-04-18T10:42:45.834 INFO:tasks.workunit.client.0.smithi040.stdout:7/439: mkdir d6/d50/d79/d90 0 2024-04-18T10:42:45.835 INFO:tasks.workunit.client.0.smithi040.stdout:2/370: dwrite dd/f15 [0,4194304] 0 2024-04-18T10:42:45.835 INFO:tasks.workunit.client.0.smithi040.stdout:3/438: dread d1/d7/d28/f61 [0,4194304] 0 2024-04-18T10:42:45.836 INFO:tasks.workunit.client.0.smithi040.stdout:2/371: readlink dd/d14/d2f/l3c 0 2024-04-18T10:42:45.837 INFO:tasks.workunit.client.0.smithi040.stdout:1/433: creat d1/d1c/d2b/fa0 x:0 0 0 2024-04-18T10:42:45.838 INFO:tasks.workunit.client.0.smithi040.stdout:1/434: dread - d1/d1c/d7b/d2d/f91 zero size 2024-04-18T10:42:45.839 INFO:tasks.workunit.client.0.smithi040.stdout:7/440: fdatasync d6/d25/d28/d2c/f3d 0 2024-04-18T10:42:45.845 INFO:tasks.workunit.client.0.smithi040.stdout:0/453: truncate dd/df/d19/d28/d3a/d46/f5d 384843 0 2024-04-18T10:42:45.845 INFO:tasks.workunit.client.0.smithi040.stdout:4/426: sync 2024-04-18T10:42:45.845 INFO:tasks.workunit.client.0.smithi040.stdout:6/433: dwrite df/d4b/d6a/d93/f1b [0,4194304] 0 2024-04-18T10:42:45.848 INFO:tasks.workunit.client.0.smithi040.stdout:1/435: link d1/d1c/l6e d1/d1c/d7b/d2e/d3e/d85/la1 0 2024-04-18T10:42:45.848 INFO:tasks.workunit.client.0.smithi040.stdout:0/454: write dd/df/f44 [959260,28375] 0 2024-04-18T10:42:45.848 INFO:tasks.workunit.client.0.smithi040.stdout:3/439: dwrite d1/f74 [0,4194304] 0 2024-04-18T10:42:45.850 INFO:tasks.workunit.client.0.smithi040.stdout:6/434: chown df/d4b/d6e/c6c 45144018 1 2024-04-18T10:42:45.853 INFO:tasks.workunit.client.0.smithi040.stdout:6/435: write df/d4b/d6a/d93/f47 [879926,59757] 0 2024-04-18T10:42:45.854 INFO:tasks.workunit.client.0.smithi040.stdout:6/436: write df/f67 [826648,92464] 0 2024-04-18T10:42:45.855 INFO:tasks.workunit.client.0.smithi040.stdout:1/436: unlink d1/d1c/d7b/d2d/c37 0 2024-04-18T10:42:45.856 INFO:tasks.workunit.client.0.smithi040.stdout:1/437: chown d1/d16/l43 29 1 2024-04-18T10:42:45.857 INFO:tasks.workunit.client.0.smithi040.stdout:4/427: getdents d2/d3/d4/d21/d28 0 2024-04-18T10:42:45.859 INFO:tasks.workunit.client.0.smithi040.stdout:0/455: dread dd/df/d19/d28/f6e [0,4194304] 0 2024-04-18T10:42:45.861 INFO:tasks.workunit.client.0.smithi040.stdout:5/382: dread d0/d1c/d52/d5d/f60 [0,4194304] 0 2024-04-18T10:42:45.862 INFO:tasks.workunit.client.0.smithi040.stdout:6/437: dwrite df/f67 [0,4194304] 0 2024-04-18T10:42:45.863 INFO:tasks.workunit.client.0.smithi040.stdout:7/441: dread d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/f7d [0,4194304] 0 2024-04-18T10:42:45.863 INFO:tasks.workunit.client.0.smithi040.stdout:1/438: mkdir d1/d1c/d2b/d32/d36/da2 0 2024-04-18T10:42:45.866 INFO:tasks.workunit.client.0.smithi040.stdout:5/383: chown d0/l5c 321 1 2024-04-18T10:42:45.867 INFO:tasks.workunit.client.0.smithi040.stdout:6/438: rmdir df/d4b/d6e/d3f/d53/d8a 39 2024-04-18T10:42:45.869 INFO:tasks.workunit.client.0.smithi040.stdout:8/457: truncate d2/f67 3410556 0 2024-04-18T10:42:45.871 INFO:tasks.workunit.client.0.smithi040.stdout:0/456: mkdir dd/daa 0 2024-04-18T10:42:45.872 INFO:tasks.workunit.client.0.smithi040.stdout:2/372: write dd/d14/d2f/d37/d38/f57 [954511,95678] 0 2024-04-18T10:42:45.872 INFO:tasks.workunit.client.0.smithi040.stdout:4/428: truncate d2/d3/d2f/f46 483138 0 2024-04-18T10:42:45.873 INFO:tasks.workunit.client.0.smithi040.stdout:7/442: dwrite d6/d25/d28/d2c/d3c/f49 [0,4194304] 0 2024-04-18T10:42:45.874 INFO:tasks.workunit.client.0.smithi040.stdout:5/384: creat d0/d78/f82 x:0 0 0 2024-04-18T10:42:45.875 INFO:tasks.workunit.client.0.smithi040.stdout:8/458: rename d2/d2c/c6d to d2/d2c/c9b 0 2024-04-18T10:42:45.876 INFO:tasks.workunit.client.0.smithi040.stdout:4/429: dread - d2/d3/d4/dd/f69 zero size 2024-04-18T10:42:45.878 INFO:tasks.workunit.client.0.smithi040.stdout:1/439: creat d1/d1c/d2b/d32/d36/d4d/d67/fa3 x:0 0 0 2024-04-18T10:42:45.880 INFO:tasks.workunit.client.0.smithi040.stdout:6/439: dwrite df/d4b/d6a/d93/f31 [0,4194304] 0 2024-04-18T10:42:45.882 INFO:tasks.workunit.client.0.smithi040.stdout:1/440: chown d1/d1c/d7b/f98 958743 1 2024-04-18T10:42:45.885 INFO:tasks.workunit.client.0.smithi040.stdout:9/479: sync 2024-04-18T10:42:45.888 INFO:tasks.workunit.client.0.smithi040.stdout:3/440: write d1/d7/f53 [3853618,69781] 0 2024-04-18T10:42:45.891 INFO:tasks.workunit.client.0.smithi040.stdout:5/385: getdents d0/d3b 0 2024-04-18T10:42:45.893 INFO:tasks.workunit.client.0.smithi040.stdout:9/480: mkdir d2/d3/d70/da8 0 2024-04-18T10:42:45.894 INFO:tasks.workunit.client.0.smithi040.stdout:7/443: dwrite d6/d25/d28/f2f [4194304,4194304] 0 2024-04-18T10:42:45.894 INFO:tasks.workunit.client.0.smithi040.stdout:8/459: dwrite d2/d15/f77 [0,4194304] 0 2024-04-18T10:42:45.896 INFO:tasks.workunit.client.0.smithi040.stdout:0/457: dwrite dd/df/d19/d28/d3a/fa7 [0,4194304] 0 2024-04-18T10:42:45.900 INFO:tasks.workunit.client.0.smithi040.stdout:6/440: rename df/f60 to df/d4b/d6e/f9f 0 2024-04-18T10:42:45.900 INFO:tasks.workunit.client.0.smithi040.stdout:5/386: truncate d0/d21/d42/f6c 635003 0 2024-04-18T10:42:45.902 INFO:tasks.workunit.client.0.smithi040.stdout:9/481: unlink d2/d5b/d6f/d80/d75/la6 0 2024-04-18T10:42:45.902 INFO:tasks.workunit.client.0.smithi040.stdout:4/430: dwrite d2/d3/d4/d1f/d29/d49/d31/f61 [0,4194304] 0 2024-04-18T10:42:45.904 INFO:tasks.workunit.client.0.smithi040.stdout:1/441: rename d1/d1c/d2b/d32/d36/da2 to d1/d1c/d7b/d2e/da4 0 2024-04-18T10:42:45.905 INFO:tasks.workunit.client.0.smithi040.stdout:0/458: fsync dd/df/d19/d28/d3a/f64 0 2024-04-18T10:42:45.906 INFO:tasks.workunit.client.0.smithi040.stdout:5/387: symlink d0/d3/d6b/d7b/l83 0 2024-04-18T10:42:45.907 INFO:tasks.workunit.client.0.smithi040.stdout:9/482: creat d2/d3/d22/d2e/d35/d40/fa9 x:0 0 0 2024-04-18T10:42:45.908 INFO:tasks.workunit.client.0.smithi040.stdout:3/441: rename d1/d2/d4e/d57/f63 to d1/d2/d16/d18/d91/f98 0 2024-04-18T10:42:45.910 INFO:tasks.workunit.client.0.smithi040.stdout:5/388: write d0/d1c/f53 [902442,115553] 0 2024-04-18T10:42:45.910 INFO:tasks.workunit.client.0.smithi040.stdout:2/373: dwrite f9 [0,4194304] 0 2024-04-18T10:42:45.911 INFO:tasks.workunit.client.0.smithi040.stdout:3/442: readlink d1/d2/d16/d18/d3b/l77 0 2024-04-18T10:42:45.912 INFO:tasks.workunit.client.0.smithi040.stdout:5/389: truncate d0/d21/f3a 271200 0 2024-04-18T10:42:45.914 INFO:tasks.workunit.client.0.smithi040.stdout:8/460: rename d2/f31 to d2/d10/d14/f9c 0 2024-04-18T10:42:45.915 INFO:tasks.workunit.client.0.smithi040.stdout:4/431: mknod d2/d3/d4/dd/d6d/d70/c78 0 2024-04-18T10:42:45.916 INFO:tasks.workunit.client.0.smithi040.stdout:4/432: dread - d2/d3/d4/dd/f69 zero size 2024-04-18T10:42:45.918 INFO:tasks.workunit.client.0.smithi040.stdout:3/443: mknod d1/d2/d4e/d58/c99 0 2024-04-18T10:42:45.918 INFO:tasks.workunit.client.0.smithi040.stdout:5/390: creat d0/d3b/d67/f84 x:0 0 0 2024-04-18T10:42:45.922 INFO:tasks.workunit.client.0.smithi040.stdout:3/444: creat d1/d7/d67/f9a x:0 0 0 2024-04-18T10:42:45.922 INFO:tasks.workunit.client.0.smithi040.stdout:5/391: rmdir d0/d3/d47 39 2024-04-18T10:42:45.926 INFO:tasks.workunit.client.0.smithi040.stdout:1/442: rename d1/d9b/f58 to d1/fa5 0 2024-04-18T10:42:45.928 INFO:tasks.workunit.client.0.smithi040.stdout:4/433: dread d2/f9 [0,4194304] 0 2024-04-18T10:42:45.929 INFO:tasks.workunit.client.0.smithi040.stdout:5/392: rename d0/d3/f13 to d0/d3/d6b/d7b/f85 0 2024-04-18T10:42:45.930 INFO:tasks.workunit.client.0.smithi040.stdout:5/393: fsync d0/d3b/d3f/f65 0 2024-04-18T10:42:45.930 INFO:tasks.workunit.client.0.smithi040.stdout:4/434: creat d2/d3/d4/d21/d28/d3f/f79 x:0 0 0 2024-04-18T10:42:45.932 INFO:tasks.workunit.client.0.smithi040.stdout:1/443: rename d1/d1c/d7b/d2e/f3c to d1/d1c/d2b/d32/d35/fa6 0 2024-04-18T10:42:45.933 INFO:tasks.workunit.client.0.smithi040.stdout:4/435: mknod d2/d3/d4/d21/d28/c7a 0 2024-04-18T10:42:45.934 INFO:tasks.workunit.client.0.smithi040.stdout:5/394: symlink d0/d21/d42/d76/l86 0 2024-04-18T10:42:45.935 INFO:tasks.workunit.client.0.smithi040.stdout:5/395: truncate d0/d78/f81 1021359 0 2024-04-18T10:42:45.936 INFO:tasks.workunit.client.0.smithi040.stdout:4/436: creat d2/d3/d4/d21/f7b x:0 0 0 2024-04-18T10:42:45.936 INFO:tasks.workunit.client.0.smithi040.stdout:4/437: chown d2/d3/d2f 345158 1 2024-04-18T10:42:45.937 INFO:tasks.workunit.client.0.smithi040.stdout:1/444: symlink d1/d1c/d7b/d2e/d3e/d85/la7 0 2024-04-18T10:42:45.937 INFO:tasks.workunit.client.0.smithi040.stdout:1/445: stat d1/d9b/c5b 0 2024-04-18T10:42:45.938 INFO:tasks.workunit.client.0.smithi040.stdout:5/396: symlink d0/d78/l87 0 2024-04-18T10:42:45.939 INFO:tasks.workunit.client.0.smithi040.stdout:4/438: mkdir d2/d3/d41/d62/d7c 0 2024-04-18T10:42:45.940 INFO:tasks.workunit.client.0.smithi040.stdout:7/444: dread d6/d25/d28/d2c/f4d [0,4194304] 0 2024-04-18T10:42:45.941 INFO:tasks.workunit.client.0.smithi040.stdout:5/397: mkdir d0/d3b/d88 0 2024-04-18T10:42:45.945 INFO:tasks.workunit.client.0.smithi040.stdout:4/439: dread d2/d3/f68 [0,4194304] 0 2024-04-18T10:42:45.949 INFO:tasks.workunit.client.0.smithi040.stdout:9/483: dread d2/d3/f8c [0,4194304] 0 2024-04-18T10:42:45.950 INFO:tasks.workunit.client.0.smithi040.stdout:7/445: mknod d6/d25/d28/d2c/c91 0 2024-04-18T10:42:45.951 INFO:tasks.workunit.client.0.smithi040.stdout:6/441: truncate df/d4b/f87 394194 0 2024-04-18T10:42:45.952 INFO:tasks.workunit.client.0.smithi040.stdout:7/446: mknod d6/d25/c92 0 2024-04-18T10:42:45.952 INFO:tasks.workunit.client.0.smithi040.stdout:6/442: dread - df/d4b/d6a/d93/f29 zero size 2024-04-18T10:42:45.953 INFO:tasks.workunit.client.0.smithi040.stdout:6/443: chown df/d4b/d6a/d93/l5d 100746341 1 2024-04-18T10:42:45.953 INFO:tasks.workunit.client.0.smithi040.stdout:2/374: write dd/f17 [5021298,89939] 0 2024-04-18T10:42:45.955 INFO:tasks.workunit.client.0.smithi040.stdout:0/459: truncate dd/df/d19/d28/d3a/f4d 51530 0 2024-04-18T10:42:45.957 INFO:tasks.workunit.client.0.smithi040.stdout:8/461: write d2/d2c/f3b [65086,18329] 0 2024-04-18T10:42:45.958 INFO:tasks.workunit.client.0.smithi040.stdout:3/445: write d1/d2/d4e/f84 [77605,116112] 0 2024-04-18T10:42:45.959 INFO:tasks.workunit.client.0.smithi040.stdout:0/460: write dd/df/d19/d28/d3a/d42/f52 [1688133,77801] 0 2024-04-18T10:42:45.962 INFO:tasks.workunit.client.0.smithi040.stdout:2/375: dwrite dd/d14/d2f/d37/d38/f57 [0,4194304] 0 2024-04-18T10:42:45.962 INFO:tasks.workunit.client.0.smithi040.stdout:3/446: fsync d1/d2/d4e/d58/d62/d6b/f92 0 2024-04-18T10:42:45.963 INFO:tasks.workunit.client.0.smithi040.stdout:2/376: stat dd/d14/d44/d5f 0 2024-04-18T10:42:45.964 INFO:tasks.workunit.client.0.smithi040.stdout:3/447: readlink d1/d7/l4b 0 2024-04-18T10:42:45.966 INFO:tasks.workunit.client.0.smithi040.stdout:0/461: rename dd/df/d19/d28/f68 to dd/df/d19/d3e/fab 0 2024-04-18T10:42:45.967 INFO:tasks.workunit.client.0.smithi040.stdout:8/462: dread d2/d15/d2b/f57 [0,4194304] 0 2024-04-18T10:42:45.968 INFO:tasks.workunit.client.0.smithi040.stdout:0/462: read dd/f49 [1394118,8717] 0 2024-04-18T10:42:45.969 INFO:tasks.workunit.client.0.smithi040.stdout:0/463: readlink dd/df/d19/l27 0 2024-04-18T10:42:45.970 INFO:tasks.workunit.client.0.smithi040.stdout:3/448: mkdir d1/d2/d16/d9b 0 2024-04-18T10:42:45.971 INFO:tasks.workunit.client.0.smithi040.stdout:3/449: fsync d1/d7/d12/f22 0 2024-04-18T10:42:45.971 INFO:tasks.workunit.client.0.smithi040.stdout:3/450: write d1/d7/d26/f82 [297605,79840] 0 2024-04-18T10:42:45.972 INFO:tasks.workunit.client.0.smithi040.stdout:1/446: truncate d1/f4 48541 0 2024-04-18T10:42:45.973 INFO:tasks.workunit.client.0.smithi040.stdout:2/377: rename dd/d14/c27 to dd/d14/d2f/d37/d5b/c6a 0 2024-04-18T10:42:45.974 INFO:tasks.workunit.client.0.smithi040.stdout:2/378: dread - dd/d14/d2f/d37/f4b zero size 2024-04-18T10:42:45.977 INFO:tasks.workunit.client.0.smithi040.stdout:0/464: write dd/df/d19/d3e/fab [761090,98275] 0 2024-04-18T10:42:45.981 INFO:tasks.workunit.client.0.smithi040.stdout:1/447: mknod d1/d9b/d75/d84/ca8 0 2024-04-18T10:42:45.983 INFO:tasks.workunit.client.0.smithi040.stdout:6/444: dwrite df/d4b/d6e/f40 [0,4194304] 0 2024-04-18T10:42:45.983 INFO:tasks.workunit.client.0.smithi040.stdout:5/398: creat d0/d3b/d3f/d72/f89 x:0 0 0 2024-04-18T10:42:45.984 INFO:tasks.workunit.client.0.smithi040.stdout:2/379: mkdir dd/d14/d44/d4c/d6b 0 2024-04-18T10:42:45.985 INFO:tasks.workunit.client.0.smithi040.stdout:1/448: write d1/d1c/d2b/d32/d36/d4d/d67/fa3 [644740,33264] 0 2024-04-18T10:42:45.992 INFO:tasks.workunit.client.0.smithi040.stdout:0/465: dwrite dd/df/d19/d28/f6e [0,4194304] 0 2024-04-18T10:42:45.993 INFO:tasks.workunit.client.0.smithi040.stdout:5/399: mknod d0/d3b/d3f/d72/c8a 0 2024-04-18T10:42:45.993 INFO:tasks.workunit.client.0.smithi040.stdout:0/466: write dd/df/d19/f66 [808270,38940] 0 2024-04-18T10:42:45.994 INFO:tasks.workunit.client.0.smithi040.stdout:5/400: fsync d0/d3/f5 0 2024-04-18T10:42:45.994 INFO:tasks.workunit.client.0.smithi040.stdout:3/451: rmdir d1/d7/d12/d95 0 2024-04-18T10:42:45.996 INFO:tasks.workunit.client.0.smithi040.stdout:1/449: rename d1/d1c/c2c to d1/d16/ca9 0 2024-04-18T10:42:45.997 INFO:tasks.workunit.client.0.smithi040.stdout:1/450: write d1/f23 [2064065,128288] 0 2024-04-18T10:42:45.998 INFO:tasks.workunit.client.0.smithi040.stdout:1/451: fdatasync d1/d9b/d75/d84/f99 0 2024-04-18T10:42:45.998 INFO:tasks.workunit.client.0.smithi040.stdout:1/452: readlink d1/d1c/d2b/l68 0 2024-04-18T10:42:46.002 INFO:tasks.workunit.client.0.smithi040.stdout:0/467: symlink dd/df/d19/d3e/d77/lac 0 2024-04-18T10:42:46.003 INFO:tasks.workunit.client.0.smithi040.stdout:8/463: dwrite d2/d10/d14/f9c [0,4194304] 0 2024-04-18T10:42:46.003 INFO:tasks.workunit.client.0.smithi040.stdout:0/468: chown dd/df/d4e 117203324 1 2024-04-18T10:42:46.005 INFO:tasks.workunit.client.0.smithi040.stdout:3/452: unlink d1/d2/d16/d18/c87 0 2024-04-18T10:42:46.005 INFO:tasks.workunit.client.0.smithi040.stdout:6/445: link df/d4b/c8b df/d4b/d6a/ca0 0 2024-04-18T10:42:46.006 INFO:tasks.workunit.client.0.smithi040.stdout:5/401: getdents d0/d3b/d88 0 2024-04-18T10:42:46.006 INFO:tasks.workunit.client.0.smithi040.stdout:8/464: truncate d2/d5/d9/f44 852896 0 2024-04-18T10:42:46.006 INFO:tasks.workunit.client.0.smithi040.stdout:6/446: chown df/c96 0 1 2024-04-18T10:42:46.007 INFO:tasks.workunit.client.0.smithi040.stdout:0/469: symlink dd/df/d19/d3e/lad 0 2024-04-18T10:42:46.007 INFO:tasks.workunit.client.0.smithi040.stdout:3/453: write d1/d2/f48 [620676,62227] 0 2024-04-18T10:42:46.008 INFO:tasks.workunit.client.0.smithi040.stdout:5/402: fsync d0/d3b/d67/f73 0 2024-04-18T10:42:46.012 INFO:tasks.workunit.client.0.smithi040.stdout:1/453: getdents d1/d1c/d2b/d32/d36/d4d/d67 0 2024-04-18T10:42:46.013 INFO:tasks.workunit.client.0.smithi040.stdout:5/403: read d0/f19 [3194379,14927] 0 2024-04-18T10:42:46.015 INFO:tasks.workunit.client.0.smithi040.stdout:8/465: link d2/f5e d2/d5/d9/f9d 0 2024-04-18T10:42:46.023 INFO:tasks.workunit.client.0.smithi040.stdout:1/454: chown d1/l1a 16079692 1 2024-04-18T10:42:46.024 INFO:tasks.workunit.client.0.smithi040.stdout:8/466: read - d2/d5/d9/d63/f64 zero size 2024-04-18T10:42:46.026 INFO:tasks.workunit.client.0.smithi040.stdout:2/380: dread dd/d14/d2f/f3a [0,4194304] 0 2024-04-18T10:42:46.027 INFO:tasks.workunit.client.0.smithi040.stdout:3/454: dwrite d1/d2/d16/d18/d3b/f3f [0,4194304] 0 2024-04-18T10:42:46.028 INFO:tasks.workunit.client.0.smithi040.stdout:5/404: write d0/d3/d47/f4a [1698669,8455] 0 2024-04-18T10:42:46.029 INFO:tasks.workunit.client.0.smithi040.stdout:8/467: symlink d2/d10/l9e 0 2024-04-18T10:42:46.030 INFO:tasks.workunit.client.0.smithi040.stdout:1/455: rename d1/cc to d1/d9b/d75/d84/caa 0 2024-04-18T10:42:46.031 INFO:tasks.workunit.client.0.smithi040.stdout:2/381: unlink dd/d14/d4a/d54/f55 0 2024-04-18T10:42:46.032 INFO:tasks.workunit.client.0.smithi040.stdout:2/382: fsync dd/f36 0 2024-04-18T10:42:46.034 INFO:tasks.workunit.client.0.smithi040.stdout:0/470: write dd/df/d19/d28/d3a/f4d [388033,129463] 0 2024-04-18T10:42:46.035 INFO:tasks.workunit.client.0.smithi040.stdout:8/468: mkdir d2/d10/d6a/d9f 0 2024-04-18T10:42:46.039 INFO:tasks.workunit.client.0.smithi040.stdout:2/383: rename dd/l3f to dd/d14/d44/d4c/d6b/l6c 0 2024-04-18T10:42:46.041 INFO:tasks.workunit.client.0.smithi040.stdout:0/471: dwrite dd/df/d19/d28/d3a/f64 [0,4194304] 0 2024-04-18T10:42:46.041 INFO:tasks.workunit.client.0.smithi040.stdout:8/469: rename d2/d5/d9/d3c/d5a/l46 to d2/d5/d9/d3c/d5a/la0 0 2024-04-18T10:42:46.042 INFO:tasks.workunit.client.0.smithi040.stdout:8/470: stat d2/d22/d49/f87 0 2024-04-18T10:42:46.044 INFO:tasks.workunit.client.0.smithi040.stdout:4/440: sync 2024-04-18T10:42:46.045 INFO:tasks.workunit.client.0.smithi040.stdout:0/472: creat dd/df/d19/d28/d3a/d42/fae x:0 0 0 2024-04-18T10:42:46.045 INFO:tasks.workunit.client.0.smithi040.stdout:4/441: write d2/f54 [366340,101280] 0 2024-04-18T10:42:46.045 INFO:tasks.workunit.client.0.smithi040.stdout:3/455: link d1/d7/l4b d1/d7/l9c 0 2024-04-18T10:42:46.046 INFO:tasks.workunit.client.0.smithi040.stdout:2/384: mknod dd/d14/d44/d5f/c6d 0 2024-04-18T10:42:46.047 INFO:tasks.workunit.client.0.smithi040.stdout:4/442: readlink d2/d3/d4/d1f/d29/d49/l60 0 2024-04-18T10:42:46.049 INFO:tasks.workunit.client.0.smithi040.stdout:8/471: mknod d2/ca1 0 2024-04-18T10:42:46.049 INFO:tasks.workunit.client.0.smithi040.stdout:5/405: dread d0/f19 [0,4194304] 0 2024-04-18T10:42:46.050 INFO:tasks.workunit.client.0.smithi040.stdout:3/456: creat d1/d7/d12/f9d x:0 0 0 2024-04-18T10:42:46.051 INFO:tasks.workunit.client.0.smithi040.stdout:0/473: mknod dd/df/d19/d28/d3a/d46/caf 0 2024-04-18T10:42:46.051 INFO:tasks.workunit.client.0.smithi040.stdout:8/472: read - d2/d5/d9/f9d zero size 2024-04-18T10:42:46.052 INFO:tasks.workunit.client.0.smithi040.stdout:4/443: creat d2/d3/d4/dd/d6d/d70/f7d x:0 0 0 2024-04-18T10:42:46.053 INFO:tasks.workunit.client.0.smithi040.stdout:5/406: write d0/d3/f36 [5527676,93749] 0 2024-04-18T10:42:46.054 INFO:tasks.workunit.client.0.smithi040.stdout:3/457: read d1/d2/d16/d18/f65 [30126,116916] 0 2024-04-18T10:42:46.056 INFO:tasks.workunit.client.0.smithi040.stdout:2/385: dwrite dd/d14/d2f/d37/f4b [0,4194304] 0 2024-04-18T10:42:46.060 INFO:tasks.workunit.client.0.smithi040.stdout:1/456: truncate d1/f23 1825093 0 2024-04-18T10:42:46.061 INFO:tasks.workunit.client.0.smithi040.stdout:0/474: creat dd/df/d19/d28/d3a/d42/fb0 x:0 0 0 2024-04-18T10:42:46.061 INFO:tasks.workunit.client.0.smithi040.stdout:5/407: creat d0/d78/f8b x:0 0 0 2024-04-18T10:42:46.063 INFO:tasks.workunit.client.0.smithi040.stdout:3/458: mkdir d1/d7/d3a/d9e 0 2024-04-18T10:42:46.064 INFO:tasks.workunit.client.0.smithi040.stdout:0/475: read dd/df/f1e [8348745,67883] 0 2024-04-18T10:42:46.066 INFO:tasks.workunit.client.0.smithi040.stdout:4/444: rename d2/d3/d4/dd/f44 to d2/d3/d2f/f7e 0 2024-04-18T10:42:46.068 INFO:tasks.workunit.client.0.smithi040.stdout:2/386: dwrite dd/f15 [4194304,4194304] 0 2024-04-18T10:42:46.070 INFO:tasks.workunit.client.0.smithi040.stdout:9/484: sync 2024-04-18T10:42:46.070 INFO:tasks.workunit.client.0.smithi040.stdout:7/447: sync 2024-04-18T10:42:46.072 INFO:tasks.workunit.client.0.smithi040.stdout:1/457: dwrite d1/d1c/d7b/d2d/f91 [0,4194304] 0 2024-04-18T10:42:46.074 INFO:tasks.workunit.client.0.smithi040.stdout:7/448: write d6/d25/d28/d2c/d2d/d47/f48 [3583350,46252] 0 2024-04-18T10:42:46.074 INFO:tasks.workunit.client.0.smithi040.stdout:4/445: mknod d2/d3/d41/d47/d6f/c7f 0 2024-04-18T10:42:46.077 INFO:tasks.workunit.client.0.smithi040.stdout:0/476: creat dd/df/d19/d3e/d75/fb1 x:0 0 0 2024-04-18T10:42:46.079 INFO:tasks.workunit.client.0.smithi040.stdout:9/485: creat d2/d3/d22/d2e/faa x:0 0 0 2024-04-18T10:42:46.082 INFO:tasks.workunit.client.0.smithi040.stdout:4/446: dwrite d2/d3/d41/d47/d6f/f75 [0,4194304] 0 2024-04-18T10:42:46.085 INFO:tasks.workunit.client.0.smithi040.stdout:8/473: dread d2/f2a [0,4194304] 0 2024-04-18T10:42:46.086 INFO:tasks.workunit.client.0.smithi040.stdout:7/449: mknod d6/d25/d28/d2c/d2d/d47/d55/c93 0 2024-04-18T10:42:46.087 INFO:tasks.workunit.client.0.smithi040.stdout:0/477: creat dd/df/d19/d3e/d77/fb2 x:0 0 0 2024-04-18T10:42:46.089 INFO:tasks.workunit.client.0.smithi040.stdout:0/478: fdatasync dd/df/d19/d3e/d77/fa2 0 2024-04-18T10:42:46.089 INFO:tasks.workunit.client.0.smithi040.stdout:7/450: truncate d6/d25/d28/d2c/d3c/f6d 279924 0 2024-04-18T10:42:46.091 INFO:tasks.workunit.client.0.smithi040.stdout:1/458: creat d1/d1c/d7b/d2e/d9e/fab x:0 0 0 2024-04-18T10:42:46.092 INFO:tasks.workunit.client.0.smithi040.stdout:3/459: getdents d1/d7/d3a 0 2024-04-18T10:42:46.093 INFO:tasks.workunit.client.0.smithi040.stdout:1/459: read d1/d1c/d2b/d32/d36/d4d/d67/f7a [2115986,34312] 0 2024-04-18T10:42:46.094 INFO:tasks.workunit.client.0.smithi040.stdout:1/460: chown d1/d9b/c5b 10 1 2024-04-18T10:42:46.095 INFO:tasks.workunit.client.0.smithi040.stdout:0/479: unlink dd/df/d19/d28/d3a/f64 0 2024-04-18T10:42:46.096 INFO:tasks.workunit.client.0.smithi040.stdout:4/447: creat d2/d3/d41/d62/d7c/f80 x:0 0 0 2024-04-18T10:42:46.097 INFO:tasks.workunit.client.0.smithi040.stdout:2/387: getdents dd/d14/d44/d5f 0 2024-04-18T10:42:46.098 INFO:tasks.workunit.client.0.smithi040.stdout:4/448: truncate d2/d3/d41/d47/f76 330651 0 2024-04-18T10:42:46.098 INFO:tasks.workunit.client.0.smithi040.stdout:8/474: mkdir d2/d22/d80/da2 0 2024-04-18T10:42:46.099 INFO:tasks.workunit.client.0.smithi040.stdout:9/486: creat d2/d5b/d6f/d80/fab x:0 0 0 2024-04-18T10:42:46.099 INFO:tasks.workunit.client.0.smithi040.stdout:5/408: dread d0/f2d [0,4194304] 0 2024-04-18T10:42:46.101 INFO:tasks.workunit.client.0.smithi040.stdout:9/487: read d2/d3/d22/f6a [312803,91572] 0 2024-04-18T10:42:46.101 INFO:tasks.workunit.client.0.smithi040.stdout:0/480: creat dd/df/d19/d3e/d77/fb3 x:0 0 0 2024-04-18T10:42:46.104 INFO:tasks.workunit.client.0.smithi040.stdout:3/460: link d1/d7/d67/f9a d1/d7/d12/f9f 0 2024-04-18T10:42:46.105 INFO:tasks.workunit.client.0.smithi040.stdout:8/475: rmdir d2/d22/d49 39 2024-04-18T10:42:46.107 INFO:tasks.workunit.client.0.smithi040.stdout:4/449: symlink d2/d3/d4/d23/l81 0 2024-04-18T10:42:46.109 INFO:tasks.workunit.client.0.smithi040.stdout:3/461: dread d1/d7/d3a/f3d [0,4194304] 0 2024-04-18T10:42:46.109 INFO:tasks.workunit.client.0.smithi040.stdout:5/409: symlink d0/d3b/d67/l8c 0 2024-04-18T10:42:46.109 INFO:tasks.workunit.client.0.smithi040.stdout:4/450: write d2/d3/d4/d1f/f66 [2488889,36239] 0 2024-04-18T10:42:46.110 INFO:tasks.workunit.client.0.smithi040.stdout:6/447: sync 2024-04-18T10:42:46.111 INFO:tasks.workunit.client.0.smithi040.stdout:4/451: chown d2/d3/d4/d1f/d29/d49/f65 6 1 2024-04-18T10:42:46.112 INFO:tasks.workunit.client.0.smithi040.stdout:7/451: link d6/d25/d28/d2c/f33 d6/f94 0 2024-04-18T10:42:46.113 INFO:tasks.workunit.client.0.smithi040.stdout:4/452: write d2/f54 [98435,81938] 0 2024-04-18T10:42:46.114 INFO:tasks.workunit.client.0.smithi040.stdout:0/481: symlink dd/df/d19/d28/d3a/d42/lb4 0 2024-04-18T10:42:46.118 INFO:tasks.workunit.client.0.smithi040.stdout:3/462: dwrite d1/d2/f1f [0,4194304] 0 2024-04-18T10:42:46.119 INFO:tasks.workunit.client.0.smithi040.stdout:2/388: dread dd/f56 [0,4194304] 0 2024-04-18T10:42:46.121 INFO:tasks.workunit.client.0.smithi040.stdout:5/410: rmdir d0/d1c/d52/d5d 39 2024-04-18T10:42:46.124 INFO:tasks.workunit.client.0.smithi040.stdout:6/448: write df/d4b/d6e/d3f/f5c [2714510,73245] 0 2024-04-18T10:42:46.126 INFO:tasks.workunit.client.0.smithi040.stdout:8/476: dread d2/d5/f96 [0,4194304] 0 2024-04-18T10:42:46.130 INFO:tasks.workunit.client.0.smithi040.stdout:7/452: symlink d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d64/d7e/l95 0 2024-04-18T10:42:46.130 INFO:tasks.workunit.client.0.smithi040.stdout:1/461: dwrite d1/d1c/d2b/d32/d36/f38 [0,4194304] 0 2024-04-18T10:42:46.131 INFO:tasks.workunit.client.0.smithi040.stdout:1/462: fsync d1/d16/f2a 0 2024-04-18T10:42:46.131 INFO:tasks.workunit.client.0.smithi040.stdout:3/463: unlink d1/f6 0 2024-04-18T10:42:46.132 INFO:tasks.workunit.client.0.smithi040.stdout:4/453: read d2/d3/d4/d1f/d29/d49/f32 [990416,69762] 0 2024-04-18T10:42:46.133 INFO:tasks.workunit.client.0.smithi040.stdout:7/453: chown d6/d25/d28/d2c/d2d/d47/f65 20394 1 2024-04-18T10:42:46.134 INFO:tasks.workunit.client.0.smithi040.stdout:7/454: chown d6/d25/c8f 185599052 1 2024-04-18T10:42:46.134 INFO:tasks.workunit.client.0.smithi040.stdout:0/482: mknod dd/df/cb5 0 2024-04-18T10:42:46.136 INFO:tasks.workunit.client.0.smithi040.stdout:0/483: fsync dd/df/d19/d28/d3a/f51 0 2024-04-18T10:42:46.136 INFO:tasks.workunit.client.0.smithi040.stdout:8/477: mknod d2/d10/d14/ca3 0 2024-04-18T10:42:46.137 INFO:tasks.workunit.client.0.smithi040.stdout:8/478: write d2/d10/d14/f8c [26587,81306] 0 2024-04-18T10:42:46.141 INFO:tasks.workunit.client.0.smithi040.stdout:3/464: mknod d1/d2/d16/d18/ca0 0 2024-04-18T10:42:46.143 INFO:tasks.workunit.client.0.smithi040.stdout:9/488: write d2/d3/d22/f45 [4237333,46354] 0 2024-04-18T10:42:46.144 INFO:tasks.workunit.client.0.smithi040.stdout:4/454: write d2/d3/f59 [2853121,72718] 0 2024-04-18T10:42:46.144 INFO:tasks.workunit.client.0.smithi040.stdout:1/463: mkdir d1/d9b/d75/d84/dac 0 2024-04-18T10:42:46.146 INFO:tasks.workunit.client.0.smithi040.stdout:7/455: creat d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/d8a/f96 x:0 0 0 2024-04-18T10:42:46.151 INFO:tasks.workunit.client.0.smithi040.stdout:4/455: creat d2/d3/d41/d47/f82 x:0 0 0 2024-04-18T10:42:46.155 INFO:tasks.workunit.client.0.smithi040.stdout:7/456: read d6/d25/d28/f4b [3619996,35021] 0 2024-04-18T10:42:46.158 INFO:tasks.workunit.client.0.smithi040.stdout:2/389: rename dd/d14/d2b/l32 to dd/l6e 0 2024-04-18T10:42:46.159 INFO:tasks.workunit.client.0.smithi040.stdout:4/456: dwrite d2/d3/d4/dd/d6d/d70/f7d [0,4194304] 0 2024-04-18T10:42:46.160 INFO:tasks.workunit.client.0.smithi040.stdout:5/411: truncate d0/d3/f36 5958094 0 2024-04-18T10:42:46.160 INFO:tasks.workunit.client.0.smithi040.stdout:6/449: getdents df/d76/d91 0 2024-04-18T10:42:46.165 INFO:tasks.workunit.client.0.smithi040.stdout:9/489: dread d2/d3/d22/f45 [0,4194304] 0 2024-04-18T10:42:46.165 INFO:tasks.workunit.client.0.smithi040.stdout:8/479: creat d2/d22/fa4 x:0 0 0 2024-04-18T10:42:46.167 INFO:tasks.workunit.client.0.smithi040.stdout:6/450: dwrite df/f13 [0,4194304] 0 2024-04-18T10:42:46.168 INFO:tasks.workunit.client.0.smithi040.stdout:3/465: link d1/d2/d16/d18/d3b/c42 d1/d7/d28/d81/ca1 0 2024-04-18T10:42:46.169 INFO:tasks.workunit.client.0.smithi040.stdout:7/457: rmdir d6/d25/d28/d2c/d2d/d47/d5c/d6b 39 2024-04-18T10:42:46.171 INFO:tasks.workunit.client.0.smithi040.stdout:2/390: chown c3 7 1 2024-04-18T10:42:46.171 INFO:tasks.workunit.client.0.smithi040.stdout:0/484: rename dd/df/f26 to dd/d91/fb6 0 2024-04-18T10:42:46.172 INFO:tasks.workunit.client.0.smithi040.stdout:2/391: chown dd/c4e 452 1 2024-04-18T10:42:46.174 INFO:tasks.workunit.client.0.smithi040.stdout:2/392: chown dd/l13 191215 1 2024-04-18T10:42:46.175 INFO:tasks.workunit.client.0.smithi040.stdout:6/451: dread df/f13 [0,4194304] 0 2024-04-18T10:42:46.175 INFO:tasks.workunit.client.0.smithi040.stdout:8/480: dwrite d2/d10/d14/f9c [4194304,4194304] 0 2024-04-18T10:42:46.176 INFO:tasks.workunit.client.0.smithi040.stdout:2/393: dread - dd/d14/d4a/f5a zero size 2024-04-18T10:42:46.176 INFO:tasks.workunit.client.0.smithi040.stdout:6/452: readlink df/d4b/d6e/l74 0 2024-04-18T10:42:46.177 INFO:tasks.workunit.client.0.smithi040.stdout:6/453: chown df/d4b/c9a 2 1 2024-04-18T10:42:46.178 INFO:tasks.workunit.client.0.smithi040.stdout:6/454: fdatasync df/d4b/d7e/f83 0 2024-04-18T10:42:46.179 INFO:tasks.workunit.client.0.smithi040.stdout:9/490: symlink d2/d3/d97/lac 0 2024-04-18T10:42:46.186 INFO:tasks.workunit.client.0.smithi040.stdout:8/481: write d2/d5/d9/d3c/d68/f69 [3466468,57178] 0 2024-04-18T10:42:46.187 INFO:tasks.workunit.client.0.smithi040.stdout:1/464: dwrite d1/d1c/d2b/d32/d35/fa6 [0,4194304] 0 2024-04-18T10:42:46.187 INFO:tasks.workunit.client.0.smithi040.stdout:4/457: rename d2/d3/d4/l2b to d2/d3/d4/l83 0 2024-04-18T10:42:46.188 INFO:tasks.workunit.client.0.smithi040.stdout:1/465: fsync d1/d9b/f9c 0 2024-04-18T10:42:46.188 INFO:tasks.workunit.client.0.smithi040.stdout:9/491: mknod d2/d3/d22/d2e/cad 0 2024-04-18T10:42:46.189 INFO:tasks.workunit.client.0.smithi040.stdout:0/485: mkdir dd/df/d19/d28/db7 0 2024-04-18T10:42:46.191 INFO:tasks.workunit.client.0.smithi040.stdout:8/482: chown d2/d22/d49/d79 1779466 1 2024-04-18T10:42:46.194 INFO:tasks.workunit.client.0.smithi040.stdout:6/455: dread df/f55 [0,4194304] 0 2024-04-18T10:42:46.194 INFO:tasks.workunit.client.0.smithi040.stdout:6/456: chown df/c96 152 1 2024-04-18T10:42:46.197 INFO:tasks.workunit.client.0.smithi040.stdout:9/492: rename d2/f82 to d2/d5b/fae 0 2024-04-18T10:42:46.198 INFO:tasks.workunit.client.0.smithi040.stdout:5/412: link d0/d3b/l46 d0/d3b/d3f/l8d 0 2024-04-18T10:42:46.200 INFO:tasks.workunit.client.0.smithi040.stdout:2/394: creat dd/f6f x:0 0 0 2024-04-18T10:42:46.200 INFO:tasks.workunit.client.0.smithi040.stdout:4/458: dread d2/f54 [0,4194304] 0 2024-04-18T10:42:46.202 INFO:tasks.workunit.client.0.smithi040.stdout:0/486: unlink dd/df/d19/d3e/da5/fa9 0 2024-04-18T10:42:46.203 INFO:tasks.workunit.client.0.smithi040.stdout:0/487: readlink dd/df/d19/d3e/lad 0 2024-04-18T10:42:46.203 INFO:tasks.workunit.client.0.smithi040.stdout:8/483: mknod d2/d10/d14/ca5 0 2024-04-18T10:42:46.205 INFO:tasks.workunit.client.0.smithi040.stdout:1/466: mkdir d1/d16/d92/dad 0 2024-04-18T10:42:46.206 INFO:tasks.workunit.client.0.smithi040.stdout:6/457: readlink df/d4b/d6e/l64 0 2024-04-18T10:42:46.207 INFO:tasks.workunit.client.0.smithi040.stdout:5/413: readlink d0/d4e/l6a 0 2024-04-18T10:42:46.209 INFO:tasks.workunit.client.0.smithi040.stdout:2/395: creat dd/d61/f70 x:0 0 0 2024-04-18T10:42:46.209 INFO:tasks.workunit.client.0.smithi040.stdout:1/467: write d1/d1c/d7b/f98 [316170,51207] 0 2024-04-18T10:42:46.210 INFO:tasks.workunit.client.0.smithi040.stdout:3/466: dwrite d1/d2/d16/f2c [0,4194304] 0 2024-04-18T10:42:46.210 INFO:tasks.workunit.client.0.smithi040.stdout:4/459: creat d2/d3/d41/d62/d7c/f84 x:0 0 0 2024-04-18T10:42:46.241 INFO:tasks.workunit.client.0.smithi040.stdout:9/493: mkdir d2/d3/d22/d2e/d35/daf 0 2024-04-18T10:42:46.242 INFO:tasks.workunit.client.0.smithi040.stdout:3/467: fdatasync d1/d2/f17 0 2024-04-18T10:42:46.243 INFO:tasks.workunit.client.0.smithi040.stdout:7/458: dwrite d6/f94 [0,4194304] 0 2024-04-18T10:42:46.247 INFO:tasks.workunit.client.0.smithi040.stdout:0/488: mkdir dd/df/db8 0 2024-04-18T10:42:46.249 INFO:tasks.workunit.client.0.smithi040.stdout:9/494: creat d2/dc/d46/d44/fb0 x:0 0 0 2024-04-18T10:42:46.250 INFO:tasks.workunit.client.0.smithi040.stdout:1/468: rename d1/d9b/d75/d84/f8f to d1/d1c/d2b/d32/d36/fae 0 2024-04-18T10:42:46.250 INFO:tasks.workunit.client.0.smithi040.stdout:2/396: chown dd/d14/d2f/d37/d5b/c6a 96 1 2024-04-18T10:42:46.250 INFO:tasks.workunit.client.0.smithi040.stdout:8/484: dwrite d2/d5/d9/f29 [0,4194304] 0 2024-04-18T10:42:46.253 INFO:tasks.workunit.client.0.smithi040.stdout:5/414: dwrite d0/d3b/d3f/f41 [0,4194304] 0 2024-04-18T10:42:46.254 INFO:tasks.workunit.client.0.smithi040.stdout:1/469: fsync d1/d1c/d2b/d32/d36/f50 0 2024-04-18T10:42:46.254 INFO:tasks.workunit.client.0.smithi040.stdout:9/495: write d2/d3/d22/d2e/d35/d40/f5e [492744,66128] 0 2024-04-18T10:42:46.255 INFO:tasks.workunit.client.0.smithi040.stdout:5/415: chown d0/d4e/f5e 401 1 2024-04-18T10:42:46.255 INFO:tasks.workunit.client.0.smithi040.stdout:3/468: unlink d1/d2/d16/f2c 0 2024-04-18T10:42:46.257 INFO:tasks.workunit.client.0.smithi040.stdout:1/470: chown d1/d1c/d2b/d32/d36/d4d/d67 49 1 2024-04-18T10:42:46.257 INFO:tasks.workunit.client.0.smithi040.stdout:7/459: rmdir d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d64/d7e 39 2024-04-18T10:42:46.258 INFO:tasks.workunit.client.0.smithi040.stdout:1/471: read d1/d1c/d2b/d32/d36/f38 [2148371,107163] 0 2024-04-18T10:42:46.259 INFO:tasks.workunit.client.0.smithi040.stdout:0/489: mknod dd/cb9 0 2024-04-18T10:42:46.259 INFO:tasks.workunit.client.0.smithi040.stdout:8/485: creat d2/d5/d9/d1b/fa6 x:0 0 0 2024-04-18T10:42:46.260 INFO:tasks.workunit.client.0.smithi040.stdout:7/460: write d6/d25/d28/d2c/d2d/d47/f65 [1450741,48084] 0 2024-04-18T10:42:46.266 INFO:tasks.workunit.client.0.smithi040.stdout:8/486: dwrite d2/d2c/f3b [0,4194304] 0 2024-04-18T10:42:46.266 INFO:tasks.workunit.client.0.smithi040.stdout:1/472: read d1/d1c/d2b/d32/d36/d4d/d67/f8e [2568970,29869] 0 2024-04-18T10:42:46.266 INFO:tasks.workunit.client.0.smithi040.stdout:2/397: link dd/f56 dd/d14/d4a/f71 0 2024-04-18T10:42:46.268 INFO:tasks.workunit.client.0.smithi040.stdout:8/487: read d2/d10/d6a/f70 [3255819,98641] 0 2024-04-18T10:42:46.268 INFO:tasks.workunit.client.0.smithi040.stdout:0/490: dread dd/df/d19/d28/f4c [0,4194304] 0 2024-04-18T10:42:46.275 INFO:tasks.workunit.client.0.smithi040.stdout:8/488: creat d2/d22/d49/d79/fa7 x:0 0 0 2024-04-18T10:42:46.276 INFO:tasks.workunit.client.0.smithi040.stdout:0/491: dwrite dd/df/d19/d3e/d77/f90 [0,4194304] 0 2024-04-18T10:42:46.277 INFO:tasks.workunit.client.0.smithi040.stdout:3/469: getdents d1/d7/d12/d7b 0 2024-04-18T10:42:46.278 INFO:tasks.workunit.client.0.smithi040.stdout:0/492: fdatasync dd/df/d19/f45 0 2024-04-18T10:42:46.280 INFO:tasks.workunit.client.0.smithi040.stdout:8/489: creat d2/d5/fa8 x:0 0 0 2024-04-18T10:42:46.281 INFO:tasks.workunit.client.0.smithi040.stdout:0/493: mkdir dd/df/d19/dba 0 2024-04-18T10:42:46.284 INFO:tasks.workunit.client.0.smithi040.stdout:0/494: mknod dd/df/cbb 0 2024-04-18T10:42:46.286 INFO:tasks.workunit.client.0.smithi040.stdout:0/495: creat dd/df/d19/d28/d3a/d5b/d8f/fbc x:0 0 0 2024-04-18T10:42:46.288 INFO:tasks.workunit.client.0.smithi040.stdout:0/496: mknod dd/df/d19/d28/cbd 0 2024-04-18T10:42:46.289 INFO:tasks.workunit.client.0.smithi040.stdout:4/460: write d2/d3/d2f/f46 [1254607,91259] 0 2024-04-18T10:42:46.291 INFO:tasks.workunit.client.0.smithi040.stdout:0/497: creat dd/df/d19/d28/d3a/d46/fbe x:0 0 0 2024-04-18T10:42:46.292 INFO:tasks.workunit.client.0.smithi040.stdout:4/461: creat d2/d3/d41/d47/d6f/f85 x:0 0 0 2024-04-18T10:42:46.293 INFO:tasks.workunit.client.0.smithi040.stdout:4/462: write d2/d3/d41/d47/d6f/f75 [2620309,49845] 0 2024-04-18T10:42:46.293 INFO:tasks.workunit.client.0.smithi040.stdout:0/498: creat dd/d91/fbf x:0 0 0 2024-04-18T10:42:46.299 INFO:tasks.workunit.client.0.smithi040.stdout:0/499: dread dd/df/d4e/fa4 [0,4194304] 0 2024-04-18T10:42:46.300 INFO:tasks.workunit.client.0.smithi040.stdout:0/500: stat dd/df/d19/d28/c48 0 2024-04-18T10:42:46.305 INFO:tasks.workunit.client.0.smithi040.stdout:0/501: link dd/df/cb5 dd/df/d19/d28/d3a/d42/cc0 0 2024-04-18T10:42:46.305 INFO:tasks.workunit.client.0.smithi040.stdout:3/470: dread d1/d7/f53 [0,4194304] 0 2024-04-18T10:42:46.308 INFO:tasks.workunit.client.0.smithi040.stdout:0/502: mknod dd/df/cc1 0 2024-04-18T10:42:46.312 INFO:tasks.workunit.client.0.smithi040.stdout:2/398: write dd/f45 [3472483,66457] 0 2024-04-18T10:42:46.313 INFO:tasks.workunit.client.0.smithi040.stdout:1/473: truncate d1/d1c/d2b/d32/d36/fae 1441064 0 2024-04-18T10:42:46.314 INFO:tasks.workunit.client.0.smithi040.stdout:5/416: dread d0/d3b/d67/f68 [0,4194304] 0 2024-04-18T10:42:46.317 INFO:tasks.workunit.client.0.smithi040.stdout:2/399: write dd/d61/f68 [261784,45039] 0 2024-04-18T10:42:46.317 INFO:tasks.workunit.client.0.smithi040.stdout:6/458: sync 2024-04-18T10:42:46.317 INFO:tasks.workunit.client.0.smithi040.stdout:3/471: dwrite d1/d2/d16/d18/d3b/f3f [0,4194304] 0 2024-04-18T10:42:46.319 INFO:tasks.workunit.client.0.smithi040.stdout:0/503: rename dd/df/d19/d3e/l70 to dd/df/d19/d28/d3a/lc2 0 2024-04-18T10:42:46.319 INFO:tasks.workunit.client.0.smithi040.stdout:7/461: dread d6/d25/d28/f4b [0,4194304] 0 2024-04-18T10:42:46.322 INFO:tasks.workunit.client.0.smithi040.stdout:4/463: truncate d2/d3/d4/dd/d6d/d70/f7d 2367285 0 2024-04-18T10:42:46.322 INFO:tasks.workunit.client.0.smithi040.stdout:5/417: mkdir d0/d4e/d8e 0 2024-04-18T10:42:46.323 INFO:tasks.workunit.client.0.smithi040.stdout:1/474: creat d1/d1c/d2b/d32/d36/d4d/d67/faf x:0 0 0 2024-04-18T10:42:46.323 INFO:tasks.workunit.client.0.smithi040.stdout:9/496: dwrite d2/d3/d22/f3c [0,4194304] 0 2024-04-18T10:42:46.324 INFO:tasks.workunit.client.0.smithi040.stdout:5/418: chown d0/d3 21774993 1 2024-04-18T10:42:46.327 INFO:tasks.workunit.client.0.smithi040.stdout:1/475: write d1/f69 [4419742,61384] 0 2024-04-18T10:42:46.327 INFO:tasks.workunit.client.0.smithi040.stdout:9/497: dread - d2/d3/f6e zero size 2024-04-18T10:42:46.328 INFO:tasks.workunit.client.0.smithi040.stdout:6/459: creat df/d76/d91/fa1 x:0 0 0 2024-04-18T10:42:46.328 INFO:tasks.workunit.client.0.smithi040.stdout:8/490: dread d2/d5/d9/d3c/d5a/f56 [0,4194304] 0 2024-04-18T10:42:46.330 INFO:tasks.workunit.client.0.smithi040.stdout:1/476: readlink d1/d1c/d2b/d32/d35/l97 0 2024-04-18T10:42:46.332 INFO:tasks.workunit.client.0.smithi040.stdout:1/477: dread - d1/fa5 zero size 2024-04-18T10:42:46.332 INFO:tasks.workunit.client.0.smithi040.stdout:7/462: dwrite d6/f44 [0,4194304] 0 2024-04-18T10:42:46.333 INFO:tasks.workunit.client.0.smithi040.stdout:1/478: fdatasync d1/d1c/d7b/d2e/f93 0 2024-04-18T10:42:46.334 INFO:tasks.workunit.client.0.smithi040.stdout:2/400: mkdir dd/d14/d44/d4c/d63/d72 0 2024-04-18T10:42:46.335 INFO:tasks.workunit.client.0.smithi040.stdout:8/491: read d2/d5/d9/d3c/d68/f69 [4454800,65648] 0 2024-04-18T10:42:46.337 INFO:tasks.workunit.client.0.smithi040.stdout:5/419: rename d0/d3/d6b/f7c to d0/d21/d42/f8f 0 2024-04-18T10:42:46.338 INFO:tasks.workunit.client.0.smithi040.stdout:8/492: write d2/d5/d9/d3c/f6f [713331,45434] 0 2024-04-18T10:42:46.339 INFO:tasks.workunit.client.0.smithi040.stdout:6/460: creat df/d4b/d7e/fa2 x:0 0 0 2024-04-18T10:42:46.340 INFO:tasks.workunit.client.0.smithi040.stdout:7/463: dwrite d6/d3e/f69 [0,4194304] 0 2024-04-18T10:42:46.340 INFO:tasks.workunit.client.0.smithi040.stdout:9/498: mknod d2/d3/d22/d2e/cb1 0 2024-04-18T10:42:46.341 INFO:tasks.workunit.client.0.smithi040.stdout:0/504: write dd/f1d [2904028,47215] 0 2024-04-18T10:42:46.341 INFO:tasks.workunit.client.0.smithi040.stdout:8/493: chown d2/d5/d9/d3c/d5a/l1d 1463362 1 2024-04-18T10:42:46.343 INFO:tasks.workunit.client.0.smithi040.stdout:1/479: rmdir d1/d1c/d7b/d2d 39 2024-04-18T10:42:46.344 INFO:tasks.workunit.client.0.smithi040.stdout:1/480: write d1/d1c/d7b/d2e/d39/f4f [3446170,14099] 0 2024-04-18T10:42:46.348 INFO:tasks.workunit.client.0.smithi040.stdout:2/401: rename dd/d14/d2f/f4f to dd/d14/d44/f73 0 2024-04-18T10:42:46.349 INFO:tasks.workunit.client.0.smithi040.stdout:7/464: read d6/d25/d28/d2c/d3c/f6d [261210,9108] 0 2024-04-18T10:42:46.351 INFO:tasks.workunit.client.0.smithi040.stdout:1/481: dwrite d1/d1c/f56 [0,4194304] 0 2024-04-18T10:42:46.351 INFO:tasks.workunit.client.0.smithi040.stdout:8/494: mkdir d2/d2c/da9 0 2024-04-18T10:42:46.354 INFO:tasks.workunit.client.0.smithi040.stdout:1/482: chown d1/d1c/d2b/l96 10271 1 2024-04-18T10:42:46.354 INFO:tasks.workunit.client.0.smithi040.stdout:5/420: creat d0/d3b/d88/f90 x:0 0 0 2024-04-18T10:42:46.356 INFO:tasks.workunit.client.0.smithi040.stdout:1/483: chown d1/d1c/l20 230630 1 2024-04-18T10:42:46.357 INFO:tasks.workunit.client.0.smithi040.stdout:2/402: dwrite f9 [0,4194304] 0 2024-04-18T10:42:46.358 INFO:tasks.workunit.client.0.smithi040.stdout:3/472: dread d1/d2/d16/f25 [0,4194304] 0 2024-04-18T10:42:46.359 INFO:tasks.workunit.client.0.smithi040.stdout:3/473: read - d1/d7/d28/d81/f85 zero size 2024-04-18T10:42:46.360 INFO:tasks.workunit.client.0.smithi040.stdout:8/495: rename d2/d22/d49/f87 to d2/d10/d14/faa 0 2024-04-18T10:42:46.361 INFO:tasks.workunit.client.0.smithi040.stdout:5/421: rmdir d0/d78 39 2024-04-18T10:42:46.362 INFO:tasks.workunit.client.0.smithi040.stdout:5/422: stat d0/d3b/d67 0 2024-04-18T10:42:46.362 INFO:tasks.workunit.client.0.smithi040.stdout:1/484: symlink d1/d1c/d7b/d2e/d9e/lb0 0 2024-04-18T10:42:46.364 INFO:tasks.workunit.client.0.smithi040.stdout:2/403: creat dd/d14/d2f/d37/f74 x:0 0 0 2024-04-18T10:42:46.366 INFO:tasks.workunit.client.0.smithi040.stdout:2/404: write dd/d14/d4a/f5a [829339,109037] 0 2024-04-18T10:42:46.367 INFO:tasks.workunit.client.0.smithi040.stdout:8/496: mknod d2/d10/d6a/cab 0 2024-04-18T10:42:46.368 INFO:tasks.workunit.client.0.smithi040.stdout:7/465: creat d6/d25/d28/d2c/d2d/d47/d5c/f97 x:0 0 0 2024-04-18T10:42:46.371 INFO:tasks.workunit.client.0.smithi040.stdout:4/464: write d2/d3/d4/dd/d6d/d70/f7d [120745,129022] 0 2024-04-18T10:42:46.372 INFO:tasks.workunit.client.0.smithi040.stdout:4/465: readlink d2/d3/d4/d21/d28/d3f/l1c 0 2024-04-18T10:42:46.372 INFO:tasks.workunit.client.0.smithi040.stdout:2/405: creat dd/d14/d2f/d37/d5b/f75 x:0 0 0 2024-04-18T10:42:46.376 INFO:tasks.workunit.client.0.smithi040.stdout:7/466: mknod d6/d3e/d73/c98 0 2024-04-18T10:42:46.379 INFO:tasks.workunit.client.0.smithi040.stdout:7/467: mkdir d6/d3e/d99 0 2024-04-18T10:42:46.387 INFO:tasks.workunit.client.0.smithi040.stdout:6/461: truncate f4 2653058 0 2024-04-18T10:42:46.388 INFO:tasks.workunit.client.0.smithi040.stdout:3/474: write d1/d7/d67/f9a [632099,20013] 0 2024-04-18T10:42:46.389 INFO:tasks.workunit.client.0.smithi040.stdout:9/499: dread d2/d5b/f48 [0,4194304] 0 2024-04-18T10:42:46.389 INFO:tasks.workunit.client.0.smithi040.stdout:8/497: write d2/d5/d9/fb [1215260,123812] 0 2024-04-18T10:42:46.393 INFO:tasks.workunit.client.0.smithi040.stdout:8/498: mknod d2/d22/d49/cac 0 2024-04-18T10:42:46.395 INFO:tasks.workunit.client.0.smithi040.stdout:0/505: sync 2024-04-18T10:42:46.397 INFO:tasks.workunit.client.0.smithi040.stdout:6/462: rename df/c14 to df/d76/ca3 0 2024-04-18T10:42:46.398 INFO:tasks.workunit.client.0.smithi040.stdout:7/468: dread d6/f14 [4194304,4194304] 0 2024-04-18T10:42:46.398 INFO:tasks.workunit.client.0.smithi040.stdout:5/423: dread d0/d3/f5 [0,4194304] 0 2024-04-18T10:42:46.401 INFO:tasks.workunit.client.0.smithi040.stdout:7/469: chown d6/d3e/d99 2 1 2024-04-18T10:42:46.404 INFO:tasks.workunit.client.0.smithi040.stdout:2/406: dread dd/f17 [0,4194304] 0 2024-04-18T10:42:46.405 INFO:tasks.workunit.client.0.smithi040.stdout:6/463: unlink df/d4b/d6e/c79 0 2024-04-18T10:42:46.405 INFO:tasks.workunit.client.0.smithi040.stdout:0/506: write dd/df/d19/d3e/d75/fb1 [585801,66294] 0 2024-04-18T10:42:46.405 INFO:tasks.workunit.client.0.smithi040.stdout:1/485: dwrite d1/d16/f3b [0,4194304] 0 2024-04-18T10:42:46.405 INFO:tasks.workunit.client.0.smithi040.stdout:4/466: dread d2/d3/d4/d1f/f66 [0,4194304] 0 2024-04-18T10:42:46.407 INFO:tasks.workunit.client.0.smithi040.stdout:5/424: chown d0/d21/d42/c6d 157 1 2024-04-18T10:42:46.407 INFO:tasks.workunit.client.0.smithi040.stdout:9/500: dwrite d2/dd/de/f58 [0,4194304] 0 2024-04-18T10:42:46.408 INFO:tasks.workunit.client.0.smithi040.stdout:2/407: write dd/f28 [57988,128755] 0 2024-04-18T10:42:46.409 INFO:tasks.workunit.client.0.smithi040.stdout:6/464: write df/d4b/d6a/d93/f47 [976371,124053] 0 2024-04-18T10:42:46.410 INFO:tasks.workunit.client.0.smithi040.stdout:9/501: write d2/d3/d22/d2e/f76 [74895,115262] 0 2024-04-18T10:42:46.415 INFO:tasks.workunit.client.0.smithi040.stdout:2/408: write dd/f15 [2006512,85543] 0 2024-04-18T10:42:46.416 INFO:tasks.workunit.client.0.smithi040.stdout:3/475: rename d1/d2/d16/f36 to d1/fa2 0 2024-04-18T10:42:46.417 INFO:tasks.workunit.client.0.smithi040.stdout:4/467: rmdir d2/d3/d4/dd/d6d/d70 39 2024-04-18T10:42:46.417 INFO:tasks.workunit.client.0.smithi040.stdout:6/465: write df/f67 [2993365,73544] 0 2024-04-18T10:42:46.418 INFO:tasks.workunit.client.0.smithi040.stdout:6/466: dread - df/d76/f84 zero size 2024-04-18T10:42:46.420 INFO:tasks.workunit.client.0.smithi040.stdout:8/499: link d2/d15/d2b/d40/c98 d2/d5/d9/d3c/d5a/cad 0 2024-04-18T10:42:46.420 INFO:tasks.workunit.client.0.smithi040.stdout:1/486: mkdir d1/db1 0 2024-04-18T10:42:46.423 INFO:tasks.workunit.client.0.smithi040.stdout:9/502: creat d2/d3/d70/fb2 x:0 0 0 2024-04-18T10:42:46.423 INFO:tasks.workunit.client.0.smithi040.stdout:3/476: creat d1/d2/d3c/fa3 x:0 0 0 2024-04-18T10:42:46.426 INFO:tasks.workunit.client.0.smithi040.stdout:8/500: creat d2/d5/d9/d63/fae x:0 0 0 2024-04-18T10:42:46.427 INFO:tasks.workunit.client.0.smithi040.stdout:1/487: fdatasync d1/d1c/d2b/d32/d36/f38 0 2024-04-18T10:42:46.427 INFO:tasks.workunit.client.0.smithi040.stdout:8/501: write d2/f6c [1819429,52030] 0 2024-04-18T10:42:46.427 INFO:tasks.workunit.client.0.smithi040.stdout:5/425: getdents d0/d3b 0 2024-04-18T10:42:46.434 INFO:tasks.workunit.client.0.smithi040.stdout:6/467: creat df/d4b/d6e/d3f/d53/d8a/fa4 x:0 0 0 2024-04-18T10:42:46.437 INFO:tasks.workunit.client.0.smithi040.stdout:7/470: dread d6/d25/d28/f66 [0,4194304] 0 2024-04-18T10:42:46.438 INFO:tasks.workunit.client.0.smithi040.stdout:9/503: mkdir d2/d3/d22/db3 0 2024-04-18T10:42:46.438 INFO:tasks.workunit.client.0.smithi040.stdout:7/471: write d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/d8a/f96 [91335,89979] 0 2024-04-18T10:42:46.440 INFO:tasks.workunit.client.0.smithi040.stdout:8/502: rmdir d2/d10/d14 39 2024-04-18T10:42:46.444 INFO:tasks.workunit.client.0.smithi040.stdout:1/488: symlink d1/db1/lb2 0 2024-04-18T10:42:46.445 INFO:tasks.workunit.client.0.smithi040.stdout:9/504: mkdir d2/dd/db4 0 2024-04-18T10:42:46.446 INFO:tasks.workunit.client.0.smithi040.stdout:7/472: mkdir d6/d50/d79/d9a 0 2024-04-18T10:42:46.447 INFO:tasks.workunit.client.0.smithi040.stdout:3/477: rmdir d1 39 2024-04-18T10:42:46.449 INFO:tasks.workunit.client.0.smithi040.stdout:4/468: truncate d2/d3/f68 394048 0 2024-04-18T10:42:46.449 INFO:tasks.workunit.client.0.smithi040.stdout:2/409: link dd/d14/l18 dd/d14/d44/d4c/d49/l76 0 2024-04-18T10:42:46.450 INFO:tasks.workunit.client.0.smithi040.stdout:4/469: dread d2/f54 [0,4194304] 0 2024-04-18T10:42:46.454 INFO:tasks.workunit.client.0.smithi040.stdout:6/468: dread df/f27 [0,4194304] 0 2024-04-18T10:42:46.456 INFO:tasks.workunit.client.0.smithi040.stdout:4/470: creat d2/d3/d41/d62/f86 x:0 0 0 2024-04-18T10:42:46.456 INFO:tasks.workunit.client.0.smithi040.stdout:7/473: mknod d6/d3e/d99/c9b 0 2024-04-18T10:42:46.457 INFO:tasks.workunit.client.0.smithi040.stdout:8/503: creat d2/d10/faf x:0 0 0 2024-04-18T10:42:46.458 INFO:tasks.workunit.client.0.smithi040.stdout:5/426: link d0/d4e/c6e d0/d21/d42/d76/c91 0 2024-04-18T10:42:46.460 INFO:tasks.workunit.client.0.smithi040.stdout:6/469: write df/d4b/d6a/d93/f56 [657950,29376] 0 2024-04-18T10:42:46.461 INFO:tasks.workunit.client.0.smithi040.stdout:2/410: dwrite dd/f28 [0,4194304] 0 2024-04-18T10:42:46.461 INFO:tasks.workunit.client.0.smithi040.stdout:1/489: getdents d1/d1c 0 2024-04-18T10:42:46.464 INFO:tasks.workunit.client.0.smithi040.stdout:9/505: dread d2/f55 [0,4194304] 0 2024-04-18T10:42:46.466 INFO:tasks.workunit.client.0.smithi040.stdout:5/427: write d0/d3b/d3f/f41 [3774910,68401] 0 2024-04-18T10:42:46.467 INFO:tasks.workunit.client.0.smithi040.stdout:6/470: dread - df/d4b/d6e/d3f/f75 zero size 2024-04-18T10:42:46.467 INFO:tasks.workunit.client.0.smithi040.stdout:1/490: symlink d1/d9b/lb3 0 2024-04-18T10:42:46.468 INFO:tasks.workunit.client.0.smithi040.stdout:3/478: dwrite d1/d2/f1f [0,4194304] 0 2024-04-18T10:42:46.470 INFO:tasks.workunit.client.0.smithi040.stdout:2/411: write dd/f17 [2338884,47749] 0 2024-04-18T10:42:46.470 INFO:tasks.workunit.client.0.smithi040.stdout:0/507: sync 2024-04-18T10:42:46.473 INFO:tasks.workunit.client.0.smithi040.stdout:4/471: dread d2/d3/d41/d47/d6f/f75 [0,4194304] 0 2024-04-18T10:42:46.474 INFO:tasks.workunit.client.0.smithi040.stdout:8/504: rename d2/d5/d9/d3c/d68/f7a to d2/d5/d9/d3c/d68/fb0 0 2024-04-18T10:42:46.475 INFO:tasks.workunit.client.0.smithi040.stdout:8/505: truncate d2/d5/d9/d1b/f4f 224620 0 2024-04-18T10:42:46.476 INFO:tasks.workunit.client.0.smithi040.stdout:8/506: write d2/d15/d2b/f92 [133661,14168] 0 2024-04-18T10:42:46.477 INFO:tasks.workunit.client.0.smithi040.stdout:1/491: creat d1/d1c/d7b/d2e/fb4 x:0 0 0 2024-04-18T10:42:46.478 INFO:tasks.workunit.client.0.smithi040.stdout:6/471: creat df/d76/d91/fa5 x:0 0 0 2024-04-18T10:42:46.478 INFO:tasks.workunit.client.0.smithi040.stdout:5/428: rmdir d0/d1c/d52/d5d 39 2024-04-18T10:42:46.482 INFO:tasks.workunit.client.0.smithi040.stdout:0/508: unlink dd/df/d19/l69 0 2024-04-18T10:42:46.483 INFO:tasks.workunit.client.0.smithi040.stdout:2/412: mkdir dd/d14/d44/d77 0 2024-04-18T10:42:46.484 INFO:tasks.workunit.client.0.smithi040.stdout:4/472: readlink d2/d3/d4/d1f/d29/d49/l16 0 2024-04-18T10:42:46.484 INFO:tasks.workunit.client.0.smithi040.stdout:2/413: truncate dd/f6f 920191 0 2024-04-18T10:42:46.485 INFO:tasks.workunit.client.0.smithi040.stdout:8/507: symlink d2/d5/d9/d1b/lb1 0 2024-04-18T10:42:46.486 INFO:tasks.workunit.client.0.smithi040.stdout:6/472: creat df/d4b/d99/fa6 x:0 0 0 2024-04-18T10:42:46.487 INFO:tasks.workunit.client.0.smithi040.stdout:5/429: readlink d0/d78/l87 0 2024-04-18T10:42:46.487 INFO:tasks.workunit.client.0.smithi040.stdout:7/474: link d6/l16 d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/l9c 0 2024-04-18T10:42:46.488 INFO:tasks.workunit.client.0.smithi040.stdout:0/509: mkdir dd/df/d4e/dc3 0 2024-04-18T10:42:46.489 INFO:tasks.workunit.client.0.smithi040.stdout:2/414: mknod dd/d14/d4a/c78 0 2024-04-18T10:42:46.489 INFO:tasks.workunit.client.0.smithi040.stdout:4/473: symlink d2/d3/d4/d21/l87 0 2024-04-18T10:42:46.490 INFO:tasks.workunit.client.0.smithi040.stdout:1/492: fsync d1/d1c/d2b/d32/d36/d4d/d67/f8e 0 2024-04-18T10:42:46.494 INFO:tasks.workunit.client.0.smithi040.stdout:7/475: chown d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/f7d 6 1 2024-04-18T10:42:46.494 INFO:tasks.workunit.client.0.smithi040.stdout:6/473: readlink df/l4f 0 2024-04-18T10:42:46.495 INFO:tasks.workunit.client.0.smithi040.stdout:8/508: dwrite d2/d22/f85 [0,4194304] 0 2024-04-18T10:42:46.503 INFO:tasks.workunit.client.0.smithi040.stdout:2/415: creat dd/d14/d2f/d37/f79 x:0 0 0 2024-04-18T10:42:46.503 INFO:tasks.workunit.client.0.smithi040.stdout:1/493: write d1/d1c/d2b/d32/d36/f50 [7850822,9135] 0 2024-04-18T10:42:46.504 INFO:tasks.workunit.client.0.smithi040.stdout:0/510: rename dd/df/d19/d28/cbd to dd/df/d19/d28/d3a/cc4 0 2024-04-18T10:42:46.505 INFO:tasks.workunit.client.0.smithi040.stdout:3/479: dread d1/d7/d67/f76 [0,4194304] 0 2024-04-18T10:42:46.515 INFO:tasks.workunit.client.0.smithi040.stdout:9/506: dwrite d2/dc/f73 [0,4194304] 0 2024-04-18T10:42:46.517 INFO:tasks.workunit.client.0.smithi040.stdout:0/511: creat dd/df/d19/d28/d3a/d5b/fc5 x:0 0 0 2024-04-18T10:42:46.519 INFO:tasks.workunit.client.0.smithi040.stdout:5/430: dwrite d0/d3b/d3f/f62 [0,4194304] 0 2024-04-18T10:42:46.521 INFO:tasks.workunit.client.0.smithi040.stdout:7/476: getdents d6/d25/d28/d2c/d2d/d47/d5c 0 2024-04-18T10:42:46.521 INFO:tasks.workunit.client.0.smithi040.stdout:0/512: chown dd/df/d4e/f55 756 1 2024-04-18T10:42:46.522 INFO:tasks.workunit.client.0.smithi040.stdout:2/416: dread dd/f15 [4194304,4194304] 0 2024-04-18T10:42:46.524 INFO:tasks.workunit.client.0.smithi040.stdout:3/480: getdents d1/d2/d4e/d57 0 2024-04-18T10:42:46.524 INFO:tasks.workunit.client.0.smithi040.stdout:0/513: fsync dd/df/d19/d28/d3a/f9d 0 2024-04-18T10:42:46.525 INFO:tasks.workunit.client.0.smithi040.stdout:0/514: fsync dd/df/d19/f22 0 2024-04-18T10:42:46.526 INFO:tasks.workunit.client.0.smithi040.stdout:2/417: symlink dd/d14/d44/l7a 0 2024-04-18T10:42:46.527 INFO:tasks.workunit.client.0.smithi040.stdout:0/515: dread - dd/df/d19/d3e/d77/f8e zero size 2024-04-18T10:42:46.527 INFO:tasks.workunit.client.0.smithi040.stdout:7/477: readlink d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/l81 0 2024-04-18T10:42:46.528 INFO:tasks.workunit.client.0.smithi040.stdout:5/431: truncate d0/f25 4212683 0 2024-04-18T10:42:46.529 INFO:tasks.workunit.client.0.smithi040.stdout:3/481: write d1/d7/d12/f30 [140574,122813] 0 2024-04-18T10:42:46.533 INFO:tasks.workunit.client.0.smithi040.stdout:7/478: creat d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/f9d x:0 0 0 2024-04-18T10:42:46.534 INFO:tasks.workunit.client.0.smithi040.stdout:5/432: mknod d0/d3/c92 0 2024-04-18T10:42:46.535 INFO:tasks.workunit.client.0.smithi040.stdout:2/418: write dd/d14/d44/d4c/f5c [730851,17454] 0 2024-04-18T10:42:46.536 INFO:tasks.workunit.client.0.smithi040.stdout:7/479: write d6/d50/f6e [229428,76688] 0 2024-04-18T10:42:46.536 INFO:tasks.workunit.client.0.smithi040.stdout:0/516: rmdir dd/df/db8 0 2024-04-18T10:42:46.539 INFO:tasks.workunit.client.0.smithi040.stdout:3/482: dwrite d1/d2/d4e/f84 [0,4194304] 0 2024-04-18T10:42:46.540 INFO:tasks.workunit.client.0.smithi040.stdout:2/419: symlink dd/d14/d44/d4c/d49/l7b 0 2024-04-18T10:42:46.541 INFO:tasks.workunit.client.0.smithi040.stdout:7/480: write d6/d25/d28/f87 [820694,3928] 0 2024-04-18T10:42:46.541 INFO:tasks.workunit.client.0.smithi040.stdout:0/517: dread - dd/df/d19/d28/d3a/d42/fb0 zero size 2024-04-18T10:42:46.544 INFO:tasks.workunit.client.0.smithi040.stdout:3/483: symlink d1/d2/d16/d18/d91/la4 0 2024-04-18T10:42:46.545 INFO:tasks.workunit.client.0.smithi040.stdout:4/474: dread d2/d3/d4/dd/f22 [0,4194304] 0 2024-04-18T10:42:46.546 INFO:tasks.workunit.client.0.smithi040.stdout:7/481: mknod d6/d25/d28/d2c/d3c/c9e 0 2024-04-18T10:42:46.546 INFO:tasks.workunit.client.0.smithi040.stdout:3/484: chown d1/d2/d4e/d58/d8e 815 1 2024-04-18T10:42:46.546 INFO:tasks.workunit.client.0.smithi040.stdout:9/507: dread d2/d3/f4e [0,4194304] 0 2024-04-18T10:42:46.549 INFO:tasks.workunit.client.0.smithi040.stdout:6/474: dread df/f2f [0,4194304] 0 2024-04-18T10:42:46.549 INFO:tasks.workunit.client.0.smithi040.stdout:2/420: rename dd/d14/d2f to dd/d14/d2b/d7c 0 2024-04-18T10:42:46.550 INFO:tasks.workunit.client.0.smithi040.stdout:6/475: read df/f13 [585155,7010] 0 2024-04-18T10:42:46.550 INFO:tasks.workunit.client.0.smithi040.stdout:0/518: symlink dd/df/d19/d28/d3a/d5b/lc6 0 2024-04-18T10:42:46.552 INFO:tasks.workunit.client.0.smithi040.stdout:1/494: dread d1/d9b/d75/f95 [0,4194304] 0 2024-04-18T10:42:46.553 INFO:tasks.workunit.client.0.smithi040.stdout:7/482: chown d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d64/d7e 17860 1 2024-04-18T10:42:46.553 INFO:tasks.workunit.client.0.smithi040.stdout:6/476: truncate df/d76/d91/fa1 560999 0 2024-04-18T10:42:46.554 INFO:tasks.workunit.client.0.smithi040.stdout:4/475: creat d2/d3/d4/d1f/d29/d49/d31/f88 x:0 0 0 2024-04-18T10:42:46.560 INFO:tasks.workunit.client.0.smithi040.stdout:7/483: mkdir d6/d25/d28/d2c/d2d/d47/d55/d9f 0 2024-04-18T10:42:46.561 INFO:tasks.workunit.client.0.smithi040.stdout:6/477: dwrite df/d4b/d6e/f1e [0,4194304] 0 2024-04-18T10:42:46.561 INFO:tasks.workunit.client.0.smithi040.stdout:3/485: getdents d1/d7/d28/d81 0 2024-04-18T10:42:46.562 INFO:tasks.workunit.client.0.smithi040.stdout:8/509: sync 2024-04-18T10:42:46.562 INFO:tasks.workunit.client.0.smithi040.stdout:7/484: write d6/d25/d28/f87 [939419,13507] 0 2024-04-18T10:42:46.563 INFO:tasks.workunit.client.0.smithi040.stdout:1/495: mkdir d1/d1c/d2b/db5 0 2024-04-18T10:42:46.563 INFO:tasks.workunit.client.0.smithi040.stdout:1/496: stat d1/d1c 0 2024-04-18T10:42:46.565 INFO:tasks.workunit.client.0.smithi040.stdout:8/510: write d2/d5/d9/f44 [1461750,17555] 0 2024-04-18T10:42:46.566 INFO:tasks.workunit.client.0.smithi040.stdout:7/485: stat d6/d25/d28/d2c/d2d/d47/f72 0 2024-04-18T10:42:46.566 INFO:tasks.workunit.client.0.smithi040.stdout:0/519: getdents dd/df/d4e 0 2024-04-18T10:42:46.567 INFO:tasks.workunit.client.0.smithi040.stdout:4/476: creat d2/d3/d4/dd/f89 x:0 0 0 2024-04-18T10:42:46.569 INFO:tasks.workunit.client.0.smithi040.stdout:6/478: mkdir df/d4b/d6e/d3f/d53/d8a/d95/da7 0 2024-04-18T10:42:46.574 INFO:tasks.workunit.client.0.smithi040.stdout:0/520: unlink dd/df/c79 0 2024-04-18T10:42:46.575 INFO:tasks.workunit.client.0.smithi040.stdout:4/477: write d2/f54 [507431,1451] 0 2024-04-18T10:42:46.575 INFO:tasks.workunit.client.0.smithi040.stdout:5/433: dread d0/d4e/f4c [0,4194304] 0 2024-04-18T10:42:46.576 INFO:tasks.workunit.client.0.smithi040.stdout:7/486: chown d6/d25/d28/d2c/c34 732947 1 2024-04-18T10:42:46.577 INFO:tasks.workunit.client.0.smithi040.stdout:8/511: creat d2/d5/d9/d3c/d5a/fb2 x:0 0 0 2024-04-18T10:42:46.577 INFO:tasks.workunit.client.0.smithi040.stdout:5/434: dread - d0/d21/d42/f55 zero size 2024-04-18T10:42:46.580 INFO:tasks.workunit.client.0.smithi040.stdout:5/435: fsync d0/d3b/d67/f84 0 2024-04-18T10:42:46.580 INFO:tasks.workunit.client.0.smithi040.stdout:1/497: creat d1/d9b/d75/d84/dac/fb6 x:0 0 0 2024-04-18T10:42:46.581 INFO:tasks.workunit.client.0.smithi040.stdout:4/478: creat d2/d3/d41/d47/d6f/f8a x:0 0 0 2024-04-18T10:42:46.582 INFO:tasks.workunit.client.0.smithi040.stdout:8/512: chown d2/d5/d9/d1b/l2e 0 1 2024-04-18T10:42:46.583 INFO:tasks.workunit.client.0.smithi040.stdout:7/487: mknod d6/d25/d28/d2c/d2d/d47/ca0 0 2024-04-18T10:42:46.586 INFO:tasks.workunit.client.0.smithi040.stdout:2/421: dread dd/d14/d44/f73 [0,4194304] 0 2024-04-18T10:42:46.586 INFO:tasks.workunit.client.0.smithi040.stdout:0/521: dwrite dd/df/d19/d3e/d77/fa2 [0,4194304] 0 2024-04-18T10:42:46.588 INFO:tasks.workunit.client.0.smithi040.stdout:1/498: dread d1/d1c/d7b/f98 [0,4194304] 0 2024-04-18T10:42:46.588 INFO:tasks.workunit.client.0.smithi040.stdout:4/479: dread - d2/d3/d4/d1f/d29/d49/d31/f88 zero size 2024-04-18T10:42:46.590 INFO:tasks.workunit.client.0.smithi040.stdout:7/488: truncate d6/d25/f46 5120505 0 2024-04-18T10:42:46.591 INFO:tasks.workunit.client.0.smithi040.stdout:3/486: write d1/d7/d12/f22 [4165646,126359] 0 2024-04-18T10:42:46.593 INFO:tasks.workunit.client.0.smithi040.stdout:6/479: truncate df/d4b/f68 1731769 0 2024-04-18T10:42:46.594 INFO:tasks.workunit.client.0.smithi040.stdout:7/489: fsync d6/d50/f6e 0 2024-04-18T10:42:46.594 INFO:tasks.workunit.client.0.smithi040.stdout:8/513: rmdir d2/d10/d6a/d9f 0 2024-04-18T10:42:46.596 INFO:tasks.workunit.client.0.smithi040.stdout:0/522: creat dd/df/d19/d3e/fc7 x:0 0 0 2024-04-18T10:42:46.596 INFO:tasks.workunit.client.0.smithi040.stdout:9/508: dwrite d2/dd/de/f61 [0,4194304] 0 2024-04-18T10:42:46.598 INFO:tasks.workunit.client.0.smithi040.stdout:5/436: dwrite d0/d78/f81 [0,4194304] 0 2024-04-18T10:42:46.599 INFO:tasks.workunit.client.0.smithi040.stdout:3/487: symlink d1/d7/d3a/la5 0 2024-04-18T10:42:46.600 INFO:tasks.workunit.client.0.smithi040.stdout:0/523: fdatasync dd/df/d19/d3e/d77/fb2 0 2024-04-18T10:42:46.600 INFO:tasks.workunit.client.0.smithi040.stdout:3/488: stat d1/d2/d4e/d57/c7f 0 2024-04-18T10:42:46.601 INFO:tasks.workunit.client.0.smithi040.stdout:3/489: chown d1/l5a 12 1 2024-04-18T10:42:46.601 INFO:tasks.workunit.client.0.smithi040.stdout:1/499: unlink d1/d1c/d7b/d2d/l6f 0 2024-04-18T10:42:46.602 INFO:tasks.workunit.client.0.smithi040.stdout:3/490: dread - d1/d2/d3c/f83 zero size 2024-04-18T10:42:46.603 INFO:tasks.workunit.client.0.smithi040.stdout:1/500: chown d1/d1c/d2b/d32/d36/fae 473 1 2024-04-18T10:42:46.604 INFO:tasks.workunit.client.0.smithi040.stdout:6/480: unlink df/d4b/d6e/d3f/d53/f7d 0 2024-04-18T10:42:46.606 INFO:tasks.workunit.client.0.smithi040.stdout:4/480: mknod d2/d3/d4/dd/d4f/c8b 0 2024-04-18T10:42:46.606 INFO:tasks.workunit.client.0.smithi040.stdout:6/481: fdatasync df/d4b/d6a/d93/f31 0 2024-04-18T10:42:46.608 INFO:tasks.workunit.client.0.smithi040.stdout:5/437: symlink d0/d3b/d67/l93 0 2024-04-18T10:42:46.608 INFO:tasks.workunit.client.0.smithi040.stdout:8/514: dwrite d2/f2a [0,4194304] 0 2024-04-18T10:42:46.609 INFO:tasks.workunit.client.0.smithi040.stdout:6/482: dread - df/d4b/d6a/d93/f8e zero size 2024-04-18T10:42:46.609 INFO:tasks.workunit.client.0.smithi040.stdout:4/481: read d2/d3/d4/dd/d4f/f5f [1054329,74884] 0 2024-04-18T10:42:46.611 INFO:tasks.workunit.client.0.smithi040.stdout:6/483: truncate df/d4b/d6a/d93/f8e 609706 0 2024-04-18T10:42:46.611 INFO:tasks.workunit.client.0.smithi040.stdout:9/509: creat d2/d5b/d6f/d80/d75/fb5 x:0 0 0 2024-04-18T10:42:46.615 INFO:tasks.workunit.client.0.smithi040.stdout:1/501: symlink d1/d1c/d7b/d2d/lb7 0 2024-04-18T10:42:46.615 INFO:tasks.workunit.client.0.smithi040.stdout:4/482: dwrite d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:46.616 INFO:tasks.workunit.client.0.smithi040.stdout:1/502: readlink d1/d1c/d7b/l4c 0 2024-04-18T10:42:46.618 INFO:tasks.workunit.client.0.smithi040.stdout:6/484: stat df/l86 0 2024-04-18T10:42:46.623 INFO:tasks.workunit.client.0.smithi040.stdout:4/483: creat d2/d3/d4/dd/d4f/f8c x:0 0 0 2024-04-18T10:42:46.624 INFO:tasks.workunit.client.0.smithi040.stdout:1/503: symlink d1/d1c/d7b/d2e/d9e/lb8 0 2024-04-18T10:42:46.625 INFO:tasks.workunit.client.0.smithi040.stdout:9/510: mknod d2/cb6 0 2024-04-18T10:42:46.626 INFO:tasks.workunit.client.0.smithi040.stdout:9/511: dread - d2/dd/f98 zero size 2024-04-18T10:42:46.626 INFO:tasks.workunit.client.0.smithi040.stdout:9/512: chown d2/d7/ca2 203 1 2024-04-18T10:42:46.627 INFO:tasks.workunit.client.0.smithi040.stdout:9/513: fsync d2/d3/d70/f81 0 2024-04-18T10:42:46.627 INFO:tasks.workunit.client.0.smithi040.stdout:7/490: rename d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/f9d to d6/d25/d28/fa1 0 2024-04-18T10:42:46.628 INFO:tasks.workunit.client.0.smithi040.stdout:3/491: link d1/d7/l8a d1/d2/d4e/d58/d62/d6b/la6 0 2024-04-18T10:42:46.629 INFO:tasks.workunit.client.0.smithi040.stdout:7/491: read - d6/d25/d28/d2c/d2d/d47/f52 zero size 2024-04-18T10:42:46.630 INFO:tasks.workunit.client.0.smithi040.stdout:3/492: write d1/d7/d67/f9a [1543145,92553] 0 2024-04-18T10:42:46.632 INFO:tasks.workunit.client.0.smithi040.stdout:5/438: rename d0/d21/f3a to d0/d3b/d88/f94 0 2024-04-18T10:42:46.635 INFO:tasks.workunit.client.0.smithi040.stdout:3/493: mknod d1/d7/d26/ca7 0 2024-04-18T10:42:46.636 INFO:tasks.workunit.client.0.smithi040.stdout:7/492: mkdir d6/d25/d28/d2c/d2d/d47/d5c/da2 0 2024-04-18T10:42:46.637 INFO:tasks.workunit.client.0.smithi040.stdout:9/514: creat d2/d3/d22/db3/fb7 x:0 0 0 2024-04-18T10:42:46.638 INFO:tasks.workunit.client.0.smithi040.stdout:8/515: rename d2/d22/c39 to d2/d4c/d97/cb3 0 2024-04-18T10:42:46.639 INFO:tasks.workunit.client.0.smithi040.stdout:1/504: link d1/d1c/d7b/f98 d1/d1c/d2b/fb9 0 2024-04-18T10:42:46.640 INFO:tasks.workunit.client.0.smithi040.stdout:1/505: write d1/d1c/f56 [4728775,55891] 0 2024-04-18T10:42:46.640 INFO:tasks.workunit.client.0.smithi040.stdout:2/422: truncate dd/f28 509949 0 2024-04-18T10:42:46.642 INFO:tasks.workunit.client.0.smithi040.stdout:3/494: write d1/d7/d28/f61 [664213,96247] 0 2024-04-18T10:42:46.642 INFO:tasks.workunit.client.0.smithi040.stdout:7/493: fsync d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/f7d 0 2024-04-18T10:42:46.643 INFO:tasks.workunit.client.0.smithi040.stdout:3/495: chown d1/d7/d3a/f3d 0 1 2024-04-18T10:42:46.643 INFO:tasks.workunit.client.0.smithi040.stdout:6/485: rename df/d4b/d6a/d93/c1c to df/d4b/d99/ca8 0 2024-04-18T10:42:46.647 INFO:tasks.workunit.client.0.smithi040.stdout:2/423: symlink dd/d14/d2b/d7c/d37/l7d 0 2024-04-18T10:42:46.648 INFO:tasks.workunit.client.0.smithi040.stdout:1/506: symlink d1/d1c/d2b/d32/d36/d4d/d67/lba 0 2024-04-18T10:42:46.649 INFO:tasks.workunit.client.0.smithi040.stdout:1/507: stat d1/d1c/d2b/d32/d36/f59 0 2024-04-18T10:42:46.649 INFO:tasks.workunit.client.0.smithi040.stdout:7/494: chown d6/d50/l7c 1728 1 2024-04-18T10:42:46.650 INFO:tasks.workunit.client.0.smithi040.stdout:3/496: creat d1/d7/d3a/fa8 x:0 0 0 2024-04-18T10:42:46.652 INFO:tasks.workunit.client.0.smithi040.stdout:5/439: rename d0/d1c to d0/d78/d95 0 2024-04-18T10:42:46.653 INFO:tasks.workunit.client.0.smithi040.stdout:8/516: creat d2/d5/d9/d3c/d5a/d94/fb4 x:0 0 0 2024-04-18T10:42:46.654 INFO:tasks.workunit.client.0.smithi040.stdout:2/424: rmdir dd/d14/d44/d4c/d49 39 2024-04-18T10:42:46.654 INFO:tasks.workunit.client.0.smithi040.stdout:0/524: write dd/d62/f76 [642536,72019] 0 2024-04-18T10:42:46.655 INFO:tasks.workunit.client.0.smithi040.stdout:1/508: symlink d1/d1c/d7b/d2e/da4/lbb 0 2024-04-18T10:42:46.658 INFO:tasks.workunit.client.0.smithi040.stdout:1/509: dread - d1/d1c/d2b/d32/f53 zero size 2024-04-18T10:42:46.658 INFO:tasks.workunit.client.0.smithi040.stdout:3/497: dwrite d1/d7/d28/f61 [0,4194304] 0 2024-04-18T10:42:46.660 INFO:tasks.workunit.client.0.smithi040.stdout:9/515: rename d2/dc/d46/d44/l91 to d2/d3/d97/lb8 0 2024-04-18T10:42:46.662 INFO:tasks.workunit.client.0.smithi040.stdout:8/517: mknod d2/d5/d9/d3c/cb5 0 2024-04-18T10:42:46.664 INFO:tasks.workunit.client.0.smithi040.stdout:8/518: write d2/d2c/f3b [3810699,15810] 0 2024-04-18T10:42:46.664 INFO:tasks.workunit.client.0.smithi040.stdout:0/525: dwrite dd/df/d19/d3e/d77/f8e [0,4194304] 0 2024-04-18T10:42:46.665 INFO:tasks.workunit.client.0.smithi040.stdout:2/425: creat dd/d14/d44/d4c/d6b/f7e x:0 0 0 2024-04-18T10:42:46.666 INFO:tasks.workunit.client.0.smithi040.stdout:1/510: creat d1/d16/d92/fbc x:0 0 0 2024-04-18T10:42:46.667 INFO:tasks.workunit.client.0.smithi040.stdout:1/511: truncate d1/d1c/d2b/d32/f4e 408691 0 2024-04-18T10:42:46.672 INFO:tasks.workunit.client.0.smithi040.stdout:4/484: dwrite d2/d3/d4/d21/d28/d3f/f39 [0,4194304] 0 2024-04-18T10:42:46.678 INFO:tasks.workunit.client.0.smithi040.stdout:2/426: creat dd/d14/d2b/d7c/d37/d5b/f7f x:0 0 0 2024-04-18T10:42:46.680 INFO:tasks.workunit.client.0.smithi040.stdout:0/526: dread dd/d62/f7f [0,4194304] 0 2024-04-18T10:42:46.685 INFO:tasks.workunit.client.0.smithi040.stdout:5/440: link d0/d3b/d3f/d72/c8a d0/d3b/c96 0 2024-04-18T10:42:46.685 INFO:tasks.workunit.client.0.smithi040.stdout:0/527: dwrite dd/f1d [0,4194304] 0 2024-04-18T10:42:46.686 INFO:tasks.workunit.client.0.smithi040.stdout:9/516: creat d2/d3/d22/d2e/d35/daf/fb9 x:0 0 0 2024-04-18T10:42:46.686 INFO:tasks.workunit.client.0.smithi040.stdout:2/427: dread dd/d14/f47 [4194304,4194304] 0 2024-04-18T10:42:46.688 INFO:tasks.workunit.client.0.smithi040.stdout:7/495: write d6/d25/d28/d2c/d2d/d47/d5c/f5f [563169,13929] 0 2024-04-18T10:42:46.689 INFO:tasks.workunit.client.0.smithi040.stdout:9/517: write d2/d3/f65 [5188774,63744] 0 2024-04-18T10:42:46.690 INFO:tasks.workunit.client.0.smithi040.stdout:8/519: unlink d2/d5/l4d 0 2024-04-18T10:42:46.695 INFO:tasks.workunit.client.0.smithi040.stdout:8/520: dwrite d2/d15/d78/f8d [0,4194304] 0 2024-04-18T10:42:46.695 INFO:tasks.workunit.client.0.smithi040.stdout:8/521: readlink d2/d10/l48 0 2024-04-18T10:42:46.696 INFO:tasks.workunit.client.0.smithi040.stdout:8/522: fsync d2/d5/d9/fb 0 2024-04-18T10:42:46.696 INFO:tasks.workunit.client.0.smithi040.stdout:6/486: rename df/d4b/d6e/f8d to df/d76/fa9 0 2024-04-18T10:42:46.697 INFO:tasks.workunit.client.0.smithi040.stdout:8/523: fsync d2/d15/d2b/f7f 0 2024-04-18T10:42:46.698 INFO:tasks.workunit.client.0.smithi040.stdout:6/487: write df/d4b/d6a/d93/f3d [347979,120049] 0 2024-04-18T10:42:46.702 INFO:tasks.workunit.client.0.smithi040.stdout:0/528: mknod dd/df/d19/d28/d3a/d5b/cc8 0 2024-04-18T10:42:46.703 INFO:tasks.workunit.client.0.smithi040.stdout:4/485: symlink d2/d3/d4/dd/d6d/l8d 0 2024-04-18T10:42:46.704 INFO:tasks.workunit.client.0.smithi040.stdout:2/428: mkdir dd/d14/d2b/d7c/d37/d80 0 2024-04-18T10:42:46.705 INFO:tasks.workunit.client.0.smithi040.stdout:7/496: creat d6/d3e/d99/fa3 x:0 0 0 2024-04-18T10:42:46.706 INFO:tasks.workunit.client.0.smithi040.stdout:3/498: truncate d1/f74 217439 0 2024-04-18T10:42:46.708 INFO:tasks.workunit.client.0.smithi040.stdout:9/518: truncate d2/d7/f5a 2376152 0 2024-04-18T10:42:46.712 INFO:tasks.workunit.client.0.smithi040.stdout:2/429: dwrite dd/d14/f22 [0,4194304] 0 2024-04-18T10:42:46.714 INFO:tasks.workunit.client.0.smithi040.stdout:8/524: rmdir d2/d22/d49/d79 39 2024-04-18T10:42:46.715 INFO:tasks.workunit.client.0.smithi040.stdout:1/512: dwrite d1/d1c/d2b/fb9 [0,4194304] 0 2024-04-18T10:42:46.718 INFO:tasks.workunit.client.0.smithi040.stdout:0/529: creat dd/df/d19/d28/d3a/d5b/d8f/fc9 x:0 0 0 2024-04-18T10:42:46.725 INFO:tasks.workunit.client.0.smithi040.stdout:7/497: symlink d6/d25/d28/d2c/d2d/d47/la4 0 2024-04-18T10:42:46.725 INFO:tasks.workunit.client.0.smithi040.stdout:9/519: creat d2/d3/d22/d2e/d35/daf/fba x:0 0 0 2024-04-18T10:42:46.728 INFO:tasks.workunit.client.0.smithi040.stdout:6/488: symlink df/laa 0 2024-04-18T10:42:46.730 INFO:tasks.workunit.client.0.smithi040.stdout:5/441: symlink d0/d3b/d3f/l97 0 2024-04-18T10:42:46.732 INFO:tasks.workunit.client.0.smithi040.stdout:7/498: dwrite d6/d25/d28/d2c/d2d/d47/f72 [0,4194304] 0 2024-04-18T10:42:46.733 INFO:tasks.workunit.client.0.smithi040.stdout:4/486: mkdir d2/d1a/d8e 0 2024-04-18T10:42:46.734 INFO:tasks.workunit.client.0.smithi040.stdout:4/487: readlink d2/d3/d4/d21/l87 0 2024-04-18T10:42:46.743 INFO:tasks.workunit.client.0.smithi040.stdout:8/525: creat d2/d10/d14/fb6 x:0 0 0 2024-04-18T10:42:46.743 INFO:tasks.workunit.client.0.smithi040.stdout:1/513: link d1/d16/f1b d1/d1c/d7b/d2e/da4/fbd 0 2024-04-18T10:42:46.744 INFO:tasks.workunit.client.0.smithi040.stdout:5/442: chown d0/d3/c18 7158 1 2024-04-18T10:42:46.745 INFO:tasks.workunit.client.0.smithi040.stdout:1/514: write d1/d1c/d7b/d2e/f93 [573212,92707] 0 2024-04-18T10:42:46.745 INFO:tasks.workunit.client.0.smithi040.stdout:0/530: link dd/df/f40 dd/df/d19/d3e/da5/fca 0 2024-04-18T10:42:46.746 INFO:tasks.workunit.client.0.smithi040.stdout:1/515: chown d1/d1c/d7b/d2d/f63 185598 1 2024-04-18T10:42:46.747 INFO:tasks.workunit.client.0.smithi040.stdout:0/531: readlink dd/df/d19/d28/d3a/d46/l6f 0 2024-04-18T10:42:46.747 INFO:tasks.workunit.client.0.smithi040.stdout:1/516: readlink d1/d1c/d7b/d2e/l57 0 2024-04-18T10:42:46.749 INFO:tasks.workunit.client.0.smithi040.stdout:2/430: rmdir dd/d14/d2b/d7c/d37/d80 0 2024-04-18T10:42:46.750 INFO:tasks.workunit.client.0.smithi040.stdout:9/520: mkdir d2/d3/d22/d2e/d35/dbb 0 2024-04-18T10:42:46.751 INFO:tasks.workunit.client.0.smithi040.stdout:7/499: creat d6/d50/d79/d90/fa5 x:0 0 0 2024-04-18T10:42:46.752 INFO:tasks.workunit.client.0.smithi040.stdout:8/526: symlink d2/d2c/lb7 0 2024-04-18T10:42:46.755 INFO:tasks.workunit.client.0.smithi040.stdout:3/499: getdents d1/d7/d28 0 2024-04-18T10:42:46.757 INFO:tasks.workunit.client.0.smithi040.stdout:0/532: rmdir dd/df/d19/d28/d3a 39 2024-04-18T10:42:46.758 INFO:tasks.workunit.client.0.smithi040.stdout:8/527: dwrite d2/d22/f85 [0,4194304] 0 2024-04-18T10:42:46.759 INFO:tasks.workunit.client.0.smithi040.stdout:1/517: rename d1/d16/f2a to d1/d16/d92/dad/fbe 0 2024-04-18T10:42:46.759 INFO:tasks.workunit.client.0.smithi040.stdout:2/431: mkdir dd/d61/d81 0 2024-04-18T10:42:46.761 INFO:tasks.workunit.client.0.smithi040.stdout:9/521: unlink d2/d5b/f48 0 2024-04-18T10:42:46.762 INFO:tasks.workunit.client.0.smithi040.stdout:6/489: creat df/fab x:0 0 0 2024-04-18T10:42:46.765 INFO:tasks.workunit.client.0.smithi040.stdout:7/500: rmdir d6/d25/d28 39 2024-04-18T10:42:46.766 INFO:tasks.workunit.client.0.smithi040.stdout:7/501: fsync d6/f32 0 2024-04-18T10:42:46.768 INFO:tasks.workunit.client.0.smithi040.stdout:5/443: mknod d0/d4e/d8e/c98 0 2024-04-18T10:42:46.768 INFO:tasks.workunit.client.0.smithi040.stdout:3/500: symlink d1/d7/d26/la9 0 2024-04-18T10:42:46.772 INFO:tasks.workunit.client.0.smithi040.stdout:7/502: dwrite d6/d3e/d99/fa3 [0,4194304] 0 2024-04-18T10:42:46.775 INFO:tasks.workunit.client.0.smithi040.stdout:2/432: rename dd/d14/d44/d4c/d63 to dd/d14/d44/d5f/d82 0 2024-04-18T10:42:46.776 INFO:tasks.workunit.client.0.smithi040.stdout:8/528: read d2/f67 [1963151,97461] 0 2024-04-18T10:42:46.776 INFO:tasks.workunit.client.0.smithi040.stdout:9/522: mknod d2/d3/d22/d2e/d35/d40/d71/cbc 0 2024-04-18T10:42:46.777 INFO:tasks.workunit.client.0.smithi040.stdout:9/523: fsync d2/dd/f98 0 2024-04-18T10:42:46.777 INFO:tasks.workunit.client.0.smithi040.stdout:6/490: creat df/d4b/d6e/d3f/d53/d8a/fac x:0 0 0 2024-04-18T10:42:46.779 INFO:tasks.workunit.client.0.smithi040.stdout:9/524: write d2/d3/d22/d2e/f7b [1082726,80378] 0 2024-04-18T10:42:46.781 INFO:tasks.workunit.client.0.smithi040.stdout:5/444: stat d0/d3b/d67/l8c 0 2024-04-18T10:42:46.784 INFO:tasks.workunit.client.0.smithi040.stdout:0/533: creat dd/df/d19/d28/d3a/d42/fcb x:0 0 0 2024-04-18T10:42:46.787 INFO:tasks.workunit.client.0.smithi040.stdout:3/501: rename d1/d2/d3c/fa3 to d1/d2/d4e/d58/d62/faa 0 2024-04-18T10:42:46.787 INFO:tasks.workunit.client.0.smithi040.stdout:8/529: dwrite d2/d5/d9/d3c/f52 [0,4194304] 0 2024-04-18T10:42:46.788 INFO:tasks.workunit.client.0.smithi040.stdout:5/445: truncate d0/d21/d42/f6c 1558065 0 2024-04-18T10:42:46.788 INFO:tasks.workunit.client.0.smithi040.stdout:4/488: write d2/d3/d2f/f35 [1505602,17236] 0 2024-04-18T10:42:46.790 INFO:tasks.workunit.client.0.smithi040.stdout:6/491: dwrite df/f4d [0,4194304] 0 2024-04-18T10:42:46.794 INFO:tasks.workunit.client.0.smithi040.stdout:8/530: write d2/d10/d14/fb6 [839939,54849] 0 2024-04-18T10:42:46.795 INFO:tasks.workunit.client.0.smithi040.stdout:9/525: dwrite d2/dd/de/f58 [4194304,4194304] 0 2024-04-18T10:42:46.796 INFO:tasks.workunit.client.0.smithi040.stdout:5/446: write d0/d4e/f4c [1226580,78234] 0 2024-04-18T10:42:46.796 INFO:tasks.workunit.client.0.smithi040.stdout:3/502: truncate d1/d7/d28/d81/f85 834578 0 2024-04-18T10:42:46.796 INFO:tasks.workunit.client.0.smithi040.stdout:4/489: symlink d2/d1a/l8f 0 2024-04-18T10:42:46.798 INFO:tasks.workunit.client.0.smithi040.stdout:4/490: chown d2/d3/d4/d1f/d29/f64 345647476 1 2024-04-18T10:42:46.801 INFO:tasks.workunit.client.0.smithi040.stdout:2/433: rename dd/d14/d2b/d7c/l3c to dd/d14/d2b/l83 0 2024-04-18T10:42:46.803 INFO:tasks.workunit.client.0.smithi040.stdout:5/447: symlink d0/d3/d6b/l99 0 2024-04-18T10:42:46.808 INFO:tasks.workunit.client.0.smithi040.stdout:9/526: unlink d2/d3/d22/d2e/d35/d40/c59 0 2024-04-18T10:42:46.809 INFO:tasks.workunit.client.0.smithi040.stdout:4/491: creat d2/d3/d4/dd/d4f/f90 x:0 0 0 2024-04-18T10:42:46.810 INFO:tasks.workunit.client.0.smithi040.stdout:9/527: fsync d2/dd/f24 0 2024-04-18T10:42:46.811 INFO:tasks.workunit.client.0.smithi040.stdout:1/518: dwrite d1/d1c/d2b/d32/d36/d4d/d67/f8e [0,4194304] 0 2024-04-18T10:42:46.811 INFO:tasks.workunit.client.0.smithi040.stdout:6/492: creat df/d4b/d6e/fad x:0 0 0 2024-04-18T10:42:46.811 INFO:tasks.workunit.client.0.smithi040.stdout:5/448: mknod d0/d4e/c9a 0 2024-04-18T10:42:46.813 INFO:tasks.workunit.client.0.smithi040.stdout:7/503: dread d6/f32 [0,4194304] 0 2024-04-18T10:42:46.814 INFO:tasks.workunit.client.0.smithi040.stdout:5/449: write d0/f39 [2465591,90104] 0 2024-04-18T10:42:46.814 INFO:tasks.workunit.client.0.smithi040.stdout:1/519: write d1/d16/f3b [2141117,3142] 0 2024-04-18T10:42:46.815 INFO:tasks.workunit.client.0.smithi040.stdout:9/528: chown d2/d3/d22/f6a 2350861 1 2024-04-18T10:42:46.815 INFO:tasks.workunit.client.0.smithi040.stdout:8/531: link d2/d5/d9/d3c/c43 d2/d5/d9/d63/cb8 0 2024-04-18T10:42:46.816 INFO:tasks.workunit.client.0.smithi040.stdout:1/520: stat d1/d1c/d2b/d32/d35/c73 0 2024-04-18T10:42:46.816 INFO:tasks.workunit.client.0.smithi040.stdout:8/532: chown d2/d22/fa4 1 1 2024-04-18T10:42:46.819 INFO:tasks.workunit.client.0.smithi040.stdout:4/492: mknod d2/d3/d4/d21/c91 0 2024-04-18T10:42:46.820 INFO:tasks.workunit.client.0.smithi040.stdout:4/493: chown d2/d3/d4/d21/d28/c7a 16985390 1 2024-04-18T10:42:46.821 INFO:tasks.workunit.client.0.smithi040.stdout:7/504: read - d6/d25/d28/d2c/d2d/d47/d55/d58/d5a/d63/f86 zero size 2024-04-18T10:42:46.822 INFO:tasks.workunit.client.0.smithi040.stdout:5/450: unlink d0/d3b/d67/l8c 0 2024-04-18T10:42:46.822 INFO:tasks.workunit.client.0.smithi040.stdout:7/505: fsync d6/d25/f46 0 2024-04-18T10:42:46.822 INFO:tasks.workunit.client.0.smithi040.stdout:9/529: creat d2/dc/d46/d44/fbd x:0 0 0 2024-04-18T10:42:46.823 INFO:tasks.workunit.client.0.smithi040.stdout:8/533: creat d2/d5/d9/fb9 x:0 0 0 2024-04-18T10:42:46.826 INFO:tasks.workunit.client.0.smithi040.stdout:6/493: link fa df/d4b/d6a/fae 0 2024-04-18T10:42:46.827 INFO:tasks.workunit.client.0.smithi040.stdout:2/434: getdents dd/d14/d4a 0 2024-04-18T10:42:46.827 INFO:tasks.workunit.client.0.smithi040.stdout:6/494: chown df/d4b/d63/l9d 5 1 2024-04-18T10:42:46.827 INFO:tasks.workunit.client.0.smithi040.stdout:2/435: stat dd/d61 0 2024-04-18T10:42:46.828 INFO:tasks.workunit.client.0.smithi040.stdout:0/534: dread dd/df/d19/d28/d3a/fa7 [0,4194304] 0 2024-04-18T10:42:46.865 INFO:tasks.workunit.client.0.smithi040.stdout:9/530: mknod d2/dc/cbe 0 2024-04-18T10:42:46.866 INFO:tasks.workunit.client.0.smithi040.stdout:1/521: link d1/d1c/d7b/d2e/f88 d1/d1c/d2b/d32/d36/d4d/d67/fbf 0 2024-04-18T10:42:46.866 INFO:tasks.workunit.client.0.smithi040.stdout:6/495: dread - df/d4b/d6e/d3f/d53/d8a/d95/f98 zero size 2024-04-18T10:42:46.866 INFO:tasks.workunit.client.0.smithi040.stdout:2/436: creat dd/d14/d2b/d7c/f84 x:0 0 0 2024-04-18T10:42:46.867 INFO:tasks.workunit.client.0.smithi040.stdout:9/531: readlink d2/d5b/l57 0 2024-04-18T10:42:46.867 INFO:tasks.workunit.client.0.smithi040.stdout:3/503: write d1/d2/d4e/f84 [4983761,89371] 0 2024-04-18T10:42:46.868 INFO:tasks.workunit.client.0.smithi040.stdout:2/437: fdatasync dd/f36 0 2024-04-18T10:42:46.868 INFO:tasks.workunit.client.0.smithi040.stdout:0/535: stat dd/df/d19/d28/d3a/d46/fbe 0 2024-04-18T10:42:46.877 INFO:tasks.workunit.client.0.smithi040.stdout:8/534: rmdir d2 39 2024-04-18T10:42:46.879 INFO:tasks.workunit.client.0.smithi040.stdout:7/506: dread d6/d25/d28/d2c/f4d [0,4194304] 0 2024-04-18T10:42:46.879 INFO:tasks.workunit.client.0.smithi040.stdout:6/496: creat df/d4b/d63/faf x:0 0 0 2024-04-18T10:42:46.879 INFO:tasks.workunit.client.0.smithi040.stdout:2/438: creat dd/d14/d44/f85 x:0 0 0 2024-04-18T10:42:46.879 INFO:tasks.workunit.client.0.smithi040.stdout:9/532: dread d2/dd/f95 [0,4194304] 0 2024-04-18T10:42:46.880 INFO:tasks.workunit.client.0.smithi040.stdout:0/536: rename dd/f1d to dd/df/d19/d3e/fcc 0 2024-04-18T10:42:46.881 INFO:tasks.workunit.client.0.smithi040.stdout:6/497: dread - df/d4b/d6e/fad zero size 2024-04-18T10:42:46.882 INFO:tasks.workunit.client.0.smithi040.stdout:4/494: getdents d2/d3/d4/dd/d6d/d70 0 2024-04-18T10:42:46.882 INFO:tasks.workunit.client.0.smithi040.stdout:2/439: rmdir dd/d14/d2b 39 2024-04-18T10:42:46.884 INFO:tasks.workunit.client.0.smithi040.stdout:3/504: rename d1/d2/d16/l23 to d1/d2/d16/d18/d3b/lab 0 2024-04-18T10:42:46.885 INFO:tasks.workunit.client.0.smithi040.stdout:9/533: chown d2/d3/d22/d2e/d35/d40/d71/c93 2041 1 2024-04-18T10:42:46.887 INFO:tasks.workunit.client.0.smithi040.stdout:9/534: write d2/d3/f12 [2208653,87672] 0 2024-04-18T10:42:46.888 INFO:tasks.workunit.client.0.smithi040.stdout:3/505: mknod d1/d2/d4e/d57/cac 0 2024-04-18T10:42:46.889 INFO:tasks.workunit.client.0.smithi040.stdout:8/535: link d2/d5/d9/d3c/d5a/f21 d2/d22/d80/fba 0 2024-04-18T10:42:46.891 INFO:tasks.workunit.client.0.smithi040.stdout:9/535: mkdir d2/dd/dbf 0 2024-04-18T10:42:46.892 INFO:tasks.workunit.client.0.smithi040.stdout:4/495: dread d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:46.893 INFO:tasks.workunit.client.0.smithi040.stdout:9/536: chown d2/dc/d46/d86 354233 1 2024-04-18T10:42:46.894 INFO:tasks.workunit.client.0.smithi040.stdout:8/536: truncate d2/d15/d2b/f92 717363 0 2024-04-18T10:42:46.894 INFO:tasks.workunit.client.0.smithi040.stdout:6/498: dwrite df/d4b/d6a/d93/f3d [0,4194304] 0 2024-04-18T10:42:46.897 INFO:tasks.workunit.client.0.smithi040.stdout:9/537: dread - d2/d3/d22/d2e/d35/d40/fa9 zero size 2024-04-18T10:42:46.899 INFO:tasks.workunit.client.0.smithi040.stdout:3/506: link d1/d2/d16/f25 d1/d2/d16/d18/d3b/fad 0 2024-04-18T10:42:46.900 INFO:tasks.workunit.client.0.smithi040.stdout:8/537: creat d2/d2c/da9/fbb x:0 0 0 2024-04-18T10:42:46.902 INFO:tasks.workunit.client.0.smithi040.stdout:7/507: dread d6/f94 [0,4194304] 0 2024-04-18T10:42:46.902 INFO:tasks.workunit.client.0.smithi040.stdout:8/538: stat d2/d4c 0 2024-04-18T10:42:46.904 INFO:tasks.workunit.client.0.smithi040.stdout:9/538: creat d2/d3/d22/d2e/fc0 x:0 0 0 2024-04-18T10:42:46.906 INFO:tasks.workunit.client.0.smithi040.stdout:0/537: dread dd/df/d4e/f5c [0,4194304] 0 2024-04-18T10:42:46.906 INFO:tasks.workunit.client.0.smithi040.stdout:8/539: chown d2/d10/d14/f8c 20024 1 2024-04-18T10:42:46.910 INFO:tasks.workunit.client.0.smithi040.stdout:4/496: dwrite d2/d3/d41/d62/d7c/f84 [0,4194304] 0 2024-04-18T10:42:46.911 INFO:tasks.workunit.client.0.smithi040.stdout:6/499: dread f4 [0,4194304] 0 2024-04-18T10:42:46.911 INFO:tasks.workunit.client.0.smithi040.stdout:2/440: dread dd/f45 [0,4194304] 0 2024-04-18T10:42:46.912 INFO:tasks.workunit.client.0.smithi040.stdout:5/451: sync 2024-04-18T10:42:46.912 INFO:tasks.workunit.client.0.smithi040.stdout:8/540: creat d2/d2c/da9/fbc x:0 0 0 2024-04-18T10:42:46.913 INFO:tasks.workunit.client.0.smithi040.stdout:0/538: creat dd/df/d19/d3e/fcd x:0 0 0 2024-04-18T10:42:46.914 INFO:tasks.workunit.client.0.smithi040.stdout:7/508: mknod d6/d25/d28/d2c/d2d/d47/d55/d9f/ca6 0 2024-04-18T10:42:46.916 INFO:tasks.workunit.client.0.smithi040.stdout:3/507: dwrite d1/f8b [0,4194304] 0 2024-04-18T10:42:46.916 INFO:tasks.workunit.client.0.smithi040.stdout:4/497: mknod d2/d3/c92 0 2024-04-18T10:42:46.919 INFO:tasks.workunit.client.0.smithi040.stdout:8/541: write d2/d15/d2b/d40/f71 [3908468,124473] 0 2024-04-18T10:42:46.919 INFO:tasks.workunit.client.0.smithi040.stdout:6/500: creat df/d4b/d6a/fb0 x:0 0 0 2024-04-18T10:42:46.919 INFO:tasks.workunit.client.0.smithi040.stdout:2/441: dread - dd/d14/d2b/d7c/d37/f79 zero size 2024-04-18T10:42:46.920 INFO:tasks.workunit.client.0.smithi040.stdout:0/539: dread - dd/df/d19/d3e/d77/fb3 zero size 2024-04-18T10:42:46.922 INFO:tasks.workunit.client.0.smithi040.stdout:5/452: truncate d0/d3b/d3f/d72/f7a 741719 0 2024-04-18T10:42:46.923 INFO:tasks.workunit.client.0.smithi040.stdout:9/539: dwrite d2/d3/f6e [0,4194304] 0 2024-04-18T10:42:46.923 INFO:tasks.workunit.client.0.smithi040.stdout:4/498: unlink d2/d3/d4/d21/l27 0 2024-04-18T10:42:46.924 INFO:tasks.workunit.client.0.smithi040.stdout:6/501: fdatasync df/d4b/d6a/d93/f31 0 2024-04-18T10:42:46.927 INFO:tasks.workunit.client.0.smithi040.stdout:5/453: rmdir d0/d78/d95/d52 39 2024-04-18T10:42:46.929 INFO:tasks.workunit.client.0.smithi040.stdout:5/454: write d0/d3b/d3f/f65 [1887663,74417] 0 2024-04-18T10:42:46.930 INFO:tasks.workunit.client.0.smithi040.stdout:7/509: dwrite d6/d25/d28/d2c/f3d [0,4194304] 0 2024-04-18T10:42:46.938 INFO:tasks.workunit.client.0.smithi040.stdout:0/540: rename dd/df/d19/d3e/d75/fb1 to dd/df/d19/d3e/da5/fce 0 2024-04-18T10:42:46.939 INFO:tasks.workunit.client.0.smithi040.stdout:2/442: creat dd/d14/f86 x:0 0 0 2024-04-18T10:42:46.943 INFO:tasks.workunit.client.0.smithi040.stdout:4/499: symlink d2/d3/d4/dd/d6d/l93 0 2024-04-18T10:42:46.944 INFO:tasks.workunit.client.0.smithi040.stdout:6/502: rmdir df 39 2024-04-18T10:42:46.945 INFO:tasks.workunit.client.0.smithi040.stdout:7/510: symlink d6/d25/la7 0 2024-04-18T10:42:46.945 INFO:tasks.workunit.client.0.smithi040.stdout:5/455: dwrite d0/d3b/d88/f94 [0,4194304] 0 2024-04-18T10:42:46.947 INFO:tasks.workunit.client.0.smithi040.stdout:7/511: fsync d6/d25/d28/d2c/f4c 0 2024-04-18T10:42:46.947 INFO:tasks.workunit.client.0.smithi040.stdout:7/512: readlink d6/d25/l23 0 2024-04-18T10:42:46.948 INFO:tasks.workunit.client.0.smithi040.stdout:5/456: write d0/d3b/d3f/f41 [2003915,70353] 0 2024-04-18T10:42:46.950 INFO:tasks.workunit.client.0.smithi040.stdout:4/500: mkdir d2/d3/d41/d94 0 2024-04-18T10:42:46.951 INFO:tasks.workunit.client.0.smithi040.stdout:4/501: write d2/d3/d41/d47/f82 [360517,104614] 0 2024-04-18T10:42:46.951 INFO:tasks.workunit.client.0.smithi040.stdout:6/503: creat df/d4b/d6a/fb1 x:0 0 0 2024-04-18T10:42:46.953 INFO:tasks.workunit.client.0.smithi040.stdout:1/522: sync 2024-04-18T10:42:46.954 INFO:tasks.workunit.client.0.smithi040.stdout:6/504: dread f4 [0,4194304] 0 2024-04-18T10:42:46.955 INFO:tasks.workunit.client.0.smithi040.stdout:1/523: chown d1/f4 17 1 2024-04-18T10:42:46.962 INFO:tasks.workunit.client.0.smithi040.stdout:8/542: write d2/d5/d9/f9d [892794,76236] 0 2024-04-18T10:42:46.963 INFO:tasks.workunit.client.0.smithi040.stdout:3/508: truncate d1/d2/d4e/d58/f5d 3594387 0 2024-04-18T10:42:46.965 INFO:tasks.workunit.client.0.smithi040.stdout:1/524: creat d1/d16/d92/dad/fc0 x:0 0 0 2024-04-18T10:42:46.968 INFO:tasks.workunit.client.0.smithi040.stdout:4/502: dwrite d2/d3/d4/dd/d6d/d70/f7d [0,4194304] 0 2024-04-18T10:42:46.969 INFO:tasks.workunit.client.0.smithi040.stdout:0/541: truncate dd/df/d19/d3e/d77/f90 1182662 0 2024-04-18T10:42:46.969 INFO:tasks.workunit.client.0.smithi040.stdout:3/509: write d1/d2/f31 [3720896,104835] 0 2024-04-18T10:42:46.971 INFO:tasks.workunit.client.0.smithi040.stdout:8/543: truncate d2/d5/fa8 477942 0 2024-04-18T10:42:46.979 INFO:tasks.workunit.client.0.smithi040.stdout:9/540: dwrite d2/d7/f29 [0,4194304] 0 2024-04-18T10:42:46.980 INFO:tasks.workunit.client.0.smithi040.stdout:6/505: dwrite df/d76/f80 [0,4194304] 0 2024-04-18T10:42:46.981 INFO:tasks.workunit.client.0.smithi040.stdout:3/510: mknod d1/d2/d4e/d58/d8e/cae 0 2024-04-18T10:42:46.983 INFO:tasks.workunit.client.0.smithi040.stdout:2/443: dwrite dd/d14/d4a/f71 [0,4194304] 0 2024-04-18T10:42:46.986 INFO:tasks.workunit.client.0.smithi040.stdout:5/457: dread d0/f25 [0,4194304] 0 2024-04-18T10:42:46.987 INFO:tasks.workunit.client.0.smithi040.stdout:2/444: dread - dd/d14/d2b/d7c/d37/d5b/f75 zero size 2024-04-18T10:42:46.989 INFO:tasks.workunit.client.0.smithi040.stdout:0/542: rename dd/df/d19/d28/d3a/d46/f5d to dd/df/d19/d3e/d77/fcf 0 2024-04-18T10:42:46.989 INFO:tasks.workunit.client.0.smithi040.stdout:4/503: dwrite d2/d3/d4/d21/f7b [0,4194304] 0 2024-04-18T10:42:46.991 INFO:tasks.workunit.client.0.smithi040.stdout:6/506: creat df/d4b/d7e/fb2 x:0 0 0 2024-04-18T10:42:46.992 INFO:tasks.workunit.client.0.smithi040.stdout:1/525: write d1/d1c/d2b/d32/d36/f38 [4878575,92484] 0 2024-04-18T10:42:46.995 INFO:tasks.workunit.client.0.smithi040.stdout:9/541: dwrite d2/d3/d22/d2e/d35/d40/d71/fa7 [0,4194304] 0 2024-04-18T10:42:46.996 INFO:tasks.workunit.client.0.smithi040.stdout:3/511: creat d1/d2/d4e/d58/d62/faf x:0 0 0 2024-04-18T10:42:46.997 INFO:tasks.workunit.client.0.smithi040.stdout:5/458: symlink d0/d3/d47/l9b 0 2024-04-18T10:42:47.000 INFO:tasks.workunit.client.0.smithi040.stdout:0/543: mkdir dd/df/d19/d28/d3a/d5b/dd0 0 2024-04-18T10:42:47.004 INFO:tasks.workunit.client.0.smithi040.stdout:5/459: dwrite d0/d78/f81 [0,4194304] 0 2024-04-18T10:42:47.005 INFO:tasks.workunit.client.0.smithi040.stdout:4/504: dread d2/d3/d2f/f35 [0,4194304] 0 2024-04-18T10:42:47.005 INFO:tasks.workunit.client.0.smithi040.stdout:9/542: rename d2/dc to d2/d3/d22/d2e/d35/daf/dc1 0 2024-04-18T10:42:47.005 INFO:tasks.workunit.client.0.smithi040.stdout:5/460: readlink d0/d21/l30 0 2024-04-18T10:42:47.007 INFO:tasks.workunit.client.0.smithi040.stdout:9/543: fdatasync d2/d3/d22/d2e/d35/daf/dc1/f1a 0 2024-04-18T10:42:47.007 INFO:tasks.workunit.client.0.smithi040.stdout:9/544: fdatasync d2/d3/d22/d2e/d35/daf/fb9 0 2024-04-18T10:42:47.008 INFO:tasks.workunit.client.0.smithi040.stdout:3/512: unlink d1/d2/d16/d18/d3b/c73 0 2024-04-18T10:42:47.009 INFO:tasks.workunit.client.0.smithi040.stdout:1/526: creat d1/d1c/d2b/d32/d7e/fc1 x:0 0 0 2024-04-18T10:42:47.010 INFO:tasks.workunit.client.0.smithi040.stdout:1/527: chown d1/d1c/d2b/d32/d36/d4d/d67/f8e 7414363 1 2024-04-18T10:42:47.011 INFO:tasks.workunit.client.0.smithi040.stdout:2/445: creat dd/d14/d44/d4c/f87 x:0 0 0 2024-04-18T10:42:47.011 INFO:tasks.workunit.client.0.smithi040.stdout:1/528: dread - d1/d1c/d2b/d32/d36/d4d/d67/faf zero size 2024-04-18T10:42:47.012 INFO:tasks.workunit.client.0.smithi040.stdout:2/446: chown dd/d14/d2b/d7c/d37/f79 588 1 2024-04-18T10:42:47.012 INFO:tasks.workunit.client.0.smithi040.stdout:4/505: unlink d2/f26 0 2024-04-18T10:42:47.016 INFO:tasks.workunit.client.0.smithi040.stdout:3/513: rename d1/d2/d3c/f6a to d1/d2/d4e/d58/d8e/fb0 0 2024-04-18T10:42:47.018 INFO:tasks.workunit.client.0.smithi040.stdout:5/461: link d0/d21/f44 d0/d78/f9c 0 2024-04-18T10:42:47.019 INFO:tasks.workunit.client.0.smithi040.stdout:4/506: rmdir d2/d3/d4/d21/d28 39 2024-04-18T10:42:47.020 INFO:tasks.workunit.client.0.smithi040.stdout:7/513: sync 2024-04-18T10:42:47.020 INFO:tasks.workunit.client.0.smithi040.stdout:0/544: link dd/df/d19/d28/d3a/c3d dd/da3/cd1 0 2024-04-18T10:42:47.021 INFO:tasks.workunit.client.0.smithi040.stdout:4/507: dread - d2/d3/d4/dd/d4f/f8c zero size 2024-04-18T10:42:47.022 INFO:tasks.workunit.client.0.smithi040.stdout:5/462: truncate d0/d3b/d3f/f40 89727 0 2024-04-18T10:42:47.022 INFO:tasks.workunit.client.0.smithi040.stdout:2/447: creat dd/d14/d44/d4c/f88 x:0 0 0 2024-04-18T10:42:47.024 INFO:tasks.workunit.client.0.smithi040.stdout:3/514: dwrite d1/f8b [0,4194304] 0 2024-04-18T10:42:47.024 INFO:tasks.workunit.client.0.smithi040.stdout:7/514: write d6/d25/d28/f42 [658487,45088] 0 2024-04-18T10:42:47.024 INFO:tasks.workunit.client.0.smithi040.stdout:1/529: link d1/d1c/d2b/d32/d35/fa6 d1/d1c/d2b/d32/d36/d4d/fc2 0 2024-04-18T10:42:47.034 INFO:tasks.workunit.client.0.smithi040.stdout:7/515: chown d6/d25/d28/d2c/f33 64314 1 2024-04-18T10:42:47.035 INFO:tasks.workunit.client.0.smithi040.stdout:8/544: dread d2/d10/d14/f9c [4194304,4194304] 0 2024-04-18T10:42:47.037 INFO:tasks.workunit.client.0.smithi040.stdout:7/516: mkdir d6/d50/d79/da8 0 2024-04-18T10:42:47.038 INFO:tasks.workunit.client.0.smithi040.stdout:1/530: getdents d1/d1c/d7b/d2e/da4 0 2024-04-18T10:42:47.040 INFO:tasks.workunit.client.0.smithi040.stdout:3/515: dread d1/d7/d28/f61 [0,4194304] 0 2024-04-18T10:42:47.040 INFO:tasks.workunit.client.0.smithi040.stdout:7/517: creat d6/d3e/d73/fa9 x:0 0 0 2024-04-18T10:42:47.041 INFO:tasks.workunit.client.0.smithi040.stdout:8/545: rename d2/d5/d9/d1b/lb1 to d2/d22/d80/lbd 0 2024-04-18T10:42:47.042 INFO:tasks.workunit.client.0.smithi040.stdout:4/508: dwrite d2/d3/d4/d1f/f66 [0,4194304] 0 2024-04-18T10:42:47.044 INFO:tasks.workunit.client.0.smithi040.stdout:8/546: mkdir d2/d2c/dbe 0 2024-04-18T10:42:47.046 INFO:tasks.workunit.client.0.smithi040.stdout:3/516: rename d1/d7/d26 to d1/d2/d16/d18/d91/db1 0 2024-04-18T10:42:47.048 INFO:tasks.workunit.client.0.smithi040.stdout:7/518: creat d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/faa x:0 0 0 2024-04-18T10:42:47.048 INFO:tasks.workunit.client.0.smithi040.stdout:7/519: readlink d6/l7b 0 2024-04-18T10:42:47.049 INFO:tasks.workunit.client.0.smithi040.stdout:7/520: readlink d6/d50/l7c 0 2024-04-18T10:42:47.050 INFO:tasks.workunit.client.0.smithi040.stdout:8/547: mkdir d2/d2c/dbf 0 2024-04-18T10:42:47.050 INFO:tasks.workunit.client.0.smithi040.stdout:7/521: read d6/f14 [4667010,108681] 0 2024-04-18T10:42:47.051 INFO:tasks.workunit.client.0.smithi040.stdout:8/548: chown d2/d22/d49/l55 20097 1 2024-04-18T10:42:47.053 INFO:tasks.workunit.client.0.smithi040.stdout:4/509: truncate d2/d3/d4/d1f/d29/d49/f42 19247 0 2024-04-18T10:42:47.055 INFO:tasks.workunit.client.0.smithi040.stdout:3/517: mkdir d1/d7/db2 0 2024-04-18T10:42:47.057 INFO:tasks.workunit.client.0.smithi040.stdout:3/518: stat d1/le 0 2024-04-18T10:42:47.057 INFO:tasks.workunit.client.0.smithi040.stdout:8/549: chown d2/d22/d80/fba 382 1 2024-04-18T10:42:47.058 INFO:tasks.workunit.client.0.smithi040.stdout:7/522: truncate d6/d25/d28/d2c/f4c 3597877 0 2024-04-18T10:42:47.060 INFO:tasks.workunit.client.0.smithi040.stdout:9/545: dread d2/d3/d22/d2e/f76 [0,4194304] 0 2024-04-18T10:42:47.063 INFO:tasks.workunit.client.0.smithi040.stdout:8/550: symlink d2/d22/d49/lc0 0 2024-04-18T10:42:47.063 INFO:tasks.workunit.client.0.smithi040.stdout:4/510: dwrite d2/d3/d4/dd/d4f/f8c [0,4194304] 0 2024-04-18T10:42:47.066 INFO:tasks.workunit.client.0.smithi040.stdout:8/551: readlink d2/d5/d9/d1b/l65 0 2024-04-18T10:42:47.066 INFO:tasks.workunit.client.0.smithi040.stdout:9/546: write d2/dd/f95 [93492,65118] 0 2024-04-18T10:42:47.067 INFO:tasks.workunit.client.0.smithi040.stdout:6/507: truncate df/d4b/d6a/d93/f1b 1776585 0 2024-04-18T10:42:47.068 INFO:tasks.workunit.client.0.smithi040.stdout:4/511: write d2/d3/d4/dd/f89 [394003,25392] 0 2024-04-18T10:42:47.070 INFO:tasks.workunit.client.0.smithi040.stdout:8/552: write d2/d5/d9/fb9 [405027,129205] 0 2024-04-18T10:42:47.071 INFO:tasks.workunit.client.0.smithi040.stdout:4/512: chown d2/d3/d4/d21/l50 32086820 1 2024-04-18T10:42:47.072 INFO:tasks.workunit.client.0.smithi040.stdout:7/523: dwrite d6/d25/d28/f2f [0,4194304] 0 2024-04-18T10:42:47.073 INFO:tasks.workunit.client.0.smithi040.stdout:9/547: mkdir d2/d3/d22/d2e/d35/daf/dc2 0 2024-04-18T10:42:47.078 INFO:tasks.workunit.client.0.smithi040.stdout:9/548: mkdir d2/d5b/d6f/dc3 0 2024-04-18T10:42:47.078 INFO:tasks.workunit.client.0.smithi040.stdout:5/463: dread d0/d4e/f29 [4194304,4194304] 0 2024-04-18T10:42:47.079 INFO:tasks.workunit.client.0.smithi040.stdout:2/448: write dd/d14/f47 [2827430,98951] 0 2024-04-18T10:42:47.079 INFO:tasks.workunit.client.0.smithi040.stdout:3/519: dread d1/d2/d16/d18/d3b/fad [0,4194304] 0 2024-04-18T10:42:47.081 INFO:tasks.workunit.client.0.smithi040.stdout:6/508: dwrite df/d4b/d6e/d3f/f59 [0,4194304] 0 2024-04-18T10:42:47.082 INFO:tasks.workunit.client.0.smithi040.stdout:5/464: read - d0/d21/d42/f8f zero size 2024-04-18T10:42:47.083 INFO:tasks.workunit.client.0.smithi040.stdout:6/509: fsync df/d76/d91/fa5 0 2024-04-18T10:42:47.084 INFO:tasks.workunit.client.0.smithi040.stdout:7/524: rename d6/d3e/l89 to d6/d25/d28/lab 0 2024-04-18T10:42:47.089 INFO:tasks.workunit.client.0.smithi040.stdout:4/513: link d2/f9 d2/d3/d41/d62/d7c/f95 0 2024-04-18T10:42:47.091 INFO:tasks.workunit.client.0.smithi040.stdout:9/549: dwrite d2/d3/d22/d2e/d35/daf/dc1/f73 [0,4194304] 0 2024-04-18T10:42:47.092 INFO:tasks.workunit.client.0.smithi040.stdout:3/520: creat d1/d7/d12/d7b/fb3 x:0 0 0 2024-04-18T10:42:47.093 INFO:tasks.workunit.client.0.smithi040.stdout:5/465: dwrite d0/d3b/d3f/f62 [4194304,4194304] 0 2024-04-18T10:42:47.095 INFO:tasks.workunit.client.0.smithi040.stdout:2/449: creat dd/d14/d44/d4c/d52/f89 x:0 0 0 2024-04-18T10:42:47.095 INFO:tasks.workunit.client.0.smithi040.stdout:9/550: read - d2/d3/d22/d2e/d35/daf/dc1/d46/d44/fb0 zero size 2024-04-18T10:42:47.097 INFO:tasks.workunit.client.0.smithi040.stdout:9/551: dread - d2/d3/d22/d2e/d35/d40/d71/fa0 zero size 2024-04-18T10:42:47.097 INFO:tasks.workunit.client.0.smithi040.stdout:9/552: chown d2/d5b/d6f/d80 27172 1 2024-04-18T10:42:47.098 INFO:tasks.workunit.client.0.smithi040.stdout:9/553: chown d2/d3/d22/d2e 7785681 1 2024-04-18T10:42:47.098 INFO:tasks.workunit.client.0.smithi040.stdout:3/521: rmdir d1/d2 39 2024-04-18T10:42:47.099 INFO:tasks.workunit.client.0.smithi040.stdout:9/554: chown d2/d3/d22/d2e/d35/dbb 2040 1 2024-04-18T10:42:47.099 INFO:tasks.workunit.client.0.smithi040.stdout:9/555: fsync d2/d5b/d6f/d80/f8b 0 2024-04-18T10:42:47.100 INFO:tasks.workunit.client.0.smithi040.stdout:9/556: write d2/d3/d22/d2e/f7b [1309137,128723] 0 2024-04-18T10:42:47.101 INFO:tasks.workunit.client.0.smithi040.stdout:9/557: dread - d2/d7/f51 zero size 2024-04-18T10:42:47.102 INFO:tasks.workunit.client.0.smithi040.stdout:4/514: symlink d2/d3/d41/l96 0 2024-04-18T10:42:47.102 INFO:tasks.workunit.client.0.smithi040.stdout:9/558: write d2/d7/f1b [1487261,108580] 0 2024-04-18T10:42:47.103 INFO:tasks.workunit.client.0.smithi040.stdout:8/553: write d2/d5/d9/d3c/d68/f88 [1932870,101506] 0 2024-04-18T10:42:47.104 INFO:tasks.workunit.client.0.smithi040.stdout:2/450: chown dd/d14/d2b/d7c/d37/l64 191627 1 2024-04-18T10:42:47.105 INFO:tasks.workunit.client.0.smithi040.stdout:8/554: write d2/f2a [3973211,45547] 0 2024-04-18T10:42:47.105 INFO:tasks.workunit.client.0.smithi040.stdout:9/559: truncate d2/d3/d22/d2e/d35/daf/fb9 812236 0 2024-04-18T10:42:47.106 INFO:tasks.workunit.client.0.smithi040.stdout:9/560: readlink d2/l4 0 2024-04-18T10:42:47.108 INFO:tasks.workunit.client.0.smithi040.stdout:5/466: mknod d0/d3b/c9d 0 2024-04-18T10:42:47.111 INFO:tasks.workunit.client.0.smithi040.stdout:7/525: rename d6/d25/d28/d2c/d2d/d47/d55/d58/d5a to d6/d25/d28/dac 0 2024-04-18T10:42:47.113 INFO:tasks.workunit.client.0.smithi040.stdout:8/555: dwrite d2/d5/d9/d3c/d5a/fb2 [0,4194304] 0 2024-04-18T10:42:47.113 INFO:tasks.workunit.client.0.smithi040.stdout:7/526: fsync d6/d25/d28/f87 0 2024-04-18T10:42:47.113 INFO:tasks.workunit.client.0.smithi040.stdout:2/451: rmdir dd/d14/d44/d4c/d6b 39 2024-04-18T10:42:47.114 INFO:tasks.workunit.client.0.smithi040.stdout:3/522: stat d1/d2/d16/c47 0 2024-04-18T10:42:47.117 INFO:tasks.workunit.client.0.smithi040.stdout:4/515: rename d2/d3/d4/d23/c77 to d2/d3/d41/d94/c97 0 2024-04-18T10:42:47.120 INFO:tasks.workunit.client.0.smithi040.stdout:9/561: mkdir d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4 0 2024-04-18T10:42:47.121 INFO:tasks.workunit.client.0.smithi040.stdout:2/452: fdatasync dd/d14/d2b/d7c/f3a 0 2024-04-18T10:42:47.122 INFO:tasks.workunit.client.0.smithi040.stdout:9/562: write d2/d3/d22/f3c [863470,3741] 0 2024-04-18T10:42:47.122 INFO:tasks.workunit.client.0.smithi040.stdout:3/523: mkdir d1/d2/d4e/d58/db4 0 2024-04-18T10:42:47.122 INFO:tasks.workunit.client.0.smithi040.stdout:2/453: write dd/f36 [1558630,119031] 0 2024-04-18T10:42:47.122 INFO:tasks.workunit.client.0.smithi040.stdout:5/467: fsync d0/d3b/d67/f68 0 2024-04-18T10:42:47.123 INFO:tasks.workunit.client.0.smithi040.stdout:3/524: readlink d1/lf 0 2024-04-18T10:42:47.124 INFO:tasks.workunit.client.0.smithi040.stdout:7/527: mkdir d6/d50/d79/da8/dad 0 2024-04-18T10:42:47.124 INFO:tasks.workunit.client.0.smithi040.stdout:2/454: write dd/f6f [262367,113204] 0 2024-04-18T10:42:47.126 INFO:tasks.workunit.client.0.smithi040.stdout:8/556: link d2/f5b d2/d15/d78/fc1 0 2024-04-18T10:42:47.128 INFO:tasks.workunit.client.0.smithi040.stdout:7/528: read - d6/d25/d28/dac/d63/f78 zero size 2024-04-18T10:42:47.129 INFO:tasks.workunit.client.0.smithi040.stdout:8/557: chown d2/d5/d9/d3c/f52 6766530 1 2024-04-18T10:42:47.130 INFO:tasks.workunit.client.0.smithi040.stdout:2/455: write dd/d14/d2b/d7c/d37/d5b/f7f [1037153,48513] 0 2024-04-18T10:42:47.130 INFO:tasks.workunit.client.0.smithi040.stdout:5/468: unlink d0/d4e/f5e 0 2024-04-18T10:42:47.131 INFO:tasks.workunit.client.0.smithi040.stdout:6/510: dwrite df/d4b/d6a/d93/f29 [0,4194304] 0 2024-04-18T10:42:47.137 INFO:tasks.workunit.client.0.smithi040.stdout:1/531: sync 2024-04-18T10:42:47.137 INFO:tasks.workunit.client.0.smithi040.stdout:0/545: sync 2024-04-18T10:42:47.139 INFO:tasks.workunit.client.0.smithi040.stdout:5/469: dwrite d0/d3b/d67/f73 [0,4194304] 0 2024-04-18T10:42:47.139 INFO:tasks.workunit.client.0.smithi040.stdout:8/558: dread d2/d5/d9/f9d [0,4194304] 0 2024-04-18T10:42:47.140 INFO:tasks.workunit.client.0.smithi040.stdout:7/529: symlink d6/d3e/d99/lae 0 2024-04-18T10:42:47.140 INFO:tasks.workunit.client.0.smithi040.stdout:1/532: fdatasync d1/d1c/d2b/d32/d36/f50 0 2024-04-18T10:42:47.142 INFO:tasks.workunit.client.0.smithi040.stdout:8/559: write d2/d22/d49/f9a [1031665,65962] 0 2024-04-18T10:42:47.143 INFO:tasks.workunit.client.0.smithi040.stdout:1/533: stat d1/d1c/d2b/d32/d36/d4d/l8d 0 2024-04-18T10:42:47.143 INFO:tasks.workunit.client.0.smithi040.stdout:0/546: truncate dd/df/d19/d28/d3a/d42/fae 383433 0 2024-04-18T10:42:47.143 INFO:tasks.workunit.client.0.smithi040.stdout:5/470: dread d0/d3/f7 [0,4194304] 0 2024-04-18T10:42:47.144 INFO:tasks.workunit.client.0.smithi040.stdout:5/471: write d0/f19 [2634241,76143] 0 2024-04-18T10:42:47.144 INFO:tasks.workunit.client.0.smithi040.stdout:2/456: rmdir dd/d14/d44/d5f 39 2024-04-18T10:42:47.145 INFO:tasks.workunit.client.0.smithi040.stdout:2/457: stat dd/d14/d44/c67 0 2024-04-18T10:42:47.145 INFO:tasks.workunit.client.0.smithi040.stdout:5/472: chown d0/d3/c92 52275517 1 2024-04-18T10:42:47.146 INFO:tasks.workunit.client.0.smithi040.stdout:3/525: symlink d1/d2/d4e/d58/db4/lb5 0 2024-04-18T10:42:47.149 INFO:tasks.workunit.client.0.smithi040.stdout:9/563: link d2/d7/c9f d2/dd/dbf/cc5 0 2024-04-18T10:42:47.150 INFO:tasks.workunit.client.0.smithi040.stdout:2/458: dread dd/d14/d2b/d7c/d37/d5b/f7f [0,4194304] 0 2024-04-18T10:42:47.151 INFO:tasks.workunit.client.0.smithi040.stdout:9/564: dread - d2/d3/d22/d2e/d35/daf/dc1/d46/d44/fbd zero size 2024-04-18T10:42:47.152 INFO:tasks.workunit.client.0.smithi040.stdout:2/459: read dd/d14/d2b/f2e [3136268,78428] 0 2024-04-18T10:42:47.153 INFO:tasks.workunit.client.0.smithi040.stdout:4/516: rename d2/d3/d4/dd/c1e to d2/d3/d4/d21/c98 0 2024-04-18T10:42:47.153 INFO:tasks.workunit.client.0.smithi040.stdout:2/460: write dd/d14/d2b/d7c/d37/f74 [43457,33038] 0 2024-04-18T10:42:47.158 INFO:tasks.workunit.client.0.smithi040.stdout:7/530: fdatasync d6/d25/f3a 0 2024-04-18T10:42:47.161 INFO:tasks.workunit.client.0.smithi040.stdout:4/517: write d2/d3/d41/d47/d6f/f75 [2288843,51892] 0 2024-04-18T10:42:47.162 INFO:tasks.workunit.client.0.smithi040.stdout:8/560: mkdir d2/d2c/dbf/dc2 0 2024-04-18T10:42:47.163 INFO:tasks.workunit.client.0.smithi040.stdout:2/461: creat dd/d14/d4a/d54/f8a x:0 0 0 2024-04-18T10:42:47.166 INFO:tasks.workunit.client.0.smithi040.stdout:6/511: dread df/f12 [0,4194304] 0 2024-04-18T10:42:47.167 INFO:tasks.workunit.client.0.smithi040.stdout:9/565: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/fc6 x:0 0 0 2024-04-18T10:42:47.167 INFO:tasks.workunit.client.0.smithi040.stdout:7/531: symlink d6/d25/d28/dac/d64/d7e/laf 0 2024-04-18T10:42:47.168 INFO:tasks.workunit.client.0.smithi040.stdout:0/547: rename dd/f37 to dd/df/d19/d3e/d77/fd2 0 2024-04-18T10:42:47.171 INFO:tasks.workunit.client.0.smithi040.stdout:5/473: creat d0/d78/d95/d52/d5d/f9e x:0 0 0 2024-04-18T10:42:47.172 INFO:tasks.workunit.client.0.smithi040.stdout:6/512: mkdir df/d4b/d63/db3 0 2024-04-18T10:42:47.174 INFO:tasks.workunit.client.0.smithi040.stdout:1/534: rename d1/d1c/d2b/d32/d36/f8c to d1/d9b/d75/d84/fc3 0 2024-04-18T10:42:47.174 INFO:tasks.workunit.client.0.smithi040.stdout:8/561: dwrite d2/d22/f85 [0,4194304] 0 2024-04-18T10:42:47.176 INFO:tasks.workunit.client.0.smithi040.stdout:3/526: getdents d1/d2/d4e/d58 0 2024-04-18T10:42:47.176 INFO:tasks.workunit.client.0.smithi040.stdout:9/566: write d2/d3/d22/d2e/d35/daf/fb9 [1322828,83927] 0 2024-04-18T10:42:47.176 INFO:tasks.workunit.client.0.smithi040.stdout:0/548: truncate dd/df/d19/f66 1838447 0 2024-04-18T10:42:47.177 INFO:tasks.workunit.client.0.smithi040.stdout:6/513: write df/fab [743991,6732] 0 2024-04-18T10:42:47.179 INFO:tasks.workunit.client.0.smithi040.stdout:2/462: dwrite dd/d14/d2b/f2e [0,4194304] 0 2024-04-18T10:42:47.180 INFO:tasks.workunit.client.0.smithi040.stdout:1/535: unlink d1/d16/l43 0 2024-04-18T10:42:47.180 INFO:tasks.workunit.client.0.smithi040.stdout:8/562: mkdir d2/d2c/da9/dc3 0 2024-04-18T10:42:47.182 INFO:tasks.workunit.client.0.smithi040.stdout:2/463: chown dd/l6e 6 1 2024-04-18T10:42:47.183 INFO:tasks.workunit.client.0.smithi040.stdout:1/536: readlink d1/d1c/d7b/l4c 0 2024-04-18T10:42:47.183 INFO:tasks.workunit.client.0.smithi040.stdout:3/527: chown d1/d2/d4e/d58/d62/d6b/l7e 4351557 1 2024-04-18T10:42:47.183 INFO:tasks.workunit.client.0.smithi040.stdout:4/518: dread d2/d3/d41/d47/d6f/f75 [0,4194304] 0 2024-04-18T10:42:47.185 INFO:tasks.workunit.client.0.smithi040.stdout:6/514: write df/d4b/d6e/d3f/d53/d8a/fac [222008,90432] 0 2024-04-18T10:42:47.186 INFO:tasks.workunit.client.0.smithi040.stdout:8/563: creat d2/d22/d80/fc4 x:0 0 0 2024-04-18T10:42:47.187 INFO:tasks.workunit.client.0.smithi040.stdout:1/537: fdatasync d1/f4 0 2024-04-18T10:42:47.188 INFO:tasks.workunit.client.0.smithi040.stdout:5/474: dwrite d0/d4e/f29 [8388608,4194304] 0 2024-04-18T10:42:47.188 INFO:tasks.workunit.client.0.smithi040.stdout:8/564: fdatasync d2/d15/d2b/d40/f71 0 2024-04-18T10:42:47.189 INFO:tasks.workunit.client.0.smithi040.stdout:2/464: stat dd/d14/d44/d4c/d49/l58 0 2024-04-18T10:42:47.214 INFO:tasks.workunit.client.0.smithi040.stdout:1/538: read d1/d1c/d7b/d2d/f5c [3388066,38410] 0 2024-04-18T10:42:47.214 INFO:tasks.workunit.client.0.smithi040.stdout:3/528: readlink d1/d7/l8a 0 2024-04-18T10:42:47.215 INFO:tasks.workunit.client.0.smithi040.stdout:6/515: symlink df/d76/d91/lb4 0 2024-04-18T10:42:47.216 INFO:tasks.workunit.client.0.smithi040.stdout:5/475: rmdir d0/d78/d95 39 2024-04-18T10:42:47.217 INFO:tasks.workunit.client.0.smithi040.stdout:2/465: read dd/d14/d2b/d7c/d37/f74 [27038,22453] 0 2024-04-18T10:42:47.217 INFO:tasks.workunit.client.0.smithi040.stdout:7/532: truncate d6/d25/d28/f66 244356 0 2024-04-18T10:42:47.220 INFO:tasks.workunit.client.0.smithi040.stdout:5/476: rmdir d0/d4e 39 2024-04-18T10:42:47.221 INFO:tasks.workunit.client.0.smithi040.stdout:6/516: creat df/d4b/d6e/d3f/d53/d8a/fb5 x:0 0 0 2024-04-18T10:42:47.223 INFO:tasks.workunit.client.0.smithi040.stdout:2/466: mknod dd/d14/d2b/c8b 0 2024-04-18T10:42:47.227 INFO:tasks.workunit.client.0.smithi040.stdout:1/539: truncate d1/d1c/d2b/d32/d36/d4d/d67/fbf 939812 0 2024-04-18T10:42:47.227 INFO:tasks.workunit.client.0.smithi040.stdout:7/533: write d6/d25/d28/f4e [824869,125681] 0 2024-04-18T10:42:47.228 INFO:tasks.workunit.client.0.smithi040.stdout:8/565: dwrite d2/d10/faf [0,4194304] 0 2024-04-18T10:42:47.233 INFO:tasks.workunit.client.0.smithi040.stdout:5/477: mkdir d0/d78/d95/d52/d5d/d9f 0 2024-04-18T10:42:47.234 INFO:tasks.workunit.client.0.smithi040.stdout:0/549: dwrite dd/d62/f7f [0,4194304] 0 2024-04-18T10:42:47.235 INFO:tasks.workunit.client.0.smithi040.stdout:8/566: dread - d2/d5/d9/d1b/fa6 zero size 2024-04-18T10:42:47.235 INFO:tasks.workunit.client.0.smithi040.stdout:9/567: dwrite d2/d3/f8c [0,4194304] 0 2024-04-18T10:42:47.237 INFO:tasks.workunit.client.0.smithi040.stdout:1/540: creat d1/d1c/d7b/d2e/d9e/fc4 x:0 0 0 2024-04-18T10:42:47.238 INFO:tasks.workunit.client.0.smithi040.stdout:3/529: dwrite d1/d2/d16/d18/d91/f98 [0,4194304] 0 2024-04-18T10:42:47.238 INFO:tasks.workunit.client.0.smithi040.stdout:6/517: write df/d4b/f68 [2374613,98502] 0 2024-04-18T10:42:47.239 INFO:tasks.workunit.client.0.smithi040.stdout:5/478: readlink d0/d3b/l46 0 2024-04-18T10:42:47.240 INFO:tasks.workunit.client.0.smithi040.stdout:2/467: truncate dd/d14/d44/d4c/d6b/f7e 34374 0 2024-04-18T10:42:47.241 INFO:tasks.workunit.client.0.smithi040.stdout:3/530: chown d1/d2/d16/f25 0 1 2024-04-18T10:42:47.244 INFO:tasks.workunit.client.0.smithi040.stdout:8/567: creat d2/d5/d9/d3c/d5a/fc5 x:0 0 0 2024-04-18T10:42:47.246 INFO:tasks.workunit.client.0.smithi040.stdout:0/550: rename dd/d91/fb6 to dd/fd3 0 2024-04-18T10:42:47.247 INFO:tasks.workunit.client.0.smithi040.stdout:0/551: dread - dd/df/d19/d28/d3a/d5b/d8f/fbc zero size 2024-04-18T10:42:47.248 INFO:tasks.workunit.client.0.smithi040.stdout:3/531: mknod d1/d2/d4e/d57/cb6 0 2024-04-18T10:42:47.249 INFO:tasks.workunit.client.0.smithi040.stdout:1/541: creat d1/fc5 x:0 0 0 2024-04-18T10:42:47.250 INFO:tasks.workunit.client.0.smithi040.stdout:2/468: dread dd/d14/d2b/d7c/d37/d5b/f7f [0,4194304] 0 2024-04-18T10:42:47.250 INFO:tasks.workunit.client.0.smithi040.stdout:8/568: unlink d2/d10/d6a/l93 0 2024-04-18T10:42:47.252 INFO:tasks.workunit.client.0.smithi040.stdout:7/534: rename d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/d8a/f96 to d6/d25/d28/dac/d64/d7e/fb0 0 2024-04-18T10:42:47.252 INFO:tasks.workunit.client.0.smithi040.stdout:0/552: truncate dd/df/d4e/f7d 587724 0 2024-04-18T10:42:47.253 INFO:tasks.workunit.client.0.smithi040.stdout:2/469: fsync dd/f15 0 2024-04-18T10:42:47.254 INFO:tasks.workunit.client.0.smithi040.stdout:7/535: chown d6/l7b 327 1 2024-04-18T10:42:47.256 INFO:tasks.workunit.client.0.smithi040.stdout:1/542: dread d1/d1c/d7b/f83 [4194304,4194304] 0 2024-04-18T10:42:47.256 INFO:tasks.workunit.client.0.smithi040.stdout:8/569: creat d2/d22/d49/d79/fc6 x:0 0 0 2024-04-18T10:42:47.258 INFO:tasks.workunit.client.0.smithi040.stdout:5/479: dwrite d0/d4e/f4c [0,4194304] 0 2024-04-18T10:42:47.258 INFO:tasks.workunit.client.0.smithi040.stdout:7/536: chown d6/d25/d28/dac/l4f 1130 1 2024-04-18T10:42:47.259 INFO:tasks.workunit.client.0.smithi040.stdout:2/470: mkdir dd/d14/d2b/d7c/d37/d38/d8c 0 2024-04-18T10:42:47.260 INFO:tasks.workunit.client.0.smithi040.stdout:3/532: dread d1/d7/d28/f61 [0,4194304] 0 2024-04-18T10:42:47.261 INFO:tasks.workunit.client.0.smithi040.stdout:1/543: write d1/d1c/d7b/d2e/d3e/f6a [889399,109313] 0 2024-04-18T10:42:47.262 INFO:tasks.workunit.client.0.smithi040.stdout:8/570: dread d2/d5/fa8 [0,4194304] 0 2024-04-18T10:42:47.263 INFO:tasks.workunit.client.0.smithi040.stdout:0/553: rename dd/df/d19/d28/d3a/d5b/d8f to dd/df/d19/d28/db7/dd4 0 2024-04-18T10:42:47.265 INFO:tasks.workunit.client.0.smithi040.stdout:0/554: truncate dd/df/d19/d28/d3a/d5b/fa6 2001776 0 2024-04-18T10:42:47.266 INFO:tasks.workunit.client.0.smithi040.stdout:0/555: write dd/df/f13 [1829943,39634] 0 2024-04-18T10:42:47.267 INFO:tasks.workunit.client.0.smithi040.stdout:0/556: read - dd/df/d19/d3e/d77/f85 zero size 2024-04-18T10:42:47.268 INFO:tasks.workunit.client.0.smithi040.stdout:3/533: unlink d1/d2/d16/d18/ca0 0 2024-04-18T10:42:47.270 INFO:tasks.workunit.client.0.smithi040.stdout:0/557: dread dd/d62/f74 [0,4194304] 0 2024-04-18T10:42:47.271 INFO:tasks.workunit.client.0.smithi040.stdout:4/519: sync 2024-04-18T10:42:47.272 INFO:tasks.workunit.client.0.smithi040.stdout:4/520: fdatasync d2/d3/d41/d47/d6f/f85 0 2024-04-18T10:42:47.272 INFO:tasks.workunit.client.0.smithi040.stdout:3/534: mkdir d1/d7/d28/db7 0 2024-04-18T10:42:47.274 INFO:tasks.workunit.client.0.smithi040.stdout:2/471: rename dd/d14/l18 to dd/d14/d2b/d7c/l8d 0 2024-04-18T10:42:47.274 INFO:tasks.workunit.client.0.smithi040.stdout:8/571: symlink d2/d2c/dbf/dc2/lc7 0 2024-04-18T10:42:47.275 INFO:tasks.workunit.client.0.smithi040.stdout:7/537: dread d6/d25/f3a [0,4194304] 0 2024-04-18T10:42:47.275 INFO:tasks.workunit.client.0.smithi040.stdout:1/544: creat d1/fc6 x:0 0 0 2024-04-18T10:42:47.275 INFO:tasks.workunit.client.0.smithi040.stdout:6/518: dread fa [0,4194304] 0 2024-04-18T10:42:47.276 INFO:tasks.workunit.client.0.smithi040.stdout:0/558: fdatasync dd/df/d19/d28/d3a/fa7 0 2024-04-18T10:42:47.280 INFO:tasks.workunit.client.0.smithi040.stdout:7/538: mkdir d6/d25/d28/dac/db1 0 2024-04-18T10:42:47.282 INFO:tasks.workunit.client.0.smithi040.stdout:2/472: truncate dd/d14/d2b/d7c/f84 355794 0 2024-04-18T10:42:47.283 INFO:tasks.workunit.client.0.smithi040.stdout:1/545: write d1/d1c/d2b/d32/d36/d4d/d67/faf [241519,84932] 0 2024-04-18T10:42:47.285 INFO:tasks.workunit.client.0.smithi040.stdout:3/535: dwrite d1/d7/d3a/f50 [0,4194304] 0 2024-04-18T10:42:47.287 INFO:tasks.workunit.client.0.smithi040.stdout:2/473: read - dd/d61/f70 zero size 2024-04-18T10:42:47.289 INFO:tasks.workunit.client.0.smithi040.stdout:3/536: chown d1/d7/d12 36592620 1 2024-04-18T10:42:47.290 INFO:tasks.workunit.client.0.smithi040.stdout:1/546: chown d1/d1c/d2b/c49 198798 1 2024-04-18T10:42:47.291 INFO:tasks.workunit.client.0.smithi040.stdout:8/572: dwrite d2/f41 [0,4194304] 0 2024-04-18T10:42:47.292 INFO:tasks.workunit.client.0.smithi040.stdout:2/474: mkdir dd/d61/d8e 0 2024-04-18T10:42:47.293 INFO:tasks.workunit.client.0.smithi040.stdout:4/521: dread d2/d3/d41/d62/d7c/f95 [0,4194304] 0 2024-04-18T10:42:47.294 INFO:tasks.workunit.client.0.smithi040.stdout:1/547: truncate d1/d1c/d2b/d32/d7e/fc1 656982 0 2024-04-18T10:42:47.296 INFO:tasks.workunit.client.0.smithi040.stdout:3/537: creat d1/d2/d4e/d58/d62/fb8 x:0 0 0 2024-04-18T10:42:47.296 INFO:tasks.workunit.client.0.smithi040.stdout:3/538: fdatasync d1/f1a 0 2024-04-18T10:42:47.298 INFO:tasks.workunit.client.0.smithi040.stdout:8/573: creat d2/d5/d9/d3c/fc8 x:0 0 0 2024-04-18T10:42:47.299 INFO:tasks.workunit.client.0.smithi040.stdout:4/522: readlink d2/d3/d4/d21/d28/d3f/l4c 0 2024-04-18T10:42:47.299 INFO:tasks.workunit.client.0.smithi040.stdout:5/480: write d0/d78/f9c [3507942,24170] 0 2024-04-18T10:42:47.301 INFO:tasks.workunit.client.0.smithi040.stdout:1/548: unlink d1/f7f 0 2024-04-18T10:42:47.301 INFO:tasks.workunit.client.0.smithi040.stdout:1/549: dread - d1/fa5 zero size 2024-04-18T10:42:47.304 INFO:tasks.workunit.client.0.smithi040.stdout:9/568: sync 2024-04-18T10:42:47.305 INFO:tasks.workunit.client.0.smithi040.stdout:3/539: creat d1/d2/d16/d18/d91/fb9 x:0 0 0 2024-04-18T10:42:47.305 INFO:tasks.workunit.client.0.smithi040.stdout:3/540: chown d1/d7/lc 68 1 2024-04-18T10:42:47.307 INFO:tasks.workunit.client.0.smithi040.stdout:5/481: symlink d0/d21/la0 0 2024-04-18T10:42:47.307 INFO:tasks.workunit.client.0.smithi040.stdout:4/523: fsync d2/d3/d41/d62/d7c/f95 0 2024-04-18T10:42:47.309 INFO:tasks.workunit.client.0.smithi040.stdout:2/475: mknod dd/d14/d2b/d7c/d37/d38/d8c/c8f 0 2024-04-18T10:42:47.311 INFO:tasks.workunit.client.0.smithi040.stdout:9/569: mkdir d2/d3/d22/d2e/d35/daf/dc7 0 2024-04-18T10:42:47.312 INFO:tasks.workunit.client.0.smithi040.stdout:5/482: dread d0/d3b/d88/f94 [0,4194304] 0 2024-04-18T10:42:47.313 INFO:tasks.workunit.client.0.smithi040.stdout:8/574: mknod d2/d22/d49/cc9 0 2024-04-18T10:42:47.314 INFO:tasks.workunit.client.0.smithi040.stdout:3/541: mkdir d1/d7/d67/dba 0 2024-04-18T10:42:47.316 INFO:tasks.workunit.client.0.smithi040.stdout:9/570: read - d2/dd/de/f6c zero size 2024-04-18T10:42:47.317 INFO:tasks.workunit.client.0.smithi040.stdout:6/519: truncate df/d4b/d6e/d3f/d53/d8a/fac 12959 0 2024-04-18T10:42:47.320 INFO:tasks.workunit.client.0.smithi040.stdout:8/575: write d2/d2c/f3b [5032400,121915] 0 2024-04-18T10:42:47.321 INFO:tasks.workunit.client.0.smithi040.stdout:3/542: dread - d1/d7/d3a/fa8 zero size 2024-04-18T10:42:47.325 INFO:tasks.workunit.client.0.smithi040.stdout:0/559: dwrite dd/df/d19/f8c [0,4194304] 0 2024-04-18T10:42:47.326 INFO:tasks.workunit.client.0.smithi040.stdout:4/524: dwrite d2/d3/d4/d21/f58 [0,4194304] 0 2024-04-18T10:42:47.326 INFO:tasks.workunit.client.0.smithi040.stdout:5/483: write d0/d3/d6b/d7b/f85 [9304297,40018] 0 2024-04-18T10:42:47.328 INFO:tasks.workunit.client.0.smithi040.stdout:8/576: rmdir d2/d4c/d97 39 2024-04-18T10:42:47.330 INFO:tasks.workunit.client.0.smithi040.stdout:7/539: dwrite d6/f14 [0,4194304] 0 2024-04-18T10:42:47.330 INFO:tasks.workunit.client.0.smithi040.stdout:9/571: rename d2/d5b/d6f/d80/d75/f88 to d2/d5b/fc8 0 2024-04-18T10:42:47.331 INFO:tasks.workunit.client.0.smithi040.stdout:1/550: dread d1/f15 [0,4194304] 0 2024-04-18T10:42:47.332 INFO:tasks.workunit.client.0.smithi040.stdout:1/551: chown d1/d16/d92/dad 46670282 1 2024-04-18T10:42:47.337 INFO:tasks.workunit.client.0.smithi040.stdout:0/560: unlink dd/df/d19/d28/db7/dd4/fc9 0 2024-04-18T10:42:47.337 INFO:tasks.workunit.client.0.smithi040.stdout:0/561: readlink dd/l12 0 2024-04-18T10:42:47.338 INFO:tasks.workunit.client.0.smithi040.stdout:0/562: fdatasync dd/df/d19/d28/fa8 0 2024-04-18T10:42:47.339 INFO:tasks.workunit.client.0.smithi040.stdout:0/563: write dd/d91/fbf [862256,58314] 0 2024-04-18T10:42:47.339 INFO:tasks.workunit.client.0.smithi040.stdout:6/520: link df/d4b/d6e/d3f/d53/d8a/d95/f98 df/d4b/fb6 0 2024-04-18T10:42:47.340 INFO:tasks.workunit.client.0.smithi040.stdout:6/521: write df/d76/d91/fa5 [278559,73596] 0 2024-04-18T10:42:47.341 INFO:tasks.workunit.client.0.smithi040.stdout:6/522: chown df/d76/d91 33194675 1 2024-04-18T10:42:47.342 INFO:tasks.workunit.client.0.smithi040.stdout:1/552: rmdir d1/d9b 39 2024-04-18T10:42:47.343 INFO:tasks.workunit.client.0.smithi040.stdout:2/476: dread dd/d14/d2b/d7c/d37/d38/f57 [0,4194304] 0 2024-04-18T10:42:47.344 INFO:tasks.workunit.client.0.smithi040.stdout:9/572: mknod d2/d3/cc9 0 2024-04-18T10:42:47.345 INFO:tasks.workunit.client.0.smithi040.stdout:5/484: symlink d0/d78/d95/d52/d5d/d9f/la1 0 2024-04-18T10:42:47.345 INFO:tasks.workunit.client.0.smithi040.stdout:9/573: read - d2/d5b/d6f/d80/f8b zero size 2024-04-18T10:42:47.346 INFO:tasks.workunit.client.0.smithi040.stdout:6/523: mkdir df/d4b/db7 0 2024-04-18T10:42:47.347 INFO:tasks.workunit.client.0.smithi040.stdout:8/577: creat d2/d15/fca x:0 0 0 2024-04-18T10:42:47.347 INFO:tasks.workunit.client.0.smithi040.stdout:8/578: dread - d2/d5/d9/d63/f64 zero size 2024-04-18T10:42:47.348 INFO:tasks.workunit.client.0.smithi040.stdout:3/543: rename d1/d2/d16/d18/d3b/f3f to d1/d2/d16/fbb 0 2024-04-18T10:42:47.348 INFO:tasks.workunit.client.0.smithi040.stdout:2/477: rename dd/d14 to dd/d14/d44/d77/d90 22 2024-04-18T10:42:47.349 INFO:tasks.workunit.client.0.smithi040.stdout:0/564: mkdir dd/df/d19/dd5 0 2024-04-18T10:42:47.359 INFO:tasks.workunit.client.0.smithi040.stdout:4/525: getdents d2/d3/d4/dd/d6d 0 2024-04-18T10:42:47.360 INFO:tasks.workunit.client.0.smithi040.stdout:9/574: symlink d2/d3/d22/d2e/d35/daf/dc7/lca 0 2024-04-18T10:42:47.361 INFO:tasks.workunit.client.0.smithi040.stdout:3/544: mknod d1/d7/d28/cbc 0 2024-04-18T10:42:47.361 INFO:tasks.workunit.client.0.smithi040.stdout:1/553: creat d1/d1c/d2b/d32/fc7 x:0 0 0 2024-04-18T10:42:47.363 INFO:tasks.workunit.client.0.smithi040.stdout:9/575: dread - d2/d3/d22/d2e/f63 zero size 2024-04-18T10:42:47.364 INFO:tasks.workunit.client.0.smithi040.stdout:6/524: dwrite df/d4b/d6a/d93/f47 [0,4194304] 0 2024-04-18T10:42:47.365 INFO:tasks.workunit.client.0.smithi040.stdout:3/545: write d1/f1a [2887572,103580] 0 2024-04-18T10:42:47.370 INFO:tasks.workunit.client.0.smithi040.stdout:3/546: truncate d1/d2/f48 4293754 0 2024-04-18T10:42:47.372 INFO:tasks.workunit.client.0.smithi040.stdout:9/576: symlink d2/d3/d22/db3/lcb 0 2024-04-18T10:42:47.372 INFO:tasks.workunit.client.0.smithi040.stdout:0/565: dwrite dd/df/d19/d3e/f7e [0,4194304] 0 2024-04-18T10:42:47.374 INFO:tasks.workunit.client.0.smithi040.stdout:1/554: mkdir d1/d1c/d2b/d32/dc8 0 2024-04-18T10:42:47.375 INFO:tasks.workunit.client.0.smithi040.stdout:7/540: dwrite d6/d25/d28/f4b [0,4194304] 0 2024-04-18T10:42:47.377 INFO:tasks.workunit.client.0.smithi040.stdout:0/566: rmdir dd/df/d4e 39 2024-04-18T10:42:47.379 INFO:tasks.workunit.client.0.smithi040.stdout:3/547: dread d1/d7/d28/d81/f85 [0,4194304] 0 2024-04-18T10:42:47.380 INFO:tasks.workunit.client.0.smithi040.stdout:4/526: dwrite d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:47.380 INFO:tasks.workunit.client.0.smithi040.stdout:3/548: chown d1/d7/d3a 14798782 1 2024-04-18T10:42:47.381 INFO:tasks.workunit.client.0.smithi040.stdout:8/579: truncate d2/d22/d49/f9a 540799 0 2024-04-18T10:42:47.382 INFO:tasks.workunit.client.0.smithi040.stdout:7/541: truncate d6/d25/d28/fa1 12085 0 2024-04-18T10:42:47.382 INFO:tasks.workunit.client.0.smithi040.stdout:6/525: write df/f12 [1686922,123414] 0 2024-04-18T10:42:47.383 INFO:tasks.workunit.client.0.smithi040.stdout:1/555: symlink d1/d1c/d2b/d32/d35/lc9 0 2024-04-18T10:42:47.383 INFO:tasks.workunit.client.0.smithi040.stdout:9/577: getdents d2/d3/d22/d2e/d35/daf/dc2 0 2024-04-18T10:42:47.385 INFO:tasks.workunit.client.0.smithi040.stdout:4/527: chown d2/d3/d4/d21/f7b 6839 1 2024-04-18T10:42:47.387 INFO:tasks.workunit.client.0.smithi040.stdout:0/567: creat dd/fd6 x:0 0 0 2024-04-18T10:42:47.387 INFO:tasks.workunit.client.0.smithi040.stdout:7/542: write d6/d25/d28/dac/d63/f86 [635584,49018] 0 2024-04-18T10:42:47.389 INFO:tasks.workunit.client.0.smithi040.stdout:2/478: dwrite dd/d14/d2b/d7c/d37/f74 [0,4194304] 0 2024-04-18T10:42:47.391 INFO:tasks.workunit.client.0.smithi040.stdout:7/543: write d6/d25/f46 [3203712,34865] 0 2024-04-18T10:42:47.392 INFO:tasks.workunit.client.0.smithi040.stdout:3/549: rename d1/d7/d28/l54 to d1/d2/d4e/d58/d8e/lbd 0 2024-04-18T10:42:47.393 INFO:tasks.workunit.client.0.smithi040.stdout:6/526: rename df/d4b/d63/db3 to df/d4b/d63/db3/db8 22 2024-04-18T10:42:47.394 INFO:tasks.workunit.client.0.smithi040.stdout:2/479: chown dd/d14/d44/d4c/d6b/f7e 35118 1 2024-04-18T10:42:47.398 INFO:tasks.workunit.client.0.smithi040.stdout:7/544: truncate d6/d25/d28/fa1 418713 0 2024-04-18T10:42:47.400 INFO:tasks.workunit.client.0.smithi040.stdout:0/568: link dd/df/d19/d28/db7/dd4/fbc dd/df/d19/d28/d3a/d42/fd7 0 2024-04-18T10:42:47.402 INFO:tasks.workunit.client.0.smithi040.stdout:9/578: getdents d2/d3/d22/d2e/d35/d40/d85 0 2024-04-18T10:42:47.402 INFO:tasks.workunit.client.0.smithi040.stdout:6/527: mkdir df/d76/db9 0 2024-04-18T10:42:47.403 INFO:tasks.workunit.client.0.smithi040.stdout:8/580: dwrite d2/d5/d9/f44 [0,4194304] 0 2024-04-18T10:42:47.403 INFO:tasks.workunit.client.0.smithi040.stdout:2/480: write dd/d14/d44/d4c/d6b/f7e [590281,114520] 0 2024-04-18T10:42:47.405 INFO:tasks.workunit.client.0.smithi040.stdout:5/485: sync 2024-04-18T10:42:47.406 INFO:tasks.workunit.client.0.smithi040.stdout:1/556: dwrite d1/d1c/d2b/d32/d35/f5d [0,4194304] 0 2024-04-18T10:42:47.409 INFO:tasks.workunit.client.0.smithi040.stdout:8/581: readlink d2/d22/d49/lc0 0 2024-04-18T10:42:47.410 INFO:tasks.workunit.client.0.smithi040.stdout:0/569: fsync dd/df/d19/d28/d3a/d42/fcb 0 2024-04-18T10:42:47.414 INFO:tasks.workunit.client.0.smithi040.stdout:4/528: dwrite d2/d3/d4/d1f/d29/d49/d31/f61 [4194304,4194304] 0 2024-04-18T10:42:47.417 INFO:tasks.workunit.client.0.smithi040.stdout:1/557: fsync d1/f30 0 2024-04-18T10:42:47.417 INFO:tasks.workunit.client.0.smithi040.stdout:3/550: dwrite d1/d7/d12/d7b/fb3 [0,4194304] 0 2024-04-18T10:42:47.418 INFO:tasks.workunit.client.0.smithi040.stdout:6/528: symlink df/d4b/d6e/d3f/d53/d8a/lba 0 2024-04-18T10:42:47.423 INFO:tasks.workunit.client.0.smithi040.stdout:0/570: mkdir dd/daa/dd8 0 2024-04-18T10:42:47.423 INFO:tasks.workunit.client.0.smithi040.stdout:2/481: symlink dd/d14/d44/d5f/d82/d72/l91 0 2024-04-18T10:42:47.424 INFO:tasks.workunit.client.0.smithi040.stdout:6/529: write df/d76/d91/fa1 [1087203,87247] 0 2024-04-18T10:42:47.424 INFO:tasks.workunit.client.0.smithi040.stdout:7/545: dwrite d6/f94 [4194304,4194304] 0 2024-04-18T10:42:47.426 INFO:tasks.workunit.client.0.smithi040.stdout:9/579: dread d2/d3/d22/d2e/f3d [0,4194304] 0 2024-04-18T10:42:47.426 INFO:tasks.workunit.client.0.smithi040.stdout:1/558: creat d1/d1c/d7b/d2e/d3e/d85/fca x:0 0 0 2024-04-18T10:42:47.427 INFO:tasks.workunit.client.0.smithi040.stdout:2/482: fdatasync dd/f15 0 2024-04-18T10:42:47.427 INFO:tasks.workunit.client.0.smithi040.stdout:3/551: mkdir d1/d2/d4e/d58/dbe 0 2024-04-18T10:42:47.428 INFO:tasks.workunit.client.0.smithi040.stdout:5/486: dwrite d0/d3/f38 [0,4194304] 0 2024-04-18T10:42:47.431 INFO:tasks.workunit.client.0.smithi040.stdout:2/483: fdatasync dd/d14/d44/f85 0 2024-04-18T10:42:47.431 INFO:tasks.workunit.client.0.smithi040.stdout:1/559: chown d1/d1c/d7b/d2e/d39 4968 1 2024-04-18T10:42:47.431 INFO:tasks.workunit.client.0.smithi040.stdout:0/571: write dd/df/d19/d3e/d77/fa2 [2426620,130959] 0 2024-04-18T10:42:47.434 INFO:tasks.workunit.client.0.smithi040.stdout:3/552: write d1/d2/d16/d18/d91/f98 [3455217,93299] 0 2024-04-18T10:42:47.434 INFO:tasks.workunit.client.0.smithi040.stdout:9/580: write d2/d5b/fc8 [1523971,90874] 0 2024-04-18T10:42:47.436 INFO:tasks.workunit.client.0.smithi040.stdout:7/546: mknod d6/d50/d79/d90/cb2 0 2024-04-18T10:42:47.436 INFO:tasks.workunit.client.0.smithi040.stdout:8/582: dwrite d2/d5/d9/d3c/d5a/f56 [0,4194304] 0 2024-04-18T10:42:47.436 INFO:tasks.workunit.client.0.smithi040.stdout:0/572: chown dd/df/d19/d28/c48 12129 1 2024-04-18T10:42:47.437 INFO:tasks.workunit.client.0.smithi040.stdout:2/484: write dd/d14/d44/d4c/f88 [394646,52640] 0 2024-04-18T10:42:47.441 INFO:tasks.workunit.client.0.smithi040.stdout:9/581: creat d2/d3/d22/d2e/fcc x:0 0 0 2024-04-18T10:42:47.441 INFO:tasks.workunit.client.0.smithi040.stdout:2/485: write dd/d14/d4a/f71 [285332,41832] 0 2024-04-18T10:42:47.442 INFO:tasks.workunit.client.0.smithi040.stdout:6/530: dread df/d4b/d6a/d93/f29 [0,4194304] 0 2024-04-18T10:42:47.443 INFO:tasks.workunit.client.0.smithi040.stdout:8/583: creat d2/d15/d78/fcb x:0 0 0 2024-04-18T10:42:47.444 INFO:tasks.workunit.client.0.smithi040.stdout:7/547: symlink d6/d25/d28/d2c/d2d/d47/lb3 0 2024-04-18T10:42:47.446 INFO:tasks.workunit.client.0.smithi040.stdout:9/582: write d2/d3/d22/d2e/d35/d40/fa9 [500725,112994] 0 2024-04-18T10:42:47.446 INFO:tasks.workunit.client.0.smithi040.stdout:6/531: mkdir df/d4b/d63/dbb 0 2024-04-18T10:42:47.448 INFO:tasks.workunit.client.0.smithi040.stdout:5/487: dwrite d0/d3b/d3f/f41 [0,4194304] 0 2024-04-18T10:42:47.448 INFO:tasks.workunit.client.0.smithi040.stdout:6/532: readlink df/laa 0 2024-04-18T10:42:47.452 INFO:tasks.workunit.client.0.smithi040.stdout:3/553: link d1/d7/c45 d1/d2/d4e/d58/d62/cbf 0 2024-04-18T10:42:47.454 INFO:tasks.workunit.client.0.smithi040.stdout:7/548: write d6/d25/f3f [1475595,124437] 0 2024-04-18T10:42:47.454 INFO:tasks.workunit.client.0.smithi040.stdout:5/488: symlink d0/d21/d42/d76/la2 0 2024-04-18T10:42:47.454 INFO:tasks.workunit.client.0.smithi040.stdout:0/573: dread dd/df/d19/d28/d3a/d42/f52 [0,4194304] 0 2024-04-18T10:42:47.455 INFO:tasks.workunit.client.0.smithi040.stdout:3/554: chown d1/l11 35664 1 2024-04-18T10:42:47.456 INFO:tasks.workunit.client.0.smithi040.stdout:6/533: dread df/d4b/d6a/d93/f8e [0,4194304] 0 2024-04-18T10:42:47.456 INFO:tasks.workunit.client.0.smithi040.stdout:9/583: mkdir d2/d3/d22/d2e/d35/dbb/dcd 0 2024-04-18T10:42:47.458 INFO:tasks.workunit.client.0.smithi040.stdout:2/486: dwrite dd/d14/d2b/d7c/d37/f4b [0,4194304] 0 2024-04-18T10:42:47.459 INFO:tasks.workunit.client.0.smithi040.stdout:8/584: dwrite d2/d2c/da9/fbc [0,4194304] 0 2024-04-18T10:42:47.459 INFO:tasks.workunit.client.0.smithi040.stdout:5/489: mknod d0/d3b/d88/ca3 0 2024-04-18T10:42:47.460 INFO:tasks.workunit.client.0.smithi040.stdout:0/574: readlink dd/df/d19/d28/d3a/d46/l6f 0 2024-04-18T10:42:47.462 INFO:tasks.workunit.client.0.smithi040.stdout:0/575: chown dd/df/d19/d28/f6e 10919 1 2024-04-18T10:42:47.463 INFO:tasks.workunit.client.0.smithi040.stdout:2/487: write dd/d14/d2b/d7c/f84 [1229097,68943] 0 2024-04-18T10:42:47.466 INFO:tasks.workunit.client.0.smithi040.stdout:9/584: symlink d2/d3/d22/d2e/d35/daf/dc1/d46/d44/lce 0 2024-04-18T10:42:47.466 INFO:tasks.workunit.client.0.smithi040.stdout:6/534: mkdir df/d4b/d63/dbb/dbc 0 2024-04-18T10:42:47.466 INFO:tasks.workunit.client.0.smithi040.stdout:9/585: write d2/dd/de/f6c [178155,3720] 0 2024-04-18T10:42:47.472 INFO:tasks.workunit.client.0.smithi040.stdout:0/576: mknod dd/d62/cd9 0 2024-04-18T10:42:47.474 INFO:tasks.workunit.client.0.smithi040.stdout:2/488: creat dd/d14/d44/d4c/d52/f92 x:0 0 0 2024-04-18T10:42:47.475 INFO:tasks.workunit.client.0.smithi040.stdout:2/489: stat dd/d14/d44/d4c/d6b/f7e 0 2024-04-18T10:42:47.476 INFO:tasks.workunit.client.0.smithi040.stdout:7/549: getdents d6/d25/d28/dac/d63 0 2024-04-18T10:42:47.477 INFO:tasks.workunit.client.0.smithi040.stdout:9/586: mkdir d2/d3/d22/d2e/d35/daf/dc7/dcf 0 2024-04-18T10:42:47.480 INFO:tasks.workunit.client.0.smithi040.stdout:6/535: mkdir df/d76/db9/dbd 0 2024-04-18T10:42:47.481 INFO:tasks.workunit.client.0.smithi040.stdout:6/536: fdatasync df/f2f 0 2024-04-18T10:42:47.481 INFO:tasks.workunit.client.0.smithi040.stdout:1/560: rmdir d1/d1c/d7b/d2e/d3e 39 2024-04-18T10:42:47.483 INFO:tasks.workunit.client.0.smithi040.stdout:2/490: symlink dd/d14/d44/d5f/d82/d72/l93 0 2024-04-18T10:42:47.484 INFO:tasks.workunit.client.0.smithi040.stdout:0/577: rename dd/df/d4e/c67 to dd/df/d19/d28/db7/cda 0 2024-04-18T10:42:47.485 INFO:tasks.workunit.client.0.smithi040.stdout:5/490: getdents d0/d21 0 2024-04-18T10:42:47.486 INFO:tasks.workunit.client.0.smithi040.stdout:0/578: chown dd/df/d19/d28/fa8 4 1 2024-04-18T10:42:47.486 INFO:tasks.workunit.client.0.smithi040.stdout:5/491: chown d0/d3b/d3f/d72 10 1 2024-04-18T10:42:47.487 INFO:tasks.workunit.client.0.smithi040.stdout:1/561: mkdir d1/d1c/d2b/d32/d36/d4d/d67/dcb 0 2024-04-18T10:42:47.487 INFO:tasks.workunit.client.0.smithi040.stdout:5/492: write d0/d3b/d3f/f62 [2143935,18512] 0 2024-04-18T10:42:47.487 INFO:tasks.workunit.client.0.smithi040.stdout:7/550: symlink d6/d50/d79/da8/dad/lb4 0 2024-04-18T10:42:47.488 INFO:tasks.workunit.client.0.smithi040.stdout:9/587: mknod d2/d5b/d6f/dc3/cd0 0 2024-04-18T10:42:47.489 INFO:tasks.workunit.client.0.smithi040.stdout:2/491: creat dd/d14/d44/d4c/d52/f94 x:0 0 0 2024-04-18T10:42:47.492 INFO:tasks.workunit.client.0.smithi040.stdout:4/529: truncate d2/d3/d4/dd/d4f/f8c 3667936 0 2024-04-18T10:42:47.493 INFO:tasks.workunit.client.0.smithi040.stdout:2/492: dread dd/f6f [0,4194304] 0 2024-04-18T10:42:47.493 INFO:tasks.workunit.client.0.smithi040.stdout:5/493: chown d0/l2f 448 1 2024-04-18T10:42:47.494 INFO:tasks.workunit.client.0.smithi040.stdout:2/493: stat dd/d14/l24 0 2024-04-18T10:42:47.497 INFO:tasks.workunit.client.0.smithi040.stdout:6/537: link df/d4b/d6e/l39 df/d4b/d63/dbb/lbe 0 2024-04-18T10:42:47.499 INFO:tasks.workunit.client.0.smithi040.stdout:6/538: write df/d4b/d6e/f1e [5102230,6319] 0 2024-04-18T10:42:47.500 INFO:tasks.workunit.client.0.smithi040.stdout:1/562: dwrite d1/d1c/d7b/d2e/d3e/f6a [0,4194304] 0 2024-04-18T10:42:47.515 INFO:tasks.workunit.client.0.smithi040.stdout:7/551: dread d6/d25/d28/d2c/d2d/d47/f72 [0,4194304] 0 2024-04-18T10:42:47.516 INFO:tasks.workunit.client.0.smithi040.stdout:0/579: fsync dd/df/d19/d3e/d77/fcf 0 2024-04-18T10:42:47.549 INFO:tasks.workunit.client.0.smithi040.stdout:2/494: mkdir dd/d14/d2b/d95 0 2024-04-18T10:42:47.555 INFO:tasks.workunit.client.0.smithi040.stdout:2/495: dwrite dd/d14/f22 [0,4194304] 0 2024-04-18T10:42:47.559 INFO:tasks.workunit.client.0.smithi040.stdout:0/580: creat dd/d91/fdb x:0 0 0 2024-04-18T10:42:47.560 INFO:tasks.workunit.client.0.smithi040.stdout:0/581: dread - dd/df/d19/d28/d3a/d42/fcb zero size 2024-04-18T10:42:47.565 INFO:tasks.workunit.client.0.smithi040.stdout:3/555: truncate d1/d2/d16/f2d 451667 0 2024-04-18T10:42:47.566 INFO:tasks.workunit.client.0.smithi040.stdout:3/556: readlink d1/d7/d3a/l4a 0 2024-04-18T10:42:47.567 INFO:tasks.workunit.client.0.smithi040.stdout:8/585: truncate d2/d10/d14/f8c 106965 0 2024-04-18T10:42:47.568 INFO:tasks.workunit.client.0.smithi040.stdout:1/563: rmdir d1/d9b/d75/d84 39 2024-04-18T10:42:47.569 INFO:tasks.workunit.client.0.smithi040.stdout:1/564: write d1/f30 [3475625,71686] 0 2024-04-18T10:42:47.569 INFO:tasks.workunit.client.0.smithi040.stdout:6/539: link df/f2d df/d76/db9/dbd/fbf 0 2024-04-18T10:42:47.572 INFO:tasks.workunit.client.0.smithi040.stdout:2/496: creat dd/d14/d44/d4c/d49/f96 x:0 0 0 2024-04-18T10:42:47.575 INFO:tasks.workunit.client.0.smithi040.stdout:8/586: dwrite d2/d5/d9/fb [0,4194304] 0 2024-04-18T10:42:47.575 INFO:tasks.workunit.client.0.smithi040.stdout:0/582: dread dd/df/d19/d28/d3a/fa7 [0,4194304] 0 2024-04-18T10:42:47.577 INFO:tasks.workunit.client.0.smithi040.stdout:5/494: link d0/d21/d42/f55 d0/d3/fa4 0 2024-04-18T10:42:47.580 INFO:tasks.workunit.client.0.smithi040.stdout:2/497: write dd/f6f [1787,92746] 0 2024-04-18T10:42:47.586 INFO:tasks.workunit.client.0.smithi040.stdout:3/557: mkdir d1/d7/db2/dc0 0 2024-04-18T10:42:47.588 INFO:tasks.workunit.client.0.smithi040.stdout:3/558: dread d1/d2/d16/f40 [0,4194304] 0 2024-04-18T10:42:47.590 INFO:tasks.workunit.client.0.smithi040.stdout:1/565: mkdir d1/d1c/d2b/db5/dcc 0 2024-04-18T10:42:47.594 INFO:tasks.workunit.client.0.smithi040.stdout:7/552: getdents d6/d25/d28/d2c/d2d 0 2024-04-18T10:42:47.598 INFO:tasks.workunit.client.0.smithi040.stdout:1/566: symlink d1/d16/d92/lcd 0 2024-04-18T10:42:47.599 INFO:tasks.workunit.client.0.smithi040.stdout:1/567: readlink d1/db1/lb2 0 2024-04-18T10:42:47.599 INFO:tasks.workunit.client.0.smithi040.stdout:1/568: dread - d1/d1c/d7b/d2e/f55 zero size 2024-04-18T10:42:47.600 INFO:tasks.workunit.client.0.smithi040.stdout:1/569: chown d1/d1c/d7b/f98 78 1 2024-04-18T10:42:47.603 INFO:tasks.workunit.client.0.smithi040.stdout:6/540: link df/d4b/d6a/d93/f31 df/d4b/d6e/d3f/d53/fc0 0 2024-04-18T10:42:47.605 INFO:tasks.workunit.client.0.smithi040.stdout:5/495: link d0/d3/c18 d0/d3b/d3f/ca5 0 2024-04-18T10:42:47.607 INFO:tasks.workunit.client.0.smithi040.stdout:3/559: mkdir d1/d2/d4e/d58/dbe/dc1 0 2024-04-18T10:42:47.608 INFO:tasks.workunit.client.0.smithi040.stdout:2/498: creat dd/d14/d44/d4c/f97 x:0 0 0 2024-04-18T10:42:47.612 INFO:tasks.workunit.client.0.smithi040.stdout:7/553: dread d6/d25/d28/d2c/f3d [0,4194304] 0 2024-04-18T10:42:47.613 INFO:tasks.workunit.client.0.smithi040.stdout:5/496: mknod d0/d4e/d8e/ca6 0 2024-04-18T10:42:47.616 INFO:tasks.workunit.client.0.smithi040.stdout:6/541: mkdir df/d4b/db7/dc1 0 2024-04-18T10:42:47.618 INFO:tasks.workunit.client.0.smithi040.stdout:3/560: mkdir d1/d2/d4e/d58/dbe/dc1/dc2 0 2024-04-18T10:42:47.620 INFO:tasks.workunit.client.0.smithi040.stdout:7/554: dwrite d6/d25/d28/d2c/d2d/d47/f59 [0,4194304] 0 2024-04-18T10:42:47.624 INFO:tasks.workunit.client.0.smithi040.stdout:3/561: creat d1/d7/d12/fc3 x:0 0 0 2024-04-18T10:42:47.625 INFO:tasks.workunit.client.0.smithi040.stdout:5/497: dread d0/d78/d95/f5a [0,4194304] 0 2024-04-18T10:42:47.626 INFO:tasks.workunit.client.0.smithi040.stdout:6/542: dwrite df/d4b/d6e/d3f/d53/fc0 [0,4194304] 0 2024-04-18T10:42:47.628 INFO:tasks.workunit.client.0.smithi040.stdout:6/543: write df/d4b/d6a/d93/f1b [2232811,92252] 0 2024-04-18T10:42:47.628 INFO:tasks.workunit.client.0.smithi040.stdout:6/544: write df/d4b/d7e/fa2 [519369,37080] 0 2024-04-18T10:42:47.629 INFO:tasks.workunit.client.0.smithi040.stdout:3/562: mkdir d1/d2/d4e/d58/dc4 0 2024-04-18T10:42:47.633 INFO:tasks.workunit.client.0.smithi040.stdout:6/545: dread df/d4b/d6a/d93/f47 [0,4194304] 0 2024-04-18T10:42:47.642 INFO:tasks.workunit.client.0.smithi040.stdout:6/546: fdatasync df/f20 0 2024-04-18T10:42:47.647 INFO:tasks.workunit.client.0.smithi040.stdout:6/547: rename df/d4b/d63/dbb/dbc to df/d76/dc2 0 2024-04-18T10:42:47.647 INFO:tasks.workunit.client.0.smithi040.stdout:2/499: sync 2024-04-18T10:42:47.647 INFO:tasks.workunit.client.0.smithi040.stdout:8/587: sync 2024-04-18T10:42:47.647 INFO:tasks.workunit.client.0.smithi040.stdout:0/583: sync 2024-04-18T10:42:47.648 INFO:tasks.workunit.client.0.smithi040.stdout:6/548: dread - df/d4b/d7e/f88 zero size 2024-04-18T10:42:47.648 INFO:tasks.workunit.client.0.smithi040.stdout:0/584: chown dd/df/d19/d3e/lad 18396 1 2024-04-18T10:42:47.651 INFO:tasks.workunit.client.0.smithi040.stdout:0/585: write dd/df/d19/d28/f2d [747083,96951] 0 2024-04-18T10:42:47.653 INFO:tasks.workunit.client.0.smithi040.stdout:6/549: creat df/d4b/db7/dc1/fc3 x:0 0 0 2024-04-18T10:42:47.656 INFO:tasks.workunit.client.0.smithi040.stdout:0/586: symlink dd/df/d4e/ldc 0 2024-04-18T10:42:47.656 INFO:tasks.workunit.client.0.smithi040.stdout:2/500: dwrite dd/d14/d44/d4c/f87 [0,4194304] 0 2024-04-18T10:42:47.657 INFO:tasks.workunit.client.0.smithi040.stdout:6/550: dread - df/d4b/d6e/d3f/d53/d8a/d95/f98 zero size 2024-04-18T10:42:47.658 INFO:tasks.workunit.client.0.smithi040.stdout:2/501: chown dd/d14/d2b/c3b 792 1 2024-04-18T10:42:47.664 INFO:tasks.workunit.client.0.smithi040.stdout:6/551: dread df/f55 [0,4194304] 0 2024-04-18T10:42:47.664 INFO:tasks.workunit.client.0.smithi040.stdout:3/563: dread d1/d2/d16/d18/d91/db1/f97 [0,4194304] 0 2024-04-18T10:42:47.665 INFO:tasks.workunit.client.0.smithi040.stdout:6/552: truncate df/f12 2521472 0 2024-04-18T10:42:47.666 INFO:tasks.workunit.client.0.smithi040.stdout:7/555: dread d6/d25/d28/d2c/f4c [0,4194304] 0 2024-04-18T10:42:47.667 INFO:tasks.workunit.client.0.smithi040.stdout:0/587: rename dd/df/d19/d3e/d77/fd2 to dd/d91/fdd 0 2024-04-18T10:42:47.667 INFO:tasks.workunit.client.0.smithi040.stdout:7/556: write d6/d25/f62 [9147841,1702] 0 2024-04-18T10:42:47.669 INFO:tasks.workunit.client.0.smithi040.stdout:7/557: chown d6/d25/d28/d2c/c34 3643010 1 2024-04-18T10:42:47.670 INFO:tasks.workunit.client.0.smithi040.stdout:2/502: mkdir dd/d61/d8e/d98 0 2024-04-18T10:42:47.671 INFO:tasks.workunit.client.0.smithi040.stdout:6/553: mkdir df/d4b/d99/dc4 0 2024-04-18T10:42:47.676 INFO:tasks.workunit.client.0.smithi040.stdout:2/503: chown dd/d14/d2b/d7c/d37/d38/c39 1984769 1 2024-04-18T10:42:47.677 INFO:tasks.workunit.client.0.smithi040.stdout:6/554: rmdir df/d76/d91 39 2024-04-18T10:42:47.679 INFO:tasks.workunit.client.0.smithi040.stdout:8/588: dread d2/f17 [0,4194304] 0 2024-04-18T10:42:47.679 INFO:tasks.workunit.client.0.smithi040.stdout:0/588: mknod dd/df/d19/d28/d3a/d5b/dd0/cde 0 2024-04-18T10:42:47.680 INFO:tasks.workunit.client.0.smithi040.stdout:8/589: dread - d2/d22/d49/f8f zero size 2024-04-18T10:42:47.681 INFO:tasks.workunit.client.0.smithi040.stdout:4/530: truncate d2/d3/d4/f2e 3146241 0 2024-04-18T10:42:47.687 INFO:tasks.workunit.client.0.smithi040.stdout:2/504: unlink dd/d14/d2b/d7c/d37/d38/c59 0 2024-04-18T10:42:47.692 INFO:tasks.workunit.client.0.smithi040.stdout:4/531: dwrite d2/d3/d4/f12 [0,4194304] 0 2024-04-18T10:42:47.693 INFO:tasks.workunit.client.0.smithi040.stdout:8/590: creat d2/d22/fcc x:0 0 0 2024-04-18T10:42:47.694 INFO:tasks.workunit.client.0.smithi040.stdout:4/532: dread - d2/d3/d4/d1f/d29/d49/d31/f88 zero size 2024-04-18T10:42:47.697 INFO:tasks.workunit.client.0.smithi040.stdout:2/505: creat dd/d14/d44/f99 x:0 0 0 2024-04-18T10:42:47.697 INFO:tasks.workunit.client.0.smithi040.stdout:5/498: rmdir d0/d21/d42 39 2024-04-18T10:42:47.698 INFO:tasks.workunit.client.0.smithi040.stdout:5/499: stat d0/d78/f9c 0 2024-04-18T10:42:47.699 INFO:tasks.workunit.client.0.smithi040.stdout:4/533: write d2/f2c [1796210,55255] 0 2024-04-18T10:42:47.700 INFO:tasks.workunit.client.0.smithi040.stdout:4/534: fsync d2/d3/d4/d1f/f66 0 2024-04-18T10:42:47.700 INFO:tasks.workunit.client.0.smithi040.stdout:4/535: readlink d2/d3/d4/d21/d28/d3f/l4c 0 2024-04-18T10:42:47.701 INFO:tasks.workunit.client.0.smithi040.stdout:2/506: creat dd/d14/d44/d4c/d6b/f9a x:0 0 0 2024-04-18T10:42:47.702 INFO:tasks.workunit.client.0.smithi040.stdout:2/507: write dd/d14/d44/d4c/d52/f89 [828786,28833] 0 2024-04-18T10:42:47.703 INFO:tasks.workunit.client.0.smithi040.stdout:2/508: chown dd/d14/d2b/d7c/l40 0 1 2024-04-18T10:42:47.705 INFO:tasks.workunit.client.0.smithi040.stdout:4/536: mkdir d2/d3/d41/d47/d99 0 2024-04-18T10:42:47.706 INFO:tasks.workunit.client.0.smithi040.stdout:4/537: truncate d2/d3/d2f/f7e 1004031 0 2024-04-18T10:42:47.707 INFO:tasks.workunit.client.0.smithi040.stdout:4/538: chown d2/d3/c92 159343 1 2024-04-18T10:42:47.717 INFO:tasks.workunit.client.0.smithi040.stdout:8/591: symlink d2/d5/lcd 0 2024-04-18T10:42:47.718 INFO:tasks.workunit.client.0.smithi040.stdout:8/592: truncate d2/d15/d78/fcb 407407 0 2024-04-18T10:42:47.719 INFO:tasks.workunit.client.0.smithi040.stdout:8/593: write d2/d22/f38 [1087408,30809] 0 2024-04-18T10:42:47.719 INFO:tasks.workunit.client.0.smithi040.stdout:8/594: chown d2/d10/d14/l3a 632725 1 2024-04-18T10:42:47.728 INFO:tasks.workunit.client.0.smithi040.stdout:1/570: dwrite d1/d16/f41 [0,4194304] 0 2024-04-18T10:42:47.730 INFO:tasks.workunit.client.0.smithi040.stdout:1/571: mknod d1/d9b/cce 0 2024-04-18T10:42:47.732 INFO:tasks.workunit.client.0.smithi040.stdout:1/572: mkdir d1/d9b/dcf 0 2024-04-18T10:42:47.733 INFO:tasks.workunit.client.0.smithi040.stdout:1/573: readlink d1/d1c/d7b/d2e/da4/lbb 0 2024-04-18T10:42:47.734 INFO:tasks.workunit.client.0.smithi040.stdout:1/574: write d1/fa5 [86192,36816] 0 2024-04-18T10:42:47.736 INFO:tasks.workunit.client.0.smithi040.stdout:1/575: read d1/d1c/d2b/d32/d36/fae [3364650,115161] 0 2024-04-18T10:42:47.737 INFO:tasks.workunit.client.0.smithi040.stdout:1/576: write d1/d1c/d2b/d32/d36/fae [3809206,98270] 0 2024-04-18T10:42:47.737 INFO:tasks.workunit.client.0.smithi040.stdout:4/539: unlink d2/d3/d4/d1f/f66 0 2024-04-18T10:42:47.740 INFO:tasks.workunit.client.0.smithi040.stdout:9/588: creat d2/d3/d22/fd1 x:0 0 0 2024-04-18T10:42:47.740 INFO:tasks.workunit.client.0.smithi040.stdout:9/589: chown d2/dd/de 3670 1 2024-04-18T10:42:47.741 INFO:tasks.workunit.client.0.smithi040.stdout:4/540: mkdir d2/d3/d41/d62/d9a 0 2024-04-18T10:42:47.743 INFO:tasks.workunit.client.0.smithi040.stdout:9/590: symlink d2/d3/d22/d2e/d35/daf/dc1/ld2 0 2024-04-18T10:42:47.745 INFO:tasks.workunit.client.0.smithi040.stdout:1/577: creat d1/d1c/d7b/d2e/fd0 x:0 0 0 2024-04-18T10:42:47.747 INFO:tasks.workunit.client.0.smithi040.stdout:1/578: write d1/d1c/d2b/d32/d35/f5d [30530,103042] 0 2024-04-18T10:42:47.747 INFO:tasks.workunit.client.0.smithi040.stdout:4/541: mknod d2/d3/d4/d21/c9b 0 2024-04-18T10:42:47.748 INFO:tasks.workunit.client.0.smithi040.stdout:1/579: fsync d1/d1c/d7b/d2e/d9e/fab 0 2024-04-18T10:42:47.748 INFO:tasks.workunit.client.0.smithi040.stdout:9/591: chown d2/d3/f21 8688192 1 2024-04-18T10:42:47.754 INFO:tasks.workunit.client.0.smithi040.stdout:9/592: dwrite d2/d7/f29 [0,4194304] 0 2024-04-18T10:42:47.754 INFO:tasks.workunit.client.0.smithi040.stdout:6/555: rename df/d4b/d6a/ca0 to df/d4b/d6a/d93/cc5 0 2024-04-18T10:42:47.755 INFO:tasks.workunit.client.0.smithi040.stdout:6/556: readlink df/d4b/d6e/l64 0 2024-04-18T10:42:47.758 INFO:tasks.workunit.client.0.smithi040.stdout:2/509: rename dd/d14/d44/d4c/f88 to dd/d14/d4a/d54/f9b 0 2024-04-18T10:42:47.761 INFO:tasks.workunit.client.0.smithi040.stdout:6/557: chown df/d4b/d6a/d93/l2e 6 1 2024-04-18T10:42:47.761 INFO:tasks.workunit.client.0.smithi040.stdout:3/564: write d1/d2/d16/f2d [1195179,82880] 0 2024-04-18T10:42:47.762 INFO:tasks.workunit.client.0.smithi040.stdout:6/558: dread - df/d4b/f94 zero size 2024-04-18T10:42:47.764 INFO:tasks.workunit.client.0.smithi040.stdout:3/565: write d1/d7/d3a/f50 [4241853,86835] 0 2024-04-18T10:42:47.764 INFO:tasks.workunit.client.0.smithi040.stdout:4/542: dread d2/d3/d41/d62/d7c/f84 [0,4194304] 0 2024-04-18T10:42:47.765 INFO:tasks.workunit.client.0.smithi040.stdout:2/510: creat dd/d14/d4a/d54/f9c x:0 0 0 2024-04-18T10:42:47.767 INFO:tasks.workunit.client.0.smithi040.stdout:9/593: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d44/d8d/fd3 x:0 0 0 2024-04-18T10:42:47.767 INFO:tasks.workunit.client.0.smithi040.stdout:2/511: read - dd/d14/d44/f99 zero size 2024-04-18T10:42:47.768 INFO:tasks.workunit.client.0.smithi040.stdout:1/580: getdents d1/d9b/d75/d84 0 2024-04-18T10:42:47.770 INFO:tasks.workunit.client.0.smithi040.stdout:8/595: sync 2024-04-18T10:42:47.771 INFO:tasks.workunit.client.0.smithi040.stdout:6/559: creat df/d4b/db7/dc1/fc6 x:0 0 0 2024-04-18T10:42:47.771 INFO:tasks.workunit.client.0.smithi040.stdout:2/512: dread - dd/d14/f86 zero size 2024-04-18T10:42:47.772 INFO:tasks.workunit.client.0.smithi040.stdout:1/581: dread - d1/d16/d92/fbc zero size 2024-04-18T10:42:47.773 INFO:tasks.workunit.client.0.smithi040.stdout:6/560: stat df/d76/c85 0 2024-04-18T10:42:47.775 INFO:tasks.workunit.client.0.smithi040.stdout:3/566: dwrite d1/f8b [0,4194304] 0 2024-04-18T10:42:47.775 INFO:tasks.workunit.client.0.smithi040.stdout:5/500: symlink d0/d3b/la7 0 2024-04-18T10:42:47.775 INFO:tasks.workunit.client.0.smithi040.stdout:0/589: dwrite dd/df/d19/d3e/d77/fcf [0,4194304] 0 2024-04-18T10:42:47.777 INFO:tasks.workunit.client.0.smithi040.stdout:3/567: fsync d1/d2/d3c/f83 0 2024-04-18T10:42:47.777 INFO:tasks.workunit.client.0.smithi040.stdout:6/561: chown df/d4b/d6e/f9f 945325898 1 2024-04-18T10:42:47.778 INFO:tasks.workunit.client.0.smithi040.stdout:7/558: rmdir d6/d25/d28/d2c/d2d/d47/d5c 39 2024-04-18T10:42:47.779 INFO:tasks.workunit.client.0.smithi040.stdout:0/590: fsync dd/df/d4e/f50 0 2024-04-18T10:42:47.779 INFO:tasks.workunit.client.0.smithi040.stdout:2/513: mkdir dd/d14/d44/d5f/d9d 0 2024-04-18T10:42:47.780 INFO:tasks.workunit.client.0.smithi040.stdout:8/596: creat d2/d22/fce x:0 0 0 2024-04-18T10:42:47.781 INFO:tasks.workunit.client.0.smithi040.stdout:2/514: chown dd/d14/f22 35759 1 2024-04-18T10:42:47.782 INFO:tasks.workunit.client.0.smithi040.stdout:0/591: chown dd/df/d19/d28/d3a/d42/f52 15005 1 2024-04-18T10:42:47.783 INFO:tasks.workunit.client.0.smithi040.stdout:5/501: mknod d0/d78/d95/d52/ca8 0 2024-04-18T10:42:47.783 INFO:tasks.workunit.client.0.smithi040.stdout:2/515: write dd/d14/d44/d4c/f97 [840424,53307] 0 2024-04-18T10:42:47.787 INFO:tasks.workunit.client.0.smithi040.stdout:6/562: rename df/d4b/d6e/d3f/d53/l82 to df/d4b/d6e/d3f/d53/d8a/d95/da7/lc7 0 2024-04-18T10:42:47.787 INFO:tasks.workunit.client.0.smithi040.stdout:6/563: chown df/d4b/d6a 24387 1 2024-04-18T10:42:47.792 INFO:tasks.workunit.client.0.smithi040.stdout:5/502: creat d0/d3/d6b/d7b/fa9 x:0 0 0 2024-04-18T10:42:47.793 INFO:tasks.workunit.client.0.smithi040.stdout:7/559: creat d6/d50/fb5 x:0 0 0 2024-04-18T10:42:47.793 INFO:tasks.workunit.client.0.smithi040.stdout:2/516: symlink dd/d14/d44/d4c/d52/l9e 0 2024-04-18T10:42:47.794 INFO:tasks.workunit.client.0.smithi040.stdout:9/594: dread d2/d3/d22/d2e/f76 [0,4194304] 0 2024-04-18T10:42:47.795 INFO:tasks.workunit.client.0.smithi040.stdout:8/597: creat d2/fcf x:0 0 0 2024-04-18T10:42:47.795 INFO:tasks.workunit.client.0.smithi040.stdout:9/595: write d2/d3/d22/d2e/d35/daf/dc1/d46/d44/fb0 [13701,113494] 0 2024-04-18T10:42:47.799 INFO:tasks.workunit.client.0.smithi040.stdout:9/596: truncate d2/d3/d22/d2e/d35/daf/fba 489451 0 2024-04-18T10:42:47.802 INFO:tasks.workunit.client.0.smithi040.stdout:2/517: mknod dd/c9f 0 2024-04-18T10:42:47.803 INFO:tasks.workunit.client.0.smithi040.stdout:8/598: mkdir d2/d15/d2b/dd0 0 2024-04-18T10:42:47.804 INFO:tasks.workunit.client.0.smithi040.stdout:1/582: dread d1/d1c/d2b/d32/d36/d4d/d67/f8e [0,4194304] 0 2024-04-18T10:42:47.807 INFO:tasks.workunit.client.0.smithi040.stdout:5/503: getdents d0/d21 0 2024-04-18T10:42:47.807 INFO:tasks.workunit.client.0.smithi040.stdout:1/583: stat d1/d1c/d7b 0 2024-04-18T10:42:47.809 INFO:tasks.workunit.client.0.smithi040.stdout:9/597: dwrite d2/d3/d22/d2e/d35/d40/fa9 [0,4194304] 0 2024-04-18T10:42:47.809 INFO:tasks.workunit.client.0.smithi040.stdout:8/599: chown d2/d5/d9/d63/f64 254 1 2024-04-18T10:42:47.811 INFO:tasks.workunit.client.0.smithi040.stdout:2/518: link dd/d14/d2b/d7c/l31 dd/d61/la0 0 2024-04-18T10:42:47.811 INFO:tasks.workunit.client.0.smithi040.stdout:9/598: read - d2/d3/d22/d2e/fcc zero size 2024-04-18T10:42:47.813 INFO:tasks.workunit.client.0.smithi040.stdout:1/584: write d1/d1c/d2b/d32/d36/d4d/fc2 [2887263,98930] 0 2024-04-18T10:42:47.813 INFO:tasks.workunit.client.0.smithi040.stdout:5/504: truncate d0/d21/d42/f7d 1703922 0 2024-04-18T10:42:47.824 INFO:tasks.workunit.client.0.smithi040.stdout:4/543: sync 2024-04-18T10:42:47.826 INFO:tasks.workunit.client.0.smithi040.stdout:9/599: write d2/d3/d22/d2e/f76 [3609398,43180] 0 2024-04-18T10:42:47.828 INFO:tasks.workunit.client.0.smithi040.stdout:3/568: dread d1/d7/f15 [0,4194304] 0 2024-04-18T10:42:47.828 INFO:tasks.workunit.client.0.smithi040.stdout:5/505: rmdir d0/d3b/d88 39 2024-04-18T10:42:47.828 INFO:tasks.workunit.client.0.smithi040.stdout:6/564: write df/d76/db9/dbd/fbf [3751694,115625] 0 2024-04-18T10:42:47.829 INFO:tasks.workunit.client.0.smithi040.stdout:0/592: dread dd/df/d19/d3e/d77/fa2 [0,4194304] 0 2024-04-18T10:42:47.832 INFO:tasks.workunit.client.0.smithi040.stdout:9/600: stat d2/d3/d22/d2e/d35/daf/dc7/lca 0 2024-04-18T10:42:47.833 INFO:tasks.workunit.client.0.smithi040.stdout:1/585: getdents d1/db1 0 2024-04-18T10:42:47.833 INFO:tasks.workunit.client.0.smithi040.stdout:6/565: dread - df/d76/d91/f92 zero size 2024-04-18T10:42:47.834 INFO:tasks.workunit.client.0.smithi040.stdout:5/506: creat d0/d3b/d88/faa x:0 0 0 2024-04-18T10:42:47.835 INFO:tasks.workunit.client.0.smithi040.stdout:6/566: fsync df/fab 0 2024-04-18T10:42:47.836 INFO:tasks.workunit.client.0.smithi040.stdout:2/519: dwrite dd/d14/d44/f73 [0,4194304] 0 2024-04-18T10:42:47.837 INFO:tasks.workunit.client.0.smithi040.stdout:9/601: symlink d2/d5b/d6f/d80/d75/ld4 0 2024-04-18T10:42:47.838 INFO:tasks.workunit.client.0.smithi040.stdout:1/586: symlink d1/d1c/d7b/d2e/ld1 0 2024-04-18T10:42:47.838 INFO:tasks.workunit.client.0.smithi040.stdout:6/567: read - df/d4b/d7e/fb2 zero size 2024-04-18T10:42:47.838 INFO:tasks.workunit.client.0.smithi040.stdout:2/520: write dd/d61/f68 [1124178,110650] 0 2024-04-18T10:42:47.849 INFO:tasks.workunit.client.0.smithi040.stdout:0/593: dwrite dd/d62/f7f [0,4194304] 0 2024-04-18T10:42:47.849 INFO:tasks.workunit.client.0.smithi040.stdout:9/602: chown d2/d3/d22/d2e/d35/d40/d85/f9c 6389 1 2024-04-18T10:42:47.850 INFO:tasks.workunit.client.0.smithi040.stdout:6/568: creat df/d76/dc2/fc8 x:0 0 0 2024-04-18T10:42:47.851 INFO:tasks.workunit.client.0.smithi040.stdout:2/521: mknod dd/d14/d44/d4c/d49/ca1 0 2024-04-18T10:42:47.852 INFO:tasks.workunit.client.0.smithi040.stdout:1/587: creat d1/d1c/d7b/d2e/d3e/d85/fd2 x:0 0 0 2024-04-18T10:42:47.853 INFO:tasks.workunit.client.0.smithi040.stdout:1/588: truncate d1/d16/f29 1069369 0 2024-04-18T10:42:47.857 INFO:tasks.workunit.client.0.smithi040.stdout:4/544: dread d2/d3/d4/dd/f48 [0,4194304] 0 2024-04-18T10:42:47.857 INFO:tasks.workunit.client.0.smithi040.stdout:0/594: creat dd/df/d19/fdf x:0 0 0 2024-04-18T10:42:47.859 INFO:tasks.workunit.client.0.smithi040.stdout:0/595: write dd/d91/fbf [316153,108673] 0 2024-04-18T10:42:47.860 INFO:tasks.workunit.client.0.smithi040.stdout:1/589: symlink d1/d1c/d7b/d2e/ld3 0 2024-04-18T10:42:47.860 INFO:tasks.workunit.client.0.smithi040.stdout:2/522: dread dd/f28 [0,4194304] 0 2024-04-18T10:42:47.861 INFO:tasks.workunit.client.0.smithi040.stdout:4/545: creat d2/d1a/f9c x:0 0 0 2024-04-18T10:42:47.863 INFO:tasks.workunit.client.0.smithi040.stdout:9/603: getdents d2/d3/d22/d2e/d35/daf/dc1/d46/d86 0 2024-04-18T10:42:47.863 INFO:tasks.workunit.client.0.smithi040.stdout:2/523: write dd/d14/d44/d4c/d49/f96 [1044432,24532] 0 2024-04-18T10:42:47.863 INFO:tasks.workunit.client.0.smithi040.stdout:7/560: sync 2024-04-18T10:42:47.865 INFO:tasks.workunit.client.0.smithi040.stdout:7/561: stat d6/d25/f62 0 2024-04-18T10:42:47.867 INFO:tasks.workunit.client.0.smithi040.stdout:3/569: dread d1/d7/d28/f61 [0,4194304] 0 2024-04-18T10:42:47.868 INFO:tasks.workunit.client.0.smithi040.stdout:4/546: creat d2/d3/d4/f9d x:0 0 0 2024-04-18T10:42:47.868 INFO:tasks.workunit.client.0.smithi040.stdout:2/524: fsync dd/d14/d2b/d7c/d37/f74 0 2024-04-18T10:42:47.872 INFO:tasks.workunit.client.0.smithi040.stdout:0/596: dwrite dd/df/d19/f31 [0,4194304] 0 2024-04-18T10:42:47.873 INFO:tasks.workunit.client.0.smithi040.stdout:1/590: dwrite d1/d16/f41 [0,4194304] 0 2024-04-18T10:42:47.874 INFO:tasks.workunit.client.0.smithi040.stdout:2/525: write dd/f36 [2541145,21882] 0 2024-04-18T10:42:47.877 INFO:tasks.workunit.client.0.smithi040.stdout:4/547: mknod d2/d3/d4/d21/d28/c9e 0 2024-04-18T10:42:47.880 INFO:tasks.workunit.client.0.smithi040.stdout:6/569: dread df/f67 [0,4194304] 0 2024-04-18T10:42:47.881 INFO:tasks.workunit.client.0.smithi040.stdout:9/604: dwrite d2/d5b/d6f/d80/d75/fb5 [0,4194304] 0 2024-04-18T10:42:47.882 INFO:tasks.workunit.client.0.smithi040.stdout:0/597: rmdir dd/df/d19/d3e 39 2024-04-18T10:42:47.882 INFO:tasks.workunit.client.0.smithi040.stdout:0/598: chown dd/df/d4e/dc3 1627943433 1 2024-04-18T10:42:47.883 INFO:tasks.workunit.client.0.smithi040.stdout:0/599: write dd/df/d19/d28/d3a/d42/fb0 [69010,21739] 0 2024-04-18T10:42:47.884 INFO:tasks.workunit.client.0.smithi040.stdout:3/570: truncate d1/d7/d3a/f52 1493599 0 2024-04-18T10:42:47.884 INFO:tasks.workunit.client.0.smithi040.stdout:7/562: mkdir d6/d25/d28/d2c/d2d/d47/d5c/da2/db6 0 2024-04-18T10:42:47.885 INFO:tasks.workunit.client.0.smithi040.stdout:2/526: write dd/d14/d2b/d7c/d37/d38/f57 [662641,100134] 0 2024-04-18T10:42:47.886 INFO:tasks.workunit.client.0.smithi040.stdout:4/548: write d2/d3/d41/d47/d6f/f75 [105444,88950] 0 2024-04-18T10:42:47.887 INFO:tasks.workunit.client.0.smithi040.stdout:2/527: chown dd/d14/f86 1007 1 2024-04-18T10:42:47.888 INFO:tasks.workunit.client.0.smithi040.stdout:4/549: truncate d2/d3/d41/d47/f82 805578 0 2024-04-18T10:42:47.888 INFO:tasks.workunit.client.0.smithi040.stdout:8/600: sync 2024-04-18T10:42:47.888 INFO:tasks.workunit.client.0.smithi040.stdout:8/601: dread - d2/d10/d14/faa zero size 2024-04-18T10:42:47.889 INFO:tasks.workunit.client.0.smithi040.stdout:8/602: dread - d2/d22/fcc zero size 2024-04-18T10:42:47.889 INFO:tasks.workunit.client.0.smithi040.stdout:1/591: rename d1/d1c/d7b/d2e/fb4 to d1/d1c/d2b/d32/d36/d4d/d67/fd4 0 2024-04-18T10:42:47.890 INFO:tasks.workunit.client.0.smithi040.stdout:0/600: stat dd/df/d19/d28/d3a/cc4 0 2024-04-18T10:42:47.891 INFO:tasks.workunit.client.0.smithi040.stdout:9/605: write d2/d3/d22/d2e/f3d [1044509,98201] 0 2024-04-18T10:42:47.891 INFO:tasks.workunit.client.0.smithi040.stdout:7/563: symlink d6/d25/d28/d2c/d3c/lb7 0 2024-04-18T10:42:47.892 INFO:tasks.workunit.client.0.smithi040.stdout:9/606: fdatasync d2/d3/d22/d2e/f76 0 2024-04-18T10:42:47.893 INFO:tasks.workunit.client.0.smithi040.stdout:2/528: mkdir dd/d14/d44/d4c/d52/da2 0 2024-04-18T10:42:47.893 INFO:tasks.workunit.client.0.smithi040.stdout:1/592: truncate d1/d9b/d75/d84/f99 810673 0 2024-04-18T10:42:47.896 INFO:tasks.workunit.client.0.smithi040.stdout:3/571: rename d1/d2/d16/d18 to d1/d7/d67/dc5 0 2024-04-18T10:42:47.897 INFO:tasks.workunit.client.0.smithi040.stdout:1/593: rename d1/d1c to d1/d1c/d7b/d2e/d3e/dd5 22 2024-04-18T10:42:47.897 INFO:tasks.workunit.client.0.smithi040.stdout:7/564: dread d6/f94 [4194304,4194304] 0 2024-04-18T10:42:47.899 INFO:tasks.workunit.client.0.smithi040.stdout:2/529: mkdir dd/d14/d2b/d7c/d37/da3 0 2024-04-18T10:42:47.899 INFO:tasks.workunit.client.0.smithi040.stdout:0/601: creat dd/df/d19/dba/fe0 x:0 0 0 2024-04-18T10:42:47.900 INFO:tasks.workunit.client.0.smithi040.stdout:3/572: symlink d1/d7/db2/lc6 0 2024-04-18T10:42:47.901 INFO:tasks.workunit.client.0.smithi040.stdout:8/603: creat d2/d4c/fd1 x:0 0 0 2024-04-18T10:42:47.902 INFO:tasks.workunit.client.0.smithi040.stdout:2/530: write dd/d14/d44/d4c/d52/f89 [411684,92007] 0 2024-04-18T10:42:47.902 INFO:tasks.workunit.client.0.smithi040.stdout:1/594: mkdir d1/d1c/d2b/db5/dd6 0 2024-04-18T10:42:47.905 INFO:tasks.workunit.client.0.smithi040.stdout:3/573: truncate d1/d2/d16/fbb 4382265 0 2024-04-18T10:42:47.906 INFO:tasks.workunit.client.0.smithi040.stdout:7/565: dread d6/d25/d28/d2c/d2d/d47/f59 [0,4194304] 0 2024-04-18T10:42:47.907 INFO:tasks.workunit.client.0.smithi040.stdout:9/607: dread d2/d3/d22/f3a [0,4194304] 0 2024-04-18T10:42:47.910 INFO:tasks.workunit.client.0.smithi040.stdout:3/574: mkdir d1/d7/db2/dc7 0 2024-04-18T10:42:47.911 INFO:tasks.workunit.client.0.smithi040.stdout:6/570: truncate df/f12 617255 0 2024-04-18T10:42:47.912 INFO:tasks.workunit.client.0.smithi040.stdout:1/595: creat d1/d1c/d7b/d2e/fd7 x:0 0 0 2024-04-18T10:42:47.913 INFO:tasks.workunit.client.0.smithi040.stdout:7/566: mkdir d6/d3e/d99/db8 0 2024-04-18T10:42:47.914 INFO:tasks.workunit.client.0.smithi040.stdout:1/596: write d1/d16/f3b [747681,6989] 0 2024-04-18T10:42:47.918 INFO:tasks.workunit.client.0.smithi040.stdout:3/575: dwrite d1/d2/d4e/f84 [0,4194304] 0 2024-04-18T10:42:47.920 INFO:tasks.workunit.client.0.smithi040.stdout:9/608: symlink d2/d3/d22/ld5 0 2024-04-18T10:42:47.921 INFO:tasks.workunit.client.0.smithi040.stdout:3/576: readlink d1/lf 0 2024-04-18T10:42:47.922 INFO:tasks.workunit.client.0.smithi040.stdout:2/531: getdents dd/d61/d8e 0 2024-04-18T10:42:47.925 INFO:tasks.workunit.client.0.smithi040.stdout:8/604: dread d2/d5/d9/d3c/d68/fb0 [0,4194304] 0 2024-04-18T10:42:47.925 INFO:tasks.workunit.client.0.smithi040.stdout:1/597: creat d1/d1c/d2b/d32/d36/d4d/d67/dcb/fd8 x:0 0 0 2024-04-18T10:42:47.926 INFO:tasks.workunit.client.0.smithi040.stdout:2/532: rename dd to dd/d14/d2b/d7c/d37/da4 22 2024-04-18T10:42:47.927 INFO:tasks.workunit.client.0.smithi040.stdout:9/609: mkdir d2/dd6 0 2024-04-18T10:42:47.927 INFO:tasks.workunit.client.0.smithi040.stdout:6/571: dwrite df/d4b/d6e/f9f [0,4194304] 0 2024-04-18T10:42:47.929 INFO:tasks.workunit.client.0.smithi040.stdout:7/567: dwrite d6/d50/d79/d90/fa5 [0,4194304] 0 2024-04-18T10:42:47.930 INFO:tasks.workunit.client.0.smithi040.stdout:1/598: fsync d1/d1c/d2b/d32/d36/d4d/f62 0 2024-04-18T10:42:47.931 INFO:tasks.workunit.client.0.smithi040.stdout:3/577: creat d1/d7/d67/dba/fc8 x:0 0 0 2024-04-18T10:42:47.932 INFO:tasks.workunit.client.0.smithi040.stdout:0/602: truncate dd/df/d19/d3e/d77/fa2 2594862 0 2024-04-18T10:42:47.932 INFO:tasks.workunit.client.0.smithi040.stdout:6/572: readlink df/d4b/d6a/d93/l2e 0 2024-04-18T10:42:47.933 INFO:tasks.workunit.client.0.smithi040.stdout:3/578: chown d1/d2/d4e/d57 1527826541 1 2024-04-18T10:42:47.934 INFO:tasks.workunit.client.0.smithi040.stdout:1/599: fsync d1/d9b/f9c 0 2024-04-18T10:42:47.934 INFO:tasks.workunit.client.0.smithi040.stdout:7/568: rmdir d6/d50/d79/da8/dad 39 2024-04-18T10:42:47.935 INFO:tasks.workunit.client.0.smithi040.stdout:2/533: getdents dd/d14/d44/d4c/d52/da2 0 2024-04-18T10:42:47.937 INFO:tasks.workunit.client.0.smithi040.stdout:7/569: write d6/d25/d28/d2c/d2d/d47/d5c/f5f [229861,16372] 0 2024-04-18T10:42:47.937 INFO:tasks.workunit.client.0.smithi040.stdout:9/610: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/fd7 x:0 0 0 2024-04-18T10:42:47.939 INFO:tasks.workunit.client.0.smithi040.stdout:6/573: creat df/d4b/d6a/d93/fc9 x:0 0 0 2024-04-18T10:42:47.940 INFO:tasks.workunit.client.0.smithi040.stdout:8/605: dread d2/d5/d9/d3c/f6f [0,4194304] 0 2024-04-18T10:42:47.942 INFO:tasks.workunit.client.0.smithi040.stdout:0/603: rename dd/df/d19/d3e/ca1 to dd/d62/ce1 0 2024-04-18T10:42:47.945 INFO:tasks.workunit.client.0.smithi040.stdout:3/579: dread d1/d7/d67/f9a [0,4194304] 0 2024-04-18T10:42:47.946 INFO:tasks.workunit.client.0.smithi040.stdout:5/507: sync 2024-04-18T10:42:47.946 INFO:tasks.workunit.client.0.smithi040.stdout:8/606: chown d2/d10/d14/f8c 84068 1 2024-04-18T10:42:47.956 INFO:tasks.workunit.client.0.smithi040.stdout:0/604: creat dd/df/d19/d28/db7/dd4/fe2 x:0 0 0 2024-04-18T10:42:47.957 INFO:tasks.workunit.client.0.smithi040.stdout:1/600: creat d1/d1c/d2b/d32/fd9 x:0 0 0 2024-04-18T10:42:47.957 INFO:tasks.workunit.client.0.smithi040.stdout:5/508: rmdir d0/d78/d95/d52/d5d 39 2024-04-18T10:42:47.958 INFO:tasks.workunit.client.0.smithi040.stdout:2/534: link dd/d14/c65 dd/d14/d4a/ca5 0 2024-04-18T10:42:47.958 INFO:tasks.workunit.client.0.smithi040.stdout:3/580: chown d1/d7/d12/c78 43 1 2024-04-18T10:42:47.958 INFO:tasks.workunit.client.0.smithi040.stdout:6/574: link df/l4f df/d4b/db7/dc1/lca 0 2024-04-18T10:42:47.959 INFO:tasks.workunit.client.0.smithi040.stdout:9/611: rename d2/d7/l23 to d2/d3/ld8 0 2024-04-18T10:42:47.960 INFO:tasks.workunit.client.0.smithi040.stdout:8/607: mkdir d2/d4c/dd2 0 2024-04-18T10:42:47.960 INFO:tasks.workunit.client.0.smithi040.stdout:1/601: fsync d1/d9b/f70 0 2024-04-18T10:42:47.963 INFO:tasks.workunit.client.0.smithi040.stdout:6/575: creat df/d4b/d63/dbb/fcb x:0 0 0 2024-04-18T10:42:47.963 INFO:tasks.workunit.client.0.smithi040.stdout:2/535: truncate dd/d14/d44/d4c/d6b/f7e 1049625 0 2024-04-18T10:42:47.964 INFO:tasks.workunit.client.0.smithi040.stdout:9/612: mknod d2/dd/cd9 0 2024-04-18T10:42:47.966 INFO:tasks.workunit.client.0.smithi040.stdout:1/602: mkdir d1/d9b/d75/d84/dac/dda 0 2024-04-18T10:42:47.967 INFO:tasks.workunit.client.0.smithi040.stdout:2/536: dread - dd/d14/d4a/d54/f9c zero size 2024-04-18T10:42:47.969 INFO:tasks.workunit.client.0.smithi040.stdout:8/608: mkdir d2/d4c/d97/dd3 0 2024-04-18T10:42:47.970 INFO:tasks.workunit.client.0.smithi040.stdout:1/603: write d1/fa5 [621248,70849] 0 2024-04-18T10:42:47.971 INFO:tasks.workunit.client.0.smithi040.stdout:6/576: mkdir df/d4b/db7/dcc 0 2024-04-18T10:42:47.971 INFO:tasks.workunit.client.0.smithi040.stdout:0/605: dwrite dd/d62/f74 [0,4194304] 0 2024-04-18T10:42:47.971 INFO:tasks.workunit.client.0.smithi040.stdout:3/581: dwrite d1/d2/d4e/d58/d62/faf [0,4194304] 0 2024-04-18T10:42:47.974 INFO:tasks.workunit.client.0.smithi040.stdout:2/537: chown dd/d14/d44/d4c/d6b/f9a 128767 1 2024-04-18T10:42:47.974 INFO:tasks.workunit.client.0.smithi040.stdout:0/606: fdatasync dd/df/d19/d28/fa8 0 2024-04-18T10:42:47.974 INFO:tasks.workunit.client.0.smithi040.stdout:1/604: write d1/f23 [2320678,18728] 0 2024-04-18T10:42:47.975 INFO:tasks.workunit.client.0.smithi040.stdout:8/609: write d2/d5/d9/d3c/d5a/f27 [2273003,79857] 0 2024-04-18T10:42:47.979 INFO:tasks.workunit.client.0.smithi040.stdout:3/582: mknod d1/d7/d28/cc9 0 2024-04-18T10:42:47.979 INFO:tasks.workunit.client.0.smithi040.stdout:9/613: dread d2/d3/d22/d2e/f76 [0,4194304] 0 2024-04-18T10:42:47.980 INFO:tasks.workunit.client.0.smithi040.stdout:2/538: chown dd/d14/d44/d4c/d52/l9e 0 1 2024-04-18T10:42:47.980 INFO:tasks.workunit.client.0.smithi040.stdout:6/577: creat df/d4b/d63/db3/fcd x:0 0 0 2024-04-18T10:42:47.980 INFO:tasks.workunit.client.0.smithi040.stdout:1/605: chown d1/d1c/d2b/d32/d36/fae 9 1 2024-04-18T10:42:47.982 INFO:tasks.workunit.client.0.smithi040.stdout:8/610: symlink d2/d4c/d97/ld4 0 2024-04-18T10:42:47.985 INFO:tasks.workunit.client.0.smithi040.stdout:5/509: dwrite d0/d21/d42/f55 [0,4194304] 0 2024-04-18T10:42:47.985 INFO:tasks.workunit.client.0.smithi040.stdout:6/578: chown df/d4b/d6a/d93/l5d 83318970 1 2024-04-18T10:42:47.985 INFO:tasks.workunit.client.0.smithi040.stdout:1/606: rmdir d1/d16/d92 39 2024-04-18T10:42:47.987 INFO:tasks.workunit.client.0.smithi040.stdout:3/583: mkdir d1/d2/d4e/d58/dbe/dca 0 2024-04-18T10:42:47.988 INFO:tasks.workunit.client.0.smithi040.stdout:9/614: creat d2/dd/de/fda x:0 0 0 2024-04-18T10:42:47.989 INFO:tasks.workunit.client.0.smithi040.stdout:6/579: mkdir df/d76/dc2/dce 0 2024-04-18T10:42:47.989 INFO:tasks.workunit.client.0.smithi040.stdout:5/510: mknod d0/d21/d42/d76/cab 0 2024-04-18T10:42:47.991 INFO:tasks.workunit.client.0.smithi040.stdout:1/607: write d1/d1c/d7b/d2e/f8b [322839,60406] 0 2024-04-18T10:42:47.991 INFO:tasks.workunit.client.0.smithi040.stdout:3/584: dread - d1/d2/d4e/d58/f72 zero size 2024-04-18T10:42:47.992 INFO:tasks.workunit.client.0.smithi040.stdout:0/607: dwrite dd/df/d19/d28/d3a/f4d [0,4194304] 0 2024-04-18T10:42:47.993 INFO:tasks.workunit.client.0.smithi040.stdout:5/511: fsync d0/d3b/d67/f73 0 2024-04-18T10:42:47.997 INFO:tasks.workunit.client.0.smithi040.stdout:5/512: read - d0/d3b/d67/f84 zero size 2024-04-18T10:42:47.997 INFO:tasks.workunit.client.0.smithi040.stdout:8/611: dwrite d2/d15/fca [0,4194304] 0 2024-04-18T10:42:47.997 INFO:tasks.workunit.client.0.smithi040.stdout:1/608: mknod d1/d9b/d75/d84/dac/dda/cdb 0 2024-04-18T10:42:47.999 INFO:tasks.workunit.client.0.smithi040.stdout:3/585: fsync d1/d7/d67/dc5/d91/db1/f97 0 2024-04-18T10:42:47.999 INFO:tasks.workunit.client.0.smithi040.stdout:1/609: chown d1/fc5 28798090 1 2024-04-18T10:42:48.000 INFO:tasks.workunit.client.0.smithi040.stdout:0/608: creat dd/df/d4e/dc3/fe3 x:0 0 0 2024-04-18T10:42:48.002 INFO:tasks.workunit.client.0.smithi040.stdout:1/610: fdatasync d1/d16/f41 0 2024-04-18T10:42:48.002 INFO:tasks.workunit.client.0.smithi040.stdout:8/612: getdents d2/d2c/da9/dc3 0 2024-04-18T10:42:48.003 INFO:tasks.workunit.client.0.smithi040.stdout:9/615: dwrite d2/d3/d22/db3/fb7 [0,4194304] 0 2024-04-18T10:42:48.004 INFO:tasks.workunit.client.0.smithi040.stdout:8/613: stat d2/d2c/f3b 0 2024-04-18T10:42:48.005 INFO:tasks.workunit.client.0.smithi040.stdout:8/614: chown d2 104747369 1 2024-04-18T10:42:48.006 INFO:tasks.workunit.client.0.smithi040.stdout:0/609: creat dd/df/d19/dd5/fe4 x:0 0 0 2024-04-18T10:42:48.007 INFO:tasks.workunit.client.0.smithi040.stdout:1/611: symlink d1/d1c/d2b/d32/ldc 0 2024-04-18T10:42:48.008 INFO:tasks.workunit.client.0.smithi040.stdout:8/615: chown d2/d10/d14/ca3 12005 1 2024-04-18T10:42:48.008 INFO:tasks.workunit.client.0.smithi040.stdout:0/610: readlink dd/df/d19/l27 0 2024-04-18T10:42:48.009 INFO:tasks.workunit.client.0.smithi040.stdout:8/616: chown d2/l3 3903012 1 2024-04-18T10:42:48.009 INFO:tasks.workunit.client.0.smithi040.stdout:1/612: write d1/f23 [3270410,79839] 0 2024-04-18T10:42:48.011 INFO:tasks.workunit.client.0.smithi040.stdout:3/586: dwrite d1/d7/d12/fc3 [0,4194304] 0 2024-04-18T10:42:48.011 INFO:tasks.workunit.client.0.smithi040.stdout:1/613: fsync d1/d1c/d2b/fb9 0 2024-04-18T10:42:48.012 INFO:tasks.workunit.client.0.smithi040.stdout:9/616: rename d2/d7/ca4 to d2/d3/d22/d2e/d35/d40/d71/cdb 0 2024-04-18T10:42:48.012 INFO:tasks.workunit.client.0.smithi040.stdout:0/611: truncate dd/df/d19/d28/d3a/f9d 776699 0 2024-04-18T10:42:48.014 INFO:tasks.workunit.client.0.smithi040.stdout:1/614: write d1/d1c/d2b/d32/d36/f50 [2224441,31892] 0 2024-04-18T10:42:48.014 INFO:tasks.workunit.client.0.smithi040.stdout:0/612: chown dd/df/d19/d3e/da5/fca 2818011 1 2024-04-18T10:42:48.015 INFO:tasks.workunit.client.0.smithi040.stdout:8/617: symlink d2/ld5 0 2024-04-18T10:42:48.015 INFO:tasks.workunit.client.0.smithi040.stdout:1/615: chown d1/d1c/d2b/d32/fc7 32 1 2024-04-18T10:42:48.015 INFO:tasks.workunit.client.0.smithi040.stdout:0/613: fsync dd/df/d19/f8c 0 2024-04-18T10:42:48.016 INFO:tasks.workunit.client.0.smithi040.stdout:9/617: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/fdc x:0 0 0 2024-04-18T10:42:48.018 INFO:tasks.workunit.client.0.smithi040.stdout:8/618: write d2/d5/d9/d3c/d5a/d94/fb4 [694859,82397] 0 2024-04-18T10:42:48.019 INFO:tasks.workunit.client.0.smithi040.stdout:0/614: read dd/df/f15 [2243906,5031] 0 2024-04-18T10:42:48.019 INFO:tasks.workunit.client.0.smithi040.stdout:0/615: chown dd/d91 156793 1 2024-04-18T10:42:48.021 INFO:tasks.workunit.client.0.smithi040.stdout:9/618: mkdir d2/d5b/d6f/d80/ddd 0 2024-04-18T10:42:48.022 INFO:tasks.workunit.client.0.smithi040.stdout:0/616: mknod dd/df/d19/d28/d3a/d46/ce5 0 2024-04-18T10:42:48.023 INFO:tasks.workunit.client.0.smithi040.stdout:8/619: getdents d2/d2c/dbf/dc2 0 2024-04-18T10:42:48.023 INFO:tasks.workunit.client.0.smithi040.stdout:9/619: write d2/d3/d22/d2e/fcc [938979,71515] 0 2024-04-18T10:42:48.024 INFO:tasks.workunit.client.0.smithi040.stdout:0/617: readlink dd/df/d19/d28/d3a/d5b/lc6 0 2024-04-18T10:42:48.027 INFO:tasks.workunit.client.0.smithi040.stdout:0/618: unlink dd/df/d19/d28/d3a/d42/f58 0 2024-04-18T10:42:48.029 INFO:tasks.workunit.client.0.smithi040.stdout:8/620: rename d2/d5/d9/d3c/d5a/f56 to d2/d15/fd6 0 2024-04-18T10:42:48.031 INFO:tasks.workunit.client.0.smithi040.stdout:9/620: dwrite d2/d3/d22/d2e/d35/d40/d71/fa0 [0,4194304] 0 2024-04-18T10:42:48.033 INFO:tasks.workunit.client.0.smithi040.stdout:0/619: rename dd/df/d4e/ldc to dd/le6 0 2024-04-18T10:42:48.034 INFO:tasks.workunit.client.0.smithi040.stdout:2/539: dread dd/f15 [4194304,4194304] 0 2024-04-18T10:42:48.035 INFO:tasks.workunit.client.0.smithi040.stdout:0/620: symlink dd/df/d19/d28/d3a/d42/le7 0 2024-04-18T10:42:48.038 INFO:tasks.workunit.client.0.smithi040.stdout:4/550: sync 2024-04-18T10:42:48.050 INFO:tasks.workunit.client.0.smithi040.stdout:2/540: rename dd/d14/d44/d4c to dd/d14/d44/d5f/d82/da6 0 2024-04-18T10:42:48.051 INFO:tasks.workunit.client.0.smithi040.stdout:9/621: read d2/d3/d22/d2e/d35/d40/d71/fa7 [3449542,99893] 0 2024-04-18T10:42:48.054 INFO:tasks.workunit.client.0.smithi040.stdout:3/587: write d1/f74 [520101,115893] 0 2024-04-18T10:42:48.054 INFO:tasks.workunit.client.0.smithi040.stdout:1/616: write d1/d16/f1b [4109839,108827] 0 2024-04-18T10:42:48.056 INFO:tasks.workunit.client.0.smithi040.stdout:4/551: unlink d2/d3/d4/d21/l50 0 2024-04-18T10:42:48.057 INFO:tasks.workunit.client.0.smithi040.stdout:0/621: mknod dd/da3/ce8 0 2024-04-18T10:42:48.057 INFO:tasks.workunit.client.0.smithi040.stdout:2/541: dread dd/d14/f22 [0,4194304] 0 2024-04-18T10:42:48.057 INFO:tasks.workunit.client.0.smithi040.stdout:3/588: write d1/d2/d16/f2d [764148,34861] 0 2024-04-18T10:42:48.058 INFO:tasks.workunit.client.0.smithi040.stdout:9/622: creat d2/d5b/d6f/d80/ddd/fde x:0 0 0 2024-04-18T10:42:48.058 INFO:tasks.workunit.client.0.smithi040.stdout:1/617: fsync d1/d1c/d2b/d32/d36/d4d/d67/f8e 0 2024-04-18T10:42:48.059 INFO:tasks.workunit.client.0.smithi040.stdout:4/552: readlink d2/d3/d4/d21/d28/d3f/l3e 0 2024-04-18T10:42:48.060 INFO:tasks.workunit.client.0.smithi040.stdout:3/589: write d1/f74 [997181,104270] 0 2024-04-18T10:42:48.060 INFO:tasks.workunit.client.0.smithi040.stdout:0/622: read dd/df/d19/f45 [3162912,30165] 0 2024-04-18T10:42:48.061 INFO:tasks.workunit.client.0.smithi040.stdout:9/623: symlink d2/d5b/d6f/dc3/ldf 0 2024-04-18T10:42:48.062 INFO:tasks.workunit.client.0.smithi040.stdout:9/624: truncate d2/dd/f98 636841 0 2024-04-18T10:42:48.063 INFO:tasks.workunit.client.0.smithi040.stdout:2/542: rename dd/d14/c3e to dd/d14/d44/d5f/ca7 0 2024-04-18T10:42:48.064 INFO:tasks.workunit.client.0.smithi040.stdout:4/553: chown d2/d3/d4/d21/d28/c40 1602686872 1 2024-04-18T10:42:48.068 INFO:tasks.workunit.client.0.smithi040.stdout:0/623: link dd/df/d19/d3e/da5/fce dd/d62/fe9 0 2024-04-18T10:42:48.069 INFO:tasks.workunit.client.0.smithi040.stdout:4/554: rmdir d2/d3/d41/d62 39 2024-04-18T10:42:48.070 INFO:tasks.workunit.client.0.smithi040.stdout:4/555: chown d2/d3 1504476 1 2024-04-18T10:42:48.070 INFO:tasks.workunit.client.0.smithi040.stdout:4/556: chown d2/d3/d4/d1f/d29/d49/c6a 962336 1 2024-04-18T10:42:48.071 INFO:tasks.workunit.client.0.smithi040.stdout:9/625: mkdir d2/d5b/d6f/d80/de0 0 2024-04-18T10:42:48.072 INFO:tasks.workunit.client.0.smithi040.stdout:3/590: dread d1/d7/d3a/f52 [0,4194304] 0 2024-04-18T10:42:48.073 INFO:tasks.workunit.client.0.smithi040.stdout:9/626: stat d2/d5b/d6f/d80/d75/fb5 0 2024-04-18T10:42:48.073 INFO:tasks.workunit.client.0.smithi040.stdout:1/618: getdents d1/d1c/d2b/d32 0 2024-04-18T10:42:48.073 INFO:tasks.workunit.client.0.smithi040.stdout:0/624: symlink dd/da3/lea 0 2024-04-18T10:42:48.074 INFO:tasks.workunit.client.0.smithi040.stdout:4/557: creat d2/d3/d2f/f9f x:0 0 0 2024-04-18T10:42:48.077 INFO:tasks.workunit.client.0.smithi040.stdout:0/625: creat dd/df/d19/d28/db7/feb x:0 0 0 2024-04-18T10:42:48.078 INFO:tasks.workunit.client.0.smithi040.stdout:4/558: creat d2/d3/d4/d1f/d29/d49/d31/fa0 x:0 0 0 2024-04-18T10:42:48.079 INFO:tasks.workunit.client.0.smithi040.stdout:2/543: rmdir dd/d14/d44 39 2024-04-18T10:42:48.080 INFO:tasks.workunit.client.0.smithi040.stdout:9/627: unlink d2/d3/d22/d2e/d35/d40/l7c 0 2024-04-18T10:42:48.085 INFO:tasks.workunit.client.0.smithi040.stdout:3/591: write d1/d7/d67/dc5/d3b/fad [137652,3481] 0 2024-04-18T10:42:48.086 INFO:tasks.workunit.client.0.smithi040.stdout:0/626: dwrite dd/df/d19/dba/fe0 [0,4194304] 0 2024-04-18T10:42:48.088 INFO:tasks.workunit.client.0.smithi040.stdout:9/628: getdents d2/d5b/d6f/dc3 0 2024-04-18T10:42:48.089 INFO:tasks.workunit.client.0.smithi040.stdout:2/544: dwrite dd/d61/f68 [0,4194304] 0 2024-04-18T10:42:48.091 INFO:tasks.workunit.client.0.smithi040.stdout:2/545: readlink dd/l6e 0 2024-04-18T10:42:48.091 INFO:tasks.workunit.client.0.smithi040.stdout:3/592: symlink d1/d2/d4e/lcb 0 2024-04-18T10:42:48.092 INFO:tasks.workunit.client.0.smithi040.stdout:9/629: write d2/d3/d22/d2e/d35/d40/d71/f78 [2418669,99047] 0 2024-04-18T10:42:48.094 INFO:tasks.workunit.client.0.smithi040.stdout:2/546: fdatasync dd/d14/d44/d5f/d82/da6/d52/f94 0 2024-04-18T10:42:48.095 INFO:tasks.workunit.client.0.smithi040.stdout:0/627: getdents dd/df/d19/d28 0 2024-04-18T10:42:48.098 INFO:tasks.workunit.client.0.smithi040.stdout:9/630: creat d2/d5b/fe1 x:0 0 0 2024-04-18T10:42:48.098 INFO:tasks.workunit.client.0.smithi040.stdout:3/593: rename d1/d7/d3a/f52 to d1/d7/d67/dc5/d91/fcc 0 2024-04-18T10:42:48.099 INFO:tasks.workunit.client.0.smithi040.stdout:2/547: rmdir dd 39 2024-04-18T10:42:48.102 INFO:tasks.workunit.client.0.smithi040.stdout:3/594: mknod d1/d7/d67/ccd 0 2024-04-18T10:42:48.104 INFO:tasks.workunit.client.0.smithi040.stdout:0/628: dwrite dd/df/d19/d28/d3a/d42/fb0 [0,4194304] 0 2024-04-18T10:42:48.104 INFO:tasks.workunit.client.0.smithi040.stdout:2/548: write dd/f45 [986491,37411] 0 2024-04-18T10:42:48.104 INFO:tasks.workunit.client.0.smithi040.stdout:3/595: chown d1/d2/d4e/d57 183011 1 2024-04-18T10:42:48.105 INFO:tasks.workunit.client.0.smithi040.stdout:6/580: sync 2024-04-18T10:42:48.105 INFO:tasks.workunit.client.0.smithi040.stdout:7/570: sync 2024-04-18T10:42:48.106 INFO:tasks.workunit.client.0.smithi040.stdout:4/559: dread d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:48.109 INFO:tasks.workunit.client.0.smithi040.stdout:9/631: dwrite d2/d5b/fc8 [0,4194304] 0 2024-04-18T10:42:48.111 INFO:tasks.workunit.client.0.smithi040.stdout:9/632: truncate d2/d3/d22/fd1 384074 0 2024-04-18T10:42:48.112 INFO:tasks.workunit.client.0.smithi040.stdout:2/549: unlink dd/d14/d2b/d7c/d37/f4b 0 2024-04-18T10:42:48.113 INFO:tasks.workunit.client.0.smithi040.stdout:4/560: rmdir d2/d3/d4/dd 39 2024-04-18T10:42:48.117 INFO:tasks.workunit.client.0.smithi040.stdout:7/571: creat d6/d50/d79/da8/dad/fb9 x:0 0 0 2024-04-18T10:42:48.117 INFO:tasks.workunit.client.0.smithi040.stdout:6/581: getdents df/d4b 0 2024-04-18T10:42:48.119 INFO:tasks.workunit.client.0.smithi040.stdout:9/633: unlink d2/d3/d22/d2e/d35/d40/d71/fa0 0 2024-04-18T10:42:48.120 INFO:tasks.workunit.client.0.smithi040.stdout:2/550: creat dd/d14/d2b/d7c/fa8 x:0 0 0 2024-04-18T10:42:48.126 INFO:tasks.workunit.client.0.smithi040.stdout:4/561: creat d2/d3/d4/dd/d6d/fa1 x:0 0 0 2024-04-18T10:42:48.127 INFO:tasks.workunit.client.0.smithi040.stdout:0/629: link dd/df/d19/l7b dd/df/d19/d3e/d75/lec 0 2024-04-18T10:42:48.127 INFO:tasks.workunit.client.0.smithi040.stdout:4/562: chown d2/d3/d4/d1f/d29/d49/d31/fa0 15122 1 2024-04-18T10:42:48.128 INFO:tasks.workunit.client.0.smithi040.stdout:3/596: getdents d1/d2/d4e/d58/d62 0 2024-04-18T10:42:48.130 INFO:tasks.workunit.client.0.smithi040.stdout:4/563: write d2/d3/d41/d62/f86 [403725,21847] 0 2024-04-18T10:42:48.131 INFO:tasks.workunit.client.0.smithi040.stdout:2/551: link dd/d14/d44/f99 dd/d14/fa9 0 2024-04-18T10:42:48.132 INFO:tasks.workunit.client.0.smithi040.stdout:2/552: stat dd/l6e 0 2024-04-18T10:42:48.133 INFO:tasks.workunit.client.0.smithi040.stdout:0/630: dread dd/df/d19/f66 [0,4194304] 0 2024-04-18T10:42:48.133 INFO:tasks.workunit.client.0.smithi040.stdout:3/597: creat d1/d2/d4e/d58/dbe/dc1/dc2/fce x:0 0 0 2024-04-18T10:42:48.135 INFO:tasks.workunit.client.0.smithi040.stdout:2/553: chown dd/d14/d44/d5f/d82/da6/d52/f89 23632 1 2024-04-18T10:42:48.135 INFO:tasks.workunit.client.0.smithi040.stdout:0/631: write dd/df/d19/f87 [274459,22825] 0 2024-04-18T10:42:48.136 INFO:tasks.workunit.client.0.smithi040.stdout:3/598: mknod d1/ccf 0 2024-04-18T10:42:48.139 INFO:tasks.workunit.client.0.smithi040.stdout:2/554: creat dd/d14/d4a/d54/faa x:0 0 0 2024-04-18T10:42:48.140 INFO:tasks.workunit.client.0.smithi040.stdout:4/564: dwrite d2/d3/d4/d1f/d29/d49/f65 [4194304,4194304] 0 2024-04-18T10:42:48.140 INFO:tasks.workunit.client.0.smithi040.stdout:0/632: mknod dd/ced 0 2024-04-18T10:42:48.142 INFO:tasks.workunit.client.0.smithi040.stdout:7/572: write d6/d25/d28/d2c/f4c [3772938,3150] 0 2024-04-18T10:42:48.143 INFO:tasks.workunit.client.0.smithi040.stdout:3/599: creat d1/d2/d4e/fd0 x:0 0 0 2024-04-18T10:42:48.143 INFO:tasks.workunit.client.0.smithi040.stdout:2/555: readlink dd/d14/d44/d5f/d82/da6/d49/l7b 0 2024-04-18T10:42:48.144 INFO:tasks.workunit.client.0.smithi040.stdout:0/633: write dd/df/d19/d28/fa8 [97317,113439] 0 2024-04-18T10:42:48.147 INFO:tasks.workunit.client.0.smithi040.stdout:4/565: truncate d2/d3/d4/d23/f63 887916 0 2024-04-18T10:42:48.148 INFO:tasks.workunit.client.0.smithi040.stdout:2/556: dread - dd/d14/d2b/d7c/d37/d5b/f75 zero size 2024-04-18T10:42:48.149 INFO:tasks.workunit.client.0.smithi040.stdout:0/634: mknod dd/df/d19/d28/cee 0 2024-04-18T10:42:48.150 INFO:tasks.workunit.client.0.smithi040.stdout:6/582: dwrite df/d4b/fb6 [0,4194304] 0 2024-04-18T10:42:48.150 INFO:tasks.workunit.client.0.smithi040.stdout:3/600: truncate d1/d2/d4e/d58/d62/d6b/f92 160695 0 2024-04-18T10:42:48.152 INFO:tasks.workunit.client.0.smithi040.stdout:2/557: mknod dd/d14/d44/cab 0 2024-04-18T10:42:48.152 INFO:tasks.workunit.client.0.smithi040.stdout:3/601: stat d1/d7/d67/dc5/f65 0 2024-04-18T10:42:48.152 INFO:tasks.workunit.client.0.smithi040.stdout:4/566: read d2/d3/d4/d1f/d29/d49/d31/f61 [3718131,107480] 0 2024-04-18T10:42:48.153 INFO:tasks.workunit.client.0.smithi040.stdout:3/602: readlink d1/d2/d16/l38 0 2024-04-18T10:42:48.156 INFO:tasks.workunit.client.0.smithi040.stdout:2/558: symlink dd/d14/d44/d5f/d82/d72/lac 0 2024-04-18T10:42:48.156 INFO:tasks.workunit.client.0.smithi040.stdout:3/603: truncate d1/d2/d4e/d58/d62/faa 48634 0 2024-04-18T10:42:48.158 INFO:tasks.workunit.client.0.smithi040.stdout:5/513: sync 2024-04-18T10:42:48.158 INFO:tasks.workunit.client.0.smithi040.stdout:8/621: sync 2024-04-18T10:42:48.171 INFO:tasks.workunit.client.0.smithi040.stdout:0/635: dwrite dd/df/d4e/f50 [0,4194304] 0 2024-04-18T10:42:48.172 INFO:tasks.workunit.client.0.smithi040.stdout:3/604: fdatasync d1/d7/d3a/f50 0 2024-04-18T10:42:48.172 INFO:tasks.workunit.client.0.smithi040.stdout:8/622: readlink d2/d15/l5c 0 2024-04-18T10:42:48.173 INFO:tasks.workunit.client.0.smithi040.stdout:6/583: getdents df/d4b/d6e/d3f/d53/d8a/d95/da7 0 2024-04-18T10:42:48.174 INFO:tasks.workunit.client.0.smithi040.stdout:5/514: mkdir d0/d3/d47/dac 0 2024-04-18T10:42:48.175 INFO:tasks.workunit.client.0.smithi040.stdout:0/636: symlink dd/df/d19/d3e/da5/lef 0 2024-04-18T10:42:48.176 INFO:tasks.workunit.client.0.smithi040.stdout:3/605: write d1/d7/d67/dc5/d91/db1/f82 [1372924,28018] 0 2024-04-18T10:42:48.176 INFO:tasks.workunit.client.0.smithi040.stdout:6/584: rmdir df/d4b/d99 39 2024-04-18T10:42:48.177 INFO:tasks.workunit.client.0.smithi040.stdout:2/559: getdents dd/d14/d44/d5f/d82/d72 0 2024-04-18T10:42:48.177 INFO:tasks.workunit.client.0.smithi040.stdout:0/637: write dd/df/d19/f31 [3990667,96787] 0 2024-04-18T10:42:48.178 INFO:tasks.workunit.client.0.smithi040.stdout:3/606: write d1/d2/f17 [5283033,60816] 0 2024-04-18T10:42:48.179 INFO:tasks.workunit.client.0.smithi040.stdout:5/515: mknod d0/d21/d42/d76/cad 0 2024-04-18T10:42:48.181 INFO:tasks.workunit.client.0.smithi040.stdout:3/607: write d1/d2/d4e/d58/d62/faf [4556836,34872] 0 2024-04-18T10:42:48.182 INFO:tasks.workunit.client.0.smithi040.stdout:5/516: write d0/d3b/d3f/f45 [789949,96972] 0 2024-04-18T10:42:48.182 INFO:tasks.workunit.client.0.smithi040.stdout:8/623: link d2/d5/d9/d63/f64 d2/d22/d49/fd7 0 2024-04-18T10:42:48.183 INFO:tasks.workunit.client.0.smithi040.stdout:0/638: creat dd/df/d4e/dc3/ff0 x:0 0 0 2024-04-18T10:42:48.184 INFO:tasks.workunit.client.0.smithi040.stdout:6/585: rename df/d4b/d6a/d93/c3e to df/d4b/d6a/d93/ccf 0 2024-04-18T10:42:48.184 INFO:tasks.workunit.client.0.smithi040.stdout:7/573: dread d6/d25/d28/d2c/d2d/d47/f48 [0,4194304] 0 2024-04-18T10:42:48.185 INFO:tasks.workunit.client.0.smithi040.stdout:2/560: symlink dd/d14/d2b/d7c/d37/da3/lad 0 2024-04-18T10:42:48.186 INFO:tasks.workunit.client.0.smithi040.stdout:3/608: creat d1/d7/d28/fd1 x:0 0 0 2024-04-18T10:42:48.189 INFO:tasks.workunit.client.0.smithi040.stdout:6/586: creat df/d76/db9/fd0 x:0 0 0 2024-04-18T10:42:48.190 INFO:tasks.workunit.client.0.smithi040.stdout:8/624: creat d2/d22/d80/da2/fd8 x:0 0 0 2024-04-18T10:42:48.193 INFO:tasks.workunit.client.0.smithi040.stdout:5/517: dwrite d0/d3b/d3f/d72/f7a [0,4194304] 0 2024-04-18T10:42:48.195 INFO:tasks.workunit.client.0.smithi040.stdout:0/639: unlink dd/df/d19/d28/f2d 0 2024-04-18T10:42:48.201 INFO:tasks.workunit.client.0.smithi040.stdout:2/561: dwrite dd/d14/d2b/d7c/d37/d38/f57 [4194304,4194304] 0 2024-04-18T10:42:48.201 INFO:tasks.workunit.client.0.smithi040.stdout:7/574: dread d6/d25/d28/d2c/f4d [0,4194304] 0 2024-04-18T10:42:48.202 INFO:tasks.workunit.client.0.smithi040.stdout:2/562: stat dd/d14/d4a 0 2024-04-18T10:42:48.203 INFO:tasks.workunit.client.0.smithi040.stdout:5/518: dread d0/d3/fa4 [0,4194304] 0 2024-04-18T10:42:48.205 INFO:tasks.workunit.client.0.smithi040.stdout:8/625: getdents d2/d15/d2b/dd0 0 2024-04-18T10:42:48.207 INFO:tasks.workunit.client.0.smithi040.stdout:3/609: getdents d1/d7/d67/dc5 0 2024-04-18T10:42:48.207 INFO:tasks.workunit.client.0.smithi040.stdout:1/619: sync 2024-04-18T10:42:48.207 INFO:tasks.workunit.client.0.smithi040.stdout:9/634: sync 2024-04-18T10:42:48.208 INFO:tasks.workunit.client.0.smithi040.stdout:3/610: read d1/d7/f15 [2028318,43528] 0 2024-04-18T10:42:48.208 INFO:tasks.workunit.client.0.smithi040.stdout:1/620: write d1/fa [3489739,38386] 0 2024-04-18T10:42:48.209 INFO:tasks.workunit.client.0.smithi040.stdout:3/611: chown d1/d2/d3c/c41 0 1 2024-04-18T10:42:48.211 INFO:tasks.workunit.client.0.smithi040.stdout:3/612: write d1/d7/d67/dc5/d91/fb9 [496275,112344] 0 2024-04-18T10:42:48.211 INFO:tasks.workunit.client.0.smithi040.stdout:3/613: fdatasync d1/d2/d4e/f84 0 2024-04-18T10:42:48.212 INFO:tasks.workunit.client.0.smithi040.stdout:3/614: dread - d1/d7/d28/fd1 zero size 2024-04-18T10:42:48.213 INFO:tasks.workunit.client.0.smithi040.stdout:9/635: creat d2/dd/fe2 x:0 0 0 2024-04-18T10:42:48.214 INFO:tasks.workunit.client.0.smithi040.stdout:6/587: write df/d4b/d6a/d93/f8e [1209838,35054] 0 2024-04-18T10:42:48.214 INFO:tasks.workunit.client.0.smithi040.stdout:5/519: dread d0/d78/d95/f53 [0,4194304] 0 2024-04-18T10:42:48.216 INFO:tasks.workunit.client.0.smithi040.stdout:3/615: rmdir d1/d7/db2 39 2024-04-18T10:42:48.218 INFO:tasks.workunit.client.0.smithi040.stdout:3/616: write d1/d7/d28/fd1 [662299,5871] 0 2024-04-18T10:42:48.219 INFO:tasks.workunit.client.0.smithi040.stdout:6/588: mknod df/d4b/d6e/cd1 0 2024-04-18T10:42:48.220 INFO:tasks.workunit.client.0.smithi040.stdout:5/520: symlink d0/d78/lae 0 2024-04-18T10:42:48.222 INFO:tasks.workunit.client.0.smithi040.stdout:9/636: link d2/d3/d22/d2e/f76 d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/fe3 0 2024-04-18T10:42:48.223 INFO:tasks.workunit.client.0.smithi040.stdout:0/640: dread dd/df/d19/d3e/d77/f90 [0,4194304] 0 2024-04-18T10:42:48.224 INFO:tasks.workunit.client.0.smithi040.stdout:1/621: dwrite d1/d16/d92/dad/fc0 [0,4194304] 0 2024-04-18T10:42:48.224 INFO:tasks.workunit.client.0.smithi040.stdout:6/589: read - df/d4b/d99/fa6 zero size 2024-04-18T10:42:48.224 INFO:tasks.workunit.client.0.smithi040.stdout:3/617: mknod d1/d2/d3c/cd2 0 2024-04-18T10:42:48.224 INFO:tasks.workunit.client.0.smithi040.stdout:9/637: write d2/d3/d22/d2e/f7b [2232582,2577] 0 2024-04-18T10:42:48.227 INFO:tasks.workunit.client.0.smithi040.stdout:0/641: rmdir dd 39 2024-04-18T10:42:48.228 INFO:tasks.workunit.client.0.smithi040.stdout:3/618: write d1/d2/f31 [993678,123801] 0 2024-04-18T10:42:48.229 INFO:tasks.workunit.client.0.smithi040.stdout:1/622: write d1/d1c/d2b/d32/d36/f50 [446726,11680] 0 2024-04-18T10:42:48.230 INFO:tasks.workunit.client.0.smithi040.stdout:2/563: truncate dd/d14/d44/d5f/d82/da6/f97 130770 0 2024-04-18T10:42:48.235 INFO:tasks.workunit.client.0.smithi040.stdout:9/638: mkdir d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/de4 0 2024-04-18T10:42:48.238 INFO:tasks.workunit.client.0.smithi040.stdout:7/575: dread d6/d3e/d73/f76 [0,4194304] 0 2024-04-18T10:42:48.238 INFO:tasks.workunit.client.0.smithi040.stdout:3/619: rename d1/ccf to d1/d2/d4e/d58/d8e/cd3 0 2024-04-18T10:42:48.238 INFO:tasks.workunit.client.0.smithi040.stdout:1/623: dwrite d1/d1c/d2b/d32/d35/f5d [0,4194304] 0 2024-04-18T10:42:48.241 INFO:tasks.workunit.client.0.smithi040.stdout:2/564: mknod dd/d14/d44/d5f/d82/da6/cae 0 2024-04-18T10:42:48.242 INFO:tasks.workunit.client.0.smithi040.stdout:3/620: rmdir d1/d7 39 2024-04-18T10:42:48.247 INFO:tasks.workunit.client.0.smithi040.stdout:4/567: sync 2024-04-18T10:42:48.247 INFO:tasks.workunit.client.0.smithi040.stdout:5/521: dwrite d0/d21/d42/f4f [0,4194304] 0 2024-04-18T10:42:48.248 INFO:tasks.workunit.client.0.smithi040.stdout:0/642: creat dd/ff1 x:0 0 0 2024-04-18T10:42:48.249 INFO:tasks.workunit.client.0.smithi040.stdout:8/626: dread d2/d2c/da9/fbc [0,4194304] 0 2024-04-18T10:42:48.250 INFO:tasks.workunit.client.0.smithi040.stdout:7/576: dwrite d6/d25/d28/d2c/d3c/f49 [0,4194304] 0 2024-04-18T10:42:48.251 INFO:tasks.workunit.client.0.smithi040.stdout:5/522: write d0/d3/d6b/d7b/fa9 [29025,65839] 0 2024-04-18T10:42:48.252 INFO:tasks.workunit.client.0.smithi040.stdout:3/621: read d1/d7/d67/dc5/d91/fb9 [534799,83027] 0 2024-04-18T10:42:48.253 INFO:tasks.workunit.client.0.smithi040.stdout:3/622: write d1/d7/d3a/f50 [4831261,51003] 0 2024-04-18T10:42:48.253 INFO:tasks.workunit.client.0.smithi040.stdout:2/565: creat dd/d14/d44/d5f/d82/d72/faf x:0 0 0 2024-04-18T10:42:48.254 INFO:tasks.workunit.client.0.smithi040.stdout:6/590: truncate df/d4b/d6e/d3f/f59 6991778 0 2024-04-18T10:42:48.255 INFO:tasks.workunit.client.0.smithi040.stdout:3/623: write d1/d7/d12/f30 [949263,94703] 0 2024-04-18T10:42:48.256 INFO:tasks.workunit.client.0.smithi040.stdout:4/568: mkdir d2/d3/d41/d47/da2 0 2024-04-18T10:42:48.259 INFO:tasks.workunit.client.0.smithi040.stdout:0/643: chown dd/df/d19/d28/d3a/d46/caf 514570 1 2024-04-18T10:42:48.260 INFO:tasks.workunit.client.0.smithi040.stdout:9/639: getdents d2/dd/de 0 2024-04-18T10:42:48.261 INFO:tasks.workunit.client.0.smithi040.stdout:0/644: chown dd/d91/fdb 89 1 2024-04-18T10:42:48.262 INFO:tasks.workunit.client.0.smithi040.stdout:5/523: dwrite d0/d3/d47/f4a [0,4194304] 0 2024-04-18T10:42:48.265 INFO:tasks.workunit.client.0.smithi040.stdout:2/566: creat dd/d14/d2b/fb0 x:0 0 0 2024-04-18T10:42:48.266 INFO:tasks.workunit.client.0.smithi040.stdout:3/624: creat d1/d2/d4e/d58/fd4 x:0 0 0 2024-04-18T10:42:48.267 INFO:tasks.workunit.client.0.smithi040.stdout:6/591: mknod df/d4b/d6e/d3f/d53/d8a/cd2 0 2024-04-18T10:42:48.273 INFO:tasks.workunit.client.0.smithi040.stdout:1/624: dread d1/d1c/d7b/d2e/da4/fbd [0,4194304] 0 2024-04-18T10:42:48.274 INFO:tasks.workunit.client.0.smithi040.stdout:3/625: mkdir d1/d7/d28/dd5 0 2024-04-18T10:42:48.275 INFO:tasks.workunit.client.0.smithi040.stdout:5/524: mkdir d0/d78/d95/d52/daf 0 2024-04-18T10:42:48.276 INFO:tasks.workunit.client.0.smithi040.stdout:2/567: mkdir dd/d14/d44/d5f/d82/da6/db1 0 2024-04-18T10:42:48.278 INFO:tasks.workunit.client.0.smithi040.stdout:6/592: dwrite df/d4b/d7e/fb2 [0,4194304] 0 2024-04-18T10:42:48.279 INFO:tasks.workunit.client.0.smithi040.stdout:5/525: fdatasync d0/d3b/d67/f73 0 2024-04-18T10:42:48.279 INFO:tasks.workunit.client.0.smithi040.stdout:1/625: readlink d1/d1c/d2b/d32/d36/d4d/l8d 0 2024-04-18T10:42:48.280 INFO:tasks.workunit.client.0.smithi040.stdout:4/569: dwrite d2/d3/d2f/f7e [0,4194304] 0 2024-04-18T10:42:48.281 INFO:tasks.workunit.client.0.smithi040.stdout:0/645: link dd/d62/ce1 dd/df/d19/d28/db7/cf2 0 2024-04-18T10:42:48.285 INFO:tasks.workunit.client.0.smithi040.stdout:3/626: rename d1/d7/d12/fc3 to d1/d2/d4e/d58/d62/fd6 0 2024-04-18T10:42:48.286 INFO:tasks.workunit.client.0.smithi040.stdout:7/577: dread d6/d25/f46 [0,4194304] 0 2024-04-18T10:42:48.287 INFO:tasks.workunit.client.0.smithi040.stdout:2/568: getdents dd/d14/d44/d5f/d82/da6/db1 0 2024-04-18T10:42:48.289 INFO:tasks.workunit.client.0.smithi040.stdout:1/626: creat d1/d1c/d2b/db5/dd6/fdd x:0 0 0 2024-04-18T10:42:48.289 INFO:tasks.workunit.client.0.smithi040.stdout:3/627: write d1/d2/d4e/d58/d62/faf [929255,14425] 0 2024-04-18T10:42:48.291 INFO:tasks.workunit.client.0.smithi040.stdout:5/526: dwrite d0/f2d [0,4194304] 0 2024-04-18T10:42:48.292 INFO:tasks.workunit.client.0.smithi040.stdout:5/527: write d0/d3b/d88/faa [982919,70087] 0 2024-04-18T10:42:48.294 INFO:tasks.workunit.client.0.smithi040.stdout:6/593: rename df/d4b/f94 to df/d4b/d6e/d3f/d53/d8a/d95/da7/fd3 0 2024-04-18T10:42:48.294 INFO:tasks.workunit.client.0.smithi040.stdout:2/569: creat dd/d14/d44/d5f/fb2 x:0 0 0 2024-04-18T10:42:48.295 INFO:tasks.workunit.client.0.smithi040.stdout:1/627: creat d1/d1c/d7b/d2e/d3e/fde x:0 0 0 2024-04-18T10:42:48.296 INFO:tasks.workunit.client.0.smithi040.stdout:1/628: chown d1/d1c/d2b/d32 509528 1 2024-04-18T10:42:48.297 INFO:tasks.workunit.client.0.smithi040.stdout:3/628: fsync d1/d2/d4e/d58/f5d 0 2024-04-18T10:42:48.299 INFO:tasks.workunit.client.0.smithi040.stdout:5/528: symlink d0/d3/d6b/d7b/lb0 0 2024-04-18T10:42:48.313 INFO:tasks.workunit.client.0.smithi040.stdout:8/627: sync 2024-04-18T10:42:48.315 INFO:tasks.workunit.client.0.smithi040.stdout:6/594: symlink df/d76/db9/ld4 0 2024-04-18T10:42:48.317 INFO:tasks.workunit.client.0.smithi040.stdout:3/629: dwrite d1/f74 [0,4194304] 0 2024-04-18T10:42:48.318 INFO:tasks.workunit.client.0.smithi040.stdout:0/646: getdents dd/df/d19/d28/d3a/d42 0 2024-04-18T10:42:48.319 INFO:tasks.workunit.client.0.smithi040.stdout:7/578: rename d6/d25/d28/d2c/d2d/d47/c80 to d6/d25/d28/d2c/d2d/d47/d55/d58/cba 0 2024-04-18T10:42:48.319 INFO:tasks.workunit.client.0.smithi040.stdout:9/640: truncate d2/d3/f2b 1612791 0 2024-04-18T10:42:48.321 INFO:tasks.workunit.client.0.smithi040.stdout:1/629: creat d1/d1c/d2b/db5/dcc/fdf x:0 0 0 2024-04-18T10:42:48.322 INFO:tasks.workunit.client.0.smithi040.stdout:3/630: creat d1/d7/d67/fd7 x:0 0 0 2024-04-18T10:42:48.322 INFO:tasks.workunit.client.0.smithi040.stdout:0/647: creat dd/daa/ff3 x:0 0 0 2024-04-18T10:42:48.323 INFO:tasks.workunit.client.0.smithi040.stdout:6/595: creat df/d4b/d6e/d3f/d53/d8a/d95/da7/fd5 x:0 0 0 2024-04-18T10:42:48.323 INFO:tasks.workunit.client.0.smithi040.stdout:8/628: write d2/d10/d14/faa [863539,5420] 0 2024-04-18T10:42:48.324 INFO:tasks.workunit.client.0.smithi040.stdout:3/631: fdatasync d1/d2/f1f 0 2024-04-18T10:42:48.325 INFO:tasks.workunit.client.0.smithi040.stdout:7/579: creat d6/d25/d28/d2c/d2d/d47/d55/d9f/fbb x:0 0 0 2024-04-18T10:42:48.325 INFO:tasks.workunit.client.0.smithi040.stdout:1/630: read - d1/d1c/d2b/d32/d36/d4d/d67/fd4 zero size 2024-04-18T10:42:48.325 INFO:tasks.workunit.client.0.smithi040.stdout:3/632: stat d1/lf 0 2024-04-18T10:42:48.326 INFO:tasks.workunit.client.0.smithi040.stdout:9/641: unlink d2/d7/l18 0 2024-04-18T10:42:48.328 INFO:tasks.workunit.client.0.smithi040.stdout:8/629: symlink d2/d4c/d97/dd3/ld9 0 2024-04-18T10:42:48.329 INFO:tasks.workunit.client.0.smithi040.stdout:1/631: mkdir d1/d9b/d75/d84/dac/dda/de0 0 2024-04-18T10:42:48.333 INFO:tasks.workunit.client.0.smithi040.stdout:3/633: link d1/le d1/d2/d4e/d58/dbe/ld8 0 2024-04-18T10:42:48.333 INFO:tasks.workunit.client.0.smithi040.stdout:6/596: truncate df/d4b/d6e/d3f/d53/d8a/d95/da7/fd3 282447 0 2024-04-18T10:42:48.334 INFO:tasks.workunit.client.0.smithi040.stdout:3/634: readlink d1/l5e 0 2024-04-18T10:42:48.335 INFO:tasks.workunit.client.0.smithi040.stdout:9/642: mknod d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/de4/ce5 0 2024-04-18T10:42:48.335 INFO:tasks.workunit.client.0.smithi040.stdout:1/632: creat d1/d1c/d2b/d32/d36/d4d/d67/fe1 x:0 0 0 2024-04-18T10:42:48.336 INFO:tasks.workunit.client.0.smithi040.stdout:0/648: dwrite dd/df/d19/d3e/fab [0,4194304] 0 2024-04-18T10:42:48.337 INFO:tasks.workunit.client.0.smithi040.stdout:6/597: unlink df/f2f 0 2024-04-18T10:42:48.339 INFO:tasks.workunit.client.0.smithi040.stdout:5/529: dread d0/d4e/f4c [0,4194304] 0 2024-04-18T10:42:48.339 INFO:tasks.workunit.client.0.smithi040.stdout:4/570: sync 2024-04-18T10:42:48.339 INFO:tasks.workunit.client.0.smithi040.stdout:3/635: mkdir d1/d7/dd9 0 2024-04-18T10:42:48.341 INFO:tasks.workunit.client.0.smithi040.stdout:0/649: mkdir dd/df/d19/d3e/df4 0 2024-04-18T10:42:48.342 INFO:tasks.workunit.client.0.smithi040.stdout:4/571: write d2/d3/d41/d47/d6f/f85 [134994,95139] 0 2024-04-18T10:42:48.345 INFO:tasks.workunit.client.0.smithi040.stdout:5/530: mkdir d0/d3b/d3f/db1 0 2024-04-18T10:42:48.347 INFO:tasks.workunit.client.0.smithi040.stdout:8/630: dread d2/f67 [0,4194304] 0 2024-04-18T10:42:48.348 INFO:tasks.workunit.client.0.smithi040.stdout:4/572: chown d2/d3/d4/d1f/d29/d49/l4d 3 1 2024-04-18T10:42:48.350 INFO:tasks.workunit.client.0.smithi040.stdout:5/531: write d0/d21/d42/f8f [943087,96505] 0 2024-04-18T10:42:48.354 INFO:tasks.workunit.client.0.smithi040.stdout:7/580: truncate d6/d25/d28/d2c/f3d 1804090 0 2024-04-18T10:42:48.356 INFO:tasks.workunit.client.0.smithi040.stdout:7/581: dread - d6/d25/d28/d2c/d2d/d47/d55/d9f/fbb zero size 2024-04-18T10:42:48.356 INFO:tasks.workunit.client.0.smithi040.stdout:9/643: rename d2/d3/d22/d2e/d35/d40/fa5 to d2/d5b/d6f/d80/fe6 0 2024-04-18T10:42:48.357 INFO:tasks.workunit.client.0.smithi040.stdout:9/644: write d2/d3/d70/fb2 [802838,44417] 0 2024-04-18T10:42:48.358 INFO:tasks.workunit.client.0.smithi040.stdout:9/645: dread - d2/d3/d70/f8f zero size 2024-04-18T10:42:48.359 INFO:tasks.workunit.client.0.smithi040.stdout:8/631: symlink d2/d5/lda 0 2024-04-18T10:42:48.363 INFO:tasks.workunit.client.0.smithi040.stdout:0/650: getdents dd 0 2024-04-18T10:42:48.364 INFO:tasks.workunit.client.0.smithi040.stdout:3/636: truncate d1/d7/d12/d7b/fb3 1669375 0 2024-04-18T10:42:48.367 INFO:tasks.workunit.client.0.smithi040.stdout:0/651: write dd/df/d19/d28/d3a/d5b/fc5 [438852,45379] 0 2024-04-18T10:42:48.369 INFO:tasks.workunit.client.0.smithi040.stdout:6/598: dwrite df/d4b/d6a/d93/f1b [0,4194304] 0 2024-04-18T10:42:48.372 INFO:tasks.workunit.client.0.smithi040.stdout:2/570: sync 2024-04-18T10:42:48.376 INFO:tasks.workunit.client.0.smithi040.stdout:3/637: creat d1/d7/d67/dc5/d91/fda x:0 0 0 2024-04-18T10:42:48.376 INFO:tasks.workunit.client.0.smithi040.stdout:0/652: dwrite dd/df/d19/d28/d3a/d5b/fc5 [0,4194304] 0 2024-04-18T10:42:48.377 INFO:tasks.workunit.client.0.smithi040.stdout:9/646: dread d2/d3/d22/d2e/d35/d40/d71/f78 [0,4194304] 0 2024-04-18T10:42:48.380 INFO:tasks.workunit.client.0.smithi040.stdout:4/573: getdents d2/d3/d4/d21/d28 0 2024-04-18T10:42:48.381 INFO:tasks.workunit.client.0.smithi040.stdout:4/574: write d2/f2c [3342901,122920] 0 2024-04-18T10:42:48.383 INFO:tasks.workunit.client.0.smithi040.stdout:1/633: rename d1/d1c/d2b/db5/dcc/fdf to d1/d1c/d2b/d32/d36/d4d/fe2 0 2024-04-18T10:42:48.386 INFO:tasks.workunit.client.0.smithi040.stdout:5/532: getdents d0 0 2024-04-18T10:42:48.387 INFO:tasks.workunit.client.0.smithi040.stdout:3/638: creat d1/d7/d67/dc5/fdb x:0 0 0 2024-04-18T10:42:48.390 INFO:tasks.workunit.client.0.smithi040.stdout:4/575: unlink d2/d3/d4/d21/c98 0 2024-04-18T10:42:48.392 INFO:tasks.workunit.client.0.smithi040.stdout:7/582: rename d6/d3e/d99/db8 to d6/d25/d28/d2c/d2d/dbc 0 2024-04-18T10:42:48.392 INFO:tasks.workunit.client.0.smithi040.stdout:2/571: creat dd/d14/d44/d77/fb3 x:0 0 0 2024-04-18T10:42:48.393 INFO:tasks.workunit.client.0.smithi040.stdout:8/632: getdents d2/d5/d9/d3c/d5a/d94 0 2024-04-18T10:42:48.394 INFO:tasks.workunit.client.0.smithi040.stdout:9/647: link d2/d3/d22/d2e/d35/d40/d85/f9c d2/d3/d22/d2e/d35/daf/dc7/dcf/fe7 0 2024-04-18T10:42:48.396 INFO:tasks.workunit.client.0.smithi040.stdout:1/634: rename d1/d1c/d2b/d32/d35/c73 to d1/d9b/d75/d84/dac/ce3 0 2024-04-18T10:42:48.397 INFO:tasks.workunit.client.0.smithi040.stdout:8/633: creat d2/d22/d80/da2/fdb x:0 0 0 2024-04-18T10:42:48.398 INFO:tasks.workunit.client.0.smithi040.stdout:1/635: write d1/d1c/d2b/d32/f64 [4913272,15772] 0 2024-04-18T10:42:48.399 INFO:tasks.workunit.client.0.smithi040.stdout:6/599: mkdir df/d4b/db7/dcc/dd6 0 2024-04-18T10:42:48.402 INFO:tasks.workunit.client.0.smithi040.stdout:5/533: link d0/d78/d95/l3d d0/d3b/d3f/db1/lb2 0 2024-04-18T10:42:48.404 INFO:tasks.workunit.client.0.smithi040.stdout:1/636: symlink d1/d1c/d2b/d32/d36/d4d/d67/le4 0 2024-04-18T10:42:48.404 INFO:tasks.workunit.client.0.smithi040.stdout:9/648: mknod d2/d3/d22/d2e/d35/daf/dc7/dcf/ce8 0 2024-04-18T10:42:48.406 INFO:tasks.workunit.client.0.smithi040.stdout:5/534: dread d0/d4e/f4c [0,4194304] 0 2024-04-18T10:42:48.407 INFO:tasks.workunit.client.0.smithi040.stdout:7/583: creat d6/fbd x:0 0 0 2024-04-18T10:42:48.408 INFO:tasks.workunit.client.0.smithi040.stdout:3/639: getdents d1/d2/d4e/d58/d62 0 2024-04-18T10:42:48.409 INFO:tasks.workunit.client.0.smithi040.stdout:8/634: symlink d2/d22/d49/ldc 0 2024-04-18T10:42:48.411 INFO:tasks.workunit.client.0.smithi040.stdout:1/637: creat d1/d1c/fe5 x:0 0 0 2024-04-18T10:42:48.411 INFO:tasks.workunit.client.0.smithi040.stdout:9/649: rmdir d2/d3/d22/d2e/d35/dbb 39 2024-04-18T10:42:48.412 INFO:tasks.workunit.client.0.smithi040.stdout:7/584: dread d6/d25/d28/f87 [0,4194304] 0 2024-04-18T10:42:48.413 INFO:tasks.workunit.client.0.smithi040.stdout:4/576: getdents d2/d3/d4/d1f/d29/d49/d31 0 2024-04-18T10:42:48.413 INFO:tasks.workunit.client.0.smithi040.stdout:7/585: chown d6/d25/d28/d2c/d2d/d47/d55/d9f 368042403 1 2024-04-18T10:42:48.414 INFO:tasks.workunit.client.0.smithi040.stdout:7/586: write d6/f14 [631545,13279] 0 2024-04-18T10:42:48.415 INFO:tasks.workunit.client.0.smithi040.stdout:6/600: mknod df/d4b/d6a/d93/cd7 0 2024-04-18T10:42:48.415 INFO:tasks.workunit.client.0.smithi040.stdout:7/587: stat d6/d50/d79 0 2024-04-18T10:42:48.416 INFO:tasks.workunit.client.0.smithi040.stdout:5/535: symlink d0/d3b/d88/lb3 0 2024-04-18T10:42:48.416 INFO:tasks.workunit.client.0.smithi040.stdout:7/588: write d6/d25/d28/d2c/d2d/d47/f52 [1017929,96596] 0 2024-04-18T10:42:48.417 INFO:tasks.workunit.client.0.smithi040.stdout:3/640: readlink d1/d2/d3c/l90 0 2024-04-18T10:42:48.417 INFO:tasks.workunit.client.0.smithi040.stdout:5/536: stat d0/d3/d47/f4a 0 2024-04-18T10:42:48.418 INFO:tasks.workunit.client.0.smithi040.stdout:5/537: fdatasync d0/f19 0 2024-04-18T10:42:48.418 INFO:tasks.workunit.client.0.smithi040.stdout:5/538: chown d0/f1 12660026 1 2024-04-18T10:42:48.419 INFO:tasks.workunit.client.0.smithi040.stdout:8/635: rename d2/d10/d14/f8c to d2/d5/d9/d63/fdd 0 2024-04-18T10:42:48.420 INFO:tasks.workunit.client.0.smithi040.stdout:8/636: chown d2 20 1 2024-04-18T10:42:48.420 INFO:tasks.workunit.client.0.smithi040.stdout:1/638: mkdir d1/d9b/d75/d84/de6 0 2024-04-18T10:42:48.421 INFO:tasks.workunit.client.0.smithi040.stdout:2/572: truncate dd/f36 4142890 0 2024-04-18T10:42:48.422 INFO:tasks.workunit.client.0.smithi040.stdout:0/653: sync 2024-04-18T10:42:48.423 INFO:tasks.workunit.client.0.smithi040.stdout:9/650: fsync d2/d7/f8 0 2024-04-18T10:42:48.423 INFO:tasks.workunit.client.0.smithi040.stdout:2/573: write dd/d14/d2b/f2e [1198951,55671] 0 2024-04-18T10:42:48.425 INFO:tasks.workunit.client.0.smithi040.stdout:4/577: mknod d2/d3/d41/d62/d7c/ca3 0 2024-04-18T10:42:48.425 INFO:tasks.workunit.client.0.smithi040.stdout:3/641: dwrite d1/d2/d16/f2d [0,4194304] 0 2024-04-18T10:42:48.427 INFO:tasks.workunit.client.0.smithi040.stdout:7/589: creat d6/d3e/fbe x:0 0 0 2024-04-18T10:42:48.427 INFO:tasks.workunit.client.0.smithi040.stdout:2/574: chown dd/d14/d44/d5f/d82/da6/d49/l58 2242 1 2024-04-18T10:42:48.435 INFO:tasks.workunit.client.0.smithi040.stdout:9/651: dwrite d2/d3/d22/d2e/d35/daf/dc1/d46/d44/d8d/fd3 [0,4194304] 0 2024-04-18T10:42:48.436 INFO:tasks.workunit.client.0.smithi040.stdout:0/654: creat dd/df/d19/d28/db7/dd4/ff5 x:0 0 0 2024-04-18T10:42:48.439 INFO:tasks.workunit.client.0.smithi040.stdout:7/590: dwrite d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/f88 [0,4194304] 0 2024-04-18T10:42:48.445 INFO:tasks.workunit.client.0.smithi040.stdout:4/578: mkdir d2/d3/d4/d21/da4 0 2024-04-18T10:42:48.446 INFO:tasks.workunit.client.0.smithi040.stdout:0/655: mknod dd/df/d19/d28/d3a/d5b/dd0/cf6 0 2024-04-18T10:42:48.447 INFO:tasks.workunit.client.0.smithi040.stdout:6/601: dwrite df/d4b/d6e/d3f/d53/d8a/d95/da7/fd3 [0,4194304] 0 2024-04-18T10:42:48.447 INFO:tasks.workunit.client.0.smithi040.stdout:2/575: symlink dd/d61/d8e/d98/lb4 0 2024-04-18T10:42:48.448 INFO:tasks.workunit.client.0.smithi040.stdout:6/602: chown df/d4b/d6e/d3f/d53/fc0 0 1 2024-04-18T10:42:48.449 INFO:tasks.workunit.client.0.smithi040.stdout:5/539: write d0/d3b/d88/f94 [1644621,74790] 0 2024-04-18T10:42:48.450 INFO:tasks.workunit.client.0.smithi040.stdout:5/540: chown d0/d4e/c33 1873 1 2024-04-18T10:42:48.451 INFO:tasks.workunit.client.0.smithi040.stdout:9/652: symlink d2/d3/d70/da8/le9 0 2024-04-18T10:42:48.453 INFO:tasks.workunit.client.0.smithi040.stdout:0/656: rmdir dd/df/d4e/dc3 39 2024-04-18T10:42:48.460 INFO:tasks.workunit.client.0.smithi040.stdout:7/591: truncate d6/d25/d28/f87 296229 0 2024-04-18T10:42:48.460 INFO:tasks.workunit.client.0.smithi040.stdout:1/639: mknod d1/d1c/d7b/ce7 0 2024-04-18T10:42:48.461 INFO:tasks.workunit.client.0.smithi040.stdout:6/603: creat df/d4b/d6a/d93/fd8 x:0 0 0 2024-04-18T10:42:48.461 INFO:tasks.workunit.client.0.smithi040.stdout:8/637: getdents d2/d15/d2b/d40 0 2024-04-18T10:42:48.462 INFO:tasks.workunit.client.0.smithi040.stdout:4/579: symlink d2/d3/d4/d21/da4/la5 0 2024-04-18T10:42:48.463 INFO:tasks.workunit.client.0.smithi040.stdout:0/657: mkdir dd/df/d19/d28/d3a/d5b/dd0/df7 0 2024-04-18T10:42:48.463 INFO:tasks.workunit.client.0.smithi040.stdout:9/653: creat d2/dd/dbf/fea x:0 0 0 2024-04-18T10:42:48.465 INFO:tasks.workunit.client.0.smithi040.stdout:5/541: dwrite d0/d3b/d3f/f40 [0,4194304] 0 2024-04-18T10:42:48.466 INFO:tasks.workunit.client.0.smithi040.stdout:0/658: fsync dd/f49 0 2024-04-18T10:42:48.467 INFO:tasks.workunit.client.0.smithi040.stdout:4/580: write d2/d3/d2f/f56 [82209,126461] 0 2024-04-18T10:42:48.467 INFO:tasks.workunit.client.0.smithi040.stdout:6/604: creat df/d4b/d63/dbb/fd9 x:0 0 0 2024-04-18T10:42:48.469 INFO:tasks.workunit.client.0.smithi040.stdout:1/640: mknod d1/d9b/d75/d84/dac/dda/de0/ce8 0 2024-04-18T10:42:48.471 INFO:tasks.workunit.client.0.smithi040.stdout:7/592: rename d6/d25/d28/d2c/d2d/d47/l68 to d6/d25/d28/d2c/d2d/dbc/lbf 0 2024-04-18T10:42:48.474 INFO:tasks.workunit.client.0.smithi040.stdout:7/593: readlink d6/d25/d28/d2c/d2d/d47/lb3 0 2024-04-18T10:42:48.476 INFO:tasks.workunit.client.0.smithi040.stdout:4/581: mknod d2/d3/d4/dd/d4f/ca6 0 2024-04-18T10:42:48.477 INFO:tasks.workunit.client.0.smithi040.stdout:3/642: dwrite d1/d2/d16/f40 [0,4194304] 0 2024-04-18T10:42:48.479 INFO:tasks.workunit.client.0.smithi040.stdout:6/605: creat df/d76/dc2/dce/fda x:0 0 0 2024-04-18T10:42:48.481 INFO:tasks.workunit.client.0.smithi040.stdout:5/542: write d0/d78/d95/d52/d5d/f60 [68678,20686] 0 2024-04-18T10:42:48.483 INFO:tasks.workunit.client.0.smithi040.stdout:7/594: rename d6/d25/c92 to d6/d3e/d73/cc0 0 2024-04-18T10:42:48.484 INFO:tasks.workunit.client.0.smithi040.stdout:5/543: fsync d0/d21/d42/f6c 0 2024-04-18T10:42:48.485 INFO:tasks.workunit.client.0.smithi040.stdout:1/641: dwrite d1/d1c/d7b/d2e/da4/fbd [4194304,4194304] 0 2024-04-18T10:42:48.485 INFO:tasks.workunit.client.0.smithi040.stdout:3/643: truncate d1/d2/d4e/d58/f72 117303 0 2024-04-18T10:42:48.486 INFO:tasks.workunit.client.0.smithi040.stdout:5/544: fdatasync d0/f2d 0 2024-04-18T10:42:48.486 INFO:tasks.workunit.client.0.smithi040.stdout:7/595: readlink d6/d3e/d99/lae 0 2024-04-18T10:42:48.486 INFO:tasks.workunit.client.0.smithi040.stdout:4/582: unlink d2/d3/d41/d47/f76 0 2024-04-18T10:42:48.487 INFO:tasks.workunit.client.0.smithi040.stdout:9/654: dread d2/d3/d22/f3a [0,4194304] 0 2024-04-18T10:42:48.487 INFO:tasks.workunit.client.0.smithi040.stdout:6/606: creat df/d4b/d6e/d3f/d53/d8a/fdb x:0 0 0 2024-04-18T10:42:48.488 INFO:tasks.workunit.client.0.smithi040.stdout:1/642: read d1/d9b/f70 [440063,71174] 0 2024-04-18T10:42:48.489 INFO:tasks.workunit.client.0.smithi040.stdout:6/607: write df/d4b/d6a/d93/f1b [3742415,649] 0 2024-04-18T10:42:48.493 INFO:tasks.workunit.client.0.smithi040.stdout:3/644: readlink d1/d7/l4b 0 2024-04-18T10:42:48.494 INFO:tasks.workunit.client.0.smithi040.stdout:5/545: rmdir d0 39 2024-04-18T10:42:48.494 INFO:tasks.workunit.client.0.smithi040.stdout:3/645: stat d1/d2/d4e/d58/f6c 0 2024-04-18T10:42:48.495 INFO:tasks.workunit.client.0.smithi040.stdout:7/596: dwrite d6/d25/d28/f42 [0,4194304] 0 2024-04-18T10:42:48.497 INFO:tasks.workunit.client.0.smithi040.stdout:8/638: write d2/d5/d9/f9d [1589367,3296] 0 2024-04-18T10:42:48.499 INFO:tasks.workunit.client.0.smithi040.stdout:4/583: dread d2/d3/d2f/f46 [0,4194304] 0 2024-04-18T10:42:48.500 INFO:tasks.workunit.client.0.smithi040.stdout:8/639: write d2/d5/d9/d3c/d5a/fb2 [109369,26060] 0 2024-04-18T10:42:48.502 INFO:tasks.workunit.client.0.smithi040.stdout:6/608: symlink df/d4b/d63/db3/ldc 0 2024-04-18T10:42:48.503 INFO:tasks.workunit.client.0.smithi040.stdout:6/609: fsync df/d4b/d6e/d3f/d53/d8a/d95/f98 0 2024-04-18T10:42:48.507 INFO:tasks.workunit.client.0.smithi040.stdout:2/576: sync 2024-04-18T10:42:48.513 INFO:tasks.workunit.client.0.smithi040.stdout:1/643: mknod d1/d1c/d2b/d32/d36/ce9 0 2024-04-18T10:42:48.515 INFO:tasks.workunit.client.0.smithi040.stdout:5/546: creat d0/d3b/d3f/fb4 x:0 0 0 2024-04-18T10:42:48.516 INFO:tasks.workunit.client.0.smithi040.stdout:8/640: write d2/f17 [1622514,114944] 0 2024-04-18T10:42:48.516 INFO:tasks.workunit.client.0.smithi040.stdout:7/597: mkdir d6/dc1 0 2024-04-18T10:42:48.517 INFO:tasks.workunit.client.0.smithi040.stdout:1/644: read d1/d1c/d7b/d2e/f93 [234210,74682] 0 2024-04-18T10:42:48.517 INFO:tasks.workunit.client.0.smithi040.stdout:0/659: dwrite dd/df/d19/d28/db7/dd4/fbc [0,4194304] 0 2024-04-18T10:42:48.520 INFO:tasks.workunit.client.0.smithi040.stdout:9/655: creat d2/d5b/d6f/d80/feb x:0 0 0 2024-04-18T10:42:48.520 INFO:tasks.workunit.client.0.smithi040.stdout:2/577: write dd/d61/f68 [4652598,24401] 0 2024-04-18T10:42:48.521 INFO:tasks.workunit.client.0.smithi040.stdout:8/641: dread d2/d5/d9/d1b/f4f [0,4194304] 0 2024-04-18T10:42:48.521 INFO:tasks.workunit.client.0.smithi040.stdout:4/584: chown d2/d3/d4/d21/d28/c9e 4159 1 2024-04-18T10:42:48.523 INFO:tasks.workunit.client.0.smithi040.stdout:3/646: getdents d1/d7/db2/dc0 0 2024-04-18T10:42:48.523 INFO:tasks.workunit.client.0.smithi040.stdout:4/585: stat d2/d3/d4/d1f/d29/d49/d31 0 2024-04-18T10:42:48.523 INFO:tasks.workunit.client.0.smithi040.stdout:3/647: read - d1/d2/d3c/f83 zero size 2024-04-18T10:42:48.524 INFO:tasks.workunit.client.0.smithi040.stdout:5/547: mkdir d0/db5 0 2024-04-18T10:42:48.538 INFO:tasks.workunit.client.0.smithi040.stdout:0/660: dread dd/df/d19/d28/d3a/f9d [0,4194304] 0 2024-04-18T10:42:48.539 INFO:tasks.workunit.client.0.smithi040.stdout:6/610: link df/d4b/d6a/d93/l97 df/d4b/d6e/ldd 0 2024-04-18T10:42:48.540 INFO:tasks.workunit.client.0.smithi040.stdout:2/578: mknod dd/d14/d44/d5f/d82/da6/cb5 0 2024-04-18T10:42:48.541 INFO:tasks.workunit.client.0.smithi040.stdout:8/642: getdents d2/d2c/dbe 0 2024-04-18T10:42:48.542 INFO:tasks.workunit.client.0.smithi040.stdout:4/586: dwrite d2/d3/d4/d21/f58 [0,4194304] 0 2024-04-18T10:42:48.543 INFO:tasks.workunit.client.0.smithi040.stdout:2/579: chown dd/c2d 0 1 2024-04-18T10:42:48.544 INFO:tasks.workunit.client.0.smithi040.stdout:7/598: dwrite d6/d25/f46 [0,4194304] 0 2024-04-18T10:42:48.545 INFO:tasks.workunit.client.0.smithi040.stdout:4/587: stat d2/d3/d41/d94 0 2024-04-18T10:42:48.545 INFO:tasks.workunit.client.0.smithi040.stdout:1/645: getdents d1/d9b/d75/d84/dac/dda 0 2024-04-18T10:42:48.546 INFO:tasks.workunit.client.0.smithi040.stdout:3/648: link d1/d2/d4e/d58/d62/d6b/la6 d1/d2/d16/ldc 0 2024-04-18T10:42:48.546 INFO:tasks.workunit.client.0.smithi040.stdout:8/643: truncate d2/d15/d2b/f7f 327258 0 2024-04-18T10:42:48.547 INFO:tasks.workunit.client.0.smithi040.stdout:2/580: fdatasync dd/d14/fa9 0 2024-04-18T10:42:48.550 INFO:tasks.workunit.client.0.smithi040.stdout:3/649: readlink d1/d7/d67/dc5/d3b/l77 0 2024-04-18T10:42:48.550 INFO:tasks.workunit.client.0.smithi040.stdout:8/644: chown d2/d5/d9/d1b/fa6 87667387 1 2024-04-18T10:42:48.551 INFO:tasks.workunit.client.0.smithi040.stdout:7/599: chown d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/d8a 4 1 2024-04-18T10:42:48.551 INFO:tasks.workunit.client.0.smithi040.stdout:2/581: readlink dd/d14/d2b/d7c/d37/l7d 0 2024-04-18T10:42:48.551 INFO:tasks.workunit.client.0.smithi040.stdout:5/548: dread d0/d3b/d3f/f45 [0,4194304] 0 2024-04-18T10:42:48.552 INFO:tasks.workunit.client.0.smithi040.stdout:6/611: link df/d4b/d6e/l72 df/lde 0 2024-04-18T10:42:48.553 INFO:tasks.workunit.client.0.smithi040.stdout:8/645: read - d2/d22/d80/da2/fd8 zero size 2024-04-18T10:42:48.553 INFO:tasks.workunit.client.0.smithi040.stdout:7/600: chown d6/d25/d28/dac 17 1 2024-04-18T10:42:48.554 INFO:tasks.workunit.client.0.smithi040.stdout:2/582: chown dd/d14/d2b/c51 7 1 2024-04-18T10:42:48.555 INFO:tasks.workunit.client.0.smithi040.stdout:3/650: unlink d1/d7/d12/c78 0 2024-04-18T10:42:48.556 INFO:tasks.workunit.client.0.smithi040.stdout:8/646: chown d2/d15/d2b/f92 2575 1 2024-04-18T10:42:48.559 INFO:tasks.workunit.client.0.smithi040.stdout:1/646: dwrite d1/d1c/f94 [0,4194304] 0 2024-04-18T10:42:48.561 INFO:tasks.workunit.client.0.smithi040.stdout:6/612: creat df/d4b/db7/fdf x:0 0 0 2024-04-18T10:42:48.562 INFO:tasks.workunit.client.0.smithi040.stdout:2/583: mknod dd/d14/d2b/d7c/cb6 0 2024-04-18T10:42:48.563 INFO:tasks.workunit.client.0.smithi040.stdout:7/601: rmdir d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/d8a 39 2024-04-18T10:42:48.565 INFO:tasks.workunit.client.0.smithi040.stdout:3/651: dwrite d1/d7/d12/f22 [0,4194304] 0 2024-04-18T10:42:48.565 INFO:tasks.workunit.client.0.smithi040.stdout:8/647: rename d2/d4c/d97/ld4 to d2/d5/d9/lde 0 2024-04-18T10:42:48.566 INFO:tasks.workunit.client.0.smithi040.stdout:4/588: getdents d2/d3/d41/d62/d7c 0 2024-04-18T10:42:48.567 INFO:tasks.workunit.client.0.smithi040.stdout:7/602: chown d6/d25/d28/d2c/d3c/f49 574870 1 2024-04-18T10:42:48.569 INFO:tasks.workunit.client.0.smithi040.stdout:4/589: write d2/d3/d41/d47/d6f/f75 [827298,21342] 0 2024-04-18T10:42:48.569 INFO:tasks.workunit.client.0.smithi040.stdout:0/661: dread dd/df/f1e [0,4194304] 0 2024-04-18T10:42:48.570 INFO:tasks.workunit.client.0.smithi040.stdout:6/613: symlink df/d4b/db7/dc1/le0 0 2024-04-18T10:42:48.572 INFO:tasks.workunit.client.0.smithi040.stdout:2/584: mknod dd/d14/cb7 0 2024-04-18T10:42:48.573 INFO:tasks.workunit.client.0.smithi040.stdout:6/614: fdatasync df/d4b/d6e/d3f/d53/f8f 0 2024-04-18T10:42:48.573 INFO:tasks.workunit.client.0.smithi040.stdout:9/656: sync 2024-04-18T10:42:48.574 INFO:tasks.workunit.client.0.smithi040.stdout:1/647: link d1/d1c/d2b/d32/fd9 d1/d1c/d2b/d32/d36/d4d/d67/dcb/fea 0 2024-04-18T10:42:48.574 INFO:tasks.workunit.client.0.smithi040.stdout:9/657: chown d2/d3/l47 2717380 1 2024-04-18T10:42:48.575 INFO:tasks.workunit.client.0.smithi040.stdout:1/648: chown d1/d1c/d2b/d32/d36/d4d/c74 91608 1 2024-04-18T10:42:48.576 INFO:tasks.workunit.client.0.smithi040.stdout:7/603: unlink d6/d25/d28/d2c/d2d/d47/d55/d58/d6c/l81 0 2024-04-18T10:42:48.577 INFO:tasks.workunit.client.0.smithi040.stdout:8/648: symlink d2/d5/ldf 0 2024-04-18T10:42:48.578 INFO:tasks.workunit.client.0.smithi040.stdout:1/649: dread - d1/d1c/d2b/d32/d35/f66 zero size 2024-04-18T10:42:48.580 INFO:tasks.workunit.client.0.smithi040.stdout:7/604: chown d6/d25/d28/dac/d64/l74 5151119 1 2024-04-18T10:42:48.581 INFO:tasks.workunit.client.0.smithi040.stdout:4/590: read d2/d3/d4/d1f/d29/d49/f42 [9158,35565] 0 2024-04-18T10:42:48.581 INFO:tasks.workunit.client.0.smithi040.stdout:9/658: rename d2/dd/de/f58 to d2/d5b/fec 0 2024-04-18T10:42:48.582 INFO:tasks.workunit.client.0.smithi040.stdout:6/615: dwrite df/d4b/d6a/d93/fd8 [0,4194304] 0 2024-04-18T10:42:48.582 INFO:tasks.workunit.client.0.smithi040.stdout:0/662: mkdir dd/df/df8 0 2024-04-18T10:42:48.583 INFO:tasks.workunit.client.0.smithi040.stdout:1/650: fdatasync d1/d1c/d2b/d32/d36/d4d/f62 0 2024-04-18T10:42:48.585 INFO:tasks.workunit.client.0.smithi040.stdout:3/652: rmdir d1/d7/d3a/d9e 0 2024-04-18T10:42:48.586 INFO:tasks.workunit.client.0.smithi040.stdout:5/549: link d0/d4e/c9a d0/d78/d95/d52/cb6 0 2024-04-18T10:42:48.587 INFO:tasks.workunit.client.0.smithi040.stdout:8/649: creat d2/d5/d9/d3c/d5a/d94/fe0 x:0 0 0 2024-04-18T10:42:48.589 INFO:tasks.workunit.client.0.smithi040.stdout:6/616: write df/f2d [414946,34775] 0 2024-04-18T10:42:48.589 INFO:tasks.workunit.client.0.smithi040.stdout:4/591: mknod d2/d3/d41/d47/d6f/ca7 0 2024-04-18T10:42:48.590 INFO:tasks.workunit.client.0.smithi040.stdout:7/605: creat d6/d50/d79/da8/dad/fc2 x:0 0 0 2024-04-18T10:42:48.591 INFO:tasks.workunit.client.0.smithi040.stdout:0/663: mkdir dd/df/d19/d28/d3a/df9 0 2024-04-18T10:42:48.592 INFO:tasks.workunit.client.0.smithi040.stdout:8/650: fsync d2/d15/d2b/f7f 0 2024-04-18T10:42:48.594 INFO:tasks.workunit.client.0.smithi040.stdout:2/585: dwrite dd/d14/d4a/d54/f9b [0,4194304] 0 2024-04-18T10:42:48.595 INFO:tasks.workunit.client.0.smithi040.stdout:0/664: stat dd/daa/dd8 0 2024-04-18T10:42:48.598 INFO:tasks.workunit.client.0.smithi040.stdout:5/550: mkdir d0/d78/d95/db7 0 2024-04-18T10:42:48.600 INFO:tasks.workunit.client.0.smithi040.stdout:1/651: rename d1/d9b/d75/d84/dac/ce3 to d1/d1c/d2b/d32/d7e/ceb 0 2024-04-18T10:42:48.601 INFO:tasks.workunit.client.0.smithi040.stdout:8/651: mknod d2/d15/d2b/d40/ce1 0 2024-04-18T10:42:48.602 INFO:tasks.workunit.client.0.smithi040.stdout:2/586: write dd/d14/d2b/d7c/f3a [2242077,14144] 0 2024-04-18T10:42:48.602 INFO:tasks.workunit.client.0.smithi040.stdout:9/659: dwrite d2/d7/f1b [0,4194304] 0 2024-04-18T10:42:48.603 INFO:tasks.workunit.client.0.smithi040.stdout:4/592: creat d2/d3/d4/d1f/d29/d49/d31/fa8 x:0 0 0 2024-04-18T10:42:48.604 INFO:tasks.workunit.client.0.smithi040.stdout:7/606: symlink d6/d25/d28/d2c/lc3 0 2024-04-18T10:42:48.607 INFO:tasks.workunit.client.0.smithi040.stdout:3/653: dwrite d1/d2/d4e/d58/d62/faf [0,4194304] 0 2024-04-18T10:42:48.609 INFO:tasks.workunit.client.0.smithi040.stdout:1/652: creat d1/db1/fec x:0 0 0 2024-04-18T10:42:48.610 INFO:tasks.workunit.client.0.smithi040.stdout:6/617: dwrite df/d4b/d6a/f89 [0,4194304] 0 2024-04-18T10:42:48.610 INFO:tasks.workunit.client.0.smithi040.stdout:5/551: creat d0/d21/fb8 x:0 0 0 2024-04-18T10:42:48.612 INFO:tasks.workunit.client.0.smithi040.stdout:1/653: chown d1/d1c/d2b/d32/d36/f50 11 1 2024-04-18T10:42:48.614 INFO:tasks.workunit.client.0.smithi040.stdout:2/587: symlink dd/d14/d4a/d54/lb8 0 2024-04-18T10:42:48.615 INFO:tasks.workunit.client.0.smithi040.stdout:2/588: chown dd/d14/d44/d5f/d82/da6/d49/l7b 1 1 2024-04-18T10:42:48.616 INFO:tasks.workunit.client.0.smithi040.stdout:2/589: write dd/d14/d2b/d7c/fa8 [864594,105957] 0 2024-04-18T10:42:48.617 INFO:tasks.workunit.client.0.smithi040.stdout:9/660: mkdir d2/d3/d22/d2e/d35/d40/d85/ded 0 2024-04-18T10:42:48.620 INFO:tasks.workunit.client.0.smithi040.stdout:7/607: mkdir d6/d25/d28/d2c/d2d/d47/d55/d58/dc4 0 2024-04-18T10:42:48.622 INFO:tasks.workunit.client.0.smithi040.stdout:3/654: creat d1/d7/d28/fdd x:0 0 0 2024-04-18T10:42:48.623 INFO:tasks.workunit.client.0.smithi040.stdout:8/652: symlink d2/d22/d49/le2 0 2024-04-18T10:42:48.623 INFO:tasks.workunit.client.0.smithi040.stdout:2/590: dwrite dd/d14/d2b/d7c/d37/f79 [0,4194304] 0 2024-04-18T10:42:48.624 INFO:tasks.workunit.client.0.smithi040.stdout:5/552: stat d0/cd 0 2024-04-18T10:42:48.625 INFO:tasks.workunit.client.0.smithi040.stdout:8/653: write d2/d22/d49/d79/fa7 [495828,30288] 0 2024-04-18T10:42:48.626 INFO:tasks.workunit.client.0.smithi040.stdout:8/654: write d2/f5e [376935,63895] 0 2024-04-18T10:42:48.628 INFO:tasks.workunit.client.0.smithi040.stdout:1/654: creat d1/d1c/d2b/db5/fed x:0 0 0 2024-04-18T10:42:48.629 INFO:tasks.workunit.client.0.smithi040.stdout:1/655: write d1/f30 [3864025,16160] 0 2024-04-18T10:42:48.630 INFO:tasks.workunit.client.0.smithi040.stdout:1/656: write d1/d1c/d2b/d32/d36/d4d/fc2 [701820,25201] 0 2024-04-18T10:42:48.635 INFO:tasks.workunit.client.0.smithi040.stdout:7/608: dread d6/d25/d28/d2c/d3c/f6d [0,4194304] 0 2024-04-18T10:42:48.635 INFO:tasks.workunit.client.0.smithi040.stdout:2/591: mknod dd/d14/d2b/d7c/d37/cb9 0 2024-04-18T10:42:48.636 INFO:tasks.workunit.client.0.smithi040.stdout:5/553: chown d0/f25 6545 1 2024-04-18T10:42:48.636 INFO:tasks.workunit.client.0.smithi040.stdout:2/592: truncate dd/d61/f70 244847 0 2024-04-18T10:42:48.639 INFO:tasks.workunit.client.0.smithi040.stdout:8/655: fdatasync d2/d22/d49/fd7 0 2024-04-18T10:42:48.641 INFO:tasks.workunit.client.0.smithi040.stdout:1/657: symlink d1/d16/d92/dad/lee 0 2024-04-18T10:42:48.643 INFO:tasks.workunit.client.0.smithi040.stdout:5/554: dwrite d0/d21/d42/f8f [0,4194304] 0 2024-04-18T10:42:48.645 INFO:tasks.workunit.client.0.smithi040.stdout:5/555: dread - d0/d3b/d3f/d72/f89 zero size 2024-04-18T10:42:48.647 INFO:tasks.workunit.client.0.smithi040.stdout:7/609: fdatasync d6/d25/d28/f66 0 2024-04-18T10:42:48.648 INFO:tasks.workunit.client.0.smithi040.stdout:9/661: dwrite d2/f19 [0,4194304] 0 2024-04-18T10:42:48.648 INFO:tasks.workunit.client.0.smithi040.stdout:5/556: truncate d0/d78/f8b 462649 0 2024-04-18T10:42:48.649 INFO:tasks.workunit.client.0.smithi040.stdout:2/593: rename dd/f36 to dd/d61/d81/fba 0 2024-04-18T10:42:48.650 INFO:tasks.workunit.client.0.smithi040.stdout:3/655: getdents d1/d2/d4e/d58 0 2024-04-18T10:42:48.651 INFO:tasks.workunit.client.0.smithi040.stdout:5/557: write d0/d78/f8b [103849,64811] 0 2024-04-18T10:42:48.657 INFO:tasks.workunit.client.0.smithi040.stdout:1/658: rename d1/f23 to d1/db1/fef 0 2024-04-18T10:42:48.660 INFO:tasks.workunit.client.0.smithi040.stdout:2/594: mknod dd/d14/d44/d77/cbb 0 2024-04-18T10:42:48.661 INFO:tasks.workunit.client.0.smithi040.stdout:9/662: creat d2/d3/d22/d2e/d35/d40/d71/fee x:0 0 0 2024-04-18T10:42:48.661 INFO:tasks.workunit.client.0.smithi040.stdout:9/663: chown d2/d3/f65 467023 1 2024-04-18T10:42:48.662 INFO:tasks.workunit.client.0.smithi040.stdout:5/558: stat d0/d3b/d3f/d72/c8a 0 2024-04-18T10:42:48.674 INFO:tasks.workunit.client.0.smithi040.stdout:1/659: mknod d1/d9b/d75/d84/dac/cf0 0 2024-04-18T10:42:48.675 INFO:tasks.workunit.client.0.smithi040.stdout:0/665: truncate dd/df/d19/d28/db7/dd4/fbc 4117285 0 2024-04-18T10:42:48.676 INFO:tasks.workunit.client.0.smithi040.stdout:9/664: chown d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/fd7 28 1 2024-04-18T10:42:48.677 INFO:tasks.workunit.client.0.smithi040.stdout:6/618: write df/d4b/d6e/d3f/d53/d8a/fac [929640,71933] 0 2024-04-18T10:42:48.677 INFO:tasks.workunit.client.0.smithi040.stdout:0/666: chown dd/da3 352929308 1 2024-04-18T10:42:48.678 INFO:tasks.workunit.client.0.smithi040.stdout:5/559: unlink d0/d21/d42/f55 0 2024-04-18T10:42:48.680 INFO:tasks.workunit.client.0.smithi040.stdout:8/656: dread d2/d10/faf [0,4194304] 0 2024-04-18T10:42:48.682 INFO:tasks.workunit.client.0.smithi040.stdout:6/619: chown df/d4b/d6e/d3f/l4c 167988 1 2024-04-18T10:42:48.683 INFO:tasks.workunit.client.0.smithi040.stdout:1/660: symlink d1/d1c/d7b/d2e/lf1 0 2024-04-18T10:42:48.684 INFO:tasks.workunit.client.0.smithi040.stdout:5/560: chown d0/d3 1647 1 2024-04-18T10:42:48.685 INFO:tasks.workunit.client.0.smithi040.stdout:4/593: dwrite d2/d3/d4/f2e [0,4194304] 0 2024-04-18T10:42:48.685 INFO:tasks.workunit.client.0.smithi040.stdout:2/595: truncate dd/d14/d44/f73 3628730 0 2024-04-18T10:42:48.687 INFO:tasks.workunit.client.0.smithi040.stdout:9/665: truncate d2/d3/d22/f6a 121091 0 2024-04-18T10:42:48.688 INFO:tasks.workunit.client.0.smithi040.stdout:8/657: creat d2/d5/d9/d3c/d68/fe3 x:0 0 0 2024-04-18T10:42:48.689 INFO:tasks.workunit.client.0.smithi040.stdout:7/610: dwrite d6/d25/f3a [0,4194304] 0 2024-04-18T10:42:48.691 INFO:tasks.workunit.client.0.smithi040.stdout:6/620: mkdir df/d4b/d6e/d3f/d53/d8a/d95/de1 0 2024-04-18T10:42:48.692 INFO:tasks.workunit.client.0.smithi040.stdout:1/661: symlink d1/d1c/d2b/db5/dd6/lf2 0 2024-04-18T10:42:48.695 INFO:tasks.workunit.client.0.smithi040.stdout:7/611: read d6/f1f [1839428,130800] 0 2024-04-18T10:42:48.695 INFO:tasks.workunit.client.0.smithi040.stdout:8/658: mknod d2/d5/d9/d3c/ce4 0 2024-04-18T10:42:48.696 INFO:tasks.workunit.client.0.smithi040.stdout:7/612: write d6/d50/fb5 [824361,8249] 0 2024-04-18T10:42:48.696 INFO:tasks.workunit.client.0.smithi040.stdout:6/621: creat df/d4b/db7/fe2 x:0 0 0 2024-04-18T10:42:48.697 INFO:tasks.workunit.client.0.smithi040.stdout:8/659: write d2/d5/d9/d3c/f52 [2117001,101687] 0 2024-04-18T10:42:48.700 INFO:tasks.workunit.client.0.smithi040.stdout:4/594: truncate d2/d3/f68 1078054 0 2024-04-18T10:42:48.701 INFO:tasks.workunit.client.0.smithi040.stdout:1/662: mknod d1/d1c/d7b/d2e/d3e/cf3 0 2024-04-18T10:42:48.702 INFO:tasks.workunit.client.0.smithi040.stdout:4/595: write d2/d3/d4/d21/f7b [278278,73242] 0 2024-04-18T10:42:48.702 INFO:tasks.workunit.client.0.smithi040.stdout:1/663: chown d1/d1c/d7b/d2e/d3e/cf3 83 1 2024-04-18T10:42:48.705 INFO:tasks.workunit.client.0.smithi040.stdout:9/666: dread d2/d3/d22/d2e/f76 [0,4194304] 0 2024-04-18T10:42:48.705 INFO:tasks.workunit.client.0.smithi040.stdout:6/622: unlink df/d4b/d6e/cd1 0 2024-04-18T10:42:48.708 INFO:tasks.workunit.client.0.smithi040.stdout:8/660: rmdir d2/d5/d9/d3c/d5a/d94 39 2024-04-18T10:42:48.712 INFO:tasks.workunit.client.0.smithi040.stdout:1/664: mknod d1/d1c/d7b/d2d/cf4 0 2024-04-18T10:42:48.713 INFO:tasks.workunit.client.0.smithi040.stdout:1/665: dread - d1/d1c/d7b/d2e/d3e/fde zero size 2024-04-18T10:42:48.714 INFO:tasks.workunit.client.0.smithi040.stdout:9/667: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/fef x:0 0 0 2024-04-18T10:42:48.715 INFO:tasks.workunit.client.0.smithi040.stdout:8/661: fsync d2/d5/d9/d3c/f50 0 2024-04-18T10:42:48.717 INFO:tasks.workunit.client.0.smithi040.stdout:5/561: rename d0/d4e/c6e to d0/d78/d95/cb9 0 2024-04-18T10:42:48.718 INFO:tasks.workunit.client.0.smithi040.stdout:6/623: dread df/d4b/f51 [0,4194304] 0 2024-04-18T10:42:48.719 INFO:tasks.workunit.client.0.smithi040.stdout:1/666: symlink d1/d16/d92/dad/lf5 0 2024-04-18T10:42:48.720 INFO:tasks.workunit.client.0.smithi040.stdout:6/624: write df/d4b/d6a/d93/f1b [4323346,37328] 0 2024-04-18T10:42:48.721 INFO:tasks.workunit.client.0.smithi040.stdout:6/625: chown df/d76/dc2/fc8 128 1 2024-04-18T10:42:48.721 INFO:tasks.workunit.client.0.smithi040.stdout:1/667: read d1/d9b/d75/d84/f99 [441352,71636] 0 2024-04-18T10:42:48.722 INFO:tasks.workunit.client.0.smithi040.stdout:3/656: sync 2024-04-18T10:42:48.722 INFO:tasks.workunit.client.0.smithi040.stdout:9/668: unlink d2/dd/f54 0 2024-04-18T10:42:48.724 INFO:tasks.workunit.client.0.smithi040.stdout:8/662: symlink d2/d5/d9/d63/le5 0 2024-04-18T10:42:48.724 INFO:tasks.workunit.client.0.smithi040.stdout:8/663: write d2/d15/d2b/f92 [1208173,33375] 0 2024-04-18T10:42:48.726 INFO:tasks.workunit.client.0.smithi040.stdout:0/667: dread dd/df/d19/d3e/f7e [0,4194304] 0 2024-04-18T10:42:48.726 INFO:tasks.workunit.client.0.smithi040.stdout:2/596: rename dd/d14/d44 to dd/d14/d2b/dbc 0 2024-04-18T10:42:48.727 INFO:tasks.workunit.client.0.smithi040.stdout:0/668: write dd/daa/ff3 [774646,105369] 0 2024-04-18T10:42:48.728 INFO:tasks.workunit.client.0.smithi040.stdout:4/596: creat d2/d3/d4/dd/fa9 x:0 0 0 2024-04-18T10:42:48.729 INFO:tasks.workunit.client.0.smithi040.stdout:4/597: fdatasync d2/d3/d4/d1f/d29/d49/d31/fa0 0 2024-04-18T10:42:48.730 INFO:tasks.workunit.client.0.smithi040.stdout:4/598: chown d2/d3/d41/d62/d9a 272 1 2024-04-18T10:42:48.731 INFO:tasks.workunit.client.0.smithi040.stdout:4/599: write d2/d3/d4/d1f/d29/d49/d31/fa8 [88052,21916] 0 2024-04-18T10:42:48.732 INFO:tasks.workunit.client.0.smithi040.stdout:4/600: readlink d2/d3/d4/d21/da4/la5 0 2024-04-18T10:42:48.733 INFO:tasks.workunit.client.0.smithi040.stdout:4/601: write d2/d3/d4/f2e [5060664,73298] 0 2024-04-18T10:42:48.733 INFO:tasks.workunit.client.0.smithi040.stdout:6/626: symlink df/d4b/d63/db3/le3 0 2024-04-18T10:42:48.735 INFO:tasks.workunit.client.0.smithi040.stdout:6/627: write df/d4b/d6e/f1e [2126623,9557] 0 2024-04-18T10:42:48.736 INFO:tasks.workunit.client.0.smithi040.stdout:3/657: mkdir d1/d2/d4e/d58/dbe/dc1/dde 0 2024-04-18T10:42:48.737 INFO:tasks.workunit.client.0.smithi040.stdout:1/668: dread d1/d1c/d7b/d2e/f93 [0,4194304] 0 2024-04-18T10:42:48.742 INFO:tasks.workunit.client.0.smithi040.stdout:6/628: dwrite df/d4b/d6e/d3f/d53/f5e [0,4194304] 0 2024-04-18T10:42:48.745 INFO:tasks.workunit.client.0.smithi040.stdout:8/664: dwrite d2/d5/d9/d3c/d68/fb0 [0,4194304] 0 2024-04-18T10:42:48.746 INFO:tasks.workunit.client.0.smithi040.stdout:8/665: fdatasync d2/f2a 0 2024-04-18T10:42:48.747 INFO:tasks.workunit.client.0.smithi040.stdout:7/613: sync 2024-04-18T10:42:48.748 INFO:tasks.workunit.client.0.smithi040.stdout:8/666: truncate d2/d15/f58 523338 0 2024-04-18T10:42:48.748 INFO:tasks.workunit.client.0.smithi040.stdout:7/614: fdatasync d6/fbd 0 2024-04-18T10:42:48.749 INFO:tasks.workunit.client.0.smithi040.stdout:9/669: mkdir d2/df0 0 2024-04-18T10:42:48.751 INFO:tasks.workunit.client.0.smithi040.stdout:3/658: mknod d1/d7/d67/dba/cdf 0 2024-04-18T10:42:48.753 INFO:tasks.workunit.client.0.smithi040.stdout:3/659: dread d1/d2/d4e/d58/f72 [0,4194304] 0 2024-04-18T10:42:48.760 INFO:tasks.workunit.client.0.smithi040.stdout:3/660: read d1/d7/d12/f22 [2766905,79702] 0 2024-04-18T10:42:48.760 INFO:tasks.workunit.client.0.smithi040.stdout:4/602: getdents d2/d3/d41/d47/d99 0 2024-04-18T10:42:48.762 INFO:tasks.workunit.client.0.smithi040.stdout:8/667: creat d2/d5/d9/fe6 x:0 0 0 2024-04-18T10:42:48.763 INFO:tasks.workunit.client.0.smithi040.stdout:9/670: stat d2/d3/ld8 0 2024-04-18T10:42:48.765 INFO:tasks.workunit.client.0.smithi040.stdout:2/597: link dd/d14/d4a/l5d dd/d61/d8e/d98/lbd 0 2024-04-18T10:42:48.766 INFO:tasks.workunit.client.0.smithi040.stdout:1/669: truncate d1/d1c/d2b/fb9 3290081 0 2024-04-18T10:42:48.767 INFO:tasks.workunit.client.0.smithi040.stdout:1/670: truncate d1/fa5 1588830 0 2024-04-18T10:42:48.768 INFO:tasks.workunit.client.0.smithi040.stdout:0/669: link dd/df/d4e/l5e dd/df/d19/d28/db7/dd4/lfa 0 2024-04-18T10:42:48.770 INFO:tasks.workunit.client.0.smithi040.stdout:5/562: rename d0/d78/d95/d52/d5d/d9f to d0/d3/dba 0 2024-04-18T10:42:48.771 INFO:tasks.workunit.client.0.smithi040.stdout:7/615: getdents d6/d50/d79/d9a 0 2024-04-18T10:42:48.772 INFO:tasks.workunit.client.0.smithi040.stdout:9/671: symlink d2/dd/de/d7f/lf1 0 2024-04-18T10:42:48.773 INFO:tasks.workunit.client.0.smithi040.stdout:9/672: fsync d2/d7/fa 0 2024-04-18T10:42:48.773 INFO:tasks.workunit.client.0.smithi040.stdout:3/661: dread d1/f4f [0,4194304] 0 2024-04-18T10:42:48.774 INFO:tasks.workunit.client.0.smithi040.stdout:9/673: write d2/dd/f24 [177444,52260] 0 2024-04-18T10:42:48.778 INFO:tasks.workunit.client.0.smithi040.stdout:1/671: creat d1/d16/d92/dad/ff6 x:0 0 0 2024-04-18T10:42:48.780 INFO:tasks.workunit.client.0.smithi040.stdout:0/670: unlink dd/ff1 0 2024-04-18T10:42:48.787 INFO:tasks.workunit.client.0.smithi040.stdout:3/662: readlink d1/d7/l8a 0 2024-04-18T10:42:48.789 INFO:tasks.workunit.client.0.smithi040.stdout:2/598: creat dd/d14/d2b/dbc/d5f/d82/da6/db1/fbe x:0 0 0 2024-04-18T10:42:48.791 INFO:tasks.workunit.client.0.smithi040.stdout:9/674: chown d2/d3/d97/lb8 4160 1 2024-04-18T10:42:48.792 INFO:tasks.workunit.client.0.smithi040.stdout:1/672: dread d1/d1c/d7b/d2d/f91 [0,4194304] 0 2024-04-18T10:42:48.798 INFO:tasks.workunit.client.0.smithi040.stdout:3/663: rmdir d1/d7/d67/dc5/d91 39 2024-04-18T10:42:48.801 INFO:tasks.workunit.client.0.smithi040.stdout:9/675: rename d2/d3/f4a to d2/d3/d22/d2e/d35/d40/d85/ff2 0 2024-04-18T10:42:48.802 INFO:tasks.workunit.client.0.smithi040.stdout:7/616: truncate d6/f1f 1583410 0 2024-04-18T10:42:48.802 INFO:tasks.workunit.client.0.smithi040.stdout:9/676: chown d2/d3/d70/l83 50468397 1 2024-04-18T10:42:48.804 INFO:tasks.workunit.client.0.smithi040.stdout:0/671: fdatasync dd/df/d4e/f55 0 2024-04-18T10:42:48.805 INFO:tasks.workunit.client.0.smithi040.stdout:5/563: creat d0/d3/d6b/fbb x:0 0 0 2024-04-18T10:42:48.806 INFO:tasks.workunit.client.0.smithi040.stdout:8/668: link d2/d10/c3e d2/ce7 0 2024-04-18T10:42:48.809 INFO:tasks.workunit.client.0.smithi040.stdout:0/672: chown dd/df/d19/d28/d3a/f4d 1895716 1 2024-04-18T10:42:48.811 INFO:tasks.workunit.client.0.smithi040.stdout:8/669: read - d2/d22/d80/da2/fd8 zero size 2024-04-18T10:42:48.812 INFO:tasks.workunit.client.0.smithi040.stdout:1/673: dread d1/d1c/d2b/d32/d36/f38 [0,4194304] 0 2024-04-18T10:42:48.813 INFO:tasks.workunit.client.0.smithi040.stdout:9/677: dwrite d2/d3/f6e [4194304,4194304] 0 2024-04-18T10:42:48.815 INFO:tasks.workunit.client.0.smithi040.stdout:7/617: truncate d6/d25/f3a 3124513 0 2024-04-18T10:42:48.815 INFO:tasks.workunit.client.0.smithi040.stdout:0/673: symlink dd/df/d19/lfb 0 2024-04-18T10:42:48.817 INFO:tasks.workunit.client.0.smithi040.stdout:8/670: symlink d2/d5/d9/d3c/le8 0 2024-04-18T10:42:48.817 INFO:tasks.workunit.client.0.smithi040.stdout:3/664: dwrite d1/d7/d12/f9d [0,4194304] 0 2024-04-18T10:42:48.818 INFO:tasks.workunit.client.0.smithi040.stdout:1/674: chown d1/d1c/d2b/d32/d35/fa6 266 1 2024-04-18T10:42:48.819 INFO:tasks.workunit.client.0.smithi040.stdout:7/618: write d6/d3e/f69 [2013810,17025] 0 2024-04-18T10:42:48.822 INFO:tasks.workunit.client.0.smithi040.stdout:8/671: write d2/d5/d9/f29 [3233768,82519] 0 2024-04-18T10:42:48.826 INFO:tasks.workunit.client.0.smithi040.stdout:5/564: dwrite d0/f1b [4194304,4194304] 0 2024-04-18T10:42:48.829 INFO:tasks.workunit.client.0.smithi040.stdout:0/674: dwrite dd/df/d4e/f55 [0,4194304] 0 2024-04-18T10:42:48.829 INFO:tasks.workunit.client.0.smithi040.stdout:3/665: symlink d1/d2/d4e/d58/dbe/le0 0 2024-04-18T10:42:48.831 INFO:tasks.workunit.client.0.smithi040.stdout:8/672: mkdir d2/d5/d9/d3c/de9 0 2024-04-18T10:42:48.831 INFO:tasks.workunit.client.0.smithi040.stdout:1/675: dread d1/d1c/f56 [4194304,4194304] 0 2024-04-18T10:42:48.831 INFO:tasks.workunit.client.0.smithi040.stdout:9/678: mkdir d2/d3/d22/d2e/d35/daf/dc1/d46/df3 0 2024-04-18T10:42:48.835 INFO:tasks.workunit.client.0.smithi040.stdout:8/673: chown d2/d5/ce 345289 1 2024-04-18T10:42:48.836 INFO:tasks.workunit.client.0.smithi040.stdout:7/619: creat d6/d25/d28/d2c/d2d/d47/d5c/da2/db6/fc5 x:0 0 0 2024-04-18T10:42:48.837 INFO:tasks.workunit.client.0.smithi040.stdout:1/676: creat d1/d1c/d7b/d2e/d3e/ff7 x:0 0 0 2024-04-18T10:42:48.837 INFO:tasks.workunit.client.0.smithi040.stdout:6/629: sync 2024-04-18T10:42:48.838 INFO:tasks.workunit.client.0.smithi040.stdout:6/630: write df/d4b/d6a/d93/fd8 [3707602,36163] 0 2024-04-18T10:42:48.840 INFO:tasks.workunit.client.0.smithi040.stdout:5/565: creat d0/d3b/fbc x:0 0 0 2024-04-18T10:42:48.842 INFO:tasks.workunit.client.0.smithi040.stdout:6/631: chown df/d4b/d6e/c50 4320 1 2024-04-18T10:42:48.843 INFO:tasks.workunit.client.0.smithi040.stdout:7/620: symlink d6/d50/d79/da8/lc6 0 2024-04-18T10:42:48.844 INFO:tasks.workunit.client.0.smithi040.stdout:1/677: symlink d1/d1c/lf8 0 2024-04-18T10:42:48.845 INFO:tasks.workunit.client.0.smithi040.stdout:9/679: rename d2/d7/ca2 to d2/d3/cf4 0 2024-04-18T10:42:48.847 INFO:tasks.workunit.client.0.smithi040.stdout:5/566: link d0/d3b/fbc d0/d3b/d3f/fbd 0 2024-04-18T10:42:48.848 INFO:tasks.workunit.client.0.smithi040.stdout:1/678: chown d1/d1c/d7b/d2e/d3e/cf3 65572565 1 2024-04-18T10:42:48.848 INFO:tasks.workunit.client.0.smithi040.stdout:8/674: rename d2/d22/d80/da2/fdb to d2/d22/d80/fea 0 2024-04-18T10:42:48.849 INFO:tasks.workunit.client.0.smithi040.stdout:5/567: creat d0/d21/fbe x:0 0 0 2024-04-18T10:42:48.850 INFO:tasks.workunit.client.0.smithi040.stdout:6/632: dwrite df/d4b/d6e/d3f/d53/d8a/fdb [0,4194304] 0 2024-04-18T10:42:48.852 INFO:tasks.workunit.client.0.smithi040.stdout:9/680: getdents d2/d5b/d6f/d80 0 2024-04-18T10:42:48.862 INFO:tasks.workunit.client.0.smithi040.stdout:6/633: creat df/d4b/d6a/d93/fe4 x:0 0 0 2024-04-18T10:42:48.865 INFO:tasks.workunit.client.0.smithi040.stdout:3/666: write d1/d7/d12/d7b/fb3 [2067170,128217] 0 2024-04-18T10:42:48.867 INFO:tasks.workunit.client.0.smithi040.stdout:5/568: dwrite d0/d21/fb8 [0,4194304] 0 2024-04-18T10:42:48.867 INFO:tasks.workunit.client.0.smithi040.stdout:6/634: unlink df/d4b/d6e/d3f/d53/d8a/cd2 0 2024-04-18T10:42:48.871 INFO:tasks.workunit.client.0.smithi040.stdout:6/635: mkdir df/d4b/db7/dcc/de5 0 2024-04-18T10:42:48.872 INFO:tasks.workunit.client.0.smithi040.stdout:3/667: truncate d1/d7/d3a/f3d 226586 0 2024-04-18T10:42:48.873 INFO:tasks.workunit.client.0.smithi040.stdout:9/681: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/ff5 x:0 0 0 2024-04-18T10:42:48.877 INFO:tasks.workunit.client.0.smithi040.stdout:0/675: dread dd/df/d4e/f50 [0,4194304] 0 2024-04-18T10:42:48.878 INFO:tasks.workunit.client.0.smithi040.stdout:3/668: creat d1/d7/d12/fe1 x:0 0 0 2024-04-18T10:42:48.881 INFO:tasks.workunit.client.0.smithi040.stdout:4/603: sync 2024-04-18T10:42:48.881 INFO:tasks.workunit.client.0.smithi040.stdout:3/669: creat d1/d2/d16/fe2 x:0 0 0 2024-04-18T10:42:48.882 INFO:tasks.workunit.client.0.smithi040.stdout:7/621: dread d6/d3e/d73/f76 [0,4194304] 0 2024-04-18T10:42:48.883 INFO:tasks.workunit.client.0.smithi040.stdout:9/682: dread d2/d3/d22/d2e/d35/d40/d71/f84 [0,4194304] 0 2024-04-18T10:42:48.884 INFO:tasks.workunit.client.0.smithi040.stdout:4/604: mkdir d2/d3/d4/d1f/daa 0 2024-04-18T10:42:48.889 INFO:tasks.workunit.client.0.smithi040.stdout:4/605: read - d2/d3/d4/d21/d28/d3f/f79 zero size 2024-04-18T10:42:48.889 INFO:tasks.workunit.client.0.smithi040.stdout:0/676: dwrite dd/df/d19/d28/d3a/d42/f52 [0,4194304] 0 2024-04-18T10:42:48.892 INFO:tasks.workunit.client.0.smithi040.stdout:9/683: symlink d2/d3/d22/d2e/d35/daf/dc2/lf6 0 2024-04-18T10:42:48.893 INFO:tasks.workunit.client.0.smithi040.stdout:8/675: dread d2/d10/d14/f47 [0,4194304] 0 2024-04-18T10:42:48.893 INFO:tasks.workunit.client.0.smithi040.stdout:0/677: readlink dd/df/l4b 0 2024-04-18T10:42:48.897 INFO:tasks.workunit.client.0.smithi040.stdout:7/622: dread d6/d25/d28/d2c/f3d [0,4194304] 0 2024-04-18T10:42:48.898 INFO:tasks.workunit.client.0.smithi040.stdout:0/678: fdatasync dd/df/d19/f8c 0 2024-04-18T10:42:48.900 INFO:tasks.workunit.client.0.smithi040.stdout:3/670: dwrite d1/d7/d67/dc5/d91/fda [0,4194304] 0 2024-04-18T10:42:48.903 INFO:tasks.workunit.client.0.smithi040.stdout:4/606: rename d2/d3/d41/d62/f86 to d2/d3/d4/fab 0 2024-04-18T10:42:48.904 INFO:tasks.workunit.client.0.smithi040.stdout:5/569: dwrite d0/d21/d42/f7d [0,4194304] 0 2024-04-18T10:42:48.905 INFO:tasks.workunit.client.0.smithi040.stdout:6/636: dwrite df/d4b/f65 [0,4194304] 0 2024-04-18T10:42:48.906 INFO:tasks.workunit.client.0.smithi040.stdout:0/679: chown dd/df/d19/d28/d3a/f9d 6525909 1 2024-04-18T10:42:48.906 INFO:tasks.workunit.client.0.smithi040.stdout:3/671: fsync d1/d7/d67/dc5/d3b/fad 0 2024-04-18T10:42:48.907 INFO:tasks.workunit.client.0.smithi040.stdout:2/599: sync 2024-04-18T10:42:48.908 INFO:tasks.workunit.client.0.smithi040.stdout:5/570: write d0/f35 [1645705,36453] 0 2024-04-18T10:42:48.909 INFO:tasks.workunit.client.0.smithi040.stdout:7/623: symlink d6/d25/d28/d2c/d2d/d47/d55/d58/lc7 0 2024-04-18T10:42:48.910 INFO:tasks.workunit.client.0.smithi040.stdout:0/680: chown dd/df/d19/d28/d3a/d42/fcb 600280283 1 2024-04-18T10:42:48.911 INFO:tasks.workunit.client.0.smithi040.stdout:9/684: rename d2/d3/d22/d2e/d35/d40/f5e to d2/d3/d22/db3/ff7 0 2024-04-18T10:42:48.912 INFO:tasks.workunit.client.0.smithi040.stdout:7/624: read d6/d25/f46 [2149278,61580] 0 2024-04-18T10:42:48.913 INFO:tasks.workunit.client.0.smithi040.stdout:4/607: symlink d2/d3/d41/d47/d6f/lac 0 2024-04-18T10:42:48.914 INFO:tasks.workunit.client.0.smithi040.stdout:7/625: chown d6/d25/d28/d2c/d3c 7597 1 2024-04-18T10:42:48.916 INFO:tasks.workunit.client.0.smithi040.stdout:2/600: creat dd/d14/d2b/fbf x:0 0 0 2024-04-18T10:42:48.916 INFO:tasks.workunit.client.0.smithi040.stdout:9/685: dread - d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/fdc zero size 2024-04-18T10:42:48.918 INFO:tasks.workunit.client.0.smithi040.stdout:5/571: unlink d0/d4e/f29 0 2024-04-18T10:42:48.918 INFO:tasks.workunit.client.0.smithi040.stdout:7/626: fdatasync d6/d3e/d73/fa9 0 2024-04-18T10:42:48.918 INFO:tasks.workunit.client.0.smithi040.stdout:3/672: dwrite d1/d2/d4e/d58/fd4 [0,4194304] 0 2024-04-18T10:42:48.920 INFO:tasks.workunit.client.0.smithi040.stdout:0/681: creat dd/df/d19/d3e/ffc x:0 0 0 2024-04-18T10:42:48.921 INFO:tasks.workunit.client.0.smithi040.stdout:6/637: link df/d76/fa9 df/d4b/d6a/fe6 0 2024-04-18T10:42:48.922 INFO:tasks.workunit.client.0.smithi040.stdout:7/627: truncate d6/fbd 127255 0 2024-04-18T10:42:48.922 INFO:tasks.workunit.client.0.smithi040.stdout:3/673: chown d1/d2/d16/c47 57 1 2024-04-18T10:42:48.924 INFO:tasks.workunit.client.0.smithi040.stdout:4/608: dwrite d2/f2c [0,4194304] 0 2024-04-18T10:42:48.925 INFO:tasks.workunit.client.0.smithi040.stdout:3/674: chown d1/d2 1405666 1 2024-04-18T10:42:48.925 INFO:tasks.workunit.client.0.smithi040.stdout:5/572: readlink d0/d3/dba/la1 0 2024-04-18T10:42:48.926 INFO:tasks.workunit.client.0.smithi040.stdout:2/601: creat dd/d14/d2b/dbc/d5f/d82/d72/fc0 x:0 0 0 2024-04-18T10:42:48.926 INFO:tasks.workunit.client.0.smithi040.stdout:7/628: chown d6/d50/d79/d90/fa5 28906318 1 2024-04-18T10:42:48.929 INFO:tasks.workunit.client.0.smithi040.stdout:6/638: truncate df/d4b/d63/dbb/fd9 421548 0 2024-04-18T10:42:48.931 INFO:tasks.workunit.client.0.smithi040.stdout:4/609: symlink d2/d3/d4/dd/d4f/lad 0 2024-04-18T10:42:48.931 INFO:tasks.workunit.client.0.smithi040.stdout:1/679: sync 2024-04-18T10:42:48.932 INFO:tasks.workunit.client.0.smithi040.stdout:9/686: dwrite d2/d3/d22/d2e/fcc [0,4194304] 0 2024-04-18T10:42:48.934 INFO:tasks.workunit.client.0.smithi040.stdout:7/629: read d6/d25/d28/d2c/f33 [1089071,90129] 0 2024-04-18T10:42:48.936 INFO:tasks.workunit.client.0.smithi040.stdout:6/639: write df/d4b/d63/db3/fcd [197688,79895] 0 2024-04-18T10:42:48.937 INFO:tasks.workunit.client.0.smithi040.stdout:1/680: unlink d1/d1c/fe5 0 2024-04-18T10:42:48.938 INFO:tasks.workunit.client.0.smithi040.stdout:0/682: link dd/d62/c8a dd/df/d19/d3e/cfd 0 2024-04-18T10:42:48.941 INFO:tasks.workunit.client.0.smithi040.stdout:5/573: dread d0/d21/fb8 [0,4194304] 0 2024-04-18T10:42:48.941 INFO:tasks.workunit.client.0.smithi040.stdout:3/675: dwrite d1/d7/d67/f76 [0,4194304] 0 2024-04-18T10:42:48.944 INFO:tasks.workunit.client.0.smithi040.stdout:6/640: dread df/f55 [0,4194304] 0 2024-04-18T10:42:48.945 INFO:tasks.workunit.client.0.smithi040.stdout:1/681: getdents d1/db1 0 2024-04-18T10:42:48.946 INFO:tasks.workunit.client.0.smithi040.stdout:7/630: rename d6/d25/d28/d2c/d2d/d47/la4 to d6/d25/d28/d2c/d2d/lc8 0 2024-04-18T10:42:48.949 INFO:tasks.workunit.client.0.smithi040.stdout:8/676: truncate d2/d15/d78/f8d 2459815 0 2024-04-18T10:42:48.949 INFO:tasks.workunit.client.0.smithi040.stdout:6/641: chown df/d4b/d63/l9d 366907376 1 2024-04-18T10:42:48.950 INFO:tasks.workunit.client.0.smithi040.stdout:9/687: dwrite d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/fd7 [0,4194304] 0 2024-04-18T10:42:48.951 INFO:tasks.workunit.client.0.smithi040.stdout:5/574: mknod d0/d78/d95/db7/cbf 0 2024-04-18T10:42:48.951 INFO:tasks.workunit.client.0.smithi040.stdout:7/631: chown d6/d25/d28/d2c/d3c/lb7 22 1 2024-04-18T10:42:48.953 INFO:tasks.workunit.client.0.smithi040.stdout:6/642: chown df/d76/d91/fa1 31282 1 2024-04-18T10:42:48.954 INFO:tasks.workunit.client.0.smithi040.stdout:0/683: dread dd/d91/fbf [0,4194304] 0 2024-04-18T10:42:48.955 INFO:tasks.workunit.client.0.smithi040.stdout:3/676: dwrite d1/d7/d3a/f50 [0,4194304] 0 2024-04-18T10:42:48.961 INFO:tasks.workunit.client.0.smithi040.stdout:0/684: dread dd/df/d19/d28/d3a/d42/fae [0,4194304] 0 2024-04-18T10:42:48.965 INFO:tasks.workunit.client.0.smithi040.stdout:1/682: link d1/f4 d1/d1c/d7b/d2e/d3e/d85/ff9 0 2024-04-18T10:42:48.970 INFO:tasks.workunit.client.0.smithi040.stdout:6/643: dwrite df/d4b/d63/dbb/fd9 [0,4194304] 0 2024-04-18T10:42:48.970 INFO:tasks.workunit.client.0.smithi040.stdout:7/632: dwrite d6/d50/d79/da8/dad/fc2 [0,4194304] 0 2024-04-18T10:42:48.973 INFO:tasks.workunit.client.0.smithi040.stdout:3/677: dwrite d1/d2/d4e/f7c [0,4194304] 0 2024-04-18T10:42:48.974 INFO:tasks.workunit.client.0.smithi040.stdout:0/685: truncate dd/df/d19/d28/d3a/d42/f72 380615 0 2024-04-18T10:42:48.979 INFO:tasks.workunit.client.0.smithi040.stdout:3/678: creat d1/d2/d4e/d58/dbe/dc1/dc2/fe3 x:0 0 0 2024-04-18T10:42:48.980 INFO:tasks.workunit.client.0.smithi040.stdout:2/602: truncate dd/d14/f47 1855488 0 2024-04-18T10:42:48.981 INFO:tasks.workunit.client.0.smithi040.stdout:2/603: write dd/d14/d2b/dbc/d5f/d82/da6/d52/f94 [938931,65583] 0 2024-04-18T10:42:48.982 INFO:tasks.workunit.client.0.smithi040.stdout:7/633: creat d6/d25/d28/d2c/d2d/d47/d55/d58/fc9 x:0 0 0 2024-04-18T10:42:48.986 INFO:tasks.workunit.client.0.smithi040.stdout:0/686: rename dd/df/d4e/f55 to dd/df/d19/d3e/df4/ffe 0 2024-04-18T10:42:48.987 INFO:tasks.workunit.client.0.smithi040.stdout:6/644: link df/d4b/d6e/fad df/d4b/db7/dcc/de5/fe7 0 2024-04-18T10:42:48.987 INFO:tasks.workunit.client.0.smithi040.stdout:3/679: chown d1/d2/d16/c33 1 1 2024-04-18T10:42:48.987 INFO:tasks.workunit.client.0.smithi040.stdout:6/645: fsync df/d76/db9/fd0 0 2024-04-18T10:42:48.989 INFO:tasks.workunit.client.0.smithi040.stdout:3/680: truncate d1/d7/d67/dba/fc8 558065 0 2024-04-18T10:42:48.990 INFO:tasks.workunit.client.0.smithi040.stdout:2/604: mkdir dd/d14/d2b/d7c/d37/da3/dc1 0 2024-04-18T10:42:48.992 INFO:tasks.workunit.client.0.smithi040.stdout:3/681: creat d1/d2/d4e/d58/dbe/dc1/dc2/fe4 x:0 0 0 2024-04-18T10:42:48.995 INFO:tasks.workunit.client.0.smithi040.stdout:6/646: mkdir df/de8 0 2024-04-18T10:42:48.995 INFO:tasks.workunit.client.0.smithi040.stdout:6/647: readlink df/d76/l7b 0 2024-04-18T10:42:48.996 INFO:tasks.workunit.client.0.smithi040.stdout:2/605: unlink dd/d14/d2b/dbc/d5f/ca7 0 2024-04-18T10:42:48.997 INFO:tasks.workunit.client.0.smithi040.stdout:2/606: chown dd/d14/d2b 38 1 2024-04-18T10:42:48.997 INFO:tasks.workunit.client.0.smithi040.stdout:3/682: unlink d1/d2/d16/l38 0 2024-04-18T10:42:48.997 INFO:tasks.workunit.client.0.smithi040.stdout:8/677: dread d2/d5/d9/fb [0,4194304] 0 2024-04-18T10:42:48.998 INFO:tasks.workunit.client.0.smithi040.stdout:7/634: link d6/d25/c26 d6/d50/d79/da8/dad/cca 0 2024-04-18T10:42:49.000 INFO:tasks.workunit.client.0.smithi040.stdout:6/648: symlink df/d4b/d6e/d3f/le9 0 2024-04-18T10:42:49.001 INFO:tasks.workunit.client.0.smithi040.stdout:6/649: fdatasync df/d76/db9/dbd/fbf 0 2024-04-18T10:42:49.002 INFO:tasks.workunit.client.0.smithi040.stdout:6/650: write df/d4b/d6e/d3f/d53/fc0 [1416392,98466] 0 2024-04-18T10:42:49.004 INFO:tasks.workunit.client.0.smithi040.stdout:7/635: unlink d6/d25/d28/f42 0 2024-04-18T10:42:49.006 INFO:tasks.workunit.client.0.smithi040.stdout:2/607: rename dd/c20 to dd/d14/d2b/d7c/d37/cc2 0 2024-04-18T10:42:49.008 INFO:tasks.workunit.client.0.smithi040.stdout:4/610: dread d2/d3/d4/d21/d28/d3f/f39 [4194304,4194304] 0 2024-04-18T10:42:49.014 INFO:tasks.workunit.client.0.smithi040.stdout:2/608: creat dd/d14/d2b/fc3 x:0 0 0 2024-04-18T10:42:49.014 INFO:tasks.workunit.client.0.smithi040.stdout:1/683: fsync d1/d1c/d7b/d2e/d3e/d85/ff9 0 2024-04-18T10:42:49.016 INFO:tasks.workunit.client.0.smithi040.stdout:9/688: write d2/d3/d22/f6a [440470,28047] 0 2024-04-18T10:42:49.019 INFO:tasks.workunit.client.0.smithi040.stdout:5/575: dread d0/d78/d95/f5a [0,4194304] 0 2024-04-18T10:42:49.019 INFO:tasks.workunit.client.0.smithi040.stdout:2/609: mknod dd/d14/d2b/dbc/d5f/cc4 0 2024-04-18T10:42:49.041 INFO:tasks.workunit.client.0.smithi040.stdout:5/576: chown d0/d3b/la7 2791224 1 2024-04-18T10:42:49.041 INFO:tasks.workunit.client.0.smithi040.stdout:6/651: creat df/d4b/d6e/d3f/d53/fea x:0 0 0 2024-04-18T10:42:49.041 INFO:tasks.workunit.client.0.smithi040.stdout:1/684: creat d1/d9b/d75/d84/dac/dda/de0/ffa x:0 0 0 2024-04-18T10:42:49.043 INFO:tasks.workunit.client.0.smithi040.stdout:6/652: stat df/d4b/d6e/f28 0 2024-04-18T10:42:49.043 INFO:tasks.workunit.client.0.smithi040.stdout:1/685: fsync d1/d1c/d7b/d2e/d3e/f9f 0 2024-04-18T10:42:49.045 INFO:tasks.workunit.client.0.smithi040.stdout:1/686: fsync d1/f30 0 2024-04-18T10:42:49.046 INFO:tasks.workunit.client.0.smithi040.stdout:6/653: truncate df/d76/f84 717270 0 2024-04-18T10:42:49.050 INFO:tasks.workunit.client.0.smithi040.stdout:2/610: rmdir dd/d14/d2b/dbc/d5f/d82/da6/d52 39 2024-04-18T10:42:49.052 INFO:tasks.workunit.client.0.smithi040.stdout:0/687: dread dd/df/d19/d3e/d77/f8e [0,4194304] 0 2024-04-18T10:42:49.052 INFO:tasks.workunit.client.0.smithi040.stdout:2/611: stat f9 0 2024-04-18T10:42:49.053 INFO:tasks.workunit.client.0.smithi040.stdout:5/577: unlink d0/l4 0 2024-04-18T10:42:49.055 INFO:tasks.workunit.client.0.smithi040.stdout:6/654: mkdir df/d4b/deb 0 2024-04-18T10:42:49.056 INFO:tasks.workunit.client.0.smithi040.stdout:3/683: dwrite d1/d7/d28/d81/f85 [0,4194304] 0 2024-04-18T10:42:49.058 INFO:tasks.workunit.client.0.smithi040.stdout:2/612: dread - dd/d14/d2b/dbc/f99 zero size 2024-04-18T10:42:49.059 INFO:tasks.workunit.client.0.smithi040.stdout:8/678: dwrite d2/d5/d9/d3c/d5a/f21 [0,4194304] 0 2024-04-18T10:42:49.061 INFO:tasks.workunit.client.0.smithi040.stdout:7/636: dwrite d6/f22 [0,4194304] 0 2024-04-18T10:42:49.063 INFO:tasks.workunit.client.0.smithi040.stdout:0/688: dread dd/df/d4e/f7d [0,4194304] 0 2024-04-18T10:42:49.063 INFO:tasks.workunit.client.0.smithi040.stdout:6/655: write df/d4b/d63/f7c [391255,57854] 0 2024-04-18T10:42:49.067 INFO:tasks.workunit.client.0.smithi040.stdout:1/687: dwrite d1/d1c/d7b/d2e/da4/fbd [0,4194304] 0 2024-04-18T10:42:49.068 INFO:tasks.workunit.client.0.smithi040.stdout:9/689: dread d2/d3/f8c [0,4194304] 0 2024-04-18T10:42:49.069 INFO:tasks.workunit.client.0.smithi040.stdout:7/637: symlink d6/d3e/lcb 0 2024-04-18T10:42:49.074 INFO:tasks.workunit.client.0.smithi040.stdout:7/638: write d6/d50/d79/d90/fa5 [3227527,20029] 0 2024-04-18T10:42:49.074 INFO:tasks.workunit.client.0.smithi040.stdout:4/611: sync 2024-04-18T10:42:49.074 INFO:tasks.workunit.client.0.smithi040.stdout:6/656: symlink df/d4b/d99/lec 0 2024-04-18T10:42:49.075 INFO:tasks.workunit.client.0.smithi040.stdout:3/684: dwrite d1/d2/d3c/f83 [0,4194304] 0 2024-04-18T10:42:49.077 INFO:tasks.workunit.client.0.smithi040.stdout:9/690: symlink d2/d3/d22/d2e/d35/daf/dc2/lf8 0 2024-04-18T10:42:49.078 INFO:tasks.workunit.client.0.smithi040.stdout:5/578: dwrite d0/d3b/d3f/f40 [0,4194304] 0 2024-04-18T10:42:49.078 INFO:tasks.workunit.client.0.smithi040.stdout:2/613: getdents dd/d14/d2b/dbc/d5f/d82/da6 0 2024-04-18T10:42:49.078 INFO:tasks.workunit.client.0.smithi040.stdout:1/688: write d1/d1c/d2b/db5/dd6/fdd [48725,103217] 0 2024-04-18T10:42:49.080 INFO:tasks.workunit.client.0.smithi040.stdout:3/685: chown d1/d7/d28/c7d 478 1 2024-04-18T10:42:49.081 INFO:tasks.workunit.client.0.smithi040.stdout:6/657: write df/d76/dc2/dce/fda [925713,74970] 0 2024-04-18T10:42:49.081 INFO:tasks.workunit.client.0.smithi040.stdout:7/639: chown d6/d25/d28/d2c/d2d/lc8 6233763 1 2024-04-18T10:42:49.081 INFO:tasks.workunit.client.0.smithi040.stdout:0/689: read dd/df/f44 [718820,52654] 0 2024-04-18T10:42:49.082 INFO:tasks.workunit.client.0.smithi040.stdout:4/612: symlink d2/d3/d4/d1f/d29/d49/d31/lae 0 2024-04-18T10:42:49.083 INFO:tasks.workunit.client.0.smithi040.stdout:2/614: chown dd/d14/d4a/d54/faa 1052117824 1 2024-04-18T10:42:49.083 INFO:tasks.workunit.client.0.smithi040.stdout:1/689: write d1/d1c/d2b/d32/f64 [3075740,27724] 0 2024-04-18T10:42:49.084 INFO:tasks.workunit.client.0.smithi040.stdout:7/640: write d6/d3e/f69 [5160729,91226] 0 2024-04-18T10:42:49.085 INFO:tasks.workunit.client.0.smithi040.stdout:4/613: read d2/d3/f59 [3885089,50238] 0 2024-04-18T10:42:49.087 INFO:tasks.workunit.client.0.smithi040.stdout:7/641: write d6/d25/d28/f2f [2031815,86410] 0 2024-04-18T10:42:49.088 INFO:tasks.workunit.client.0.smithi040.stdout:4/614: write d2/d3/d4/d21/f7b [548194,50455] 0 2024-04-18T10:42:49.089 INFO:tasks.workunit.client.0.smithi040.stdout:3/686: creat d1/d2/d4e/d58/db4/fe5 x:0 0 0 2024-04-18T10:42:49.090 INFO:tasks.workunit.client.0.smithi040.stdout:6/658: mkdir df/d4b/ded 0 2024-04-18T10:42:49.090 INFO:tasks.workunit.client.0.smithi040.stdout:4/615: dread d2/d3/d4/d1f/d29/d49/d31/fa8 [0,4194304] 0 2024-04-18T10:42:49.092 INFO:tasks.workunit.client.0.smithi040.stdout:9/691: mkdir d2/d3/d22/d2e/d35/daf/dc1/d46/d44/df9 0 2024-04-18T10:42:49.093 INFO:tasks.workunit.client.0.smithi040.stdout:0/690: dread dd/d62/fe9 [0,4194304] 0 2024-04-18T10:42:49.093 INFO:tasks.workunit.client.0.smithi040.stdout:2/615: mkdir dd/d14/d2b/dbc/d5f/d82/da6/db1/dc5 0 2024-04-18T10:42:49.096 INFO:tasks.workunit.client.0.smithi040.stdout:5/579: rename d0/d21/d42/d76/cad to d0/d3/d6b/d7b/cc0 0 2024-04-18T10:42:49.098 INFO:tasks.workunit.client.0.smithi040.stdout:3/687: write d1/d2/d16/fbb [406409,100089] 0 2024-04-18T10:42:49.099 INFO:tasks.workunit.client.0.smithi040.stdout:6/659: rmdir df/d4b/d6e/d3f/d53/d8a/d95/da7 39 2024-04-18T10:42:49.101 INFO:tasks.workunit.client.0.smithi040.stdout:4/616: fdatasync d2/d3/d4/dd/d6d/fa1 0 2024-04-18T10:42:49.103 INFO:tasks.workunit.client.0.smithi040.stdout:4/617: stat d2/d3/d4/d1f/d29/d49/l60 0 2024-04-18T10:42:49.103 INFO:tasks.workunit.client.0.smithi040.stdout:2/616: symlink dd/d61/d81/lc6 0 2024-04-18T10:42:49.105 INFO:tasks.workunit.client.0.smithi040.stdout:9/692: rename d2/d3/f8c to d2/d3/d22/d2e/d35/daf/dc1/ffa 0 2024-04-18T10:42:49.106 INFO:tasks.workunit.client.0.smithi040.stdout:6/660: dwrite df/d76/d91/f92 [0,4194304] 0 2024-04-18T10:42:49.107 INFO:tasks.workunit.client.0.smithi040.stdout:3/688: creat d1/d2/d4e/d58/db4/fe6 x:0 0 0 2024-04-18T10:42:49.108 INFO:tasks.workunit.client.0.smithi040.stdout:3/689: chown d1/d7/db2/dc0 890 1 2024-04-18T10:42:49.109 INFO:tasks.workunit.client.0.smithi040.stdout:6/661: write df/d4b/d6e/d3f/d53/d8a/fdb [1653822,5312] 0 2024-04-18T10:42:49.109 INFO:tasks.workunit.client.0.smithi040.stdout:4/618: symlink d2/d1a/laf 0 2024-04-18T10:42:49.111 INFO:tasks.workunit.client.0.smithi040.stdout:2/617: write dd/d14/f22 [1076735,85085] 0 2024-04-18T10:42:49.112 INFO:tasks.workunit.client.0.smithi040.stdout:7/642: creat d6/d25/d28/dac/d64/fcc x:0 0 0 2024-04-18T10:42:49.112 INFO:tasks.workunit.client.0.smithi040.stdout:4/619: chown d2/d3/d41/d47/da2 6 1 2024-04-18T10:42:49.114 INFO:tasks.workunit.client.0.smithi040.stdout:5/580: unlink d0/d21/d42/d76/c91 0 2024-04-18T10:42:49.115 INFO:tasks.workunit.client.0.smithi040.stdout:9/693: write d2/d3/d22/f3a [1929928,26478] 0 2024-04-18T10:42:49.115 INFO:tasks.workunit.client.0.smithi040.stdout:8/679: dwrite d2/d10/d14/f47 [0,4194304] 0 2024-04-18T10:42:49.116 INFO:tasks.workunit.client.0.smithi040.stdout:9/694: chown d2/d3/d22/d2e/d35/daf/dc1/d46/d86 3747 1 2024-04-18T10:42:49.117 INFO:tasks.workunit.client.0.smithi040.stdout:9/695: chown d2/d3/d22/d2e/d35/daf/dc1/d46 428141530 1 2024-04-18T10:42:49.119 INFO:tasks.workunit.client.0.smithi040.stdout:6/662: creat df/d76/dc2/fee x:0 0 0 2024-04-18T10:42:49.119 INFO:tasks.workunit.client.0.smithi040.stdout:6/663: chown df/d4b/d6a/d93/c36 3 1 2024-04-18T10:42:49.120 INFO:tasks.workunit.client.0.smithi040.stdout:2/618: creat dd/d61/d81/fc7 x:0 0 0 2024-04-18T10:42:49.121 INFO:tasks.workunit.client.0.smithi040.stdout:7/643: fsync d6/d25/d28/d2c/f3d 0 2024-04-18T10:42:49.122 INFO:tasks.workunit.client.0.smithi040.stdout:4/620: write d2/d3/d2f/f35 [2453411,28425] 0 2024-04-18T10:42:49.123 INFO:tasks.workunit.client.0.smithi040.stdout:1/690: link d1/d1c/d7b/c78 d1/d1c/d2b/d32/d36/d4d/cfb 0 2024-04-18T10:42:49.125 INFO:tasks.workunit.client.0.smithi040.stdout:8/680: creat d2/d2c/feb x:0 0 0 2024-04-18T10:42:49.126 INFO:tasks.workunit.client.0.smithi040.stdout:1/691: write d1/d1c/d7b/d2e/d3e/fde [272233,130444] 0 2024-04-18T10:42:49.128 INFO:tasks.workunit.client.0.smithi040.stdout:9/696: unlink d2/d7/fa 0 2024-04-18T10:42:49.129 INFO:tasks.workunit.client.0.smithi040.stdout:6/664: readlink df/l2b 0 2024-04-18T10:42:49.130 INFO:tasks.workunit.client.0.smithi040.stdout:4/621: dwrite d2/d3/d2f/f56 [0,4194304] 0 2024-04-18T10:42:49.130 INFO:tasks.workunit.client.0.smithi040.stdout:2/619: creat dd/d14/d2b/d7c/d37/d38/fc8 x:0 0 0 2024-04-18T10:42:49.132 INFO:tasks.workunit.client.0.smithi040.stdout:5/581: creat d0/db5/fc1 x:0 0 0 2024-04-18T10:42:49.133 INFO:tasks.workunit.client.0.smithi040.stdout:4/622: chown d2/d3/d4/d21/d28/d3f/l4c 68 1 2024-04-18T10:42:49.135 INFO:tasks.workunit.client.0.smithi040.stdout:4/623: write d2/d3/d4/d1f/d29/d49/d31/fa0 [606870,101929] 0 2024-04-18T10:42:49.138 INFO:tasks.workunit.client.0.smithi040.stdout:4/624: dread - d2/d3/d4/d1f/d29/d49/d31/f88 zero size 2024-04-18T10:42:49.138 INFO:tasks.workunit.client.0.smithi040.stdout:9/697: dwrite d2/d5b/fc8 [0,4194304] 0 2024-04-18T10:42:49.142 INFO:tasks.workunit.client.0.smithi040.stdout:2/620: rmdir dd/d61/d8e/d98 39 2024-04-18T10:42:49.144 INFO:tasks.workunit.client.0.smithi040.stdout:2/621: read dd/d14/d2b/d7c/d37/d5b/f7f [1039566,32388] 0 2024-04-18T10:42:49.147 INFO:tasks.workunit.client.0.smithi040.stdout:4/625: mkdir d2/d3/d41/d62/db0 0 2024-04-18T10:42:49.148 INFO:tasks.workunit.client.0.smithi040.stdout:0/691: dwrite dd/df/d4e/f5c [0,4194304] 0 2024-04-18T10:42:49.149 INFO:tasks.workunit.client.0.smithi040.stdout:9/698: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d44/ffb x:0 0 0 2024-04-18T10:42:49.152 INFO:tasks.workunit.client.0.smithi040.stdout:6/665: truncate df/d4b/d6e/f24 136740 0 2024-04-18T10:42:49.154 INFO:tasks.workunit.client.0.smithi040.stdout:5/582: mkdir d0/d4e/dc2 0 2024-04-18T10:42:49.155 INFO:tasks.workunit.client.0.smithi040.stdout:2/622: dwrite dd/d14/d2b/fc3 [0,4194304] 0 2024-04-18T10:42:49.158 INFO:tasks.workunit.client.0.smithi040.stdout:3/690: write d1/d7/d12/f22 [935738,85882] 0 2024-04-18T10:42:49.159 INFO:tasks.workunit.client.0.smithi040.stdout:9/699: mkdir d2/d5b/d6f/d80/ddd/dfc 0 2024-04-18T10:42:49.160 INFO:tasks.workunit.client.0.smithi040.stdout:2/623: fdatasync dd/d14/d2b/d7c/d37/d38/f57 0 2024-04-18T10:42:49.161 INFO:tasks.workunit.client.0.smithi040.stdout:4/626: dread d2/d3/d4/f2e [0,4194304] 0 2024-04-18T10:42:49.163 INFO:tasks.workunit.client.0.smithi040.stdout:0/692: dwrite dd/df/d19/f22 [4194304,4194304] 0 2024-04-18T10:42:49.166 INFO:tasks.workunit.client.0.smithi040.stdout:0/693: chown dd/df/d19/fdf 34 1 2024-04-18T10:42:49.167 INFO:tasks.workunit.client.0.smithi040.stdout:9/700: creat d2/d3/d70/da8/ffd x:0 0 0 2024-04-18T10:42:49.168 INFO:tasks.workunit.client.0.smithi040.stdout:8/681: dread d2/f6c [0,4194304] 0 2024-04-18T10:42:49.168 INFO:tasks.workunit.client.0.smithi040.stdout:5/583: link d0/d3/d6b/d7b/f85 d0/d4e/d8e/fc3 0 2024-04-18T10:42:49.170 INFO:tasks.workunit.client.0.smithi040.stdout:6/666: creat df/fef x:0 0 0 2024-04-18T10:42:49.171 INFO:tasks.workunit.client.0.smithi040.stdout:3/691: dread d1/d2/f17 [0,4194304] 0 2024-04-18T10:42:49.171 INFO:tasks.workunit.client.0.smithi040.stdout:7/644: dread d6/d25/d28/d2c/d3c/f51 [0,4194304] 0 2024-04-18T10:42:49.171 INFO:tasks.workunit.client.0.smithi040.stdout:5/584: dread - d0/d3b/fbc zero size 2024-04-18T10:42:49.193 INFO:tasks.workunit.client.0.smithi040.stdout:0/694: creat dd/df/d19/d28/d3a/d5b/fff x:0 0 0 2024-04-18T10:42:49.193 INFO:tasks.workunit.client.0.smithi040.stdout:8/682: mknod d2/d22/cec 0 2024-04-18T10:42:49.194 INFO:tasks.workunit.client.0.smithi040.stdout:6/667: chown df/d4b/d6a/fae 717765 1 2024-04-18T10:42:49.194 INFO:tasks.workunit.client.0.smithi040.stdout:7/645: stat d6/d25/d28/f66 0 2024-04-18T10:42:49.196 INFO:tasks.workunit.client.0.smithi040.stdout:2/624: dwrite dd/d14/d4a/f71 [4194304,4194304] 0 2024-04-18T10:42:49.197 INFO:tasks.workunit.client.0.smithi040.stdout:4/627: dwrite d2/f2c [0,4194304] 0 2024-04-18T10:42:49.197 INFO:tasks.workunit.client.0.smithi040.stdout:1/692: write d1/d1c/d2b/d32/fd9 [883664,61210] 0 2024-04-18T10:42:49.198 INFO:tasks.workunit.client.0.smithi040.stdout:8/683: chown d2/d5/d9/c3d 98558 1 2024-04-18T10:42:49.200 INFO:tasks.workunit.client.0.smithi040.stdout:0/695: dread - dd/df/d19/d28/d3a/d42/fcb zero size 2024-04-18T10:42:49.203 INFO:tasks.workunit.client.0.smithi040.stdout:4/628: write d2/d3/d4/dd/d4f/f90 [852334,126858] 0 2024-04-18T10:42:49.204 INFO:tasks.workunit.client.0.smithi040.stdout:1/693: fsync d1/d16/f3b 0 2024-04-18T10:42:49.204 INFO:tasks.workunit.client.0.smithi040.stdout:8/684: creat d2/d15/d78/fed x:0 0 0 2024-04-18T10:42:49.204 INFO:tasks.workunit.client.0.smithi040.stdout:5/585: stat d0/d78/d95/l3d 0 2024-04-18T10:42:49.205 INFO:tasks.workunit.client.0.smithi040.stdout:3/692: creat d1/d2/d4e/d58/dbe/dc1/dde/fe7 x:0 0 0 2024-04-18T10:42:49.206 INFO:tasks.workunit.client.0.smithi040.stdout:5/586: write d0/d21/fbe [663394,36638] 0 2024-04-18T10:42:49.207 INFO:tasks.workunit.client.0.smithi040.stdout:6/668: creat df/d4b/db7/dcc/dd6/ff0 x:0 0 0 2024-04-18T10:42:49.207 INFO:tasks.workunit.client.0.smithi040.stdout:5/587: readlink d0/d3b/l46 0 2024-04-18T10:42:49.207 INFO:tasks.workunit.client.0.smithi040.stdout:0/696: fsync dd/df/d19/d28/d3a/d42/f59 0 2024-04-18T10:42:49.208 INFO:tasks.workunit.client.0.smithi040.stdout:6/669: chown df/fab 301274928 1 2024-04-18T10:42:49.211 INFO:tasks.workunit.client.0.smithi040.stdout:8/685: readlink d2/d5/d9/d3c/d5a/la0 0 2024-04-18T10:42:49.212 INFO:tasks.workunit.client.0.smithi040.stdout:3/693: dread d1/d2/d4e/d58/f72 [0,4194304] 0 2024-04-18T10:42:49.212 INFO:tasks.workunit.client.0.smithi040.stdout:2/625: dread dd/d14/d2b/d7c/f84 [0,4194304] 0 2024-04-18T10:42:49.213 INFO:tasks.workunit.client.0.smithi040.stdout:1/694: read d1/fa [173901,51974] 0 2024-04-18T10:42:49.214 INFO:tasks.workunit.client.0.smithi040.stdout:4/629: symlink d2/d3/d41/d62/d9a/lb1 0 2024-04-18T10:42:49.214 INFO:tasks.workunit.client.0.smithi040.stdout:8/686: write d2/d15/d78/fcb [1214842,104414] 0 2024-04-18T10:42:49.216 INFO:tasks.workunit.client.0.smithi040.stdout:1/695: chown d1/d9b/lb3 9058 1 2024-04-18T10:42:49.217 INFO:tasks.workunit.client.0.smithi040.stdout:3/694: mknod d1/d7/d67/dc5/d91/ce8 0 2024-04-18T10:42:49.217 INFO:tasks.workunit.client.0.smithi040.stdout:6/670: truncate df/d4b/d7e/fa2 1569350 0 2024-04-18T10:42:49.217 INFO:tasks.workunit.client.0.smithi040.stdout:0/697: dwrite dd/df/d19/d3e/d77/f85 [0,4194304] 0 2024-04-18T10:42:49.220 INFO:tasks.workunit.client.0.smithi040.stdout:4/630: mkdir d2/d3/d4/dd/d6d/d70/db2 0 2024-04-18T10:42:49.222 INFO:tasks.workunit.client.0.smithi040.stdout:2/626: link dd/d14/f86 dd/d14/d4a/fc9 0 2024-04-18T10:42:49.224 INFO:tasks.workunit.client.0.smithi040.stdout:3/695: symlink d1/d7/d28/le9 0 2024-04-18T10:42:49.225 INFO:tasks.workunit.client.0.smithi040.stdout:6/671: write df/d4b/d6e/d3f/d53/d8a/d95/da7/fd5 [178317,64819] 0 2024-04-18T10:42:49.226 INFO:tasks.workunit.client.0.smithi040.stdout:0/698: mkdir dd/df/d19/d28/d3a/d42/d100 0 2024-04-18T10:42:49.226 INFO:tasks.workunit.client.0.smithi040.stdout:0/699: chown dd/df/d19/d3e/da5/lef 9 1 2024-04-18T10:42:49.227 INFO:tasks.workunit.client.0.smithi040.stdout:2/627: mknod dd/d14/d4a/d54/cca 0 2024-04-18T10:42:49.229 INFO:tasks.workunit.client.0.smithi040.stdout:8/687: getdents d2/d22/d80/da2 0 2024-04-18T10:42:49.229 INFO:tasks.workunit.client.0.smithi040.stdout:2/628: chown dd/d14/d2b/d7c/d37/d38/c39 5045284 1 2024-04-18T10:42:49.232 INFO:tasks.workunit.client.0.smithi040.stdout:0/700: dread dd/df/d4e/fa4 [0,4194304] 0 2024-04-18T10:42:49.232 INFO:tasks.workunit.client.0.smithi040.stdout:6/672: link df/d4b/d6e/d3f/f5c df/d4b/d99/ff1 0 2024-04-18T10:42:49.233 INFO:tasks.workunit.client.0.smithi040.stdout:8/688: rename d2/d15/d2b/f92 to d2/d15/d78/fee 0 2024-04-18T10:42:49.238 INFO:tasks.workunit.client.0.smithi040.stdout:7/646: truncate d6/d25/d28/d2c/d2d/d47/f48 2086377 0 2024-04-18T10:42:49.241 INFO:tasks.workunit.client.0.smithi040.stdout:5/588: write d0/d3b/fbc [107470,108669] 0 2024-04-18T10:42:49.242 INFO:tasks.workunit.client.0.smithi040.stdout:0/701: dwrite dd/df/d19/d28/d3a/d42/f72 [0,4194304] 0 2024-04-18T10:42:49.243 INFO:tasks.workunit.client.0.smithi040.stdout:7/647: truncate d6/d25/d28/d2c/d2d/d47/f65 5067562 0 2024-04-18T10:42:49.245 INFO:tasks.workunit.client.0.smithi040.stdout:2/629: link dd/d14/fa9 dd/d61/d8e/fcb 0 2024-04-18T10:42:49.248 INFO:tasks.workunit.client.0.smithi040.stdout:6/673: getdents df/d4b/d6e/d3f 0 2024-04-18T10:42:49.250 INFO:tasks.workunit.client.0.smithi040.stdout:5/589: mkdir d0/d78/dc4 0 2024-04-18T10:42:49.253 INFO:tasks.workunit.client.0.smithi040.stdout:0/702: mkdir dd/daa/d101 0 2024-04-18T10:42:49.254 INFO:tasks.workunit.client.0.smithi040.stdout:1/696: dread d1/d1c/f56 [0,4194304] 0 2024-04-18T10:42:49.254 INFO:tasks.workunit.client.0.smithi040.stdout:6/674: rename df/fef to df/d76/d91/ff2 0 2024-04-18T10:42:49.256 INFO:tasks.workunit.client.0.smithi040.stdout:9/701: sync 2024-04-18T10:42:49.258 INFO:tasks.workunit.client.0.smithi040.stdout:3/696: dwrite d1/d7/d67/dc5/d91/fcc [0,4194304] 0 2024-04-18T10:42:49.259 INFO:tasks.workunit.client.0.smithi040.stdout:3/697: stat d1/d7/d67/dc5/d3b 0 2024-04-18T10:42:49.259 INFO:tasks.workunit.client.0.smithi040.stdout:2/630: mkdir dd/d61/d8e/d98/dcc 0 2024-04-18T10:42:49.260 INFO:tasks.workunit.client.0.smithi040.stdout:2/631: chown dd/d14/d2b/d7c/d37/d38/d8c/c8f 2269 1 2024-04-18T10:42:49.260 INFO:tasks.workunit.client.0.smithi040.stdout:8/689: write d2/d5/d9/f44 [4130972,90645] 0 2024-04-18T10:42:49.262 INFO:tasks.workunit.client.0.smithi040.stdout:0/703: write dd/df/d19/d28/f6e [3376984,117816] 0 2024-04-18T10:42:49.263 INFO:tasks.workunit.client.0.smithi040.stdout:1/697: symlink d1/d1c/d2b/db5/dcc/lfc 0 2024-04-18T10:42:49.264 INFO:tasks.workunit.client.0.smithi040.stdout:0/704: dread - dd/df/d19/d3e/d77/fb2 zero size 2024-04-18T10:42:49.265 INFO:tasks.workunit.client.0.smithi040.stdout:2/632: truncate dd/d14/d2b/dbc/d5f/d82/da6/db1/fbe 247421 0 2024-04-18T10:42:49.266 INFO:tasks.workunit.client.0.smithi040.stdout:0/705: dread - dd/df/d19/d28/d3a/d5b/fff zero size 2024-04-18T10:42:49.267 INFO:tasks.workunit.client.0.smithi040.stdout:2/633: write dd/d14/d4a/d54/f9c [116772,97801] 0 2024-04-18T10:42:49.272 INFO:tasks.workunit.client.0.smithi040.stdout:1/698: mkdir d1/d1c/d2b/d32/dfd 0 2024-04-18T10:42:49.272 INFO:tasks.workunit.client.0.smithi040.stdout:8/690: dread d2/d2c/da9/fbc [0,4194304] 0 2024-04-18T10:42:49.273 INFO:tasks.workunit.client.0.smithi040.stdout:6/675: symlink df/d4b/db7/dcc/de5/lf3 0 2024-04-18T10:42:49.274 INFO:tasks.workunit.client.0.smithi040.stdout:2/634: symlink dd/d14/d2b/lcd 0 2024-04-18T10:42:49.274 INFO:tasks.workunit.client.0.smithi040.stdout:7/648: truncate d6/d25/f62 6809285 0 2024-04-18T10:42:49.276 INFO:tasks.workunit.client.0.smithi040.stdout:0/706: creat dd/df/d19/d3e/f102 x:0 0 0 2024-04-18T10:42:49.277 INFO:tasks.workunit.client.0.smithi040.stdout:3/698: write d1/d7/d12/f9f [1963774,44180] 0 2024-04-18T10:42:49.277 INFO:tasks.workunit.client.0.smithi040.stdout:1/699: symlink d1/d1c/d7b/d2e/d3e/lfe 0 2024-04-18T10:42:49.277 INFO:tasks.workunit.client.0.smithi040.stdout:0/707: dread - dd/df/d19/d28/db7/feb zero size 2024-04-18T10:42:49.278 INFO:tasks.workunit.client.0.smithi040.stdout:8/691: dread d2/d5/fa8 [0,4194304] 0 2024-04-18T10:42:49.279 INFO:tasks.workunit.client.0.smithi040.stdout:2/635: mkdir dd/d14/d2b/dbc/d5f/d82/da6/dce 0 2024-04-18T10:42:49.280 INFO:tasks.workunit.client.0.smithi040.stdout:1/700: dread - d1/d1c/d7b/d2e/d9e/fc4 zero size 2024-04-18T10:42:49.282 INFO:tasks.workunit.client.0.smithi040.stdout:4/631: sync 2024-04-18T10:42:49.283 INFO:tasks.workunit.client.0.smithi040.stdout:6/676: truncate df/fab 164282 0 2024-04-18T10:42:49.286 INFO:tasks.workunit.client.0.smithi040.stdout:8/692: dread d2/d5/d9/d3c/d5a/f21 [0,4194304] 0 2024-04-18T10:42:49.286 INFO:tasks.workunit.client.0.smithi040.stdout:0/708: chown dd/df/d19/d28/d3a/d42/l97 22 1 2024-04-18T10:42:49.287 INFO:tasks.workunit.client.0.smithi040.stdout:5/590: dread d0/d3/d6b/d7b/f85 [4194304,4194304] 0 2024-04-18T10:42:49.291 INFO:tasks.workunit.client.0.smithi040.stdout:1/701: chown d1/d1c/d7b/c78 91 1 2024-04-18T10:42:49.293 INFO:tasks.workunit.client.0.smithi040.stdout:9/702: write d2/d3/d22/d2e/d35/d40/d85/f9c [73686,123273] 0 2024-04-18T10:42:49.294 INFO:tasks.workunit.client.0.smithi040.stdout:6/677: symlink df/d4b/d6e/d3f/d53/d8a/d95/da7/lf4 0 2024-04-18T10:42:49.297 INFO:tasks.workunit.client.0.smithi040.stdout:7/649: rename d6/d50/f6e to d6/d25/d28/fcd 0 2024-04-18T10:42:49.302 INFO:tasks.workunit.client.0.smithi040.stdout:0/709: write dd/df/d19/d28/f53 [4890099,89549] 0 2024-04-18T10:42:49.303 INFO:tasks.workunit.client.0.smithi040.stdout:2/636: rename dd/d14/d2b/dbc/d77 to dd/d14/d2b/d7c/d37/d5b/dcf 0 2024-04-18T10:42:49.303 INFO:tasks.workunit.client.0.smithi040.stdout:9/703: dread d2/d3/d22/d2e/d35/daf/dc1/ffa [0,4194304] 0 2024-04-18T10:42:49.303 INFO:tasks.workunit.client.0.smithi040.stdout:3/699: dread d1/d2/f48 [0,4194304] 0 2024-04-18T10:42:49.305 INFO:tasks.workunit.client.0.smithi040.stdout:8/693: dwrite d2/f6c [0,4194304] 0 2024-04-18T10:42:49.306 INFO:tasks.workunit.client.0.smithi040.stdout:4/632: creat d2/d3/d4/dd/d6d/fb3 x:0 0 0 2024-04-18T10:42:49.307 INFO:tasks.workunit.client.0.smithi040.stdout:6/678: mkdir df/d4b/deb/df5 0 2024-04-18T10:42:49.307 INFO:tasks.workunit.client.0.smithi040.stdout:0/710: dread - dd/df/d19/d28/db7/dd4/ff5 zero size 2024-04-18T10:42:49.309 INFO:tasks.workunit.client.0.smithi040.stdout:7/650: mknod d6/d25/d28/d2c/cce 0 2024-04-18T10:42:49.309 INFO:tasks.workunit.client.0.smithi040.stdout:2/637: mkdir dd/d61/d8e/d98/dd0 0 2024-04-18T10:42:49.310 INFO:tasks.workunit.client.0.smithi040.stdout:0/711: fsync dd/df/d19/f8c 0 2024-04-18T10:42:49.310 INFO:tasks.workunit.client.0.smithi040.stdout:6/679: chown df/d4b/d6a/d93/c66 6036376 1 2024-04-18T10:42:49.311 INFO:tasks.workunit.client.0.smithi040.stdout:3/700: mkdir d1/d2/d4e/d58/dbe/dc1/dc2/dea 0 2024-04-18T10:42:49.313 INFO:tasks.workunit.client.0.smithi040.stdout:0/712: chown dd/df/d19/d3e/d75 0 1 2024-04-18T10:42:49.314 INFO:tasks.workunit.client.0.smithi040.stdout:8/694: mknod d2/d5/d9/d3c/de9/cef 0 2024-04-18T10:42:49.314 INFO:tasks.workunit.client.0.smithi040.stdout:1/702: dread d1/d1c/d7b/d2d/f63 [0,4194304] 0 2024-04-18T10:42:49.315 INFO:tasks.workunit.client.0.smithi040.stdout:7/651: write d6/d25/d28/fa1 [1152626,92299] 0 2024-04-18T10:42:49.315 INFO:tasks.workunit.client.0.smithi040.stdout:6/680: mkdir df/d4b/db7/df6 0 2024-04-18T10:42:49.316 INFO:tasks.workunit.client.0.smithi040.stdout:0/713: chown dd/df/l4b 10 1 2024-04-18T10:42:49.318 INFO:tasks.workunit.client.0.smithi040.stdout:8/695: symlink d2/d2c/lf0 0 2024-04-18T10:42:49.320 INFO:tasks.workunit.client.0.smithi040.stdout:6/681: write df/d4b/d6a/d93/f56 [462595,40115] 0 2024-04-18T10:42:49.322 INFO:tasks.workunit.client.0.smithi040.stdout:7/652: mkdir d6/d25/dcf 0 2024-04-18T10:42:49.323 INFO:tasks.workunit.client.0.smithi040.stdout:3/701: creat d1/d2/d4e/feb x:0 0 0 2024-04-18T10:42:49.323 INFO:tasks.workunit.client.0.smithi040.stdout:5/591: dread d0/d3/f38 [0,4194304] 0 2024-04-18T10:42:49.324 INFO:tasks.workunit.client.0.smithi040.stdout:1/703: creat d1/d9b/d75/fff x:0 0 0 2024-04-18T10:42:49.324 INFO:tasks.workunit.client.0.smithi040.stdout:0/714: mkdir dd/df/d4e/dc3/d103 0 2024-04-18T10:42:49.325 INFO:tasks.workunit.client.0.smithi040.stdout:2/638: dwrite dd/d14/d2b/f2e [4194304,4194304] 0 2024-04-18T10:42:49.328 INFO:tasks.workunit.client.0.smithi040.stdout:7/653: readlink d6/d25/d28/dac/l9c 0 2024-04-18T10:42:49.330 INFO:tasks.workunit.client.0.smithi040.stdout:3/702: fdatasync d1/d7/d67/dc5/d91/db1/f82 0 2024-04-18T10:42:49.332 INFO:tasks.workunit.client.0.smithi040.stdout:1/704: write d1/d1c/d7b/d2e/d3e/ff7 [728160,121311] 0 2024-04-18T10:42:49.333 INFO:tasks.workunit.client.0.smithi040.stdout:2/639: creat dd/d14/d2b/d7c/d37/fd1 x:0 0 0 2024-04-18T10:42:49.334 INFO:tasks.workunit.client.0.smithi040.stdout:8/696: dwrite d2/d22/f85 [0,4194304] 0 2024-04-18T10:42:49.335 INFO:tasks.workunit.client.0.smithi040.stdout:6/682: getdents df/d4b/d6e/d3f 0 2024-04-18T10:42:49.338 INFO:tasks.workunit.client.0.smithi040.stdout:0/715: rename dd/df/d4e/f7d to dd/df/d19/d28/d3a/df9/f104 0 2024-04-18T10:42:49.338 INFO:tasks.workunit.client.0.smithi040.stdout:9/704: dread d2/d3/d22/d2e/d35/daf/dc1/f1a [0,4194304] 0 2024-04-18T10:42:49.340 INFO:tasks.workunit.client.0.smithi040.stdout:3/703: unlink d1/d7/d67/dc5/d91/db1/f82 0 2024-04-18T10:42:49.340 INFO:tasks.workunit.client.0.smithi040.stdout:7/654: read d6/d25/d28/d2c/d2d/d47/f72 [926727,20861] 0 2024-04-18T10:42:49.341 INFO:tasks.workunit.client.0.smithi040.stdout:3/704: fdatasync d1/d2/d16/fe2 0 2024-04-18T10:42:49.342 INFO:tasks.workunit.client.0.smithi040.stdout:4/633: dread d2/d3/d4/d1f/d29/d49/f65 [0,4194304] 0 2024-04-18T10:42:49.343 INFO:tasks.workunit.client.0.smithi040.stdout:5/592: getdents d0/d3/d6b/d7b 0 2024-04-18T10:42:49.344 INFO:tasks.workunit.client.0.smithi040.stdout:8/697: mkdir d2/d22/d49/df1 0 2024-04-18T10:42:49.345 INFO:tasks.workunit.client.0.smithi040.stdout:0/716: write dd/df/d19/d28/db7/dd4/fe2 [116504,20066] 0 2024-04-18T10:42:49.345 INFO:tasks.workunit.client.0.smithi040.stdout:1/705: dwrite d1/db1/fef [0,4194304] 0 2024-04-18T10:42:49.346 INFO:tasks.workunit.client.0.smithi040.stdout:3/705: fdatasync d1/d7/d12/d7b/fb3 0 2024-04-18T10:42:49.348 INFO:tasks.workunit.client.0.smithi040.stdout:7/655: mkdir d6/d25/d28/d2c/d2d/dbc/dd0 0 2024-04-18T10:42:49.349 INFO:tasks.workunit.client.0.smithi040.stdout:5/593: write d0/d21/d42/f4f [4777513,52349] 0 2024-04-18T10:42:49.349 INFO:tasks.workunit.client.0.smithi040.stdout:0/717: readlink dd/df/d19/d28/d3a/d5b/l93 0 2024-04-18T10:42:49.351 INFO:tasks.workunit.client.0.smithi040.stdout:7/656: fsync d6/d3e/d99/fa3 0 2024-04-18T10:42:49.351 INFO:tasks.workunit.client.0.smithi040.stdout:6/683: link c5 df/d4b/d6e/d3f/d53/d8a/d95/de1/cf7 0 2024-04-18T10:42:49.356 INFO:tasks.workunit.client.0.smithi040.stdout:1/706: creat d1/d16/d92/dad/f100 x:0 0 0 2024-04-18T10:42:49.360 INFO:tasks.workunit.client.0.smithi040.stdout:0/718: readlink dd/df/d19/d3e/l9a 0 2024-04-18T10:42:49.362 INFO:tasks.workunit.client.0.smithi040.stdout:6/684: creat df/d76/db9/ff8 x:0 0 0 2024-04-18T10:42:49.365 INFO:tasks.workunit.client.0.smithi040.stdout:4/634: dwrite d2/d3/d4/fab [0,4194304] 0 2024-04-18T10:42:49.365 INFO:tasks.workunit.client.0.smithi040.stdout:8/698: symlink d2/d5/d9/d3c/d5a/lf2 0 2024-04-18T10:42:49.369 INFO:tasks.workunit.client.0.smithi040.stdout:3/706: dwrite d1/d7/d67/dc5/d3b/fad [0,4194304] 0 2024-04-18T10:42:49.369 INFO:tasks.workunit.client.0.smithi040.stdout:7/657: dwrite d6/fbd [0,4194304] 0 2024-04-18T10:42:49.372 INFO:tasks.workunit.client.0.smithi040.stdout:1/707: write d1/d1c/f56 [4517602,86947] 0 2024-04-18T10:42:49.372 INFO:tasks.workunit.client.0.smithi040.stdout:0/719: readlink dd/df/d4e/l5e 0 2024-04-18T10:42:49.372 INFO:tasks.workunit.client.0.smithi040.stdout:9/705: dread d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/fe3 [0,4194304] 0 2024-04-18T10:42:49.373 INFO:tasks.workunit.client.0.smithi040.stdout:4/635: dread - d2/d3/d4/dd/fa9 zero size 2024-04-18T10:42:49.406 INFO:tasks.workunit.client.0.smithi040.stdout:1/708: stat d1/d1c/d2b/db5/dd6/lf2 0 2024-04-18T10:42:49.406 INFO:tasks.workunit.client.0.smithi040.stdout:5/594: dwrite d0/d3/f36 [0,4194304] 0 2024-04-18T10:42:49.408 INFO:tasks.workunit.client.0.smithi040.stdout:6/685: rename df/d4b/f65 to df/d4b/db7/df6/ff9 0 2024-04-18T10:42:49.410 INFO:tasks.workunit.client.0.smithi040.stdout:2/640: dwrite dd/d14/f86 [0,4194304] 0 2024-04-18T10:42:49.410 INFO:tasks.workunit.client.0.smithi040.stdout:0/720: mknod dd/df/d19/d3e/c105 0 2024-04-18T10:42:49.412 INFO:tasks.workunit.client.0.smithi040.stdout:6/686: readlink df/l86 0 2024-04-18T10:42:49.412 INFO:tasks.workunit.client.0.smithi040.stdout:4/636: stat d2/d3/d4/dd/d6d/d70/db2 0 2024-04-18T10:42:49.413 INFO:tasks.workunit.client.0.smithi040.stdout:8/699: dwrite d2/d15/f82 [0,4194304] 0 2024-04-18T10:42:49.414 INFO:tasks.workunit.client.0.smithi040.stdout:6/687: dread - df/d4b/d6a/fb0 zero size 2024-04-18T10:42:49.419 INFO:tasks.workunit.client.0.smithi040.stdout:8/700: creat d2/d5/d9/d63/ff3 x:0 0 0 2024-04-18T10:42:49.421 INFO:tasks.workunit.client.0.smithi040.stdout:5/595: rename d0/d3/l4d to d0/d3/d47/lc5 0 2024-04-18T10:42:49.422 INFO:tasks.workunit.client.0.smithi040.stdout:4/637: mknod d2/d1a/d8e/cb4 0 2024-04-18T10:42:49.422 INFO:tasks.workunit.client.0.smithi040.stdout:5/596: truncate d0/d3b/d67/f84 805349 0 2024-04-18T10:42:49.423 INFO:tasks.workunit.client.0.smithi040.stdout:0/721: creat dd/df/d4e/f106 x:0 0 0 2024-04-18T10:42:49.424 INFO:tasks.workunit.client.0.smithi040.stdout:6/688: mknod df/d4b/d6e/d3f/d53/d8a/cfa 0 2024-04-18T10:42:49.426 INFO:tasks.workunit.client.0.smithi040.stdout:4/638: creat d2/d3/d4/d1f/fb5 x:0 0 0 2024-04-18T10:42:49.427 INFO:tasks.workunit.client.0.smithi040.stdout:4/639: dread - d2/d3/d4/dd/fa9 zero size 2024-04-18T10:42:49.428 INFO:tasks.workunit.client.0.smithi040.stdout:5/597: rename d0/d3b/d3f/d72/l77 to d0/d78/d95/db7/lc6 0 2024-04-18T10:42:49.429 INFO:tasks.workunit.client.0.smithi040.stdout:8/701: mkdir d2/d4c/df4 0 2024-04-18T10:42:49.429 INFO:tasks.workunit.client.0.smithi040.stdout:9/706: dread d2/d7/f29 [0,4194304] 0 2024-04-18T10:42:49.430 INFO:tasks.workunit.client.0.smithi040.stdout:0/722: read dd/df/d19/d28/d3a/f9d [502733,122998] 0 2024-04-18T10:42:49.430 INFO:tasks.workunit.client.0.smithi040.stdout:2/641: creat dd/d14/d2b/dbc/d5f/d82/da6/fd2 x:0 0 0 2024-04-18T10:42:49.431 INFO:tasks.workunit.client.0.smithi040.stdout:5/598: mkdir d0/d3b/d67/dc7 0 2024-04-18T10:42:49.432 INFO:tasks.workunit.client.0.smithi040.stdout:5/599: stat d0/d21/l30 0 2024-04-18T10:42:49.432 INFO:tasks.workunit.client.0.smithi040.stdout:9/707: mknod d2/dd/de/cfe 0 2024-04-18T10:42:49.433 INFO:tasks.workunit.client.0.smithi040.stdout:5/600: fsync d0/d78/d95/f75 0 2024-04-18T10:42:49.434 INFO:tasks.workunit.client.0.smithi040.stdout:8/702: rename d2/d15/c6b to d2/d22/d49/df1/cf5 0 2024-04-18T10:42:49.434 INFO:tasks.workunit.client.0.smithi040.stdout:9/708: truncate d2/d5b/fe1 1026156 0 2024-04-18T10:42:49.435 INFO:tasks.workunit.client.0.smithi040.stdout:8/703: fsync d2/d5/d9/fb9 0 2024-04-18T10:42:49.435 INFO:tasks.workunit.client.0.smithi040.stdout:9/709: fsync d2/d3/d22/d2e/f63 0 2024-04-18T10:42:49.435 INFO:tasks.workunit.client.0.smithi040.stdout:6/689: link df/d4b/d6e/d3f/d53/d8a/fb5 df/ffb 0 2024-04-18T10:42:49.436 INFO:tasks.workunit.client.0.smithi040.stdout:0/723: dread dd/df/d19/d28/f4c [0,4194304] 0 2024-04-18T10:42:49.437 INFO:tasks.workunit.client.0.smithi040.stdout:2/642: chown dd/d61/d8e/fcb 5 1 2024-04-18T10:42:49.437 INFO:tasks.workunit.client.0.smithi040.stdout:6/690: stat df/d4b/d99/fa6 0 2024-04-18T10:42:49.437 INFO:tasks.workunit.client.0.smithi040.stdout:4/640: creat d2/d3/d4/fb6 x:0 0 0 2024-04-18T10:42:49.439 INFO:tasks.workunit.client.0.smithi040.stdout:5/601: write d0/d3/f5 [2746545,67595] 0 2024-04-18T10:42:49.442 INFO:tasks.workunit.client.0.smithi040.stdout:0/724: mkdir dd/df/d19/d28/d3a/d46/d107 0 2024-04-18T10:42:49.447 INFO:tasks.workunit.client.0.smithi040.stdout:6/691: creat df/d4b/d6e/d3f/d53/d8a/d95/ffc x:0 0 0 2024-04-18T10:42:49.448 INFO:tasks.workunit.client.0.smithi040.stdout:6/692: readlink df/d4b/d6e/d3f/l44 0 2024-04-18T10:42:49.448 INFO:tasks.workunit.client.0.smithi040.stdout:4/641: dwrite d2/d3/d2f/f46 [0,4194304] 0 2024-04-18T10:42:49.450 INFO:tasks.workunit.client.0.smithi040.stdout:3/707: sync 2024-04-18T10:42:49.451 INFO:tasks.workunit.client.0.smithi040.stdout:5/602: getdents d0/d4e/d8e 0 2024-04-18T10:42:49.453 INFO:tasks.workunit.client.0.smithi040.stdout:4/642: creat d2/d3/d4/dd/d6d/d70/fb7 x:0 0 0 2024-04-18T10:42:49.457 INFO:tasks.workunit.client.0.smithi040.stdout:5/603: fdatasync d0/f35 0 2024-04-18T10:42:49.458 INFO:tasks.workunit.client.0.smithi040.stdout:6/693: dwrite df/d4b/db7/dc1/fc6 [0,4194304] 0 2024-04-18T10:42:49.462 INFO:tasks.workunit.client.0.smithi040.stdout:3/708: dwrite d1/d7/d67/dc5/d91/fcc [0,4194304] 0 2024-04-18T10:42:49.463 INFO:tasks.workunit.client.0.smithi040.stdout:8/704: truncate d2/f6c 2323811 0 2024-04-18T10:42:49.463 INFO:tasks.workunit.client.0.smithi040.stdout:5/604: readlink d0/l2f 0 2024-04-18T10:42:49.466 INFO:tasks.workunit.client.0.smithi040.stdout:2/643: dwrite dd/d14/d2b/dbc/d5f/d82/da6/d52/f92 [0,4194304] 0 2024-04-18T10:42:49.467 INFO:tasks.workunit.client.0.smithi040.stdout:5/605: stat d0/d21/d42/d76/la2 0 2024-04-18T10:42:49.469 INFO:tasks.workunit.client.0.smithi040.stdout:8/705: rmdir d2/d22/d49/df1 39 2024-04-18T10:42:49.471 INFO:tasks.workunit.client.0.smithi040.stdout:5/606: write d0/d3b/fbc [510461,11835] 0 2024-04-18T10:42:49.473 INFO:tasks.workunit.client.0.smithi040.stdout:9/710: dwrite d2/d3/f12 [0,4194304] 0 2024-04-18T10:42:49.475 INFO:tasks.workunit.client.0.smithi040.stdout:8/706: symlink d2/d22/d49/df1/lf6 0 2024-04-18T10:42:49.477 INFO:tasks.workunit.client.0.smithi040.stdout:5/607: write d0/d3/d6b/fbb [607851,64795] 0 2024-04-18T10:42:49.478 INFO:tasks.workunit.client.0.smithi040.stdout:3/709: dwrite d1/d7/d12/f30 [4194304,4194304] 0 2024-04-18T10:42:49.478 INFO:tasks.workunit.client.0.smithi040.stdout:2/644: link dd/d14/d2b/d7c/d37/d38/fc8 dd/d14/d2b/dbc/d5f/d82/fd3 0 2024-04-18T10:42:49.480 INFO:tasks.workunit.client.0.smithi040.stdout:8/707: mkdir d2/d5/d9/df7 0 2024-04-18T10:42:49.481 INFO:tasks.workunit.client.0.smithi040.stdout:9/711: write d2/d3/d22/d2e/d35/d40/d71/f78 [3111234,72980] 0 2024-04-18T10:42:49.484 INFO:tasks.workunit.client.0.smithi040.stdout:3/710: write d1/d2/f48 [1991761,124653] 0 2024-04-18T10:42:49.485 INFO:tasks.workunit.client.0.smithi040.stdout:3/711: dread - d1/d2/d4e/d58/dbe/dc1/dc2/fce zero size 2024-04-18T10:42:49.486 INFO:tasks.workunit.client.0.smithi040.stdout:3/712: chown d1/d7/d28/cc9 4 1 2024-04-18T10:42:49.487 INFO:tasks.workunit.client.0.smithi040.stdout:8/708: creat d2/d5/d9/ff8 x:0 0 0 2024-04-18T10:42:49.489 INFO:tasks.workunit.client.0.smithi040.stdout:9/712: rename d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/fef to d2/d3/d22/d2e/d35/d40/d71/fff 0 2024-04-18T10:42:49.490 INFO:tasks.workunit.client.0.smithi040.stdout:5/608: dread d0/d3/d6b/d7b/fa9 [0,4194304] 0 2024-04-18T10:42:49.491 INFO:tasks.workunit.client.0.smithi040.stdout:7/658: sync 2024-04-18T10:42:49.493 INFO:tasks.workunit.client.0.smithi040.stdout:6/694: dwrite df/f20 [0,4194304] 0 2024-04-18T10:42:49.493 INFO:tasks.workunit.client.0.smithi040.stdout:4/643: dread d2/d3/d4/d21/f58 [0,4194304] 0 2024-04-18T10:42:49.494 INFO:tasks.workunit.client.0.smithi040.stdout:2/645: unlink dd/d14/d2b/dbc/d5f/d82/da6/d49/l76 0 2024-04-18T10:42:49.496 INFO:tasks.workunit.client.0.smithi040.stdout:2/646: stat dd/c9f 0 2024-04-18T10:42:49.498 INFO:tasks.workunit.client.0.smithi040.stdout:4/644: creat d2/d1a/fb8 x:0 0 0 2024-04-18T10:42:49.498 INFO:tasks.workunit.client.0.smithi040.stdout:6/695: creat df/de8/ffd x:0 0 0 2024-04-18T10:42:49.499 INFO:tasks.workunit.client.0.smithi040.stdout:8/709: dwrite d2/d15/d78/fcb [0,4194304] 0 2024-04-18T10:42:49.500 INFO:tasks.workunit.client.0.smithi040.stdout:4/645: readlink d2/d3/d4/d1f/d29/d49/d31/lae 0 2024-04-18T10:42:49.501 INFO:tasks.workunit.client.0.smithi040.stdout:9/713: rename d2/d5b/d6f/d80/de0 to d2/d3/d22/d2e/d35/d40/d100 0 2024-04-18T10:42:49.503 INFO:tasks.workunit.client.0.smithi040.stdout:5/609: creat d0/fc8 x:0 0 0 2024-04-18T10:42:49.503 INFO:tasks.workunit.client.0.smithi040.stdout:9/714: write d2/d3/d22/d2e/d35/daf/dc1/d46/d44/d8d/fd3 [1228505,59508] 0 2024-04-18T10:42:49.505 INFO:tasks.workunit.client.0.smithi040.stdout:9/715: read d2/d3/d22/d2e/f76 [2351526,45870] 0 2024-04-18T10:42:49.507 INFO:tasks.workunit.client.0.smithi040.stdout:6/696: rename df/l86 to df/d4b/d6e/d3f/d53/d8a/d95/da7/lfe 0 2024-04-18T10:42:49.508 INFO:tasks.workunit.client.0.smithi040.stdout:6/697: stat df/d4b/db7/df6/ff9 0 2024-04-18T10:42:49.509 INFO:tasks.workunit.client.0.smithi040.stdout:7/659: link d6/d25/l23 d6/dc1/ld1 0 2024-04-18T10:42:49.510 INFO:tasks.workunit.client.0.smithi040.stdout:4/646: getdents d2/d3/d41/d47/da2 0 2024-04-18T10:42:49.510 INFO:tasks.workunit.client.0.smithi040.stdout:5/610: read d0/d3/fa4 [3562168,27514] 0 2024-04-18T10:42:49.518 INFO:tasks.workunit.client.0.smithi040.stdout:7/660: symlink d6/d25/d28/d2c/d2d/dbc/dd0/ld2 0 2024-04-18T10:42:49.519 INFO:tasks.workunit.client.0.smithi040.stdout:5/611: rmdir d0/d21/d42/d76 39 2024-04-18T10:42:49.519 INFO:tasks.workunit.client.0.smithi040.stdout:6/698: dread df/d4b/d7e/f83 [0,4194304] 0 2024-04-18T10:42:49.520 INFO:tasks.workunit.client.0.smithi040.stdout:7/661: fsync d6/d3e/d99/fa3 0 2024-04-18T10:42:49.522 INFO:tasks.workunit.client.0.smithi040.stdout:6/699: creat df/de8/fff x:0 0 0 2024-04-18T10:42:49.523 INFO:tasks.workunit.client.0.smithi040.stdout:5/612: rename d0/d78/l87 to d0/d3b/d3f/d72/lc9 0 2024-04-18T10:42:49.524 INFO:tasks.workunit.client.0.smithi040.stdout:5/613: chown d0/d21/d42/f7d 1906 1 2024-04-18T10:42:49.524 INFO:tasks.workunit.client.0.smithi040.stdout:4/647: dread d2/d3/d41/d47/d6f/f85 [0,4194304] 0 2024-04-18T10:42:49.525 INFO:tasks.workunit.client.0.smithi040.stdout:7/662: unlink d6/d25/d28/f4b 0 2024-04-18T10:42:49.526 INFO:tasks.workunit.client.0.smithi040.stdout:5/614: write d0/d3b/d3f/f65 [946261,45594] 0 2024-04-18T10:42:49.528 INFO:tasks.workunit.client.0.smithi040.stdout:3/713: dread d1/d7/d12/d7b/fb3 [0,4194304] 0 2024-04-18T10:42:49.528 INFO:tasks.workunit.client.0.smithi040.stdout:5/615: readlink d0/d3/d47/l9b 0 2024-04-18T10:42:49.530 INFO:tasks.workunit.client.0.smithi040.stdout:4/648: mknod d2/d3/d4/d1f/cb9 0 2024-04-18T10:42:49.530 INFO:tasks.workunit.client.0.smithi040.stdout:7/663: truncate d6/d25/d28/dac/d64/d7e/fb0 258780 0 2024-04-18T10:42:49.531 INFO:tasks.workunit.client.0.smithi040.stdout:9/716: dread d2/d5b/fae [0,4194304] 0 2024-04-18T10:42:49.531 INFO:tasks.workunit.client.0.smithi040.stdout:3/714: read d1/d2/d4e/f84 [1474598,67633] 0 2024-04-18T10:42:49.531 INFO:tasks.workunit.client.0.smithi040.stdout:0/725: sync 2024-04-18T10:42:49.532 INFO:tasks.workunit.client.0.smithi040.stdout:1/709: sync 2024-04-18T10:42:49.532 INFO:tasks.workunit.client.0.smithi040.stdout:6/700: rmdir df/d4b/ded 0 2024-04-18T10:42:49.534 INFO:tasks.workunit.client.0.smithi040.stdout:5/616: unlink d0/d4e/l6a 0 2024-04-18T10:42:49.539 INFO:tasks.workunit.client.0.smithi040.stdout:4/649: dwrite d2/d1a/f9c [0,4194304] 0 2024-04-18T10:42:49.539 INFO:tasks.workunit.client.0.smithi040.stdout:1/710: unlink d1/d1c/d2b/c9a 0 2024-04-18T10:42:49.541 INFO:tasks.workunit.client.0.smithi040.stdout:6/701: mknod df/d4b/d7e/c100 0 2024-04-18T10:42:49.551 INFO:tasks.workunit.client.0.smithi040.stdout:1/711: symlink d1/d9b/d75/d84/dac/dda/l101 0 2024-04-18T10:42:49.552 INFO:tasks.workunit.client.0.smithi040.stdout:5/617: dwrite d0/d3b/d3f/f45 [0,4194304] 0 2024-04-18T10:42:49.553 INFO:tasks.workunit.client.0.smithi040.stdout:5/618: chown d0/d78/d95/f5a 491 1 2024-04-18T10:42:49.554 INFO:tasks.workunit.client.0.smithi040.stdout:1/712: read d1/d16/d92/dad/fc0 [668636,39644] 0 2024-04-18T10:42:49.555 INFO:tasks.workunit.client.0.smithi040.stdout:6/702: creat df/d4b/d63/f101 x:0 0 0 2024-04-18T10:42:49.557 INFO:tasks.workunit.client.0.smithi040.stdout:0/726: unlink dd/df/d19/d28/d3a/d5b/l9c 0 2024-04-18T10:42:49.557 INFO:tasks.workunit.client.0.smithi040.stdout:2/647: truncate dd/f6f 274286 0 2024-04-18T10:42:49.558 INFO:tasks.workunit.client.0.smithi040.stdout:9/717: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d44/df9/f101 x:0 0 0 2024-04-18T10:42:49.563 INFO:tasks.workunit.client.0.smithi040.stdout:2/648: dwrite dd/d14/d2b/d7c/d37/d38/f57 [4194304,4194304] 0 2024-04-18T10:42:49.566 INFO:tasks.workunit.client.0.smithi040.stdout:6/703: creat df/d4b/d63/dbb/f102 x:0 0 0 2024-04-18T10:42:49.567 INFO:tasks.workunit.client.0.smithi040.stdout:3/715: getdents d1/d2/d4e 0 2024-04-18T10:42:49.568 INFO:tasks.workunit.client.0.smithi040.stdout:9/718: fdatasync d2/d3/d22/d2e/d35/daf/dc1/ffa 0 2024-04-18T10:42:49.570 INFO:tasks.workunit.client.0.smithi040.stdout:7/664: rename d6/d25/d28/d2c/d2d/d47/d5c/d6b/l8c to d6/ld3 0 2024-04-18T10:42:49.574 INFO:tasks.workunit.client.0.smithi040.stdout:5/619: creat d0/d3b/d3f/db1/fca x:0 0 0 2024-04-18T10:42:49.575 INFO:tasks.workunit.client.0.smithi040.stdout:2/649: fdatasync dd/d14/d2b/d7c/d37/d38/fc8 0 2024-04-18T10:42:49.575 INFO:tasks.workunit.client.0.smithi040.stdout:7/665: dwrite d6/d25/f3f [0,4194304] 0 2024-04-18T10:42:49.577 INFO:tasks.workunit.client.0.smithi040.stdout:2/650: chown dd/d14/d2b/d7c/d37/d38/d8c/c8f 335782 1 2024-04-18T10:42:49.577 INFO:tasks.workunit.client.0.smithi040.stdout:0/727: creat dd/df/d19/d28/d3a/d46/d107/f108 x:0 0 0 2024-04-18T10:42:49.578 INFO:tasks.workunit.client.0.smithi040.stdout:2/651: write dd/d14/f22 [3894304,1706] 0 2024-04-18T10:42:49.581 INFO:tasks.workunit.client.0.smithi040.stdout:3/716: creat d1/d7/d67/dc5/d91/db1/fec x:0 0 0 2024-04-18T10:42:49.583 INFO:tasks.workunit.client.0.smithi040.stdout:8/710: read d2/f6c [1185751,24598] 0 2024-04-18T10:42:49.584 INFO:tasks.workunit.client.0.smithi040.stdout:8/711: chown d2/d5/d9/d3c/d5a/f21 0 1 2024-04-18T10:42:49.585 INFO:tasks.workunit.client.0.smithi040.stdout:4/650: write d2/d3/d4/d1f/d29/d49/d31/fa8 [458770,2972] 0 2024-04-18T10:42:49.588 INFO:tasks.workunit.client.0.smithi040.stdout:1/713: rename d1/d16/d92/lcd to d1/d1c/d2b/d32/d36/l102 0 2024-04-18T10:42:49.588 INFO:tasks.workunit.client.0.smithi040.stdout:7/666: read d6/fa [5053737,92618] 0 2024-04-18T10:42:49.590 INFO:tasks.workunit.client.0.smithi040.stdout:7/667: write d6/d25/d28/d2c/d2d/d47/d55/d58/fc9 [858889,65662] 0 2024-04-18T10:42:49.595 INFO:tasks.workunit.client.0.smithi040.stdout:5/620: creat d0/d4e/dc2/fcb x:0 0 0 2024-04-18T10:42:49.596 INFO:tasks.workunit.client.0.smithi040.stdout:5/621: write d0/d78/d95/d52/d5d/f60 [1519756,56936] 0 2024-04-18T10:42:49.596 INFO:tasks.workunit.client.0.smithi040.stdout:8/712: fdatasync d2/d10/d6a/f70 0 2024-04-18T10:42:49.598 INFO:tasks.workunit.client.0.smithi040.stdout:8/713: truncate d2/d2c/da9/fbb 949020 0 2024-04-18T10:42:49.600 INFO:tasks.workunit.client.0.smithi040.stdout:9/719: rename d2/d3/d70/l83 to d2/d3/d22/d2e/d35/daf/dc1/d46/df3/l102 0 2024-04-18T10:42:49.600 INFO:tasks.workunit.client.0.smithi040.stdout:8/714: chown d2/d5/d9/d1b/c8a 14 1 2024-04-18T10:42:49.600 INFO:tasks.workunit.client.0.smithi040.stdout:0/728: dread dd/df/d19/d28/f53 [0,4194304] 0 2024-04-18T10:42:49.602 INFO:tasks.workunit.client.0.smithi040.stdout:0/729: chown dd/df/d19/d28/d3a/d42/fae 3450 1 2024-04-18T10:42:49.603 INFO:tasks.workunit.client.0.smithi040.stdout:2/652: mkdir dd/d61/d8e/d98/dcc/dd4 0 2024-04-18T10:42:49.608 INFO:tasks.workunit.client.0.smithi040.stdout:7/668: dread d6/f44 [0,4194304] 0 2024-04-18T10:42:49.609 INFO:tasks.workunit.client.0.smithi040.stdout:0/730: dwrite dd/df/d19/d28/d3a/d42/f81 [0,4194304] 0 2024-04-18T10:42:49.610 INFO:tasks.workunit.client.0.smithi040.stdout:7/669: write d6/d50/d79/da8/dad/fb9 [279627,81326] 0 2024-04-18T10:42:49.611 INFO:tasks.workunit.client.0.smithi040.stdout:1/714: mkdir d1/d9b/dcf/d103 0 2024-04-18T10:42:49.613 INFO:tasks.workunit.client.0.smithi040.stdout:9/720: creat d2/d3/d70/f103 x:0 0 0 2024-04-18T10:42:49.614 INFO:tasks.workunit.client.0.smithi040.stdout:8/715: symlink d2/d5/d9/d3c/lf9 0 2024-04-18T10:42:49.614 INFO:tasks.workunit.client.0.smithi040.stdout:8/716: chown d2/d10/d14/ca3 674208 1 2024-04-18T10:42:49.615 INFO:tasks.workunit.client.0.smithi040.stdout:8/717: chown d2/d22/d80/da2 2698 1 2024-04-18T10:42:49.615 INFO:tasks.workunit.client.0.smithi040.stdout:8/718: chown d2/d15/d2b/dd0 272871 1 2024-04-18T10:42:49.617 INFO:tasks.workunit.client.0.smithi040.stdout:2/653: mkdir dd/d14/d2b/d7c/d37/d38/d8c/dd5 0 2024-04-18T10:42:49.620 INFO:tasks.workunit.client.0.smithi040.stdout:4/651: truncate d2/d1a/f9c 1041063 0 2024-04-18T10:42:49.620 INFO:tasks.workunit.client.0.smithi040.stdout:2/654: dread - dd/d14/d2b/d7c/d37/d5b/dcf/fb3 zero size 2024-04-18T10:42:49.620 INFO:tasks.workunit.client.0.smithi040.stdout:5/622: getdents d0/d3/d47/dac 0 2024-04-18T10:42:49.621 INFO:tasks.workunit.client.0.smithi040.stdout:3/717: dwrite d1/d7/d3a/f3d [0,4194304] 0 2024-04-18T10:42:49.622 INFO:tasks.workunit.client.0.smithi040.stdout:1/715: readlink d1/d1c/l4a 0 2024-04-18T10:42:49.623 INFO:tasks.workunit.client.0.smithi040.stdout:6/704: link df/d4b/db7/dc1/lca df/d4b/d6e/l103 0 2024-04-18T10:42:49.624 INFO:tasks.workunit.client.0.smithi040.stdout:8/719: write d2/d5/d9/d3c/f6f [347098,19118] 0 2024-04-18T10:42:49.624 INFO:tasks.workunit.client.0.smithi040.stdout:1/716: dread - d1/db1/fec zero size 2024-04-18T10:42:49.624 INFO:tasks.workunit.client.0.smithi040.stdout:3/718: chown d1/d2/d4e/l56 7033581 1 2024-04-18T10:42:49.653 INFO:tasks.workunit.client.0.smithi040.stdout:8/720: dread - d2/d4c/fd1 zero size 2024-04-18T10:42:49.653 INFO:tasks.workunit.client.0.smithi040.stdout:4/652: symlink d2/d3/d4/dd/d4f/lba 0 2024-04-18T10:42:49.655 INFO:tasks.workunit.client.0.smithi040.stdout:7/670: creat d6/d25/d28/dac/d64/fd4 x:0 0 0 2024-04-18T10:42:49.655 INFO:tasks.workunit.client.0.smithi040.stdout:5/623: mkdir d0/d21/d42/dcc 0 2024-04-18T10:42:49.657 INFO:tasks.workunit.client.0.smithi040.stdout:0/731: dwrite dd/df/f44 [0,4194304] 0 2024-04-18T10:42:49.658 INFO:tasks.workunit.client.0.smithi040.stdout:9/721: write d2/f55 [2732962,66976] 0 2024-04-18T10:42:49.658 INFO:tasks.workunit.client.0.smithi040.stdout:6/705: dread df/d76/d91/fa5 [0,4194304] 0 2024-04-18T10:42:49.660 INFO:tasks.workunit.client.0.smithi040.stdout:9/722: stat d2/d3/f12 0 2024-04-18T10:42:49.660 INFO:tasks.workunit.client.0.smithi040.stdout:3/719: mknod d1/d2/d4e/d58/dbe/dc1/dde/ced 0 2024-04-18T10:42:49.660 INFO:tasks.workunit.client.0.smithi040.stdout:8/721: fdatasync d2/d10/d14/f9c 0 2024-04-18T10:42:49.660 INFO:tasks.workunit.client.0.smithi040.stdout:1/717: write d1/d1c/d2b/d32/fd9 [1277735,46338] 0 2024-04-18T10:42:49.662 INFO:tasks.workunit.client.0.smithi040.stdout:6/706: fdatasync df/d4b/d6a/d93/fc9 0 2024-04-18T10:42:49.662 INFO:tasks.workunit.client.0.smithi040.stdout:4/653: creat d2/d3/d41/d47/d99/fbb x:0 0 0 2024-04-18T10:42:49.663 INFO:tasks.workunit.client.0.smithi040.stdout:8/722: fsync d2/d10/d14/faa 0 2024-04-18T10:42:49.665 INFO:tasks.workunit.client.0.smithi040.stdout:3/720: truncate d1/d2/d4e/feb 138971 0 2024-04-18T10:42:49.665 INFO:tasks.workunit.client.0.smithi040.stdout:4/654: dread - d2/d3/d4/fb6 zero size 2024-04-18T10:42:49.665 INFO:tasks.workunit.client.0.smithi040.stdout:7/671: truncate d6/d25/d28/d2c/d2d/d47/d55/d58/fc9 1128235 0 2024-04-18T10:42:49.665 INFO:tasks.workunit.client.0.smithi040.stdout:6/707: chown df/d4b/d99/fa6 896907962 1 2024-04-18T10:42:49.666 INFO:tasks.workunit.client.0.smithi040.stdout:0/732: write dd/fd3 [925998,77212] 0 2024-04-18T10:42:49.666 INFO:tasks.workunit.client.0.smithi040.stdout:3/721: chown d1/d7/f15 88 1 2024-04-18T10:42:49.667 INFO:tasks.workunit.client.0.smithi040.stdout:4/655: chown d2/l5c 53934 1 2024-04-18T10:42:49.667 INFO:tasks.workunit.client.0.smithi040.stdout:5/624: getdents d0/d3 0 2024-04-18T10:42:49.669 INFO:tasks.workunit.client.0.smithi040.stdout:8/723: mknod d2/d10/cfa 0 2024-04-18T10:42:49.693 INFO:tasks.workunit.client.0.smithi040.stdout:6/708: mkdir df/d4b/d6a/d93/d104 0 2024-04-18T10:42:49.695 INFO:tasks.workunit.client.0.smithi040.stdout:9/723: truncate d2/d7/f29 2422324 0 2024-04-18T10:42:49.697 INFO:tasks.workunit.client.0.smithi040.stdout:1/718: dwrite d1/d9b/f70 [0,4194304] 0 2024-04-18T10:42:49.698 INFO:tasks.workunit.client.0.smithi040.stdout:8/724: write d2/d15/fd6 [1626859,101843] 0 2024-04-18T10:42:49.700 INFO:tasks.workunit.client.0.smithi040.stdout:6/709: write df/d4b/d6e/d3f/d53/d8a/d95/da7/fd3 [12928,13116] 0 2024-04-18T10:42:49.703 INFO:tasks.workunit.client.0.smithi040.stdout:9/724: getdents d2/d5b/d6f/dc3 0 2024-04-18T10:42:49.710 INFO:tasks.workunit.client.0.smithi040.stdout:9/725: write d2/d3/d22/d2e/d35/daf/dc7/dcf/fe7 [531057,100345] 0 2024-04-18T10:42:49.710 INFO:tasks.workunit.client.0.smithi040.stdout:1/719: dwrite d1/d1c/d7b/d2e/fd0 [0,4194304] 0 2024-04-18T10:42:49.710 INFO:tasks.workunit.client.0.smithi040.stdout:2/655: sync 2024-04-18T10:42:49.711 INFO:tasks.workunit.client.0.smithi040.stdout:8/725: dwrite d2/d2c/da9/fbb [0,4194304] 0 2024-04-18T10:42:49.712 INFO:tasks.workunit.client.0.smithi040.stdout:5/625: truncate d0/d21/d42/f7d 3503119 0 2024-04-18T10:42:49.713 INFO:tasks.workunit.client.0.smithi040.stdout:9/726: write d2/dd/f24 [813092,240] 0 2024-04-18T10:42:49.713 INFO:tasks.workunit.client.0.smithi040.stdout:3/722: dread d1/d2/f1f [0,4194304] 0 2024-04-18T10:42:49.715 INFO:tasks.workunit.client.0.smithi040.stdout:8/726: write d2/d5/d9/d3c/d68/fe3 [1015023,81244] 0 2024-04-18T10:42:49.717 INFO:tasks.workunit.client.0.smithi040.stdout:5/626: write d0/d78/d95/d52/d5d/f9e [203197,113913] 0 2024-04-18T10:42:49.717 INFO:tasks.workunit.client.0.smithi040.stdout:8/727: chown d2/d5/ldf 51613422 1 2024-04-18T10:42:49.721 INFO:tasks.workunit.client.0.smithi040.stdout:6/710: write df/d4b/d6e/d3f/f5c [4769897,44171] 0 2024-04-18T10:42:49.721 INFO:tasks.workunit.client.0.smithi040.stdout:1/720: dwrite d1/fc6 [0,4194304] 0 2024-04-18T10:42:49.722 INFO:tasks.workunit.client.0.smithi040.stdout:4/656: dread d2/d3/d4/d1f/d29/d49/d31/f61 [0,4194304] 0 2024-04-18T10:42:49.722 INFO:tasks.workunit.client.0.smithi040.stdout:6/711: read - df/d4b/d7e/f88 zero size 2024-04-18T10:42:49.724 INFO:tasks.workunit.client.0.smithi040.stdout:8/728: chown d2/d5/d9/d63/cb8 0 1 2024-04-18T10:42:49.724 INFO:tasks.workunit.client.0.smithi040.stdout:5/627: symlink d0/d3/d47/lcd 0 2024-04-18T10:42:49.724 INFO:tasks.workunit.client.0.smithi040.stdout:1/721: chown d1/d1c/d2b/d32/d36/d4d/cfb 3257 1 2024-04-18T10:42:49.724 INFO:tasks.workunit.client.0.smithi040.stdout:8/729: read d2/d22/f85 [4086894,62150] 0 2024-04-18T10:42:49.726 INFO:tasks.workunit.client.0.smithi040.stdout:3/723: creat d1/d7/db2/dc0/fee x:0 0 0 2024-04-18T10:42:49.726 INFO:tasks.workunit.client.0.smithi040.stdout:8/730: write d2/d5/f8b [199514,38830] 0 2024-04-18T10:42:49.726 INFO:tasks.workunit.client.0.smithi040.stdout:5/628: truncate d0/d3b/d3f/f65 4918858 0 2024-04-18T10:42:49.727 INFO:tasks.workunit.client.0.smithi040.stdout:9/727: getdents d2 0 2024-04-18T10:42:49.727 INFO:tasks.workunit.client.0.smithi040.stdout:8/731: chown d2/d22 140671 1 2024-04-18T10:42:49.728 INFO:tasks.workunit.client.0.smithi040.stdout:9/728: stat d2/dd/de/l62 0 2024-04-18T10:42:49.729 INFO:tasks.workunit.client.0.smithi040.stdout:4/657: creat d2/d3/d41/d62/d7c/fbc x:0 0 0 2024-04-18T10:42:49.730 INFO:tasks.workunit.client.0.smithi040.stdout:6/712: symlink df/d4b/d63/l105 0 2024-04-18T10:42:49.732 INFO:tasks.workunit.client.0.smithi040.stdout:1/722: symlink d1/d9b/d75/d84/dac/dda/l104 0 2024-04-18T10:42:49.732 INFO:tasks.workunit.client.0.smithi040.stdout:7/672: sync 2024-04-18T10:42:49.733 INFO:tasks.workunit.client.0.smithi040.stdout:0/733: sync 2024-04-18T10:42:49.735 INFO:tasks.workunit.client.0.smithi040.stdout:5/629: unlink d0/d78/d95/d52/d5d/f60 0 2024-04-18T10:42:49.736 INFO:tasks.workunit.client.0.smithi040.stdout:0/734: write dd/df/d19/fdf [930498,35585] 0 2024-04-18T10:42:49.737 INFO:tasks.workunit.client.0.smithi040.stdout:4/658: dread d2/d3/d2f/f46 [0,4194304] 0 2024-04-18T10:42:49.737 INFO:tasks.workunit.client.0.smithi040.stdout:9/729: creat d2/d3/d22/d2e/d35/d40/d85/f104 x:0 0 0 2024-04-18T10:42:49.739 INFO:tasks.workunit.client.0.smithi040.stdout:6/713: dread df/f55 [0,4194304] 0 2024-04-18T10:42:49.739 INFO:tasks.workunit.client.0.smithi040.stdout:5/630: chown d0/d21/la0 7974825 1 2024-04-18T10:42:49.741 INFO:tasks.workunit.client.0.smithi040.stdout:8/732: rmdir d2/d2c/dbe 0 2024-04-18T10:42:49.742 INFO:tasks.workunit.client.0.smithi040.stdout:9/730: write d2/d3/f12 [358694,32577] 0 2024-04-18T10:42:49.743 INFO:tasks.workunit.client.0.smithi040.stdout:0/735: mknod dd/df/d4e/dc3/c109 0 2024-04-18T10:42:49.743 INFO:tasks.workunit.client.0.smithi040.stdout:6/714: chown df/d76/d91/f9b 2 1 2024-04-18T10:42:49.744 INFO:tasks.workunit.client.0.smithi040.stdout:7/673: dread d6/d25/d28/d2c/d2d/d47/d55/d58/fc9 [0,4194304] 0 2024-04-18T10:42:49.744 INFO:tasks.workunit.client.0.smithi040.stdout:2/656: dread dd/f45 [0,4194304] 0 2024-04-18T10:42:49.745 INFO:tasks.workunit.client.0.smithi040.stdout:1/723: dwrite d1/fa5 [0,4194304] 0 2024-04-18T10:42:49.748 INFO:tasks.workunit.client.0.smithi040.stdout:7/674: readlink d6/d25/d28/d2c/d2d/d47/d55/d58/l83 0 2024-04-18T10:42:49.749 INFO:tasks.workunit.client.0.smithi040.stdout:8/733: unlink d2/d22/d80/fc4 0 2024-04-18T10:42:49.749 INFO:tasks.workunit.client.0.smithi040.stdout:7/675: write d6/f22 [72880,34948] 0 2024-04-18T10:42:49.750 INFO:tasks.workunit.client.0.smithi040.stdout:0/736: symlink dd/d62/l10a 0 2024-04-18T10:42:49.752 INFO:tasks.workunit.client.0.smithi040.stdout:5/631: dwrite d0/d3/f1a [0,4194304] 0 2024-04-18T10:42:49.757 INFO:tasks.workunit.client.0.smithi040.stdout:1/724: rename d1/d1c/d7b/d2e/da4/lbb to d1/d1c/d2b/d32/d36/l105 0 2024-04-18T10:42:49.758 INFO:tasks.workunit.client.0.smithi040.stdout:5/632: dwrite d0/fc8 [0,4194304] 0 2024-04-18T10:42:49.760 INFO:tasks.workunit.client.0.smithi040.stdout:8/734: write d2/d5/d9/d3c/d5a/d94/fe0 [111886,41151] 0 2024-04-18T10:42:49.765 INFO:tasks.workunit.client.0.smithi040.stdout:7/676: truncate d6/d25/d28/d2c/d2d/d47/d55/d58/f60 80926 0 2024-04-18T10:42:49.765 INFO:tasks.workunit.client.0.smithi040.stdout:9/731: write d2/d5b/d6f/d80/ddd/fde [198329,4256] 0 2024-04-18T10:42:49.766 INFO:tasks.workunit.client.0.smithi040.stdout:9/732: chown d2/dd/de/d7f 19 1 2024-04-18T10:42:49.767 INFO:tasks.workunit.client.0.smithi040.stdout:9/733: chown d2/d3/d22/d2e/d35/d40/f68 12052430 1 2024-04-18T10:42:49.767 INFO:tasks.workunit.client.0.smithi040.stdout:0/737: mkdir dd/d10b 0 2024-04-18T10:42:49.771 INFO:tasks.workunit.client.0.smithi040.stdout:6/715: link df/d4b/d63/db3/le3 df/de8/l106 0 2024-04-18T10:42:49.773 INFO:tasks.workunit.client.0.smithi040.stdout:7/677: dwrite d6/d25/d28/dac/d63/f86 [0,4194304] 0 2024-04-18T10:42:49.774 INFO:tasks.workunit.client.0.smithi040.stdout:9/734: creat d2/d5b/d6f/dc3/f105 x:0 0 0 2024-04-18T10:42:49.776 INFO:tasks.workunit.client.0.smithi040.stdout:8/735: symlink d2/d4c/lfb 0 2024-04-18T10:42:49.776 INFO:tasks.workunit.client.0.smithi040.stdout:3/724: dread d1/d7/d67/dc5/d91/fda [0,4194304] 0 2024-04-18T10:42:49.777 INFO:tasks.workunit.client.0.smithi040.stdout:6/716: mkdir df/d4b/db7/df6/d107 0 2024-04-18T10:42:49.779 INFO:tasks.workunit.client.0.smithi040.stdout:3/725: chown d1/d7/d28/fdd 1 1 2024-04-18T10:42:49.782 INFO:tasks.workunit.client.0.smithi040.stdout:8/736: getdents d2/d2c/dbf/dc2 0 2024-04-18T10:42:49.783 INFO:tasks.workunit.client.0.smithi040.stdout:3/726: chown d1/d2/d4e/d58/d62/d6b 13333 1 2024-04-18T10:42:49.783 INFO:tasks.workunit.client.0.smithi040.stdout:7/678: dread d6/d25/d28/f87 [0,4194304] 0 2024-04-18T10:42:49.783 INFO:tasks.workunit.client.0.smithi040.stdout:0/738: dwrite dd/fd6 [0,4194304] 0 2024-04-18T10:42:49.786 INFO:tasks.workunit.client.0.smithi040.stdout:9/735: getdents d2 0 2024-04-18T10:42:49.788 INFO:tasks.workunit.client.0.smithi040.stdout:9/736: write d2/d5b/d6f/d80/ddd/fde [93413,94830] 0 2024-04-18T10:42:49.788 INFO:tasks.workunit.client.0.smithi040.stdout:8/737: unlink d2/d5/d9/d63/ff3 0 2024-04-18T10:42:49.790 INFO:tasks.workunit.client.0.smithi040.stdout:3/727: mkdir d1/d2/d4e/d57/def 0 2024-04-18T10:42:49.791 INFO:tasks.workunit.client.0.smithi040.stdout:7/679: creat d6/d50/d79/d90/fd5 x:0 0 0 2024-04-18T10:42:49.791 INFO:tasks.workunit.client.0.smithi040.stdout:3/728: read d1/d7/d12/d7b/fb3 [2086535,7178] 0 2024-04-18T10:42:49.792 INFO:tasks.workunit.client.0.smithi040.stdout:6/717: dread df/d4b/d6a/fae [0,4194304] 0 2024-04-18T10:42:49.793 INFO:tasks.workunit.client.0.smithi040.stdout:0/739: creat dd/df/d19/d28/d3a/d46/d107/f10c x:0 0 0 2024-04-18T10:42:49.794 INFO:tasks.workunit.client.0.smithi040.stdout:8/738: symlink d2/d22/d80/da2/lfc 0 2024-04-18T10:42:49.797 INFO:tasks.workunit.client.0.smithi040.stdout:6/718: mkdir df/d108 0 2024-04-18T10:42:49.798 INFO:tasks.workunit.client.0.smithi040.stdout:9/737: dwrite d2/d3/d22/d2e/d35/daf/dc1/f1a [0,4194304] 0 2024-04-18T10:42:49.798 INFO:tasks.workunit.client.0.smithi040.stdout:7/680: rename d6/d25/d28/d2c/d2d/d47/f48 to d6/d25/d28/d2c/d3c/fd6 0 2024-04-18T10:42:49.799 INFO:tasks.workunit.client.0.smithi040.stdout:5/633: dread d0/d3b/d88/f94 [0,4194304] 0 2024-04-18T10:42:49.799 INFO:tasks.workunit.client.0.smithi040.stdout:8/739: mkdir d2/d15/d2b/d40/dfd 0 2024-04-18T10:42:49.801 INFO:tasks.workunit.client.0.smithi040.stdout:6/719: unlink df/d4b/db7/fdf 0 2024-04-18T10:42:49.802 INFO:tasks.workunit.client.0.smithi040.stdout:8/740: write d2/d5/d9/d63/fae [401599,122443] 0 2024-04-18T10:42:49.802 INFO:tasks.workunit.client.0.smithi040.stdout:7/681: readlink d6/d25/l1d 0 2024-04-18T10:42:49.802 INFO:tasks.workunit.client.0.smithi040.stdout:5/634: truncate d0/d3b/d3f/fb4 108133 0 2024-04-18T10:42:49.807 INFO:tasks.workunit.client.0.smithi040.stdout:9/738: mknod d2/dd/de/d7f/c106 0 2024-04-18T10:42:49.808 INFO:tasks.workunit.client.0.smithi040.stdout:6/720: readlink df/d4b/l73 0 2024-04-18T10:42:49.809 INFO:tasks.workunit.client.0.smithi040.stdout:4/659: sync 2024-04-18T10:42:49.809 INFO:tasks.workunit.client.0.smithi040.stdout:5/635: dwrite d0/d78/f9c [0,4194304] 0 2024-04-18T10:42:49.810 INFO:tasks.workunit.client.0.smithi040.stdout:5/636: chown d0/d78/d95/d52/d5d 282853885 1 2024-04-18T10:42:49.811 INFO:tasks.workunit.client.0.smithi040.stdout:8/741: unlink d2/d10/d14/f9c 0 2024-04-18T10:42:49.813 INFO:tasks.workunit.client.0.smithi040.stdout:5/637: read d0/d3b/d67/f84 [804254,37341] 0 2024-04-18T10:42:49.817 INFO:tasks.workunit.client.0.smithi040.stdout:6/721: creat df/d76/d91/f109 x:0 0 0 2024-04-18T10:42:49.818 INFO:tasks.workunit.client.0.smithi040.stdout:4/660: dread d2/f54 [0,4194304] 0 2024-04-18T10:42:49.820 INFO:tasks.workunit.client.0.smithi040.stdout:7/682: creat d6/d25/dcf/fd7 x:0 0 0 2024-04-18T10:42:49.824 INFO:tasks.workunit.client.0.smithi040.stdout:4/661: fdatasync d2/d3/d41/d62/d7c/fbc 0 2024-04-18T10:42:49.825 INFO:tasks.workunit.client.0.smithi040.stdout:9/739: dwrite d2/d5b/d6f/d80/d75/fb5 [4194304,4194304] 0 2024-04-18T10:42:49.825 INFO:tasks.workunit.client.0.smithi040.stdout:7/683: stat d6/d25/d28/d2c/d2d/dbc/dd0 0 2024-04-18T10:42:49.825 INFO:tasks.workunit.client.0.smithi040.stdout:5/638: dwrite d0/d4e/dc2/fcb [0,4194304] 0 2024-04-18T10:42:49.826 INFO:tasks.workunit.client.0.smithi040.stdout:3/729: dread d1/d7/d3a/f50 [0,4194304] 0 2024-04-18T10:42:49.830 INFO:tasks.workunit.client.0.smithi040.stdout:6/722: link df/d4b/d6e/f1e df/d4b/deb/df5/f10a 0 2024-04-18T10:42:49.832 INFO:tasks.workunit.client.0.smithi040.stdout:6/723: write df/d4b/d6e/d3f/f75 [107405,23734] 0 2024-04-18T10:42:49.832 INFO:tasks.workunit.client.0.smithi040.stdout:5/639: dread d0/d78/d95/d52/d5d/f9e [0,4194304] 0 2024-04-18T10:42:49.834 INFO:tasks.workunit.client.0.smithi040.stdout:3/730: truncate d1/f4f 30272 0 2024-04-18T10:42:49.837 INFO:tasks.workunit.client.0.smithi040.stdout:9/740: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/f107 x:0 0 0 2024-04-18T10:42:49.840 INFO:tasks.workunit.client.0.smithi040.stdout:3/731: mknod d1/d2/d4e/cf0 0 2024-04-18T10:42:49.840 INFO:tasks.workunit.client.0.smithi040.stdout:2/657: sync 2024-04-18T10:42:49.842 INFO:tasks.workunit.client.0.smithi040.stdout:4/662: creat d2/d3/d4/dd/fbd x:0 0 0 2024-04-18T10:42:49.842 INFO:tasks.workunit.client.0.smithi040.stdout:7/684: dwrite d6/d3e/d73/f76 [0,4194304] 0 2024-04-18T10:42:49.844 INFO:tasks.workunit.client.0.smithi040.stdout:9/741: mknod d2/d3/d70/da8/c108 0 2024-04-18T10:42:49.845 INFO:tasks.workunit.client.0.smithi040.stdout:1/725: dwrite d1/d1c/d7b/d2e/d3e/d85/ff9 [0,4194304] 0 2024-04-18T10:42:49.847 INFO:tasks.workunit.client.0.smithi040.stdout:5/640: dwrite d0/d78/f81 [0,4194304] 0 2024-04-18T10:42:49.847 INFO:tasks.workunit.client.0.smithi040.stdout:4/663: write d2/d3/d4/fb6 [968838,49010] 0 2024-04-18T10:42:49.848 INFO:tasks.workunit.client.0.smithi040.stdout:7/685: chown d6/d50/d79/d90/fa5 180 1 2024-04-18T10:42:49.848 INFO:tasks.workunit.client.0.smithi040.stdout:2/658: chown dd/d14/d2b/d7c/d37/d5b/dcf/fb3 1272971 1 2024-04-18T10:42:49.849 INFO:tasks.workunit.client.0.smithi040.stdout:5/641: read d0/d78/f8b [119255,6772] 0 2024-04-18T10:42:49.850 INFO:tasks.workunit.client.0.smithi040.stdout:9/742: write d2/d3/d22/d2e/fc0 [138826,109526] 0 2024-04-18T10:42:49.852 INFO:tasks.workunit.client.0.smithi040.stdout:1/726: truncate d1/d1c/d7b/d2e/d3e/d85/fd2 383672 0 2024-04-18T10:42:49.853 INFO:tasks.workunit.client.0.smithi040.stdout:4/664: truncate d2/d3/d41/d47/d6f/f85 599608 0 2024-04-18T10:42:49.854 INFO:tasks.workunit.client.0.smithi040.stdout:0/740: truncate dd/df/d19/f22 4933772 0 2024-04-18T10:42:49.855 INFO:tasks.workunit.client.0.smithi040.stdout:0/741: chown dd/df/c99 78145 1 2024-04-18T10:42:49.856 INFO:tasks.workunit.client.0.smithi040.stdout:7/686: creat d6/d25/d28/d2c/d2d/fd8 x:0 0 0 2024-04-18T10:42:49.856 INFO:tasks.workunit.client.0.smithi040.stdout:0/742: dread - dd/df/d19/d28/d3a/d5b/fff zero size 2024-04-18T10:42:49.857 INFO:tasks.workunit.client.0.smithi040.stdout:0/743: stat l1 0 2024-04-18T10:42:49.858 INFO:tasks.workunit.client.0.smithi040.stdout:7/687: dread - d6/d25/d28/d2c/d2d/d47/d55/d9f/fbb zero size 2024-04-18T10:42:49.858 INFO:tasks.workunit.client.0.smithi040.stdout:9/743: write d2/d5b/d6f/d80/feb [196618,44958] 0 2024-04-18T10:42:49.859 INFO:tasks.workunit.client.0.smithi040.stdout:7/688: write d6/d25/dcf/fd7 [471635,7902] 0 2024-04-18T10:42:49.860 INFO:tasks.workunit.client.0.smithi040.stdout:9/744: chown d2/d3/d22/d2e/d35/d40/d71/f78 7078 1 2024-04-18T10:42:49.864 INFO:tasks.workunit.client.0.smithi040.stdout:1/727: creat d1/d1c/d7b/d2e/da4/f106 x:0 0 0 2024-04-18T10:42:49.865 INFO:tasks.workunit.client.0.smithi040.stdout:2/659: mknod dd/d14/d2b/dbc/d5f/d82/da6/d52/da2/cd6 0 2024-04-18T10:42:49.866 INFO:tasks.workunit.client.0.smithi040.stdout:9/745: readlink d2/d3/l47 0 2024-04-18T10:42:49.867 INFO:tasks.workunit.client.0.smithi040.stdout:7/689: creat d6/d25/d28/d2c/d2d/d47/d5c/da2/db6/fd9 x:0 0 0 2024-04-18T10:42:49.868 INFO:tasks.workunit.client.0.smithi040.stdout:6/724: dread df/d76/db9/dbd/fbf [0,4194304] 0 2024-04-18T10:42:49.869 INFO:tasks.workunit.client.0.smithi040.stdout:5/642: creat d0/d21/d42/fce x:0 0 0 2024-04-18T10:42:49.870 INFO:tasks.workunit.client.0.smithi040.stdout:1/728: unlink d1/d1c/d7b/d2e/d3e/ff7 0 2024-04-18T10:42:49.870 INFO:tasks.workunit.client.0.smithi040.stdout:9/746: chown d2/d5b/fae 2028422445 1 2024-04-18T10:42:49.874 INFO:tasks.workunit.client.0.smithi040.stdout:6/725: creat df/d4b/d63/dbb/f10b x:0 0 0 2024-04-18T10:42:49.875 INFO:tasks.workunit.client.0.smithi040.stdout:5/643: creat d0/d4e/fcf x:0 0 0 2024-04-18T10:42:49.875 INFO:tasks.workunit.client.0.smithi040.stdout:4/665: dwrite d2/f54 [0,4194304] 0 2024-04-18T10:42:49.880 INFO:tasks.workunit.client.0.smithi040.stdout:9/747: fdatasync d2/d3/d22/d2e/d35/d40/d85/f9c 0 2024-04-18T10:42:49.882 INFO:tasks.workunit.client.0.smithi040.stdout:8/742: dwrite d2/d5/d9/d3c/f50 [0,4194304] 0 2024-04-18T10:42:49.882 INFO:tasks.workunit.client.0.smithi040.stdout:6/726: write df/d4b/d6a/d93/fc9 [700953,48299] 0 2024-04-18T10:42:49.885 INFO:tasks.workunit.client.0.smithi040.stdout:2/660: dwrite dd/d14/d2b/dbc/d5f/d82/d72/fc0 [0,4194304] 0 2024-04-18T10:42:49.888 INFO:tasks.workunit.client.0.smithi040.stdout:6/727: chown df/d4b/d6a/d93/f8e 1 1 2024-04-18T10:42:49.891 INFO:tasks.workunit.client.0.smithi040.stdout:9/748: write d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/ff5 [224558,555] 0 2024-04-18T10:42:49.891 INFO:tasks.workunit.client.0.smithi040.stdout:3/732: dread d1/d7/d28/d81/f85 [0,4194304] 0 2024-04-18T10:42:49.894 INFO:tasks.workunit.client.0.smithi040.stdout:5/644: dwrite d0/d21/fb8 [4194304,4194304] 0 2024-04-18T10:42:49.895 INFO:tasks.workunit.client.0.smithi040.stdout:2/661: fdatasync dd/d14/d2b/dbc/d5f/d82/da6/d6b/f9a 0 2024-04-18T10:42:49.897 INFO:tasks.workunit.client.0.smithi040.stdout:6/728: truncate df/d4b/d6e/d3f/d53/d8a/d95/f98 5158285 0 2024-04-18T10:42:49.897 INFO:tasks.workunit.client.0.smithi040.stdout:2/662: chown dd/d14/d2b/d7c 208 1 2024-04-18T10:42:49.899 INFO:tasks.workunit.client.0.smithi040.stdout:0/744: dread dd/df/f2b [0,4194304] 0 2024-04-18T10:42:49.899 INFO:tasks.workunit.client.0.smithi040.stdout:6/729: fdatasync df/d76/db9/fd0 0 2024-04-18T10:42:49.899 INFO:tasks.workunit.client.0.smithi040.stdout:0/745: chown dd/df/d19/d3e 11156 1 2024-04-18T10:42:49.899 INFO:tasks.workunit.client.0.smithi040.stdout:6/730: fsync df/f4d 0 2024-04-18T10:42:49.904 INFO:tasks.workunit.client.0.smithi040.stdout:5/645: symlink d0/d78/d95/d52/daf/ld0 0 2024-04-18T10:42:49.908 INFO:tasks.workunit.client.0.smithi040.stdout:0/746: symlink dd/df/d19/d28/d3a/d46/d107/l10d 0 2024-04-18T10:42:49.910 INFO:tasks.workunit.client.0.smithi040.stdout:3/733: write d1/d2/d4e/d58/d8e/fb0 [462207,16951] 0 2024-04-18T10:42:49.911 INFO:tasks.workunit.client.0.smithi040.stdout:5/646: dwrite d0/d3b/d3f/fbd [0,4194304] 0 2024-04-18T10:42:49.912 INFO:tasks.workunit.client.0.smithi040.stdout:0/747: symlink dd/daa/d101/l10e 0 2024-04-18T10:42:49.915 INFO:tasks.workunit.client.0.smithi040.stdout:0/748: mkdir dd/daa/dd8/d10f 0 2024-04-18T10:42:49.918 INFO:tasks.workunit.client.0.smithi040.stdout:7/690: dread d6/d25/d28/f4e [0,4194304] 0 2024-04-18T10:42:49.922 INFO:tasks.workunit.client.0.smithi040.stdout:7/691: rename d6/d25/d28/d2c/d2d/d47/ca0 to d6/d50/d79/da8/dad/cda 0 2024-04-18T10:42:49.924 INFO:tasks.workunit.client.0.smithi040.stdout:7/692: mknod d6/d50/cdb 0 2024-04-18T10:42:49.925 INFO:tasks.workunit.client.0.smithi040.stdout:1/729: sync 2024-04-18T10:42:49.927 INFO:tasks.workunit.client.0.smithi040.stdout:7/693: truncate d6/d25/d28/d2c/d2d/d47/d55/d58/fc9 68738 0 2024-04-18T10:42:49.929 INFO:tasks.workunit.client.0.smithi040.stdout:7/694: truncate d6/d50/f54 4634698 0 2024-04-18T10:42:49.930 INFO:tasks.workunit.client.0.smithi040.stdout:7/695: readlink d6/d25/d28/dac/d64/l74 0 2024-04-18T10:42:49.934 INFO:tasks.workunit.client.0.smithi040.stdout:7/696: rename d6/d50/d79/d90/fd5 to d6/d25/d28/d2c/d2d/d47/d5c/da2/fdc 0 2024-04-18T10:42:49.936 INFO:tasks.workunit.client.0.smithi040.stdout:8/743: truncate d2/d5/d9/d3c/d5a/f27 2238206 0 2024-04-18T10:42:49.938 INFO:tasks.workunit.client.0.smithi040.stdout:8/744: readlink d2/d22/d49/le2 0 2024-04-18T10:42:49.938 INFO:tasks.workunit.client.0.smithi040.stdout:2/663: write dd/f6f [819822,28646] 0 2024-04-18T10:42:49.939 INFO:tasks.workunit.client.0.smithi040.stdout:4/666: dwrite d2/d1a/f9c [0,4194304] 0 2024-04-18T10:42:49.940 INFO:tasks.workunit.client.0.smithi040.stdout:9/749: truncate d2/d3/f65 2410066 0 2024-04-18T10:42:49.942 INFO:tasks.workunit.client.0.smithi040.stdout:3/734: truncate d1/d2/f31 1943547 0 2024-04-18T10:42:49.943 INFO:tasks.workunit.client.0.smithi040.stdout:0/749: write dd/df/f15 [5605583,75523] 0 2024-04-18T10:42:49.944 INFO:tasks.workunit.client.0.smithi040.stdout:4/667: creat d2/d1a/d8e/fbe x:0 0 0 2024-04-18T10:42:49.947 INFO:tasks.workunit.client.0.smithi040.stdout:9/750: chown d2/c28 130754899 1 2024-04-18T10:42:49.948 INFO:tasks.workunit.client.0.smithi040.stdout:1/730: dread d1/d1c/d2b/d32/d36/d4d/fc2 [0,4194304] 0 2024-04-18T10:42:49.950 INFO:tasks.workunit.client.0.smithi040.stdout:6/731: dwrite df/d4b/d7e/f83 [0,4194304] 0 2024-04-18T10:42:49.951 INFO:tasks.workunit.client.0.smithi040.stdout:5/647: dread d0/f35 [0,4194304] 0 2024-04-18T10:42:49.952 INFO:tasks.workunit.client.0.smithi040.stdout:1/731: dread - d1/fc5 zero size 2024-04-18T10:42:49.952 INFO:tasks.workunit.client.0.smithi040.stdout:0/750: fdatasync dd/d91/fdb 0 2024-04-18T10:42:49.954 INFO:tasks.workunit.client.0.smithi040.stdout:2/664: rename dd/d14/d2b/d7c/d37/c48 to dd/d14/d2b/dbc/d5f/d82/da6/dce/cd7 0 2024-04-18T10:42:49.954 INFO:tasks.workunit.client.0.smithi040.stdout:5/648: chown d0/d4e/dc2 58532 1 2024-04-18T10:42:49.955 INFO:tasks.workunit.client.0.smithi040.stdout:2/665: readlink dd/l6e 0 2024-04-18T10:42:49.956 INFO:tasks.workunit.client.0.smithi040.stdout:8/745: dwrite d2/d5/d9/d3c/f52 [0,4194304] 0 2024-04-18T10:42:49.961 INFO:tasks.workunit.client.0.smithi040.stdout:0/751: creat dd/df/d19/d28/d3a/d5b/dd0/f110 x:0 0 0 2024-04-18T10:42:49.961 INFO:tasks.workunit.client.0.smithi040.stdout:8/746: write d2/d10/d14/fb6 [1825949,37526] 0 2024-04-18T10:42:49.963 INFO:tasks.workunit.client.0.smithi040.stdout:9/751: dwrite d2/d5b/d6f/d80/d75/fb5 [4194304,4194304] 0 2024-04-18T10:42:49.965 INFO:tasks.workunit.client.0.smithi040.stdout:5/649: truncate d0/d3/f7 1099413 0 2024-04-18T10:42:49.968 INFO:tasks.workunit.client.0.smithi040.stdout:6/732: rename df/d4b/d6e/d3f/d53/d8a/d95 to df/d4b/d99/dc4/d10c 0 2024-04-18T10:42:49.970 INFO:tasks.workunit.client.0.smithi040.stdout:2/666: creat dd/d14/d2b/dbc/d5f/d82/da6/dce/fd8 x:0 0 0 2024-04-18T10:42:49.971 INFO:tasks.workunit.client.0.smithi040.stdout:0/752: write dd/df/d19/d3e/fcc [4039666,94598] 0 2024-04-18T10:42:49.971 INFO:tasks.workunit.client.0.smithi040.stdout:8/747: mkdir d2/d5/d9/d3c/d68/dfe 0 2024-04-18T10:42:49.973 INFO:tasks.workunit.client.0.smithi040.stdout:5/650: rmdir d0/d21/d42 39 2024-04-18T10:42:49.973 INFO:tasks.workunit.client.0.smithi040.stdout:5/651: stat d0/f39 0 2024-04-18T10:42:49.977 INFO:tasks.workunit.client.0.smithi040.stdout:9/752: rename d2/d3/d22/d2e/d35/daf/dc7 to d2/d3/d22/d2e/d35/daf/dc1/d46/d86/d109 0 2024-04-18T10:42:49.980 INFO:tasks.workunit.client.0.smithi040.stdout:6/733: symlink df/d76/dc2/dce/l10d 0 2024-04-18T10:42:49.980 INFO:tasks.workunit.client.0.smithi040.stdout:9/753: write d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/fdc [272223,1163] 0 2024-04-18T10:42:49.985 INFO:tasks.workunit.client.0.smithi040.stdout:9/754: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d86/d109/dcf/f10a x:0 0 0 2024-04-18T10:42:49.987 INFO:tasks.workunit.client.0.smithi040.stdout:3/735: dread d1/f8b [0,4194304] 0 2024-04-18T10:42:49.988 INFO:tasks.workunit.client.0.smithi040.stdout:2/667: rename dd/f28 to dd/d14/d2b/dbc/d5f/d82/da6/db1/dc5/fd9 0 2024-04-18T10:42:49.999 INFO:tasks.workunit.client.0.smithi040.stdout:0/753: dwrite dd/df/d19/d28/f53 [0,4194304] 0 2024-04-18T10:42:49.999 INFO:tasks.workunit.client.0.smithi040.stdout:8/748: mkdir d2/d15/d2b/dd0/dff 0 2024-04-18T10:42:49.999 INFO:tasks.workunit.client.0.smithi040.stdout:5/652: symlink d0/d78/dc4/ld1 0 2024-04-18T10:42:50.002 INFO:tasks.workunit.client.0.smithi040.stdout:4/668: dread d2/d3/d4/d21/f7b [0,4194304] 0 2024-04-18T10:42:50.004 INFO:tasks.workunit.client.0.smithi040.stdout:0/754: write dd/df/d19/d3e/ffc [790672,112148] 0 2024-04-18T10:42:50.004 INFO:tasks.workunit.client.0.smithi040.stdout:8/749: chown d2/d5/d9/d3c/l4e 550 1 2024-04-18T10:42:50.005 INFO:tasks.workunit.client.0.smithi040.stdout:1/732: truncate d1/d1c/d7b/d2e/da4/fbd 1368839 0 2024-04-18T10:42:50.006 INFO:tasks.workunit.client.0.smithi040.stdout:8/750: readlink d2/d15/l5c 0 2024-04-18T10:42:50.007 INFO:tasks.workunit.client.0.smithi040.stdout:3/736: dread d1/d2/d4e/d58/d62/d6b/f92 [0,4194304] 0 2024-04-18T10:42:50.007 INFO:tasks.workunit.client.0.smithi040.stdout:4/669: dread - d2/d3/d41/d47/d6f/f8a zero size 2024-04-18T10:42:50.009 INFO:tasks.workunit.client.0.smithi040.stdout:5/653: unlink d0/d21/fb8 0 2024-04-18T10:42:50.009 INFO:tasks.workunit.client.0.smithi040.stdout:0/755: stat dd/df/d19/d3e/d77/lac 0 2024-04-18T10:42:50.009 INFO:tasks.workunit.client.0.smithi040.stdout:2/668: unlink dd/d14/d2b/dbc/f73 0 2024-04-18T10:42:50.011 INFO:tasks.workunit.client.0.smithi040.stdout:9/755: dwrite d2/d3/d22/d2e/f7b [0,4194304] 0 2024-04-18T10:42:50.011 INFO:tasks.workunit.client.0.smithi040.stdout:8/751: fdatasync d2/d5/d9/d3c/d68/f88 0 2024-04-18T10:42:50.014 INFO:tasks.workunit.client.0.smithi040.stdout:1/733: rmdir d1/d1c/d2b/d32/d36/d4d/d67/dcb 39 2024-04-18T10:42:50.014 INFO:tasks.workunit.client.0.smithi040.stdout:9/756: readlink d2/dd/de/d7f/lf1 0 2024-04-18T10:42:50.015 INFO:tasks.workunit.client.0.smithi040.stdout:7/697: sync 2024-04-18T10:42:50.017 INFO:tasks.workunit.client.0.smithi040.stdout:2/669: mkdir dd/d14/d2b/d7c/d37/d5b/dda 0 2024-04-18T10:42:50.022 INFO:tasks.workunit.client.0.smithi040.stdout:1/734: mkdir d1/d1c/d7b/d2e/da4/d107 0 2024-04-18T10:42:50.023 INFO:tasks.workunit.client.0.smithi040.stdout:3/737: link d1/d2/d4e/l5c d1/d7/d67/dc5/lf1 0 2024-04-18T10:42:50.025 INFO:tasks.workunit.client.0.smithi040.stdout:5/654: dwrite d0/d78/f81 [0,4194304] 0 2024-04-18T10:42:50.025 INFO:tasks.workunit.client.0.smithi040.stdout:4/670: dwrite d2/d3/d4/dd/d6d/fb3 [0,4194304] 0 2024-04-18T10:42:50.027 INFO:tasks.workunit.client.0.smithi040.stdout:7/698: creat d6/d25/d28/d2c/d2d/d47/d5c/d6b/fdd x:0 0 0 2024-04-18T10:42:50.030 INFO:tasks.workunit.client.0.smithi040.stdout:9/757: dwrite d2/d3/d22/d2e/d35/daf/dc1/ffa [0,4194304] 0 2024-04-18T10:42:50.032 INFO:tasks.workunit.client.0.smithi040.stdout:5/655: rmdir d0/d3/d6b 39 2024-04-18T10:42:50.032 INFO:tasks.workunit.client.0.smithi040.stdout:9/758: read - d2/d3/d22/d2e/d35/d40/d71/fee zero size 2024-04-18T10:42:50.035 INFO:tasks.workunit.client.0.smithi040.stdout:1/735: write d1/d1c/d2b/d32/d36/d4d/d67/fd4 [27184,78149] 0 2024-04-18T10:42:50.036 INFO:tasks.workunit.client.0.smithi040.stdout:4/671: symlink d2/d3/d41/d47/d6f/lbf 0 2024-04-18T10:42:50.039 INFO:tasks.workunit.client.0.smithi040.stdout:4/672: read d2/d3/d4/fb6 [130774,59771] 0 2024-04-18T10:42:50.040 INFO:tasks.workunit.client.0.smithi040.stdout:9/759: dwrite d2/d5b/d6f/d80/feb [0,4194304] 0 2024-04-18T10:42:50.040 INFO:tasks.workunit.client.0.smithi040.stdout:4/673: readlink d2/d3/d4/dd/d4f/l55 0 2024-04-18T10:42:50.041 INFO:tasks.workunit.client.0.smithi040.stdout:2/670: getdents dd/d14/d2b/dbc/d5f/d82/da6 0 2024-04-18T10:42:50.049 INFO:tasks.workunit.client.0.smithi040.stdout:8/752: dread d2/f5b [0,4194304] 0 2024-04-18T10:42:50.049 INFO:tasks.workunit.client.0.smithi040.stdout:9/760: dwrite d2/d3/d22/d2e/d35/daf/dc1/d46/d44/ffb [0,4194304] 0 2024-04-18T10:42:50.049 INFO:tasks.workunit.client.0.smithi040.stdout:0/756: truncate dd/df/d19/d28/f33 3236073 0 2024-04-18T10:42:50.051 INFO:tasks.workunit.client.0.smithi040.stdout:4/674: symlink d2/d3/d41/d62/d7c/lc0 0 2024-04-18T10:42:50.052 INFO:tasks.workunit.client.0.smithi040.stdout:4/675: fdatasync d2/d3/d2f/f56 0 2024-04-18T10:42:50.054 INFO:tasks.workunit.client.0.smithi040.stdout:5/656: creat d0/d78/fd2 x:0 0 0 2024-04-18T10:42:50.056 INFO:tasks.workunit.client.0.smithi040.stdout:9/761: read d2/d3/d22/d2e/d35/d40/d85/ff2 [837019,93730] 0 2024-04-18T10:42:50.057 INFO:tasks.workunit.client.0.smithi040.stdout:4/676: mknod d2/d3/d4/dd/d4f/cc1 0 2024-04-18T10:42:50.057 INFO:tasks.workunit.client.0.smithi040.stdout:6/734: sync 2024-04-18T10:42:50.059 INFO:tasks.workunit.client.0.smithi040.stdout:0/757: creat dd/df/d19/d28/d3a/d5b/dd0/df7/f111 x:0 0 0 2024-04-18T10:42:50.060 INFO:tasks.workunit.client.0.smithi040.stdout:2/671: getdents dd/d14 0 2024-04-18T10:42:50.061 INFO:tasks.workunit.client.0.smithi040.stdout:8/753: dwrite d2/d5/d9/fb [0,4194304] 0 2024-04-18T10:42:50.062 INFO:tasks.workunit.client.0.smithi040.stdout:5/657: chown d0/d3/l8 33490490 1 2024-04-18T10:42:50.063 INFO:tasks.workunit.client.0.smithi040.stdout:0/758: dread - dd/df/d19/d3e/d77/fb2 zero size 2024-04-18T10:42:50.065 INFO:tasks.workunit.client.0.smithi040.stdout:9/762: truncate d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/fdc 495575 0 2024-04-18T10:42:50.066 INFO:tasks.workunit.client.0.smithi040.stdout:9/763: chown d2/dd/cd9 232 1 2024-04-18T10:42:50.067 INFO:tasks.workunit.client.0.smithi040.stdout:0/759: chown dd/df/d19/d3e/d77/fa2 120614966 1 2024-04-18T10:42:50.068 INFO:tasks.workunit.client.0.smithi040.stdout:5/658: symlink d0/d3b/d67/dc7/ld3 0 2024-04-18T10:42:50.069 INFO:tasks.workunit.client.0.smithi040.stdout:0/760: write dd/df/d4e/dc3/fe3 [823632,10250] 0 2024-04-18T10:42:50.070 INFO:tasks.workunit.client.0.smithi040.stdout:9/764: write d2/d5b/fae [1398440,53849] 0 2024-04-18T10:42:50.070 INFO:tasks.workunit.client.0.smithi040.stdout:5/659: creat d0/d3b/d67/dc7/fd4 x:0 0 0 2024-04-18T10:42:50.071 INFO:tasks.workunit.client.0.smithi040.stdout:0/761: fdatasync dd/df/d19/d28/d3a/d42/fb0 0 2024-04-18T10:42:50.072 INFO:tasks.workunit.client.0.smithi040.stdout:4/677: dread d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:50.075 INFO:tasks.workunit.client.0.smithi040.stdout:5/660: unlink d0/d3/d6b/d7b/cc0 0 2024-04-18T10:42:50.083 INFO:tasks.workunit.client.0.smithi040.stdout:9/765: link d2/d3/d70/c7d d2/d3/d22/d2e/d35/d40/d100/c10b 0 2024-04-18T10:42:50.084 INFO:tasks.workunit.client.0.smithi040.stdout:3/738: sync 2024-04-18T10:42:50.084 INFO:tasks.workunit.client.0.smithi040.stdout:0/762: getdents dd/df/d19/dba 0 2024-04-18T10:42:50.085 INFO:tasks.workunit.client.0.smithi040.stdout:5/661: truncate d0/d21/d42/f7d 2978788 0 2024-04-18T10:42:50.087 INFO:tasks.workunit.client.0.smithi040.stdout:9/766: mkdir d2/d3/d22/d2e/d35/daf/dc1/d46/d44/d8d/d10c 0 2024-04-18T10:42:50.089 INFO:tasks.workunit.client.0.smithi040.stdout:7/699: truncate d6/d25/d28/dac/d63/f86 106337 0 2024-04-18T10:42:50.091 INFO:tasks.workunit.client.0.smithi040.stdout:0/763: fdatasync dd/df/d19/d28/f33 0 2024-04-18T10:42:50.093 INFO:tasks.workunit.client.0.smithi040.stdout:1/736: dread d1/fa [0,4194304] 0 2024-04-18T10:42:50.094 INFO:tasks.workunit.client.0.smithi040.stdout:9/767: truncate d2/d5b/d6f/d80/f8b 820657 0 2024-04-18T10:42:50.094 INFO:tasks.workunit.client.0.smithi040.stdout:5/662: mkdir d0/d3/d47/dd5 0 2024-04-18T10:42:50.096 INFO:tasks.workunit.client.0.smithi040.stdout:3/739: mknod d1/d2/d4e/d58/dbe/dc1/dc2/dea/cf2 0 2024-04-18T10:42:50.096 INFO:tasks.workunit.client.0.smithi040.stdout:9/768: truncate d2/d3/d22/fd1 1222970 0 2024-04-18T10:42:50.096 INFO:tasks.workunit.client.0.smithi040.stdout:3/740: read d1/f8b [3201164,20996] 0 2024-04-18T10:42:50.098 INFO:tasks.workunit.client.0.smithi040.stdout:0/764: creat dd/daa/dd8/f112 x:0 0 0 2024-04-18T10:42:50.098 INFO:tasks.workunit.client.0.smithi040.stdout:9/769: chown d2/dd/de/l2d 49932252 1 2024-04-18T10:42:50.098 INFO:tasks.workunit.client.0.smithi040.stdout:0/765: chown dd/d10b 1 1 2024-04-18T10:42:50.100 INFO:tasks.workunit.client.0.smithi040.stdout:9/770: write d2/d3/d22/db3/fb7 [3636575,109287] 0 2024-04-18T10:42:50.100 INFO:tasks.workunit.client.0.smithi040.stdout:1/737: write d1/d1c/d2b/d32/f4e [1361011,32960] 0 2024-04-18T10:42:50.118 INFO:tasks.workunit.client.0.smithi040.stdout:0/766: mkdir dd/daa/dd8/d113 0 2024-04-18T10:42:50.118 INFO:tasks.workunit.client.0.smithi040.stdout:2/672: write dd/d14/d2b/dbc/f99 [49872,105551] 0 2024-04-18T10:42:50.119 INFO:tasks.workunit.client.0.smithi040.stdout:8/754: truncate d2/d22/d80/fba 4170658 0 2024-04-18T10:42:50.119 INFO:tasks.workunit.client.0.smithi040.stdout:5/663: dwrite d0/d3b/d3f/db1/fca [0,4194304] 0 2024-04-18T10:42:50.120 INFO:tasks.workunit.client.0.smithi040.stdout:1/738: readlink d1/d1c/d7b/l4c 0 2024-04-18T10:42:50.122 INFO:tasks.workunit.client.0.smithi040.stdout:9/771: chown d2/d5b/d6f/d80/ddd/fde 257230 1 2024-04-18T10:42:50.124 INFO:tasks.workunit.client.0.smithi040.stdout:0/767: readlink dd/df/d19/d3e/lad 0 2024-04-18T10:42:50.129 INFO:tasks.workunit.client.0.smithi040.stdout:6/735: dwrite df/d4b/d6a/fe6 [4194304,4194304] 0 2024-04-18T10:42:50.130 INFO:tasks.workunit.client.0.smithi040.stdout:5/664: mkdir d0/d3b/d3f/d72/dd6 0 2024-04-18T10:42:50.131 INFO:tasks.workunit.client.0.smithi040.stdout:0/768: chown dd/df/d19/d28/d3a/c5f 375777480 1 2024-04-18T10:42:50.133 INFO:tasks.workunit.client.0.smithi040.stdout:4/678: dwrite d2/d3/d4/dd/d4f/f8c [4194304,4194304] 0 2024-04-18T10:42:50.134 INFO:tasks.workunit.client.0.smithi040.stdout:2/673: rename dd/d14/d2b/c8b to dd/d14/d2b/dbc/d5f/d82/da6/d49/cdb 0 2024-04-18T10:42:50.136 INFO:tasks.workunit.client.0.smithi040.stdout:7/700: dwrite d6/d25/d28/f36 [4194304,4194304] 0 2024-04-18T10:42:50.139 INFO:tasks.workunit.client.0.smithi040.stdout:0/769: write dd/f49 [2310922,19963] 0 2024-04-18T10:42:50.141 INFO:tasks.workunit.client.0.smithi040.stdout:0/770: read dd/df/d19/d3e/d77/fa2 [2055980,28752] 0 2024-04-18T10:42:50.142 INFO:tasks.workunit.client.0.smithi040.stdout:6/736: truncate df/d4b/d6a/d93/f46 3898393 0 2024-04-18T10:42:50.142 INFO:tasks.workunit.client.0.smithi040.stdout:5/665: symlink d0/d21/d42/dcc/ld7 0 2024-04-18T10:42:50.143 INFO:tasks.workunit.client.0.smithi040.stdout:1/739: getdents d1/d1c/d2b/db5/dd6 0 2024-04-18T10:42:50.143 INFO:tasks.workunit.client.0.smithi040.stdout:0/771: stat dd/df/d19/d28/d3a/d46/d107/f10c 0 2024-04-18T10:42:50.147 INFO:tasks.workunit.client.0.smithi040.stdout:9/772: getdents d2/dd 0 2024-04-18T10:42:50.148 INFO:tasks.workunit.client.0.smithi040.stdout:2/674: rename dd/d14/d2b/d7c/cb6 to dd/d14/d2b/dbc/d5f/d82/da6/d6b/cdc 0 2024-04-18T10:42:50.148 INFO:tasks.workunit.client.0.smithi040.stdout:4/679: mknod d2/d3/d4/dd/cc2 0 2024-04-18T10:42:50.150 INFO:tasks.workunit.client.0.smithi040.stdout:1/740: symlink d1/d1c/d2b/d32/d36/l108 0 2024-04-18T10:42:50.152 INFO:tasks.workunit.client.0.smithi040.stdout:6/737: dwrite df/d4b/d6e/d3f/d53/d8a/fdb [0,4194304] 0 2024-04-18T10:42:50.152 INFO:tasks.workunit.client.0.smithi040.stdout:7/701: link d6/d25/d28/d2c/d2d/d47/f52 d6/d25/d28/dac/d63/fde 0 2024-04-18T10:42:50.154 INFO:tasks.workunit.client.0.smithi040.stdout:9/773: symlink d2/d5b/l10d 0 2024-04-18T10:42:50.154 INFO:tasks.workunit.client.0.smithi040.stdout:0/772: dwrite dd/df/d19/d28/d3a/d5b/dd0/f110 [0,4194304] 0 2024-04-18T10:42:50.155 INFO:tasks.workunit.client.0.smithi040.stdout:7/702: chown d6/d50/fb5 90687483 1 2024-04-18T10:42:50.158 INFO:tasks.workunit.client.0.smithi040.stdout:3/741: sync 2024-04-18T10:42:50.159 INFO:tasks.workunit.client.0.smithi040.stdout:2/675: mknod dd/d14/d2b/d7c/d37/d38/d8c/dd5/cdd 0 2024-04-18T10:42:50.162 INFO:tasks.workunit.client.0.smithi040.stdout:1/741: truncate d1/d1c/d2b/d32/d36/d4d/d67/faf 469770 0 2024-04-18T10:42:50.164 INFO:tasks.workunit.client.0.smithi040.stdout:8/755: truncate d2/d15/d78/fcb 1576855 0 2024-04-18T10:42:50.164 INFO:tasks.workunit.client.0.smithi040.stdout:5/666: link d0/d3/cc d0/d4e/cd8 0 2024-04-18T10:42:50.166 INFO:tasks.workunit.client.0.smithi040.stdout:7/703: creat d6/d25/d28/dac/fdf x:0 0 0 2024-04-18T10:42:50.167 INFO:tasks.workunit.client.0.smithi040.stdout:6/738: dwrite df/d76/dc2/fc8 [0,4194304] 0 2024-04-18T10:42:50.167 INFO:tasks.workunit.client.0.smithi040.stdout:4/680: dwrite d2/d3/d2f/f46 [0,4194304] 0 2024-04-18T10:42:50.170 INFO:tasks.workunit.client.0.smithi040.stdout:2/676: symlink dd/d14/d2b/d7c/lde 0 2024-04-18T10:42:50.171 INFO:tasks.workunit.client.0.smithi040.stdout:4/681: readlink d2/d3/d4/d21/d28/d3f/l1c 0 2024-04-18T10:42:50.172 INFO:tasks.workunit.client.0.smithi040.stdout:2/677: fdatasync dd/d14/d2b/f2e 0 2024-04-18T10:42:50.174 INFO:tasks.workunit.client.0.smithi040.stdout:4/682: write d2/d3/d2f/f9f [847545,48191] 0 2024-04-18T10:42:50.175 INFO:tasks.workunit.client.0.smithi040.stdout:5/667: stat d0/d3/f36 0 2024-04-18T10:42:50.176 INFO:tasks.workunit.client.0.smithi040.stdout:8/756: dwrite d2/d22/fcc [0,4194304] 0 2024-04-18T10:42:50.177 INFO:tasks.workunit.client.0.smithi040.stdout:6/739: mknod df/d4b/d7e/c10e 0 2024-04-18T10:42:50.180 INFO:tasks.workunit.client.0.smithi040.stdout:1/742: mknod d1/d9b/d75/c109 0 2024-04-18T10:42:50.181 INFO:tasks.workunit.client.0.smithi040.stdout:7/704: dread d6/d25/d28/d2c/f4d [0,4194304] 0 2024-04-18T10:42:50.182 INFO:tasks.workunit.client.0.smithi040.stdout:6/740: creat df/d4b/d99/f10f x:0 0 0 2024-04-18T10:42:50.187 INFO:tasks.workunit.client.0.smithi040.stdout:5/668: dwrite d0/d4e/f4c [0,4194304] 0 2024-04-18T10:42:50.190 INFO:tasks.workunit.client.0.smithi040.stdout:8/757: rename d2/d5/d9/f29 to d2/d4c/f100 0 2024-04-18T10:42:50.191 INFO:tasks.workunit.client.0.smithi040.stdout:8/758: symlink d2/d4c/d97/l101 0 2024-04-18T10:42:50.193 INFO:tasks.workunit.client.0.smithi040.stdout:8/759: truncate d2/d5/d9/d3c/f95 443380 0 2024-04-18T10:42:50.194 INFO:tasks.workunit.client.0.smithi040.stdout:5/669: dread d0/d21/d42/f6c [0,4194304] 0 2024-04-18T10:42:50.197 INFO:tasks.workunit.client.0.smithi040.stdout:8/760: creat d2/d5/d9/d3c/f102 x:0 0 0 2024-04-18T10:42:50.198 INFO:tasks.workunit.client.0.smithi040.stdout:5/670: mknod d0/cd9 0 2024-04-18T10:42:50.200 INFO:tasks.workunit.client.0.smithi040.stdout:8/761: creat d2/d15/d2b/d40/dfd/f103 x:0 0 0 2024-04-18T10:42:50.201 INFO:tasks.workunit.client.0.smithi040.stdout:8/762: write d2/d15/fd6 [4902205,8527] 0 2024-04-18T10:42:50.203 INFO:tasks.workunit.client.0.smithi040.stdout:8/763: write d2/d4c/f100 [4938403,86035] 0 2024-04-18T10:42:50.204 INFO:tasks.workunit.client.0.smithi040.stdout:5/671: dwrite d0/d3b/d3f/f40 [0,4194304] 0 2024-04-18T10:42:50.207 INFO:tasks.workunit.client.0.smithi040.stdout:5/672: fdatasync d0/d3b/d3f/f62 0 2024-04-18T10:42:50.208 INFO:tasks.workunit.client.0.smithi040.stdout:8/764: creat d2/d10/d14/f104 x:0 0 0 2024-04-18T10:42:50.214 INFO:tasks.workunit.client.0.smithi040.stdout:5/673: dwrite d0/d3b/d3f/fbd [0,4194304] 0 2024-04-18T10:42:50.215 INFO:tasks.workunit.client.0.smithi040.stdout:8/765: dwrite d2/d15/d78/fed [0,4194304] 0 2024-04-18T10:42:50.217 INFO:tasks.workunit.client.0.smithi040.stdout:5/674: write d0/f19 [913947,73653] 0 2024-04-18T10:42:50.217 INFO:tasks.workunit.client.0.smithi040.stdout:8/766: fsync d2/d15/d78/fee 0 2024-04-18T10:42:50.229 INFO:tasks.workunit.client.0.smithi040.stdout:9/774: write d2/d7/f5a [1635578,80110] 0 2024-04-18T10:42:50.229 INFO:tasks.workunit.client.0.smithi040.stdout:0/773: write dd/d91/fdd [1165711,53266] 0 2024-04-18T10:42:50.231 INFO:tasks.workunit.client.0.smithi040.stdout:9/775: dread d2/dd/f98 [0,4194304] 0 2024-04-18T10:42:50.235 INFO:tasks.workunit.client.0.smithi040.stdout:4/683: write d2/d3/f68 [527170,50186] 0 2024-04-18T10:42:50.235 INFO:tasks.workunit.client.0.smithi040.stdout:1/743: truncate d1/d1c/f56 2392183 0 2024-04-18T10:42:50.236 INFO:tasks.workunit.client.0.smithi040.stdout:7/705: write d6/f1f [222829,69746] 0 2024-04-18T10:42:50.238 INFO:tasks.workunit.client.0.smithi040.stdout:4/684: fsync d2/d3/d41/d47/d6f/f8a 0 2024-04-18T10:42:50.239 INFO:tasks.workunit.client.0.smithi040.stdout:9/776: dwrite d2/d3/d70/f103 [0,4194304] 0 2024-04-18T10:42:50.240 INFO:tasks.workunit.client.0.smithi040.stdout:4/685: write d2/d3/f68 [291737,56646] 0 2024-04-18T10:42:50.241 INFO:tasks.workunit.client.0.smithi040.stdout:3/742: sync 2024-04-18T10:42:50.241 INFO:tasks.workunit.client.0.smithi040.stdout:2/678: sync 2024-04-18T10:42:50.244 INFO:tasks.workunit.client.0.smithi040.stdout:3/743: chown d1/d7/d67/dc5/c27 144414187 1 2024-04-18T10:42:50.244 INFO:tasks.workunit.client.0.smithi040.stdout:9/777: symlink d2/d3/d97/l10e 0 2024-04-18T10:42:50.246 INFO:tasks.workunit.client.0.smithi040.stdout:1/744: dwrite d1/d1c/d2b/d32/d36/f38 [0,4194304] 0 2024-04-18T10:42:50.246 INFO:tasks.workunit.client.0.smithi040.stdout:8/767: write d2/f67 [547934,110101] 0 2024-04-18T10:42:50.248 INFO:tasks.workunit.client.0.smithi040.stdout:2/679: mkdir dd/d14/d2b/dbc/d5f/d82/da6/db1/ddf 0 2024-04-18T10:42:50.251 INFO:tasks.workunit.client.0.smithi040.stdout:3/744: chown d1/d2/d16/c24 127111 1 2024-04-18T10:42:50.254 INFO:tasks.workunit.client.0.smithi040.stdout:9/778: dwrite d2/d3/d22/d2e/f63 [0,4194304] 0 2024-04-18T10:42:50.256 INFO:tasks.workunit.client.0.smithi040.stdout:4/686: dread d2/d3/d4/d1f/d29/d49/f65 [0,4194304] 0 2024-04-18T10:42:50.257 INFO:tasks.workunit.client.0.smithi040.stdout:4/687: write d2/d3/d2f/f7e [3363089,123615] 0 2024-04-18T10:42:50.262 INFO:tasks.workunit.client.0.smithi040.stdout:3/745: creat d1/d7/d67/dba/ff3 x:0 0 0 2024-04-18T10:42:50.268 INFO:tasks.workunit.client.0.smithi040.stdout:2/680: link dd/f6f dd/d14/d2b/d7c/d37/d5b/fe0 0 2024-04-18T10:42:50.268 INFO:tasks.workunit.client.0.smithi040.stdout:3/746: dwrite d1/d2/d16/f40 [0,4194304] 0 2024-04-18T10:42:50.269 INFO:tasks.workunit.client.0.smithi040.stdout:3/747: rename d1 to d1/d7/dd9/df4 22 2024-04-18T10:42:50.271 INFO:tasks.workunit.client.0.smithi040.stdout:4/688: link d2/d3/d4/dd/f48 d2/d3/d4/dd/d4f/fc3 0 2024-04-18T10:42:50.271 INFO:tasks.workunit.client.0.smithi040.stdout:9/779: getdents d2/d3/d22/d2e/d35/daf/dc1/d46/d86/d109 0 2024-04-18T10:42:50.273 INFO:tasks.workunit.client.0.smithi040.stdout:4/689: readlink d2/d3/d4/d1f/d29/d49/l60 0 2024-04-18T10:42:50.276 INFO:tasks.workunit.client.0.smithi040.stdout:2/681: rename dd/d14/d2b/dbc/d5f/d82/d72/fc0 to dd/d14/d2b/dbc/d5f/fe1 0 2024-04-18T10:42:50.277 INFO:tasks.workunit.client.0.smithi040.stdout:2/682: dread - dd/d14/d2b/d7c/d37/d38/fc8 zero size 2024-04-18T10:42:50.278 INFO:tasks.workunit.client.0.smithi040.stdout:0/774: dread dd/df/d19/d28/d3a/f4d [0,4194304] 0 2024-04-18T10:42:50.279 INFO:tasks.workunit.client.0.smithi040.stdout:9/780: mknod d2/d3/c10f 0 2024-04-18T10:42:50.281 INFO:tasks.workunit.client.0.smithi040.stdout:2/683: mkdir dd/d14/d2b/dbc/d5f/d82/da6/dce/de2 0 2024-04-18T10:42:50.281 INFO:tasks.workunit.client.0.smithi040.stdout:1/745: truncate d1/d1c/d7b/d2e/d39/f4f 3381577 0 2024-04-18T10:42:50.284 INFO:tasks.workunit.client.0.smithi040.stdout:0/775: unlink dd/d91/fbf 0 2024-04-18T10:42:50.284 INFO:tasks.workunit.client.0.smithi040.stdout:6/741: sync 2024-04-18T10:42:50.286 INFO:tasks.workunit.client.0.smithi040.stdout:6/742: write df/d4b/d6e/d3f/d53/d8a/fdb [4562319,41618] 0 2024-04-18T10:42:50.288 INFO:tasks.workunit.client.0.smithi040.stdout:1/746: write d1/d16/d92/dad/fbe [2395803,101013] 0 2024-04-18T10:42:50.288 INFO:tasks.workunit.client.0.smithi040.stdout:6/743: chown df/f4d 27922 1 2024-04-18T10:42:50.291 INFO:tasks.workunit.client.0.smithi040.stdout:3/748: getdents d1/d2/d4e/d58/dbe/dc1/dc2/dea 0 2024-04-18T10:42:50.292 INFO:tasks.workunit.client.0.smithi040.stdout:9/781: dwrite d2/d3/f4e [0,4194304] 0 2024-04-18T10:42:50.293 INFO:tasks.workunit.client.0.smithi040.stdout:9/782: dread - d2/d7/f51 zero size 2024-04-18T10:42:50.294 INFO:tasks.workunit.client.0.smithi040.stdout:0/776: symlink dd/l114 0 2024-04-18T10:42:50.296 INFO:tasks.workunit.client.0.smithi040.stdout:8/768: dread d2/f67 [0,4194304] 0 2024-04-18T10:42:50.297 INFO:tasks.workunit.client.0.smithi040.stdout:8/769: dread - d2/d22/fa4 zero size 2024-04-18T10:42:50.298 INFO:tasks.workunit.client.0.smithi040.stdout:8/770: write d2/d15/f82 [2352882,15632] 0 2024-04-18T10:42:50.298 INFO:tasks.workunit.client.0.smithi040.stdout:4/690: truncate d2/d3/d4/d21/d28/d3f/f39 3409282 0 2024-04-18T10:42:50.299 INFO:tasks.workunit.client.0.smithi040.stdout:3/749: stat d1/d7/d67/dc5/d3b/l96 0 2024-04-18T10:42:50.300 INFO:tasks.workunit.client.0.smithi040.stdout:4/691: fsync d2/d3/d2f/f35 0 2024-04-18T10:42:50.301 INFO:tasks.workunit.client.0.smithi040.stdout:3/750: fdatasync d1/d7/d67/f76 0 2024-04-18T10:42:50.301 INFO:tasks.workunit.client.0.smithi040.stdout:9/783: creat d2/d3/d22/d2e/d35/daf/dc1/d46/d86/d109/f110 x:0 0 0 2024-04-18T10:42:50.303 INFO:tasks.workunit.client.0.smithi040.stdout:6/744: mkdir df/d76/d110 0 2024-04-18T10:42:50.305 INFO:tasks.workunit.client.0.smithi040.stdout:6/745: stat df/d4b/d7e/f83 0 2024-04-18T10:42:50.307 INFO:tasks.workunit.client.0.smithi040.stdout:1/747: dwrite d1/d1c/d2b/d32/d36/d4d/d67/dcb/fd8 [0,4194304] 0 2024-04-18T10:42:50.311 INFO:tasks.workunit.client.0.smithi040.stdout:2/684: dwrite dd/d14/f47 [0,4194304] 0 2024-04-18T10:42:50.313 INFO:tasks.workunit.client.0.smithi040.stdout:3/751: dwrite d1/d7/d67/f76 [0,4194304] 0 2024-04-18T10:42:50.314 INFO:tasks.workunit.client.0.smithi040.stdout:3/752: write d1/d2/d3c/f83 [1678694,123777] 0 2024-04-18T10:42:50.315 INFO:tasks.workunit.client.0.smithi040.stdout:8/771: creat d2/d22/d49/f105 x:0 0 0 2024-04-18T10:42:50.317 INFO:tasks.workunit.client.0.smithi040.stdout:6/746: mknod df/d4b/db7/dcc/de5/c111 0 2024-04-18T10:42:50.323 INFO:tasks.workunit.client.0.smithi040.stdout:1/748: mknod d1/d1c/d7b/d2e/d9e/c10a 0 2024-04-18T10:42:50.323 INFO:tasks.workunit.client.0.smithi040.stdout:6/747: read df/d4b/d6a/d93/f31 [364176,51685] 0 2024-04-18T10:42:50.324 INFO:tasks.workunit.client.0.smithi040.stdout:1/749: chown d1/d9b/d75/d84/dac/dda/de0/ce8 25796977 1 2024-04-18T10:42:50.324 INFO:tasks.workunit.client.0.smithi040.stdout:2/685: mknod dd/d14/d2b/dbc/d5f/ce3 0 2024-04-18T10:42:50.325 INFO:tasks.workunit.client.0.smithi040.stdout:5/675: sync 2024-04-18T10:42:50.325 INFO:tasks.workunit.client.0.smithi040.stdout:7/706: sync 2024-04-18T10:42:50.325 INFO:tasks.workunit.client.0.smithi040.stdout:6/748: write df/d4b/d99/ff1 [3187301,85737] 0 2024-04-18T10:42:50.329 INFO:tasks.workunit.client.0.smithi040.stdout:7/707: truncate d6/d25/d28/d2c/d2d/d47/d5c/da2/db6/fd9 851846 0 2024-04-18T10:42:50.329 INFO:tasks.workunit.client.0.smithi040.stdout:4/692: link d2/l5c d2/d3/d4/lc4 0 2024-04-18T10:42:50.330 INFO:tasks.workunit.client.0.smithi040.stdout:0/777: link dd/df/d19/d28/d3a/lc2 dd/d62/l115 0 2024-04-18T10:42:50.331 INFO:tasks.workunit.client.0.smithi040.stdout:5/676: creat d0/d3b/d67/fda x:0 0 0 2024-04-18T10:42:50.332 INFO:tasks.workunit.client.0.smithi040.stdout:6/749: symlink df/d4b/d6a/l112 0 2024-04-18T10:42:50.333 INFO:tasks.workunit.client.0.smithi040.stdout:5/677: write d0/d21/d42/f4f [5288518,932] 0 2024-04-18T10:42:50.333 INFO:tasks.workunit.client.0.smithi040.stdout:8/772: mkdir d2/d106 0 2024-04-18T10:42:50.334 INFO:tasks.workunit.client.0.smithi040.stdout:3/753: rename d1/d7/d67/dc5/d3b/lab to d1/d7/dd9/lf5 0 2024-04-18T10:42:50.335 INFO:tasks.workunit.client.0.smithi040.stdout:3/754: chown d1/d7/d67/dc5 504918100 1 2024-04-18T10:42:50.336 INFO:tasks.workunit.client.0.smithi040.stdout:9/784: getdents d2/d3/d22/d2e/d35 0 2024-04-18T10:42:50.336 INFO:tasks.workunit.client.0.smithi040.stdout:4/693: unlink d2/d3/d4/d1f/l3a 0 2024-04-18T10:42:50.337 INFO:tasks.workunit.client.0.smithi040.stdout:1/750: mknod d1/d1c/d2b/d32/d7e/c10b 0 2024-04-18T10:42:50.339 INFO:tasks.workunit.client.0.smithi040.stdout:6/750: creat df/d4b/d63/dbb/f113 x:0 0 0 2024-04-18T10:42:50.341 INFO:tasks.workunit.client.0.smithi040.stdout:6/751: write df/d4b/d6e/d3f/d53/d8a/fac [1181281,7335] 0 2024-04-18T10:42:50.341 INFO:tasks.workunit.client.0.smithi040.stdout:8/773: chown d2/d15/d78/c99 672150443 1 2024-04-18T10:42:50.343 INFO:tasks.workunit.client.0.smithi040.stdout:9/785: truncate d2/d5b/d6f/d80/fe6 960384 0 2024-04-18T10:42:50.349 INFO:tasks.workunit.client.0.smithi040.stdout:6/752: dwrite df/f4d [0,4194304] 0 2024-04-18T10:42:50.351 INFO:tasks.workunit.client.0.smithi040.stdout:3/755: unlink d1/d2/d4e/feb 0 2024-04-18T10:42:50.353 INFO:tasks.workunit.client.0.smithi040.stdout:4/694: link d2/d3/d4/dd/fa9 d2/d3/d4/dd/d4f/fc5 0 2024-04-18T10:42:50.354 INFO:tasks.workunit.client.0.smithi040.stdout:0/778: dread dd/df/d19/d28/d3a/d42/f59 [0,4194304] 0 2024-04-18T10:42:50.355 INFO:tasks.workunit.client.0.smithi040.stdout:2/686: dread dd/d14/d2b/fc3 [0,4194304] 0 2024-04-18T10:42:50.359 INFO:tasks.workunit.client.0.smithi040.stdout:4/695: dwrite d2/d3/d2f/f46 [0,4194304] 0 2024-04-18T10:42:50.360 INFO:tasks.workunit.client.0.smithi040.stdout:8/774: creat d2/d4c/dd2/f107 x:0 0 0 2024-04-18T10:42:50.376 INFO:tasks.workunit.client.0.smithi040.stdout:9/786: link d2/d3/d22/d2e/d35/d40/d85/f104 d2/df0/f111 0 2024-04-18T10:42:50.377 INFO:tasks.workunit.client.0.smithi040.stdout:2/687: unlink dd/f17 0 2024-04-18T10:42:50.377 INFO:tasks.workunit.client.0.smithi040.stdout:5/678: dread d0/d78/f9c [0,4194304] 0 2024-04-18T10:42:50.378 INFO:tasks.workunit.client.0.smithi040.stdout:7/708: truncate d6/f94 6985595 0 2024-04-18T10:42:50.380 INFO:tasks.workunit.client.0.smithi040.stdout:4/696: chown d2/d3/d4/d21/d28/d3f/f39 1 1 2024-04-18T10:42:50.381 INFO:tasks.workunit.client.0.smithi040.stdout:1/751: truncate d1/d1c/d2b/d32/d36/f50 6919823 0 2024-04-18T10:42:50.383 INFO:tasks.workunit.client.0.smithi040.stdout:7/709: write d6/d25/d28/d2c/f4c [3716419,106307] 0 2024-04-18T10:42:50.383 INFO:tasks.workunit.client.0.smithi040.stdout:3/756: dwrite d1/d2/d4e/d58/d62/faa [0,4194304] 0 2024-04-18T10:42:50.384 INFO:tasks.workunit.client.0.smithi040.stdout:5/679: symlink d0/d21/d42/dcc/ldb 0 2024-04-18T10:42:50.384 INFO:tasks.workunit.client.0.smithi040.stdout:2/688: mkdir dd/d14/d2b/d7c/d37/de4 0 2024-04-18T10:42:50.385 INFO:tasks.workunit.client.0.smithi040.stdout:1/752: fsync d1/d1c/d7b/d2d/f6c 0 2024-04-18T10:42:50.386 INFO:tasks.workunit.client.0.smithi040.stdout:2/689: read dd/d14/f47 [833409,70779] 0 2024-04-18T10:42:50.388 INFO:tasks.workunit.client.0.smithi040.stdout:2/690: write dd/d14/d2b/d7c/d37/fd1 [746657,83254] 0 2024-04-18T10:42:50.391 INFO:tasks.workunit.client.0.smithi040.stdout:4/697: fsync d2/d3/d4/dd/fa9 0 2024-04-18T10:42:50.396 INFO:tasks.workunit.client.0.smithi040.stdout:9/787: dread d2/d3/d22/d2e/d35/d40/d71/f78 [0,4194304] 0 2024-04-18T10:42:50.396 INFO:tasks.workunit.client.0.smithi040.stdout:5/680: mkdir d0/d3/d6b/d7b/ddc 0 2024-04-18T10:42:50.397 INFO:tasks.workunit.client.0.smithi040.stdout:9/788: dread - d2/dd/de/fda zero size 2024-04-18T10:42:50.398 INFO:tasks.workunit.client.0.smithi040.stdout:8/775: truncate d2/d2c/da9/fbc 142974 0 2024-04-18T10:42:50.398 INFO:tasks.workunit.client.0.smithi040.stdout:6/753: link df/d4b/d99/ca8 df/c114 0 2024-04-18T10:42:50.401 INFO:tasks.workunit.client.0.smithi040.stdout:6/754: stat df/d76/d91 0 2024-04-18T10:42:50.402 INFO:tasks.workunit.client.0.smithi040.stdout:8/776: rename d2/d22 to d2/d22/d80/da2/d108 22 2024-04-18T10:42:50.402 INFO:tasks.workunit.client.0.smithi040.stdout:4/698: rmdir d2/d3/d4/dd 39 2024-04-18T10:42:50.402 INFO:tasks.workunit.client.0.smithi040.stdout:4/699: chown d2/d3/f59 16329 1 2024-04-18T10:42:50.405 INFO:tasks.workunit.client.0.smithi040.stdout:6/755: dread df/d4b/d6a/d93/f56 [0,4194304] 0 2024-04-18T10:42:50.409 INFO:tasks.workunit.client.0.smithi040.stdout:0/779: sync 2024-04-18T10:42:50.409 INFO:tasks.workunit.client.0.smithi040.stdout:5/681: rmdir d0/d3b 39 2024-04-18T10:42:50.410 INFO:tasks.workunit.client.0.smithi040.stdout:7/710: unlink d6/d3e/d73/cc0 0 2024-04-18T10:42:50.411 INFO:tasks.workunit.client.0.smithi040.stdout:7/711: fdatasync d6/d50/d79/d90/fa5 0 2024-04-18T10:42:50.412 INFO:tasks.workunit.client.0.smithi040.stdout:7/712: readlink d6/d50/l7c 0 2024-04-18T10:42:50.414 INFO:tasks.workunit.client.0.smithi040.stdout:9/789: unlink d2/dd/de/f61 0 2024-04-18T10:42:50.417 INFO:tasks.workunit.client.0.smithi040.stdout:7/713: dwrite d6/d3e/d99/fa3 [0,4194304] 0 2024-04-18T10:42:50.418 INFO:tasks.workunit.client.0.smithi040.stdout:7/714: fsync d6/d25/d28/d2c/d2d/fd8 0 2024-04-18T10:42:50.419 INFO:tasks.workunit.client.0.smithi040.stdout:6/756: creat df/d4b/db7/dcc/dd6/f115 x:0 0 0 2024-04-18T10:42:50.422 INFO:tasks.workunit.client.0.smithi040.stdout:2/691: link dd/d14/d2b/d7c/l40 dd/d14/d2b/dbc/d5f/d82/d72/le5 0 2024-04-18T10:42:50.425 INFO:tasks.workunit.client.0.smithi040.stdout:9/790: rename d2/d3/d22/d2e/f7b to d2/d3/d70/da8/f112 0 2024-04-18T10:42:50.426 INFO:tasks.workunit.client.0.smithi040.stdout:9/791: dread - d2/d3/d70/da8/ffd zero size 2024-04-18T10:42:50.426 INFO:tasks.workunit.client.0.smithi040.stdout:4/700: truncate d2/d3/d2f/f56 4188948 0 2024-04-18T10:42:50.427 INFO:tasks.workunit.client.0.smithi040.stdout:9/792: write d2/d3/d70/fb2 [1250140,66309] 0 2024-04-18T10:42:50.428 INFO:tasks.workunit.client.0.smithi040.stdout:3/757: rmdir d1/d2/d4e/d57/def 0 2024-04-18T10:42:50.430 INFO:tasks.workunit.client.0.smithi040.stdout:5/682: unlink d0/d3b/d3f/db1/fca 0 2024-04-18T10:42:50.431 INFO:tasks.workunit.client.0.smithi040.stdout:0/780: link dd/df/d19/f8c dd/df/d19/d28/d3a/d46/d107/f116 0 2024-04-18T10:42:50.431 INFO:tasks.workunit.client.0.smithi040.stdout:6/757: creat df/d4b/d6a/d93/f116 x:0 0 0 2024-04-18T10:42:50.433 INFO:tasks.workunit.client.0.smithi040.stdout:1/753: getdents d1/d1c/d2b/d32 0 2024-04-18T10:42:50.433 INFO:tasks.workunit.client.0.smithi040.stdout:8/777: link d2/d5/d9/d3c/ce4 d2/d4c/d97/c109 0 2024-04-18T10:42:50.435 INFO:tasks.workunit.client.0.smithi040.stdout:2/692: rename dd/c1e to dd/d61/d8e/d98/dcc/ce6 0 2024-04-18T10:42:50.436 INFO:tasks.workunit.client.0.smithi040.stdout:3/758: dwrite d1/d2/d16/f2d [0,4194304] 0 2024-04-18T10:42:50.437 INFO:tasks.workunit.client.0.smithi040.stdout:3/759: readlink d1/l11 0 2024-04-18T10:42:50.439 INFO:tasks.workunit.client.0.smithi040.stdout:7/715: mknod d6/d25/d28/d2c/ce0 0 2024-04-18T10:42:50.441 INFO:tasks.workunit.client.0.smithi040.stdout:1/754: symlink d1/d1c/d2b/db5/dcc/l10c 0 2024-04-18T10:42:50.443 INFO:tasks.workunit.client.0.smithi040.stdout:5/683: mknod d0/d3/d6b/d7b/ddc/cdd 0 2024-04-18T10:42:50.444 INFO:tasks.workunit.client.0.smithi040.stdout:8/778: dwrite d2/d5/d9/d3c/fc8 [0,4194304] 0 2024-04-18T10:42:50.445 INFO:tasks.workunit.client.0.smithi040.stdout:1/755: chown d1/d1c/d7b/d2e/d3e/c5f 850 1 2024-04-18T10:42:50.446 INFO:tasks.workunit.client.0.smithi040.stdout:6/758: creat df/d4b/db7/df6/d107/f117 x:0 0 0 2024-04-18T10:42:50.448 INFO:tasks.workunit.client.0.smithi040.stdout:2/693: mknod dd/d14/d2b/dbc/d5f/d82/da6/d52/ce7 0 2024-04-18T10:42:50.448 INFO:tasks.workunit.client.0.smithi040.stdout:0/781: dread dd/df/d19/d28/d3a/d5b/fa6 [0,4194304] 0 2024-04-18T10:42:50.449 INFO:tasks.workunit.client.0.smithi040.stdout:3/760: unlink d1/d7/d67/dc5/d91/fda 0 2024-04-18T10:42:50.450 INFO:tasks.workunit.client.0.smithi040.stdout:0/782: readlink dd/df/d19/d28/d3a/d46/l78 0 2024-04-18T10:42:50.450 INFO:tasks.workunit.client.0.smithi040.stdout:3/761: readlink d1/d7/d67/dc5/d3b/l75 0 2024-04-18T10:42:50.450 INFO:tasks.workunit.client.0.smithi040.stdout:7/716: dread d6/d25/d28/f66 [0,4194304] 0 2024-04-18T10:42:50.450 INFO:tasks.workunit.client.0.smithi040.stdout:3/762: readlink d1/lf 0 2024-04-18T10:42:50.456 INFO:tasks.workunit.client.0.smithi040.stdout:2/694: creat dd/d14/d2b/d7c/d37/d38/fe8 x:0 0 0 2024-04-18T10:42:50.462 INFO:tasks.workunit.client.0.smithi040.stdout:5/684: creat d0/d3/dba/fde x:0 0 0 2024-04-18T10:42:50.464 INFO:tasks.workunit.client.0.smithi040.stdout:7/717: fsync d6/d25/d28/d2c/d2d/d47/d5c/da2/fdc 0 2024-04-18T10:42:50.468 INFO:tasks.workunit.client.0.smithi040.stdout:6/759: symlink df/d76/db9/dbd/l118 0 2024-04-18T10:42:50.470 INFO:tasks.workunit.client.0.smithi040.stdout:9/793: truncate d2/d3/d22/d2e/d35/d40/d71/f78 3316175 0 2024-04-18T10:42:50.472 INFO:tasks.workunit.client.0.smithi040.stdout:7/718: write d6/d25/d28/d2c/d2d/d47/d5c/f97 [481733,92547] 0 2024-04-18T10:42:50.472 INFO:tasks.workunit.client.0.smithi040.stdout:8/779: link d2/ca1 d2/d15/d78/c10a 0 2024-04-18T10:42:50.475 INFO:tasks.workunit.client.0.smithi040.stdout:6/760: unlink df/d4b/d6e/d3f/d53/l69 0 2024-04-18T10:42:50.479 INFO:tasks.workunit.client.0.smithi040.stdout:5/685: creat d0/d78/d95/fdf x:0 0 0 2024-04-18T10:42:50.480 INFO:tasks.workunit.client.0.smithi040.stdout:3/763: dread d1/d7/d67/dc5/f65 [0,4194304] 0 2024-04-18T10:42:50.480 INFO:tasks.workunit.client.0.smithi040.stdout:4/701: truncate d2/d3/d4/dd/d6d/d70/f7d 3632900 0 2024-04-18T10:42:50.481 INFO:tasks.workunit.client.0.smithi040.stdout:9/794: fdatasync d2/d3/f41 0 2024-04-18T10:42:50.486 INFO:tasks.workunit.client.0.smithi040.stdout:8/780: dwrite d2/d5/d9/f9d [0,4194304] 0 2024-04-18T10:42:50.486 INFO:tasks.workunit.client.0.smithi040.stdout:5/686: chown d0/d78/d95/db7/cbf 16 1 2024-04-18T10:42:50.488 INFO:tasks.workunit.client.0.smithi040.stdout:3/764: chown d1/d7/d12/fe1 51 1 2024-04-18T10:42:50.488 INFO:tasks.workunit.client.0.smithi040.stdout:6/761: creat df/d4b/d99/dc4/d10c/f119 x:0 0 0 2024-04-18T10:42:50.488 INFO:tasks.workunit.client.0.smithi040.stdout:7/719: dwrite d6/d25/d28/d2c/d2d/d47/d5c/d6b/fdd [0,4194304] 0 2024-04-18T10:42:50.489 INFO:tasks.workunit.client.0.smithi040.stdout:4/702: chown d2/d3/d4/dd/d4f/f5f 40 1 2024-04-18T10:42:50.492 INFO:tasks.workunit.client.0.smithi040.stdout:1/756: dwrite d1/d9b/d75/d84/f99 [0,4194304] 0 2024-04-18T10:42:50.492 INFO:tasks.workunit.client.0.smithi040.stdout:5/687: chown d0/d78/d95/c5b 161973 1 2024-04-18T10:42:50.493 INFO:tasks.workunit.client.0.smithi040.stdout:8/781: fdatasync d2/d15/d2b/d40/dfd/f103 0 2024-04-18T10:42:50.495 INFO:tasks.workunit.client.0.smithi040.stdout:6/762: rmdir df/d4b/db7/dcc 39 2024-04-18T10:42:50.495 INFO:tasks.workunit.client.0.smithi040.stdout:0/783: dwrite dd/df/d19/d3e/d77/fa2 [0,4194304] 0 2024-04-18T10:42:50.498 INFO:tasks.workunit.client.0.smithi040.stdout:9/795: mknod d2/d3/d22/d2e/d35/daf/dc1/d46/d86/d109/c113 0 2024-04-18T10:42:50.499 INFO:tasks.workunit.client.0.smithi040.stdout:5/688: creat d0/d4e/fe0 x:0 0 0 2024-04-18T10:42:50.499 INFO:tasks.workunit.client.0.smithi040.stdout:4/703: mknod d2/d3/d4/d1f/d29/d49/d31/cc6 0 2024-04-18T10:42:50.499 INFO:tasks.workunit.client.0.smithi040.stdout:8/782: write d2/d5/d9/d3c/d68/fb0 [69337,109993] 0 2024-04-18T10:42:50.500 INFO:tasks.workunit.client.0.smithi040.stdout:1/757: mknod d1/d16/d92/c10d 0 2024-04-18T10:42:50.501 INFO:tasks.workunit.client.0.smithi040.stdout:6/763: truncate df/d76/db9/fd0 728003 0 2024-04-18T10:42:50.502 INFO:tasks.workunit.client.0.smithi040.stdout:7/720: mkdir d6/d25/d28/d2c/d2d/d47/d55/d9f/de1 0 2024-04-18T10:42:50.502 INFO:tasks.workunit.client.0.smithi040.stdout:8/783: write d2/d22/fce [1047362,8385] 0 2024-04-18T10:42:50.503 INFO:tasks.workunit.client.0.smithi040.stdout:9/796: truncate d2/dd/de/fda 759954 0 2024-04-18T10:42:50.504 INFO:tasks.workunit.client.0.smithi040.stdout:4/704: mkdir d2/d3/d41/d94/dc7 0 2024-04-18T10:42:50.505 INFO:tasks.workunit.client.0.smithi040.stdout:1/758: read d1/d9b/d75/d84/f99 [729346,20164] 0 2024-04-18T10:42:50.506 INFO:tasks.workunit.client.0.smithi040.stdout:8/784: write d2/d15/fd6 [3965523,71193] 0 2024-04-18T10:42:50.507 INFO:tasks.workunit.client.0.smithi040.stdout:4/705: stat d2/d3/d4/dd/f69 0 2024-04-18T10:42:50.507 INFO:tasks.workunit.client.0.smithi040.stdout:3/765: dwrite d1/f8b [0,4194304] 0 2024-04-18T10:42:50.508 INFO:tasks.workunit.client.0.smithi040.stdout:9/797: write d2/d3/d70/f103 [4540930,22212] 0 2024-04-18T10:42:50.508 INFO:tasks.workunit.client.0.smithi040.stdout:6/764: creat df/d76/d91/f11a x:0 0 0 2024-04-18T10:42:50.509 INFO:tasks.workunit.client.0.smithi040.stdout:5/689: creat d0/d3/d47/dd5/fe1 x:0 0 0 2024-04-18T10:42:50.510 INFO:tasks.workunit.client.0.smithi040.stdout:5/690: chown d0/d3b/l46 4302 1 2024-04-18T10:42:50.511 INFO:tasks.workunit.client.0.smithi040.stdout:1/759: mknod d1/d9b/dcf/c10e 0 2024-04-18T10:42:50.514 INFO:tasks.workunit.client.0.smithi040.stdout:7/721: rename d6/d25/d28/dac/d64/d7e/l95 to d6/d25/d28/dac/d63/le2 0 2024-04-18T10:42:50.515 INFO:tasks.workunit.client.0.smithi040.stdout:4/706: fsync d2/d3/d4/dd/fa9 0 2024-04-18T10:42:50.515 INFO:tasks.workunit.client.0.smithi040.stdout:5/691: dread d0/d3b/d3f/fbd [0,4194304] 0 2024-04-18T10:42:50.517 INFO:tasks.workunit.client.0.smithi040.stdout:7/722: write d6/d25/d28/d2c/f4c [1143480,80811] 0 2024-04-18T10:42:50.517 INFO:tasks.workunit.client.0.smithi040.stdout:6/765: symlink df/d76/l11b 0 2024-04-18T10:42:50.517 INFO:tasks.workunit.client.0.smithi040.stdout:5/692: dread - d0/d78/d95/fdf zero size 2024-04-18T10:42:50.524 INFO:tasks.workunit.client.0.smithi040.stdout:8/785: truncate d2/d15/d78/f8d 307283 0 2024-04-18T10:42:50.527 INFO:tasks.workunit.client.0.smithi040.stdout:7/723: dread - d6/d25/d28/dac/d64/fd4 zero size 2024-04-18T10:42:50.527 INFO:tasks.workunit.client.0.smithi040.stdout:1/760: dwrite d1/d9b/d75/d84/dac/dda/de0/ffa [0,4194304] 0 2024-04-18T10:42:50.531 INFO:tasks.workunit.client.0.smithi040.stdout:5/693: write d0/d78/f9c [3848771,8720] 0 2024-04-18T10:42:50.532 INFO:tasks.workunit.client.0.smithi040.stdout:8/786: mkdir d2/d15/d78/d10b 0 2024-04-18T10:42:50.533 INFO:tasks.workunit.client.0.smithi040.stdout:2/695: sync 2024-04-18T10:42:50.534 INFO:tasks.workunit.client.0.smithi040.stdout:3/766: getdents d1/d7/d67/dc5/d3b 0 2024-04-18T10:42:50.535 INFO:tasks.workunit.client.0.smithi040.stdout:4/707: creat d2/d3/d41/fc8 x:0 0 0 2024-04-18T10:42:50.539 INFO:tasks.workunit.client.0.smithi040.stdout:2/696: fdatasync dd/f45 0 2024-04-18T10:42:50.539 INFO:tasks.workunit.client.0.smithi040.stdout:6/766: link ce df/de8/c11c 0 2024-04-18T10:42:50.541 INFO:tasks.workunit.client.0.smithi040.stdout:3/767: creat d1/d7/db2/ff6 x:0 0 0 2024-04-18T10:42:50.541 INFO:tasks.workunit.client.0.smithi040.stdout:8/787: dwrite d2/d5/d9/d3c/d5a/fb2 [0,4194304] 0 2024-04-18T10:42:50.542 INFO:tasks.workunit.client.0.smithi040.stdout:4/708: fsync d2/d3/d4/d21/f58 0 2024-04-18T10:42:50.544 INFO:tasks.workunit.client.0.smithi040.stdout:7/724: dread d6/f22 [4194304,4194304] 0 2024-04-18T10:42:50.544 INFO:tasks.workunit.client.0.smithi040.stdout:1/761: dread d1/d1c/f56 [0,4194304] 0 2024-04-18T10:42:50.544 INFO:tasks.workunit.client.0.smithi040.stdout:5/694: rename d0/d3/d47/f4a to d0/d3/fe2 0 2024-04-18T10:42:50.546 INFO:tasks.workunit.client.0.smithi040.stdout:2/697: unlink dd/d14/d2b/dbc/d5f/c6d 0 2024-04-18T10:42:50.553 INFO:tasks.workunit.client.0.smithi040.stdout:5/695: rename d0/d78/f81 to d0/d3b/d88/fe3 0 2024-04-18T10:42:50.553 INFO:tasks.workunit.client.0.smithi040.stdout:8/788: truncate d2/d5/d9/d1b/f4f 316905 0 2024-04-18T10:42:50.554 INFO:tasks.workunit.client.0.smithi040.stdout:0/784: write dd/df/d19/f66 [1170851,92329] 0 2024-04-18T10:42:50.555 INFO:tasks.workunit.client.0.smithi040.stdout:5/696: write d0/d4e/f4c [4373960,56370] 0 2024-04-18T10:42:50.555 INFO:tasks.workunit.client.0.smithi040.stdout:2/698: creat dd/d14/d2b/d7c/fe9 x:0 0 0 2024-04-18T10:42:50.557 INFO:tasks.workunit.client.0.smithi040.stdout:6/767: dread fa [0,4194304] 0 2024-04-18T10:42:50.557 INFO:tasks.workunit.client.0.smithi040.stdout:2/699: fdatasync dd/d61/d81/fc7 0 2024-04-18T10:42:50.559 INFO:tasks.workunit.client.0.smithi040.stdout:9/798: sync 2024-04-18T10:42:50.561 INFO:tasks.workunit.client.0.smithi040.stdout:8/789: dwrite d2/d4c/f100 [0,4194304] 0 2024-04-18T10:42:50.566 INFO:tasks.workunit.client.0.smithi040.stdout:8/790: dread d2/d5/d9/d3c/fc8 [0,4194304] 0 2024-04-18T10:42:50.567 INFO:tasks.workunit.client.0.smithi040.stdout:8/791: chown d2/fcf 1427 1 2024-04-18T10:42:50.567 INFO:tasks.workunit.client.0.smithi040.stdout:7/725: rename d6/d25/f62 to d6/d25/d28/d2c/d2d/d47/d55/fe3 0 2024-04-18T10:42:50.569 INFO:tasks.workunit.client.0.smithi040.stdout:3/768: getdents d1/d2/d4e 0 2024-04-18T10:42:50.569 INFO:tasks.workunit.client.0.smithi040.stdout:8/792: write d2/d5/d9/d3c/d5a/fc5 [11124,18497] 0 2024-04-18T10:42:50.571 INFO:tasks.workunit.client.0.smithi040.stdout:3/769: write d1/d7/d12/d7b/fb3 [3098615,117276] 0 2024-04-18T10:42:50.571 INFO:tasks.workunit.client.0.smithi040.stdout:4/709: getdents d2/d3/d4/dd/d4f 0 2024-04-18T10:42:50.571 INFO:tasks.workunit.client.0.smithi040.stdout:8/793: write d2/d10/d14/f104 [924576,5008] 0 2024-04-18T10:42:50.572 INFO:tasks.workunit.client.0.smithi040.stdout:4/710: readlink d2/d3/d4/d21/da4/la5 0 2024-04-18T10:42:50.575 INFO:tasks.workunit.client.0.smithi040.stdout:1/762: getdents d1/d1c/d2b/db5/dcc 0 2024-04-18T10:42:50.576 INFO:tasks.workunit.client.0.smithi040.stdout:1/763: readlink d1/d9b/d75/d84/dac/dda/l101 0 2024-04-18T10:42:50.578 INFO:tasks.workunit.client.0.smithi040.stdout:0/785: creat dd/df/d4e/f117 x:0 0 0 2024-04-18T10:42:50.578 INFO:tasks.workunit.client.0.smithi040.stdout:3/770: dwrite d1/d2/d16/f2d [0,4194304] 0 2024-04-18T10:42:50.580 INFO:tasks.workunit.client.0.smithi040.stdout:3/771: write d1/d7/d67/dc5/d91/fcc [1474328,79125] 0 2024-04-18T10:42:50.581 INFO:tasks.workunit.client.0.smithi040.stdout:3/772: write d1/d2/f48 [1047734,118602] 0 2024-04-18T10:42:50.587 INFO:tasks.workunit.client.0.smithi040.stdout:6/768: rename df/d4b/d6e/c5f to df/d4b/db7/df6/d107/c11d 0 2024-04-18T10:42:50.589 INFO:tasks.workunit.client.0.smithi040.stdout:0/786: unlink dd/df/f2b 0 2024-04-18T10:42:50.590 INFO:tasks.workunit.client.0.smithi040.stdout:0/787: stat dd/df/d19/f45 0 2024-04-18T10:42:50.590 INFO:tasks.workunit.client.0.smithi040.stdout:0/788: stat dd/df/d19/d3e/d77/f90 0 2024-04-18T10:42:50.591 INFO:tasks.workunit.client.0.smithi040.stdout:9/799: link d2/dd/de/l62 d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/l114 0 2024-04-18T10:42:50.591 INFO:tasks.workunit.client.0.smithi040.stdout:0/789: fsync dd/df/d4e/dc3/ff0 0 2024-04-18T10:42:50.592 INFO:tasks.workunit.client.0.smithi040.stdout:8/794: symlink d2/l10c 0 2024-04-18T10:42:50.595 INFO:tasks.workunit.client.0.smithi040.stdout:3/773: symlink d1/d7/d67/dc5/d91/db1/lf7 0 2024-04-18T10:42:50.597 INFO:tasks.workunit.client.0.smithi040.stdout:2/700: link c1 dd/d14/d2b/d7c/d37/de4/cea 0 2024-04-18T10:42:50.598 INFO:tasks.workunit.client.0.smithi040.stdout:8/795: dwrite d2/d5/d9/d3c/d5a/fc5 [0,4194304] 0 2024-04-18T10:42:50.603 INFO:tasks.workunit.client.0.smithi040.stdout:1/764: mknod d1/d1c/d7b/c10f 0 2024-04-18T10:42:50.604 INFO:tasks.workunit.client.0.smithi040.stdout:6/769: truncate df/f27 2527936 0 2024-04-18T10:42:50.605 INFO:tasks.workunit.client.0.smithi040.stdout:6/770: stat df/d4b/d6a/fb1 0 2024-04-18T10:42:50.605 INFO:tasks.workunit.client.0.smithi040.stdout:9/800: read - d2/d5b/d6f/d80/fab zero size 2024-04-18T10:42:50.606 INFO:tasks.workunit.client.0.smithi040.stdout:6/771: read df/f67 [2688026,15265] 0 2024-04-18T10:42:50.607 INFO:tasks.workunit.client.0.smithi040.stdout:0/790: mkdir dd/df/d19/d3e/d118 0 2024-04-18T10:42:50.608 INFO:tasks.workunit.client.0.smithi040.stdout:2/701: write dd/d14/d2b/dbc/d5f/fe1 [1277326,35640] 0 2024-04-18T10:42:50.611 INFO:tasks.workunit.client.0.smithi040.stdout:7/726: rename d6/d25/d28/d2c to d6/d25/dcf/de4 0 2024-04-18T10:42:50.612 INFO:tasks.workunit.client.0.smithi040.stdout:9/801: fsync d2/d3/d22/d2e/f76 0 2024-04-18T10:42:50.613 INFO:tasks.workunit.client.0.smithi040.stdout:6/772: mkdir df/de8/d11e 0 2024-04-18T10:42:50.615 INFO:tasks.workunit.client.0.smithi040.stdout:0/791: dwrite dd/fd6 [4194304,4194304] 0 2024-04-18T10:42:50.618 INFO:tasks.workunit.client.0.smithi040.stdout:3/774: rename d1/d2/d4e/d58/d8e to d1/d2/d4e/d58/dc4/df8 0 2024-04-18T10:42:50.621 INFO:tasks.workunit.client.0.smithi040.stdout:5/697: dwrite d0/f25 [0,4194304] 0 2024-04-18T10:42:50.622 INFO:tasks.workunit.client.0.smithi040.stdout:5/698: truncate d0/f25 5017990 0 2024-04-18T10:42:50.623 INFO:tasks.workunit.client.0.smithi040.stdout:9/802: rmdir d2/d3/d22/d2e/d35/daf/dc2 39 2024-04-18T10:42:50.624 INFO:tasks.workunit.client.0.smithi040.stdout:8/796: dread d2/d5/d9/d3c/d5a/f27 [0,4194304] 0 2024-04-18T10:42:50.629 INFO:tasks.workunit.client.0.smithi040.stdout:2/702: rename dd/d14/d2b/d7c/d37/d5b/c6a to dd/d14/d2b/d7c/d37/da3/dc1/ceb 0 2024-04-18T10:42:50.630 INFO:tasks.workunit.client.0.smithi040.stdout:2/703: truncate dd/d61/d8e/fcb 772697 0 2024-04-18T10:42:50.630 INFO:tasks.workunit.client.0.smithi040.stdout:3/775: symlink d1/d2/d4e/d57/lf9 0 2024-04-18T10:42:50.631 INFO:tasks.workunit.client.0.smithi040.stdout:4/711: truncate d2/d1a/f9c 3728686 0 2024-04-18T10:42:50.632 INFO:tasks.workunit.client.0.smithi040.stdout:3/776: dread - d1/d2/d4e/d58/dbe/dc1/dc2/fe4 zero size 2024-04-18T10:42:50.632 INFO:tasks.workunit.client.0.smithi040.stdout:7/727: creat d6/d25/dcf/de4/d2d/d47/d55/d58/d6c/d8a/fe5 x:0 0 0 2024-04-18T10:42:50.633 INFO:tasks.workunit.client.0.smithi040.stdout:9/803: rmdir d2 39 2024-04-18T10:42:50.633 INFO:tasks.workunit.client.0.smithi040.stdout:4/712: write d2/d3/d4/dd/d4f/f90 [1675676,117679] 0 2024-04-18T10:42:50.634 INFO:tasks.workunit.client.0.smithi040.stdout:8/797: chown d2/d5/d9/c2d 0 1 2024-04-18T10:42:50.635 INFO:tasks.workunit.client.0.smithi040.stdout:4/713: stat d2/d3/f59 0 2024-04-18T10:42:50.636 INFO:tasks.workunit.client.0.smithi040.stdout:8/798: truncate d2/d15/f77 4584477 0 2024-04-18T10:42:50.637 INFO:tasks.workunit.client.0.smithi040.stdout:6/773: creat df/d4b/d6e/f11f x:0 0 0 2024-04-18T10:42:50.637 INFO:tasks.workunit.client.0.smithi040.stdout:8/799: fsync d2/d15/d2b/d40/f71 0 2024-04-18T10:42:50.638 INFO:tasks.workunit.client.0.smithi040.stdout:6/774: write df/d4b/d99/fa6 [23770,98087] 0 2024-04-18T10:42:50.639 INFO:tasks.workunit.client.0.smithi040.stdout:7/728: dread d6/d25/dcf/fd7 [0,4194304] 0 2024-04-18T10:42:50.639 INFO:tasks.workunit.client.0.smithi040.stdout:5/699: rename d0/f25 to d0/d78/d95/db7/fe4 0 2024-04-18T10:42:50.640 INFO:tasks.workunit.client.0.smithi040.stdout:8/800: dread d2/d5/d9/d3c/f95 [0,4194304] 0 2024-04-18T10:42:50.641 INFO:tasks.workunit.client.0.smithi040.stdout:8/801: fdatasync d2/d5/d9/f44 0 2024-04-18T10:42:50.646 INFO:tasks.workunit.client.0.smithi040.stdout:4/714: mknod d2/d3/d41/d62/cc9 0 2024-04-18T10:42:50.647 INFO:tasks.workunit.client.0.smithi040.stdout:0/792: write dd/d62/fe9 [682149,92187] 0 2024-04-18T10:42:50.651 INFO:tasks.workunit.client.0.smithi040.stdout:2/704: creat dd/d14/d2b/dbc/d5f/d82/da6/db1/ddf/fec x:0 0 0 2024-04-18T10:42:50.653 INFO:tasks.workunit.client.0.smithi040.stdout:5/700: rmdir d0/d21 39 2024-04-18T10:42:50.655 INFO:tasks.workunit.client.0.smithi040.stdout:7/729: mkdir d6/d25/dcf/de4/d2d/d47/d5c/da2/de6 0 2024-04-18T10:42:50.659 INFO:tasks.workunit.client.0.smithi040.stdout:1/765: sync 2024-04-18T10:42:50.659 INFO:tasks.workunit.client.0.smithi040.stdout:1/766: stat d1/fc6 0 2024-04-18T10:42:50.660 INFO:tasks.workunit.client.0.smithi040.stdout:3/777: mkdir d1/d7/d28/db7/dfa 0 2024-04-18T10:42:50.662 INFO:tasks.workunit.client.0.smithi040.stdout:4/715: creat d2/d3/d4/d23/fca x:0 0 0 2024-04-18T10:42:50.663 INFO:tasks.workunit.client.0.smithi040.stdout:0/793: symlink dd/df/d19/d28/d3a/d5b/dd0/df7/l119 0 2024-04-18T10:42:50.664 INFO:tasks.workunit.client.0.smithi040.stdout:4/716: write d2/d3/d4/d23/fca [221375,58587] 0 2024-04-18T10:42:50.666 INFO:tasks.workunit.client.0.smithi040.stdout:0/794: truncate dd/df/d4e/dc3/ff0 185310 0 2024-04-18T10:42:50.667 INFO:tasks.workunit.client.0.smithi040.stdout:1/767: dwrite d1/d1c/d2b/d32/d36/d4d/d67/faf [0,4194304] 0 2024-04-18T10:42:50.667 INFO:tasks.workunit.client.0.smithi040.stdout:4/717: chown d2/d3/d4/d1f/d29/d49/d31/cc6 4 1 2024-04-18T10:42:50.669 INFO:tasks.workunit.client.0.smithi040.stdout:1/768: chown d1/d1c/d2b/d32/d36/d4d/d67/lba 6 1 2024-04-18T10:42:50.670 INFO:tasks.workunit.client.0.smithi040.stdout:4/718: truncate d2/d3/d41/d47/d99/fbb 91035 0 2024-04-18T10:42:50.671 INFO:tasks.workunit.client.0.smithi040.stdout:4/719: write d2/d3/d4/d1f/d29/d49/d31/f88 [322847,127724] 0 2024-04-18T10:42:50.672 INFO:tasks.workunit.client.0.smithi040.stdout:4/720: chown d2/d3/d4/dd/c72 10468287 1 2024-04-18T10:42:50.673 INFO:tasks.workunit.client.0.smithi040.stdout:4/721: chown d2/d3/d4/d1f/d29/d49/l16 233 1 2024-04-18T10:42:50.674 INFO:tasks.workunit.client.0.smithi040.stdout:4/722: write d2/d3/d4/dd/d4f/f8c [8858555,60662] 0 2024-04-18T10:42:50.686 INFO:tasks.workunit.client.0.smithi040.stdout:6/775: rmdir df/d4b/db7/dcc/de5 39 2024-04-18T10:42:50.687 INFO:tasks.workunit.client.0.smithi040.stdout:6/776: dread - df/d76/dc2/fee zero size 2024-04-18T10:42:50.688 INFO:tasks.workunit.client.0.smithi040.stdout:2/705: symlink dd/d14/d2b/d7c/d37/d38/led 0 2024-04-18T10:42:50.689 INFO:tasks.workunit.client.0.smithi040.stdout:6/777: chown df/d4b/db7/dcc/dd6/f115 395209263 1 2024-04-18T10:42:50.689 INFO:tasks.workunit.client.0.smithi040.stdout:2/706: write dd/f56 [389141,20320] 0 2024-04-18T10:42:50.690 INFO:tasks.workunit.client.0.smithi040.stdout:6/778: chown df/d4b/d99/dc4 30 1 2024-04-18T10:42:50.691 INFO:tasks.workunit.client.0.smithi040.stdout:7/730: unlink d6/d25/dcf/de4/d2d/fd8 0 2024-04-18T10:42:50.693 INFO:tasks.workunit.client.0.smithi040.stdout:2/707: dread dd/d61/d8e/fcb [0,4194304] 0 2024-04-18T10:42:50.700 INFO:tasks.workunit.client.0.smithi040.stdout:8/802: dwrite d2/d5/d9/d63/f64 [0,4194304] 0 2024-04-18T10:42:50.701 INFO:tasks.workunit.client.0.smithi040.stdout:9/804: dwrite d2/dd/f98 [0,4194304] 0 2024-04-18T10:42:50.702 INFO:tasks.workunit.client.0.smithi040.stdout:6/779: unlink df/d4b/d6a/d93/fc9 0 2024-04-18T10:42:50.705 INFO:tasks.workunit.client.0.smithi040.stdout:6/780: chown df/d4b/d99/f10f 670978 1 2024-04-18T10:42:50.707 INFO:tasks.workunit.client.0.smithi040.stdout:5/701: dread d0/d21/d42/f4f [4194304,4194304] 0 2024-04-18T10:42:50.707 INFO:tasks.workunit.client.0.smithi040.stdout:0/795: link dd/df/d19/d28/d3a/fa7 dd/d10b/f11a 0 2024-04-18T10:42:50.710 INFO:tasks.workunit.client.0.smithi040.stdout:4/723: creat d2/d3/d41/d62/db0/fcb x:0 0 0 2024-04-18T10:42:50.710 INFO:tasks.workunit.client.0.smithi040.stdout:0/796: chown dd/df/d19/d3e/d77/fa2 19390 1 2024-04-18T10:42:50.711 INFO:tasks.workunit.client.0.smithi040.stdout:8/803: dwrite d2/d22/d49/fd7 [0,4194304] 0 2024-04-18T10:42:50.712 INFO:tasks.workunit.client.0.smithi040.stdout:8/804: chown d2/d15/d2b/dd0 50 1 2024-04-18T10:42:50.713 INFO:tasks.workunit.client.0.smithi040.stdout:8/805: write d2/d22/f38 [2886676,101842] 0 2024-04-18T10:42:50.714 INFO:tasks.workunit.client.0.smithi040.stdout:8/806: chown d2/d5/d9/d3c/c43 46 1 2024-04-18T10:42:50.715 INFO:tasks.workunit.client.0.smithi040.stdout:3/778: truncate d1/d7/d12/f22 3955433 0 2024-04-18T10:42:50.719 INFO:tasks.workunit.client.0.smithi040.stdout:9/805: mkdir d2/d3/d70/d115 0 2024-04-18T10:42:50.719 INFO:tasks.workunit.client.0.smithi040.stdout:0/797: dread dd/daa/ff3 [0,4194304] 0 2024-04-18T10:42:50.720 INFO:tasks.workunit.client.0.smithi040.stdout:5/702: mkdir d0/d78/dc4/de5 0 2024-04-18T10:42:50.720 INFO:tasks.workunit.client.0.smithi040.stdout:3/779: dread d1/d7/d67/dc5/f65 [0,4194304] 0 2024-04-18T10:42:50.721 INFO:tasks.workunit.client.0.smithi040.stdout:2/708: mknod dd/d61/d8e/d98/dd0/cee 0 2024-04-18T10:42:50.723 INFO:tasks.workunit.client.0.smithi040.stdout:8/807: dread d2/d5/d9/d3c/d5a/d94/fe0 [0,4194304] 0 2024-04-18T10:42:50.723 INFO:tasks.workunit.client.0.smithi040.stdout:3/780: dread - d1/d2/d4e/d58/dbe/dc1/dc2/fe3 zero size 2024-04-18T10:42:50.726 INFO:tasks.workunit.client.0.smithi040.stdout:5/703: mkdir d0/d21/d42/dcc/de6 0 2024-04-18T10:42:50.731 INFO:tasks.workunit.client.0.smithi040.stdout:3/781: mknod d1/d2/d4e/d58/dbe/dc1/cfb 0 2024-04-18T10:42:50.732 INFO:tasks.workunit.client.0.smithi040.stdout:4/724: creat d2/fcc x:0 0 0 2024-04-18T10:42:50.732 INFO:tasks.workunit.client.0.smithi040.stdout:3/782: chown d1/d2/d4e/d58/dc4/df8/cae 2134558 1 2024-04-18T10:42:50.733 INFO:tasks.workunit.client.0.smithi040.stdout:5/704: mkdir d0/d3/dba/de7 0 2024-04-18T10:42:50.734 INFO:tasks.workunit.client.0.smithi040.stdout:5/705: chown d0/d21/d42/f6c 130355098 1 2024-04-18T10:42:50.735 INFO:tasks.workunit.client.0.smithi040.stdout:6/781: getdents df/de8 0 2024-04-18T10:42:50.736 INFO:tasks.workunit.client.0.smithi040.stdout:1/769: dread d1/d1c/d7b/d2e/d39/f4f [0,4194304] 0 2024-04-18T10:42:50.738 INFO:tasks.workunit.client.0.smithi040.stdout:2/709: link dd/d14/d2b/dbc/d5f/d82/da6/d52/l5e dd/d61/d8e/d98/dcc/lef 0 2024-04-18T10:42:50.743 INFO:tasks.workunit.client.0.smithi040.stdout:3/783: dwrite d1/d2/d4e/d58/db4/fe5 [0,4194304] 0 2024-04-18T10:42:50.744 INFO:tasks.workunit.client.0.smithi040.stdout:3/784: fsync d1/d2/d4e/f7c 0 2024-04-18T10:42:50.745 INFO:tasks.workunit.client.0.smithi040.stdout:3/785: truncate d1/d7/d12/f9f 2336057 0 2024-04-18T10:42:50.745 INFO:tasks.workunit.client.0.smithi040.stdout:7/731: write d6/d25/dcf/de4/d3c/fd6 [1899858,11800] 0 2024-04-18T10:42:50.747 INFO:tasks.workunit.client.0.smithi040.stdout:2/710: dread dd/d14/fa9 [0,4194304] 0 2024-04-18T10:42:50.748 INFO:tasks.workunit.client.0.smithi040.stdout:5/706: rename d0/d3/c11 to d0/d3/d47/ce8 0 2024-04-18T10:42:50.749 INFO:tasks.workunit.client.0.smithi040.stdout:5/707: write d0/d78/d95/f5a [3467459,24702] 0 2024-04-18T10:42:50.749 INFO:tasks.workunit.client.0.smithi040.stdout:1/770: fdatasync d1/f18 0 2024-04-18T10:42:50.751 INFO:tasks.workunit.client.0.smithi040.stdout:4/725: getdents d2/d3/d4/d21/d28/d3f 0 2024-04-18T10:42:50.751 INFO:tasks.workunit.client.0.smithi040.stdout:0/798: dread dd/df/d19/d28/f53 [0,4194304] 0 2024-04-18T10:42:50.751 INFO:tasks.workunit.client.0.smithi040.stdout:8/808: dread d2/d15/fd6 [0,4194304] 0 2024-04-18T10:42:50.752 INFO:tasks.workunit.client.0.smithi040.stdout:8/809: chown d2/f6c 285151 1 2024-04-18T10:42:50.753 INFO:tasks.workunit.client.0.smithi040.stdout:0/799: dread - dd/df/d4e/f117 zero size 2024-04-18T10:42:50.753 INFO:tasks.workunit.client.0.smithi040.stdout:4/726: dread - d2/d3/d41/d62/db0/fcb zero size 2024-04-18T10:42:50.754 INFO:tasks.workunit.client.0.smithi040.stdout:8/810: dread - d2/d5/d9/d1b/fa6 zero size 2024-04-18T10:42:50.755 INFO:tasks.workunit.client.0.smithi040.stdout:3/786: unlink d1/d7/d67/dc5/d91/fb9 0 2024-04-18T10:42:50.761 INFO:tasks.workunit.client.0.smithi040.stdout:2/711: unlink dd/d14/d2b/dbc/d5f/d82/da6/d52/l9e 0 2024-04-18T10:42:50.762 INFO:tasks.workunit.client.0.smithi040.stdout:1/771: mknod d1/d9b/c110 0 2024-04-18T10:42:50.764 INFO:tasks.workunit.client.0.smithi040.stdout:4/727: symlink d2/d3/d4/d1f/lcd 0 2024-04-18T10:42:50.765 INFO:tasks.workunit.client.0.smithi040.stdout:8/811: creat d2/d4c/d97/f10d x:0 0 0 2024-04-18T10:42:50.766 INFO:tasks.workunit.client.0.smithi040.stdout:3/787: mknod d1/d2/d4e/d58/cfc 0 2024-04-18T10:42:50.767 INFO:tasks.workunit.client.0.smithi040.stdout:9/806: truncate d2/d3/d22/d2e/f3d 2310219 0 2024-04-18T10:42:50.767 INFO:tasks.workunit.client.0.smithi040.stdout:3/788: write d1/d7/d28/fdd [846318,32633] 0 2024-04-18T10:42:50.769 INFO:tasks.workunit.client.0.smithi040.stdout:6/782: rename df/d4b/d6e/ldd to df/d4b/db7/dcc/dd6/l120 0 2024-04-18T10:42:50.771 INFO:tasks.workunit.client.0.smithi040.stdout:5/708: getdents d0/d78/dc4/de5 0 2024-04-18T10:42:50.773 INFO:tasks.workunit.client.0.smithi040.stdout:3/789: write d1/d7/d3a/f50 [1102228,82818] 0 2024-04-18T10:42:50.777 INFO:tasks.workunit.client.0.smithi040.stdout:1/772: truncate d1/f30 4032874 0 2024-04-18T10:42:50.779 INFO:tasks.workunit.client.0.smithi040.stdout:5/709: mkdir d0/d3b/d3f/de9 0 2024-04-18T10:42:50.779 INFO:tasks.workunit.client.0.smithi040.stdout:0/800: link dd/df/d19/l24 dd/df/d19/dd5/l11b 0 2024-04-18T10:42:50.780 INFO:tasks.workunit.client.0.smithi040.stdout:8/812: mkdir d2/d5/d9/df7/d10e 0 2024-04-18T10:42:50.781 INFO:tasks.workunit.client.0.smithi040.stdout:0/801: write dd/df/d19/dd5/fe4 [766095,54633] 0 2024-04-18T10:42:50.782 INFO:tasks.workunit.client.0.smithi040.stdout:3/790: creat d1/d2/d4e/d58/ffd x:0 0 0 2024-04-18T10:42:50.787 INFO:tasks.workunit.client.0.smithi040.stdout:7/732: dwrite d6/d25/dcf/de4/d3c/f51 [0,4194304] 0 2024-04-18T10:42:50.787 INFO:tasks.workunit.client.0.smithi040.stdout:8/813: creat d2/d5/d9/d3c/f10f x:0 0 0 2024-04-18T10:42:50.789 INFO:tasks.workunit.client.0.smithi040.stdout:0/802: write dd/df/d19/d28/f53 [4535276,123499] 0 2024-04-18T10:42:50.789 INFO:tasks.workunit.client.0.smithi040.stdout:0/803: stat dd/df/d19/d8d/c96 0 2024-04-18T10:42:50.790 INFO:tasks.workunit.client.0.smithi040.stdout:0/804: dread - dd/df/d19/d28/db7/dd4/ff5 zero size 2024-04-18T10:42:50.791 INFO:tasks.workunit.client.0.smithi040.stdout:6/783: getdents df/de8 0 2024-04-18T10:42:50.793 INFO:tasks.workunit.client.0.smithi040.stdout:4/728: getdents d2/d3/d4/dd 0 2024-04-18T10:42:50.793 INFO:tasks.workunit.client.0.smithi040.stdout:4/729: chown d2/d3/d4/d1f/d29/f64 53942 1 2024-04-18T10:42:50.812 INFO:tasks.workunit.client.0.smithi040.stdout:4/730: truncate d2/d3/d4/f9d 112048 0 2024-04-18T10:42:50.812 INFO:tasks.workunit.client.0.smithi040.stdout:5/710: link d0/d78/fd2 d0/d3b/d3f/de9/fea 0 2024-04-18T10:42:50.812 INFO:tasks.workunit.client.0.smithi040.stdout:2/712: truncate dd/d14/d4a/f71 4962667 0 2024-04-18T10:42:50.812 INFO:tasks.workunit.client.0.smithi040.stdout:0/805: mkdir dd/df/d19/d28/d3a/d46/d107/d11c 0 2024-04-18T10:42:50.814 INFO:tasks.workunit.client.0.smithi040.stdout:9/807: truncate d2/d3/d22/d2e/d35/daf/dc1/f1a 4150970 0 2024-04-18T10:42:50.814 INFO:tasks.workunit.client.0.smithi040.stdout:3/791: link d1/d2/f48 d1/d7/ffe 0 2024-04-18T10:42:50.815 INFO:tasks.workunit.client.0.smithi040.stdout:4/731: mkdir d2/d3/d2f/dce 0 2024-04-18T10:42:50.818 INFO:tasks.workunit.client.0.smithi040.stdout:4/732: chown d2/d3/d4/dd/c11 966875797 1 2024-04-18T10:42:50.819 INFO:tasks.workunit.client.0.smithi040.stdout:8/814: getdents d2/d10/d6a 0 2024-04-18T10:42:50.820 INFO:tasks.workunit.client.0.smithi040.stdout:9/808: readlink d2/d3/d22/d2e/d35/daf/dc2/lf8 0 2024-04-18T10:42:50.823 INFO:tasks.workunit.client.0.smithi040.stdout:1/773: dread d1/d16/d92/dad/fc0 [0,4194304] 0 2024-04-18T10:42:50.826 INFO:tasks.workunit.client.0.smithi040.stdout:4/733: symlink d2/d3/d41/d62/d7c/lcf 0 2024-04-18T10:42:50.826 INFO:tasks.workunit.client.0.smithi040.stdout:0/806: dwrite dd/df/d19/d28/d3a/f51 [0,4194304] 0 2024-04-18T10:42:50.828 INFO:tasks.workunit.client.0.smithi040.stdout:2/713: dread dd/d14/f47 [0,4194304] 0 2024-04-18T10:42:50.828 INFO:tasks.workunit.client.0.smithi040.stdout:9/809: unlink d2/d3/d22/fd1 0 2024-04-18T10:42:50.828 INFO:tasks.workunit.client.0.smithi040.stdout:3/792: dwrite d1/f74 [0,4194304] 0 2024-04-18T10:42:50.831 INFO:tasks.workunit.client.0.smithi040.stdout:2/714: dread - dd/d14/d2b/dbc/d5f/fb2 zero size 2024-04-18T10:42:50.834 INFO:tasks.workunit.client.0.smithi040.stdout:8/815: write d2/d10/d6a/f70 [4998845,49705] 0 2024-04-18T10:42:50.835 INFO:tasks.workunit.client.0.smithi040.stdout:4/734: truncate d2/d3/d4/fb6 310132 0 2024-04-18T10:42:50.836 INFO:tasks.workunit.client.0.smithi040.stdout:5/711: dread d0/d3b/d88/f94 [0,4194304] 0 2024-04-18T10:42:50.838 INFO:tasks.workunit.client.0.smithi040.stdout:8/816: fsync d2/d10/d14/f104 0 2024-04-18T10:42:50.841 INFO:tasks.workunit.client.0.smithi040.stdout:2/715: mknod dd/d14/d2b/dbc/d5f/d82/da6/db1/ddf/cf0 0 2024-04-18T10:42:50.842 INFO:tasks.workunit.client.0.smithi040.stdout:9/810: dwrite d2/d5b/fe1 [0,4194304] 0 2024-04-18T10:42:50.842 INFO:tasks.workunit.client.0.smithi040.stdout:5/712: write d0/d3b/d88/faa [1914957,8544] 0 2024-04-18T10:42:50.843 INFO:tasks.workunit.client.0.smithi040.stdout:0/807: dwrite dd/df/d19/d28/db7/dd4/fe2 [0,4194304] 0 2024-04-18T10:42:50.843 INFO:tasks.workunit.client.0.smithi040.stdout:4/735: unlink d2/d3/d4/d21/d28/d3f/f79 0 2024-04-18T10:42:50.847 INFO:tasks.workunit.client.0.smithi040.stdout:4/736: symlink d2/d1a/ld0 0 2024-04-18T10:42:50.847 INFO:tasks.workunit.client.0.smithi040.stdout:8/817: mknod d2/d10/c110 0 2024-04-18T10:42:50.849 INFO:tasks.workunit.client.0.smithi040.stdout:5/713: rename d0/d4e/d8e/fc3 to d0/d4e/d8e/feb 0 2024-04-18T10:42:50.850 INFO:tasks.workunit.client.0.smithi040.stdout:8/818: fdatasync d2/d22/d80/da2/fd8 0 2024-04-18T10:42:50.852 INFO:tasks.workunit.client.0.smithi040.stdout:7/733: sync 2024-04-18T10:42:50.852 INFO:tasks.workunit.client.0.smithi040.stdout:6/784: sync 2024-04-18T10:42:50.854 INFO:tasks.workunit.client.0.smithi040.stdout:4/737: mknod d2/d3/d4/dd/d6d/d70/db2/cd1 0 2024-04-18T10:42:50.855 INFO:tasks.workunit.client.0.smithi040.stdout:2/716: dwrite dd/d14/d2b/d7c/fe9 [0,4194304] 0 2024-04-18T10:42:50.856 INFO:tasks.workunit.client.0.smithi040.stdout:5/714: creat d0/d3b/d3f/de9/fec x:0 0 0 2024-04-18T10:42:50.856 INFO:tasks.workunit.client.0.smithi040.stdout:6/785: write df/d4b/d63/dbb/f113 [608499,33782] 0 2024-04-18T10:42:50.857 INFO:tasks.workunit.client.0.smithi040.stdout:5/715: chown d0/d3b/d67 79 1 2024-04-18T10:42:50.858 INFO:tasks.workunit.client.0.smithi040.stdout:8/819: read d2/d15/d78/fc1 [4086446,99487] 0 2024-04-18T10:42:50.858 INFO:tasks.workunit.client.0.smithi040.stdout:7/734: symlink d6/d25/dcf/de4/d2d/d47/d5c/le7 0 2024-04-18T10:42:50.858 INFO:tasks.workunit.client.0.smithi040.stdout:9/811: dwrite d2/d3/d22/d2e/d35/d40/d71/fa7 [0,4194304] 0 2024-04-18T10:42:50.859 INFO:tasks.workunit.client.0.smithi040.stdout:4/738: rmdir d2/d3/d41/d47/d99 39 2024-04-18T10:42:50.859 INFO:tasks.workunit.client.0.smithi040.stdout:7/735: truncate d6/fbd 4242946 0 2024-04-18T10:42:50.860 INFO:tasks.workunit.client.0.smithi040.stdout:7/736: fdatasync d6/fbd 0 2024-04-18T10:42:50.865 INFO:tasks.workunit.client.0.smithi040.stdout:5/716: mkdir d0/d3b/d88/ded 0 2024-04-18T10:42:50.865 INFO:tasks.workunit.client.0.smithi040.stdout:6/786: mkdir df/d121 0 2024-04-18T10:42:50.866 INFO:tasks.workunit.client.0.smithi040.stdout:9/812: truncate d2/d7/f14 688882 0 2024-04-18T10:42:50.867 INFO:tasks.workunit.client.0.smithi040.stdout:1/774: dread d1/f11 [0,4194304] 0 2024-04-18T10:42:50.868 INFO:tasks.workunit.client.0.smithi040.stdout:8/820: symlink d2/d5/d9/d3c/d5a/l111 0 2024-04-18T10:42:50.869 INFO:tasks.workunit.client.0.smithi040.stdout:6/787: fdatasync df/d4b/d6e/d3f/d53/d8a/fac 0 2024-04-18T10:42:50.869 INFO:tasks.workunit.client.0.smithi040.stdout:5/717: mknod d0/d21/d42/dcc/de6/cee 0 2024-04-18T10:42:50.871 INFO:tasks.workunit.client.0.smithi040.stdout:1/775: chown d1/d9b/d75/fff 1 1 2024-04-18T10:42:50.872 INFO:tasks.workunit.client.0.smithi040.stdout:8/821: unlink d2/d10/d6a/cab 0 2024-04-18T10:42:50.874 INFO:tasks.workunit.client.0.smithi040.stdout:7/737: rename d6/d25/dcf/de4/d3c/f6d to d6/d25/dcf/de4/d2d/d47/d5c/da2/fe8 0 2024-04-18T10:42:50.876 INFO:tasks.workunit.client.0.smithi040.stdout:4/739: dwrite d2/d3/d41/d47/d99/fbb [0,4194304] 0 2024-04-18T10:42:50.876 INFO:tasks.workunit.client.0.smithi040.stdout:5/718: getdents d0/d3/d47/dac 0 2024-04-18T10:42:50.876 INFO:tasks.workunit.client.0.smithi040.stdout:6/788: read df/d4b/d7e/f83 [1661818,72858] 0 2024-04-18T10:42:50.879 INFO:tasks.workunit.client.0.smithi040.stdout:9/813: link d2/d3/d22/d2e/d35/d40/d85/ff2 d2/d3/d22/d2e/d35/daf/dc1/f116 0 2024-04-18T10:42:50.879 INFO:tasks.workunit.client.0.smithi040.stdout:7/738: mkdir d6/d25/d28/dac/de9 0 2024-04-18T10:42:50.880 INFO:tasks.workunit.client.0.smithi040.stdout:6/789: chown df/d76/ca3 7625 1 2024-04-18T10:42:50.882 INFO:tasks.workunit.client.0.smithi040.stdout:5/719: getdents d0/d3b/d3f 0 2024-04-18T10:42:50.883 INFO:tasks.workunit.client.0.smithi040.stdout:7/739: chown d6/d50/d79/da8/dad/fb9 13 1 2024-04-18T10:42:50.884 INFO:tasks.workunit.client.0.smithi040.stdout:6/790: write df/f20 [3310675,105609] 0 2024-04-18T10:42:50.887 INFO:tasks.workunit.client.0.smithi040.stdout:1/776: dwrite d1/d1c/d7b/d2e/f55 [0,4194304] 0 2024-04-18T10:42:50.887 INFO:tasks.workunit.client.0.smithi040.stdout:9/814: rmdir d2/d5b/d6f/d80/ddd/dfc 0 2024-04-18T10:42:50.887 INFO:tasks.workunit.client.0.smithi040.stdout:7/740: read d6/d25/d28/dac/f7d [47242,34290] 0 2024-04-18T10:42:50.887 INFO:tasks.workunit.client.0.smithi040.stdout:5/720: truncate d0/db5/fc1 477959 0 2024-04-18T10:42:50.892 INFO:tasks.workunit.client.0.smithi040.stdout:7/741: chown d6/d25/dcf/de4/d2d/d47/d55/d58/d6c/d8a 7256456 1 2024-04-18T10:42:50.892 INFO:tasks.workunit.client.0.smithi040.stdout:4/740: dwrite d2/d3/d4/d1f/d29/d49/d31/fa0 [0,4194304] 0 2024-04-18T10:42:50.894 INFO:tasks.workunit.client.0.smithi040.stdout:1/777: creat d1/d1c/d7b/d2e/d9e/f111 x:0 0 0 2024-04-18T10:42:50.896 INFO:tasks.workunit.client.0.smithi040.stdout:5/721: unlink d0/d3/l15 0 2024-04-18T10:42:50.897 INFO:tasks.workunit.client.0.smithi040.stdout:9/815: mkdir d2/d3/d22/d2e/d35/daf/dc1/d46/d117 0 2024-04-18T10:42:50.905 INFO:tasks.workunit.client.0.smithi040.stdout:3/793: write d1/d7/d12/f22 [1207747,89807] 0 2024-04-18T10:42:50.905 INFO:tasks.workunit.client.0.smithi040.stdout:7/742: fdatasync d6/f94 0 2024-04-18T10:42:50.906 INFO:tasks.workunit.client.0.smithi040.stdout:7/743: chown d6/d25/d28/dac/d64/fd4 21016 1 2024-04-18T10:42:50.907 INFO:tasks.workunit.client.0.smithi040.stdout:8/822: dread d2/d5/d9/f44 [0,4194304] 0 2024-04-18T10:42:50.908 INFO:tasks.workunit.client.0.smithi040.stdout:8/823: fsync d2/f17 0 2024-04-18T10:42:50.908 INFO:tasks.workunit.client.0.smithi040.stdout:5/722: mkdir d0/d3/dba/de7/def 0 2024-04-18T10:42:50.910 INFO:tasks.workunit.client.0.smithi040.stdout:9/816: symlink d2/d3/d22/d2e/d35/d40/d85/ded/l118 0 2024-04-18T10:42:50.913 INFO:tasks.workunit.client.0.smithi040.stdout:3/794: creat d1/d7/d28/dd5/fff x:0 0 0 2024-04-18T10:42:50.914 INFO:tasks.workunit.client.0.smithi040.stdout:7/744: dwrite d6/d25/d28/fa1 [0,4194304] 0 2024-04-18T10:42:50.914 INFO:tasks.workunit.client.0.smithi040.stdout:8/824: symlink d2/d15/d2b/d40/l112 0 2024-04-18T10:42:50.917 INFO:tasks.workunit.client.0.smithi040.stdout:9/817: symlink d2/d5b/d6f/d80/d75/l119 0 2024-04-18T10:42:50.918 INFO:tasks.workunit.client.0.smithi040.stdout:3/795: symlink d1/d7/d28/l100 0 2024-04-18T10:42:50.919 INFO:tasks.workunit.client.0.smithi040.stdout:5/723: creat d0/d3b/d3f/d72/dd6/ff0 x:0 0 0 2024-04-18T10:42:50.919 INFO:tasks.workunit.client.0.smithi040.stdout:0/808: dwrite dd/df/d19/f8c [0,4194304] 0 2024-04-18T10:42:50.922 INFO:tasks.workunit.client.0.smithi040.stdout:8/825: mkdir d2/d15/d2b/dd0/dff/d113 0 2024-04-18T10:42:50.924 INFO:tasks.workunit.client.0.smithi040.stdout:7/745: symlink d6/d25/dcf/de4/d2d/d47/d55/d58/dc4/lea 0 2024-04-18T10:42:50.925 INFO:tasks.workunit.client.0.smithi040.stdout:9/818: creat d2/d3/d22/d2e/d35/dbb/f11a x:0 0 0 2024-04-18T10:42:50.926 INFO:tasks.workunit.client.0.smithi040.stdout:2/717: sync 2024-04-18T10:42:50.927 INFO:tasks.workunit.client.0.smithi040.stdout:5/724: mknod d0/d3b/d3f/cf1 0 2024-04-18T10:42:50.928 INFO:tasks.workunit.client.0.smithi040.stdout:2/718: write dd/d14/d2b/dbc/d5f/d82/da6/db1/fbe [870419,30242] 0 2024-04-18T10:42:50.931 INFO:tasks.workunit.client.0.smithi040.stdout:8/826: rmdir d2/d22 39 2024-04-18T10:42:50.933 INFO:tasks.workunit.client.0.smithi040.stdout:7/746: chown d6/d25/dcf/de4/d2d/d47/d55/d58/fc9 0 1 2024-04-18T10:42:50.935 INFO:tasks.workunit.client.0.smithi040.stdout:5/725: chown d0/d21/d42/f7d 13899008 1 2024-04-18T10:42:50.940 INFO:tasks.workunit.client.0.smithi040.stdout:3/796: link d1/d2/d4e/d58/d62/faa d1/d2/d4e/d58/db4/f101 0 2024-04-18T10:42:50.941 INFO:tasks.workunit.client.0.smithi040.stdout:7/747: rmdir d6/d25/d28/dac/d64/d7e 39 2024-04-18T10:42:50.943 INFO:tasks.workunit.client.0.smithi040.stdout:5/726: mkdir d0/d3b/d3f/db1/df2 0 2024-04-18T10:42:50.947 INFO:tasks.workunit.client.0.smithi040.stdout:3/797: symlink d1/d7/d28/db7/l102 0 2024-04-18T10:42:50.950 INFO:tasks.workunit.client.0.smithi040.stdout:6/791: dwrite df/f3b [0,4194304] 0 2024-04-18T10:42:50.951 INFO:tasks.workunit.client.0.smithi040.stdout:8/827: mknod d2/d22/d49/c114 0 2024-04-18T10:42:50.952 INFO:tasks.workunit.client.0.smithi040.stdout:1/778: write d1/d1c/d2b/d32/d36/d4d/d67/fbf [18577,74114] 0 2024-04-18T10:42:50.953 INFO:tasks.workunit.client.0.smithi040.stdout:3/798: stat d1/d2/d4e/l6d 0 2024-04-18T10:42:50.955 INFO:tasks.workunit.client.0.smithi040.stdout:9/819: link d2/c28 d2/d3/d22/d2e/d35/daf/c11b 0 2024-04-18T10:42:50.956 INFO:tasks.workunit.client.0.smithi040.stdout:1/779: write d1/d16/f29 [1134174,116567] 0 2024-04-18T10:42:50.956 INFO:tasks.workunit.client.0.smithi040.stdout:0/809: dread dd/df/d19/d28/f6e [0,4194304] 0 2024-04-18T10:42:50.958 INFO:tasks.workunit.client.0.smithi040.stdout:5/727: rename d0/l26 to d0/d3/dba/de7/def/lf3 0 2024-04-18T10:42:50.961 INFO:tasks.workunit.client.0.smithi040.stdout:4/741: dwrite d2/d3/d4/d1f/d29/f64 [0,4194304] 0 2024-04-18T10:42:50.961 INFO:tasks.workunit.client.0.smithi040.stdout:5/728: readlink d0/d3b/d3f/l97 0 2024-04-18T10:42:50.964 INFO:tasks.workunit.client.0.smithi040.stdout:6/792: symlink df/d4b/d6a/d93/l122 0 2024-04-18T10:42:50.965 INFO:tasks.workunit.client.0.smithi040.stdout:3/799: dwrite d1/d7/d67/dc5/d3b/fad [4194304,4194304] 0 2024-04-18T10:42:50.968 INFO:tasks.workunit.client.0.smithi040.stdout:7/748: link d6/d25/la7 d6/d25/d28/dac/d64/d7e/leb 0 2024-04-18T10:42:50.971 INFO:tasks.workunit.client.0.smithi040.stdout:8/828: rename d2/d10/d6a/f70 to d2/d5/d9/d3c/de9/f115 0 2024-04-18T10:42:50.974 INFO:tasks.workunit.client.0.smithi040.stdout:4/742: creat d2/d3/d41/d62/d9a/fd2 x:0 0 0 2024-04-18T10:42:50.976 INFO:tasks.workunit.client.0.smithi040.stdout:6/793: rmdir df/d4b/d6e/d3f/d53 39 2024-04-18T10:42:50.979 INFO:tasks.workunit.client.0.smithi040.stdout:0/810: creat dd/d10b/f11d x:0 0 0 2024-04-18T10:42:50.980 INFO:tasks.workunit.client.0.smithi040.stdout:7/749: fdatasync d6/d25/dcf/de4/d2d/d47/f52 0 2024-04-18T10:42:50.981 INFO:tasks.workunit.client.0.smithi040.stdout:9/820: mknod d2/d3/d22/d2e/d35/daf/dc1/d46/d44/d8d/d10c/c11c 0 2024-04-18T10:42:50.981 INFO:tasks.workunit.client.0.smithi040.stdout:7/750: fsync d6/d3e/d73/f76 0 2024-04-18T10:42:50.982 INFO:tasks.workunit.client.0.smithi040.stdout:8/829: symlink d2/d2c/dbf/dc2/l116 0 2024-04-18T10:42:50.984 INFO:tasks.workunit.client.0.smithi040.stdout:4/743: creat d2/d3/d4/dd/d4f/fd3 x:0 0 0 2024-04-18T10:42:50.985 INFO:tasks.workunit.client.0.smithi040.stdout:3/800: mkdir d1/d7/d67/dc5/d103 0 2024-04-18T10:42:50.986 INFO:tasks.workunit.client.0.smithi040.stdout:2/719: dwrite dd/d14/d4a/f71 [0,4194304] 0 2024-04-18T10:42:50.986 INFO:tasks.workunit.client.0.smithi040.stdout:0/811: dread dd/d91/fdd [0,4194304] 0 2024-04-18T10:42:50.987 INFO:tasks.workunit.client.0.smithi040.stdout:1/780: creat d1/d1c/d7b/f112 x:0 0 0 2024-04-18T10:42:50.989 INFO:tasks.workunit.client.0.smithi040.stdout:1/781: chown d1/d1c/d7b/d2e/f93 2577370 1 2024-04-18T10:42:50.990 INFO:tasks.workunit.client.0.smithi040.stdout:4/744: truncate d2/d3/d41/d62/d7c/f80 923367 0 2024-04-18T10:42:50.991 INFO:tasks.workunit.client.0.smithi040.stdout:1/782: write d1/d1c/d7b/d2e/d3e/fde [2914,127849] 0 2024-04-18T10:42:50.994 INFO:tasks.workunit.client.0.smithi040.stdout:6/794: mkdir df/d123 0 2024-04-18T10:42:50.994 INFO:tasks.workunit.client.0.smithi040.stdout:6/795: fsync df/d4b/d7e/f88 0 2024-04-18T10:42:50.995 INFO:tasks.workunit.client.0.smithi040.stdout:8/830: creat d2/d2c/da9/f117 x:0 0 0 2024-04-18T10:42:50.995 INFO:tasks.workunit.client.0.smithi040.stdout:2/720: dread dd/d14/d2b/d7c/d37/d5b/fe0 [0,4194304] 0 2024-04-18T10:42:50.995 INFO:tasks.workunit.client.0.smithi040.stdout:7/751: readlink d6/d25/d28/dac/d63/le2 0 2024-04-18T10:42:50.996 INFO:tasks.workunit.client.0.smithi040.stdout:6/796: dread - df/d4b/d6a/fb0 zero size 2024-04-18T10:42:50.997 INFO:tasks.workunit.client.0.smithi040.stdout:3/801: mkdir d1/d7/d67/dc5/d91/db1/d104 0 2024-04-18T10:42:50.998 INFO:tasks.workunit.client.0.smithi040.stdout:6/797: write df/d4b/d6e/d3f/f5c [3306416,119058] 0 2024-04-18T10:42:50.999 INFO:tasks.workunit.client.0.smithi040.stdout:6/798: write df/d4b/d6a/d93/f3d [2736643,96331] 0 2024-04-18T10:42:51.000 INFO:tasks.workunit.client.0.smithi040.stdout:5/729: getdents d0/d3/d6b/d7b 0 2024-04-18T10:42:51.005 INFO:tasks.workunit.client.0.smithi040.stdout:8/831: mknod d2/d15/d78/c118 0 2024-04-18T10:42:51.006 INFO:tasks.workunit.client.0.smithi040.stdout:7/752: symlink d6/d25/dcf/de4/d2d/dbc/lec 0 2024-04-18T10:42:51.006 INFO:tasks.workunit.client.0.smithi040.stdout:8/832: write d2/d4c/f100 [2453203,84597] 0 2024-04-18T10:42:51.006 INFO:tasks.workunit.client.0.smithi040.stdout:7/753: chown d6/f22 3921 1 2024-04-18T10:42:51.008 INFO:tasks.workunit.client.0.smithi040.stdout:8/833: chown d2/d5/d9/d3c/d68/fe3 510624 1 2024-04-18T10:42:51.008 INFO:tasks.workunit.client.0.smithi040.stdout:7/754: chown d6/d25/dcf/de4/d2d/d47/lb3 41424282 1 2024-04-18T10:42:51.009 INFO:tasks.workunit.client.0.smithi040.stdout:2/721: symlink dd/d14/d2b/dbc/d5f/d82/da6/db1/ddf/lf1 0 2024-04-18T10:42:51.009 INFO:tasks.workunit.client.0.smithi040.stdout:7/755: chown d6/d25/dcf/de4/d2d/d47/d5c/d6b/c8b 5 1 2024-04-18T10:42:51.010 INFO:tasks.workunit.client.0.smithi040.stdout:3/802: symlink d1/d2/d4e/d58/dc4/df8/l105 0 2024-04-18T10:42:51.012 INFO:tasks.workunit.client.0.smithi040.stdout:0/812: creat dd/df/d4e/dc3/d103/f11e x:0 0 0 2024-04-18T10:42:51.012 INFO:tasks.workunit.client.0.smithi040.stdout:6/799: fdatasync df/d4b/d7e/f8c 0 2024-04-18T10:42:51.016 INFO:tasks.workunit.client.0.smithi040.stdout:9/821: creat d2/d3/d22/d2e/d35/daf/f11d x:0 0 0 2024-04-18T10:42:51.017 INFO:tasks.workunit.client.0.smithi040.stdout:8/834: rmdir d2/d15 39 2024-04-18T10:42:51.019 INFO:tasks.workunit.client.0.smithi040.stdout:0/813: mknod dd/df/d19/d8d/c11f 0 2024-04-18T10:42:51.032 INFO:tasks.workunit.client.0.smithi040.stdout:6/800: mknod df/d4b/d99/c124 0 2024-04-18T10:42:51.032 INFO:tasks.workunit.client.0.smithi040.stdout:5/730: creat d0/d3b/d3f/db1/df2/ff4 x:0 0 0 2024-04-18T10:42:51.033 INFO:tasks.workunit.client.0.smithi040.stdout:9/822: mkdir d2/d3/d22/d2e/d35/daf/dc1/d46/d44/d8d/d11e 0 2024-04-18T10:42:51.034 INFO:tasks.workunit.client.0.smithi040.stdout:2/722: creat dd/d14/d2b/d7c/d37/d5b/dda/ff2 x:0 0 0 2024-04-18T10:42:51.034 INFO:tasks.workunit.client.0.smithi040.stdout:8/835: chown d2/d2c/c9b 12695 1 2024-04-18T10:42:51.034 INFO:tasks.workunit.client.0.smithi040.stdout:1/783: dread d1/fa5 [0,4194304] 0 2024-04-18T10:42:51.036 INFO:tasks.workunit.client.0.smithi040.stdout:0/814: stat dd/ce 0 2024-04-18T10:42:51.038 INFO:tasks.workunit.client.0.smithi040.stdout:3/803: truncate d1/d7/d12/f30 2582094 0 2024-04-18T10:42:51.039 INFO:tasks.workunit.client.0.smithi040.stdout:5/731: mknod d0/d21/d42/dcc/de6/cf5 0 2024-04-18T10:42:51.040 INFO:tasks.workunit.client.0.smithi040.stdout:8/836: fdatasync d2/d10/d14/f16 0 2024-04-18T10:42:51.040 INFO:tasks.workunit.client.0.smithi040.stdout:1/784: rmdir d1/d1c/d7b/d2e/da4 39 2024-04-18T10:42:51.041 INFO:tasks.workunit.client.0.smithi040.stdout:6/801: dread - df/d4b/d6e/d3f/d53/d8a/fa4 zero size 2024-04-18T10:42:51.042 INFO:tasks.workunit.client.0.smithi040.stdout:2/723: creat dd/d14/d2b/d7c/d37/d38/d8c/ff3 x:0 0 0 2024-04-18T10:42:51.043 INFO:tasks.workunit.client.0.smithi040.stdout:0/815: mknod dd/df/d19/d28/d3a/d5b/dd0/df7/c120 0 2024-04-18T10:42:51.045 INFO:tasks.workunit.client.0.smithi040.stdout:4/745: dwrite d2/d3/d4/dd/d6d/d70/f7d [0,4194304] 0 2024-04-18T10:42:51.048 INFO:tasks.workunit.client.0.smithi040.stdout:5/732: creat d0/d78/d95/d52/d5d/ff6 x:0 0 0 2024-04-18T10:42:51.048 INFO:tasks.workunit.client.0.smithi040.stdout:8/837: write d2/d22/d80/da2/fd8 [610224,4681] 0 2024-04-18T10:42:51.049 INFO:tasks.workunit.client.0.smithi040.stdout:6/802: write df/d4b/d99/ff1 [3535467,36205] 0 2024-04-18T10:42:51.049 INFO:tasks.workunit.client.0.smithi040.stdout:1/785: truncate d1/d16/f1b 2048887 0 2024-04-18T10:42:51.050 INFO:tasks.workunit.client.0.smithi040.stdout:9/823: dwrite d2/d5b/d6f/d80/fab [0,4194304] 0 2024-04-18T10:42:51.051 INFO:tasks.workunit.client.0.smithi040.stdout:0/816: write dd/df/d19/d3e/fcd [974582,118909] 0 2024-04-18T10:42:51.053 INFO:tasks.workunit.client.0.smithi040.stdout:2/724: creat dd/d14/d2b/dbc/d5f/d82/da6/dce/ff4 x:0 0 0 2024-04-18T10:42:51.054 INFO:tasks.workunit.client.0.smithi040.stdout:6/803: fsync df/d4b/d7e/f83 0 2024-04-18T10:42:51.056 INFO:tasks.workunit.client.0.smithi040.stdout:2/725: read dd/d14/d2b/dbc/d5f/d82/da6/d52/f94 [518168,48324] 0 2024-04-18T10:42:51.056 INFO:tasks.workunit.client.0.smithi040.stdout:5/733: rmdir d0/d3/d47/dd5 39 2024-04-18T10:42:51.057 INFO:tasks.workunit.client.0.smithi040.stdout:2/726: write dd/d14/d2b/f2e [4801236,130609] 0 2024-04-18T10:42:51.057 INFO:tasks.workunit.client.0.smithi040.stdout:4/746: symlink d2/d3/d41/d62/db0/ld4 0 2024-04-18T10:42:51.058 INFO:tasks.workunit.client.0.smithi040.stdout:8/838: stat d2/d5/d9/d63/fdd 0 2024-04-18T10:42:51.062 INFO:tasks.workunit.client.0.smithi040.stdout:2/727: stat dd/d14/c21 0 2024-04-18T10:42:51.063 INFO:tasks.workunit.client.0.smithi040.stdout:8/839: mknod d2/d10/d6a/c119 0 2024-04-18T10:42:51.063 INFO:tasks.workunit.client.0.smithi040.stdout:4/747: symlink d2/d3/d41/d62/d7c/ld5 0 2024-04-18T10:42:51.063 INFO:tasks.workunit.client.0.smithi040.stdout:8/840: fdatasync d2/d5/d9/fe6 0 2024-04-18T10:42:51.064 INFO:tasks.workunit.client.0.smithi040.stdout:4/748: chown d2/d3/d41/l96 968 1 2024-04-18T10:42:51.066 INFO:tasks.workunit.client.0.smithi040.stdout:2/728: rmdir dd/d14/d2b/d7c/d37/da3 39 2024-04-18T10:42:51.068 INFO:tasks.workunit.client.0.smithi040.stdout:8/841: symlink d2/d4c/d97/l11a 0 2024-04-18T10:42:51.069 INFO:tasks.workunit.client.0.smithi040.stdout:6/804: creat df/d4b/d6e/d3f/f125 x:0 0 0 2024-04-18T10:42:51.070 INFO:tasks.workunit.client.0.smithi040.stdout:9/824: getdents d2/d5b 0 2024-04-18T10:42:51.072 INFO:tasks.workunit.client.0.smithi040.stdout:0/817: getdents dd/df/d4e 0 2024-04-18T10:42:51.072 INFO:tasks.workunit.client.0.smithi040.stdout:2/729: stat dd/d14/d2b/d7c/d37/da3 0 2024-04-18T10:42:51.072 INFO:tasks.workunit.client.0.smithi040.stdout:9/825: stat d2/d5b/d6f 0 2024-04-18T10:42:51.072 INFO:tasks.workunit.client.0.smithi040.stdout:8/842: fdatasync d2/f6c 0 2024-04-18T10:42:51.074 INFO:tasks.workunit.client.0.smithi040.stdout:6/805: symlink df/d4b/deb/df5/l126 0 2024-04-18T10:42:51.079 INFO:tasks.workunit.client.0.smithi040.stdout:0/818: chown dd/df/d19/d28/d3a/d42/d100 1927915 1 2024-04-18T10:42:51.079 INFO:tasks.workunit.client.0.smithi040.stdout:7/756: sync 2024-04-18T10:42:51.079 INFO:tasks.workunit.client.0.smithi040.stdout:6/806: mkdir df/d4b/deb/df5/d127 0 2024-04-18T10:42:51.081 INFO:tasks.workunit.client.0.smithi040.stdout:4/749: dwrite d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:51.082 INFO:tasks.workunit.client.0.smithi040.stdout:0/819: readlink dd/df/d19/d28/db7/dd4/lfa 0 2024-04-18T10:42:51.085 INFO:tasks.workunit.client.0.smithi040.stdout:8/843: creat d2/f11b x:0 0 0 2024-04-18T10:42:51.085 INFO:tasks.workunit.client.0.smithi040.stdout:6/807: chown df/d4b/d6a/d93/fe4 1270214 1 2024-04-18T10:42:51.087 INFO:tasks.workunit.client.0.smithi040.stdout:1/786: write d1/d1c/d7b/d2e/da4/fbd [2234923,96067] 0 2024-04-18T10:42:51.088 INFO:tasks.workunit.client.0.smithi040.stdout:3/804: dread d1/d2/d4e/d58/d62/faa [0,4194304] 0 2024-04-18T10:42:51.088 INFO:tasks.workunit.client.0.smithi040.stdout:7/757: write d6/d50/d79/da8/dad/fc2 [4211782,95593] 0 2024-04-18T10:42:51.091 INFO:tasks.workunit.client.0.smithi040.stdout:2/730: dwrite dd/d61/f70 [0,4194304] 0 2024-04-18T10:42:51.092 INFO:tasks.workunit.client.0.smithi040.stdout:0/820: chown dd/df/d19/d3e/l9a 1 1 2024-04-18T10:42:51.092 INFO:tasks.workunit.client.0.smithi040.stdout:4/750: mknod d2/d3/d4/d21/d28/cd6 0 2024-04-18T10:42:51.093 INFO:tasks.workunit.client.0.smithi040.stdout:9/826: dwrite d2/d3/d22/d2e/faa [0,4194304] 0 2024-04-18T10:42:51.093 INFO:tasks.workunit.client.0.smithi040.stdout:5/734: dread d0/d3b/d67/f73 [0,4194304] 0 2024-04-18T10:42:51.097 INFO:tasks.workunit.client.0.smithi040.stdout:8/844: unlink d2/d5/d9/d3c/c61 0 2024-04-18T10:42:51.097 INFO:tasks.workunit.client.0.smithi040.stdout:0/821: fsync dd/df/d19/d28/f6e 0 2024-04-18T10:42:51.099 INFO:tasks.workunit.client.0.smithi040.stdout:9/827: stat d2/d3/d22/d2e/d35/daf/dc1/d46/d86/d109/f110 0 2024-04-18T10:42:51.100 INFO:tasks.workunit.client.0.smithi040.stdout:5/735: creat d0/d3/dba/de7/ff7 x:0 0 0 2024-04-18T10:42:51.100 INFO:tasks.workunit.client.0.smithi040.stdout:2/731: creat dd/d61/d8e/d98/dcc/dd4/ff5 x:0 0 0 2024-04-18T10:42:51.101 INFO:tasks.workunit.client.0.smithi040.stdout:4/751: creat d2/d3/d4/d1f/d29/d49/d31/fd7 x:0 0 0 2024-04-18T10:42:51.102 INFO:tasks.workunit.client.0.smithi040.stdout:7/758: dwrite d6/d3e/f69 [0,4194304] 0 2024-04-18T10:42:51.103 INFO:tasks.workunit.client.0.smithi040.stdout:6/808: creat df/d4b/db7/dcc/f128 x:0 0 0 2024-04-18T10:42:51.105 INFO:tasks.workunit.client.0.smithi040.stdout:0/822: fdatasync dd/d91/fdd 0 2024-04-18T10:42:51.107 INFO:tasks.workunit.client.0.smithi040.stdout:9/828: creat d2/d3/d22/d2e/f11f x:0 0 0 2024-04-18T10:42:51.108 INFO:tasks.workunit.client.0.smithi040.stdout:2/732: creat dd/d14/d2b/dbc/d5f/d82/da6/dce/ff6 x:0 0 0 2024-04-18T10:42:51.109 INFO:tasks.workunit.client.0.smithi040.stdout:3/805: link d1/f4f d1/d7/d3a/f106 0 2024-04-18T10:42:51.111 INFO:tasks.workunit.client.0.smithi040.stdout:6/809: creat df/d76/db9/f129 x:0 0 0 2024-04-18T10:42:51.113 INFO:tasks.workunit.client.0.smithi040.stdout:4/752: mknod d2/d3/d4/cd8 0 2024-04-18T10:42:51.114 INFO:tasks.workunit.client.0.smithi040.stdout:9/829: mknod d2/d3/d22/d2e/d35/daf/dc1/c120 0 2024-04-18T10:42:51.114 INFO:tasks.workunit.client.0.smithi040.stdout:0/823: dwrite dd/daa/dd8/f112 [0,4194304] 0 2024-04-18T10:42:51.117 INFO:tasks.workunit.client.0.smithi040.stdout:3/806: rmdir d1/d7/d67/dc5/d91 39 2024-04-18T10:42:51.118 INFO:tasks.workunit.client.0.smithi040.stdout:6/810: chown df/f27 675180 1 2024-04-18T10:42:51.119 INFO:tasks.workunit.client.0.smithi040.stdout:2/733: symlink dd/d14/d2b/d7c/d37/de4/lf7 0 2024-04-18T10:42:51.120 INFO:tasks.workunit.client.0.smithi040.stdout:4/753: chown d2/d3/d4/dd/d6d/l93 414420730 1 2024-04-18T10:42:51.120 INFO:tasks.workunit.client.0.smithi040.stdout:0/824: mknod dd/df/d19/d3e/d75/c121 0 2024-04-18T10:42:51.121 INFO:tasks.workunit.client.0.smithi040.stdout:6/811: dread - df/d4b/d99/dc4/d10c/f119 zero size 2024-04-18T10:42:51.122 INFO:tasks.workunit.client.0.smithi040.stdout:3/807: mkdir d1/d7/d67/d107 0 2024-04-18T10:42:51.123 INFO:tasks.workunit.client.0.smithi040.stdout:9/830: dwrite d2/d3/d70/fb2 [0,4194304] 0 2024-04-18T10:42:51.124 INFO:tasks.workunit.client.0.smithi040.stdout:2/734: write dd/d14/d2b/dbc/d5f/fe1 [4344557,121961] 0 2024-04-18T10:42:51.125 INFO:tasks.workunit.client.0.smithi040.stdout:5/736: dread d0/d21/f44 [0,4194304] 0 2024-04-18T10:42:51.126 INFO:tasks.workunit.client.0.smithi040.stdout:3/808: chown d1/d7/d28/cbc 35857 1 2024-04-18T10:42:51.127 INFO:tasks.workunit.client.0.smithi040.stdout:6/812: mkdir df/d4b/db7/df6/d12a 0 2024-04-18T10:42:51.128 INFO:tasks.workunit.client.0.smithi040.stdout:4/754: truncate d2/d3/d4/dd/fbd 647295 0 2024-04-18T10:42:51.129 INFO:tasks.workunit.client.0.smithi040.stdout:3/809: write d1/d7/d28/fd1 [689955,123623] 0 2024-04-18T10:42:51.129 INFO:tasks.workunit.client.0.smithi040.stdout:0/825: rename dd/df/d19/d3e/df4 to dd/da3/d122 0 2024-04-18T10:42:51.130 INFO:tasks.workunit.client.0.smithi040.stdout:0/826: readlink dd/df/d19/d28/d3a/d42/lb4 0 2024-04-18T10:42:51.131 INFO:tasks.workunit.client.0.smithi040.stdout:2/735: unlink dd/d61/la0 0 2024-04-18T10:42:51.132 INFO:tasks.workunit.client.0.smithi040.stdout:2/736: fsync dd/d14/d2b/d7c/d37/f62 0 2024-04-18T10:42:51.134 INFO:tasks.workunit.client.0.smithi040.stdout:9/831: symlink d2/d3/d22/d2e/d35/daf/dc1/d46/d5f/dc4/l121 0 2024-04-18T10:42:51.135 INFO:tasks.workunit.client.0.smithi040.stdout:6/813: mkdir df/d76/d91/d12b 0 2024-04-18T10:42:51.136 INFO:tasks.workunit.client.0.smithi040.stdout:0/827: creat dd/df/d19/d28/d3a/d5b/dd0/f123 x:0 0 0 2024-04-18T10:42:51.139 INFO:tasks.workunit.client.0.smithi040.stdout:4/755: symlink d2/d3/d2f/dce/ld9 0 2024-04-18T10:42:51.139 INFO:tasks.workunit.client.0.smithi040.stdout:5/737: getdents d0/d3/d6b/d7b 0 2024-04-18T10:42:51.141 INFO:tasks.workunit.client.0.smithi040.stdout:1/787: dread d1/d9b/d75/f95 [0,4194304] 0 2024-04-18T10:42:51.141 INFO:tasks.workunit.client.0.smithi040.stdout:2/737: rename dd/d14/d2b/d7c/l40 to dd/d14/d2b/dbc/d5f/d82/da6/lf8 0 2024-04-18T10:42:51.142 INFO:tasks.workunit.client.0.smithi040.stdout:5/738: creat d0/db5/ff8 x:0 0 0 2024-04-18T10:42:51.144 INFO:tasks.workunit.client.0.smithi040.stdout:9/832: rmdir d2/dd/db4 0 2024-04-18T10:42:51.148 INFO:tasks.workunit.client.0.smithi040.stdout:9/833: read d2/d3/f41 [842887,57346] 0 2024-04-18T10:42:51.150 INFO:tasks.workunit.client.0.smithi040.stdout:0/828: rename dd/df/d19/c3f to dd/c124 0 2024-04-18T10:42:51.151 INFO:tasks.workunit.client.0.smithi040.stdout:0/829: fdatasync dd/df/d19/d28/d3a/d5b/dd0/df7/f111 0 2024-04-18T10:42:51.156 INFO:tasks.workunit.client.0.smithi040.stdout:9/834: rename d2/d3/d97/l10e to d2/d3/d22/l122 0 2024-04-18T10:42:51.156 INFO:tasks.workunit.client.0.smithi040.stdout:6/814: dread df/d4b/d6a/d93/f47 [0,4194304] 0 2024-04-18T10:42:51.156 INFO:tasks.workunit.client.0.smithi040.stdout:8/845: write d2/d2c/da9/fbc [841811,35762] 0 2024-04-18T10:42:51.157 INFO:tasks.workunit.client.0.smithi040.stdout:0/830: symlink dd/df/d19/l125 0 2024-04-18T10:42:51.158 INFO:tasks.workunit.client.0.smithi040.stdout:7/759: dwrite d6/d25/dcf/de4/f3d [0,4194304] 0 2024-04-18T10:42:51.159 INFO:tasks.workunit.client.0.smithi040.stdout:6/815: fsync df/d76/db9/dbd/fbf 0 2024-04-18T10:42:51.160 INFO:tasks.workunit.client.0.smithi040.stdout:9/835: fdatasync d2/d3/d22/db3/ff7 0 2024-04-18T10:42:51.163 INFO:tasks.workunit.client.0.smithi040.stdout:8/846: symlink d2/d5/d9/d3c/d68/l11c 0 2024-04-18T10:42:51.163 INFO:tasks.workunit.client.0.smithi040.stdout:8/847: stat d2/d22/d49 0 2024-04-18T10:42:51.165 INFO:tasks.workunit.client.0.smithi040.stdout:0/831: dread dd/df/d19/d3e/fcd [0,4194304] 0 2024-04-18T10:42:51.167 INFO:tasks.workunit.client.0.smithi040.stdout:0/832: stat dd/df/d19/d28/d3a/d5b/c73 0 2024-04-18T10:42:51.169 INFO:tasks.workunit.client.0.smithi040.stdout:8/848: creat d2/d22/d49/df1/f11d x:0 0 0 2024-04-18T10:42:51.171 INFO:tasks.workunit.client.0.smithi040.stdout:9/836: dwrite d2/d3/d70/da8/f112 [0,4194304] 0 2024-04-18T10:42:51.173 INFO:tasks.workunit.client.0.smithi040.stdout:7/760: dread d6/d25/dcf/de4/f4d [0,4194304] 0 2024-04-18T10:42:51.174 INFO:tasks.workunit.client.0.smithi040.stdout:0/833: creat dd/f126 x:0 0 0 2024-04-18T10:42:51.176 INFO:tasks.workunit.client.0.smithi040.stdout:4/756: write d2/d3/d4/dd/fa9 [251025,73434] 0 2024-04-18T10:42:51.177 INFO:tasks.workunit.client.0.smithi040.stdout:2/738: chown dd/d14/d2b/dbc/d5f/d82/da6/db1 0 1 2024-04-18T10:42:51.180 INFO:tasks.workunit.client.0.smithi040.stdout:7/761: dread d6/d25/d28/f87 [0,4194304] 0 2024-04-18T10:42:51.180 INFO:tasks.workunit.client.0.smithi040.stdout:0/834: creat dd/df/d19/d3e/d77/f127 x:0 0 0 2024-04-18T10:42:51.180 INFO:tasks.workunit.client.0.smithi040.stdout:8/849: dwrite d2/d5/d9/f9d [0,4194304] 0 2024-04-18T10:42:51.183 INFO:tasks.workunit.client.0.smithi040.stdout:9/837: link d2/d3/d22/d2e/d35/daf/dc1/d46/d86/d109/f110 d2/d3/d22/db3/f123 0 2024-04-18T10:42:51.186 INFO:tasks.workunit.client.0.smithi040.stdout:4/757: dwrite d2/d3/d41/fc8 [0,4194304] 0 2024-04-18T10:42:51.188 INFO:tasks.workunit.client.0.smithi040.stdout:2/739: fsync dd/d14/d2b/dbc/d5f/d82/da6/f97 0 2024-04-18T10:42:51.190 INFO:tasks.workunit.client.0.smithi040.stdout:0/835: creat dd/df/d19/d28/db7/f128 x:0 0 0 2024-04-18T10:42:51.190 INFO:tasks.workunit.client.0.smithi040.stdout:4/758: read d2/f9 [799639,68073] 0 2024-04-18T10:42:51.193 INFO:tasks.workunit.client.0.smithi040.stdout:6/816: dread df/d4b/fb6 [0,4194304] 0 2024-04-18T10:42:51.194 INFO:tasks.workunit.client.0.smithi040.stdout:2/740: dread dd/d14/f47 [0,4194304] 0 2024-04-18T10:42:51.195 INFO:tasks.workunit.client.0.smithi040.stdout:2/741: fdatasync f9 0 2024-04-18T10:42:51.197 INFO:tasks.workunit.client.0.smithi040.stdout:0/836: dwrite dd/f126 [0,4194304] 0 2024-04-18T10:42:51.204 INFO:tasks.workunit.client.0.smithi040.stdout:4/759: readlink d2/d3/d4/lc4 0 2024-04-18T10:42:51.208 INFO:tasks.workunit.client.0.smithi040.stdout:2/742: creat dd/d14/d2b/d7c/ff9 x:0 0 0 2024-04-18T10:42:51.210 INFO:tasks.workunit.client.0.smithi040.stdout:8/850: symlink d2/d15/d78/d10b/l11e 0 2024-04-18T10:42:51.210 INFO:tasks.workunit.client.0.smithi040.stdout:5/739: sync 2024-04-18T10:42:51.210 INFO:tasks.workunit.client.0.smithi040.stdout:1/788: sync 2024-04-18T10:42:51.210 INFO:tasks.workunit.client.0.smithi040.stdout:3/810: sync 2024-04-18T10:42:51.212 INFO:tasks.workunit.client.0.smithi040.stdout:9/838: rename d2/d3 to d2/d5b/d6f/d80/d75/d124 0 2024-04-18T10:42:51.214 INFO:tasks.workunit.client.0.smithi040.stdout:6/817: symlink df/d121/l12c 0 2024-04-18T10:42:51.215 INFO:tasks.workunit.client.0.smithi040.stdout:2/743: mkdir dd/d14/d2b/d7c/d37/d38/d8c/dd5/dfa 0 2024-04-18T10:42:51.215 INFO:tasks.workunit.client.0.smithi040.stdout:7/762: getdents d6/d25/dcf/de4/d2d/d47/d5c 0 2024-04-18T10:42:51.217 INFO:tasks.workunit.client.0.smithi040.stdout:8/851: creat d2/d5/d9/d1b/f11f x:0 0 0 2024-04-18T10:42:51.217 INFO:tasks.workunit.client.0.smithi040.stdout:4/760: write d2/d3/d41/fc8 [4166546,57465] 0 2024-04-18T10:42:51.220 INFO:tasks.workunit.client.0.smithi040.stdout:9/839: rename d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d44 to d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40/d85/ded/d125 0 2024-04-18T10:42:51.220 INFO:tasks.workunit.client.0.smithi040.stdout:2/744: dread dd/d14/f47 [0,4194304] 0 2024-04-18T10:42:51.221 INFO:tasks.workunit.client.0.smithi040.stdout:6/818: creat df/d4b/d6a/d93/f12d x:0 0 0 2024-04-18T10:42:51.236 INFO:tasks.workunit.client.0.smithi040.stdout:5/740: mknod d0/d3b/cf9 0 2024-04-18T10:42:51.237 INFO:tasks.workunit.client.0.smithi040.stdout:3/811: creat d1/d2/d4e/d58/dbe/dca/f108 x:0 0 0 2024-04-18T10:42:51.239 INFO:tasks.workunit.client.0.smithi040.stdout:1/789: getdents d1/d1c/d2b/db5/dcc 0 2024-04-18T10:42:51.245 INFO:tasks.workunit.client.0.smithi040.stdout:6/819: mkdir df/d4b/d6e/d3f/d12e 0 2024-04-18T10:42:51.245 INFO:tasks.workunit.client.0.smithi040.stdout:8/852: dwrite d2/d4c/f100 [4194304,4194304] 0 2024-04-18T10:42:51.246 INFO:tasks.workunit.client.0.smithi040.stdout:9/840: creat d2/d7/f126 x:0 0 0 2024-04-18T10:42:51.246 INFO:tasks.workunit.client.0.smithi040.stdout:4/761: dwrite d2/d3/d4/dd/f89 [0,4194304] 0 2024-04-18T10:42:51.248 INFO:tasks.workunit.client.0.smithi040.stdout:1/790: truncate d1/db1/fef 4791254 0 2024-04-18T10:42:51.249 INFO:tasks.workunit.client.0.smithi040.stdout:2/745: getdents dd/d14/d2b/d7c/d37 0 2024-04-18T10:42:51.252 INFO:tasks.workunit.client.0.smithi040.stdout:4/762: write d2/d3/d4/d23/f63 [60509,41868] 0 2024-04-18T10:42:51.254 INFO:tasks.workunit.client.0.smithi040.stdout:0/837: dwrite dd/df/f40 [0,4194304] 0 2024-04-18T10:42:51.256 INFO:tasks.workunit.client.0.smithi040.stdout:3/812: dwrite d1/d2/f17 [0,4194304] 0 2024-04-18T10:42:51.261 INFO:tasks.workunit.client.0.smithi040.stdout:2/746: truncate dd/d14/f47 4359136 0 2024-04-18T10:42:51.262 INFO:tasks.workunit.client.0.smithi040.stdout:4/763: mknod d2/d3/d4/dd/cda 0 2024-04-18T10:42:51.264 INFO:tasks.workunit.client.0.smithi040.stdout:4/764: stat d2/c1b 0 2024-04-18T10:42:51.265 INFO:tasks.workunit.client.0.smithi040.stdout:6/820: dwrite df/d4b/db7/dcc/f128 [0,4194304] 0 2024-04-18T10:42:51.265 INFO:tasks.workunit.client.0.smithi040.stdout:0/838: creat dd/d91/f129 x:0 0 0 2024-04-18T10:42:51.266 INFO:tasks.workunit.client.0.smithi040.stdout:8/853: getdents d2/d2c/dbf/dc2 0 2024-04-18T10:42:51.266 INFO:tasks.workunit.client.0.smithi040.stdout:1/791: dwrite d1/d1c/d2b/d32/d36/d4d/d67/fa3 [0,4194304] 0 2024-04-18T10:42:51.266 INFO:tasks.workunit.client.0.smithi040.stdout:3/813: mknod d1/d2/d3c/c109 0 2024-04-18T10:42:51.267 INFO:tasks.workunit.client.0.smithi040.stdout:6/821: chown df/f3b 13062000 1 2024-04-18T10:42:51.268 INFO:tasks.workunit.client.0.smithi040.stdout:9/841: symlink d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/l127 0 2024-04-18T10:42:51.268 INFO:tasks.workunit.client.0.smithi040.stdout:8/854: readlink d2/d5/ldf 0 2024-04-18T10:42:51.269 INFO:tasks.workunit.client.0.smithi040.stdout:0/839: write dd/df/d19/f8c [1652836,15725] 0 2024-04-18T10:42:51.272 INFO:tasks.workunit.client.0.smithi040.stdout:4/765: mknod d2/d3/d4/d21/d28/cdb 0 2024-04-18T10:42:51.272 INFO:tasks.workunit.client.0.smithi040.stdout:0/840: fsync dd/df/d19/d3e/d77/fb2 0 2024-04-18T10:42:51.274 INFO:tasks.workunit.client.0.smithi040.stdout:8/855: write d2/f67 [1294545,108469] 0 2024-04-18T10:42:51.278 INFO:tasks.workunit.client.0.smithi040.stdout:0/841: read - dd/f6b zero size 2024-04-18T10:42:51.278 INFO:tasks.workunit.client.0.smithi040.stdout:1/792: dwrite d1/d1c/d2b/d32/d36/d4d/d67/fa3 [0,4194304] 0 2024-04-18T10:42:51.280 INFO:tasks.workunit.client.0.smithi040.stdout:8/856: mkdir d2/d15/d78/d10b/d120 0 2024-04-18T10:42:51.284 INFO:tasks.workunit.client.0.smithi040.stdout:4/766: creat d2/d3/d41/d94/dc7/fdc x:0 0 0 2024-04-18T10:42:51.284 INFO:tasks.workunit.client.0.smithi040.stdout:1/793: dread d1/d1c/d7b/d2e/f93 [0,4194304] 0 2024-04-18T10:42:51.285 INFO:tasks.workunit.client.0.smithi040.stdout:9/842: getdents d2/df0 0 2024-04-18T10:42:51.285 INFO:tasks.workunit.client.0.smithi040.stdout:8/857: read d2/d22/d49/fd7 [1549390,72729] 0 2024-04-18T10:42:51.286 INFO:tasks.workunit.client.0.smithi040.stdout:8/858: fsync d2/d5/d9/d3c/d5a/fb2 0 2024-04-18T10:42:51.286 INFO:tasks.workunit.client.0.smithi040.stdout:6/822: rename df/d4b/f87 to df/d4b/d99/dc4/d10c/f12f 0 2024-04-18T10:42:51.288 INFO:tasks.workunit.client.0.smithi040.stdout:6/823: readlink df/d76/db9/dbd/l118 0 2024-04-18T10:42:51.290 INFO:tasks.workunit.client.0.smithi040.stdout:1/794: mknod d1/d1c/d2b/d32/dfd/c113 0 2024-04-18T10:42:51.292 INFO:tasks.workunit.client.0.smithi040.stdout:9/843: dwrite d2/d5b/d6f/dc3/f105 [0,4194304] 0 2024-04-18T10:42:51.294 INFO:tasks.workunit.client.0.smithi040.stdout:9/844: chown d2/d5b/d6f/d80/d75/d124/d70/da8 3806 1 2024-04-18T10:42:51.296 INFO:tasks.workunit.client.0.smithi040.stdout:1/795: rename d1/d1c/f24 to d1/d1c/d7b/d2d/f114 0 2024-04-18T10:42:51.297 INFO:tasks.workunit.client.0.smithi040.stdout:5/741: dread d0/d3b/fbc [0,4194304] 0 2024-04-18T10:42:51.299 INFO:tasks.workunit.client.0.smithi040.stdout:5/742: truncate d0/d3b/d3f/fb4 613527 0 2024-04-18T10:42:51.299 INFO:tasks.workunit.client.0.smithi040.stdout:1/796: mknod d1/d9b/d75/d84/dac/dda/c115 0 2024-04-18T10:42:51.299 INFO:tasks.workunit.client.0.smithi040.stdout:8/859: dread d2/d10/d14/f104 [0,4194304] 0 2024-04-18T10:42:51.299 INFO:tasks.workunit.client.0.smithi040.stdout:5/743: readlink d0/d3b/l46 0 2024-04-18T10:42:51.302 INFO:tasks.workunit.client.0.smithi040.stdout:1/797: unlink d1/db1/lb2 0 2024-04-18T10:42:51.305 INFO:tasks.workunit.client.0.smithi040.stdout:7/763: sync 2024-04-18T10:42:51.305 INFO:tasks.workunit.client.0.smithi040.stdout:1/798: unlink d1/d1c/d7b/c10f 0 2024-04-18T10:42:51.307 INFO:tasks.workunit.client.0.smithi040.stdout:8/860: dwrite d2/d10/d14/fb6 [0,4194304] 0 2024-04-18T10:42:51.308 INFO:tasks.workunit.client.0.smithi040.stdout:7/764: write d6/f44 [118020,76060] 0 2024-04-18T10:42:51.311 INFO:tasks.workunit.client.0.smithi040.stdout:8/861: creat d2/d4c/d97/f121 x:0 0 0 2024-04-18T10:42:51.312 INFO:tasks.workunit.client.0.smithi040.stdout:5/744: dwrite d0/d3/fe2 [0,4194304] 0 2024-04-18T10:42:51.315 INFO:tasks.workunit.client.0.smithi040.stdout:1/799: link d1/d1c/d2b/d32/d36/f50 d1/d16/f116 0 2024-04-18T10:42:51.317 INFO:tasks.workunit.client.0.smithi040.stdout:5/745: mkdir d0/d3b/d3f/db1/df2/dfa 0 2024-04-18T10:42:51.318 INFO:tasks.workunit.client.0.smithi040.stdout:7/765: dwrite d6/d25/d28/fa1 [0,4194304] 0 2024-04-18T10:42:51.318 INFO:tasks.workunit.client.0.smithi040.stdout:1/800: truncate d1/d1c/d7b/d2e/d9e/f111 372935 0 2024-04-18T10:42:51.319 INFO:tasks.workunit.client.0.smithi040.stdout:5/746: write d0/db5/ff8 [852070,84703] 0 2024-04-18T10:42:51.319 INFO:tasks.workunit.client.0.smithi040.stdout:5/747: chown d0/d21 1865126 1 2024-04-18T10:42:51.320 INFO:tasks.workunit.client.0.smithi040.stdout:5/748: readlink d0/d3/l8 0 2024-04-18T10:42:51.320 INFO:tasks.workunit.client.0.smithi040.stdout:8/862: link d2/d5/d9/d1b/l2e d2/d15/d2b/l122 0 2024-04-18T10:42:51.324 INFO:tasks.workunit.client.0.smithi040.stdout:5/749: unlink d0/d78/d95/l80 0 2024-04-18T10:42:51.325 INFO:tasks.workunit.client.0.smithi040.stdout:1/801: symlink d1/d1c/d7b/d2e/da4/d107/l117 0 2024-04-18T10:42:51.328 INFO:tasks.workunit.client.0.smithi040.stdout:5/750: creat d0/d21/ffb x:0 0 0 2024-04-18T10:42:51.329 INFO:tasks.workunit.client.0.smithi040.stdout:1/802: creat d1/d1c/d7b/d2e/f118 x:0 0 0 2024-04-18T10:42:51.329 INFO:tasks.workunit.client.0.smithi040.stdout:5/751: chown d0/d78/d95/d52/d5d/f9e 403909 1 2024-04-18T10:42:51.332 INFO:tasks.workunit.client.0.smithi040.stdout:5/752: creat d0/d3/d6b/d7b/ddc/ffc x:0 0 0 2024-04-18T10:42:51.333 INFO:tasks.workunit.client.0.smithi040.stdout:1/803: mkdir d1/d1c/d7b/d119 0 2024-04-18T10:42:51.333 INFO:tasks.workunit.client.0.smithi040.stdout:5/753: rmdir d0/d3b/d88 39 2024-04-18T10:42:51.334 INFO:tasks.workunit.client.0.smithi040.stdout:5/754: write d0/d21/d42/f8f [3433664,105906] 0 2024-04-18T10:42:51.336 INFO:tasks.workunit.client.0.smithi040.stdout:1/804: creat d1/d1c/f11a x:0 0 0 2024-04-18T10:42:51.336 INFO:tasks.workunit.client.0.smithi040.stdout:1/805: write d1/db1/fef [2169241,76786] 0 2024-04-18T10:42:51.337 INFO:tasks.workunit.client.0.smithi040.stdout:5/755: rename d0/d3/d47/lcd to d0/d3b/d3f/d72/dd6/lfd 0 2024-04-18T10:42:51.341 INFO:tasks.workunit.client.0.smithi040.stdout:1/806: getdents d1/d1c/d2b/d32/d35 0 2024-04-18T10:42:51.343 INFO:tasks.workunit.client.0.smithi040.stdout:5/756: rename d0/d3b/d3f/l54 to d0/d78/lfe 0 2024-04-18T10:42:51.350 INFO:tasks.workunit.client.0.smithi040.stdout:5/757: dwrite d0/d3/fa4 [4194304,4194304] 0 2024-04-18T10:42:51.359 INFO:tasks.workunit.client.0.smithi040.stdout:2/747: write dd/f6f [503907,30708] 0 2024-04-18T10:42:51.362 INFO:tasks.workunit.client.0.smithi040.stdout:4/767: getdents d2/d3/d4/dd/d6d/d70/db2 0 2024-04-18T10:42:51.363 INFO:tasks.workunit.client.0.smithi040.stdout:3/814: truncate d1/d2/d4e/d58/d62/faf 2898011 0 2024-04-18T10:42:51.363 INFO:tasks.workunit.client.0.smithi040.stdout:2/748: dread dd/d14/d4a/f71 [0,4194304] 0 2024-04-18T10:42:51.364 INFO:tasks.workunit.client.0.smithi040.stdout:3/815: write d1/d2/d3c/f83 [2926004,74664] 0 2024-04-18T10:42:51.367 INFO:tasks.workunit.client.0.smithi040.stdout:6/824: read df/d4b/d99/dc4/d10c/f12f [266310,129594] 0 2024-04-18T10:42:51.371 INFO:tasks.workunit.client.0.smithi040.stdout:0/842: sync 2024-04-18T10:42:51.374 INFO:tasks.workunit.client.0.smithi040.stdout:2/749: rename dd/d14 to dd/d61/d81/dfb 0 2024-04-18T10:42:51.377 INFO:tasks.workunit.client.0.smithi040.stdout:0/843: creat dd/df/d19/d3e/da5/f12a x:0 0 0 2024-04-18T10:42:51.377 INFO:tasks.workunit.client.0.smithi040.stdout:3/816: dread d1/d7/f15 [0,4194304] 0 2024-04-18T10:42:51.378 INFO:tasks.workunit.client.0.smithi040.stdout:1/807: dread d1/d1c/d7b/d2e/d3e/d85/ff9 [0,4194304] 0 2024-04-18T10:42:51.380 INFO:tasks.workunit.client.0.smithi040.stdout:2/750: dread dd/d61/d81/dfb/d4a/f5a [0,4194304] 0 2024-04-18T10:42:51.382 INFO:tasks.workunit.client.0.smithi040.stdout:0/844: getdents dd/df/d19/d3e/d118 0 2024-04-18T10:42:51.382 INFO:tasks.workunit.client.0.smithi040.stdout:3/817: chown d1/d7/d67/dc5/d91/db1/fec 3434 1 2024-04-18T10:42:51.384 INFO:tasks.workunit.client.0.smithi040.stdout:0/845: fdatasync dd/df/d4e/f5c 0 2024-04-18T10:42:51.384 INFO:tasks.workunit.client.0.smithi040.stdout:8/863: truncate d2/d2c/da9/fbb 4103076 0 2024-04-18T10:42:51.386 INFO:tasks.workunit.client.0.smithi040.stdout:9/845: dwrite d2/f5 [4194304,4194304] 0 2024-04-18T10:42:51.387 INFO:tasks.workunit.client.0.smithi040.stdout:3/818: creat d1/d2/d4e/d58/d62/f10a x:0 0 0 2024-04-18T10:42:51.387 INFO:tasks.workunit.client.0.smithi040.stdout:0/846: chown dd/df/d19/d3e/d118 8 1 2024-04-18T10:42:51.388 INFO:tasks.workunit.client.0.smithi040.stdout:2/751: truncate dd/d61/d81/dfb/d2b/dbc/f99 1095071 0 2024-04-18T10:42:51.390 INFO:tasks.workunit.client.0.smithi040.stdout:1/808: rename d1/d1c/d2b/d32/d36/d4d/d67/dcb/fd8 to d1/d1c/d2b/db5/dcc/f11b 0 2024-04-18T10:42:51.393 INFO:tasks.workunit.client.0.smithi040.stdout:0/847: mkdir dd/d62/d12b 0 2024-04-18T10:42:51.393 INFO:tasks.workunit.client.0.smithi040.stdout:9/846: dread d2/d5b/d6f/d80/d75/d124/d22/db3/ff7 [0,4194304] 0 2024-04-18T10:42:51.397 INFO:tasks.workunit.client.0.smithi040.stdout:2/752: truncate dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/f5c 4611607 0 2024-04-18T10:42:51.397 INFO:tasks.workunit.client.0.smithi040.stdout:0/848: mkdir dd/df/d19/dba/d12c 0 2024-04-18T10:42:51.397 INFO:tasks.workunit.client.0.smithi040.stdout:5/758: write d0/d3/f2b [1196728,26435] 0 2024-04-18T10:42:51.399 INFO:tasks.workunit.client.0.smithi040.stdout:0/849: rename dd/df/d19 to dd/df/d19/dd5/d12d 22 2024-04-18T10:42:51.399 INFO:tasks.workunit.client.0.smithi040.stdout:9/847: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d86/f128 x:0 0 0 2024-04-18T10:42:51.405 INFO:tasks.workunit.client.0.smithi040.stdout:0/850: chown dd/df/cb5 2 1 2024-04-18T10:42:51.406 INFO:tasks.workunit.client.0.smithi040.stdout:2/753: symlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d6b/lfc 0 2024-04-18T10:42:51.408 INFO:tasks.workunit.client.0.smithi040.stdout:6/825: dwrite df/d4b/d6e/d3f/d53/fc0 [0,4194304] 0 2024-04-18T10:42:51.417 INFO:tasks.workunit.client.0.smithi040.stdout:7/766: sync 2024-04-18T10:42:51.420 INFO:tasks.workunit.client.0.smithi040.stdout:5/759: symlink d0/d3b/d88/ded/lff 0 2024-04-18T10:42:51.421 INFO:tasks.workunit.client.0.smithi040.stdout:0/851: dread dd/df/f40 [0,4194304] 0 2024-04-18T10:42:51.423 INFO:tasks.workunit.client.0.smithi040.stdout:1/809: truncate d1/d1c/d2b/d32/d36/d4d/d67/faf 4069300 0 2024-04-18T10:42:51.424 INFO:tasks.workunit.client.0.smithi040.stdout:2/754: rename dd/d61/d81/dfb/d2b/d7c/d37/d5b/dda/ff2 to dd/d61/d81/dfb/d2b/d7c/d37/da3/dc1/ffd 0 2024-04-18T10:42:51.425 INFO:tasks.workunit.client.0.smithi040.stdout:0/852: chown dd/df/d19/dd5/l11b 1 1 2024-04-18T10:42:51.427 INFO:tasks.workunit.client.0.smithi040.stdout:1/810: dread d1/d1c/d7b/d2d/f6c [0,4194304] 0 2024-04-18T10:42:51.427 INFO:tasks.workunit.client.0.smithi040.stdout:2/755: chown dd/d61/d81/dfb/d2b/fc3 587487 1 2024-04-18T10:42:51.428 INFO:tasks.workunit.client.0.smithi040.stdout:7/767: truncate d6/d25/dcf/de4/f33 7102148 0 2024-04-18T10:42:51.428 INFO:tasks.workunit.client.0.smithi040.stdout:8/864: dwrite d2/d22/f85 [0,4194304] 0 2024-04-18T10:42:51.432 INFO:tasks.workunit.client.0.smithi040.stdout:5/760: write d0/d78/d95/d52/d5d/f9e [942270,99986] 0 2024-04-18T10:42:51.433 INFO:tasks.workunit.client.0.smithi040.stdout:0/853: dread dd/df/d19/d3e/ffc [0,4194304] 0 2024-04-18T10:42:51.434 INFO:tasks.workunit.client.0.smithi040.stdout:5/761: truncate d0/d3b/d88/f90 504422 0 2024-04-18T10:42:51.435 INFO:tasks.workunit.client.0.smithi040.stdout:5/762: dread - d0/d3b/d3f/de9/fec zero size 2024-04-18T10:42:51.435 INFO:tasks.workunit.client.0.smithi040.stdout:2/756: mknod dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/cfe 0 2024-04-18T10:42:51.436 INFO:tasks.workunit.client.0.smithi040.stdout:5/763: fsync d0/d21/fbe 0 2024-04-18T10:42:51.437 INFO:tasks.workunit.client.0.smithi040.stdout:6/826: truncate df/d4b/db7/df6/ff9 14452 0 2024-04-18T10:42:51.440 INFO:tasks.workunit.client.0.smithi040.stdout:2/757: symlink dd/d61/d81/dfb/lff 0 2024-04-18T10:42:51.442 INFO:tasks.workunit.client.0.smithi040.stdout:8/865: truncate d2/d2c/da9/fbb 2869471 0 2024-04-18T10:42:51.443 INFO:tasks.workunit.client.0.smithi040.stdout:7/768: truncate d6/d25/dcf/de4/d2d/d47/d5c/d6b/fdd 3889237 0 2024-04-18T10:42:51.445 INFO:tasks.workunit.client.0.smithi040.stdout:6/827: rename df/f27 to df/d4b/db7/df6/d12a/f130 0 2024-04-18T10:42:51.447 INFO:tasks.workunit.client.0.smithi040.stdout:2/758: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/d72/f100 x:0 0 0 2024-04-18T10:42:51.447 INFO:tasks.workunit.client.0.smithi040.stdout:6/828: chown df/d76/d91/f9b 2555 1 2024-04-18T10:42:51.449 INFO:tasks.workunit.client.0.smithi040.stdout:8/866: dwrite d2/f11b [0,4194304] 0 2024-04-18T10:42:51.451 INFO:tasks.workunit.client.0.smithi040.stdout:5/764: link d0/d3b/d3f/ca5 d0/d78/dc4/de5/c100 0 2024-04-18T10:42:51.451 INFO:tasks.workunit.client.0.smithi040.stdout:4/768: sync 2024-04-18T10:42:51.451 INFO:tasks.workunit.client.0.smithi040.stdout:3/819: sync 2024-04-18T10:42:51.453 INFO:tasks.workunit.client.0.smithi040.stdout:2/759: mknod dd/d61/d81/dfb/d4a/c101 0 2024-04-18T10:42:51.456 INFO:tasks.workunit.client.0.smithi040.stdout:4/769: stat d2/d3/d4/d1f/d29/d49/f32 0 2024-04-18T10:42:51.457 INFO:tasks.workunit.client.0.smithi040.stdout:3/820: symlink d1/d2/d4e/d58/dbe/dc1/dde/l10b 0 2024-04-18T10:42:51.458 INFO:tasks.workunit.client.0.smithi040.stdout:0/854: dread dd/df/d19/f45 [0,4194304] 0 2024-04-18T10:42:51.459 INFO:tasks.workunit.client.0.smithi040.stdout:5/765: mknod d0/d78/d95/d52/daf/c101 0 2024-04-18T10:42:51.460 INFO:tasks.workunit.client.0.smithi040.stdout:6/829: dwrite df/d4b/d63/faf [0,4194304] 0 2024-04-18T10:42:51.462 INFO:tasks.workunit.client.0.smithi040.stdout:0/855: chown dd/df/d19/l8b 3251613 1 2024-04-18T10:42:51.463 INFO:tasks.workunit.client.0.smithi040.stdout:2/760: truncate dd/d61/d81/dfb/d2b/d7c/d37/d38/d8c/ff3 13528 0 2024-04-18T10:42:51.463 INFO:tasks.workunit.client.0.smithi040.stdout:3/821: creat d1/d2/d4e/d57/f10c x:0 0 0 2024-04-18T10:42:51.464 INFO:tasks.workunit.client.0.smithi040.stdout:8/867: dread d2/d15/d78/fee [0,4194304] 0 2024-04-18T10:42:51.465 INFO:tasks.workunit.client.0.smithi040.stdout:0/856: readlink dd/df/d19/d28/d3a/d5b/l93 0 2024-04-18T10:42:51.467 INFO:tasks.workunit.client.0.smithi040.stdout:2/761: mkdir dd/d61/d81/dfb/d4a/d54/d102 0 2024-04-18T10:42:51.468 INFO:tasks.workunit.client.0.smithi040.stdout:8/868: chown d2/d15/d2b/f7f 11 1 2024-04-18T10:42:51.469 INFO:tasks.workunit.client.0.smithi040.stdout:3/822: creat d1/d2/d4e/d58/d62/f10d x:0 0 0 2024-04-18T10:42:51.471 INFO:tasks.workunit.client.0.smithi040.stdout:6/830: link df/d4b/db7/dc1/fc3 df/d4b/d6a/d93/f131 0 2024-04-18T10:42:51.473 INFO:tasks.workunit.client.0.smithi040.stdout:5/766: dwrite d0/d21/d42/fce [0,4194304] 0 2024-04-18T10:42:51.473 INFO:tasks.workunit.client.0.smithi040.stdout:8/869: write d2/d15/d2b/f57 [1578653,7290] 0 2024-04-18T10:42:51.473 INFO:tasks.workunit.client.0.smithi040.stdout:3/823: write d1/d7/d12/f22 [4381612,126784] 0 2024-04-18T10:42:51.474 INFO:tasks.workunit.client.0.smithi040.stdout:0/857: creat dd/df/d19/d28/f12e x:0 0 0 2024-04-18T10:42:51.477 INFO:tasks.workunit.client.0.smithi040.stdout:9/848: sync 2024-04-18T10:42:51.477 INFO:tasks.workunit.client.0.smithi040.stdout:2/762: truncate dd/d61/d81/dfb/d2b/f2e 8555549 0 2024-04-18T10:42:51.477 INFO:tasks.workunit.client.0.smithi040.stdout:5/767: chown d0/d4e/fe0 125515 1 2024-04-18T10:42:51.478 INFO:tasks.workunit.client.0.smithi040.stdout:6/831: creat df/d4b/d6a/d93/d104/f132 x:0 0 0 2024-04-18T10:42:51.478 INFO:tasks.workunit.client.0.smithi040.stdout:7/769: dread d6/d25/dcf/de4/d2d/d47/f59 [0,4194304] 0 2024-04-18T10:42:51.479 INFO:tasks.workunit.client.0.smithi040.stdout:0/858: write dd/df/d19/f31 [3226898,73898] 0 2024-04-18T10:42:51.481 INFO:tasks.workunit.client.0.smithi040.stdout:9/849: write d2/d5b/d6f/d80/d75/d124/d70/f8f [857978,25823] 0 2024-04-18T10:42:51.482 INFO:tasks.workunit.client.0.smithi040.stdout:3/824: mkdir d1/d2/d4e/d58/dbe/d10e 0 2024-04-18T10:42:51.483 INFO:tasks.workunit.client.0.smithi040.stdout:9/850: chown d2/d5b/d6f/d80/d75/d124/d22/db3/fb7 33279725 1 2024-04-18T10:42:51.516 INFO:tasks.workunit.client.0.smithi040.stdout:8/870: mkdir d2/d15/d78/d10b/d120/d123 0 2024-04-18T10:42:51.517 INFO:tasks.workunit.client.0.smithi040.stdout:5/768: mkdir d0/d3b/d3f/d72/d102 0 2024-04-18T10:42:51.518 INFO:tasks.workunit.client.0.smithi040.stdout:6/832: dwrite df/d4b/d6e/d3f/f5c [0,4194304] 0 2024-04-18T10:42:51.518 INFO:tasks.workunit.client.0.smithi040.stdout:2/763: dread dd/d61/d8e/fcb [0,4194304] 0 2024-04-18T10:42:51.519 INFO:tasks.workunit.client.0.smithi040.stdout:0/859: mkdir dd/d10b/d12f 0 2024-04-18T10:42:51.520 INFO:tasks.workunit.client.0.smithi040.stdout:5/769: chown d0/d3b/d67/f68 1851 1 2024-04-18T10:42:51.521 INFO:tasks.workunit.client.0.smithi040.stdout:4/770: dread d2/d3/d2f/f56 [0,4194304] 0 2024-04-18T10:42:51.524 INFO:tasks.workunit.client.0.smithi040.stdout:9/851: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/f129 x:0 0 0 2024-04-18T10:42:51.524 INFO:tasks.workunit.client.0.smithi040.stdout:3/825: dread d1/d7/d3a/f106 [0,4194304] 0 2024-04-18T10:42:51.531 INFO:tasks.workunit.client.0.smithi040.stdout:8/871: rename d2/d10/d14/f47 to d2/d2c/f124 0 2024-04-18T10:42:51.531 INFO:tasks.workunit.client.0.smithi040.stdout:6/833: truncate df/d4b/d7e/f8c 220264 0 2024-04-18T10:42:51.532 INFO:tasks.workunit.client.0.smithi040.stdout:4/771: creat d2/d3/d41/d47/d99/fdd x:0 0 0 2024-04-18T10:42:51.533 INFO:tasks.workunit.client.0.smithi040.stdout:2/764: write dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d49/f96 [262579,56985] 0 2024-04-18T10:42:51.535 INFO:tasks.workunit.client.0.smithi040.stdout:1/811: sync 2024-04-18T10:42:51.535 INFO:tasks.workunit.client.0.smithi040.stdout:9/852: chown d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40/d85/f104 1473687 1 2024-04-18T10:42:51.535 INFO:tasks.workunit.client.0.smithi040.stdout:6/834: truncate df/d76/db9/ff8 864040 0 2024-04-18T10:42:51.537 INFO:tasks.workunit.client.0.smithi040.stdout:1/812: chown d1/d16/l3d 2809177 1 2024-04-18T10:42:51.538 INFO:tasks.workunit.client.0.smithi040.stdout:2/765: dread - dd/d61/d81/dfb/d2b/d7c/d37/d5b/f75 zero size 2024-04-18T10:42:51.538 INFO:tasks.workunit.client.0.smithi040.stdout:5/770: rename d0/d3/f36 to d0/d78/d95/d52/daf/f103 0 2024-04-18T10:42:51.542 INFO:tasks.workunit.client.0.smithi040.stdout:3/826: dwrite d1/d2/d16/fe2 [0,4194304] 0 2024-04-18T10:42:51.543 INFO:tasks.workunit.client.0.smithi040.stdout:4/772: mkdir d2/d3/d4/dd/dde 0 2024-04-18T10:42:51.547 INFO:tasks.workunit.client.0.smithi040.stdout:0/860: rename dd/df/d4e to dd/df/d19/d28/d3a/d46/d107/d11c/d130 0 2024-04-18T10:42:51.547 INFO:tasks.workunit.client.0.smithi040.stdout:3/827: stat d1/d7/d67/dc5/f65 0 2024-04-18T10:42:51.548 INFO:tasks.workunit.client.0.smithi040.stdout:1/813: symlink d1/d1c/d2b/db5/dd6/l11c 0 2024-04-18T10:42:51.548 INFO:tasks.workunit.client.0.smithi040.stdout:9/853: read d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/ff5 [12685,129893] 0 2024-04-18T10:42:51.549 INFO:tasks.workunit.client.0.smithi040.stdout:4/773: read d2/d3/d41/d47/f82 [195992,110467] 0 2024-04-18T10:42:51.551 INFO:tasks.workunit.client.0.smithi040.stdout:6/835: dwrite df/d4b/d6a/d93/f116 [0,4194304] 0 2024-04-18T10:42:51.551 INFO:tasks.workunit.client.0.smithi040.stdout:5/771: dread d0/d78/d95/d52/d5d/f9e [0,4194304] 0 2024-04-18T10:42:51.553 INFO:tasks.workunit.client.0.smithi040.stdout:5/772: stat d0/d78/d95/f75 0 2024-04-18T10:42:51.554 INFO:tasks.workunit.client.0.smithi040.stdout:9/854: read d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40/d85/ded/d125/fb0 [63683,26778] 0 2024-04-18T10:42:51.556 INFO:tasks.workunit.client.0.smithi040.stdout:0/861: mknod dd/d10b/c131 0 2024-04-18T10:42:51.558 INFO:tasks.workunit.client.0.smithi040.stdout:1/814: creat d1/d9b/dcf/f11d x:0 0 0 2024-04-18T10:42:51.560 INFO:tasks.workunit.client.0.smithi040.stdout:7/770: sync 2024-04-18T10:42:51.561 INFO:tasks.workunit.client.0.smithi040.stdout:4/774: creat d2/d3/d41/d94/fdf x:0 0 0 2024-04-18T10:42:51.563 INFO:tasks.workunit.client.0.smithi040.stdout:6/836: fdatasync df/d4b/d6e/f30 0 2024-04-18T10:42:51.564 INFO:tasks.workunit.client.0.smithi040.stdout:5/773: chown d0/d3/c18 1662527564 1 2024-04-18T10:42:51.567 INFO:tasks.workunit.client.0.smithi040.stdout:9/855: mkdir d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d86/d12a 0 2024-04-18T10:42:51.568 INFO:tasks.workunit.client.0.smithi040.stdout:2/766: rename dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/lf8 to dd/d61/d81/dfb/d2b/dbc/d5f/l103 0 2024-04-18T10:42:51.570 INFO:tasks.workunit.client.0.smithi040.stdout:7/771: fdatasync d6/d25/dcf/de4/d2d/d47/d55/d58/fc9 0 2024-04-18T10:42:51.571 INFO:tasks.workunit.client.0.smithi040.stdout:3/828: dread d1/d7/ffe [0,4194304] 0 2024-04-18T10:42:51.572 INFO:tasks.workunit.client.0.smithi040.stdout:7/772: write d6/d50/d79/da8/dad/fb9 [82930,52507] 0 2024-04-18T10:42:51.574 INFO:tasks.workunit.client.0.smithi040.stdout:7/773: write d6/d3e/d99/fa3 [4971662,47041] 0 2024-04-18T10:42:51.574 INFO:tasks.workunit.client.0.smithi040.stdout:6/837: mkdir df/d76/dc2/dce/d133 0 2024-04-18T10:42:51.575 INFO:tasks.workunit.client.0.smithi040.stdout:5/774: mkdir d0/d3b/d3f/db1/df2/d104 0 2024-04-18T10:42:51.577 INFO:tasks.workunit.client.0.smithi040.stdout:9/856: unlink d2/d5b/d6f/d80/d75/d124/d70/da8/c108 0 2024-04-18T10:42:51.578 INFO:tasks.workunit.client.0.smithi040.stdout:7/774: dread d6/d25/d28/fcd [0,4194304] 0 2024-04-18T10:42:51.581 INFO:tasks.workunit.client.0.smithi040.stdout:3/829: dwrite d1/d2/d4e/d58/dc4/df8/fb0 [0,4194304] 0 2024-04-18T10:42:51.582 INFO:tasks.workunit.client.0.smithi040.stdout:4/775: creat d2/d3/d4/d1f/daa/fe0 x:0 0 0 2024-04-18T10:42:51.584 INFO:tasks.workunit.client.0.smithi040.stdout:7/775: write d6/d25/dcf/de4/f4c [3717748,120211] 0 2024-04-18T10:42:51.584 INFO:tasks.workunit.client.0.smithi040.stdout:8/872: write d2/d5/d9/d1b/f4f [864036,7509] 0 2024-04-18T10:42:51.585 INFO:tasks.workunit.client.0.smithi040.stdout:6/838: dwrite df/d4b/d6a/d93/f3d [0,4194304] 0 2024-04-18T10:42:51.586 INFO:tasks.workunit.client.0.smithi040.stdout:3/830: read - d1/d2/d4e/d58/dbe/dc1/dc2/fe4 zero size 2024-04-18T10:42:51.588 INFO:tasks.workunit.client.0.smithi040.stdout:6/839: write df/d76/d91/f92 [841155,91667] 0 2024-04-18T10:42:51.589 INFO:tasks.workunit.client.0.smithi040.stdout:6/840: stat df/de8/ffd 0 2024-04-18T10:42:51.589 INFO:tasks.workunit.client.0.smithi040.stdout:3/831: read - d1/d7/d28/dd5/fff zero size 2024-04-18T10:42:51.590 INFO:tasks.workunit.client.0.smithi040.stdout:6/841: chown df/d4b/d63/db3/fcd 222795146 1 2024-04-18T10:42:51.591 INFO:tasks.workunit.client.0.smithi040.stdout:2/767: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d6b/f104 x:0 0 0 2024-04-18T10:42:51.593 INFO:tasks.workunit.client.0.smithi040.stdout:9/857: symlink d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/l12b 0 2024-04-18T10:42:51.595 INFO:tasks.workunit.client.0.smithi040.stdout:0/862: getdents dd/df/d19/d3e/d75 0 2024-04-18T10:42:51.598 INFO:tasks.workunit.client.0.smithi040.stdout:7/776: chown d6/d25/dcf/de4/d2d/d47/d55/fe3 142177 1 2024-04-18T10:42:51.600 INFO:tasks.workunit.client.0.smithi040.stdout:8/873: unlink d2/d5/d9/d3c/d5a/d94/fe0 0 2024-04-18T10:42:51.600 INFO:tasks.workunit.client.0.smithi040.stdout:8/874: write d2/d22/d49/d79/fc6 [170176,71940] 0 2024-04-18T10:42:51.601 INFO:tasks.workunit.client.0.smithi040.stdout:3/832: rmdir d1/d7/d67 39 2024-04-18T10:42:51.603 INFO:tasks.workunit.client.0.smithi040.stdout:6/842: creat df/d4b/d99/dc4/d10c/da7/f134 x:0 0 0 2024-04-18T10:42:51.604 INFO:tasks.workunit.client.0.smithi040.stdout:8/875: read d2/d15/d2b/d40/f71 [963786,120906] 0 2024-04-18T10:42:51.604 INFO:tasks.workunit.client.0.smithi040.stdout:4/776: mkdir d2/d3/d4/d21/d28/de1 0 2024-04-18T10:42:51.606 INFO:tasks.workunit.client.0.smithi040.stdout:0/863: mknod dd/daa/d101/c132 0 2024-04-18T10:42:51.607 INFO:tasks.workunit.client.0.smithi040.stdout:5/775: rmdir d0/d3b/d3f/db1/df2/dfa 0 2024-04-18T10:42:51.610 INFO:tasks.workunit.client.0.smithi040.stdout:5/776: chown d0/d4e/l56 10455801 1 2024-04-18T10:42:51.611 INFO:tasks.workunit.client.0.smithi040.stdout:1/815: truncate d1/d16/f1b 1245338 0 2024-04-18T10:42:51.611 INFO:tasks.workunit.client.0.smithi040.stdout:6/843: dwrite df/d4b/d99/dc4/d10c/f119 [0,4194304] 0 2024-04-18T10:42:51.612 INFO:tasks.workunit.client.0.smithi040.stdout:4/777: rmdir d2/d3/d41/d94 39 2024-04-18T10:42:51.613 INFO:tasks.workunit.client.0.smithi040.stdout:5/777: write d0/d3b/d67/f73 [3972863,100132] 0 2024-04-18T10:42:51.614 INFO:tasks.workunit.client.0.smithi040.stdout:6/844: write df/d4b/db7/dc1/fc6 [1810803,74500] 0 2024-04-18T10:42:51.618 INFO:tasks.workunit.client.0.smithi040.stdout:8/876: mknod d2/d15/d2b/c125 0 2024-04-18T10:42:51.619 INFO:tasks.workunit.client.0.smithi040.stdout:0/864: dread dd/df/d19/f66 [0,4194304] 0 2024-04-18T10:42:51.619 INFO:tasks.workunit.client.0.smithi040.stdout:1/816: stat d1/d1c/d2b/fb9 0 2024-04-18T10:42:51.626 INFO:tasks.workunit.client.0.smithi040.stdout:6/845: mknod df/d4b/deb/c135 0 2024-04-18T10:42:51.626 INFO:tasks.workunit.client.0.smithi040.stdout:6/846: write df/d4b/d63/db3/fcd [1278968,4129] 0 2024-04-18T10:42:51.631 INFO:tasks.workunit.client.0.smithi040.stdout:8/877: rename d2/d5/d9/d3c/f50 to d2/d15/d2b/dd0/f126 0 2024-04-18T10:42:51.634 INFO:tasks.workunit.client.0.smithi040.stdout:0/865: creat dd/df/d19/d28/d3a/df9/f133 x:0 0 0 2024-04-18T10:42:51.635 INFO:tasks.workunit.client.0.smithi040.stdout:2/768: sync 2024-04-18T10:42:51.635 INFO:tasks.workunit.client.0.smithi040.stdout:4/778: creat d2/d3/d4/dd/d4f/fe2 x:0 0 0 2024-04-18T10:42:51.636 INFO:tasks.workunit.client.0.smithi040.stdout:7/777: write d6/d50/f54 [5582288,13076] 0 2024-04-18T10:42:51.637 INFO:tasks.workunit.client.0.smithi040.stdout:4/779: dread - d2/d3/d4/d1f/fb5 zero size 2024-04-18T10:42:51.638 INFO:tasks.workunit.client.0.smithi040.stdout:2/769: write dd/d61/d81/dfb/d2b/f2e [309751,88834] 0 2024-04-18T10:42:51.639 INFO:tasks.workunit.client.0.smithi040.stdout:4/780: chown d2/d3/d4/d21/d28/de1 0 1 2024-04-18T10:42:51.642 INFO:tasks.workunit.client.0.smithi040.stdout:8/878: creat d2/d4c/dd2/f127 x:0 0 0 2024-04-18T10:42:51.643 INFO:tasks.workunit.client.0.smithi040.stdout:0/866: fsync dd/df/d19/d28/d3a/d46/d107/d11c/d130/f50 0 2024-04-18T10:42:51.644 INFO:tasks.workunit.client.0.smithi040.stdout:5/778: creat d0/d3b/f105 x:0 0 0 2024-04-18T10:42:51.645 INFO:tasks.workunit.client.0.smithi040.stdout:7/778: dwrite d6/fbd [0,4194304] 0 2024-04-18T10:42:51.646 INFO:tasks.workunit.client.0.smithi040.stdout:8/879: write d2/f41 [2270149,105059] 0 2024-04-18T10:42:51.646 INFO:tasks.workunit.client.0.smithi040.stdout:3/833: link d1/d7/d67/dc5/lf1 d1/d2/d4e/l10f 0 2024-04-18T10:42:51.648 INFO:tasks.workunit.client.0.smithi040.stdout:1/817: dwrite d1/f11 [0,4194304] 0 2024-04-18T10:42:51.648 INFO:tasks.workunit.client.0.smithi040.stdout:2/770: readlink dd/d61/d81/dfb/d2b/l83 0 2024-04-18T10:42:51.649 INFO:tasks.workunit.client.0.smithi040.stdout:4/781: fsync d2/d3/d4/d1f/d29/d49/f73 0 2024-04-18T10:42:51.651 INFO:tasks.workunit.client.0.smithi040.stdout:8/880: read - d2/d5/d9/d3c/f10f zero size 2024-04-18T10:42:51.653 INFO:tasks.workunit.client.0.smithi040.stdout:8/881: stat d2/d2c/da9 0 2024-04-18T10:42:51.653 INFO:tasks.workunit.client.0.smithi040.stdout:3/834: fdatasync d1/d7/f53 0 2024-04-18T10:42:51.656 INFO:tasks.workunit.client.0.smithi040.stdout:6/847: dwrite df/ffb [0,4194304] 0 2024-04-18T10:42:51.657 INFO:tasks.workunit.client.0.smithi040.stdout:6/848: chown df/d4b 21953329 1 2024-04-18T10:42:51.658 INFO:tasks.workunit.client.0.smithi040.stdout:0/867: symlink dd/df/l134 0 2024-04-18T10:42:51.659 INFO:tasks.workunit.client.0.smithi040.stdout:6/849: chown df/d4b/d6e/c41 0 1 2024-04-18T10:42:51.660 INFO:tasks.workunit.client.0.smithi040.stdout:0/868: readlink dd/df/d19/l125 0 2024-04-18T10:42:51.660 INFO:tasks.workunit.client.0.smithi040.stdout:5/779: mkdir d0/d3/d47/d106 0 2024-04-18T10:42:51.660 INFO:tasks.workunit.client.0.smithi040.stdout:4/782: dwrite d2/d3/d4/d1f/fb5 [0,4194304] 0 2024-04-18T10:42:51.662 INFO:tasks.workunit.client.0.smithi040.stdout:5/780: chown d0/d3b/d88/ca3 5922824 1 2024-04-18T10:42:51.662 INFO:tasks.workunit.client.0.smithi040.stdout:7/779: unlink d6/c37 0 2024-04-18T10:42:51.663 INFO:tasks.workunit.client.0.smithi040.stdout:5/781: fsync d0/d78/d95/d52/d5d/ff6 0 2024-04-18T10:42:51.664 INFO:tasks.workunit.client.0.smithi040.stdout:4/783: truncate d2/d3/d4/dd/d4f/fe2 614640 0 2024-04-18T10:42:51.665 INFO:tasks.workunit.client.0.smithi040.stdout:8/882: rmdir d2/d2c/da9 39 2024-04-18T10:42:51.666 INFO:tasks.workunit.client.0.smithi040.stdout:4/784: read - d2/d3/d4/d1f/d29/d49/d31/fd7 zero size 2024-04-18T10:42:51.666 INFO:tasks.workunit.client.0.smithi040.stdout:9/858: getdents d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/de4 0 2024-04-18T10:42:51.667 INFO:tasks.workunit.client.0.smithi040.stdout:3/835: mknod d1/d2/d4e/d58/d62/c110 0 2024-04-18T10:42:51.671 INFO:tasks.workunit.client.0.smithi040.stdout:2/771: creat dd/f105 x:0 0 0 2024-04-18T10:42:51.672 INFO:tasks.workunit.client.0.smithi040.stdout:5/782: symlink d0/d3b/d88/l107 0 2024-04-18T10:42:51.673 INFO:tasks.workunit.client.0.smithi040.stdout:8/883: dwrite d2/d22/fa4 [0,4194304] 0 2024-04-18T10:42:51.674 INFO:tasks.workunit.client.0.smithi040.stdout:5/783: fsync d0/d3b/d67/dc7/fd4 0 2024-04-18T10:42:51.674 INFO:tasks.workunit.client.0.smithi040.stdout:7/780: rename d6/d25/dcf/de4/d2d/dbc to d6/d25/dcf/de4/d2d/d47/d5c/d6b/ded 0 2024-04-18T10:42:51.678 INFO:tasks.workunit.client.0.smithi040.stdout:3/836: creat d1/d7/d28/db7/dfa/f111 x:0 0 0 2024-04-18T10:42:51.680 INFO:tasks.workunit.client.0.smithi040.stdout:5/784: creat d0/d78/d95/d52/d5d/f108 x:0 0 0 2024-04-18T10:42:51.682 INFO:tasks.workunit.client.0.smithi040.stdout:5/785: readlink d0/d3/l8 0 2024-04-18T10:42:51.686 INFO:tasks.workunit.client.0.smithi040.stdout:7/781: rename d6/d25/dcf/de4/d2d/d47/f65 to d6/fee 0 2024-04-18T10:42:51.686 INFO:tasks.workunit.client.0.smithi040.stdout:2/772: dwrite dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d6b/f7e [0,4194304] 0 2024-04-18T10:42:51.686 INFO:tasks.workunit.client.0.smithi040.stdout:4/785: dwrite d2/d3/d4/d1f/d29/d49/d31/f61 [4194304,4194304] 0 2024-04-18T10:42:51.691 INFO:tasks.workunit.client.0.smithi040.stdout:7/782: write d6/f44 [1698120,6489] 0 2024-04-18T10:42:51.691 INFO:tasks.workunit.client.0.smithi040.stdout:3/837: rename d1/d2/c80 to d1/d7/dd9/c112 0 2024-04-18T10:42:51.691 INFO:tasks.workunit.client.0.smithi040.stdout:7/783: fdatasync d6/d3e/d99/fa3 0 2024-04-18T10:42:51.694 INFO:tasks.workunit.client.0.smithi040.stdout:7/784: symlink d6/d3e/lef 0 2024-04-18T10:42:51.696 INFO:tasks.workunit.client.0.smithi040.stdout:7/785: chown d6/l7b 4124351 1 2024-04-18T10:42:51.697 INFO:tasks.workunit.client.0.smithi040.stdout:5/786: dwrite d0/d3/dba/de7/ff7 [0,4194304] 0 2024-04-18T10:42:51.698 INFO:tasks.workunit.client.0.smithi040.stdout:4/786: creat d2/d3/d4/dd/d6d/fe3 x:0 0 0 2024-04-18T10:42:51.701 INFO:tasks.workunit.client.0.smithi040.stdout:2/773: dwrite dd/d61/f70 [0,4194304] 0 2024-04-18T10:42:51.702 INFO:tasks.workunit.client.0.smithi040.stdout:7/786: creat d6/d25/d28/dac/de9/ff0 x:0 0 0 2024-04-18T10:42:51.702 INFO:tasks.workunit.client.0.smithi040.stdout:5/787: rmdir d0/d21/d42 39 2024-04-18T10:42:51.703 INFO:tasks.workunit.client.0.smithi040.stdout:2/774: fdatasync dd/d61/d81/dfb/d2b/dbc/f85 0 2024-04-18T10:42:51.704 INFO:tasks.workunit.client.0.smithi040.stdout:5/788: readlink d0/l5c 0 2024-04-18T10:42:51.706 INFO:tasks.workunit.client.0.smithi040.stdout:5/789: chown d0/d3b/d67/l93 784 1 2024-04-18T10:42:51.706 INFO:tasks.workunit.client.0.smithi040.stdout:6/850: dread df/d4b/d6a/d93/f1b [0,4194304] 0 2024-04-18T10:42:51.706 INFO:tasks.workunit.client.0.smithi040.stdout:2/775: rmdir dd/d61/d81/dfb/d2b/d7c/d37/d38 39 2024-04-18T10:42:51.706 INFO:tasks.workunit.client.0.smithi040.stdout:5/790: dread - d0/d3b/f105 zero size 2024-04-18T10:42:51.708 INFO:tasks.workunit.client.0.smithi040.stdout:6/851: mkdir df/d4b/d99/dc4/d136 0 2024-04-18T10:42:51.711 INFO:tasks.workunit.client.0.smithi040.stdout:2/776: read dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/f97 [123463,46547] 0 2024-04-18T10:42:51.712 INFO:tasks.workunit.client.0.smithi040.stdout:7/787: link d6/d25/dcf/de4/d2d/d47/d5c/d6b/ded/lbf d6/d50/d79/da8/dad/lf1 0 2024-04-18T10:42:51.713 INFO:tasks.workunit.client.0.smithi040.stdout:7/788: read - d6/d25/dcf/de4/d2d/d47/d55/d58/d6c/d8a/fe5 zero size 2024-04-18T10:42:51.716 INFO:tasks.workunit.client.0.smithi040.stdout:6/852: symlink df/d4b/d6e/d3f/l137 0 2024-04-18T10:42:51.719 INFO:tasks.workunit.client.0.smithi040.stdout:8/884: sync 2024-04-18T10:42:51.721 INFO:tasks.workunit.client.0.smithi040.stdout:6/853: dwrite df/d76/db9/dbd/fbf [0,4194304] 0 2024-04-18T10:42:51.722 INFO:tasks.workunit.client.0.smithi040.stdout:8/885: rename d2/d2c/dbf/dc2/lc7 to d2/d15/d2b/d40/l128 0 2024-04-18T10:42:51.724 INFO:tasks.workunit.client.0.smithi040.stdout:8/886: write d2/d4c/dd2/f107 [316648,72840] 0 2024-04-18T10:42:51.726 INFO:tasks.workunit.client.0.smithi040.stdout:2/777: rename dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/dce/ff4 to dd/d61/d81/dfb/d2b/d7c/d37/d38/d8c/f106 0 2024-04-18T10:42:51.729 INFO:tasks.workunit.client.0.smithi040.stdout:6/854: rename df/d76/dc2/fc8 to df/d76/db9/dbd/f138 0 2024-04-18T10:42:51.731 INFO:tasks.workunit.client.0.smithi040.stdout:8/887: mknod d2/d2c/da9/c129 0 2024-04-18T10:42:51.732 INFO:tasks.workunit.client.0.smithi040.stdout:2/778: read dd/d61/d81/dfb/f22 [2478478,50672] 0 2024-04-18T10:42:51.733 INFO:tasks.workunit.client.0.smithi040.stdout:2/779: stat dd/d61/d81/dfb/d2b/d7c/d37/d38/fc8 0 2024-04-18T10:42:51.735 INFO:tasks.workunit.client.0.smithi040.stdout:6/855: rename df/d4b/d6a/fb1 to df/d4b/deb/f139 0 2024-04-18T10:42:51.737 INFO:tasks.workunit.client.0.smithi040.stdout:6/856: read - df/d4b/d99/f9e zero size 2024-04-18T10:42:51.738 INFO:tasks.workunit.client.0.smithi040.stdout:6/857: symlink df/d76/db9/l13a 0 2024-04-18T10:42:51.740 INFO:tasks.workunit.client.0.smithi040.stdout:6/858: mknod df/d4b/d99/dc4/c13b 0 2024-04-18T10:42:51.741 INFO:tasks.workunit.client.0.smithi040.stdout:8/888: dread d2/d5/f8b [0,4194304] 0 2024-04-18T10:42:51.742 INFO:tasks.workunit.client.0.smithi040.stdout:6/859: mkdir df/d123/d13c 0 2024-04-18T10:42:51.743 INFO:tasks.workunit.client.0.smithi040.stdout:8/889: mkdir d2/d2c/dbf/dc2/d12a 0 2024-04-18T10:42:51.744 INFO:tasks.workunit.client.0.smithi040.stdout:8/890: readlink d2/d15/d78/d10b/l11e 0 2024-04-18T10:42:51.747 INFO:tasks.workunit.client.0.smithi040.stdout:6/860: rename df/de8/l106 to df/d4b/db7/dcc/dd6/l13d 0 2024-04-18T10:42:51.748 INFO:tasks.workunit.client.0.smithi040.stdout:2/780: dread dd/d61/d81/dfb/d2b/d7c/d37/d38/f57 [0,4194304] 0 2024-04-18T10:42:51.752 INFO:tasks.workunit.client.0.smithi040.stdout:2/781: mkdir dd/d61/d8e/d107 0 2024-04-18T10:42:51.753 INFO:tasks.workunit.client.0.smithi040.stdout:4/787: dread d2/d3/d41/d47/d99/fbb [0,4194304] 0 2024-04-18T10:42:51.755 INFO:tasks.workunit.client.0.smithi040.stdout:4/788: chown d2/d3/d4/d21/d28/c57 69 1 2024-04-18T10:42:51.759 INFO:tasks.workunit.client.0.smithi040.stdout:4/789: truncate d2/d3/d41/d47/f82 1360751 0 2024-04-18T10:42:51.760 INFO:tasks.workunit.client.0.smithi040.stdout:1/818: dread d1/d1c/d2b/d32/d36/f59 [0,4194304] 0 2024-04-18T10:42:51.761 INFO:tasks.workunit.client.0.smithi040.stdout:1/819: chown d1/db1/fec 1282951555 1 2024-04-18T10:42:51.761 INFO:tasks.workunit.client.0.smithi040.stdout:2/782: rename dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/cfe to dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/c108 0 2024-04-18T10:42:51.765 INFO:tasks.workunit.client.0.smithi040.stdout:2/783: fdatasync dd/d61/d81/dfb/d2b/fc3 0 2024-04-18T10:42:51.765 INFO:tasks.workunit.client.0.smithi040.stdout:0/869: write dd/df/d19/d28/d3a/df9/f104 [1502512,94730] 0 2024-04-18T10:42:51.766 INFO:tasks.workunit.client.0.smithi040.stdout:1/820: rename d1/d1c/d7b/d2e/d9e/lb0 to d1/d1c/d7b/d119/l11e 0 2024-04-18T10:42:51.767 INFO:tasks.workunit.client.0.smithi040.stdout:4/790: link d2/d3/d4/d21/d28/d3f/f39 d2/d3/d4/d1f/fe4 0 2024-04-18T10:42:51.769 INFO:tasks.workunit.client.0.smithi040.stdout:4/791: write d2/d3/d4/d1f/d29/d49/d31/fa8 [487459,50363] 0 2024-04-18T10:42:51.770 INFO:tasks.workunit.client.0.smithi040.stdout:0/870: rmdir dd/df/d19/d28/db7 39 2024-04-18T10:42:51.771 INFO:tasks.workunit.client.0.smithi040.stdout:9/859: write d2/d5b/d6f/d80/d75/d124/d22/d2e/f3d [694099,2146] 0 2024-04-18T10:42:51.777 INFO:tasks.workunit.client.0.smithi040.stdout:8/891: dread d2/d15/f82 [0,4194304] 0 2024-04-18T10:42:51.778 INFO:tasks.workunit.client.0.smithi040.stdout:4/792: dwrite d2/d3/d4/f9d [0,4194304] 0 2024-04-18T10:42:51.780 INFO:tasks.workunit.client.0.smithi040.stdout:2/784: symlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/l109 0 2024-04-18T10:42:51.781 INFO:tasks.workunit.client.0.smithi040.stdout:0/871: dwrite dd/df/d19/d28/f53 [0,4194304] 0 2024-04-18T10:42:51.788 INFO:tasks.workunit.client.0.smithi040.stdout:3/838: truncate d1/d7/d67/dc5/d91/f98 2658910 0 2024-04-18T10:42:51.788 INFO:tasks.workunit.client.0.smithi040.stdout:3/839: truncate d1/f8b 5079808 0 2024-04-18T10:42:51.794 INFO:tasks.workunit.client.0.smithi040.stdout:7/789: rmdir d6/d50 39 2024-04-18T10:42:51.795 INFO:tasks.workunit.client.0.smithi040.stdout:7/790: chown d6/d25/dcf/de4/d2d/l35 6937 1 2024-04-18T10:42:51.797 INFO:tasks.workunit.client.0.smithi040.stdout:9/860: link d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40/d71/fff d2/dd6/f12c 0 2024-04-18T10:42:51.797 INFO:tasks.workunit.client.0.smithi040.stdout:5/791: truncate d0/d3/dba/de7/ff7 110622 0 2024-04-18T10:42:51.800 INFO:tasks.workunit.client.0.smithi040.stdout:3/840: mknod d1/d2/d4e/d58/dc4/c113 0 2024-04-18T10:42:51.801 INFO:tasks.workunit.client.0.smithi040.stdout:3/841: write d1/d7/d67/fd7 [976650,32694] 0 2024-04-18T10:42:51.801 INFO:tasks.workunit.client.0.smithi040.stdout:0/872: creat dd/df/df8/f135 x:0 0 0 2024-04-18T10:42:51.803 INFO:tasks.workunit.client.0.smithi040.stdout:0/873: fdatasync dd/df/d19/d28/d3a/d5b/dd0/f110 0 2024-04-18T10:42:51.803 INFO:tasks.workunit.client.0.smithi040.stdout:0/874: stat dd/df/d19/d28/d3a/d42/f72 0 2024-04-18T10:42:51.804 INFO:tasks.workunit.client.0.smithi040.stdout:2/785: creat dd/d61/d81/dfb/d2b/d7c/d37/da3/f10a x:0 0 0 2024-04-18T10:42:51.804 INFO:tasks.workunit.client.0.smithi040.stdout:0/875: chown dd/df/f44 674 1 2024-04-18T10:42:51.806 INFO:tasks.workunit.client.0.smithi040.stdout:0/876: chown dd/df/d19/d28/d3a/d46/d107/d11c/d130/f5c 171865457 1 2024-04-18T10:42:51.806 INFO:tasks.workunit.client.0.smithi040.stdout:7/791: truncate d6/d25/dcf/de4/d2d/d47/d55/d58/fc9 641454 0 2024-04-18T10:42:51.808 INFO:tasks.workunit.client.0.smithi040.stdout:7/792: chown d6/d25/dcf/de4/d2d/d47/f52 61 1 2024-04-18T10:42:51.809 INFO:tasks.workunit.client.0.smithi040.stdout:4/793: creat d2/d3/d4/d21/fe5 x:0 0 0 2024-04-18T10:42:51.811 INFO:tasks.workunit.client.0.smithi040.stdout:5/792: write d0/d21/d42/f8f [2338143,110120] 0 2024-04-18T10:42:51.812 INFO:tasks.workunit.client.0.smithi040.stdout:9/861: dread d2/dd/f24 [0,4194304] 0 2024-04-18T10:42:51.814 INFO:tasks.workunit.client.0.smithi040.stdout:2/786: creat dd/d61/d81/dfb/d2b/d7c/d37/d38/f10b x:0 0 0 2024-04-18T10:42:51.815 INFO:tasks.workunit.client.0.smithi040.stdout:8/892: getdents d2/d22/d80/da2 0 2024-04-18T10:42:51.815 INFO:tasks.workunit.client.0.smithi040.stdout:0/877: readlink dd/df/d19/d28/l32 0 2024-04-18T10:42:51.816 INFO:tasks.workunit.client.0.smithi040.stdout:5/793: dread d0/d3/d6b/fbb [0,4194304] 0 2024-04-18T10:42:51.816 INFO:tasks.workunit.client.0.smithi040.stdout:2/787: fdatasync dd/d61/d81/dfb/d2b/d7c/d37/d38/f10b 0 2024-04-18T10:42:51.817 INFO:tasks.workunit.client.0.smithi040.stdout:8/893: fsync d2/d5/d9/d3c/d5a/fb2 0 2024-04-18T10:42:51.817 INFO:tasks.workunit.client.0.smithi040.stdout:0/878: write dd/df/f1e [854184,41383] 0 2024-04-18T10:42:51.818 INFO:tasks.workunit.client.0.smithi040.stdout:4/794: symlink d2/d3/d41/d47/d6f/le6 0 2024-04-18T10:42:51.820 INFO:tasks.workunit.client.0.smithi040.stdout:9/862: mknod d2/d5b/d6f/d80/d75/d124/d70/c12d 0 2024-04-18T10:42:51.821 INFO:tasks.workunit.client.0.smithi040.stdout:7/793: getdents d6/d25/dcf/de4/d2d/d47/d5c/da2/de6 0 2024-04-18T10:42:51.822 INFO:tasks.workunit.client.0.smithi040.stdout:5/794: rmdir d0/d78/d95/db7 39 2024-04-18T10:42:51.825 INFO:tasks.workunit.client.0.smithi040.stdout:5/795: write d0/d3b/d3f/f40 [4175174,123390] 0 2024-04-18T10:42:51.825 INFO:tasks.workunit.client.0.smithi040.stdout:4/795: rmdir d2/d3/d4/dd/d6d/d70/db2 39 2024-04-18T10:42:51.825 INFO:tasks.workunit.client.0.smithi040.stdout:6/861: dwrite df/d4b/db7/dcc/de5/fe7 [0,4194304] 0 2024-04-18T10:42:51.827 INFO:tasks.workunit.client.0.smithi040.stdout:6/862: chown df/d4b/d6e/f33 1044572 1 2024-04-18T10:42:51.827 INFO:tasks.workunit.client.0.smithi040.stdout:4/796: write d2/d3/d4/dd/d4f/f5f [8140523,67383] 0 2024-04-18T10:42:51.829 INFO:tasks.workunit.client.0.smithi040.stdout:8/894: mknod d2/d106/c12b 0 2024-04-18T10:42:51.829 INFO:tasks.workunit.client.0.smithi040.stdout:4/797: write d2/d3/d4/dd/d4f/fc5 [808990,45308] 0 2024-04-18T10:42:51.830 INFO:tasks.workunit.client.0.smithi040.stdout:4/798: stat d2/d3/d2f/f7e 0 2024-04-18T10:42:51.830 INFO:tasks.workunit.client.0.smithi040.stdout:9/863: mknod d2/dd/dbf/c12e 0 2024-04-18T10:42:51.835 INFO:tasks.workunit.client.0.smithi040.stdout:1/821: rmdir d1/d1c/d7b/d2e 39 2024-04-18T10:42:51.836 INFO:tasks.workunit.client.0.smithi040.stdout:3/842: link d1/d2/d4e/d58/f5d d1/d7/d67/dc5/f114 0 2024-04-18T10:42:51.836 INFO:tasks.workunit.client.0.smithi040.stdout:7/794: mknod d6/d25/d28/dac/d64/d7e/cf2 0 2024-04-18T10:42:51.837 INFO:tasks.workunit.client.0.smithi040.stdout:7/795: chown d6/d3e/lcb 10571860 1 2024-04-18T10:42:51.838 INFO:tasks.workunit.client.0.smithi040.stdout:2/788: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/dc5/f10c x:0 0 0 2024-04-18T10:42:51.841 INFO:tasks.workunit.client.0.smithi040.stdout:5/796: unlink d0/d3b/d88/fe3 0 2024-04-18T10:42:51.844 INFO:tasks.workunit.client.0.smithi040.stdout:8/895: creat d2/d10/d14/f12c x:0 0 0 2024-04-18T10:42:51.845 INFO:tasks.workunit.client.0.smithi040.stdout:3/843: dread d1/d2/d4e/d58/db4/f101 [0,4194304] 0 2024-04-18T10:42:51.848 INFO:tasks.workunit.client.0.smithi040.stdout:2/789: mkdir dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d6b/d10d 0 2024-04-18T10:42:51.849 INFO:tasks.workunit.client.0.smithi040.stdout:0/879: link dd/l114 dd/df/d19/d28/d3a/d5b/dd0/df7/l136 0 2024-04-18T10:42:51.849 INFO:tasks.workunit.client.0.smithi040.stdout:2/790: read - dd/d61/d81/dfb/d2b/d7c/ff9 zero size 2024-04-18T10:42:51.850 INFO:tasks.workunit.client.0.smithi040.stdout:5/797: symlink d0/d3/dba/l109 0 2024-04-18T10:42:51.850 INFO:tasks.workunit.client.0.smithi040.stdout:2/791: read - dd/d61/d8e/d98/dcc/dd4/ff5 zero size 2024-04-18T10:42:51.851 INFO:tasks.workunit.client.0.smithi040.stdout:6/863: symlink df/d4b/db7/dcc/l13e 0 2024-04-18T10:42:51.856 INFO:tasks.workunit.client.0.smithi040.stdout:5/798: dwrite d0/d4e/fe0 [0,4194304] 0 2024-04-18T10:42:51.856 INFO:tasks.workunit.client.0.smithi040.stdout:6/864: read df/d4b/d6a/d93/f29 [2606458,110528] 0 2024-04-18T10:42:51.858 INFO:tasks.workunit.client.0.smithi040.stdout:6/865: write df/d4b/d6a/d93/f31 [337910,90494] 0 2024-04-18T10:42:51.859 INFO:tasks.workunit.client.0.smithi040.stdout:3/844: symlink d1/d2/d4e/d58/dbe/dc1/dde/l115 0 2024-04-18T10:42:51.861 INFO:tasks.workunit.client.0.smithi040.stdout:6/866: write df/d4b/d99/dc4/d10c/ffc [417676,36309] 0 2024-04-18T10:42:51.861 INFO:tasks.workunit.client.0.smithi040.stdout:1/822: symlink d1/d1c/d7b/d2e/d3e/l11f 0 2024-04-18T10:42:51.861 INFO:tasks.workunit.client.0.smithi040.stdout:3/845: read d1/d7/d3a/f3d [2115433,100850] 0 2024-04-18T10:42:51.862 INFO:tasks.workunit.client.0.smithi040.stdout:6/867: dread - df/d4b/d6a/d93/f12d zero size 2024-04-18T10:42:51.863 INFO:tasks.workunit.client.0.smithi040.stdout:1/823: truncate d1/d16/f41 4354258 0 2024-04-18T10:42:51.864 INFO:tasks.workunit.client.0.smithi040.stdout:6/868: write df/d76/db9/f129 [1474,35374] 0 2024-04-18T10:42:51.864 INFO:tasks.workunit.client.0.smithi040.stdout:2/792: chown dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/f5c 3187 1 2024-04-18T10:42:51.865 INFO:tasks.workunit.client.0.smithi040.stdout:6/869: write df/f20 [1453936,72333] 0 2024-04-18T10:42:51.868 INFO:tasks.workunit.client.0.smithi040.stdout:5/799: fdatasync d0/d78/d95/d52/d5d/f69 0 2024-04-18T10:42:51.871 INFO:tasks.workunit.client.0.smithi040.stdout:6/870: dwrite df/d76/db9/dbd/fbf [0,4194304] 0 2024-04-18T10:42:51.873 INFO:tasks.workunit.client.0.smithi040.stdout:7/796: creat d6/d25/dcf/de4/ff3 x:0 0 0 2024-04-18T10:42:51.874 INFO:tasks.workunit.client.0.smithi040.stdout:0/880: creat dd/daa/dd8/d10f/f137 x:0 0 0 2024-04-18T10:42:51.874 INFO:tasks.workunit.client.0.smithi040.stdout:0/881: chown dd/d10b/d12f 155598770 1 2024-04-18T10:42:51.875 INFO:tasks.workunit.client.0.smithi040.stdout:3/846: symlink d1/d2/d4e/d58/d62/l116 0 2024-04-18T10:42:51.876 INFO:tasks.workunit.client.0.smithi040.stdout:1/824: symlink d1/d9b/d75/d84/dac/l120 0 2024-04-18T10:42:51.880 INFO:tasks.workunit.client.0.smithi040.stdout:2/793: mkdir dd/d61/d81/dfb/d2b/d7c/d37/d38/d8c/d10e 0 2024-04-18T10:42:51.881 INFO:tasks.workunit.client.0.smithi040.stdout:2/794: chown dd/d61/d81/dfb/d4a/fc9 216605 1 2024-04-18T10:42:51.882 INFO:tasks.workunit.client.0.smithi040.stdout:2/795: chown dd/d61/d81/dfb/fa9 21 1 2024-04-18T10:42:51.884 INFO:tasks.workunit.client.0.smithi040.stdout:5/800: creat d0/d3b/d88/f10a x:0 0 0 2024-04-18T10:42:51.887 INFO:tasks.workunit.client.0.smithi040.stdout:7/797: mknod d6/d25/d28/dac/cf4 0 2024-04-18T10:42:51.888 INFO:tasks.workunit.client.0.smithi040.stdout:6/871: dread df/fab [0,4194304] 0 2024-04-18T10:42:51.889 INFO:tasks.workunit.client.0.smithi040.stdout:0/882: mkdir dd/d91/d138 0 2024-04-18T10:42:51.890 INFO:tasks.workunit.client.0.smithi040.stdout:3/847: mkdir d1/d2/d4e/d58/d62/d117 0 2024-04-18T10:42:51.894 INFO:tasks.workunit.client.0.smithi040.stdout:5/801: dread - d0/d78/f82 zero size 2024-04-18T10:42:51.897 INFO:tasks.workunit.client.0.smithi040.stdout:7/798: creat d6/d25/dcf/de4/d2d/d47/d5c/ff5 x:0 0 0 2024-04-18T10:42:51.897 INFO:tasks.workunit.client.0.smithi040.stdout:5/802: stat d0/d3b/d3f/l8d 0 2024-04-18T10:42:51.898 INFO:tasks.workunit.client.0.smithi040.stdout:0/883: mkdir dd/d10b/d139 0 2024-04-18T10:42:51.901 INFO:tasks.workunit.client.0.smithi040.stdout:2/796: unlink dd/d61/d81/dfb/d2b/d7c/d37/cb9 0 2024-04-18T10:42:51.901 INFO:tasks.workunit.client.0.smithi040.stdout:5/803: dread - d0/d78/fd2 zero size 2024-04-18T10:42:51.901 INFO:tasks.workunit.client.0.smithi040.stdout:1/825: dread d1/d1c/d2b/d32/d36/d4d/d67/f8e [0,4194304] 0 2024-04-18T10:42:51.902 INFO:tasks.workunit.client.0.smithi040.stdout:4/799: dwrite d2/d3/d41/d62/d7c/f95 [0,4194304] 0 2024-04-18T10:42:51.902 INFO:tasks.workunit.client.0.smithi040.stdout:3/848: dwrite d1/d2/d4e/fd0 [0,4194304] 0 2024-04-18T10:42:51.908 INFO:tasks.workunit.client.0.smithi040.stdout:0/884: write dd/df/d19/f8c [2587969,101527] 0 2024-04-18T10:42:51.910 INFO:tasks.workunit.client.0.smithi040.stdout:5/804: read d0/d21/d42/fce [835967,89786] 0 2024-04-18T10:42:51.911 INFO:tasks.workunit.client.0.smithi040.stdout:9/864: dwrite d2/d5b/d6f/d80/d75/d124/f21 [0,4194304] 0 2024-04-18T10:42:51.913 INFO:tasks.workunit.client.0.smithi040.stdout:8/896: dwrite d2/d22/d49/f9a [0,4194304] 0 2024-04-18T10:42:51.913 INFO:tasks.workunit.client.0.smithi040.stdout:0/885: write dd/f126 [3998274,58014] 0 2024-04-18T10:42:51.914 INFO:tasks.workunit.client.0.smithi040.stdout:1/826: mknod d1/d1c/d2b/db5/c121 0 2024-04-18T10:42:51.914 INFO:tasks.workunit.client.0.smithi040.stdout:5/805: truncate d0/f39 8569515 0 2024-04-18T10:42:51.916 INFO:tasks.workunit.client.0.smithi040.stdout:4/800: fsync d2/d3/d41/d62/d7c/f84 0 2024-04-18T10:42:51.920 INFO:tasks.workunit.client.0.smithi040.stdout:5/806: chown d0/d3b/d67/fda 1954 1 2024-04-18T10:42:51.921 INFO:tasks.workunit.client.0.smithi040.stdout:7/799: getdents d6/d25/d28 0 2024-04-18T10:42:51.921 INFO:tasks.workunit.client.0.smithi040.stdout:1/827: dread d1/db1/fef [4194304,4194304] 0 2024-04-18T10:42:51.922 INFO:tasks.workunit.client.0.smithi040.stdout:3/849: dwrite d1/d2/d4e/d58/dbe/dca/f108 [0,4194304] 0 2024-04-18T10:42:51.924 INFO:tasks.workunit.client.0.smithi040.stdout:1/828: write d1/d9b/f9c [635472,64470] 0 2024-04-18T10:42:51.926 INFO:tasks.workunit.client.0.smithi040.stdout:3/850: chown d1/d7/d67/dc5/d3b/c71 53111 1 2024-04-18T10:42:51.927 INFO:tasks.workunit.client.0.smithi040.stdout:9/865: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40/d85/f12f x:0 0 0 2024-04-18T10:42:51.927 INFO:tasks.workunit.client.0.smithi040.stdout:0/886: dwrite dd/fd6 [0,4194304] 0 2024-04-18T10:42:51.929 INFO:tasks.workunit.client.0.smithi040.stdout:6/872: truncate df/ffb 1359389 0 2024-04-18T10:42:51.930 INFO:tasks.workunit.client.0.smithi040.stdout:4/801: creat d2/d3/d4/dd/d4f/fe7 x:0 0 0 2024-04-18T10:42:51.932 INFO:tasks.workunit.client.0.smithi040.stdout:5/807: rmdir d0/d3/d6b/d7b/ddc 39 2024-04-18T10:42:51.932 INFO:tasks.workunit.client.0.smithi040.stdout:6/873: write df/d76/db9/dbd/fbf [3284835,50111] 0 2024-04-18T10:42:51.934 INFO:tasks.workunit.client.0.smithi040.stdout:2/797: link dd/d61/d81/dfb/d2b/dbc/d5f/fe1 dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/dc5/f10f 0 2024-04-18T10:42:51.936 INFO:tasks.workunit.client.0.smithi040.stdout:1/829: chown d1/d1c/d7b/d119/l11e 30 1 2024-04-18T10:42:51.936 INFO:tasks.workunit.client.0.smithi040.stdout:0/887: creat dd/df/d19/d28/d3a/d46/d107/d11c/d130/f13a x:0 0 0 2024-04-18T10:42:51.937 INFO:tasks.workunit.client.0.smithi040.stdout:9/866: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/de4/f130 x:0 0 0 2024-04-18T10:42:51.938 INFO:tasks.workunit.client.0.smithi040.stdout:2/798: readlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d49/l58 0 2024-04-18T10:42:51.939 INFO:tasks.workunit.client.0.smithi040.stdout:4/802: dwrite d2/d3/d4/d21/f58 [0,4194304] 0 2024-04-18T10:42:51.941 INFO:tasks.workunit.client.0.smithi040.stdout:1/830: creat d1/d1c/d2b/d32/d36/d4d/d67/dcb/f122 x:0 0 0 2024-04-18T10:42:51.944 INFO:tasks.workunit.client.0.smithi040.stdout:3/851: link d1/d7/d28/c7d d1/d2/c118 0 2024-04-18T10:42:51.944 INFO:tasks.workunit.client.0.smithi040.stdout:2/799: truncate dd/d61/d81/dfb/d2b/d7c/ff9 319909 0 2024-04-18T10:42:51.946 INFO:tasks.workunit.client.0.smithi040.stdout:2/800: write dd/d61/d81/dfb/d2b/dbc/d5f/fb2 [810651,85408] 0 2024-04-18T10:42:51.947 INFO:tasks.workunit.client.0.smithi040.stdout:1/831: creat d1/d1c/d2b/db5/dcc/f123 x:0 0 0 2024-04-18T10:42:51.949 INFO:tasks.workunit.client.0.smithi040.stdout:9/867: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40/d85/ded/d125/d8d/d10c/f131 x:0 0 0 2024-04-18T10:42:51.950 INFO:tasks.workunit.client.0.smithi040.stdout:3/852: creat d1/d7/db2/dc0/f119 x:0 0 0 2024-04-18T10:42:51.951 INFO:tasks.workunit.client.0.smithi040.stdout:7/800: link d6/d25/c26 d6/d25/dcf/de4/d2d/d47/d5c/cf6 0 2024-04-18T10:42:51.951 INFO:tasks.workunit.client.0.smithi040.stdout:9/868: readlink d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc2/lf6 0 2024-04-18T10:42:51.952 INFO:tasks.workunit.client.0.smithi040.stdout:9/869: fsync d2/d7/f8 0 2024-04-18T10:42:51.952 INFO:tasks.workunit.client.0.smithi040.stdout:4/803: creat d2/d3/d4/d21/d28/fe8 x:0 0 0 2024-04-18T10:42:51.953 INFO:tasks.workunit.client.0.smithi040.stdout:2/801: mkdir dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/dce/d110 0 2024-04-18T10:42:51.955 INFO:tasks.workunit.client.0.smithi040.stdout:0/888: dread dd/df/d19/d28/d3a/d46/d107/d11c/d130/f50 [0,4194304] 0 2024-04-18T10:42:51.957 INFO:tasks.workunit.client.0.smithi040.stdout:2/802: write dd/d61/d81/dfb/fa9 [1530370,125557] 0 2024-04-18T10:42:51.958 INFO:tasks.workunit.client.0.smithi040.stdout:1/832: rename d1/f18 to d1/d1c/d2b/d32/d36/d4d/d67/f124 0 2024-04-18T10:42:51.960 INFO:tasks.workunit.client.0.smithi040.stdout:0/889: creat dd/df/d19/d28/d3a/d46/d107/d11c/f13b x:0 0 0 2024-04-18T10:42:51.962 INFO:tasks.workunit.client.0.smithi040.stdout:1/833: fsync d1/d1c/d7b/d2e/d39/f46 0 2024-04-18T10:42:51.963 INFO:tasks.workunit.client.0.smithi040.stdout:9/870: dwrite d2/dd/de/d7f/f9d [0,4194304] 0 2024-04-18T10:42:51.964 INFO:tasks.workunit.client.0.smithi040.stdout:0/890: rename dd/d10b/c131 to dd/da3/d122/c13c 0 2024-04-18T10:42:51.965 INFO:tasks.workunit.client.0.smithi040.stdout:7/801: dread d6/d25/dcf/de4/d2d/d47/d5c/f97 [0,4194304] 0 2024-04-18T10:42:51.966 INFO:tasks.workunit.client.0.smithi040.stdout:1/834: mkdir d1/d9b/d75/d125 0 2024-04-18T10:42:51.968 INFO:tasks.workunit.client.0.smithi040.stdout:9/871: rename d2/df0 to d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40/d71/d132 0 2024-04-18T10:42:51.970 INFO:tasks.workunit.client.0.smithi040.stdout:0/891: write dd/df/d19/d3e/fcd [1158515,114524] 0 2024-04-18T10:42:51.971 INFO:tasks.workunit.client.0.smithi040.stdout:0/892: fdatasync dd/df/d19/d3e/d77/f85 0 2024-04-18T10:42:51.972 INFO:tasks.workunit.client.0.smithi040.stdout:9/872: rmdir d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf 39 2024-04-18T10:42:51.973 INFO:tasks.workunit.client.0.smithi040.stdout:7/802: symlink d6/d25/d28/dac/d64/lf7 0 2024-04-18T10:42:51.977 INFO:tasks.workunit.client.0.smithi040.stdout:1/835: dwrite d1/d1c/d7b/d2d/f63 [0,4194304] 0 2024-04-18T10:42:51.978 INFO:tasks.workunit.client.0.smithi040.stdout:7/803: mkdir d6/dc1/df8 0 2024-04-18T10:42:51.979 INFO:tasks.workunit.client.0.smithi040.stdout:0/893: read dd/df/d19/d28/db7/dd4/fbc [1099658,24775] 0 2024-04-18T10:42:51.981 INFO:tasks.workunit.client.0.smithi040.stdout:1/836: rename d1/d1c/d2b/d32/dc8 to d1/d1c/d7b/d2e/d3e/d85/d126 0 2024-04-18T10:42:51.981 INFO:tasks.workunit.client.0.smithi040.stdout:1/837: read - d1/d1c/d7b/d2e/f118 zero size 2024-04-18T10:42:51.988 INFO:tasks.workunit.client.0.smithi040.stdout:1/838: creat d1/d9b/d75/d84/dac/f127 x:0 0 0 2024-04-18T10:42:51.990 INFO:tasks.workunit.client.0.smithi040.stdout:1/839: truncate d1/d1c/d2b/d32/d36/d4d/d67/fbf 1814989 0 2024-04-18T10:42:51.990 INFO:tasks.workunit.client.0.smithi040.stdout:9/873: rename d2/d5b/d6f/d80/d75/d124/f65 to d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40/d85/ded/f133 0 2024-04-18T10:42:51.994 INFO:tasks.workunit.client.0.smithi040.stdout:9/874: creat d2/dd/de/f134 x:0 0 0 2024-04-18T10:42:51.998 INFO:tasks.workunit.client.0.smithi040.stdout:4/804: write d2/d3/d4/d1f/d29/d49/f73 [437644,113507] 0 2024-04-18T10:42:51.998 INFO:tasks.workunit.client.0.smithi040.stdout:9/875: symlink d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d86/d12a/l135 0 2024-04-18T10:42:52.000 INFO:tasks.workunit.client.0.smithi040.stdout:0/894: dread dd/df/d19/d3e/d77/f85 [0,4194304] 0 2024-04-18T10:42:52.001 INFO:tasks.workunit.client.0.smithi040.stdout:4/805: write d2/d3/d4/dd/f89 [827772,77485] 0 2024-04-18T10:42:52.010 INFO:tasks.workunit.client.0.smithi040.stdout:8/897: sync 2024-04-18T10:42:52.017 INFO:tasks.workunit.client.0.smithi040.stdout:7/804: write d6/d25/d28/dac/d63/fde [1436443,75831] 0 2024-04-18T10:42:52.017 INFO:tasks.workunit.client.0.smithi040.stdout:0/895: dread - dd/df/d19/d28/d3a/d46/d107/d11c/f13b zero size 2024-04-18T10:42:52.020 INFO:tasks.workunit.client.0.smithi040.stdout:8/898: symlink d2/l12d 0 2024-04-18T10:42:52.021 INFO:tasks.workunit.client.0.smithi040.stdout:7/805: fsync d6/d25/dcf/de4/d2d/d47/d55/d9f/fbb 0 2024-04-18T10:42:52.021 INFO:tasks.workunit.client.0.smithi040.stdout:4/806: creat d2/fe9 x:0 0 0 2024-04-18T10:42:52.025 INFO:tasks.workunit.client.0.smithi040.stdout:8/899: creat d2/d4c/dd2/f12e x:0 0 0 2024-04-18T10:42:52.026 INFO:tasks.workunit.client.0.smithi040.stdout:0/896: rename dd/df/d19/d3e/da5/fce to dd/df/d19/d28/d3a/d46/f13d 0 2024-04-18T10:42:52.026 INFO:tasks.workunit.client.0.smithi040.stdout:4/807: chown d2/d3/d2f/dce/ld9 46883369 1 2024-04-18T10:42:52.027 INFO:tasks.workunit.client.0.smithi040.stdout:1/840: dwrite d1/d1c/f9d [0,4194304] 0 2024-04-18T10:42:52.028 INFO:tasks.workunit.client.0.smithi040.stdout:0/897: dread - dd/f6b zero size 2024-04-18T10:42:52.029 INFO:tasks.workunit.client.0.smithi040.stdout:4/808: stat d2/d3/d4/d1f/d29/c6e 0 2024-04-18T10:42:52.031 INFO:tasks.workunit.client.0.smithi040.stdout:9/876: dwrite d2/d7/f29 [0,4194304] 0 2024-04-18T10:42:52.032 INFO:tasks.workunit.client.0.smithi040.stdout:1/841: dread - d1/d9b/d75/d84/fc3 zero size 2024-04-18T10:42:52.032 INFO:tasks.workunit.client.0.smithi040.stdout:8/900: write d2/d5/d9/d3c/f102 [640761,43560] 0 2024-04-18T10:42:52.035 INFO:tasks.workunit.client.0.smithi040.stdout:4/809: fsync d2/d3/d4/d1f/d29/d49/f32 0 2024-04-18T10:42:52.037 INFO:tasks.workunit.client.0.smithi040.stdout:9/877: creat d2/dd/de/f136 x:0 0 0 2024-04-18T10:42:52.038 INFO:tasks.workunit.client.0.smithi040.stdout:0/898: truncate dd/df/d19/d28/db7/feb 672796 0 2024-04-18T10:42:52.038 INFO:tasks.workunit.client.0.smithi040.stdout:8/901: unlink d2/d15/d78/d10b/l11e 0 2024-04-18T10:42:52.038 INFO:tasks.workunit.client.0.smithi040.stdout:7/806: dwrite d6/d25/d28/dac/d64/fcc [0,4194304] 0 2024-04-18T10:42:52.040 INFO:tasks.workunit.client.0.smithi040.stdout:9/878: mkdir d2/d5b/d6f/dc3/d137 0 2024-04-18T10:42:52.043 INFO:tasks.workunit.client.0.smithi040.stdout:4/810: rename d2/d3/d4/d21 to d2/d3/d4/d23/dea 0 2024-04-18T10:42:52.043 INFO:tasks.workunit.client.0.smithi040.stdout:8/902: rmdir d2/d15/d2b/dd0/dff 39 2024-04-18T10:42:52.045 INFO:tasks.workunit.client.0.smithi040.stdout:7/807: mkdir d6/d25/dcf/de4/d2d/d47/d55/d58/dc4/df9 0 2024-04-18T10:42:52.047 INFO:tasks.workunit.client.0.smithi040.stdout:1/842: dwrite d1/d1c/d2b/d32/d36/d4d/d67/f8e [0,4194304] 0 2024-04-18T10:42:52.049 INFO:tasks.workunit.client.0.smithi040.stdout:7/808: fsync d6/f22 0 2024-04-18T10:42:52.054 INFO:tasks.workunit.client.0.smithi040.stdout:8/903: dwrite d2/d2c/f124 [0,4194304] 0 2024-04-18T10:42:52.055 INFO:tasks.workunit.client.0.smithi040.stdout:4/811: dwrite d2/d3/d4/dd/d6d/d70/f7d [0,4194304] 0 2024-04-18T10:42:52.055 INFO:tasks.workunit.client.0.smithi040.stdout:7/809: write d6/d25/dcf/de4/d2d/d47/d55/d58/d6c/faa [699388,52772] 0 2024-04-18T10:42:52.055 INFO:tasks.workunit.client.0.smithi040.stdout:8/904: readlink d2/d5/d9/d63/l76 0 2024-04-18T10:42:52.058 INFO:tasks.workunit.client.0.smithi040.stdout:8/905: chown d2/d5/d9/c53 9316 1 2024-04-18T10:42:52.059 INFO:tasks.workunit.client.0.smithi040.stdout:4/812: readlink d2/d3/d4/dd/d6d/l8d 0 2024-04-18T10:42:52.060 INFO:tasks.workunit.client.0.smithi040.stdout:8/906: write d2/d15/fca [1368410,41512] 0 2024-04-18T10:42:52.060 INFO:tasks.workunit.client.0.smithi040.stdout:4/813: write d2/d3/d4/d1f/d29/d49/f73 [1547449,114432] 0 2024-04-18T10:42:52.062 INFO:tasks.workunit.client.0.smithi040.stdout:8/907: mknod d2/d5/d9/d63/c12f 0 2024-04-18T10:42:52.065 INFO:tasks.workunit.client.0.smithi040.stdout:8/908: symlink d2/d5/d9/d3c/d68/l130 0 2024-04-18T10:42:52.065 INFO:tasks.workunit.client.0.smithi040.stdout:4/814: truncate d2/d3/d41/d47/f82 1150451 0 2024-04-18T10:42:52.066 INFO:tasks.workunit.client.0.smithi040.stdout:8/909: chown d2/d5/d9/d3c/f102 98836 1 2024-04-18T10:42:52.066 INFO:tasks.workunit.client.0.smithi040.stdout:7/810: dread d6/d25/d28/dac/f7d [0,4194304] 0 2024-04-18T10:42:52.067 INFO:tasks.workunit.client.0.smithi040.stdout:4/815: write d2/d3/d4/dd/d6d/d70/fb7 [349316,111052] 0 2024-04-18T10:42:52.068 INFO:tasks.workunit.client.0.smithi040.stdout:4/816: chown d2/d3/d41/d47/d6f 0 1 2024-04-18T10:42:52.073 INFO:tasks.workunit.client.0.smithi040.stdout:8/910: link d2/d5/d9/d3c/f102 d2/d5/d9/d3c/d68/dfe/f131 0 2024-04-18T10:42:52.074 INFO:tasks.workunit.client.0.smithi040.stdout:4/817: dwrite d2/f2c [0,4194304] 0 2024-04-18T10:42:52.077 INFO:tasks.workunit.client.0.smithi040.stdout:8/911: creat d2/d15/d78/d10b/f132 x:0 0 0 2024-04-18T10:42:52.079 INFO:tasks.workunit.client.0.smithi040.stdout:8/912: getdents d2/d4c/df4 0 2024-04-18T10:42:52.080 INFO:tasks.workunit.client.0.smithi040.stdout:8/913: write d2/d5/d9/d3c/f10f [234470,108123] 0 2024-04-18T10:42:52.084 INFO:tasks.workunit.client.0.smithi040.stdout:8/914: symlink d2/d15/d2b/dd0/dff/l133 0 2024-04-18T10:42:52.085 INFO:tasks.workunit.client.0.smithi040.stdout:6/874: sync 2024-04-18T10:42:52.085 INFO:tasks.workunit.client.0.smithi040.stdout:5/808: sync 2024-04-18T10:42:52.089 INFO:tasks.workunit.client.0.smithi040.stdout:5/809: rename d0/d3b/d67/dc7/ld3 to d0/d4e/dc2/l10b 0 2024-04-18T10:42:52.090 INFO:tasks.workunit.client.0.smithi040.stdout:5/810: read - d0/d78/d95/d52/d5d/f108 zero size 2024-04-18T10:42:52.090 INFO:tasks.workunit.client.0.smithi040.stdout:6/875: mkdir df/d4b/d6e/d3f/d13f 0 2024-04-18T10:42:52.090 INFO:tasks.workunit.client.0.smithi040.stdout:9/879: write d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/f4c [648711,81292] 0 2024-04-18T10:42:52.094 INFO:tasks.workunit.client.0.smithi040.stdout:6/876: unlink df/d4b/d6a/d93/f56 0 2024-04-18T10:42:52.096 INFO:tasks.workunit.client.0.smithi040.stdout:5/811: dread d0/db5/ff8 [0,4194304] 0 2024-04-18T10:42:52.097 INFO:tasks.workunit.client.0.smithi040.stdout:9/880: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/dbb/f138 x:0 0 0 2024-04-18T10:42:52.097 INFO:tasks.workunit.client.0.smithi040.stdout:1/843: dwrite d1/f69 [0,4194304] 0 2024-04-18T10:42:52.099 INFO:tasks.workunit.client.0.smithi040.stdout:6/877: mkdir df/d4b/deb/df5/d140 0 2024-04-18T10:42:52.103 INFO:tasks.workunit.client.0.smithi040.stdout:7/811: truncate d6/d25/dcf/de4/d2d/d47/f72 1010750 0 2024-04-18T10:42:52.108 INFO:tasks.workunit.client.0.smithi040.stdout:7/812: fsync d6/d25/d28/dac/f7d 0 2024-04-18T10:42:52.114 INFO:tasks.workunit.client.0.smithi040.stdout:5/812: dwrite d0/d3/d6b/d7b/f85 [0,4194304] 0 2024-04-18T10:42:52.115 INFO:tasks.workunit.client.0.smithi040.stdout:8/915: dread d2/d2c/f3b [0,4194304] 0 2024-04-18T10:42:52.115 INFO:tasks.workunit.client.0.smithi040.stdout:1/844: dwrite d1/d1c/d7b/d2e/d3e/d85/fd2 [0,4194304] 0 2024-04-18T10:42:52.117 INFO:tasks.workunit.client.0.smithi040.stdout:9/881: dwrite d2/dd/f24 [0,4194304] 0 2024-04-18T10:42:52.120 INFO:tasks.workunit.client.0.smithi040.stdout:7/813: mkdir d6/d50/d79/d9a/dfa 0 2024-04-18T10:42:52.120 INFO:tasks.workunit.client.0.smithi040.stdout:4/818: dwrite d2/d3/d4/dd/f69 [0,4194304] 0 2024-04-18T10:42:52.125 INFO:tasks.workunit.client.0.smithi040.stdout:7/814: mknod d6/d50/d79/cfb 0 2024-04-18T10:42:52.129 INFO:tasks.workunit.client.0.smithi040.stdout:8/916: dread d2/d22/d49/f9a [0,4194304] 0 2024-04-18T10:42:52.129 INFO:tasks.workunit.client.0.smithi040.stdout:5/813: dwrite d0/d3/dba/fde [0,4194304] 0 2024-04-18T10:42:52.129 INFO:tasks.workunit.client.0.smithi040.stdout:7/815: chown d6/d25/dcf/de4/d2d/d47/d5c/ff5 106 1 2024-04-18T10:42:52.130 INFO:tasks.workunit.client.0.smithi040.stdout:7/816: chown d6/d25/l29 46908080 1 2024-04-18T10:42:52.131 INFO:tasks.workunit.client.0.smithi040.stdout:1/845: getdents d1/d1c/d2b/d32/d36/d4d 0 2024-04-18T10:42:52.132 INFO:tasks.workunit.client.0.smithi040.stdout:4/819: fdatasync d2/d3/d4/dd/d4f/fc3 0 2024-04-18T10:42:52.134 INFO:tasks.workunit.client.0.smithi040.stdout:4/820: read - d2/d3/d4/dd/d4f/fd3 zero size 2024-04-18T10:42:52.138 INFO:tasks.workunit.client.0.smithi040.stdout:7/817: dwrite d6/d25/dcf/de4/f3d [0,4194304] 0 2024-04-18T10:42:52.138 INFO:tasks.workunit.client.0.smithi040.stdout:9/882: dread d2/d5b/d6f/d80/d75/d124/d70/f8f [0,4194304] 0 2024-04-18T10:42:52.139 INFO:tasks.workunit.client.0.smithi040.stdout:1/846: rename d1/d16/l79 to d1/d1c/d2b/db5/l128 0 2024-04-18T10:42:52.140 INFO:tasks.workunit.client.0.smithi040.stdout:4/821: symlink d2/d3/d41/d47/da2/leb 0 2024-04-18T10:42:52.141 INFO:tasks.workunit.client.0.smithi040.stdout:7/818: creat d6/d3e/d73/ffc x:0 0 0 2024-04-18T10:42:52.142 INFO:tasks.workunit.client.0.smithi040.stdout:8/917: getdents d2/d5 0 2024-04-18T10:42:52.143 INFO:tasks.workunit.client.0.smithi040.stdout:7/819: chown d6/fee 1303 1 2024-04-18T10:42:52.145 INFO:tasks.workunit.client.0.smithi040.stdout:7/820: chown d6/d25/d28/dac/d64/lf7 45 1 2024-04-18T10:42:52.147 INFO:tasks.workunit.client.0.smithi040.stdout:8/918: truncate d2/d5/d9/d1b/fa6 677167 0 2024-04-18T10:42:52.147 INFO:tasks.workunit.client.0.smithi040.stdout:9/883: truncate d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/fe3 2962305 0 2024-04-18T10:42:52.150 INFO:tasks.workunit.client.0.smithi040.stdout:7/821: write d6/d25/dcf/de4/d2d/f57 [2205747,99469] 0 2024-04-18T10:42:52.152 INFO:tasks.workunit.client.0.smithi040.stdout:4/822: dwrite d2/d3/d4/dd/fbd [0,4194304] 0 2024-04-18T10:42:52.152 INFO:tasks.workunit.client.0.smithi040.stdout:2/803: sync 2024-04-18T10:42:52.152 INFO:tasks.workunit.client.0.smithi040.stdout:0/899: sync 2024-04-18T10:42:52.153 INFO:tasks.workunit.client.0.smithi040.stdout:3/853: sync 2024-04-18T10:42:52.154 INFO:tasks.workunit.client.0.smithi040.stdout:0/900: fdatasync dd/df/f44 0 2024-04-18T10:42:52.155 INFO:tasks.workunit.client.0.smithi040.stdout:3/854: dread - d1/d7/d67/dc5/fdb zero size 2024-04-18T10:42:52.156 INFO:tasks.workunit.client.0.smithi040.stdout:7/822: write d6/d25/d28/f4e [4351274,102864] 0 2024-04-18T10:42:52.157 INFO:tasks.workunit.client.0.smithi040.stdout:2/804: readlink dd/d61/d81/dfb/d2b/d7c/d37/l64 0 2024-04-18T10:42:52.158 INFO:tasks.workunit.client.0.smithi040.stdout:5/814: dread d0/d3b/d67/f68 [0,4194304] 0 2024-04-18T10:42:52.158 INFO:tasks.workunit.client.0.smithi040.stdout:7/823: write d6/d3e/fbe [615846,61186] 0 2024-04-18T10:42:52.159 INFO:tasks.workunit.client.0.smithi040.stdout:0/901: mknod dd/da3/d122/c13e 0 2024-04-18T10:42:52.159 INFO:tasks.workunit.client.0.smithi040.stdout:4/823: mknod d2/d3/d4/d23/dea/d28/d3f/cec 0 2024-04-18T10:42:52.163 INFO:tasks.workunit.client.0.smithi040.stdout:5/815: creat d0/d3/f10c x:0 0 0 2024-04-18T10:42:52.163 INFO:tasks.workunit.client.0.smithi040.stdout:0/902: dread - dd/df/d19/d28/d3a/d46/d107/f10c zero size 2024-04-18T10:42:52.164 INFO:tasks.workunit.client.0.smithi040.stdout:7/824: write d6/d25/dcf/de4/d2d/d47/d55/d58/d6c/f88 [2916224,23035] 0 2024-04-18T10:42:52.164 INFO:tasks.workunit.client.0.smithi040.stdout:4/824: creat d2/d3/d41/d47/da2/fed x:0 0 0 2024-04-18T10:42:52.167 INFO:tasks.workunit.client.0.smithi040.stdout:3/855: dwrite d1/d7/d12/f9d [0,4194304] 0 2024-04-18T10:42:52.167 INFO:tasks.workunit.client.0.smithi040.stdout:4/825: fsync d2/d3/f59 0 2024-04-18T10:42:52.167 INFO:tasks.workunit.client.0.smithi040.stdout:5/816: creat d0/d4e/f10d x:0 0 0 2024-04-18T10:42:52.168 INFO:tasks.workunit.client.0.smithi040.stdout:0/903: write dd/df/d19/d28/db7/f128 [892645,10930] 0 2024-04-18T10:42:52.169 INFO:tasks.workunit.client.0.smithi040.stdout:2/805: dread dd/d61/d81/dfb/d2b/d7c/d37/d38/f57 [0,4194304] 0 2024-04-18T10:42:52.170 INFO:tasks.workunit.client.0.smithi040.stdout:5/817: write d0/d21/ffb [67376,128308] 0 2024-04-18T10:42:52.170 INFO:tasks.workunit.client.0.smithi040.stdout:4/826: stat d2/d3/d41/d62/d9a 0 2024-04-18T10:42:52.171 INFO:tasks.workunit.client.0.smithi040.stdout:5/818: stat d0/d3/dba/de7 0 2024-04-18T10:42:52.178 INFO:tasks.workunit.client.0.smithi040.stdout:4/827: dwrite d2/d3/d4/dd/d6d/fb3 [0,4194304] 0 2024-04-18T10:42:52.179 INFO:tasks.workunit.client.0.smithi040.stdout:5/819: getdents d0/d78 0 2024-04-18T10:42:52.180 INFO:tasks.workunit.client.0.smithi040.stdout:2/806: getdents dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1 0 2024-04-18T10:42:52.183 INFO:tasks.workunit.client.0.smithi040.stdout:4/828: read d2/d3/d4/d1f/d29/d49/f65 [1527680,66412] 0 2024-04-18T10:42:52.186 INFO:tasks.workunit.client.0.smithi040.stdout:0/904: dread dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3/fe3 [0,4194304] 0 2024-04-18T10:42:52.187 INFO:tasks.workunit.client.0.smithi040.stdout:6/878: sync 2024-04-18T10:42:52.188 INFO:tasks.workunit.client.0.smithi040.stdout:5/820: getdents d0/d3b/d3f/db1/df2 0 2024-04-18T10:42:52.188 INFO:tasks.workunit.client.0.smithi040.stdout:2/807: dwrite dd/d61/d81/dfb/d2b/dbc/f99 [0,4194304] 0 2024-04-18T10:42:52.190 INFO:tasks.workunit.client.0.smithi040.stdout:9/884: dread d2/d5b/d6f/d80/fab [0,4194304] 0 2024-04-18T10:42:52.191 INFO:tasks.workunit.client.0.smithi040.stdout:0/905: symlink dd/df/d19/d8d/l13f 0 2024-04-18T10:42:52.192 INFO:tasks.workunit.client.0.smithi040.stdout:6/879: symlink df/d4b/d6a/d93/l141 0 2024-04-18T10:42:52.194 INFO:tasks.workunit.client.0.smithi040.stdout:0/906: mkdir dd/d10b/d140 0 2024-04-18T10:42:52.195 INFO:tasks.workunit.client.0.smithi040.stdout:5/821: rename d0/d3/d47/dd5 to d0/d4e/dc2/d10e 0 2024-04-18T10:42:52.196 INFO:tasks.workunit.client.0.smithi040.stdout:6/880: symlink df/d4b/d6a/l142 0 2024-04-18T10:42:52.196 INFO:tasks.workunit.client.0.smithi040.stdout:6/881: chown df/d4b/d6e/f11f 100610 1 2024-04-18T10:42:52.197 INFO:tasks.workunit.client.0.smithi040.stdout:2/808: creat dd/d61/d81/dfb/d2b/d7c/d37/d5b/dda/f111 x:0 0 0 2024-04-18T10:42:52.197 INFO:tasks.workunit.client.0.smithi040.stdout:6/882: write df/d4b/d63/dbb/fcb [510352,108498] 0 2024-04-18T10:42:52.203 INFO:tasks.workunit.client.0.smithi040.stdout:1/847: dread d1/d16/f1b [0,4194304] 0 2024-04-18T10:42:52.204 INFO:tasks.workunit.client.0.smithi040.stdout:9/885: rename d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40/d100/c10b to d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/c139 0 2024-04-18T10:42:52.205 INFO:tasks.workunit.client.0.smithi040.stdout:0/907: dwrite dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3/fe3 [0,4194304] 0 2024-04-18T10:42:52.207 INFO:tasks.workunit.client.0.smithi040.stdout:0/908: write dd/df/d19/f8c [2819808,112456] 0 2024-04-18T10:42:52.208 INFO:tasks.workunit.client.0.smithi040.stdout:9/886: unlink d2/d7/f1b 0 2024-04-18T10:42:52.210 INFO:tasks.workunit.client.0.smithi040.stdout:9/887: chown d2/dd/de/f6c 404023 1 2024-04-18T10:42:52.210 INFO:tasks.workunit.client.0.smithi040.stdout:2/809: dread dd/f45 [0,4194304] 0 2024-04-18T10:42:52.210 INFO:tasks.workunit.client.0.smithi040.stdout:0/909: read - dd/df/d19/d28/d3a/d5b/dd0/df7/f111 zero size 2024-04-18T10:42:52.213 INFO:tasks.workunit.client.0.smithi040.stdout:0/910: dread - dd/df/d19/d28/d3a/d5b/dd0/f123 zero size 2024-04-18T10:42:52.216 INFO:tasks.workunit.client.0.smithi040.stdout:2/810: dread dd/d61/d81/dfb/fa9 [0,4194304] 0 2024-04-18T10:42:52.219 INFO:tasks.workunit.client.0.smithi040.stdout:9/888: dread d2/d7/f8 [0,4194304] 0 2024-04-18T10:42:52.222 INFO:tasks.workunit.client.0.smithi040.stdout:0/911: rename dd/df/d19/d28/d3a/d42/f59 to dd/df/d19/dd5/f141 0 2024-04-18T10:42:52.225 INFO:tasks.workunit.client.0.smithi040.stdout:3/856: dread d1/d2/d16/fbb [0,4194304] 0 2024-04-18T10:42:52.226 INFO:tasks.workunit.client.0.smithi040.stdout:3/857: stat d1/d7/d67/dc5/d3b 0 2024-04-18T10:42:52.226 INFO:tasks.workunit.client.0.smithi040.stdout:8/919: write d2/d5/d9/d3c/d5a/f21 [2086398,34660] 0 2024-04-18T10:42:52.228 INFO:tasks.workunit.client.0.smithi040.stdout:2/811: read dd/d61/d81/fba [3789120,63549] 0 2024-04-18T10:42:52.229 INFO:tasks.workunit.client.0.smithi040.stdout:2/812: write dd/d61/d81/dfb/d2b/d7c/d37/d38/f10b [348158,111737] 0 2024-04-18T10:42:52.230 INFO:tasks.workunit.client.0.smithi040.stdout:4/829: rmdir d2/d3/d4 39 2024-04-18T10:42:52.232 INFO:tasks.workunit.client.0.smithi040.stdout:8/920: mkdir d2/d106/d134 0 2024-04-18T10:42:52.233 INFO:tasks.workunit.client.0.smithi040.stdout:4/830: symlink d2/d1a/lee 0 2024-04-18T10:42:52.235 INFO:tasks.workunit.client.0.smithi040.stdout:8/921: write d2/d5/d9/f9d [269972,18440] 0 2024-04-18T10:42:52.236 INFO:tasks.workunit.client.0.smithi040.stdout:1/848: dread d1/d1c/d7b/f83 [0,4194304] 0 2024-04-18T10:42:52.236 INFO:tasks.workunit.client.0.smithi040.stdout:0/912: getdents dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3 0 2024-04-18T10:42:52.237 INFO:tasks.workunit.client.0.smithi040.stdout:3/858: dwrite d1/d7/d28/f61 [0,4194304] 0 2024-04-18T10:42:52.239 INFO:tasks.workunit.client.0.smithi040.stdout:0/913: fdatasync dd/df/d19/d3e/da5/f12a 0 2024-04-18T10:42:52.240 INFO:tasks.workunit.client.0.smithi040.stdout:3/859: chown d1/d7/l4b 24270 1 2024-04-18T10:42:52.244 INFO:tasks.workunit.client.0.smithi040.stdout:4/831: dread d2/d3/d4/dd/d4f/fc5 [0,4194304] 0 2024-04-18T10:42:52.244 INFO:tasks.workunit.client.0.smithi040.stdout:0/914: mkdir dd/df/d19/d28/d3a/d46/d107/d142 0 2024-04-18T10:42:52.247 INFO:tasks.workunit.client.0.smithi040.stdout:9/889: rename d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/d40 to d2/d5b/d13a 0 2024-04-18T10:42:52.249 INFO:tasks.workunit.client.0.smithi040.stdout:0/915: chown dd/df/d19/d28/d3a/df9/f104 1718678884 1 2024-04-18T10:42:52.250 INFO:tasks.workunit.client.0.smithi040.stdout:8/922: dwrite d2/d2c/f3b [0,4194304] 0 2024-04-18T10:42:52.251 INFO:tasks.workunit.client.0.smithi040.stdout:9/890: write d2/dd/f98 [3022173,34495] 0 2024-04-18T10:42:52.252 INFO:tasks.workunit.client.0.smithi040.stdout:5/822: dwrite d0/d21/d42/fce [0,4194304] 0 2024-04-18T10:42:52.256 INFO:tasks.workunit.client.0.smithi040.stdout:2/813: rename c1 to dd/d61/d81/dfb/d2b/d7c/d37/d38/d8c/c112 0 2024-04-18T10:42:52.258 INFO:tasks.workunit.client.0.smithi040.stdout:3/860: link d1/d2/d4e/d58/f5d d1/d2/d16/d9b/f11a 0 2024-04-18T10:42:52.259 INFO:tasks.workunit.client.0.smithi040.stdout:6/883: dwrite df/d4b/d6e/d3f/d53/d8a/fb5 [0,4194304] 0 2024-04-18T10:42:52.260 INFO:tasks.workunit.client.0.smithi040.stdout:3/861: chown d1/d2/d4e/d58/dbe/dc1/dc2 861873985 1 2024-04-18T10:42:52.260 INFO:tasks.workunit.client.0.smithi040.stdout:6/884: fsync df/d4b/d99/f10f 0 2024-04-18T10:42:52.262 INFO:tasks.workunit.client.0.smithi040.stdout:3/862: write d1/d2/d4e/d58/dbe/dc1/dc2/fe4 [251973,64369] 0 2024-04-18T10:42:52.263 INFO:tasks.workunit.client.0.smithi040.stdout:3/863: chown d1/d2/d4e/d57/c7f 624251 1 2024-04-18T10:42:52.266 INFO:tasks.workunit.client.0.smithi040.stdout:5/823: unlink d0/d4e/cd8 0 2024-04-18T10:42:52.266 INFO:tasks.workunit.client.0.smithi040.stdout:9/891: mkdir d2/dd/de/d13b 0 2024-04-18T10:42:52.267 INFO:tasks.workunit.client.0.smithi040.stdout:0/916: creat dd/df/d19/d28/d3a/d46/d107/d11c/f143 x:0 0 0 2024-04-18T10:42:52.268 INFO:tasks.workunit.client.0.smithi040.stdout:0/917: chown dd/df/d19/d3e/da5/f12a 205399693 1 2024-04-18T10:42:52.270 INFO:tasks.workunit.client.0.smithi040.stdout:1/849: rename d1/d1c/d7b/d2e/l57 to d1/d9b/d75/d84/dac/l129 0 2024-04-18T10:42:52.271 INFO:tasks.workunit.client.0.smithi040.stdout:2/814: symlink dd/d61/d81/dfb/d2b/dbc/d5f/l113 0 2024-04-18T10:42:52.271 INFO:tasks.workunit.client.0.smithi040.stdout:0/918: write dd/df/d19/d3e/d77/fb3 [11127,846] 0 2024-04-18T10:42:52.273 INFO:tasks.workunit.client.0.smithi040.stdout:1/850: write d1/d1c/d2b/d32/d35/f66 [131347,89637] 0 2024-04-18T10:42:52.273 INFO:tasks.workunit.client.0.smithi040.stdout:3/864: mknod d1/d2/d4e/d58/db4/c11b 0 2024-04-18T10:42:52.274 INFO:tasks.workunit.client.0.smithi040.stdout:0/919: write dd/d62/f74 [881381,36645] 0 2024-04-18T10:42:52.275 INFO:tasks.workunit.client.0.smithi040.stdout:8/923: symlink d2/d15/d78/d10b/d120/d123/l135 0 2024-04-18T10:42:52.276 INFO:tasks.workunit.client.0.smithi040.stdout:5/824: dwrite d0/d3b/d3f/d72/f89 [0,4194304] 0 2024-04-18T10:42:52.278 INFO:tasks.workunit.client.0.smithi040.stdout:9/892: creat d2/d5b/d6f/d80/d75/d124/d22/db3/f13c x:0 0 0 2024-04-18T10:42:52.279 INFO:tasks.workunit.client.0.smithi040.stdout:6/885: mknod df/d4b/deb/df5/d127/c143 0 2024-04-18T10:42:52.282 INFO:tasks.workunit.client.0.smithi040.stdout:0/920: write dd/daa/dd8/d10f/f137 [222216,91866] 0 2024-04-18T10:42:52.282 INFO:tasks.workunit.client.0.smithi040.stdout:5/825: fsync d0/d21/f44 0 2024-04-18T10:42:52.283 INFO:tasks.workunit.client.0.smithi040.stdout:8/924: chown d2/d2c/da9/fbb 810286 1 2024-04-18T10:42:52.288 INFO:tasks.workunit.client.0.smithi040.stdout:2/815: link dd/d61/d81/dfb/d2b/dbc/d5f/ce3 dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/c114 0 2024-04-18T10:42:52.288 INFO:tasks.workunit.client.0.smithi040.stdout:6/886: dread - df/d76/d91/f9b zero size 2024-04-18T10:42:52.288 INFO:tasks.workunit.client.0.smithi040.stdout:5/826: write d0/d3b/d88/f90 [1031464,39140] 0 2024-04-18T10:42:52.290 INFO:tasks.workunit.client.0.smithi040.stdout:0/921: mknod dd/df/d19/dba/c144 0 2024-04-18T10:42:52.290 INFO:tasks.workunit.client.0.smithi040.stdout:9/893: dread - d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/de4/f130 zero size 2024-04-18T10:42:52.292 INFO:tasks.workunit.client.0.smithi040.stdout:7/825: dwrite d6/d25/dcf/de4/d2d/d47/f72 [0,4194304] 0 2024-04-18T10:42:52.293 INFO:tasks.workunit.client.0.smithi040.stdout:3/865: dwrite d1/d7/db2/dc0/f119 [0,4194304] 0 2024-04-18T10:42:52.295 INFO:tasks.workunit.client.0.smithi040.stdout:6/887: creat df/d121/f144 x:0 0 0 2024-04-18T10:42:52.296 INFO:tasks.workunit.client.0.smithi040.stdout:0/922: rmdir dd/d62 39 2024-04-18T10:42:52.296 INFO:tasks.workunit.client.0.smithi040.stdout:1/851: dwrite d1/d1c/d7b/f83 [0,4194304] 0 2024-04-18T10:42:52.300 INFO:tasks.workunit.client.0.smithi040.stdout:7/826: creat d6/d25/d28/ffd x:0 0 0 2024-04-18T10:42:52.305 INFO:tasks.workunit.client.0.smithi040.stdout:4/832: truncate d2/d3/d4/d1f/fb5 3874019 0 2024-04-18T10:42:52.306 INFO:tasks.workunit.client.0.smithi040.stdout:2/816: dwrite dd/d61/d81/dfb/f86 [0,4194304] 0 2024-04-18T10:42:52.308 INFO:tasks.workunit.client.0.smithi040.stdout:1/852: symlink d1/d1c/d2b/l12a 0 2024-04-18T10:42:52.309 INFO:tasks.workunit.client.0.smithi040.stdout:3/866: dwrite d1/d2/d4e/d58/d62/fb8 [0,4194304] 0 2024-04-18T10:42:52.311 INFO:tasks.workunit.client.0.smithi040.stdout:3/867: fdatasync d1/d7/d67/fd7 0 2024-04-18T10:42:52.312 INFO:tasks.workunit.client.0.smithi040.stdout:5/827: link d0/d3b/f105 d0/d3/d6b/d7b/ddc/f10f 0 2024-04-18T10:42:52.316 INFO:tasks.workunit.client.0.smithi040.stdout:2/817: dwrite dd/d61/f70 [0,4194304] 0 2024-04-18T10:42:52.317 INFO:tasks.workunit.client.0.smithi040.stdout:2/818: readlink dd/d61/d8e/d98/lb4 0 2024-04-18T10:42:52.319 INFO:tasks.workunit.client.0.smithi040.stdout:3/868: creat d1/d7/d67/dba/f11c x:0 0 0 2024-04-18T10:42:52.321 INFO:tasks.workunit.client.0.smithi040.stdout:5/828: write d0/d3b/d88/f94 [2789681,84799] 0 2024-04-18T10:42:52.322 INFO:tasks.workunit.client.0.smithi040.stdout:5/829: fsync d0/d3b/d3f/d72/dd6/ff0 0 2024-04-18T10:42:52.324 INFO:tasks.workunit.client.0.smithi040.stdout:7/827: rename d6/d25/dcf/de4/d2d/d47/d55/d58/cba to d6/d3e/d99/cfe 0 2024-04-18T10:42:52.327 INFO:tasks.workunit.client.0.smithi040.stdout:3/869: symlink d1/d7/d28/d81/l11d 0 2024-04-18T10:42:52.329 INFO:tasks.workunit.client.0.smithi040.stdout:5/830: symlink d0/d3b/d3f/db1/df2/d104/l110 0 2024-04-18T10:42:52.330 INFO:tasks.workunit.client.0.smithi040.stdout:5/831: dread - d0/d78/f82 zero size 2024-04-18T10:42:52.330 INFO:tasks.workunit.client.0.smithi040.stdout:7/828: mkdir d6/d50/dff 0 2024-04-18T10:42:52.332 INFO:tasks.workunit.client.0.smithi040.stdout:5/832: readlink d0/d78/lae 0 2024-04-18T10:42:52.332 INFO:tasks.workunit.client.0.smithi040.stdout:7/829: stat d6/f1f 0 2024-04-18T10:42:52.332 INFO:tasks.workunit.client.0.smithi040.stdout:7/830: readlink d6/d25/dcf/de4/d2d/lc8 0 2024-04-18T10:42:52.333 INFO:tasks.workunit.client.0.smithi040.stdout:5/833: write d0/d3/f38 [6940343,96445] 0 2024-04-18T10:42:52.335 INFO:tasks.workunit.client.0.smithi040.stdout:7/831: creat d6/d25/dcf/f100 x:0 0 0 2024-04-18T10:42:52.337 INFO:tasks.workunit.client.0.smithi040.stdout:5/834: link d0/d3b/d67/fda d0/d21/d42/f111 0 2024-04-18T10:42:52.339 INFO:tasks.workunit.client.0.smithi040.stdout:5/835: symlink d0/d21/l112 0 2024-04-18T10:42:52.342 INFO:tasks.workunit.client.0.smithi040.stdout:5/836: truncate d0/d3/f7 1983755 0 2024-04-18T10:42:52.343 INFO:tasks.workunit.client.0.smithi040.stdout:5/837: symlink d0/d4e/dc2/l113 0 2024-04-18T10:42:52.344 INFO:tasks.workunit.client.0.smithi040.stdout:5/838: readlink d0/d21/la0 0 2024-04-18T10:42:52.344 INFO:tasks.workunit.client.0.smithi040.stdout:0/923: dread dd/df/d19/d3e/f7e [0,4194304] 0 2024-04-18T10:42:52.345 INFO:tasks.workunit.client.0.smithi040.stdout:5/839: stat d0/d3/d6b/d7b/ddc 0 2024-04-18T10:42:52.347 INFO:tasks.workunit.client.0.smithi040.stdout:0/924: mkdir dd/df/d19/dba/d145 0 2024-04-18T10:42:52.349 INFO:tasks.workunit.client.0.smithi040.stdout:0/925: creat dd/df/d19/d28/d3a/d46/d107/f146 x:0 0 0 2024-04-18T10:42:52.355 INFO:tasks.workunit.client.0.smithi040.stdout:4/833: dread d2/d3/d4/f2e [0,4194304] 0 2024-04-18T10:42:52.355 INFO:tasks.workunit.client.0.smithi040.stdout:6/888: rmdir df/d121 39 2024-04-18T10:42:52.356 INFO:tasks.workunit.client.0.smithi040.stdout:8/925: truncate d2/d15/f77 4042981 0 2024-04-18T10:42:52.357 INFO:tasks.workunit.client.0.smithi040.stdout:0/926: dwrite dd/d62/f7f [0,4194304] 0 2024-04-18T10:42:52.363 INFO:tasks.workunit.client.0.smithi040.stdout:8/926: read d2/d22/f85 [3638422,97137] 0 2024-04-18T10:42:52.364 INFO:tasks.workunit.client.0.smithi040.stdout:1/853: dread d1/d9b/d75/d84/dac/dda/de0/ffa [0,4194304] 0 2024-04-18T10:42:52.365 INFO:tasks.workunit.client.0.smithi040.stdout:4/834: dread d2/d3/d4/dd/f69 [0,4194304] 0 2024-04-18T10:42:52.366 INFO:tasks.workunit.client.0.smithi040.stdout:6/889: creat df/d4b/d99/dc4/d10c/f145 x:0 0 0 2024-04-18T10:42:52.369 INFO:tasks.workunit.client.0.smithi040.stdout:9/894: sync 2024-04-18T10:42:52.370 INFO:tasks.workunit.client.0.smithi040.stdout:2/819: truncate dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/f89 609931 0 2024-04-18T10:42:52.370 INFO:tasks.workunit.client.0.smithi040.stdout:8/927: creat d2/d2c/dbf/dc2/d12a/f136 x:0 0 0 2024-04-18T10:42:52.371 INFO:tasks.workunit.client.0.smithi040.stdout:0/927: dwrite dd/df/d19/d28/d3a/d46/d107/d11c/d130/f13a [0,4194304] 0 2024-04-18T10:42:52.374 INFO:tasks.workunit.client.0.smithi040.stdout:8/928: write d2/f17 [560513,78806] 0 2024-04-18T10:42:52.378 INFO:tasks.workunit.client.0.smithi040.stdout:4/835: dread d2/d3/d4/f2e [0,4194304] 0 2024-04-18T10:42:52.380 INFO:tasks.workunit.client.0.smithi040.stdout:0/928: symlink dd/daa/dd8/d113/l147 0 2024-04-18T10:42:52.380 INFO:tasks.workunit.client.0.smithi040.stdout:9/895: dread d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/fba [0,4194304] 0 2024-04-18T10:42:52.383 INFO:tasks.workunit.client.0.smithi040.stdout:3/870: dwrite d1/d2/d4e/d58/f72 [0,4194304] 0 2024-04-18T10:42:52.384 INFO:tasks.workunit.client.0.smithi040.stdout:2/820: mkdir dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/dce/de2/d115 0 2024-04-18T10:42:52.384 INFO:tasks.workunit.client.0.smithi040.stdout:5/840: dread d0/d3b/d3f/d72/f7a [0,4194304] 0 2024-04-18T10:42:52.385 INFO:tasks.workunit.client.0.smithi040.stdout:4/836: creat d2/d3/d2f/fef x:0 0 0 2024-04-18T10:42:52.387 INFO:tasks.workunit.client.0.smithi040.stdout:9/896: mkdir d2/dd/dbf/d13d 0 2024-04-18T10:42:52.387 INFO:tasks.workunit.client.0.smithi040.stdout:0/929: mkdir dd/df/d19/d28/d3a/d46/d148 0 2024-04-18T10:42:52.387 INFO:tasks.workunit.client.0.smithi040.stdout:7/832: dread d6/d25/f4a [0,4194304] 0 2024-04-18T10:42:52.388 INFO:tasks.workunit.client.0.smithi040.stdout:3/871: creat d1/d7/db2/f11e x:0 0 0 2024-04-18T10:42:52.388 INFO:tasks.workunit.client.0.smithi040.stdout:5/841: write d0/d3/f2b [1772811,51007] 0 2024-04-18T10:42:52.392 INFO:tasks.workunit.client.0.smithi040.stdout:2/821: rmdir dd/d61/d81/dfb/d2b/d7c/d37/da3 39 2024-04-18T10:42:52.394 INFO:tasks.workunit.client.0.smithi040.stdout:2/822: stat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52 0 2024-04-18T10:42:52.395 INFO:tasks.workunit.client.0.smithi040.stdout:2/823: dread - dd/d61/d81/dfb/d2b/dbc/d5f/d82/fd3 zero size 2024-04-18T10:42:52.396 INFO:tasks.workunit.client.0.smithi040.stdout:0/930: read dd/df/d19/d3e/da5/fca [3769089,58440] 0 2024-04-18T10:42:52.396 INFO:tasks.workunit.client.0.smithi040.stdout:8/929: dread d2/d5/d9/d3c/de9/f115 [4194304,4194304] 0 2024-04-18T10:42:52.397 INFO:tasks.workunit.client.0.smithi040.stdout:3/872: mkdir d1/d2/d4e/d58/dc4/df8/d11f 0 2024-04-18T10:42:52.399 INFO:tasks.workunit.client.0.smithi040.stdout:2/824: write dd/d61/d81/dfb/d2b/d7c/f3a [1527896,21620] 0 2024-04-18T10:42:52.400 INFO:tasks.workunit.client.0.smithi040.stdout:5/842: mkdir d0/d78/d95/db7/d114 0 2024-04-18T10:42:52.401 INFO:tasks.workunit.client.0.smithi040.stdout:6/890: dread df/d4b/d6a/d93/f31 [0,4194304] 0 2024-04-18T10:42:52.401 INFO:tasks.workunit.client.0.smithi040.stdout:0/931: chown dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3/fe3 237106 1 2024-04-18T10:42:52.401 INFO:tasks.workunit.client.0.smithi040.stdout:2/825: stat dd/d61/d81/dfb/d2b/dbc 0 2024-04-18T10:42:52.402 INFO:tasks.workunit.client.0.smithi040.stdout:4/837: getdents d2/d3/d4/dd/d6d 0 2024-04-18T10:42:52.402 INFO:tasks.workunit.client.0.smithi040.stdout:6/891: chown df/d4b/d6e/d3f/d53/fea 1 1 2024-04-18T10:42:52.404 INFO:tasks.workunit.client.0.smithi040.stdout:6/892: chown df/d4b/d6a/f89 335893976 1 2024-04-18T10:42:52.407 INFO:tasks.workunit.client.0.smithi040.stdout:0/932: rmdir dd/df/d19/d3e/d75 39 2024-04-18T10:42:52.414 INFO:tasks.workunit.client.0.smithi040.stdout:4/838: rmdir d2/d3/d4/d1f/d29/d49/d31 39 2024-04-18T10:42:52.418 INFO:tasks.workunit.client.0.smithi040.stdout:9/897: link d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/f73 d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/f13e 0 2024-04-18T10:42:52.418 INFO:tasks.workunit.client.0.smithi040.stdout:0/933: dread - dd/df/d19/d3e/d77/fb2 zero size 2024-04-18T10:42:52.418 INFO:tasks.workunit.client.0.smithi040.stdout:1/854: dread d1/d16/d92/dad/fc0 [0,4194304] 0 2024-04-18T10:42:52.419 INFO:tasks.workunit.client.0.smithi040.stdout:3/873: write d1/d2/d4e/d58/f5d [4038886,119403] 0 2024-04-18T10:42:52.419 INFO:tasks.workunit.client.0.smithi040.stdout:9/898: stat d2/d5b/d13a/d100 0 2024-04-18T10:42:52.421 INFO:tasks.workunit.client.0.smithi040.stdout:4/839: creat d2/ff0 x:0 0 0 2024-04-18T10:42:52.423 INFO:tasks.workunit.client.0.smithi040.stdout:3/874: fsync d1/d2/f17 0 2024-04-18T10:42:52.423 INFO:tasks.workunit.client.0.smithi040.stdout:7/833: dread d6/d25/dcf/de4/f4c [0,4194304] 0 2024-04-18T10:42:52.427 INFO:tasks.workunit.client.0.smithi040.stdout:8/930: dread d2/d22/d49/fd7 [0,4194304] 0 2024-04-18T10:42:52.428 INFO:tasks.workunit.client.0.smithi040.stdout:0/934: rename dd/df/d19/d28/d3a/d46/d107/l10d to dd/d91/d138/l149 0 2024-04-18T10:42:52.429 INFO:tasks.workunit.client.0.smithi040.stdout:6/893: dwrite df/d121/f144 [0,4194304] 0 2024-04-18T10:42:52.430 INFO:tasks.workunit.client.0.smithi040.stdout:3/875: creat d1/d2/d4e/d57/f120 x:0 0 0 2024-04-18T10:42:52.431 INFO:tasks.workunit.client.0.smithi040.stdout:0/935: chown dd/d10b/d12f 156 1 2024-04-18T10:42:52.433 INFO:tasks.workunit.client.0.smithi040.stdout:2/826: dread dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/f89 [0,4194304] 0 2024-04-18T10:42:52.434 INFO:tasks.workunit.client.0.smithi040.stdout:6/894: dread - df/d4b/d6a/d93/f131 zero size 2024-04-18T10:42:52.438 INFO:tasks.workunit.client.0.smithi040.stdout:9/899: dwrite d2/d5b/fe1 [0,4194304] 0 2024-04-18T10:42:52.438 INFO:tasks.workunit.client.0.smithi040.stdout:0/936: mkdir dd/df/d19/d28/d3a/d14a 0 2024-04-18T10:42:52.439 INFO:tasks.workunit.client.0.smithi040.stdout:2/827: symlink dd/d61/d81/l116 0 2024-04-18T10:42:52.441 INFO:tasks.workunit.client.0.smithi040.stdout:3/876: creat d1/d2/d4e/d58/dc4/df8/f121 x:0 0 0 2024-04-18T10:42:52.442 INFO:tasks.workunit.client.0.smithi040.stdout:7/834: dread d6/d25/dcf/de4/d2d/d47/f72 [0,4194304] 0 2024-04-18T10:42:52.446 INFO:tasks.workunit.client.0.smithi040.stdout:1/855: dread d1/d1c/d7b/d2d/f63 [0,4194304] 0 2024-04-18T10:42:52.446 INFO:tasks.workunit.client.0.smithi040.stdout:4/840: dwrite d2/d3/d4/d1f/d29/d49/f42 [0,4194304] 0 2024-04-18T10:42:52.448 INFO:tasks.workunit.client.0.smithi040.stdout:2/828: fdatasync dd/d61/d81/dfb/d2b/d7c/d37/d5b/f75 0 2024-04-18T10:42:52.448 INFO:tasks.workunit.client.0.smithi040.stdout:0/937: truncate dd/df/d19/d28/fa8 808521 0 2024-04-18T10:42:52.451 INFO:tasks.workunit.client.0.smithi040.stdout:9/900: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/f13f x:0 0 0 2024-04-18T10:42:52.452 INFO:tasks.workunit.client.0.smithi040.stdout:1/856: fsync d1/d1c/d2b/d32/d36/f7d 0 2024-04-18T10:42:52.456 INFO:tasks.workunit.client.0.smithi040.stdout:9/901: chown d2/d5b/d6f/dc3/ldf 12304 1 2024-04-18T10:42:52.456 INFO:tasks.workunit.client.0.smithi040.stdout:0/938: write dd/f2e [2301372,90148] 0 2024-04-18T10:42:52.456 INFO:tasks.workunit.client.0.smithi040.stdout:3/877: rename d1/d7/d67/dc5/l5f to d1/d2/d4e/d58/dbe/dc1/dc2/dea/l122 0 2024-04-18T10:42:52.458 INFO:tasks.workunit.client.0.smithi040.stdout:8/931: dwrite d2/d15/d78/f8d [0,4194304] 0 2024-04-18T10:42:52.459 INFO:tasks.workunit.client.0.smithi040.stdout:2/829: mknod dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/ddf/c117 0 2024-04-18T10:42:52.461 INFO:tasks.workunit.client.0.smithi040.stdout:7/835: getdents d6/d25/dcf/de4/d2d/d47/d55/d58/dc4 0 2024-04-18T10:42:52.462 INFO:tasks.workunit.client.0.smithi040.stdout:5/843: sync 2024-04-18T10:42:52.463 INFO:tasks.workunit.client.0.smithi040.stdout:6/895: dwrite df/d4b/f68 [0,4194304] 0 2024-04-18T10:42:52.468 INFO:tasks.workunit.client.0.smithi040.stdout:4/841: dread d2/d3/d2f/f35 [0,4194304] 0 2024-04-18T10:42:52.470 INFO:tasks.workunit.client.0.smithi040.stdout:2/830: dread - dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/dc5/f10c zero size 2024-04-18T10:42:52.472 INFO:tasks.workunit.client.0.smithi040.stdout:1/857: dwrite d1/fc5 [0,4194304] 0 2024-04-18T10:42:52.475 INFO:tasks.workunit.client.0.smithi040.stdout:6/896: symlink df/d108/l146 0 2024-04-18T10:42:52.477 INFO:tasks.workunit.client.0.smithi040.stdout:5/844: rename d0/d78/d95/d52 to d0/d3/d47/d106/d115 0 2024-04-18T10:42:52.478 INFO:tasks.workunit.client.0.smithi040.stdout:0/939: getdents dd/df/d19/dd5 0 2024-04-18T10:42:52.480 INFO:tasks.workunit.client.0.smithi040.stdout:3/878: dwrite d1/d7/d28/d81/f85 [0,4194304] 0 2024-04-18T10:42:52.480 INFO:tasks.workunit.client.0.smithi040.stdout:2/831: fdatasync dd/d61/d81/dfb/d2b/dbc/d5f/fb2 0 2024-04-18T10:42:52.482 INFO:tasks.workunit.client.0.smithi040.stdout:8/932: dwrite d2/d15/d2b/d40/f71 [0,4194304] 0 2024-04-18T10:42:52.485 INFO:tasks.workunit.client.0.smithi040.stdout:1/858: read d1/d1c/d2b/d32/d36/d4d/d67/dcb/fea [1104212,93543] 0 2024-04-18T10:42:52.488 INFO:tasks.workunit.client.0.smithi040.stdout:7/836: dwrite d6/d25/d28/ffd [0,4194304] 0 2024-04-18T10:42:52.488 INFO:tasks.workunit.client.0.smithi040.stdout:2/832: chown dd/d61/d81/dfb/cb7 0 1 2024-04-18T10:42:52.488 INFO:tasks.workunit.client.0.smithi040.stdout:6/897: getdents df/d4b/d99 0 2024-04-18T10:42:52.494 INFO:tasks.workunit.client.0.smithi040.stdout:8/933: read d2/d5/d9/d3c/d68/fb0 [414693,88067] 0 2024-04-18T10:42:52.494 INFO:tasks.workunit.client.0.smithi040.stdout:5/845: link d0/d3/f7 d0/d3b/d3f/de9/f116 0 2024-04-18T10:42:52.495 INFO:tasks.workunit.client.0.smithi040.stdout:4/842: dwrite d2/d3/d4/d1f/d29/d49/d31/fa8 [0,4194304] 0 2024-04-18T10:42:52.495 INFO:tasks.workunit.client.0.smithi040.stdout:6/898: symlink df/d4b/db7/dcc/de5/l147 0 2024-04-18T10:42:52.496 INFO:tasks.workunit.client.0.smithi040.stdout:5/846: chown d0/d78/f8b 41561378 1 2024-04-18T10:42:52.496 INFO:tasks.workunit.client.0.smithi040.stdout:8/934: read d2/d22/d49/f9a [3081533,58426] 0 2024-04-18T10:42:52.497 INFO:tasks.workunit.client.0.smithi040.stdout:0/940: dread dd/df/d19/dd5/fe4 [0,4194304] 0 2024-04-18T10:42:52.497 INFO:tasks.workunit.client.0.smithi040.stdout:5/847: stat d0/d3/d47/d106/d115/d5d/ff6 0 2024-04-18T10:42:52.499 INFO:tasks.workunit.client.0.smithi040.stdout:5/848: write d0/d3b/d3f/d72/dd6/ff0 [644595,26125] 0 2024-04-18T10:42:52.509 INFO:tasks.workunit.client.0.smithi040.stdout:7/837: dread d6/d50/d79/da8/dad/fb9 [0,4194304] 0 2024-04-18T10:42:52.522 INFO:tasks.workunit.client.0.smithi040.stdout:9/902: dread d2/d5b/d13a/d85/ded/d125/ffb [0,4194304] 0 2024-04-18T10:42:52.539 INFO:tasks.workunit.client.0.smithi040.stdout:1/859: dread d1/d1c/d2b/d32/d36/f38 [0,4194304] 0 2024-04-18T10:42:52.540 INFO:tasks.workunit.client.0.smithi040.stdout:1/860: chown d1/d16/c25 689 1 2024-04-18T10:42:52.546 INFO:tasks.workunit.client.0.smithi040.stdout:1/861: dread d1/d9b/f9c [0,4194304] 0 2024-04-18T10:42:52.552 INFO:tasks.workunit.client.0.smithi040.stdout:7/838: dread d6/d25/f3f [0,4194304] 0 2024-04-18T10:42:52.555 INFO:tasks.workunit.client.0.smithi040.stdout:9/903: dread d2/d5b/d6f/d80/d75/d124/d22/d2e/faa [0,4194304] 0 2024-04-18T10:42:52.556 INFO:tasks.workunit.client.0.smithi040.stdout:9/904: write d2/d5b/d6f/d80/d75/d124/f4e [764132,80875] 0 2024-04-18T10:42:52.557 INFO:tasks.workunit.client.0.smithi040.stdout:9/905: fsync d2/dd/de/d7f/f9d 0 2024-04-18T10:42:52.559 INFO:tasks.workunit.client.0.smithi040.stdout:8/935: dread d2/d15/d78/fcb [0,4194304] 0 2024-04-18T10:42:52.560 INFO:tasks.workunit.client.0.smithi040.stdout:8/936: fdatasync d2/d2c/da9/f117 0 2024-04-18T10:42:52.560 INFO:tasks.workunit.client.0.smithi040.stdout:8/937: chown d2/d15/d78/fed 1 1 2024-04-18T10:42:52.578 INFO:tasks.workunit.client.0.smithi040.stdout:4/843: sync 2024-04-18T10:42:52.580 INFO:tasks.workunit.client.0.smithi040.stdout:4/844: write d2/d3/d41/d62/d7c/fbc [794206,587] 0 2024-04-18T10:42:52.591 INFO:tasks.workunit.client.0.smithi040.stdout:6/899: symlink df/d4b/d6e/d3f/d13f/l148 0 2024-04-18T10:42:52.595 INFO:tasks.workunit.client.0.smithi040.stdout:1/862: symlink d1/d9b/d75/d84/dac/dda/l12b 0 2024-04-18T10:42:52.598 INFO:tasks.workunit.client.0.smithi040.stdout:5/849: mkdir d0/d3b/d117 0 2024-04-18T10:42:52.598 INFO:tasks.workunit.client.0.smithi040.stdout:5/850: readlink d0/d3b/d88/ded/lff 0 2024-04-18T10:42:52.601 INFO:tasks.workunit.client.0.smithi040.stdout:3/879: dread d1/d7/d67/dc5/f65 [0,4194304] 0 2024-04-18T10:42:52.604 INFO:tasks.workunit.client.0.smithi040.stdout:3/880: write d1/d2/d4e/d58/db4/fe6 [1018898,85057] 0 2024-04-18T10:42:52.604 INFO:tasks.workunit.client.0.smithi040.stdout:5/851: dwrite d0/d78/f9c [0,4194304] 0 2024-04-18T10:42:52.605 INFO:tasks.workunit.client.0.smithi040.stdout:2/833: getdents dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/dce/de2 0 2024-04-18T10:42:52.605 INFO:tasks.workunit.client.0.smithi040.stdout:5/852: chown d0/d4e/dc2/fcb 287784548 1 2024-04-18T10:42:52.606 INFO:tasks.workunit.client.0.smithi040.stdout:3/881: write d1/d2/d4e/f84 [1690346,62016] 0 2024-04-18T10:42:52.610 INFO:tasks.workunit.client.0.smithi040.stdout:9/906: symlink d2/dd/dbf/l140 0 2024-04-18T10:42:52.613 INFO:tasks.workunit.client.0.smithi040.stdout:4/845: symlink d2/d3/d41/d62/d9a/lf1 0 2024-04-18T10:42:52.614 INFO:tasks.workunit.client.0.smithi040.stdout:4/846: write d2/d3/d4/fab [4503457,91601] 0 2024-04-18T10:42:52.615 INFO:tasks.workunit.client.0.smithi040.stdout:8/938: dread d2/d5/d9/d3c/f95 [0,4194304] 0 2024-04-18T10:42:52.616 INFO:tasks.workunit.client.0.smithi040.stdout:6/900: symlink df/d4b/d6a/d93/l149 0 2024-04-18T10:42:52.618 INFO:tasks.workunit.client.0.smithi040.stdout:1/863: creat d1/d16/d92/dad/f12c x:0 0 0 2024-04-18T10:42:52.622 INFO:tasks.workunit.client.0.smithi040.stdout:1/864: dread d1/d9b/d75/d84/dac/dda/de0/ffa [0,4194304] 0 2024-04-18T10:42:52.623 INFO:tasks.workunit.client.0.smithi040.stdout:9/907: symlink d2/d5b/d13a/d85/ded/d125/df9/l141 0 2024-04-18T10:42:52.625 INFO:tasks.workunit.client.0.smithi040.stdout:4/847: mknod d2/d3/d4/d23/cf2 0 2024-04-18T10:42:52.627 INFO:tasks.workunit.client.0.smithi040.stdout:8/939: creat d2/d5/d9/d63/f137 x:0 0 0 2024-04-18T10:42:52.627 INFO:tasks.workunit.client.0.smithi040.stdout:8/940: fdatasync d2/f41 0 2024-04-18T10:42:52.630 INFO:tasks.workunit.client.0.smithi040.stdout:0/941: getdents dd/daa/dd8/d10f 0 2024-04-18T10:42:52.631 INFO:tasks.workunit.client.0.smithi040.stdout:0/942: stat dd/df/d19/d3e/da5/fca 0 2024-04-18T10:42:52.631 INFO:tasks.workunit.client.0.smithi040.stdout:5/853: dread d0/d3b/d3f/f40 [0,4194304] 0 2024-04-18T10:42:52.632 INFO:tasks.workunit.client.0.smithi040.stdout:5/854: chown d0/d3/f10c 7612 1 2024-04-18T10:42:52.638 INFO:tasks.workunit.client.0.smithi040.stdout:8/941: dread d2/d15/d2b/f57 [0,4194304] 0 2024-04-18T10:42:52.639 INFO:tasks.workunit.client.0.smithi040.stdout:0/943: dwrite dd/df/d19/d28/d3a/d46/d107/f116 [0,4194304] 0 2024-04-18T10:42:52.640 INFO:tasks.workunit.client.0.smithi040.stdout:2/834: dread dd/d61/d81/dfb/f22 [0,4194304] 0 2024-04-18T10:42:52.640 INFO:tasks.workunit.client.0.smithi040.stdout:8/942: dread - d2/d22/d49/df1/f11d zero size 2024-04-18T10:42:52.641 INFO:tasks.workunit.client.0.smithi040.stdout:6/901: mknod df/d4b/d6e/c14a 0 2024-04-18T10:42:52.644 INFO:tasks.workunit.client.0.smithi040.stdout:7/839: rename d6/d25/dcf/de4/d2d/d47 to d6/d25/d28/dac/d64/d101 0 2024-04-18T10:42:52.648 INFO:tasks.workunit.client.0.smithi040.stdout:0/944: dread dd/df/d19/d28/d3a/d5b/fa6 [0,4194304] 0 2024-04-18T10:42:52.649 INFO:tasks.workunit.client.0.smithi040.stdout:5/855: creat d0/d78/dc4/f118 x:0 0 0 2024-04-18T10:42:52.652 INFO:tasks.workunit.client.0.smithi040.stdout:9/908: symlink d2/d5b/d6f/d80/l142 0 2024-04-18T10:42:52.653 INFO:tasks.workunit.client.0.smithi040.stdout:4/848: symlink d2/d3/d41/d94/dc7/lf3 0 2024-04-18T10:42:52.655 INFO:tasks.workunit.client.0.smithi040.stdout:8/943: symlink d2/d22/d80/l138 0 2024-04-18T10:42:52.660 INFO:tasks.workunit.client.0.smithi040.stdout:0/945: write dd/df/d19/f66 [2208245,46009] 0 2024-04-18T10:42:52.660 INFO:tasks.workunit.client.0.smithi040.stdout:3/882: getdents d1/d2/d4e/d57 0 2024-04-18T10:42:52.666 INFO:tasks.workunit.client.0.smithi040.stdout:7/840: dread d6/d25/dcf/de4/f3d [0,4194304] 0 2024-04-18T10:42:52.669 INFO:tasks.workunit.client.0.smithi040.stdout:3/883: dwrite d1/d2/d4e/d57/f10c [0,4194304] 0 2024-04-18T10:42:52.670 INFO:tasks.workunit.client.0.smithi040.stdout:9/909: dwrite d2/d5b/d6f/d80/d75/d124/f6e [0,4194304] 0 2024-04-18T10:42:52.674 INFO:tasks.workunit.client.0.smithi040.stdout:8/944: link d2/d15/d78/fc1 d2/d5/f139 0 2024-04-18T10:42:52.675 INFO:tasks.workunit.client.0.smithi040.stdout:8/945: write d2/d2c/feb [932623,46227] 0 2024-04-18T10:42:52.678 INFO:tasks.workunit.client.0.smithi040.stdout:5/856: link d0/d78/d95/db7/fe4 d0/d3b/f119 0 2024-04-18T10:42:52.684 INFO:tasks.workunit.client.0.smithi040.stdout:3/884: rename d1/d2/d16 to d1/d7/d67/d123 0 2024-04-18T10:42:52.688 INFO:tasks.workunit.client.0.smithi040.stdout:3/885: stat d1/d2/d4e/d58 0 2024-04-18T10:42:52.689 INFO:tasks.workunit.client.0.smithi040.stdout:4/849: getdents d2/d3/d2f 0 2024-04-18T10:42:52.691 INFO:tasks.workunit.client.0.smithi040.stdout:4/850: symlink d2/d3/d4/dd/lf4 0 2024-04-18T10:42:52.693 INFO:tasks.workunit.client.0.smithi040.stdout:4/851: write d2/d3/d41/d62/d7c/f84 [201692,78557] 0 2024-04-18T10:42:52.693 INFO:tasks.workunit.client.0.smithi040.stdout:4/852: chown d2/d3/d2f/dce/ld9 0 1 2024-04-18T10:42:52.694 INFO:tasks.workunit.client.0.smithi040.stdout:4/853: truncate d2/f9 4960621 0 2024-04-18T10:42:52.697 INFO:tasks.workunit.client.0.smithi040.stdout:4/854: link d2/d3/d41/d47/d99/fdd d2/d3/d41/d47/d6f/ff5 0 2024-04-18T10:42:52.702 INFO:tasks.workunit.client.0.smithi040.stdout:6/902: sync 2024-04-18T10:42:52.703 INFO:tasks.workunit.client.0.smithi040.stdout:4/855: dwrite d2/d3/d4/dd/d4f/f8c [4194304,4194304] 0 2024-04-18T10:42:52.707 INFO:tasks.workunit.client.0.smithi040.stdout:4/856: symlink d2/d3/d4/d1f/daa/lf6 0 2024-04-18T10:42:52.708 INFO:tasks.workunit.client.0.smithi040.stdout:6/903: rename df/d4b/d6a/d93/c66 to df/d4b/d6e/d3f/d53/d8a/c14b 0 2024-04-18T10:42:52.711 INFO:tasks.workunit.client.0.smithi040.stdout:6/904: symlink df/d4b/deb/l14c 0 2024-04-18T10:42:52.712 INFO:tasks.workunit.client.0.smithi040.stdout:6/905: write df/d76/dc2/dce/fda [1479632,69893] 0 2024-04-18T10:42:52.713 INFO:tasks.workunit.client.0.smithi040.stdout:6/906: write df/d4b/d6e/d3f/d53/d8a/fac [475407,104055] 0 2024-04-18T10:42:52.719 INFO:tasks.workunit.client.0.smithi040.stdout:4/857: mknod d2/d3/d41/cf7 0 2024-04-18T10:42:52.721 INFO:tasks.workunit.client.0.smithi040.stdout:4/858: creat d2/d3/d41/d62/d7c/ff8 x:0 0 0 2024-04-18T10:42:52.723 INFO:tasks.workunit.client.0.smithi040.stdout:4/859: chown d2/d3/d4/dd/d4f/lba 33282315 1 2024-04-18T10:42:52.725 INFO:tasks.workunit.client.0.smithi040.stdout:1/865: dwrite d1/d1c/f56 [0,4194304] 0 2024-04-18T10:42:52.726 INFO:tasks.workunit.client.0.smithi040.stdout:1/866: readlink d1/d9b/l61 0 2024-04-18T10:42:52.726 INFO:tasks.workunit.client.0.smithi040.stdout:1/867: readlink d1/d16/l3d 0 2024-04-18T10:42:52.728 INFO:tasks.workunit.client.0.smithi040.stdout:2/835: write dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/dc5/fd9 [1516267,95333] 0 2024-04-18T10:42:52.732 INFO:tasks.workunit.client.0.smithi040.stdout:1/868: dwrite d1/d1c/d7b/d2d/f5c [0,4194304] 0 2024-04-18T10:42:52.735 INFO:tasks.workunit.client.0.smithi040.stdout:2/836: creat dd/d61/d81/dfb/d4a/d54/f118 x:0 0 0 2024-04-18T10:42:52.735 INFO:tasks.workunit.client.0.smithi040.stdout:8/946: readlink d2/d5/l7 0 2024-04-18T10:42:52.736 INFO:tasks.workunit.client.0.smithi040.stdout:7/841: sync 2024-04-18T10:42:52.737 INFO:tasks.workunit.client.0.smithi040.stdout:0/946: truncate dd/df/d19/d3e/d77/fa2 2647764 0 2024-04-18T10:42:52.743 INFO:tasks.workunit.client.0.smithi040.stdout:2/837: symlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/l119 0 2024-04-18T10:42:52.745 INFO:tasks.workunit.client.0.smithi040.stdout:8/947: mknod d2/d5/d9/d3c/d68/c13a 0 2024-04-18T10:42:52.746 INFO:tasks.workunit.client.0.smithi040.stdout:0/947: symlink dd/df/d19/d3e/d77/l14b 0 2024-04-18T10:42:52.747 INFO:tasks.workunit.client.0.smithi040.stdout:6/907: dread df/f2d [0,4194304] 0 2024-04-18T10:42:52.748 INFO:tasks.workunit.client.0.smithi040.stdout:6/908: truncate df/d4b/d6a/d93/f8e 1406719 0 2024-04-18T10:42:52.748 INFO:tasks.workunit.client.0.smithi040.stdout:0/948: write dd/df/d19/d28/f4c [50291,93666] 0 2024-04-18T10:42:52.752 INFO:tasks.workunit.client.0.smithi040.stdout:0/949: readlink dd/df/d19/d28/d3a/d5b/dd0/df7/l136 0 2024-04-18T10:42:52.761 INFO:tasks.workunit.client.0.smithi040.stdout:9/910: creat d2/d5b/d6f/f143 x:0 0 0 2024-04-18T10:42:52.761 INFO:tasks.workunit.client.0.smithi040.stdout:0/950: creat dd/df/d19/d28/d3a/f14c x:0 0 0 2024-04-18T10:42:52.762 INFO:tasks.workunit.client.0.smithi040.stdout:6/909: rmdir df/d4b/d6e/d3f 39 2024-04-18T10:42:52.764 INFO:tasks.workunit.client.0.smithi040.stdout:9/911: readlink d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/l121 0 2024-04-18T10:42:52.765 INFO:tasks.workunit.client.0.smithi040.stdout:0/951: mkdir dd/df/d19/d28/d3a/d5b/d14d 0 2024-04-18T10:42:52.765 INFO:tasks.workunit.client.0.smithi040.stdout:7/842: dread d6/f1f [0,4194304] 0 2024-04-18T10:42:52.766 INFO:tasks.workunit.client.0.smithi040.stdout:6/910: truncate df/d76/d91/f9b 241977 0 2024-04-18T10:42:52.767 INFO:tasks.workunit.client.0.smithi040.stdout:0/952: stat dd/df/d19/d28/d3a/d42/fae 0 2024-04-18T10:42:52.767 INFO:tasks.workunit.client.0.smithi040.stdout:9/912: mknod d2/d5b/d6f/d80/ddd/c144 0 2024-04-18T10:42:52.767 INFO:tasks.workunit.client.0.smithi040.stdout:6/911: chown df/d76/d91/f109 444324163 1 2024-04-18T10:42:52.767 INFO:tasks.workunit.client.0.smithi040.stdout:7/843: dread - d6/d25/d28/dac/d64/d101/d5c/ff5 zero size 2024-04-18T10:42:52.769 INFO:tasks.workunit.client.0.smithi040.stdout:7/844: fsync d6/d25/dcf/de4/ff3 0 2024-04-18T10:42:52.772 INFO:tasks.workunit.client.0.smithi040.stdout:0/953: truncate dd/df/d19/d28/d3a/fa7 16360 0 2024-04-18T10:42:52.775 INFO:tasks.workunit.client.0.smithi040.stdout:0/954: dread - dd/df/d19/d3e/f102 zero size 2024-04-18T10:42:52.776 INFO:tasks.workunit.client.0.smithi040.stdout:2/838: dread dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d6b/f7e [0,4194304] 0 2024-04-18T10:42:52.778 INFO:tasks.workunit.client.0.smithi040.stdout:9/913: dwrite d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/fd7 [0,4194304] 0 2024-04-18T10:42:52.778 INFO:tasks.workunit.client.0.smithi040.stdout:5/857: sync 2024-04-18T10:42:52.778 INFO:tasks.workunit.client.0.smithi040.stdout:3/886: sync 2024-04-18T10:42:52.782 INFO:tasks.workunit.client.0.smithi040.stdout:9/914: write d2/f5 [1300547,28565] 0 2024-04-18T10:42:52.783 INFO:tasks.workunit.client.0.smithi040.stdout:3/887: write d1/d2/d4e/f84 [6097396,123713] 0 2024-04-18T10:42:52.784 INFO:tasks.workunit.client.0.smithi040.stdout:6/912: dread df/d4b/d6a/d93/f1b [0,4194304] 0 2024-04-18T10:42:52.785 INFO:tasks.workunit.client.0.smithi040.stdout:2/839: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/d72/f11a x:0 0 0 2024-04-18T10:42:52.789 INFO:tasks.workunit.client.0.smithi040.stdout:0/955: rename dd/df/d19/d28/d3a/lc2 to dd/df/d19/d28/d3a/d5b/dd0/l14e 0 2024-04-18T10:42:52.794 INFO:tasks.workunit.client.0.smithi040.stdout:3/888: dwrite d1/d2/d4e/f84 [0,4194304] 0 2024-04-18T10:42:52.797 INFO:tasks.workunit.client.0.smithi040.stdout:5/858: dwrite d0/d3/dba/de7/ff7 [0,4194304] 0 2024-04-18T10:42:52.797 INFO:tasks.workunit.client.0.smithi040.stdout:9/915: rename d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/f1a to d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/f145 0 2024-04-18T10:42:52.797 INFO:tasks.workunit.client.0.smithi040.stdout:7/845: dread d6/d25/f3a [0,4194304] 0 2024-04-18T10:42:52.801 INFO:tasks.workunit.client.0.smithi040.stdout:3/889: creat d1/d2/d4e/d58/d62/d6b/f124 x:0 0 0 2024-04-18T10:42:52.803 INFO:tasks.workunit.client.0.smithi040.stdout:2/840: rename dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/dce to dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/d11b 0 2024-04-18T10:42:52.804 INFO:tasks.workunit.client.0.smithi040.stdout:4/860: sync 2024-04-18T10:42:52.805 INFO:tasks.workunit.client.0.smithi040.stdout:1/869: sync 2024-04-18T10:42:52.805 INFO:tasks.workunit.client.0.smithi040.stdout:6/913: write df/fab [988062,111572] 0 2024-04-18T10:42:52.808 INFO:tasks.workunit.client.0.smithi040.stdout:0/956: write dd/df/d19/d28/d3a/fa7 [958216,54827] 0 2024-04-18T10:42:52.808 INFO:tasks.workunit.client.0.smithi040.stdout:9/916: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d117/f146 x:0 0 0 2024-04-18T10:42:52.811 INFO:tasks.workunit.client.0.smithi040.stdout:3/890: dwrite d1/d7/d3a/f50 [0,4194304] 0 2024-04-18T10:42:52.811 INFO:tasks.workunit.client.0.smithi040.stdout:5/859: rename d0/d3b/d3f/l97 to d0/d21/l11a 0 2024-04-18T10:42:52.812 INFO:tasks.workunit.client.0.smithi040.stdout:2/841: getdents dd/d61/d81/dfb/d2b/d7c/d37/d38/d8c/dd5/dfa 0 2024-04-18T10:42:52.814 INFO:tasks.workunit.client.0.smithi040.stdout:1/870: creat d1/d1c/d7b/f12d x:0 0 0 2024-04-18T10:42:52.816 INFO:tasks.workunit.client.0.smithi040.stdout:5/860: fdatasync d0/d78/d95/f53 0 2024-04-18T10:42:52.817 INFO:tasks.workunit.client.0.smithi040.stdout:6/914: link df/d4b/d6e/f32 df/d76/dc2/dce/f14d 0 2024-04-18T10:42:52.817 INFO:tasks.workunit.client.0.smithi040.stdout:9/917: chown d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46 136 1 2024-04-18T10:42:52.819 INFO:tasks.workunit.client.0.smithi040.stdout:3/891: chown d1/d7/d67/d123/fe2 147 1 2024-04-18T10:42:52.821 INFO:tasks.workunit.client.0.smithi040.stdout:2/842: stat dd/d61/d81/dfb/d2b/d7c/d37/d38/d8c/ff3 0 2024-04-18T10:42:52.821 INFO:tasks.workunit.client.0.smithi040.stdout:6/915: chown df/d4b/d63/f7c 4072 1 2024-04-18T10:42:52.822 INFO:tasks.workunit.client.0.smithi040.stdout:1/871: write d1/d1c/d2b/d32/d36/fae [4106821,80276] 0 2024-04-18T10:42:52.824 INFO:tasks.workunit.client.0.smithi040.stdout:5/861: creat d0/d78/d95/db7/d114/f11b x:0 0 0 2024-04-18T10:42:52.825 INFO:tasks.workunit.client.0.smithi040.stdout:3/892: chown d1/d2/d3c/cd2 28715077 1 2024-04-18T10:42:52.826 INFO:tasks.workunit.client.0.smithi040.stdout:2/843: fdatasync dd/d61/d81/fc7 0 2024-04-18T10:42:52.826 INFO:tasks.workunit.client.0.smithi040.stdout:4/861: dwrite d2/d3/d4/dd/d4f/fe2 [0,4194304] 0 2024-04-18T10:42:52.828 INFO:tasks.workunit.client.0.smithi040.stdout:0/957: dwrite dd/df/d19/f87 [0,4194304] 0 2024-04-18T10:42:52.829 INFO:tasks.workunit.client.0.smithi040.stdout:6/916: creat df/d4b/d99/dc4/f14e x:0 0 0 2024-04-18T10:42:52.829 INFO:tasks.workunit.client.0.smithi040.stdout:1/872: chown d1/d1c/d2b/d32/ldc 16208 1 2024-04-18T10:42:52.831 INFO:tasks.workunit.client.0.smithi040.stdout:5/862: chown d0/d3/d47/d106/d115/ca8 2284362 1 2024-04-18T10:42:52.831 INFO:tasks.workunit.client.0.smithi040.stdout:7/846: dread d6/f14 [0,4194304] 0 2024-04-18T10:42:52.832 INFO:tasks.workunit.client.0.smithi040.stdout:3/893: creat d1/d2/d4e/d58/dc4/df8/f125 x:0 0 0 2024-04-18T10:42:52.835 INFO:tasks.workunit.client.0.smithi040.stdout:4/862: creat d2/d3/d41/d62/ff9 x:0 0 0 2024-04-18T10:42:52.835 INFO:tasks.workunit.client.0.smithi040.stdout:7/847: chown d6/d25/d28/dac/d63 9 1 2024-04-18T10:42:52.835 INFO:tasks.workunit.client.0.smithi040.stdout:3/894: dread - d1/d7/db2/ff6 zero size 2024-04-18T10:42:52.836 INFO:tasks.workunit.client.0.smithi040.stdout:8/948: sync 2024-04-18T10:42:52.839 INFO:tasks.workunit.client.0.smithi040.stdout:6/917: symlink df/d4b/d6e/d3f/d53/d8a/l14f 0 2024-04-18T10:42:52.843 INFO:tasks.workunit.client.0.smithi040.stdout:1/873: truncate d1/d1c/d2b/d32/d7e/fc1 1296634 0 2024-04-18T10:42:52.847 INFO:tasks.workunit.client.0.smithi040.stdout:8/949: creat d2/d5/d9/df7/f13b x:0 0 0 2024-04-18T10:42:52.847 INFO:tasks.workunit.client.0.smithi040.stdout:9/918: write d2/dd/de/f6c [776621,95335] 0 2024-04-18T10:42:52.848 INFO:tasks.workunit.client.0.smithi040.stdout:8/950: fsync d2/d22/f38 0 2024-04-18T10:42:52.849 INFO:tasks.workunit.client.0.smithi040.stdout:6/918: rmdir df/d4b/d99/dc4/d10c 39 2024-04-18T10:42:52.850 INFO:tasks.workunit.client.0.smithi040.stdout:9/919: chown d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d117 27 1 2024-04-18T10:42:52.852 INFO:tasks.workunit.client.0.smithi040.stdout:0/958: link dd/df/d19/d28/f12e dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3/d103/f14f 0 2024-04-18T10:42:52.854 INFO:tasks.workunit.client.0.smithi040.stdout:1/874: rmdir d1/d1c/d7b/d2e/d9e 39 2024-04-18T10:42:52.855 INFO:tasks.workunit.client.0.smithi040.stdout:1/875: chown d1/d1c/d2b/l68 0 1 2024-04-18T10:42:52.856 INFO:tasks.workunit.client.0.smithi040.stdout:0/959: dread dd/df/d19/f87 [0,4194304] 0 2024-04-18T10:42:52.856 INFO:tasks.workunit.client.0.smithi040.stdout:2/844: write dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/f89 [927248,52074] 0 2024-04-18T10:42:52.858 INFO:tasks.workunit.client.0.smithi040.stdout:2/845: stat dd/c9f 0 2024-04-18T10:42:52.858 INFO:tasks.workunit.client.0.smithi040.stdout:4/863: truncate d2/d3/f59 3852331 0 2024-04-18T10:42:52.861 INFO:tasks.workunit.client.0.smithi040.stdout:6/919: creat df/d4b/d63/f150 x:0 0 0 2024-04-18T10:42:52.864 INFO:tasks.workunit.client.0.smithi040.stdout:4/864: dwrite d2/d3/d4/d1f/d29/d49/d31/fa8 [0,4194304] 0 2024-04-18T10:42:52.866 INFO:tasks.workunit.client.0.smithi040.stdout:9/920: rmdir d2/d5b/d6f 39 2024-04-18T10:42:52.866 INFO:tasks.workunit.client.0.smithi040.stdout:5/863: link d0/d78/d95/db7/fe4 d0/d3b/d88/ded/f11c 0 2024-04-18T10:42:52.868 INFO:tasks.workunit.client.0.smithi040.stdout:8/951: dread d2/d5/d9/d3c/d5a/fc5 [0,4194304] 0 2024-04-18T10:42:52.868 INFO:tasks.workunit.client.0.smithi040.stdout:3/895: write d1/d7/d12/f30 [1205727,59089] 0 2024-04-18T10:42:52.869 INFO:tasks.workunit.client.0.smithi040.stdout:7/848: fsync d6/d25/d28/dac/d64/d101/d5c/d6b/fdd 0 2024-04-18T10:42:52.878 INFO:tasks.workunit.client.0.smithi040.stdout:1/876: mknod d1/d9b/d75/d84/dac/dda/de0/c12e 0 2024-04-18T10:42:52.878 INFO:tasks.workunit.client.0.smithi040.stdout:0/960: mkdir dd/df/d19/d28/d3a/d5b/d150 0 2024-04-18T10:42:52.879 INFO:tasks.workunit.client.0.smithi040.stdout:2/846: unlink dd/d61/d81/dfb/l34 0 2024-04-18T10:42:52.879 INFO:tasks.workunit.client.0.smithi040.stdout:0/961: chown dd 107414658 1 2024-04-18T10:42:52.880 INFO:tasks.workunit.client.0.smithi040.stdout:8/952: creat d2/d15/d2b/d40/f13c x:0 0 0 2024-04-18T10:42:52.881 INFO:tasks.workunit.client.0.smithi040.stdout:3/896: creat d1/d2/d3c/f126 x:0 0 0 2024-04-18T10:42:52.883 INFO:tasks.workunit.client.0.smithi040.stdout:9/921: dread d2/d5b/d6f/d80/f8b [0,4194304] 0 2024-04-18T10:42:52.885 INFO:tasks.workunit.client.0.smithi040.stdout:9/922: dread - d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d86/f128 zero size 2024-04-18T10:42:52.887 INFO:tasks.workunit.client.0.smithi040.stdout:2/847: mknod dd/d61/d81/dfb/d2b/d7c/c11c 0 2024-04-18T10:42:52.888 INFO:tasks.workunit.client.0.smithi040.stdout:8/953: mkdir d2/d4c/dd2/d13d 0 2024-04-18T10:42:52.892 INFO:tasks.workunit.client.0.smithi040.stdout:8/954: truncate d2/d15/d2b/f7f 886736 0 2024-04-18T10:42:52.892 INFO:tasks.workunit.client.0.smithi040.stdout:9/923: mkdir d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/d147 0 2024-04-18T10:42:52.893 INFO:tasks.workunit.client.0.smithi040.stdout:5/864: dwrite d0/d3b/d67/fda [0,4194304] 0 2024-04-18T10:42:52.895 INFO:tasks.workunit.client.0.smithi040.stdout:4/865: dread d2/d3/d4/d1f/d29/f64 [0,4194304] 0 2024-04-18T10:42:52.895 INFO:tasks.workunit.client.0.smithi040.stdout:7/849: link d6/d50/d79/da8/lc6 d6/dc1/l102 0 2024-04-18T10:42:52.897 INFO:tasks.workunit.client.0.smithi040.stdout:2/848: chown dd/d61/d81/dfb/d2b/d7c/d37/f79 1698 1 2024-04-18T10:42:52.897 INFO:tasks.workunit.client.0.smithi040.stdout:8/955: creat d2/d5/d9/f13e x:0 0 0 2024-04-18T10:42:52.899 INFO:tasks.workunit.client.0.smithi040.stdout:3/897: getdents d1/d7/d67/d123/d9b 0 2024-04-18T10:42:52.902 INFO:tasks.workunit.client.0.smithi040.stdout:0/962: dread dd/df/d19/f22 [0,4194304] 0 2024-04-18T10:42:52.902 INFO:tasks.workunit.client.0.smithi040.stdout:2/849: write dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/d11b/fd8 [732237,93178] 0 2024-04-18T10:42:52.903 INFO:tasks.workunit.client.0.smithi040.stdout:4/866: unlink d2/d3/d41/d62/d9a/lf1 0 2024-04-18T10:42:52.904 INFO:tasks.workunit.client.0.smithi040.stdout:1/877: truncate d1/f4 3812015 0 2024-04-18T10:42:52.905 INFO:tasks.workunit.client.0.smithi040.stdout:8/956: dread d2/d22/d49/f9a [0,4194304] 0 2024-04-18T10:42:52.906 INFO:tasks.workunit.client.0.smithi040.stdout:5/865: rename d0/d78/d95/f53 to d0/d3b/d3f/db1/df2/f11d 0 2024-04-18T10:42:52.906 INFO:tasks.workunit.client.0.smithi040.stdout:0/963: write dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3/ff0 [36798,35504] 0 2024-04-18T10:42:52.906 INFO:tasks.workunit.client.0.smithi040.stdout:1/878: write d1/f69 [735914,117891] 0 2024-04-18T10:42:52.907 INFO:tasks.workunit.client.0.smithi040.stdout:7/850: creat d6/dc1/df8/f103 x:0 0 0 2024-04-18T10:42:52.908 INFO:tasks.workunit.client.0.smithi040.stdout:3/898: fdatasync d1/d2/d4e/d58/d62/faa 0 2024-04-18T10:42:52.913 INFO:tasks.workunit.client.0.smithi040.stdout:7/851: truncate d6/d25/d28/dac/de9/ff0 913196 0 2024-04-18T10:42:52.913 INFO:tasks.workunit.client.0.smithi040.stdout:8/957: readlink d2/d5/d9/d1b/l2e 0 2024-04-18T10:42:52.914 INFO:tasks.workunit.client.0.smithi040.stdout:5/866: chown d0/d78/lfe 105471 1 2024-04-18T10:42:52.915 INFO:tasks.workunit.client.0.smithi040.stdout:4/867: dwrite d2/d3/d4/d1f/d29/d49/d31/f61 [4194304,4194304] 0 2024-04-18T10:42:52.916 INFO:tasks.workunit.client.0.smithi040.stdout:9/924: getdents d2/d5b/d13a/d85/ded/d125 0 2024-04-18T10:42:52.916 INFO:tasks.workunit.client.0.smithi040.stdout:1/879: chown d1/c8 821658 1 2024-04-18T10:42:52.919 INFO:tasks.workunit.client.0.smithi040.stdout:3/899: creat d1/d7/d67/dc5/d3b/f127 x:0 0 0 2024-04-18T10:42:52.922 INFO:tasks.workunit.client.0.smithi040.stdout:2/850: dwrite dd/d61/d81/dfb/d2b/d7c/d37/fd1 [0,4194304] 0 2024-04-18T10:42:52.923 INFO:tasks.workunit.client.0.smithi040.stdout:8/958: rename d2/d15/d78/d10b/f132 to d2/d4c/d97/f13f 0 2024-04-18T10:42:52.925 INFO:tasks.workunit.client.0.smithi040.stdout:9/925: mknod d2/d5b/d6f/d80/d75/d124/d97/c148 0 2024-04-18T10:42:52.928 INFO:tasks.workunit.client.0.smithi040.stdout:7/852: getdents d6/d25/d28/dac/de9 0 2024-04-18T10:42:52.928 INFO:tasks.workunit.client.0.smithi040.stdout:9/926: chown d2/dd/cd9 50296 1 2024-04-18T10:42:52.930 INFO:tasks.workunit.client.0.smithi040.stdout:4/868: link d2/d3/d4/d1f/d29/f64 d2/d3/d41/d62/db0/ffa 0 2024-04-18T10:42:52.932 INFO:tasks.workunit.client.0.smithi040.stdout:8/959: mkdir d2/d5/d9/d1b/d140 0 2024-04-18T10:42:52.933 INFO:tasks.workunit.client.0.smithi040.stdout:2/851: symlink dd/d61/d8e/l11d 0 2024-04-18T10:42:52.933 INFO:tasks.workunit.client.0.smithi040.stdout:0/964: dwrite dd/df/d19/d28/d3a/d5b/fa6 [0,4194304] 0 2024-04-18T10:42:52.934 INFO:tasks.workunit.client.0.smithi040.stdout:5/867: dwrite d0/f19 [4194304,4194304] 0 2024-04-18T10:42:52.936 INFO:tasks.workunit.client.0.smithi040.stdout:3/900: rename d1/d7/db2/dc0/fee to d1/d2/d4e/d58/dbe/dc1/dc2/dea/f128 0 2024-04-18T10:42:52.938 INFO:tasks.workunit.client.0.smithi040.stdout:8/960: chown d2/d4c/d97/f10d 0 1 2024-04-18T10:42:52.939 INFO:tasks.workunit.client.0.smithi040.stdout:5/868: read - d0/d78/d95/fdf zero size 2024-04-18T10:42:52.942 INFO:tasks.workunit.client.0.smithi040.stdout:1/880: dwrite d1/d9b/d75/d84/dac/dda/de0/ffa [0,4194304] 0 2024-04-18T10:42:52.943 INFO:tasks.workunit.client.0.smithi040.stdout:2/852: mkdir dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/d11e 0 2024-04-18T10:42:52.944 INFO:tasks.workunit.client.0.smithi040.stdout:1/881: write d1/d16/d92/dad/f100 [251409,89253] 0 2024-04-18T10:42:52.945 INFO:tasks.workunit.client.0.smithi040.stdout:4/869: symlink d2/d3/d4/lfb 0 2024-04-18T10:42:52.948 INFO:tasks.workunit.client.0.smithi040.stdout:9/927: rename d2/d5b/d13a/d85/ded/d125/d8d/fd3 to d2/d5b/d13a/d85/ded/d125/f149 0 2024-04-18T10:42:52.948 INFO:tasks.workunit.client.0.smithi040.stdout:8/961: dread d2/d5/d9/d63/f64 [0,4194304] 0 2024-04-18T10:42:52.949 INFO:tasks.workunit.client.0.smithi040.stdout:9/928: readlink d2/d5b/d6f/d80/d75/d124/d97/lb8 0 2024-04-18T10:42:52.951 INFO:tasks.workunit.client.0.smithi040.stdout:0/965: write dd/df/d19/d28/d3a/d46/d107/d11c/d130/fa4 [798106,38460] 0 2024-04-18T10:42:52.956 INFO:tasks.workunit.client.0.smithi040.stdout:4/870: creat d2/d3/d4/d1f/d29/ffc x:0 0 0 2024-04-18T10:42:52.957 INFO:tasks.workunit.client.0.smithi040.stdout:5/869: mknod d0/d21/c11e 0 2024-04-18T10:42:52.959 INFO:tasks.workunit.client.0.smithi040.stdout:0/966: dwrite dd/df/d19/d28/d3a/d46/d107/f116 [0,4194304] 0 2024-04-18T10:42:52.959 INFO:tasks.workunit.client.0.smithi040.stdout:3/901: mkdir d1/d2/d4e/d58/dc4/df8/d11f/d129 0 2024-04-18T10:42:52.961 INFO:tasks.workunit.client.0.smithi040.stdout:2/853: dwrite dd/d61/d81/dfb/fa9 [0,4194304] 0 2024-04-18T10:42:52.961 INFO:tasks.workunit.client.0.smithi040.stdout:6/920: sync 2024-04-18T10:42:52.963 INFO:tasks.workunit.client.0.smithi040.stdout:1/882: link d1/d1c/d7b/f112 d1/d1c/d2b/d32/f12f 0 2024-04-18T10:42:52.965 INFO:tasks.workunit.client.0.smithi040.stdout:8/962: mknod d2/d4c/df4/c141 0 2024-04-18T10:42:52.965 INFO:tasks.workunit.client.0.smithi040.stdout:4/871: mkdir d2/d3/d4/d1f/d29/dfd 0 2024-04-18T10:42:52.968 INFO:tasks.workunit.client.0.smithi040.stdout:5/870: dwrite d0/d3/fe2 [4194304,4194304] 0 2024-04-18T10:42:52.970 INFO:tasks.workunit.client.0.smithi040.stdout:6/921: symlink df/d4b/d63/db3/l151 0 2024-04-18T10:42:52.981 INFO:tasks.workunit.client.0.smithi040.stdout:2/854: creat dd/d61/d8e/d98/dcc/dd4/f11f x:0 0 0 2024-04-18T10:42:52.982 INFO:tasks.workunit.client.0.smithi040.stdout:1/883: mknod d1/d9b/d75/d84/c130 0 2024-04-18T10:42:52.984 INFO:tasks.workunit.client.0.smithi040.stdout:7/853: dwrite d6/d25/d28/dac/d64/d101/d5c/d6b/fdd [0,4194304] 0 2024-04-18T10:42:52.984 INFO:tasks.workunit.client.0.smithi040.stdout:4/872: rename d2/d3/d4/dd/d4f/fc5 to d2/d3/d4/dd/d4f/ffe 0 2024-04-18T10:42:52.985 INFO:tasks.workunit.client.0.smithi040.stdout:5/871: rmdir d0/d3b/d3f/de9 39 2024-04-18T10:42:52.985 INFO:tasks.workunit.client.0.smithi040.stdout:6/922: symlink df/d4b/d6a/d93/l152 0 2024-04-18T10:42:52.986 INFO:tasks.workunit.client.0.smithi040.stdout:9/929: getdents d2/d5b/d13a/d85/ded/d125 0 2024-04-18T10:42:52.986 INFO:tasks.workunit.client.0.smithi040.stdout:3/902: rename d1/d7/c4c to d1/d7/d12/c12a 0 2024-04-18T10:42:52.987 INFO:tasks.workunit.client.0.smithi040.stdout:1/884: mknod d1/d1c/d7b/d2d/c131 0 2024-04-18T10:42:52.989 INFO:tasks.workunit.client.0.smithi040.stdout:5/872: write d0/d3/fa4 [5250826,56833] 0 2024-04-18T10:42:52.989 INFO:tasks.workunit.client.0.smithi040.stdout:2/855: readlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/d72/le5 0 2024-04-18T10:42:52.991 INFO:tasks.workunit.client.0.smithi040.stdout:5/873: fsync d0/d3/d6b/d7b/f85 0 2024-04-18T10:42:52.991 INFO:tasks.workunit.client.0.smithi040.stdout:1/885: write d1/d1c/d7b/d2e/d3e/fde [424661,50371] 0 2024-04-18T10:42:52.992 INFO:tasks.workunit.client.0.smithi040.stdout:4/873: rmdir d2/d3/d4/dd/d4f 39 2024-04-18T10:42:52.995 INFO:tasks.workunit.client.0.smithi040.stdout:3/903: mknod d1/d2/d4e/d57/c12b 0 2024-04-18T10:42:52.997 INFO:tasks.workunit.client.0.smithi040.stdout:7/854: dwrite d6/d25/d28/dac/d64/d101/d5c/d6b/fdd [0,4194304] 0 2024-04-18T10:42:53.001 INFO:tasks.workunit.client.0.smithi040.stdout:3/904: rmdir d1/d2/d4e/d58/dbe/dc1 39 2024-04-18T10:42:53.003 INFO:tasks.workunit.client.0.smithi040.stdout:1/886: rename d1/d1c/d7b/d2e/d3e/d85/fd2 to d1/d9b/d75/d84/dac/dda/de0/f132 0 2024-04-18T10:42:53.004 INFO:tasks.workunit.client.0.smithi040.stdout:4/874: dwrite d2/d3/d41/d47/d6f/f8a [0,4194304] 0 2024-04-18T10:42:53.004 INFO:tasks.workunit.client.0.smithi040.stdout:7/855: fdatasync d6/f14 0 2024-04-18T10:42:53.008 INFO:tasks.workunit.client.0.smithi040.stdout:4/875: write d2/d3/d41/d62/ff9 [635935,109299] 0 2024-04-18T10:42:53.010 INFO:tasks.workunit.client.0.smithi040.stdout:2/856: dwrite dd/d61/d81/dfb/d2b/d7c/d37/da3/f10a [0,4194304] 0 2024-04-18T10:42:53.011 INFO:tasks.workunit.client.0.smithi040.stdout:6/923: rmdir df/d4b/d6a/d93 39 2024-04-18T10:42:53.014 INFO:tasks.workunit.client.0.smithi040.stdout:0/967: dwrite dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3/d103/f14f [0,4194304] 0 2024-04-18T10:42:53.017 INFO:tasks.workunit.client.0.smithi040.stdout:9/930: getdents d2/d5b/d13a/d85 0 2024-04-18T10:42:53.020 INFO:tasks.workunit.client.0.smithi040.stdout:3/905: rename d1/d7/d12/l68 to d1/d7/d12/d7b/l12c 0 2024-04-18T10:42:53.021 INFO:tasks.workunit.client.0.smithi040.stdout:3/906: truncate d1/d7/d28/db7/dfa/f111 886785 0 2024-04-18T10:42:53.022 INFO:tasks.workunit.client.0.smithi040.stdout:6/924: unlink df/d4b/d63/f7c 0 2024-04-18T10:42:53.023 INFO:tasks.workunit.client.0.smithi040.stdout:6/925: write df/d4b/d6e/d3f/f75 [530037,10199] 0 2024-04-18T10:42:53.024 INFO:tasks.workunit.client.0.smithi040.stdout:7/856: mknod d6/d25/d28/c104 0 2024-04-18T10:42:53.026 INFO:tasks.workunit.client.0.smithi040.stdout:4/876: mkdir d2/d3/d4/d23/dea/d28/de1/dff 0 2024-04-18T10:42:53.029 INFO:tasks.workunit.client.0.smithi040.stdout:3/907: dwrite d1/d2/d4e/d58/d62/fb8 [0,4194304] 0 2024-04-18T10:42:53.029 INFO:tasks.workunit.client.0.smithi040.stdout:9/931: mknod d2/d5b/c14a 0 2024-04-18T10:42:53.034 INFO:tasks.workunit.client.0.smithi040.stdout:5/874: dwrite d0/d78/d95/db7/fe4 [4194304,4194304] 0 2024-04-18T10:42:53.035 INFO:tasks.workunit.client.0.smithi040.stdout:5/875: read - d0/d3b/d67/dc7/fd4 zero size 2024-04-18T10:42:53.038 INFO:tasks.workunit.client.0.smithi040.stdout:7/857: dread d6/d25/d28/dac/d63/f86 [0,4194304] 0 2024-04-18T10:42:53.039 INFO:tasks.workunit.client.0.smithi040.stdout:2/857: link dd/d61/d8e/d98/lbd dd/d61/d81/dfb/d2b/d7c/d37/d5b/dcf/l120 0 2024-04-18T10:42:53.040 INFO:tasks.workunit.client.0.smithi040.stdout:2/858: stat dd/d61/d81/dfb/d2b/d7c/d37/d5b/dcf/cbb 0 2024-04-18T10:42:53.040 INFO:tasks.workunit.client.0.smithi040.stdout:9/932: mknod d2/d5b/d6f/d80/d75/d124/d97/c14b 0 2024-04-18T10:42:53.041 INFO:tasks.workunit.client.0.smithi040.stdout:2/859: chown dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d6b/f104 0 1 2024-04-18T10:42:53.041 INFO:tasks.workunit.client.0.smithi040.stdout:2/860: stat dd/f45 0 2024-04-18T10:42:53.045 INFO:tasks.workunit.client.0.smithi040.stdout:7/858: creat d6/d50/d79/da8/dad/f105 x:0 0 0 2024-04-18T10:42:53.045 INFO:tasks.workunit.client.0.smithi040.stdout:1/887: write d1/d9b/f9c [511034,104023] 0 2024-04-18T10:42:53.046 INFO:tasks.workunit.client.0.smithi040.stdout:9/933: creat d2/dd/de/f14c x:0 0 0 2024-04-18T10:42:53.046 INFO:tasks.workunit.client.0.smithi040.stdout:1/888: stat d1/d1c/d2b/d32/f4e 0 2024-04-18T10:42:53.046 INFO:tasks.workunit.client.0.smithi040.stdout:6/926: link df/d4b/d6a/d93/l5d df/d121/l153 0 2024-04-18T10:42:53.047 INFO:tasks.workunit.client.0.smithi040.stdout:9/934: chown d2/dd/de/lf 0 1 2024-04-18T10:42:53.048 INFO:tasks.workunit.client.0.smithi040.stdout:4/877: getdents d2/d3/d4 0 2024-04-18T10:42:53.049 INFO:tasks.workunit.client.0.smithi040.stdout:2/861: rmdir dd/d61/d81/dfb/d2b/dbc/d5f 39 2024-04-18T10:42:53.051 INFO:tasks.workunit.client.0.smithi040.stdout:5/876: mkdir d0/d3/d47/d106/d115/d11f 0 2024-04-18T10:42:53.051 INFO:tasks.workunit.client.0.smithi040.stdout:5/877: chown d0/cd9 105459695 1 2024-04-18T10:42:53.052 INFO:tasks.workunit.client.0.smithi040.stdout:7/859: mkdir d6/d25/d28/dac/d64/d7e/d106 0 2024-04-18T10:42:53.053 INFO:tasks.workunit.client.0.smithi040.stdout:1/889: write d1/d1c/d7b/d2d/f63 [777218,96674] 0 2024-04-18T10:42:53.057 INFO:tasks.workunit.client.0.smithi040.stdout:2/862: stat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d49/f96 0 2024-04-18T10:42:53.057 INFO:tasks.workunit.client.0.smithi040.stdout:9/935: mkdir d2/d5b/d6f/d80/d75/d124/d14d 0 2024-04-18T10:42:53.057 INFO:tasks.workunit.client.0.smithi040.stdout:1/890: dread - d1/d9b/d75/d84/dac/f127 zero size 2024-04-18T10:42:53.057 INFO:tasks.workunit.client.0.smithi040.stdout:4/878: mkdir d2/d3/d4/dd/d100 0 2024-04-18T10:42:53.057 INFO:tasks.workunit.client.0.smithi040.stdout:2/863: stat dd/f45 0 2024-04-18T10:42:53.058 INFO:tasks.workunit.client.0.smithi040.stdout:5/878: symlink d0/d3b/l120 0 2024-04-18T10:42:53.059 INFO:tasks.workunit.client.0.smithi040.stdout:6/927: dread df/d4b/d6e/d3f/d53/fc0 [0,4194304] 0 2024-04-18T10:42:53.060 INFO:tasks.workunit.client.0.smithi040.stdout:1/891: chown d1/d1c/d7b/d2e/ld1 18673 1 2024-04-18T10:42:53.063 INFO:tasks.workunit.client.0.smithi040.stdout:6/928: write df/f67 [551917,57287] 0 2024-04-18T10:42:53.064 INFO:tasks.workunit.client.0.smithi040.stdout:4/879: symlink d2/d3/d4/dd/d6d/d70/db2/l101 0 2024-04-18T10:42:53.066 INFO:tasks.workunit.client.0.smithi040.stdout:9/936: rename d2/d5b/d6f/d80/d75/d124/l47 to d2/d5b/d13a/d85/ded/d125/d8d/d10c/l14e 0 2024-04-18T10:42:53.068 INFO:tasks.workunit.client.0.smithi040.stdout:5/879: getdents d0/d3/dba 0 2024-04-18T10:42:53.070 INFO:tasks.workunit.client.0.smithi040.stdout:8/963: sync 2024-04-18T10:42:53.071 INFO:tasks.workunit.client.0.smithi040.stdout:3/908: dread d1/d7/d67/d123/d9b/f11a [0,4194304] 0 2024-04-18T10:42:53.072 INFO:tasks.workunit.client.0.smithi040.stdout:6/929: fsync df/d4b/d99/dc4/d10c/f119 0 2024-04-18T10:42:53.073 INFO:tasks.workunit.client.0.smithi040.stdout:5/880: write d0/d4e/dc2/fcb [2392898,33659] 0 2024-04-18T10:42:53.074 INFO:tasks.workunit.client.0.smithi040.stdout:1/892: dwrite d1/d9b/d75/fff [0,4194304] 0 2024-04-18T10:42:53.075 INFO:tasks.workunit.client.0.smithi040.stdout:8/964: chown d2/d22/d80/fba 5 1 2024-04-18T10:42:53.075 INFO:tasks.workunit.client.0.smithi040.stdout:7/860: dread d6/d25/f4a [0,4194304] 0 2024-04-18T10:42:53.077 INFO:tasks.workunit.client.0.smithi040.stdout:2/864: getdents dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/d11b 0 2024-04-18T10:42:53.078 INFO:tasks.workunit.client.0.smithi040.stdout:9/937: mkdir d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d14f 0 2024-04-18T10:42:53.079 INFO:tasks.workunit.client.0.smithi040.stdout:5/881: chown d0/d3b/d88/f10a 94421066 1 2024-04-18T10:42:53.079 INFO:tasks.workunit.client.0.smithi040.stdout:7/861: fsync d6/d25/dcf/de4/d3c/f51 0 2024-04-18T10:42:53.080 INFO:tasks.workunit.client.0.smithi040.stdout:3/909: creat d1/d7/d67/dc5/d91/f12d x:0 0 0 2024-04-18T10:42:53.081 INFO:tasks.workunit.client.0.smithi040.stdout:9/938: write d2/d5b/d13a/fa9 [3159963,90535] 0 2024-04-18T10:42:53.081 INFO:tasks.workunit.client.0.smithi040.stdout:3/910: readlink d1/lf 0 2024-04-18T10:42:53.086 INFO:tasks.workunit.client.0.smithi040.stdout:4/880: dread d2/d3/d41/d62/d7c/f84 [0,4194304] 0 2024-04-18T10:42:53.086 INFO:tasks.workunit.client.0.smithi040.stdout:1/893: dwrite d1/d1c/d7b/d2e/fd0 [0,4194304] 0 2024-04-18T10:42:53.088 INFO:tasks.workunit.client.0.smithi040.stdout:5/882: rmdir d0/d3b/d3f 39 2024-04-18T10:42:53.091 INFO:tasks.workunit.client.0.smithi040.stdout:3/911: symlink d1/d7/d28/d81/l12e 0 2024-04-18T10:42:53.094 INFO:tasks.workunit.client.0.smithi040.stdout:8/965: rename d2/d5 to d2/d10/d142 0 2024-04-18T10:42:53.095 INFO:tasks.workunit.client.0.smithi040.stdout:5/883: dwrite d0/d21/ffb [0,4194304] 0 2024-04-18T10:42:53.095 INFO:tasks.workunit.client.0.smithi040.stdout:8/966: stat d2/d22/d49/cc9 0 2024-04-18T10:42:53.096 INFO:tasks.workunit.client.0.smithi040.stdout:9/939: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/f150 x:0 0 0 2024-04-18T10:42:53.097 INFO:tasks.workunit.client.0.smithi040.stdout:0/968: sync 2024-04-18T10:42:53.098 INFO:tasks.workunit.client.0.smithi040.stdout:0/969: chown dd/f2e 13671893 1 2024-04-18T10:42:53.098 INFO:tasks.workunit.client.0.smithi040.stdout:4/881: symlink d2/d3/d4/d23/dea/da4/l102 0 2024-04-18T10:42:53.099 INFO:tasks.workunit.client.0.smithi040.stdout:2/865: getdents dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/d11b/d110 0 2024-04-18T10:42:53.099 INFO:tasks.workunit.client.0.smithi040.stdout:6/930: truncate df/d121/f144 3261873 0 2024-04-18T10:42:53.103 INFO:tasks.workunit.client.0.smithi040.stdout:2/866: write dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d49/f96 [698373,19340] 0 2024-04-18T10:42:53.103 INFO:tasks.workunit.client.0.smithi040.stdout:5/884: unlink d0/cd9 0 2024-04-18T10:42:53.105 INFO:tasks.workunit.client.0.smithi040.stdout:8/967: symlink d2/d2c/dbf/dc2/d12a/l143 0 2024-04-18T10:42:53.106 INFO:tasks.workunit.client.0.smithi040.stdout:7/862: dwrite d6/d25/d28/dac/d64/d101/d55/fe3 [0,4194304] 0 2024-04-18T10:42:53.106 INFO:tasks.workunit.client.0.smithi040.stdout:9/940: mkdir d2/d5b/d6f/d80/d75/d124/d70/d151 0 2024-04-18T10:42:53.108 INFO:tasks.workunit.client.0.smithi040.stdout:0/970: rename dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3/d103 to dd/da3/d122/d151 0 2024-04-18T10:42:53.109 INFO:tasks.workunit.client.0.smithi040.stdout:3/912: creat d1/d2/d4e/d58/dbe/dc1/dc2/dea/f12f x:0 0 0 2024-04-18T10:42:53.112 INFO:tasks.workunit.client.0.smithi040.stdout:1/894: creat d1/d1c/d7b/d2e/f133 x:0 0 0 2024-04-18T10:42:53.114 INFO:tasks.workunit.client.0.smithi040.stdout:7/863: dread d6/d25/d28/dac/d64/d101/d5c/da2/db6/fd9 [0,4194304] 0 2024-04-18T10:42:53.114 INFO:tasks.workunit.client.0.smithi040.stdout:8/968: unlink d2/d10/d142/d9/d63/c72 0 2024-04-18T10:42:53.115 INFO:tasks.workunit.client.0.smithi040.stdout:1/895: chown d1/d1c/d2b/db5/dd6 810216 1 2024-04-18T10:42:53.117 INFO:tasks.workunit.client.0.smithi040.stdout:9/941: creat d2/d5b/d6f/f152 x:0 0 0 2024-04-18T10:42:53.118 INFO:tasks.workunit.client.0.smithi040.stdout:3/913: dread d1/d2/f17 [0,4194304] 0 2024-04-18T10:42:53.120 INFO:tasks.workunit.client.0.smithi040.stdout:5/885: dwrite d0/d3/d6b/d7b/fa9 [0,4194304] 0 2024-04-18T10:42:53.121 INFO:tasks.workunit.client.0.smithi040.stdout:9/942: chown d2/d5b/d13a/d85/ff2 396 1 2024-04-18T10:42:53.125 INFO:tasks.workunit.client.0.smithi040.stdout:7/864: mknod d6/dc1/df8/c107 0 2024-04-18T10:42:53.128 INFO:tasks.workunit.client.0.smithi040.stdout:8/969: symlink d2/d2c/dbf/dc2/l144 0 2024-04-18T10:42:53.131 INFO:tasks.workunit.client.0.smithi040.stdout:1/896: fdatasync d1/d1c/d7b/d2e/d3e/d85/fca 0 2024-04-18T10:42:53.133 INFO:tasks.workunit.client.0.smithi040.stdout:6/931: rename df/d4b/d6a/d93/ccf to df/d4b/d6e/d3f/d12e/c154 0 2024-04-18T10:42:53.134 INFO:tasks.workunit.client.0.smithi040.stdout:6/932: chown df/d4b/d99/dc4/d10c 15046428 1 2024-04-18T10:42:53.135 INFO:tasks.workunit.client.0.smithi040.stdout:4/882: dread d2/d3/d4/d1f/d29/d49/f42 [0,4194304] 0 2024-04-18T10:42:53.141 INFO:tasks.workunit.client.0.smithi040.stdout:3/914: symlink d1/d7/d67/dc5/l130 0 2024-04-18T10:42:53.142 INFO:tasks.workunit.client.0.smithi040.stdout:8/970: rename d2/l45 to d2/d10/d142/d9/d63/l145 0 2024-04-18T10:42:53.143 INFO:tasks.workunit.client.0.smithi040.stdout:5/886: mknod d0/d78/d95/c121 0 2024-04-18T10:42:53.143 INFO:tasks.workunit.client.0.smithi040.stdout:3/915: read d1/d7/d67/d123/fbb [3076729,65907] 0 2024-04-18T10:42:53.144 INFO:tasks.workunit.client.0.smithi040.stdout:6/933: mknod df/d4b/d99/c155 0 2024-04-18T10:42:53.145 INFO:tasks.workunit.client.0.smithi040.stdout:4/883: mkdir d2/d1a/d8e/d103 0 2024-04-18T10:42:53.146 INFO:tasks.workunit.client.0.smithi040.stdout:3/916: chown d1/d7/c64 404742 1 2024-04-18T10:42:53.147 INFO:tasks.workunit.client.0.smithi040.stdout:2/867: getdents dd/d61/d81/dfb/d2b/d7c/d37 0 2024-04-18T10:42:53.148 INFO:tasks.workunit.client.0.smithi040.stdout:1/897: dwrite d1/d1c/d2b/d32/d36/d4d/d67/dcb/fea [0,4194304] 0 2024-04-18T10:42:53.149 INFO:tasks.workunit.client.0.smithi040.stdout:0/971: getdents dd/daa/dd8 0 2024-04-18T10:42:53.153 INFO:tasks.workunit.client.0.smithi040.stdout:5/887: creat d0/d3/dba/de7/def/f122 x:0 0 0 2024-04-18T10:42:53.155 INFO:tasks.workunit.client.0.smithi040.stdout:9/943: write d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/f69 [1300114,71784] 0 2024-04-18T10:42:53.156 INFO:tasks.workunit.client.0.smithi040.stdout:3/917: dwrite d1/d7/d28/dd5/fff [0,4194304] 0 2024-04-18T10:42:53.156 INFO:tasks.workunit.client.0.smithi040.stdout:7/865: link d6/d25/dcf/de4/c82 d6/d25/dcf/de4/d2d/c108 0 2024-04-18T10:42:53.158 INFO:tasks.workunit.client.0.smithi040.stdout:9/944: readlink d2/d5b/d6f/d80/d75/d124/d97/lb8 0 2024-04-18T10:42:53.158 INFO:tasks.workunit.client.0.smithi040.stdout:6/934: mknod df/c156 0 2024-04-18T10:42:53.160 INFO:tasks.workunit.client.0.smithi040.stdout:2/868: creat dd/d61/d81/dfb/d2b/d7c/d37/d38/d8c/dd5/f121 x:0 0 0 2024-04-18T10:42:53.163 INFO:tasks.workunit.client.0.smithi040.stdout:5/888: creat d0/d3b/d88/ded/f123 x:0 0 0 2024-04-18T10:42:53.164 INFO:tasks.workunit.client.0.smithi040.stdout:1/898: symlink d1/d9b/d75/d125/l134 0 2024-04-18T10:42:53.166 INFO:tasks.workunit.client.0.smithi040.stdout:1/899: truncate d1/d16/d92/dad/fbe 5220822 0 2024-04-18T10:42:53.166 INFO:tasks.workunit.client.0.smithi040.stdout:7/866: rename d6/d25/f3f to d6/d25/dcf/de4/d3c/f109 0 2024-04-18T10:42:53.167 INFO:tasks.workunit.client.0.smithi040.stdout:1/900: write d1/d1c/d7b/f83 [5252242,81611] 0 2024-04-18T10:42:53.168 INFO:tasks.workunit.client.0.smithi040.stdout:3/918: dread d1/d7/d3a/f50 [0,4194304] 0 2024-04-18T10:42:53.168 INFO:tasks.workunit.client.0.smithi040.stdout:2/869: mkdir dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/d122 0 2024-04-18T10:42:53.169 INFO:tasks.workunit.client.0.smithi040.stdout:8/971: link d2/d4c/d97/l11a d2/d15/d78/d10b/d120/d123/l146 0 2024-04-18T10:42:53.170 INFO:tasks.workunit.client.0.smithi040.stdout:4/884: creat d2/f104 x:0 0 0 2024-04-18T10:42:53.171 INFO:tasks.workunit.client.0.smithi040.stdout:2/870: stat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/f89 0 2024-04-18T10:42:53.172 INFO:tasks.workunit.client.0.smithi040.stdout:9/945: link d2/d5b/d6f/d80/d75/fb5 d2/d5b/d13a/d85/ded/d125/d8d/d11e/f153 0 2024-04-18T10:42:53.174 INFO:tasks.workunit.client.0.smithi040.stdout:7/867: rename d6/d3e/d99 to d6/d50/d79/d9a/dfa/d10a 0 2024-04-18T10:42:53.175 INFO:tasks.workunit.client.0.smithi040.stdout:1/901: unlink d1/d1c/d7b/d2e/ld1 0 2024-04-18T10:42:53.176 INFO:tasks.workunit.client.0.smithi040.stdout:5/889: mkdir d0/d3/d6b/d7b/d124 0 2024-04-18T10:42:53.177 INFO:tasks.workunit.client.0.smithi040.stdout:5/890: write d0/d3b/d88/ded/f123 [404089,127000] 0 2024-04-18T10:42:53.177 INFO:tasks.workunit.client.0.smithi040.stdout:6/935: rmdir df/d4b/deb/df5/d140 0 2024-04-18T10:42:53.178 INFO:tasks.workunit.client.0.smithi040.stdout:1/902: read d1/d1c/d7b/d2e/d39/f4f [141996,93360] 0 2024-04-18T10:42:53.179 INFO:tasks.workunit.client.0.smithi040.stdout:1/903: chown d1/d9b 9 1 2024-04-18T10:42:53.179 INFO:tasks.workunit.client.0.smithi040.stdout:1/904: chown d1/d1c/d7b/d2d/c131 4002 1 2024-04-18T10:42:53.180 INFO:tasks.workunit.client.0.smithi040.stdout:1/905: chown d1/d9b/d75/d84/dac/dda/c115 3894291 1 2024-04-18T10:42:53.181 INFO:tasks.workunit.client.0.smithi040.stdout:2/871: symlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/l123 0 2024-04-18T10:42:53.182 INFO:tasks.workunit.client.0.smithi040.stdout:9/946: rmdir d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d86/d109/dcf 39 2024-04-18T10:42:53.183 INFO:tasks.workunit.client.0.smithi040.stdout:3/919: rename d1/d7/d67/dc5/d103 to d1/d7/d67/dba/d131 0 2024-04-18T10:42:53.185 INFO:tasks.workunit.client.0.smithi040.stdout:0/972: truncate dd/df/d19/d28/d3a/f51 3084963 0 2024-04-18T10:42:53.186 INFO:tasks.workunit.client.0.smithi040.stdout:8/972: creat d2/d106/d134/f147 x:0 0 0 2024-04-18T10:42:53.187 INFO:tasks.workunit.client.0.smithi040.stdout:6/936: fsync df/d76/f80 0 2024-04-18T10:42:53.190 INFO:tasks.workunit.client.0.smithi040.stdout:6/937: chown df/d4b/db7/dcc/de5 0 1 2024-04-18T10:42:53.190 INFO:tasks.workunit.client.0.smithi040.stdout:9/947: dwrite d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/de4/f130 [0,4194304] 0 2024-04-18T10:42:53.190 INFO:tasks.workunit.client.0.smithi040.stdout:2/872: creat dd/d61/d8e/d98/dcc/f124 x:0 0 0 2024-04-18T10:42:53.193 INFO:tasks.workunit.client.0.smithi040.stdout:2/873: dread - dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/ddf/fec zero size 2024-04-18T10:42:53.195 INFO:tasks.workunit.client.0.smithi040.stdout:2/874: fsync dd/d61/d81/dfb/d2b/d7c/fa8 0 2024-04-18T10:42:53.197 INFO:tasks.workunit.client.0.smithi040.stdout:0/973: mkdir dd/da3/d152 0 2024-04-18T10:42:53.197 INFO:tasks.workunit.client.0.smithi040.stdout:8/973: dread d2/d15/f82 [0,4194304] 0 2024-04-18T10:42:53.223 INFO:tasks.workunit.client.0.smithi040.stdout:8/974: read d2/d22/d49/d79/fc6 [107355,64163] 0 2024-04-18T10:42:53.224 INFO:tasks.workunit.client.0.smithi040.stdout:4/885: creat d2/d3/d41/f105 x:0 0 0 2024-04-18T10:42:53.224 INFO:tasks.workunit.client.0.smithi040.stdout:1/906: mknod d1/d9b/d75/c135 0 2024-04-18T10:42:53.226 INFO:tasks.workunit.client.0.smithi040.stdout:5/891: fsync d0/d3b/d3f/de9/fea 0 2024-04-18T10:42:53.226 INFO:tasks.workunit.client.0.smithi040.stdout:7/868: truncate d6/d25/dcf/de4/d3c/f49 1008118 0 2024-04-18T10:42:53.228 INFO:tasks.workunit.client.0.smithi040.stdout:5/892: stat d0/d78/d95/db7/d114/f11b 0 2024-04-18T10:42:53.230 INFO:tasks.workunit.client.0.smithi040.stdout:8/975: creat d2/d4c/d97/dd3/f148 x:0 0 0 2024-04-18T10:42:53.230 INFO:tasks.workunit.client.0.smithi040.stdout:4/886: chown d2/d3/d4/d1f/fe4 6945 1 2024-04-18T10:42:53.230 INFO:tasks.workunit.client.0.smithi040.stdout:3/920: link d1/d7/d67/d123/c4d d1/d7/d28/d81/c132 0 2024-04-18T10:42:53.231 INFO:tasks.workunit.client.0.smithi040.stdout:4/887: stat d2/c37 0 2024-04-18T10:42:53.231 INFO:tasks.workunit.client.0.smithi040.stdout:2/875: creat dd/f125 x:0 0 0 2024-04-18T10:42:53.233 INFO:tasks.workunit.client.0.smithi040.stdout:6/938: getdents df/de8 0 2024-04-18T10:42:53.233 INFO:tasks.workunit.client.0.smithi040.stdout:7/869: dread - d6/d25/d28/dac/d63/f78 zero size 2024-04-18T10:42:53.235 INFO:tasks.workunit.client.0.smithi040.stdout:0/974: dwrite dd/df/d19/d3e/f7e [0,4194304] 0 2024-04-18T10:42:53.235 INFO:tasks.workunit.client.0.smithi040.stdout:3/921: mknod d1/d7/d12/d7b/c133 0 2024-04-18T10:42:53.238 INFO:tasks.workunit.client.0.smithi040.stdout:3/922: fdatasync d1/d7/d67/f76 0 2024-04-18T10:42:53.239 INFO:tasks.workunit.client.0.smithi040.stdout:3/923: dread - d1/d2/d4e/d58/d62/f10d zero size 2024-04-18T10:42:53.240 INFO:tasks.workunit.client.0.smithi040.stdout:3/924: write d1/d7/d12/fe1 [174193,64812] 0 2024-04-18T10:42:53.240 INFO:tasks.workunit.client.0.smithi040.stdout:3/925: stat d1/d7/d67/dc5/d91/db1 0 2024-04-18T10:42:53.242 INFO:tasks.workunit.client.0.smithi040.stdout:4/888: mknod d2/d3/d4/d23/dea/d28/de1/c106 0 2024-04-18T10:42:53.243 INFO:tasks.workunit.client.0.smithi040.stdout:3/926: truncate d1/d2/d4e/d58/dbe/dc1/dc2/dea/f12f 175700 0 2024-04-18T10:42:53.243 INFO:tasks.workunit.client.0.smithi040.stdout:6/939: creat df/d4b/d99/dc4/d10c/da7/f157 x:0 0 0 2024-04-18T10:42:53.244 INFO:tasks.workunit.client.0.smithi040.stdout:7/870: truncate d6/d25/f46 1613734 0 2024-04-18T10:42:53.247 INFO:tasks.workunit.client.0.smithi040.stdout:0/975: symlink dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3/l153 0 2024-04-18T10:42:53.248 INFO:tasks.workunit.client.0.smithi040.stdout:2/876: creat dd/d61/d81/dfb/d2b/d95/f126 x:0 0 0 2024-04-18T10:42:53.250 INFO:tasks.workunit.client.0.smithi040.stdout:4/889: creat d2/d3/d4/f107 x:0 0 0 2024-04-18T10:42:53.251 INFO:tasks.workunit.client.0.smithi040.stdout:1/907: truncate d1/d1c/d2b/d32/d36/d4d/d67/dcb/fea 4082392 0 2024-04-18T10:42:53.251 INFO:tasks.workunit.client.0.smithi040.stdout:6/940: dwrite df/d76/f84 [0,4194304] 0 2024-04-18T10:42:53.252 INFO:tasks.workunit.client.0.smithi040.stdout:3/927: symlink d1/d2/d4e/d58/dbe/dca/l134 0 2024-04-18T10:42:53.253 INFO:tasks.workunit.client.0.smithi040.stdout:3/928: write d1/d7/d67/dba/ff3 [250389,91363] 0 2024-04-18T10:42:53.254 INFO:tasks.workunit.client.0.smithi040.stdout:8/976: link d2/d10/d142/d9/d3c/l4e d2/d4c/dd2/l149 0 2024-04-18T10:42:53.256 INFO:tasks.workunit.client.0.smithi040.stdout:2/877: mkdir dd/d61/d81/d127 0 2024-04-18T10:42:53.258 INFO:tasks.workunit.client.0.smithi040.stdout:6/941: creat df/d76/d91/f158 x:0 0 0 2024-04-18T10:42:53.259 INFO:tasks.workunit.client.0.smithi040.stdout:6/942: chown df/fab 2 1 2024-04-18T10:42:53.259 INFO:tasks.workunit.client.0.smithi040.stdout:7/871: creat d6/d25/d28/dac/d64/d101/d55/d58/dc4/df9/f10b x:0 0 0 2024-04-18T10:42:53.260 INFO:tasks.workunit.client.0.smithi040.stdout:0/976: symlink dd/d10b/d140/l154 0 2024-04-18T10:42:53.262 INFO:tasks.workunit.client.0.smithi040.stdout:9/948: sync 2024-04-18T10:42:53.262 INFO:tasks.workunit.client.0.smithi040.stdout:3/929: unlink d1/d2/d4e/d57/c12b 0 2024-04-18T10:42:53.265 INFO:tasks.workunit.client.0.smithi040.stdout:5/893: dread d0/d3b/d88/ded/f11c [0,4194304] 0 2024-04-18T10:42:53.265 INFO:tasks.workunit.client.0.smithi040.stdout:9/949: chown d2/d5b/d6f/d80/d75/d124/d22/f3c 1795 1 2024-04-18T10:42:53.268 INFO:tasks.workunit.client.0.smithi040.stdout:7/872: dwrite d6/d50/d79/d9a/dfa/d10a/fa3 [0,4194304] 0 2024-04-18T10:42:53.270 INFO:tasks.workunit.client.0.smithi040.stdout:7/873: chown d6/d25/d28/dac/d64/d101/d55/d58/d6c/f88 0 1 2024-04-18T10:42:53.272 INFO:tasks.workunit.client.0.smithi040.stdout:3/930: dwrite d1/d7/f53 [0,4194304] 0 2024-04-18T10:42:53.272 INFO:tasks.workunit.client.0.smithi040.stdout:6/943: read df/f43 [515855,116599] 0 2024-04-18T10:42:53.273 INFO:tasks.workunit.client.0.smithi040.stdout:1/908: link d1/d1c/d2b/d32/d36/d4d/d67/fa3 d1/d1c/d2b/db5/dd6/f136 0 2024-04-18T10:42:53.273 INFO:tasks.workunit.client.0.smithi040.stdout:6/944: stat df/d4b/d99/dc4/d10c/f119 0 2024-04-18T10:42:53.274 INFO:tasks.workunit.client.0.smithi040.stdout:6/945: chown df/d4b/d63/db3 64732627 1 2024-04-18T10:42:53.274 INFO:tasks.workunit.client.0.smithi040.stdout:6/946: dread - df/d4b/db7/dcc/dd6/f115 zero size 2024-04-18T10:42:53.275 INFO:tasks.workunit.client.0.smithi040.stdout:5/894: stat d0/d3b/l3c 0 2024-04-18T10:42:53.279 INFO:tasks.workunit.client.0.smithi040.stdout:7/874: mkdir d6/d25/d28/dac/d64/d101/d55/d58/dc4/d10c 0 2024-04-18T10:42:53.282 INFO:tasks.workunit.client.0.smithi040.stdout:1/909: dwrite d1/d1c/d2b/d32/d36/d4d/d67/fd4 [0,4194304] 0 2024-04-18T10:42:53.284 INFO:tasks.workunit.client.0.smithi040.stdout:6/947: creat df/d76/dc2/f159 x:0 0 0 2024-04-18T10:42:53.284 INFO:tasks.workunit.client.0.smithi040.stdout:1/910: chown d1/d1c/d7b/ce7 7 1 2024-04-18T10:42:53.285 INFO:tasks.workunit.client.0.smithi040.stdout:9/950: dwrite d2/d5b/d6f/d80/fe6 [0,4194304] 0 2024-04-18T10:42:53.287 INFO:tasks.workunit.client.0.smithi040.stdout:2/878: rmdir dd/d61 39 2024-04-18T10:42:53.287 INFO:tasks.workunit.client.0.smithi040.stdout:8/977: dread d2/f11b [0,4194304] 0 2024-04-18T10:42:53.290 INFO:tasks.workunit.client.0.smithi040.stdout:3/931: creat d1/d7/d67/d107/f135 x:0 0 0 2024-04-18T10:42:53.293 INFO:tasks.workunit.client.0.smithi040.stdout:7/875: dread d6/d50/f54 [4194304,4194304] 0 2024-04-18T10:42:53.294 INFO:tasks.workunit.client.0.smithi040.stdout:3/932: dread d1/d7/f53 [0,4194304] 0 2024-04-18T10:42:53.299 INFO:tasks.workunit.client.0.smithi040.stdout:4/890: mknod d2/d3/d4/c108 0 2024-04-18T10:42:53.300 INFO:tasks.workunit.client.0.smithi040.stdout:4/891: dread - d2/fe9 zero size 2024-04-18T10:42:53.300 INFO:tasks.workunit.client.0.smithi040.stdout:6/948: symlink df/d123/d13c/l15a 0 2024-04-18T10:42:53.303 INFO:tasks.workunit.client.0.smithi040.stdout:3/933: rename d1/d7/d67/dc5/d3b/l8d to d1/d2/d4e/d58/dc4/df8/d11f/l136 0 2024-04-18T10:42:53.305 INFO:tasks.workunit.client.0.smithi040.stdout:8/978: link d2/d10/d142/d9/d3c/f6f d2/d15/d2b/dd0/dff/d113/f14a 0 2024-04-18T10:42:53.306 INFO:tasks.workunit.client.0.smithi040.stdout:4/892: chown d2/d3/d4/d1f/d29/ffc 10730 1 2024-04-18T10:42:53.308 INFO:tasks.workunit.client.0.smithi040.stdout:1/911: creat d1/d9b/d75/f137 x:0 0 0 2024-04-18T10:42:53.308 INFO:tasks.workunit.client.0.smithi040.stdout:7/876: mkdir d6/d50/d79/da8/d10d 0 2024-04-18T10:42:53.312 INFO:tasks.workunit.client.0.smithi040.stdout:8/979: truncate d2/d10/d142/d9/d63/fdd 383581 0 2024-04-18T10:42:53.315 INFO:tasks.workunit.client.0.smithi040.stdout:7/877: unlink d6/l7b 0 2024-04-18T10:42:53.315 INFO:tasks.workunit.client.0.smithi040.stdout:9/951: link d2/dd/de/l62 d2/d5b/d13a/d71/d132/l154 0 2024-04-18T10:42:53.316 INFO:tasks.workunit.client.0.smithi040.stdout:5/895: write d0/d3b/fbc [4122176,63600] 0 2024-04-18T10:42:53.317 INFO:tasks.workunit.client.0.smithi040.stdout:3/934: creat d1/d7/db2/dc7/f137 x:0 0 0 2024-04-18T10:42:53.317 INFO:tasks.workunit.client.0.smithi040.stdout:0/977: sync 2024-04-18T10:42:53.322 INFO:tasks.workunit.client.0.smithi040.stdout:0/978: fdatasync dd/df/d19/d28/f53 0 2024-04-18T10:42:53.323 INFO:tasks.workunit.client.0.smithi040.stdout:7/878: dread d6/d50/d79/da8/dad/fb9 [0,4194304] 0 2024-04-18T10:42:53.323 INFO:tasks.workunit.client.0.smithi040.stdout:3/935: mkdir d1/d7/d67/dba/d131/d138 0 2024-04-18T10:42:53.324 INFO:tasks.workunit.client.0.smithi040.stdout:1/912: dwrite d1/d1c/d7b/d2e/d9e/fab [0,4194304] 0 2024-04-18T10:42:53.326 INFO:tasks.workunit.client.0.smithi040.stdout:9/952: creat d2/d5b/d6f/d80/d75/d124/d22/db3/f155 x:0 0 0 2024-04-18T10:42:53.326 INFO:tasks.workunit.client.0.smithi040.stdout:3/936: chown d1/d7/d12/fe1 1 1 2024-04-18T10:42:53.327 INFO:tasks.workunit.client.0.smithi040.stdout:5/896: mknod d0/d3/d6b/d7b/c125 0 2024-04-18T10:42:53.330 INFO:tasks.workunit.client.0.smithi040.stdout:5/897: chown d0/d3b/d3f/f41 5973811 1 2024-04-18T10:42:53.331 INFO:tasks.workunit.client.0.smithi040.stdout:6/949: write df/d4b/d6a/fae [5202906,90149] 0 2024-04-18T10:42:53.332 INFO:tasks.workunit.client.0.smithi040.stdout:8/980: dread d2/d10/d142/d9/f9d [0,4194304] 0 2024-04-18T10:42:53.332 INFO:tasks.workunit.client.0.smithi040.stdout:5/898: chown d0/d3b/d3f/fbd 8 1 2024-04-18T10:42:53.333 INFO:tasks.workunit.client.0.smithi040.stdout:0/979: rename dd/df/d19/d28/c35 to dd/d62/c155 0 2024-04-18T10:42:53.334 INFO:tasks.workunit.client.0.smithi040.stdout:4/893: dread d2/d3/d4/dd/f48 [0,4194304] 0 2024-04-18T10:42:53.334 INFO:tasks.workunit.client.0.smithi040.stdout:5/899: write d0/f35 [9093201,42046] 0 2024-04-18T10:42:53.337 INFO:tasks.workunit.client.0.smithi040.stdout:1/913: symlink d1/d9b/d75/l138 0 2024-04-18T10:42:53.339 INFO:tasks.workunit.client.0.smithi040.stdout:2/879: sync 2024-04-18T10:42:53.339 INFO:tasks.workunit.client.0.smithi040.stdout:5/900: read d0/d3/d47/d106/d115/daf/f103 [998523,64085] 0 2024-04-18T10:42:53.339 INFO:tasks.workunit.client.0.smithi040.stdout:9/953: fdatasync d2/d5b/d13a/d85/ded/d125/fbd 0 2024-04-18T10:42:53.340 INFO:tasks.workunit.client.0.smithi040.stdout:6/950: creat df/d76/dc2/dce/f15b x:0 0 0 2024-04-18T10:42:53.341 INFO:tasks.workunit.client.0.smithi040.stdout:6/951: chown df/d108 0 1 2024-04-18T10:42:53.342 INFO:tasks.workunit.client.0.smithi040.stdout:9/954: chown d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/ld2 253 1 2024-04-18T10:42:53.342 INFO:tasks.workunit.client.0.smithi040.stdout:8/981: mkdir d2/d2c/dbf/dc2/d12a/d14b 0 2024-04-18T10:42:53.343 INFO:tasks.workunit.client.0.smithi040.stdout:1/914: mknod d1/d9b/c139 0 2024-04-18T10:42:53.344 INFO:tasks.workunit.client.0.smithi040.stdout:7/879: rmdir d6/d25/d28/dac/d64/d101/d55/d58/dc4/d10c 0 2024-04-18T10:42:53.348 INFO:tasks.workunit.client.0.smithi040.stdout:0/980: creat dd/da3/d152/f156 x:0 0 0 2024-04-18T10:42:53.349 INFO:tasks.workunit.client.0.smithi040.stdout:8/982: fsync d2/d22/d80/fea 0 2024-04-18T10:42:53.351 INFO:tasks.workunit.client.0.smithi040.stdout:4/894: symlink d2/d3/d4/d23/dea/d28/d3f/l109 0 2024-04-18T10:42:53.351 INFO:tasks.workunit.client.0.smithi040.stdout:8/983: fdatasync d2/d22/d49/d79/fa7 0 2024-04-18T10:42:53.353 INFO:tasks.workunit.client.0.smithi040.stdout:7/880: dwrite d6/d25/dcf/de4/d2d/f57 [0,4194304] 0 2024-04-18T10:42:53.353 INFO:tasks.workunit.client.0.smithi040.stdout:5/901: mknod d0/d3/d47/c126 0 2024-04-18T10:42:53.354 INFO:tasks.workunit.client.0.smithi040.stdout:2/880: write dd/d61/d81/dfb/d4a/f5a [338042,122679] 0 2024-04-18T10:42:53.355 INFO:tasks.workunit.client.0.smithi040.stdout:6/952: link df/d4b/d63/faf df/d4b/d6e/d3f/d12e/f15c 0 2024-04-18T10:42:53.356 INFO:tasks.workunit.client.0.smithi040.stdout:4/895: write d2/d3/d41/d62/db0/fcb [180119,105343] 0 2024-04-18T10:42:53.357 INFO:tasks.workunit.client.0.smithi040.stdout:3/937: dread d1/d7/db2/dc0/f119 [0,4194304] 0 2024-04-18T10:42:53.358 INFO:tasks.workunit.client.0.smithi040.stdout:7/881: read d6/d50/d79/d9a/dfa/d10a/fa3 [848344,56583] 0 2024-04-18T10:42:53.359 INFO:tasks.workunit.client.0.smithi040.stdout:9/955: link d2/dd/f98 d2/d7/f156 0 2024-04-18T10:42:53.360 INFO:tasks.workunit.client.0.smithi040.stdout:0/981: symlink dd/df/d19/d28/d3a/d46/d107/d142/l157 0 2024-04-18T10:42:53.364 INFO:tasks.workunit.client.0.smithi040.stdout:0/982: write dd/df/d19/d28/d3a/d46/d107/d11c/f13b [198418,74825] 0 2024-04-18T10:42:53.365 INFO:tasks.workunit.client.0.smithi040.stdout:2/881: dwrite dd/d61/d81/dfb/d2b/d7c/d37/d38/fe8 [0,4194304] 0 2024-04-18T10:42:53.367 INFO:tasks.workunit.client.0.smithi040.stdout:0/983: dread - dd/df/d19/d28/d3a/d46/d107/f108 zero size 2024-04-18T10:42:53.367 INFO:tasks.workunit.client.0.smithi040.stdout:6/953: rmdir df/d4b/d6e/d3f/d13f 39 2024-04-18T10:42:53.368 INFO:tasks.workunit.client.0.smithi040.stdout:6/954: stat df/d4b/d6e/f11f 0 2024-04-18T10:42:53.372 INFO:tasks.workunit.client.0.smithi040.stdout:9/956: mknod d2/d5b/d6f/d80/d75/d124/d22/db3/c157 0 2024-04-18T10:42:53.376 INFO:tasks.workunit.client.0.smithi040.stdout:2/882: symlink dd/d61/d81/dfb/d2b/d7c/d37/d5b/dda/l128 0 2024-04-18T10:42:53.378 INFO:tasks.workunit.client.0.smithi040.stdout:0/984: unlink dd/df/d19/d3e/fab 0 2024-04-18T10:42:53.380 INFO:tasks.workunit.client.0.smithi040.stdout:8/984: truncate d2/d2c/feb 453009 0 2024-04-18T10:42:53.380 INFO:tasks.workunit.client.0.smithi040.stdout:9/957: dwrite d2/d5b/d6f/f143 [0,4194304] 0 2024-04-18T10:42:53.381 INFO:tasks.workunit.client.0.smithi040.stdout:1/915: dwrite d1/d1c/d7b/d2e/d3e/d85/ff9 [0,4194304] 0 2024-04-18T10:42:53.384 INFO:tasks.workunit.client.0.smithi040.stdout:3/938: creat d1/d2/d4e/d58/dbe/f139 x:0 0 0 2024-04-18T10:42:53.384 INFO:tasks.workunit.client.0.smithi040.stdout:1/916: chown d1/d9b/d75/d84/dac/dda/c115 1 1 2024-04-18T10:42:53.387 INFO:tasks.workunit.client.0.smithi040.stdout:3/939: write d1/d7/f15 [4786749,97146] 0 2024-04-18T10:42:53.388 INFO:tasks.workunit.client.0.smithi040.stdout:4/896: link d2/d1a/f9c d2/d3/d41/d62/f10a 0 2024-04-18T10:42:53.394 INFO:tasks.workunit.client.0.smithi040.stdout:8/985: dwrite d2/d10/d142/d9/fe6 [0,4194304] 0 2024-04-18T10:42:53.396 INFO:tasks.workunit.client.0.smithi040.stdout:6/955: link df/d76/db9/l13a df/d4b/d6a/d93/l15d 0 2024-04-18T10:42:53.398 INFO:tasks.workunit.client.0.smithi040.stdout:5/902: link d0/d3/d47/lc5 d0/d3b/l127 0 2024-04-18T10:42:53.398 INFO:tasks.workunit.client.0.smithi040.stdout:7/882: dwrite d6/d25/d28/dac/d63/f86 [0,4194304] 0 2024-04-18T10:42:53.399 INFO:tasks.workunit.client.0.smithi040.stdout:1/917: dwrite d1/fc5 [4194304,4194304] 0 2024-04-18T10:42:53.402 INFO:tasks.workunit.client.0.smithi040.stdout:1/918: readlink d1/d1c/d2b/d32/l45 0 2024-04-18T10:42:53.402 INFO:tasks.workunit.client.0.smithi040.stdout:7/883: chown d6/d25/d28/dac/d64/fd4 18525626 1 2024-04-18T10:42:53.404 INFO:tasks.workunit.client.0.smithi040.stdout:1/919: chown d1/d9b/d75/d84/ca8 21047 1 2024-04-18T10:42:53.407 INFO:tasks.workunit.client.0.smithi040.stdout:0/985: creat dd/df/d19/d28/f158 x:0 0 0 2024-04-18T10:42:53.407 INFO:tasks.workunit.client.0.smithi040.stdout:8/986: dread d2/d10/d14/f104 [0,4194304] 0 2024-04-18T10:42:53.407 INFO:tasks.workunit.client.0.smithi040.stdout:6/956: readlink df/d4b/d6a/d93/l5d 0 2024-04-18T10:42:53.409 INFO:tasks.workunit.client.0.smithi040.stdout:5/903: dwrite d0/db5/fc1 [0,4194304] 0 2024-04-18T10:42:53.410 INFO:tasks.workunit.client.0.smithi040.stdout:3/940: mknod d1/c13a 0 2024-04-18T10:42:53.412 INFO:tasks.workunit.client.0.smithi040.stdout:8/987: write d2/d10/d142/d9/d3c/f52 [2453223,94994] 0 2024-04-18T10:42:53.412 INFO:tasks.workunit.client.0.smithi040.stdout:3/941: chown d1/d7/d3a/l4a 87422 1 2024-04-18T10:42:53.412 INFO:tasks.workunit.client.0.smithi040.stdout:7/884: creat d6/d50/d79/d9a/f10e x:0 0 0 2024-04-18T10:42:53.412 INFO:tasks.workunit.client.0.smithi040.stdout:9/958: dread d2/d5b/d6f/d80/d75/d124/d22/d2e/faa [0,4194304] 0 2024-04-18T10:42:53.414 INFO:tasks.workunit.client.0.smithi040.stdout:4/897: symlink d2/d3/d4/dd/l10b 0 2024-04-18T10:42:53.414 INFO:tasks.workunit.client.0.smithi040.stdout:1/920: symlink d1/d1c/d2b/d32/d36/d4d/l13a 0 2024-04-18T10:42:53.429 INFO:tasks.workunit.client.0.smithi040.stdout:6/957: creat df/d4b/db7/df6/d12a/f15e x:0 0 0 2024-04-18T10:42:53.430 INFO:tasks.workunit.client.0.smithi040.stdout:9/959: creat d2/d5b/d13a/d85/ded/f158 x:0 0 0 2024-04-18T10:42:53.431 INFO:tasks.workunit.client.0.smithi040.stdout:0/986: getdents dd/df/d19/d28/d3a/d46/d148 0 2024-04-18T10:42:53.432 INFO:tasks.workunit.client.0.smithi040.stdout:8/988: mknod d2/d15/c14c 0 2024-04-18T10:42:53.438 INFO:tasks.workunit.client.0.smithi040.stdout:1/921: creat d1/d1c/d2b/f13b x:0 0 0 2024-04-18T10:42:53.438 INFO:tasks.workunit.client.0.smithi040.stdout:3/942: dwrite d1/d7/db2/dc7/f137 [0,4194304] 0 2024-04-18T10:42:53.438 INFO:tasks.workunit.client.0.smithi040.stdout:0/987: symlink dd/da3/d152/l159 0 2024-04-18T10:42:53.441 INFO:tasks.workunit.client.0.smithi040.stdout:2/883: truncate dd/d61/d81/dfb/d4a/f71 1123862 0 2024-04-18T10:42:53.442 INFO:tasks.workunit.client.0.smithi040.stdout:1/922: chown d1/d9b/f9c 7734035 1 2024-04-18T10:42:53.443 INFO:tasks.workunit.client.0.smithi040.stdout:4/898: dwrite d2/d3/d4/d1f/d29/d49/d31/f88 [0,4194304] 0 2024-04-18T10:42:53.443 INFO:tasks.workunit.client.0.smithi040.stdout:7/885: dread d6/d25/dcf/de4/f3d [0,4194304] 0 2024-04-18T10:42:53.445 INFO:tasks.workunit.client.0.smithi040.stdout:6/958: link df/d123/d13c/l15a df/d4b/d99/dc4/d10c/da7/l15f 0 2024-04-18T10:42:53.446 INFO:tasks.workunit.client.0.smithi040.stdout:1/923: dread - d1/d1c/d2b/db5/dcc/f123 zero size 2024-04-18T10:42:53.451 INFO:tasks.workunit.client.0.smithi040.stdout:6/959: dread df/d4b/f51 [0,4194304] 0 2024-04-18T10:42:53.453 INFO:tasks.workunit.client.0.smithi040.stdout:3/943: truncate d1/d7/d67/fd7 105126 0 2024-04-18T10:42:53.455 INFO:tasks.workunit.client.0.smithi040.stdout:3/944: fsync d1/d7/d67/d123/f2d 0 2024-04-18T10:42:53.455 INFO:tasks.workunit.client.0.smithi040.stdout:7/886: dwrite d6/fee [4194304,4194304] 0 2024-04-18T10:42:53.455 INFO:tasks.workunit.client.0.smithi040.stdout:2/884: unlink dd/d61/d8e/d98/dcc/ce6 0 2024-04-18T10:42:53.457 INFO:tasks.workunit.client.0.smithi040.stdout:4/899: rename d2/d3/d4/d1f/d29/d49/l60 to d2/d1a/d8e/l10c 0 2024-04-18T10:42:53.459 INFO:tasks.workunit.client.0.smithi040.stdout:4/900: stat d2/d3/d4/dd/d6d/d70/f7d 0 2024-04-18T10:42:53.459 INFO:tasks.workunit.client.0.smithi040.stdout:1/924: mkdir d1/d16/d13c 0 2024-04-18T10:42:53.460 INFO:tasks.workunit.client.0.smithi040.stdout:3/945: mknod d1/d2/d3c/c13b 0 2024-04-18T10:42:53.460 INFO:tasks.workunit.client.0.smithi040.stdout:1/925: stat d1/d1c/d7b/d2e/d3e/lfe 0 2024-04-18T10:42:53.463 INFO:tasks.workunit.client.0.smithi040.stdout:7/887: mknod d6/d25/d28/dac/d64/d101/d5c/d6b/ded/dd0/c10f 0 2024-04-18T10:42:53.466 INFO:tasks.workunit.client.0.smithi040.stdout:4/901: symlink d2/d3/d4/d23/l10d 0 2024-04-18T10:42:53.467 INFO:tasks.workunit.client.0.smithi040.stdout:2/885: link c6 dd/d61/d81/dfb/d2b/d7c/d37/d38/d8c/c129 0 2024-04-18T10:42:53.471 INFO:tasks.workunit.client.0.smithi040.stdout:8/989: dread d2/d15/d2b/d40/f71 [0,4194304] 0 2024-04-18T10:42:53.474 INFO:tasks.workunit.client.0.smithi040.stdout:3/946: dread d1/d2/d4e/d58/db4/f101 [0,4194304] 0 2024-04-18T10:42:53.474 INFO:tasks.workunit.client.0.smithi040.stdout:1/926: dwrite d1/d9b/d75/d84/f99 [0,4194304] 0 2024-04-18T10:42:53.475 INFO:tasks.workunit.client.0.smithi040.stdout:8/990: truncate d2/d15/d2b/d40/f13c 931576 0 2024-04-18T10:42:53.477 INFO:tasks.workunit.client.0.smithi040.stdout:1/927: write d1/d16/d92/fbc [188057,91000] 0 2024-04-18T10:42:53.479 INFO:tasks.workunit.client.0.smithi040.stdout:8/991: mknod d2/d15/d2b/d40/dfd/c14d 0 2024-04-18T10:42:53.481 INFO:tasks.workunit.client.0.smithi040.stdout:3/947: mkdir d1/d7/d67/dba/d131/d138/d13c 0 2024-04-18T10:42:53.482 INFO:tasks.workunit.client.0.smithi040.stdout:5/904: sync 2024-04-18T10:42:53.483 INFO:tasks.workunit.client.0.smithi040.stdout:1/928: creat d1/d1c/d7b/d2e/d9e/f13d x:0 0 0 2024-04-18T10:42:53.486 INFO:tasks.workunit.client.0.smithi040.stdout:8/992: mknod d2/d4c/d97/dd3/c14e 0 2024-04-18T10:42:53.488 INFO:tasks.workunit.client.0.smithi040.stdout:5/905: creat d0/d4e/f128 x:0 0 0 2024-04-18T10:42:53.489 INFO:tasks.workunit.client.0.smithi040.stdout:8/993: chown d2/d22/d80/fea 26 1 2024-04-18T10:42:53.491 INFO:tasks.workunit.client.0.smithi040.stdout:1/929: dwrite d1/d16/f29 [0,4194304] 0 2024-04-18T10:42:53.491 INFO:tasks.workunit.client.0.smithi040.stdout:0/988: dread dd/df/d19/d28/d3a/d46/d107/d11c/d130/dc3/fe3 [0,4194304] 0 2024-04-18T10:42:53.491 INFO:tasks.workunit.client.0.smithi040.stdout:8/994: fdatasync d2/d22/f38 0 2024-04-18T10:42:53.492 INFO:tasks.workunit.client.0.smithi040.stdout:7/888: write d6/d25/dcf/de4/d3c/f49 [1089069,49857] 0 2024-04-18T10:42:53.496 INFO:tasks.workunit.client.0.smithi040.stdout:9/960: sync 2024-04-18T10:42:53.505 INFO:tasks.workunit.client.0.smithi040.stdout:8/995: fsync d2/d10/d142/d9/f13e 0 2024-04-18T10:42:53.506 INFO:tasks.workunit.client.0.smithi040.stdout:3/948: truncate d1/d2/d4e/fd0 3989741 0 2024-04-18T10:42:53.506 INFO:tasks.workunit.client.0.smithi040.stdout:6/960: dwrite df/d4b/db7/df6/ff9 [0,4194304] 0 2024-04-18T10:42:53.506 INFO:tasks.workunit.client.0.smithi040.stdout:9/961: dread - d2/d7/f51 zero size 2024-04-18T10:42:53.508 INFO:tasks.workunit.client.0.smithi040.stdout:4/902: dread d2/d3/d4/fab [0,4194304] 0 2024-04-18T10:42:53.512 INFO:tasks.workunit.client.0.smithi040.stdout:9/962: fsync d2/d5b/d6f/dc3/f105 0 2024-04-18T10:42:53.513 INFO:tasks.workunit.client.0.smithi040.stdout:8/996: mknod d2/d2c/dbf/dc2/c14f 0 2024-04-18T10:42:53.513 INFO:tasks.workunit.client.0.smithi040.stdout:0/989: write dd/df/d19/f87 [4836714,129610] 0 2024-04-18T10:42:53.513 INFO:tasks.workunit.client.0.smithi040.stdout:7/889: chown d6/d25/d28/lab 499654 1 2024-04-18T10:42:53.514 INFO:tasks.workunit.client.0.smithi040.stdout:2/886: dwrite dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/dc5/f10f [4194304,4194304] 0 2024-04-18T10:42:53.514 INFO:tasks.workunit.client.0.smithi040.stdout:3/949: creat d1/d7/dd9/f13d x:0 0 0 2024-04-18T10:42:53.518 INFO:tasks.workunit.client.0.smithi040.stdout:4/903: unlink d2/d3/d4/d1f/d29/d49/f65 0 2024-04-18T10:42:53.519 INFO:tasks.workunit.client.0.smithi040.stdout:3/950: dread d1/d7/d67/dba/ff3 [0,4194304] 0 2024-04-18T10:42:53.520 INFO:tasks.workunit.client.0.smithi040.stdout:8/997: rmdir d2/d15/d2b/d40/dfd 39 2024-04-18T10:42:53.521 INFO:tasks.workunit.client.0.smithi040.stdout:7/890: fsync d6/d25/dcf/de4/f3d 0 2024-04-18T10:42:53.523 INFO:tasks.workunit.client.0.smithi040.stdout:0/990: mknod dd/df/d19/d28/d3a/d5b/dd0/df7/c15a 0 2024-04-18T10:42:53.526 INFO:tasks.workunit.client.0.smithi040.stdout:9/963: creat d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d14f/f159 x:0 0 0 2024-04-18T10:42:53.528 INFO:tasks.workunit.client.0.smithi040.stdout:7/891: write d6/d25/d28/dac/d64/fd4 [215077,75623] 0 2024-04-18T10:42:53.529 INFO:tasks.workunit.client.0.smithi040.stdout:2/887: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/f12a x:0 0 0 2024-04-18T10:42:53.532 INFO:tasks.workunit.client.0.smithi040.stdout:0/991: write dd/df/d19/d3e/da5/f12a [610362,26464] 0 2024-04-18T10:42:53.532 INFO:tasks.workunit.client.0.smithi040.stdout:6/961: dread df/d4b/d6a/d93/f47 [0,4194304] 0 2024-04-18T10:42:53.532 INFO:tasks.workunit.client.0.smithi040.stdout:4/904: getdents d2/d3/d4 0 2024-04-18T10:42:53.533 INFO:tasks.workunit.client.0.smithi040.stdout:1/930: dwrite d1/d1c/d2b/d32/d36/d4d/fe2 [0,4194304] 0 2024-04-18T10:42:53.537 INFO:tasks.workunit.client.0.smithi040.stdout:0/992: read - dd/d91/f129 zero size 2024-04-18T10:42:53.537 INFO:tasks.workunit.client.0.smithi040.stdout:3/951: dread d1/d7/d67/dc5/d91/f98 [0,4194304] 0 2024-04-18T10:42:53.538 INFO:tasks.workunit.client.0.smithi040.stdout:8/998: link d2/d4c/dd2/l149 d2/d4c/d97/dd3/l150 0 2024-04-18T10:42:53.539 INFO:tasks.workunit.client.0.smithi040.stdout:4/905: read d2/d3/d4/d23/f63 [413100,13541] 0 2024-04-18T10:42:53.539 INFO:tasks.workunit.client.0.smithi040.stdout:6/962: readlink df/l23 0 2024-04-18T10:42:53.539 INFO:tasks.workunit.client.0.smithi040.stdout:7/892: truncate d6/d25/d28/f2f 8924533 0 2024-04-18T10:42:53.546 INFO:tasks.workunit.client.0.smithi040.stdout:8/999: readlink d2/d15/l5c 0 2024-04-18T10:42:53.547 INFO:tasks.workunit.client.0.smithi040.stdout:3/952: readlink d1/d7/d28/d81/l11d 0 2024-04-18T10:42:53.548 INFO:tasks.workunit.client.0.smithi040.stdout:2/888: truncate dd/d61/d81/dfb/d2b/d7c/d37/d5b/fe0 1748133 0 2024-04-18T10:42:53.548 INFO:tasks.workunit.client.0.smithi040.stdout:7/893: readlink d6/d25/d28/dac/l39 0 2024-04-18T10:42:53.549 INFO:tasks.workunit.client.0.smithi040.stdout:0/993: write dd/df/d19/d28/db7/feb [1714689,69629] 0 2024-04-18T10:42:53.552 INFO:tasks.workunit.client.0.smithi040.stdout:1/931: dwrite d1/d1c/d7b/d2e/d3e/fde [0,4194304] 0 2024-04-18T10:42:53.554 INFO:tasks.workunit.client.0.smithi040.stdout:9/964: getdents d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/dbb/dcd 0 2024-04-18T10:42:53.556 INFO:tasks.workunit.client.0.smithi040.stdout:4/906: symlink d2/d3/d41/d94/dc7/l10e 0 2024-04-18T10:42:53.556 INFO:tasks.workunit.client.0.smithi040.stdout:9/965: read d2/d5b/d6f/d80/d75/d124/d70/da8/f112 [2404069,9616] 0 2024-04-18T10:42:53.557 INFO:tasks.workunit.client.0.smithi040.stdout:3/953: symlink d1/d7/d67/d107/l13e 0 2024-04-18T10:42:53.560 INFO:tasks.workunit.client.0.smithi040.stdout:0/994: rmdir dd/df/d19/d28/d3a/df9 39 2024-04-18T10:42:53.566 INFO:tasks.workunit.client.0.smithi040.stdout:9/966: unlink d2/d5b/d6f/d80/d75/d124/d22/d2e/cad 0 2024-04-18T10:42:53.569 INFO:tasks.workunit.client.0.smithi040.stdout:5/906: sync 2024-04-18T10:42:53.569 INFO:tasks.workunit.client.0.smithi040.stdout:2/889: mknod dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/c12b 0 2024-04-18T10:42:53.571 INFO:tasks.workunit.client.0.smithi040.stdout:9/967: dread - d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d14f/f159 zero size 2024-04-18T10:42:53.572 INFO:tasks.workunit.client.0.smithi040.stdout:4/907: dwrite d2/d3/d4/dd/d4f/f5f [0,4194304] 0 2024-04-18T10:42:53.573 INFO:tasks.workunit.client.0.smithi040.stdout:0/995: dread dd/fd3 [0,4194304] 0 2024-04-18T10:42:53.574 INFO:tasks.workunit.client.0.smithi040.stdout:2/890: write dd/d61/d81/dfb/d2b/d7c/fe9 [2828401,50801] 0 2024-04-18T10:42:53.576 INFO:tasks.workunit.client.0.smithi040.stdout:3/954: getdents d1/d7/db2 0 2024-04-18T10:42:53.576 INFO:tasks.workunit.client.0.smithi040.stdout:4/908: write d2/d3/d4/dd/d4f/f5f [4870179,67855] 0 2024-04-18T10:42:53.580 INFO:tasks.workunit.client.0.smithi040.stdout:9/968: symlink d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc2/l15a 0 2024-04-18T10:42:53.583 INFO:tasks.workunit.client.0.smithi040.stdout:2/891: symlink dd/d61/d81/dfb/d2b/d7c/d37/da3/l12c 0 2024-04-18T10:42:53.586 INFO:tasks.workunit.client.0.smithi040.stdout:1/932: dread d1/d1c/d7b/d2e/d3e/f6a [0,4194304] 0 2024-04-18T10:42:53.586 INFO:tasks.workunit.client.0.smithi040.stdout:5/907: rename d0/d3b/d3f/db1/df2/f11d to d0/f129 0 2024-04-18T10:42:53.587 INFO:tasks.workunit.client.0.smithi040.stdout:5/908: dread - d0/d78/f82 zero size 2024-04-18T10:42:53.587 INFO:tasks.workunit.client.0.smithi040.stdout:9/969: mknod d2/d5b/d6f/d80/d75/d124/d22/db3/c15b 0 2024-04-18T10:42:53.587 INFO:tasks.workunit.client.0.smithi040.stdout:0/996: dread dd/df/d19/d3e/fcd [0,4194304] 0 2024-04-18T10:42:53.588 INFO:tasks.workunit.client.0.smithi040.stdout:9/970: dread - d2/d5b/f3e zero size 2024-04-18T10:42:53.589 INFO:tasks.workunit.client.0.smithi040.stdout:6/963: sync 2024-04-18T10:42:53.589 INFO:tasks.workunit.client.0.smithi040.stdout:0/997: fdatasync dd/df/d19/d28/d3a/d46/d107/f116 0 2024-04-18T10:42:53.590 INFO:tasks.workunit.client.0.smithi040.stdout:7/894: write d6/d50/d79/d9a/dfa/d10a/fa3 [2183050,82049] 0 2024-04-18T10:42:53.590 INFO:tasks.workunit.client.0.smithi040.stdout:0/998: stat dd/df/d19/f87 0 2024-04-18T10:42:53.593 INFO:tasks.workunit.client.0.smithi040.stdout:1/933: chown d1/d1c/d2b/d32/fd9 0 1 2024-04-18T10:42:53.594 INFO:tasks.workunit.client.0.smithi040.stdout:1/934: readlink d1/d1c/d2b/d32/d36/l108 0 2024-04-18T10:42:53.594 INFO:tasks.workunit.client.0.smithi040.stdout:9/971: mkdir d2/d5b/d6f/d15c 0 2024-04-18T10:42:53.595 INFO:tasks.workunit.client.0.smithi040.stdout:0/999: dread dd/df/d19/d28/d3a/f9d [0,4194304] 0 2024-04-18T10:42:53.601 INFO:tasks.workunit.client.0.smithi040.stdout:4/909: getdents d2/d3/d4/d23/dea/d28 0 2024-04-18T10:42:53.603 INFO:tasks.workunit.client.0.smithi040.stdout:1/935: creat d1/d16/d92/dad/f13e x:0 0 0 2024-04-18T10:42:53.606 INFO:tasks.workunit.client.0.smithi040.stdout:3/955: truncate d1/d7/d28/f61 3097802 0 2024-04-18T10:42:53.607 INFO:tasks.workunit.client.0.smithi040.stdout:6/964: unlink df/d4b/d6e/l39 0 2024-04-18T10:42:53.608 INFO:tasks.workunit.client.0.smithi040.stdout:1/936: fsync d1/d1c/d2b/f5e 0 2024-04-18T10:42:53.609 INFO:tasks.workunit.client.0.smithi040.stdout:4/910: dwrite d2/d3/d4/d1f/daa/fe0 [0,4194304] 0 2024-04-18T10:42:53.609 INFO:tasks.workunit.client.0.smithi040.stdout:5/909: dread d0/d4e/d8e/feb [4194304,4194304] 0 2024-04-18T10:42:53.611 INFO:tasks.workunit.client.0.smithi040.stdout:2/892: truncate dd/d61/f70 2164682 0 2024-04-18T10:42:53.611 INFO:tasks.workunit.client.0.smithi040.stdout:1/937: chown d1/d16/d92/dad/lf5 5515 1 2024-04-18T10:42:53.613 INFO:tasks.workunit.client.0.smithi040.stdout:3/956: symlink d1/d7/d67/l13f 0 2024-04-18T10:42:53.613 INFO:tasks.workunit.client.0.smithi040.stdout:9/972: link d2/d5b/d13a/d85/ded/d125/c56 d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/dc4/de4/c15d 0 2024-04-18T10:42:53.613 INFO:tasks.workunit.client.0.smithi040.stdout:4/911: stat d2/d3/d41/d47/d6f/ca7 0 2024-04-18T10:42:53.613 INFO:tasks.workunit.client.0.smithi040.stdout:6/965: truncate df/d4b/d99/dc4/d10c/da7/fd5 461165 0 2024-04-18T10:42:53.614 INFO:tasks.workunit.client.0.smithi040.stdout:5/910: unlink d0/d3b/d88/f94 0 2024-04-18T10:42:53.616 INFO:tasks.workunit.client.0.smithi040.stdout:5/911: fsync d0/d3b/d3f/f45 0 2024-04-18T10:42:53.616 INFO:tasks.workunit.client.0.smithi040.stdout:9/973: write d2/d5b/d6f/d80/d75/d124/d22/f6a [333114,93904] 0 2024-04-18T10:42:53.621 INFO:tasks.workunit.client.0.smithi040.stdout:4/912: dread d2/d3/d4/d1f/daa/fe0 [0,4194304] 0 2024-04-18T10:42:53.621 INFO:tasks.workunit.client.0.smithi040.stdout:6/966: dwrite df/d4b/d6a/fe6 [0,4194304] 0 2024-04-18T10:42:53.631 INFO:tasks.workunit.client.0.smithi040.stdout:3/957: mkdir d1/d2/d140 0 2024-04-18T10:42:53.636 INFO:tasks.workunit.client.0.smithi040.stdout:3/958: symlink d1/d7/d12/d7b/l141 0 2024-04-18T10:42:53.636 INFO:tasks.workunit.client.0.smithi040.stdout:2/893: dwrite dd/d61/d81/dfb/d4a/d54/f8a [0,4194304] 0 2024-04-18T10:42:53.637 INFO:tasks.workunit.client.0.smithi040.stdout:1/938: rename d1/d1c/d2b/fa0 to d1/d9b/d75/f13f 0 2024-04-18T10:42:53.640 INFO:tasks.workunit.client.0.smithi040.stdout:3/959: write d1/d2/d4e/d58/dbe/dc1/dc2/fce [438358,79842] 0 2024-04-18T10:42:53.640 INFO:tasks.workunit.client.0.smithi040.stdout:9/974: creat d2/d5b/f15e x:0 0 0 2024-04-18T10:42:53.642 INFO:tasks.workunit.client.0.smithi040.stdout:1/939: dread - d1/d1c/d2b/d32/d36/d4d/d67/dcb/f122 zero size 2024-04-18T10:42:53.643 INFO:tasks.workunit.client.0.smithi040.stdout:2/894: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/f12d x:0 0 0 2024-04-18T10:42:53.643 INFO:tasks.workunit.client.0.smithi040.stdout:4/913: link d2/d3/d41/l96 d2/d1a/d8e/l10f 0 2024-04-18T10:42:53.645 INFO:tasks.workunit.client.0.smithi040.stdout:2/895: fsync dd/d61/d81/dfb/d2b/dbc/d5f/fb2 0 2024-04-18T10:42:53.645 INFO:tasks.workunit.client.0.smithi040.stdout:3/960: creat d1/d2/d4e/f142 x:0 0 0 2024-04-18T10:42:53.646 INFO:tasks.workunit.client.0.smithi040.stdout:9/975: mkdir d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/d15f 0 2024-04-18T10:42:53.646 INFO:tasks.workunit.client.0.smithi040.stdout:2/896: fsync dd/d61/d8e/d98/dcc/f124 0 2024-04-18T10:42:53.648 INFO:tasks.workunit.client.0.smithi040.stdout:1/940: rename d1/d1c/d7b/d2e/d39 to d1/d1c/d2b/d32/d35/d140 0 2024-04-18T10:42:53.649 INFO:tasks.workunit.client.0.smithi040.stdout:9/976: chown d2/d5b/d13a/d85/ded/d125/d8d/d11e 2539 1 2024-04-18T10:42:53.650 INFO:tasks.workunit.client.0.smithi040.stdout:5/912: dwrite d0/d3/d47/d106/d115/d5d/f69 [0,4194304] 0 2024-04-18T10:42:53.651 INFO:tasks.workunit.client.0.smithi040.stdout:4/914: creat d2/d3/d4/dd/dde/f110 x:0 0 0 2024-04-18T10:42:53.651 INFO:tasks.workunit.client.0.smithi040.stdout:9/977: readlink d2/d5b/d6f/d80/d75/d124/d22/d2e/l66 0 2024-04-18T10:42:53.652 INFO:tasks.workunit.client.0.smithi040.stdout:1/941: chown d1/d1c/c81 74056449 1 2024-04-18T10:42:53.653 INFO:tasks.workunit.client.0.smithi040.stdout:9/978: dread - d2/d5b/d6f/d80/d75/d124/d22/db3/f155 zero size 2024-04-18T10:42:53.655 INFO:tasks.workunit.client.0.smithi040.stdout:7/895: sync 2024-04-18T10:42:53.656 INFO:tasks.workunit.client.0.smithi040.stdout:4/915: creat d2/d3/d41/d62/db0/f111 x:0 0 0 2024-04-18T10:42:53.658 INFO:tasks.workunit.client.0.smithi040.stdout:1/942: rmdir d1/d1c/d2b/d32/d7e 39 2024-04-18T10:42:53.660 INFO:tasks.workunit.client.0.smithi040.stdout:5/913: creat d0/d3/d6b/d7b/d124/f12a x:0 0 0 2024-04-18T10:42:53.661 INFO:tasks.workunit.client.0.smithi040.stdout:9/979: dwrite d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/fdc [0,4194304] 0 2024-04-18T10:42:53.664 INFO:tasks.workunit.client.0.smithi040.stdout:1/943: unlink d1/d1c/d2b/db5/dcc/f11b 0 2024-04-18T10:42:53.666 INFO:tasks.workunit.client.0.smithi040.stdout:5/914: mknod d0/d78/c12b 0 2024-04-18T10:42:53.667 INFO:tasks.workunit.client.0.smithi040.stdout:7/896: mkdir d6/d25/d28/dac/db1/d110 0 2024-04-18T10:42:53.668 INFO:tasks.workunit.client.0.smithi040.stdout:4/916: creat d2/d3/d4/dd/d100/f112 x:0 0 0 2024-04-18T10:42:53.670 INFO:tasks.workunit.client.0.smithi040.stdout:9/980: fsync d2/d5b/d6f/d80/d75/d124/d22/d2e/f3d 0 2024-04-18T10:42:53.671 INFO:tasks.workunit.client.0.smithi040.stdout:1/944: symlink d1/d9b/d75/d125/l141 0 2024-04-18T10:42:53.671 INFO:tasks.workunit.client.0.smithi040.stdout:9/981: fsync d2/d7/f8 0 2024-04-18T10:42:53.672 INFO:tasks.workunit.client.0.smithi040.stdout:2/897: dwrite dd/d61/d81/dfb/d2b/d7c/d37/d38/fc8 [0,4194304] 0 2024-04-18T10:42:53.672 INFO:tasks.workunit.client.0.smithi040.stdout:5/915: fsync d0/d3b/d3f/f41 0 2024-04-18T10:42:53.673 INFO:tasks.workunit.client.0.smithi040.stdout:1/945: fdatasync d1/d1c/d7b/d2d/f63 0 2024-04-18T10:42:53.674 INFO:tasks.workunit.client.0.smithi040.stdout:4/917: creat d2/d3/d4/f113 x:0 0 0 2024-04-18T10:42:53.676 INFO:tasks.workunit.client.0.smithi040.stdout:5/916: rmdir d0/d3b/d88 39 2024-04-18T10:42:53.679 INFO:tasks.workunit.client.0.smithi040.stdout:2/898: symlink dd/d61/d81/l12e 0 2024-04-18T10:42:53.680 INFO:tasks.workunit.client.0.smithi040.stdout:6/967: sync 2024-04-18T10:42:53.682 INFO:tasks.workunit.client.0.smithi040.stdout:2/899: rmdir dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2 39 2024-04-18T10:42:53.683 INFO:tasks.workunit.client.0.smithi040.stdout:2/900: write dd/d61/d81/dfb/d2b/fc3 [3378388,110648] 0 2024-04-18T10:42:53.684 INFO:tasks.workunit.client.0.smithi040.stdout:6/968: rename df/d76/f80 to df/de8/d11e/f160 0 2024-04-18T10:42:53.684 INFO:tasks.workunit.client.0.smithi040.stdout:5/917: symlink d0/d3b/d117/l12c 0 2024-04-18T10:42:53.685 INFO:tasks.workunit.client.0.smithi040.stdout:6/969: dread - df/d4b/db7/dcc/dd6/ff0 zero size 2024-04-18T10:42:53.686 INFO:tasks.workunit.client.0.smithi040.stdout:6/970: chown df/d4b/d7e/c100 2967213 1 2024-04-18T10:42:53.688 INFO:tasks.workunit.client.0.smithi040.stdout:2/901: truncate dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/fd2 1043247 0 2024-04-18T10:42:53.693 INFO:tasks.workunit.client.0.smithi040.stdout:5/918: dwrite d0/d3/d47/d106/d115/d5d/f9e [0,4194304] 0 2024-04-18T10:42:53.694 INFO:tasks.workunit.client.0.smithi040.stdout:2/902: symlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/d122/l12f 0 2024-04-18T10:42:53.696 INFO:tasks.workunit.client.0.smithi040.stdout:2/903: chown dd/d61/d81/dfb/f22 1653 1 2024-04-18T10:42:53.697 INFO:tasks.workunit.client.0.smithi040.stdout:9/982: write d2/d5b/d6f/d80/d75/d124/d70/da8/f112 [753408,76952] 0 2024-04-18T10:42:53.699 INFO:tasks.workunit.client.0.smithi040.stdout:9/983: write d2/dd/de/f136 [174726,7361] 0 2024-04-18T10:42:53.699 INFO:tasks.workunit.client.0.smithi040.stdout:2/904: read dd/d61/d81/dfb/d2b/dbc/f99 [2711393,62402] 0 2024-04-18T10:42:53.700 INFO:tasks.workunit.client.0.smithi040.stdout:2/905: fdatasync dd/f105 0 2024-04-18T10:42:53.700 INFO:tasks.workunit.client.0.smithi040.stdout:7/897: dread d6/d25/d28/dac/d64/d101/f72 [0,4194304] 0 2024-04-18T10:42:53.700 INFO:tasks.workunit.client.0.smithi040.stdout:4/918: unlink d2/d3/d4/dd/d4f/fd3 0 2024-04-18T10:42:53.705 INFO:tasks.workunit.client.0.smithi040.stdout:9/984: rename d2/d5b/d6f/f152 to d2/d5b/d6f/d80/d75/d124/d14d/f160 0 2024-04-18T10:42:53.705 INFO:tasks.workunit.client.0.smithi040.stdout:6/971: truncate df/f2d 1980258 0 2024-04-18T10:42:53.707 INFO:tasks.workunit.client.0.smithi040.stdout:7/898: readlink d6/d25/d28/dac/d64/d101/d5c/d6b/ded/lbf 0 2024-04-18T10:42:53.708 INFO:tasks.workunit.client.0.smithi040.stdout:1/946: dwrite d1/d1c/d2b/db5/dd6/f136 [0,4194304] 0 2024-04-18T10:42:53.708 INFO:tasks.workunit.client.0.smithi040.stdout:4/919: rename d2/d3/d4/dd/f69 to d2/d3/d41/d94/f114 0 2024-04-18T10:42:53.710 INFO:tasks.workunit.client.0.smithi040.stdout:2/906: dwrite dd/d61/d81/dfb/d2b/fc3 [0,4194304] 0 2024-04-18T10:42:53.713 INFO:tasks.workunit.client.0.smithi040.stdout:7/899: fsync d6/d25/d28/dac/d64/d101/d5c/ff5 0 2024-04-18T10:42:53.714 INFO:tasks.workunit.client.0.smithi040.stdout:1/947: chown d1/d1c/d2b/d32/fc7 9321648 1 2024-04-18T10:42:53.715 INFO:tasks.workunit.client.0.smithi040.stdout:6/972: rename df/l2b to df/d4b/d63/db3/l161 0 2024-04-18T10:42:53.717 INFO:tasks.workunit.client.0.smithi040.stdout:4/920: rmdir d2/d3/d4/d23/dea/d28/d3f 39 2024-04-18T10:42:53.718 INFO:tasks.workunit.client.0.smithi040.stdout:2/907: creat dd/d61/d81/dfb/d2b/d7c/d37/d5b/f130 x:0 0 0 2024-04-18T10:42:53.719 INFO:tasks.workunit.client.0.smithi040.stdout:7/900: creat d6/d50/d79/d9a/f111 x:0 0 0 2024-04-18T10:42:53.719 INFO:tasks.workunit.client.0.smithi040.stdout:7/901: readlink d6/d3e/lcb 0 2024-04-18T10:42:53.721 INFO:tasks.workunit.client.0.smithi040.stdout:1/948: unlink d1/d1c/d7b/d2e/d3e/l11f 0 2024-04-18T10:42:53.721 INFO:tasks.workunit.client.0.smithi040.stdout:7/902: write d6/d25/d28/dac/d64/d101/d5c/da2/db6/fc5 [324639,36140] 0 2024-04-18T10:42:53.723 INFO:tasks.workunit.client.0.smithi040.stdout:4/921: mknod d2/d3/d4/d23/dea/da4/c115 0 2024-04-18T10:42:53.724 INFO:tasks.workunit.client.0.smithi040.stdout:7/903: chown d6/d25/c26 486 1 2024-04-18T10:42:53.724 INFO:tasks.workunit.client.0.smithi040.stdout:2/908: chown dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/cd6 2095297940 1 2024-04-18T10:42:53.725 INFO:tasks.workunit.client.0.smithi040.stdout:1/949: dread d1/d1c/d7b/d2e/d3e/f6a [0,4194304] 0 2024-04-18T10:42:53.725 INFO:tasks.workunit.client.0.smithi040.stdout:7/904: dread - d6/d25/dcf/de4/ff3 zero size 2024-04-18T10:42:53.726 INFO:tasks.workunit.client.0.smithi040.stdout:4/922: creat d2/d3/d2f/dce/f116 x:0 0 0 2024-04-18T10:42:53.729 INFO:tasks.workunit.client.0.smithi040.stdout:1/950: fdatasync d1/d1c/d2b/d32/d36/d4d/f62 0 2024-04-18T10:42:53.729 INFO:tasks.workunit.client.0.smithi040.stdout:4/923: rmdir d2/d3/d4/d23 39 2024-04-18T10:42:53.730 INFO:tasks.workunit.client.0.smithi040.stdout:2/909: dread dd/d61/d81/dfb/d2b/d7c/d37/d38/fc8 [0,4194304] 0 2024-04-18T10:42:53.732 INFO:tasks.workunit.client.0.smithi040.stdout:1/951: creat d1/d1c/d2b/d32/d35/f142 x:0 0 0 2024-04-18T10:42:53.734 INFO:tasks.workunit.client.0.smithi040.stdout:1/952: truncate d1/d1c/d7b/d2e/d9e/fc4 746083 0 2024-04-18T10:42:53.738 INFO:tasks.workunit.client.0.smithi040.stdout:3/961: sync 2024-04-18T10:42:53.740 INFO:tasks.workunit.client.0.smithi040.stdout:2/910: dwrite dd/d61/d81/dfb/d2b/d7c/d37/da3/dc1/ffd [0,4194304] 0 2024-04-18T10:42:53.742 INFO:tasks.workunit.client.0.smithi040.stdout:1/953: rename d1/d1c/d7b/c40 to d1/d1c/d2b/db5/c143 0 2024-04-18T10:42:53.749 INFO:tasks.workunit.client.0.smithi040.stdout:4/924: mknod d2/d3/d4/d23/dea/d28/de1/dff/c117 0 2024-04-18T10:42:53.749 INFO:tasks.workunit.client.0.smithi040.stdout:9/985: write d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/f13e [1117849,775] 0 2024-04-18T10:42:53.749 INFO:tasks.workunit.client.0.smithi040.stdout:3/962: mkdir d1/d7/d67/d123/d9b/d143 0 2024-04-18T10:42:53.750 INFO:tasks.workunit.client.0.smithi040.stdout:3/963: chown d1/d7/d28/db7 371 1 2024-04-18T10:42:53.754 INFO:tasks.workunit.client.0.smithi040.stdout:6/973: dread df/d4b/d6e/d3f/d12e/f15c [0,4194304] 0 2024-04-18T10:42:53.755 INFO:tasks.workunit.client.0.smithi040.stdout:3/964: symlink d1/d2/d4e/d58/dbe/dc1/dc2/l144 0 2024-04-18T10:42:53.757 INFO:tasks.workunit.client.0.smithi040.stdout:9/986: creat d2/d7/f161 x:0 0 0 2024-04-18T10:42:53.761 INFO:tasks.workunit.client.0.smithi040.stdout:4/925: link d2/d3/d41/d94/fdf d2/d3/d4/d23/dea/f118 0 2024-04-18T10:42:53.763 INFO:tasks.workunit.client.0.smithi040.stdout:6/974: creat df/d4b/d6e/d3f/f162 x:0 0 0 2024-04-18T10:42:53.764 INFO:tasks.workunit.client.0.smithi040.stdout:7/905: dwrite d6/fa [4194304,4194304] 0 2024-04-18T10:42:53.766 INFO:tasks.workunit.client.0.smithi040.stdout:9/987: dwrite d2/f19 [0,4194304] 0 2024-04-18T10:42:53.767 INFO:tasks.workunit.client.0.smithi040.stdout:4/926: mkdir d2/d3/d4/dd/d4f/d119 0 2024-04-18T10:42:53.769 INFO:tasks.workunit.client.0.smithi040.stdout:6/975: mknod df/d4b/db7/dcc/dd6/c163 0 2024-04-18T10:42:53.770 INFO:tasks.workunit.client.0.smithi040.stdout:4/927: chown d2/d3/d4/d1f/d29/d49/l16 6 1 2024-04-18T10:42:53.775 INFO:tasks.workunit.client.0.smithi040.stdout:4/928: fdatasync d2/d3/f4e 0 2024-04-18T10:42:53.775 INFO:tasks.workunit.client.0.smithi040.stdout:7/906: dread d6/d25/d28/fcd [0,4194304] 0 2024-04-18T10:42:53.775 INFO:tasks.workunit.client.0.smithi040.stdout:3/965: write d1/f4f [1042585,85853] 0 2024-04-18T10:42:53.777 INFO:tasks.workunit.client.0.smithi040.stdout:4/929: readlink d2/d3/d4/d23/dea/da4/la5 0 2024-04-18T10:42:53.777 INFO:tasks.workunit.client.0.smithi040.stdout:1/954: dread d1/f77 [0,4194304] 0 2024-04-18T10:42:53.778 INFO:tasks.workunit.client.0.smithi040.stdout:9/988: rename d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/c38 to d2/dd/de/d13b/c162 0 2024-04-18T10:42:53.778 INFO:tasks.workunit.client.0.smithi040.stdout:7/907: chown d6/d50/d79/d9a/dfa/d10a/cfe 2 1 2024-04-18T10:42:53.779 INFO:tasks.workunit.client.0.smithi040.stdout:3/966: creat d1/d7/d28/db7/dfa/f145 x:0 0 0 2024-04-18T10:42:53.779 INFO:tasks.workunit.client.0.smithi040.stdout:4/930: symlink d2/d3/d41/d62/d9a/l11a 0 2024-04-18T10:42:53.781 INFO:tasks.workunit.client.0.smithi040.stdout:7/908: write d6/d25/d28/fcd [5369,59715] 0 2024-04-18T10:42:53.781 INFO:tasks.workunit.client.0.smithi040.stdout:3/967: write d1/f74 [5046559,95089] 0 2024-04-18T10:42:53.785 INFO:tasks.workunit.client.0.smithi040.stdout:7/909: truncate d6/d25/d28/fcd 439165 0 2024-04-18T10:42:53.785 INFO:tasks.workunit.client.0.smithi040.stdout:9/989: dwrite d2/d5b/f15e [0,4194304] 0 2024-04-18T10:42:53.787 INFO:tasks.workunit.client.0.smithi040.stdout:4/931: rename d2/d1a/d8e/fbe to d2/d3/d4/d23/dea/d28/d3f/f11b 0 2024-04-18T10:42:53.789 INFO:tasks.workunit.client.0.smithi040.stdout:7/910: creat d6/d25/d28/dac/d64/d101/d5c/d6b/f112 x:0 0 0 2024-04-18T10:42:53.793 INFO:tasks.workunit.client.0.smithi040.stdout:3/968: rename d1/d2/d4e/d58/db4/fe6 to d1/d2/d4e/d58/f146 0 2024-04-18T10:42:53.795 INFO:tasks.workunit.client.0.smithi040.stdout:4/932: mknod d2/d3/d4/d1f/d29/d49/d31/c11c 0 2024-04-18T10:42:53.797 INFO:tasks.workunit.client.0.smithi040.stdout:7/911: read d6/d25/d28/dac/d64/d101/d55/d58/fc9 [69552,112878] 0 2024-04-18T10:42:53.799 INFO:tasks.workunit.client.0.smithi040.stdout:6/976: dread df/d4b/d6e/f40 [0,4194304] 0 2024-04-18T10:42:53.799 INFO:tasks.workunit.client.0.smithi040.stdout:4/933: fsync d2/d3/d4/d1f/fe4 0 2024-04-18T10:42:53.809 INFO:tasks.workunit.client.0.smithi040.stdout:3/969: getdents d1/d7/d67/dc5/d91 0 2024-04-18T10:42:53.810 INFO:tasks.workunit.client.0.smithi040.stdout:4/934: link d2/f2c d2/d3/f11d 0 2024-04-18T10:42:53.811 INFO:tasks.workunit.client.0.smithi040.stdout:7/912: write d6/f32 [2153041,97007] 0 2024-04-18T10:42:53.811 INFO:tasks.workunit.client.0.smithi040.stdout:6/977: write df/d4b/d6e/f33 [4042670,26008] 0 2024-04-18T10:42:53.812 INFO:tasks.workunit.client.0.smithi040.stdout:9/990: dwrite d2/d5b/d6f/d80/d75/d124/d22/db3/f123 [0,4194304] 0 2024-04-18T10:42:53.812 INFO:tasks.workunit.client.0.smithi040.stdout:4/935: chown d2/d3/d41/d62/d9a/fd2 28472 1 2024-04-18T10:42:53.813 INFO:tasks.workunit.client.0.smithi040.stdout:5/919: sync 2024-04-18T10:42:53.814 INFO:tasks.workunit.client.0.smithi040.stdout:7/913: chown d6/d25/d28/dac/d64/d7e/laf 61 1 2024-04-18T10:42:53.816 INFO:tasks.workunit.client.0.smithi040.stdout:9/991: creat d2/d5b/d13a/d100/f163 x:0 0 0 2024-04-18T10:42:53.816 INFO:tasks.workunit.client.0.smithi040.stdout:6/978: creat df/d76/d110/f164 x:0 0 0 2024-04-18T10:42:53.818 INFO:tasks.workunit.client.0.smithi040.stdout:5/920: rename d0/d3/c28 to d0/d3b/d117/c12d 0 2024-04-18T10:42:53.821 INFO:tasks.workunit.client.0.smithi040.stdout:5/921: dread d0/d3b/d3f/f65 [4194304,4194304] 0 2024-04-18T10:42:53.821 INFO:tasks.workunit.client.0.smithi040.stdout:6/979: rename df/d4b/d99/dc4/c13b to df/d4b/d99/dc4/d10c/de1/c165 0 2024-04-18T10:42:53.823 INFO:tasks.workunit.client.0.smithi040.stdout:7/914: getdents d6/d25/d28/dac/d64/d101/d55/d9f 0 2024-04-18T10:42:53.825 INFO:tasks.workunit.client.0.smithi040.stdout:9/992: link d2/dd/l3f d2/d5b/d13a/d85/ded/l164 0 2024-04-18T10:42:53.826 INFO:tasks.workunit.client.0.smithi040.stdout:9/993: write d2/f55 [2679194,7386] 0 2024-04-18T10:42:53.827 INFO:tasks.workunit.client.0.smithi040.stdout:7/915: unlink d6/d50/d79/d9a/dfa/d10a/lae 0 2024-04-18T10:42:53.829 INFO:tasks.workunit.client.0.smithi040.stdout:9/994: mkdir d2/d5b/d6f/d80/d75/d124/d22/d2e/d35/daf/dc1/d46/d5f/d165 0 2024-04-18T10:42:53.829 INFO:tasks.workunit.client.0.smithi040.stdout:6/980: link df/d4b/d6a/d93/l141 df/d4b/d99/dc4/d10c/de1/l166 0 2024-04-18T10:42:53.831 INFO:tasks.workunit.client.0.smithi040.stdout:6/981: truncate df/d76/d110/f164 375846 0 2024-04-18T10:42:53.833 INFO:tasks.workunit.client.0.smithi040.stdout:7/916: dread d6/f1f [0,4194304] 0 2024-04-18T10:42:53.833 INFO:tasks.workunit.client.0.smithi040.stdout:6/982: write df/d4b/d99/dc4/d10c/f119 [4956458,35331] 0 2024-04-18T10:42:53.838 INFO:tasks.workunit.client.0.smithi040.stdout:4/936: dread d2/d3/d4/d1f/fe4 [0,4194304] 0 2024-04-18T10:42:53.838 INFO:tasks.workunit.client.0.smithi040.stdout:6/983: mknod df/d4b/d99/dc4/d10c/c167 0 2024-04-18T10:42:53.840 INFO:tasks.workunit.client.0.smithi040.stdout:7/917: dwrite d6/d25/d28/ffd [0,4194304] 0 2024-04-18T10:42:53.841 INFO:tasks.workunit.client.0.smithi040.stdout:6/984: stat df/de8/d11e/f160 0 2024-04-18T10:42:53.843 INFO:tasks.workunit.client.0.smithi040.stdout:7/918: truncate d6/d25/d28/ffd 4302460 0 2024-04-18T10:42:53.844 INFO:tasks.workunit.client.0.smithi040.stdout:9/995: write d2/d5b/d13a/d85/ded/f133 [2619750,103148] 0 2024-04-18T10:42:53.844 INFO:tasks.workunit.client.0.smithi040.stdout:7/919: chown d6/d25/d28/dac/l9c 7224599 1 2024-04-18T10:42:53.845 INFO:tasks.workunit.client.0.smithi040.stdout:4/937: write d2/d3/d4/d1f/d29/d49/d31/f88 [4786496,20483] 0 2024-04-18T10:42:53.846 INFO:tasks.workunit.client.0.smithi040.stdout:5/922: dread d0/d4e/f4c [0,4194304] 0 2024-04-18T10:42:53.846 INFO:tasks.workunit.client.0.smithi040.stdout:6/985: fsync df/d76/dc2/dce/f14d 0 2024-04-18T10:42:53.847 INFO:tasks.workunit.client.0.smithi040.stdout:7/920: rename d6/d25/d28/dac/d64/d101 to d6/d25/d28/dac/d64/d101/d5c/da2/db6/d113 22 2024-04-18T10:42:53.849 INFO:tasks.workunit.client.0.smithi040.stdout:9/996: creat d2/d5b/f166 x:0 0 0 2024-04-18T10:42:53.850 INFO:tasks.workunit.client.0.smithi040.stdout:6/986: mknod df/d76/d91/d12b/c168 0 2024-04-18T10:42:53.855 INFO:tasks.workunit.client.0.smithi040.stdout:9/997: creat d2/d5b/d6f/d15c/f167 x:0 0 0 2024-04-18T10:42:53.856 INFO:tasks.workunit.client.0.smithi040.stdout:5/923: link d0/d3/d6b/d7b/lb0 d0/d78/dc4/l12e 0 2024-04-18T10:42:53.860 INFO:tasks.workunit.client.0.smithi040.stdout:6/987: write df/d4b/d7e/fb2 [2857751,125268] 0 2024-04-18T10:42:53.862 INFO:tasks.workunit.client.0.smithi040.stdout:5/924: dwrite d0/d3b/d3f/fbd [0,4194304] 0 2024-04-18T10:42:53.864 INFO:tasks.workunit.client.0.smithi040.stdout:6/988: write df/d4b/d6e/f40 [2188233,9328] 0 2024-04-18T10:42:53.868 INFO:tasks.workunit.client.0.smithi040.stdout:6/989: chown df/d4b/d6a/d93/l149 198 1 2024-04-18T10:42:53.868 INFO:tasks.workunit.client.0.smithi040.stdout:5/925: fsync d0/d3/f10 0 2024-04-18T10:42:53.869 INFO:tasks.workunit.client.0.smithi040.stdout:7/921: dwrite d6/d25/d28/dac/d64/d101/d5c/da2/fe8 [0,4194304] 0 2024-04-18T10:42:53.870 INFO:tasks.workunit.client.0.smithi040.stdout:9/998: dwrite d2/dd/f98 [0,4194304] 0 2024-04-18T10:42:53.872 INFO:tasks.workunit.client.0.smithi040.stdout:7/922: stat d6/d25/d28/dac/d64/d101/d5c/d6b/f112 0 2024-04-18T10:42:53.872 INFO:tasks.workunit.client.0.smithi040.stdout:2/911: sync 2024-04-18T10:42:53.873 INFO:tasks.workunit.client.0.smithi040.stdout:5/926: symlink d0/d3/d47/d106/l12f 0 2024-04-18T10:42:53.873 INFO:tasks.workunit.client.0.smithi040.stdout:6/990: read df/d4b/d6a/d93/f116 [1224652,76345] 0 2024-04-18T10:42:53.873 INFO:tasks.workunit.client.0.smithi040.stdout:9/999: truncate d2/d5b/d13a/f68 3332798 0 2024-04-18T10:42:53.874 INFO:tasks.workunit.client.0.smithi040.stdout:7/923: write d6/d25/d28/dac/d64/d101/d5c/ff5 [812780,79890] 0 2024-04-18T10:42:53.877 INFO:tasks.workunit.client.0.smithi040.stdout:7/924: creat d6/dc1/df8/f114 x:0 0 0 2024-04-18T10:42:53.881 INFO:tasks.workunit.client.0.smithi040.stdout:7/925: creat d6/d25/d28/f115 x:0 0 0 2024-04-18T10:42:53.881 INFO:tasks.workunit.client.0.smithi040.stdout:6/991: dwrite df/d4b/d6e/d3f/d53/fc0 [0,4194304] 0 2024-04-18T10:42:53.884 INFO:tasks.workunit.client.0.smithi040.stdout:7/926: readlink d6/d25/d28/dac/l4f 0 2024-04-18T10:42:53.884 INFO:tasks.workunit.client.0.smithi040.stdout:6/992: symlink df/d76/d91/l169 0 2024-04-18T10:42:53.888 INFO:tasks.workunit.client.0.smithi040.stdout:6/993: unlink df/d4b/d6e/d3f/d53/d8a/lba 0 2024-04-18T10:42:53.888 INFO:tasks.workunit.client.0.smithi040.stdout:4/938: sync 2024-04-18T10:42:53.888 INFO:tasks.workunit.client.0.smithi040.stdout:1/955: sync 2024-04-18T10:42:53.888 INFO:tasks.workunit.client.0.smithi040.stdout:3/970: sync 2024-04-18T10:42:53.889 INFO:tasks.workunit.client.0.smithi040.stdout:6/994: stat df/d4b/db7/df6/d12a 0 2024-04-18T10:42:53.890 INFO:tasks.workunit.client.0.smithi040.stdout:1/956: chown d1/d1c/d7b/d2e/d9e/fc4 150177317 1 2024-04-18T10:42:53.890 INFO:tasks.workunit.client.0.smithi040.stdout:3/971: chown d1/d2/d4e/d58/dbe/dc1/dc2/fce 14546977 1 2024-04-18T10:42:53.891 INFO:tasks.workunit.client.0.smithi040.stdout:4/939: chown d2/d3/d4/d1f/d29/d49/f45 0 1 2024-04-18T10:42:53.893 INFO:tasks.workunit.client.0.smithi040.stdout:1/957: mknod d1/d1c/d2b/db5/dd6/c144 0 2024-04-18T10:42:53.894 INFO:tasks.workunit.client.0.smithi040.stdout:6/995: creat df/d4b/d6e/f16a x:0 0 0 2024-04-18T10:42:53.895 INFO:tasks.workunit.client.0.smithi040.stdout:1/958: symlink d1/d9b/l145 0 2024-04-18T10:42:53.898 INFO:tasks.workunit.client.0.smithi040.stdout:1/959: mkdir d1/d1c/d2b/db5/dd6/d146 0 2024-04-18T10:42:53.899 INFO:tasks.workunit.client.0.smithi040.stdout:3/972: dwrite d1/d7/f53 [0,4194304] 0 2024-04-18T10:42:53.904 INFO:tasks.workunit.client.0.smithi040.stdout:6/996: dwrite df/d4b/db7/dcc/dd6/f115 [0,4194304] 0 2024-04-18T10:42:53.908 INFO:tasks.workunit.client.0.smithi040.stdout:1/960: dwrite d1/d1c/d7b/d2e/d9e/fab [0,4194304] 0 2024-04-18T10:42:53.909 INFO:tasks.workunit.client.0.smithi040.stdout:1/961: chown d1/d1c/f9d 12153939 1 2024-04-18T10:42:53.913 INFO:tasks.workunit.client.0.smithi040.stdout:5/927: dread d0/d3/f2b [0,4194304] 0 2024-04-18T10:42:53.913 INFO:tasks.workunit.client.0.smithi040.stdout:2/912: truncate dd/d61/d81/dfb/d4a/fc9 3942982 0 2024-04-18T10:42:53.913 INFO:tasks.workunit.client.0.smithi040.stdout:1/962: mkdir d1/d1c/d7b/d2e/da4/d107/d147 0 2024-04-18T10:42:53.914 INFO:tasks.workunit.client.0.smithi040.stdout:5/928: write d0/d3/d6b/d7b/d124/f12a [490400,27196] 0 2024-04-18T10:42:53.915 INFO:tasks.workunit.client.0.smithi040.stdout:1/963: chown d1/d1c/d7b/f98 16047 1 2024-04-18T10:42:53.917 INFO:tasks.workunit.client.0.smithi040.stdout:1/964: read d1/d16/f29 [1508897,40780] 0 2024-04-18T10:42:53.917 INFO:tasks.workunit.client.0.smithi040.stdout:6/997: creat df/d4b/d63/dbb/f16b x:0 0 0 2024-04-18T10:42:53.917 INFO:tasks.workunit.client.0.smithi040.stdout:5/929: write d0/d3/d47/d106/d115/d5d/ff6 [215725,28074] 0 2024-04-18T10:42:53.918 INFO:tasks.workunit.client.0.smithi040.stdout:2/913: truncate dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/ddf/fec 928897 0 2024-04-18T10:42:53.920 INFO:tasks.workunit.client.0.smithi040.stdout:6/998: mkdir df/d4b/d63/db3/d16c 0 2024-04-18T10:42:53.922 INFO:tasks.workunit.client.0.smithi040.stdout:1/965: dread d1/d1c/d7b/d2e/d3e/fde [0,4194304] 0 2024-04-18T10:42:53.923 INFO:tasks.workunit.client.0.smithi040.stdout:6/999: creat df/d76/d110/f16d x:0 0 0 2024-04-18T10:42:53.923 INFO:tasks.workunit.client.0.smithi040.stdout:7/927: sync 2024-04-18T10:42:53.923 INFO:tasks.workunit.client.0.smithi040.stdout:5/930: write d0/d3b/d88/f10a [1014046,2664] 0 2024-04-18T10:42:53.925 INFO:tasks.workunit.client.0.smithi040.stdout:2/914: getdents dd/d61/d81/dfb/d2b/d7c/d37/d38/d8c 0 2024-04-18T10:42:53.927 INFO:tasks.workunit.client.0.smithi040.stdout:1/966: write d1/d1c/d7b/d2e/f118 [293190,63968] 0 2024-04-18T10:42:53.929 INFO:tasks.workunit.client.0.smithi040.stdout:4/940: dwrite d2/d3/d41/d62/f10a [0,4194304] 0 2024-04-18T10:42:53.929 INFO:tasks.workunit.client.0.smithi040.stdout:5/931: creat d0/d3b/d3f/f130 x:0 0 0 2024-04-18T10:42:53.930 INFO:tasks.workunit.client.0.smithi040.stdout:1/967: write d1/d1c/d7b/d2e/f88 [2858134,64353] 0 2024-04-18T10:42:53.931 INFO:tasks.workunit.client.0.smithi040.stdout:2/915: mkdir dd/d61/d81/dfb/d2b/dbc/d131 0 2024-04-18T10:42:53.935 INFO:tasks.workunit.client.0.smithi040.stdout:7/928: rename d6/dc1/l102 to d6/d25/d28/dac/d64/d101/d5c/d6b/l116 0 2024-04-18T10:42:53.939 INFO:tasks.workunit.client.0.smithi040.stdout:3/973: dread d1/d2/d4e/d58/d62/fd6 [0,4194304] 0 2024-04-18T10:42:53.941 INFO:tasks.workunit.client.0.smithi040.stdout:2/916: dwrite dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/dc5/f10f [0,4194304] 0 2024-04-18T10:42:53.941 INFO:tasks.workunit.client.0.smithi040.stdout:5/932: fdatasync d0/d3b/d3f/de9/f116 0 2024-04-18T10:42:53.944 INFO:tasks.workunit.client.0.smithi040.stdout:4/941: dread d2/d3/d4/dd/f48 [0,4194304] 0 2024-04-18T10:42:53.945 INFO:tasks.workunit.client.0.smithi040.stdout:3/974: truncate d1/d2/f48 2598733 0 2024-04-18T10:42:53.946 INFO:tasks.workunit.client.0.smithi040.stdout:1/968: creat d1/d1c/f148 x:0 0 0 2024-04-18T10:42:53.946 INFO:tasks.workunit.client.0.smithi040.stdout:3/975: chown d1/d7/d67/dc5/d91/db1/d104 70 1 2024-04-18T10:42:53.947 INFO:tasks.workunit.client.0.smithi040.stdout:3/976: dread - d1/d2/d4e/f142 zero size 2024-04-18T10:42:53.948 INFO:tasks.workunit.client.0.smithi040.stdout:1/969: chown d1/d1c/d2b/d32/dfd/c113 4396 1 2024-04-18T10:42:53.948 INFO:tasks.workunit.client.0.smithi040.stdout:3/977: stat d1/d2/d4e/c86 0 2024-04-18T10:42:53.949 INFO:tasks.workunit.client.0.smithi040.stdout:3/978: fsync d1/d7/d67/dc5/fdb 0 2024-04-18T10:42:53.949 INFO:tasks.workunit.client.0.smithi040.stdout:3/979: readlink d1/d7/d28/d81/l12e 0 2024-04-18T10:42:53.950 INFO:tasks.workunit.client.0.smithi040.stdout:7/929: creat d6/d25/d28/f117 x:0 0 0 2024-04-18T10:42:53.953 INFO:tasks.workunit.client.0.smithi040.stdout:4/942: rename d2/d3/d4/dd/d6d/d70 to d2/d3/d41/d47/d6f/d11e 0 2024-04-18T10:42:53.954 INFO:tasks.workunit.client.0.smithi040.stdout:4/943: fdatasync d2/fe9 0 2024-04-18T10:42:53.957 INFO:tasks.workunit.client.0.smithi040.stdout:1/970: mknod d1/d16/c149 0 2024-04-18T10:42:53.959 INFO:tasks.workunit.client.0.smithi040.stdout:3/980: dread d1/d7/db2/dc0/f119 [0,4194304] 0 2024-04-18T10:42:53.960 INFO:tasks.workunit.client.0.smithi040.stdout:1/971: read d1/d1c/d2b/d32/d36/d4d/d67/fd4 [567276,125559] 0 2024-04-18T10:42:53.960 INFO:tasks.workunit.client.0.smithi040.stdout:7/930: mkdir d6/d25/d28/dac/d64/d101/d5c/d118 0 2024-04-18T10:42:53.960 INFO:tasks.workunit.client.0.smithi040.stdout:4/944: symlink d2/d1a/d8e/d103/l11f 0 2024-04-18T10:42:53.962 INFO:tasks.workunit.client.0.smithi040.stdout:2/917: getdents dd/d61/d81/dfb/d2b/d7c/d37/da3 0 2024-04-18T10:42:53.965 INFO:tasks.workunit.client.0.smithi040.stdout:3/981: mkdir d1/d7/d67/dc5/d91/db1/d147 0 2024-04-18T10:42:53.965 INFO:tasks.workunit.client.0.smithi040.stdout:7/931: dread d6/d25/d28/dac/d64/d101/d55/d58/d6c/faa [0,4194304] 0 2024-04-18T10:42:53.967 INFO:tasks.workunit.client.0.smithi040.stdout:1/972: unlink d1/d16/c22 0 2024-04-18T10:42:53.971 INFO:tasks.workunit.client.0.smithi040.stdout:7/932: symlink d6/d25/dcf/de4/d2d/l119 0 2024-04-18T10:42:53.972 INFO:tasks.workunit.client.0.smithi040.stdout:5/933: dwrite d0/d3b/d3f/f65 [0,4194304] 0 2024-04-18T10:42:53.973 INFO:tasks.workunit.client.0.smithi040.stdout:3/982: dwrite d1/d2/d4e/d58/d62/faa [0,4194304] 0 2024-04-18T10:42:53.973 INFO:tasks.workunit.client.0.smithi040.stdout:4/945: mkdir d2/d3/d4/d1f/d29/dfd/d120 0 2024-04-18T10:42:53.974 INFO:tasks.workunit.client.0.smithi040.stdout:1/973: symlink d1/d1c/d2b/db5/dd6/l14a 0 2024-04-18T10:42:53.977 INFO:tasks.workunit.client.0.smithi040.stdout:7/933: symlink d6/d25/dcf/de4/d3c/l11a 0 2024-04-18T10:42:53.977 INFO:tasks.workunit.client.0.smithi040.stdout:4/946: mknod d2/d3/d2f/dce/c121 0 2024-04-18T10:42:53.979 INFO:tasks.workunit.client.0.smithi040.stdout:1/974: symlink d1/d1c/d7b/d2e/d9e/l14b 0 2024-04-18T10:42:53.980 INFO:tasks.workunit.client.0.smithi040.stdout:5/934: read d0/d21/f44 [1935801,45795] 0 2024-04-18T10:42:53.981 INFO:tasks.workunit.client.0.smithi040.stdout:4/947: truncate d2/d3/d4/dd/dde/f110 982938 0 2024-04-18T10:42:53.982 INFO:tasks.workunit.client.0.smithi040.stdout:5/935: write d0/d3b/d3f/d72/f89 [913555,124593] 0 2024-04-18T10:42:53.983 INFO:tasks.workunit.client.0.smithi040.stdout:7/934: rename d6/f1f to d6/d25/d28/dac/d64/d101/d5c/da2/de6/f11b 0 2024-04-18T10:42:53.985 INFO:tasks.workunit.client.0.smithi040.stdout:2/918: dwrite dd/d61/f68 [0,4194304] 0 2024-04-18T10:42:53.988 INFO:tasks.workunit.client.0.smithi040.stdout:1/975: rename d1/d9b/d75/f137 to d1/d1c/d7b/d2e/d9e/f14c 0 2024-04-18T10:42:53.989 INFO:tasks.workunit.client.0.smithi040.stdout:4/948: creat d2/d3/d4/d1f/d29/dfd/d120/f122 x:0 0 0 2024-04-18T10:42:53.990 INFO:tasks.workunit.client.0.smithi040.stdout:2/919: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/f132 x:0 0 0 2024-04-18T10:42:54.002 INFO:tasks.workunit.client.0.smithi040.stdout:4/949: rmdir d2/d1a/d8e/d103 39 2024-04-18T10:42:54.003 INFO:tasks.workunit.client.0.smithi040.stdout:1/976: dread d1/d1c/d7b/d2e/d3e/f6a [0,4194304] 0 2024-04-18T10:42:54.005 INFO:tasks.workunit.client.0.smithi040.stdout:2/920: truncate dd/d61/d81/dfb/d2b/d7c/d37/d5b/f130 682724 0 2024-04-18T10:42:54.009 INFO:tasks.workunit.client.0.smithi040.stdout:1/977: getdents d1/d1c/d7b/d2e/d3e 0 2024-04-18T10:42:54.010 INFO:tasks.workunit.client.0.smithi040.stdout:1/978: readlink d1/l7 0 2024-04-18T10:42:54.013 INFO:tasks.workunit.client.0.smithi040.stdout:3/983: truncate d1/d7/d28/d81/f85 1048880 0 2024-04-18T10:42:54.014 INFO:tasks.workunit.client.0.smithi040.stdout:3/984: stat d1/d7/dd9/lf5 0 2024-04-18T10:42:54.015 INFO:tasks.workunit.client.0.smithi040.stdout:1/979: getdents d1/d1c/d2b/d32/d35/d140 0 2024-04-18T10:42:54.016 INFO:tasks.workunit.client.0.smithi040.stdout:5/936: truncate d0/f35 8614850 0 2024-04-18T10:42:54.018 INFO:tasks.workunit.client.0.smithi040.stdout:2/921: write dd/f15 [5490624,92027] 0 2024-04-18T10:42:54.020 INFO:tasks.workunit.client.0.smithi040.stdout:1/980: dread d1/d1c/d7b/d2e/f118 [0,4194304] 0 2024-04-18T10:42:54.020 INFO:tasks.workunit.client.0.smithi040.stdout:5/937: creat d0/f131 x:0 0 0 2024-04-18T10:42:54.023 INFO:tasks.workunit.client.0.smithi040.stdout:5/938: symlink d0/d3/d47/d106/l132 0 2024-04-18T10:42:54.024 INFO:tasks.workunit.client.0.smithi040.stdout:1/981: symlink d1/d1c/d7b/d2e/d9e/l14d 0 2024-04-18T10:42:54.025 INFO:tasks.workunit.client.0.smithi040.stdout:3/985: dwrite d1/d7/db2/dc0/f119 [0,4194304] 0 2024-04-18T10:42:54.025 INFO:tasks.workunit.client.0.smithi040.stdout:4/950: dwrite d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:54.030 INFO:tasks.workunit.client.0.smithi040.stdout:3/986: stat d1/d2/d4e/d58/d62/l116 0 2024-04-18T10:42:54.031 INFO:tasks.workunit.client.0.smithi040.stdout:5/939: mkdir d0/d3/d6b/d7b/ddc/d133 0 2024-04-18T10:42:54.033 INFO:tasks.workunit.client.0.smithi040.stdout:1/982: symlink d1/d16/d92/l14e 0 2024-04-18T10:42:54.036 INFO:tasks.workunit.client.0.smithi040.stdout:2/922: dwrite dd/d61/d81/dfb/d2b/d7c/d37/fd1 [0,4194304] 0 2024-04-18T10:42:54.037 INFO:tasks.workunit.client.0.smithi040.stdout:3/987: write d1/d2/d4e/d58/dbe/dc1/dc2/fe3 [405307,35348] 0 2024-04-18T10:42:54.039 INFO:tasks.workunit.client.0.smithi040.stdout:1/983: mknod d1/c14f 0 2024-04-18T10:42:54.040 INFO:tasks.workunit.client.0.smithi040.stdout:7/935: sync 2024-04-18T10:42:54.041 INFO:tasks.workunit.client.0.smithi040.stdout:4/951: dwrite d2/d3/d4/dd/fbd [0,4194304] 0 2024-04-18T10:42:54.044 INFO:tasks.workunit.client.0.smithi040.stdout:3/988: mkdir d1/d2/d4e/d58/dbe/d148 0 2024-04-18T10:42:54.045 INFO:tasks.workunit.client.0.smithi040.stdout:5/940: dwrite d0/d3b/fbc [0,4194304] 0 2024-04-18T10:42:54.046 INFO:tasks.workunit.client.0.smithi040.stdout:5/941: read d0/d3b/fbc [196692,30759] 0 2024-04-18T10:42:54.047 INFO:tasks.workunit.client.0.smithi040.stdout:2/923: creat dd/d61/d81/dfb/d2b/d7c/d37/d5b/dda/f133 x:0 0 0 2024-04-18T10:42:54.047 INFO:tasks.workunit.client.0.smithi040.stdout:7/936: creat d6/d25/d28/dac/de9/f11c x:0 0 0 2024-04-18T10:42:54.047 INFO:tasks.workunit.client.0.smithi040.stdout:4/952: fdatasync d2/d3/d4/dd/d4f/fc3 0 2024-04-18T10:42:54.051 INFO:tasks.workunit.client.0.smithi040.stdout:1/984: dwrite d1/d1c/d7b/d2e/f88 [0,4194304] 0 2024-04-18T10:42:54.051 INFO:tasks.workunit.client.0.smithi040.stdout:7/937: mknod d6/d50/d79/d9a/dfa/c11d 0 2024-04-18T10:42:54.053 INFO:tasks.workunit.client.0.smithi040.stdout:4/953: rmdir d2/d3/d41/d62/d7c 39 2024-04-18T10:42:54.054 INFO:tasks.workunit.client.0.smithi040.stdout:2/924: creat dd/f134 x:0 0 0 2024-04-18T10:42:54.056 INFO:tasks.workunit.client.0.smithi040.stdout:4/954: chown d2/d3/d4/d1f/d29/d49/c43 66789286 1 2024-04-18T10:42:54.057 INFO:tasks.workunit.client.0.smithi040.stdout:2/925: truncate dd/d61/d81/dfb/d2b/dbc/d5f/fb2 1330886 0 2024-04-18T10:42:54.058 INFO:tasks.workunit.client.0.smithi040.stdout:1/985: creat d1/d1c/d2b/d32/f150 x:0 0 0 2024-04-18T10:42:54.059 INFO:tasks.workunit.client.0.smithi040.stdout:4/955: truncate d2/d3/d41/d62/db0/ffa 2814893 0 2024-04-18T10:42:54.062 INFO:tasks.workunit.client.0.smithi040.stdout:4/956: symlink d2/d3/d41/d47/l123 0 2024-04-18T10:42:54.072 INFO:tasks.workunit.client.0.smithi040.stdout:4/957: dread d2/d3/d4/f2e [0,4194304] 0 2024-04-18T10:42:54.079 INFO:tasks.workunit.client.0.smithi040.stdout:4/958: dwrite d2/d3/d4/d23/dea/fe5 [0,4194304] 0 2024-04-18T10:42:54.080 INFO:tasks.workunit.client.0.smithi040.stdout:4/959: chown d2/d3/d41/d47/d6f/f85 12 1 2024-04-18T10:42:54.080 INFO:tasks.workunit.client.0.smithi040.stdout:4/960: fdatasync d2/d3/d41/fc8 0 2024-04-18T10:42:54.083 INFO:tasks.workunit.client.0.smithi040.stdout:4/961: mkdir d2/d3/d41/d62/d9a/d124 0 2024-04-18T10:42:54.097 INFO:tasks.workunit.client.0.smithi040.stdout:7/938: dread d6/d25/dcf/de4/d3c/f109 [0,4194304] 0 2024-04-18T10:42:54.098 INFO:tasks.workunit.client.0.smithi040.stdout:3/989: sync 2024-04-18T10:42:54.099 INFO:tasks.workunit.client.0.smithi040.stdout:7/939: creat d6/d25/d28/dac/d64/d7e/d106/f11e x:0 0 0 2024-04-18T10:42:54.104 INFO:tasks.workunit.client.0.smithi040.stdout:3/990: dwrite d1/d7/db2/dc0/f119 [0,4194304] 0 2024-04-18T10:42:54.107 INFO:tasks.workunit.client.0.smithi040.stdout:3/991: creat d1/d7/d67/dc5/d91/db1/d147/f149 x:0 0 0 2024-04-18T10:42:54.109 INFO:tasks.workunit.client.0.smithi040.stdout:3/992: creat d1/d7/d67/dc5/d3b/f14a x:0 0 0 2024-04-18T10:42:54.112 INFO:tasks.workunit.client.0.smithi040.stdout:3/993: unlink d1/d2/d4e/d58/dbe/dc1/dc2/dea/f128 0 2024-04-18T10:42:54.114 INFO:tasks.workunit.client.0.smithi040.stdout:3/994: mkdir d1/d7/d67/dc5/d3b/d14b 0 2024-04-18T10:42:54.116 INFO:tasks.workunit.client.0.smithi040.stdout:3/995: symlink d1/d7/dd9/l14c 0 2024-04-18T10:42:54.121 INFO:tasks.workunit.client.0.smithi040.stdout:1/986: truncate d1/d1c/d2b/d32/d36/d4d/d67/fa3 565708 0 2024-04-18T10:42:54.125 INFO:tasks.workunit.client.0.smithi040.stdout:7/940: write d6/d25/dcf/fd7 [1296788,83014] 0 2024-04-18T10:42:54.127 INFO:tasks.workunit.client.0.smithi040.stdout:4/962: dread d2/d3/d41/d47/d6f/f8a [0,4194304] 0 2024-04-18T10:42:54.127 INFO:tasks.workunit.client.0.smithi040.stdout:3/996: write d1/d2/f1f [687873,100355] 0 2024-04-18T10:42:54.128 INFO:tasks.workunit.client.0.smithi040.stdout:7/941: unlink d6/d25/d28/f2f 0 2024-04-18T10:42:54.131 INFO:tasks.workunit.client.0.smithi040.stdout:3/997: unlink d1/d7/d67/d123/fe2 0 2024-04-18T10:42:54.132 INFO:tasks.workunit.client.0.smithi040.stdout:4/963: creat d2/d3/d4/d1f/d29/d49/d31/f125 x:0 0 0 2024-04-18T10:42:54.132 INFO:tasks.workunit.client.0.smithi040.stdout:4/964: chown d2/d3/d4/d23/l81 85484 1 2024-04-18T10:42:54.135 INFO:tasks.workunit.client.0.smithi040.stdout:7/942: creat d6/d25/dcf/f11f x:0 0 0 2024-04-18T10:42:54.135 INFO:tasks.workunit.client.0.smithi040.stdout:7/943: read - d6/d3e/d73/ffc zero size 2024-04-18T10:42:54.136 INFO:tasks.workunit.client.0.smithi040.stdout:3/998: dread d1/d7/d3a/f106 [0,4194304] 0 2024-04-18T10:42:54.137 INFO:tasks.workunit.client.0.smithi040.stdout:4/965: creat d2/d3/d4/d1f/d29/d49/d31/f126 x:0 0 0 2024-04-18T10:42:54.138 INFO:tasks.workunit.client.0.smithi040.stdout:4/966: stat d2/d3/d4/d1f/d29/d49/f73 0 2024-04-18T10:42:54.139 INFO:tasks.workunit.client.0.smithi040.stdout:4/967: readlink d2/lf 0 2024-04-18T10:42:54.139 INFO:tasks.workunit.client.0.smithi040.stdout:7/944: mknod d6/d50/d79/d90/c120 0 2024-04-18T10:42:54.139 INFO:tasks.workunit.client.0.smithi040.stdout:4/968: write d2/d1a/f9c [2781834,45684] 0 2024-04-18T10:42:54.141 INFO:tasks.workunit.client.0.smithi040.stdout:3/999: creat d1/d7/d67/dc5/d91/db1/f14d x:0 0 0 2024-04-18T10:42:54.147 INFO:tasks.workunit.client.0.smithi040.stdout:2/926: sync 2024-04-18T10:42:54.147 INFO:tasks.workunit.client.0.smithi040.stdout:5/942: sync 2024-04-18T10:42:54.149 INFO:tasks.workunit.client.0.smithi040.stdout:2/927: write dd/d61/d81/dfb/d2b/f2e [8732215,119616] 0 2024-04-18T10:42:54.152 INFO:tasks.workunit.client.0.smithi040.stdout:2/928: mknod dd/d61/d81/dfb/d2b/d95/c135 0 2024-04-18T10:42:54.158 INFO:tasks.workunit.client.0.smithi040.stdout:5/943: dwrite d0/d3b/f119 [4194304,4194304] 0 2024-04-18T10:42:54.159 INFO:tasks.workunit.client.0.smithi040.stdout:2/929: write dd/d61/d81/dfb/d2b/d7c/d37/d5b/fe0 [2488930,30207] 0 2024-04-18T10:42:54.160 INFO:tasks.workunit.client.0.smithi040.stdout:4/969: dwrite d2/d3/d4/d1f/d29/f64 [0,4194304] 0 2024-04-18T10:42:54.160 INFO:tasks.workunit.client.0.smithi040.stdout:7/945: dwrite d6/d25/d28/dac/d63/f78 [0,4194304] 0 2024-04-18T10:42:54.162 INFO:tasks.workunit.client.0.smithi040.stdout:5/944: chown d0/d3b/d3f/db1/df2/ff4 157 1 2024-04-18T10:42:54.166 INFO:tasks.workunit.client.0.smithi040.stdout:4/970: mkdir d2/d3/d41/d127 0 2024-04-18T10:42:54.168 INFO:tasks.workunit.client.0.smithi040.stdout:2/930: getdents dd/d61/d81/dfb/d2b/dbc/d131 0 2024-04-18T10:42:54.169 INFO:tasks.workunit.client.0.smithi040.stdout:5/945: write d0/d3b/fbc [5153945,94125] 0 2024-04-18T10:42:54.169 INFO:tasks.workunit.client.0.smithi040.stdout:4/971: write d2/fcc [548382,125775] 0 2024-04-18T10:42:54.171 INFO:tasks.workunit.client.0.smithi040.stdout:7/946: dwrite d6/d25/dcf/fd7 [0,4194304] 0 2024-04-18T10:42:54.173 INFO:tasks.workunit.client.0.smithi040.stdout:7/947: chown d6/d25/f4a 25432066 1 2024-04-18T10:42:54.173 INFO:tasks.workunit.client.0.smithi040.stdout:2/931: creat dd/d61/d81/d127/f136 x:0 0 0 2024-04-18T10:42:54.174 INFO:tasks.workunit.client.0.smithi040.stdout:1/987: sync 2024-04-18T10:42:54.175 INFO:tasks.workunit.client.0.smithi040.stdout:4/972: creat d2/d3/d4/d23/dea/d28/d3f/f128 x:0 0 0 2024-04-18T10:42:54.178 INFO:tasks.workunit.client.0.smithi040.stdout:7/948: creat d6/d50/d79/d9a/dfa/f121 x:0 0 0 2024-04-18T10:42:54.178 INFO:tasks.workunit.client.0.smithi040.stdout:5/946: dwrite d0/d3b/d3f/f45 [0,4194304] 0 2024-04-18T10:42:54.179 INFO:tasks.workunit.client.0.smithi040.stdout:7/949: readlink d6/d25/d28/dac/d64/d101/lb3 0 2024-04-18T10:42:54.179 INFO:tasks.workunit.client.0.smithi040.stdout:1/988: mknod d1/d1c/d7b/d2e/d3e/d85/c151 0 2024-04-18T10:42:54.179 INFO:tasks.workunit.client.0.smithi040.stdout:5/947: chown d0/d3/d47/d106/d115/ca8 7 1 2024-04-18T10:42:54.187 INFO:tasks.workunit.client.0.smithi040.stdout:7/950: chown d6/d25/d28/f117 0 1 2024-04-18T10:42:54.188 INFO:tasks.workunit.client.0.smithi040.stdout:7/951: chown d6/d25/d28/dac/d63 73418 1 2024-04-18T10:42:54.190 INFO:tasks.workunit.client.0.smithi040.stdout:4/973: creat d2/d3/d41/d47/f129 x:0 0 0 2024-04-18T10:42:54.193 INFO:tasks.workunit.client.0.smithi040.stdout:5/948: getdents d0/d3/d6b/d7b 0 2024-04-18T10:42:54.193 INFO:tasks.workunit.client.0.smithi040.stdout:4/974: mkdir d2/d3/d41/d12a 0 2024-04-18T10:42:54.194 INFO:tasks.workunit.client.0.smithi040.stdout:5/949: dread - d0/d3b/d3f/de9/fec zero size 2024-04-18T10:42:54.194 INFO:tasks.workunit.client.0.smithi040.stdout:4/975: stat d2/d3/d4/d1f/d29/d49/f32 0 2024-04-18T10:42:54.197 INFO:tasks.workunit.client.0.smithi040.stdout:5/950: rename d0/d78/d95/db7/d114/f11b to d0/d4e/dc2/d10e/f134 0 2024-04-18T10:42:54.201 INFO:tasks.workunit.client.0.smithi040.stdout:4/976: dwrite d2/d3/f59 [0,4194304] 0 2024-04-18T10:42:54.203 INFO:tasks.workunit.client.0.smithi040.stdout:5/951: dread d0/d3/d6b/d7b/d124/f12a [0,4194304] 0 2024-04-18T10:42:54.206 INFO:tasks.workunit.client.0.smithi040.stdout:5/952: unlink d0/d3b/d67/f73 0 2024-04-18T10:42:54.211 INFO:tasks.workunit.client.0.smithi040.stdout:5/953: dread d0/d3/d47/d106/d115/d5d/f9e [0,4194304] 0 2024-04-18T10:42:54.212 INFO:tasks.workunit.client.0.smithi040.stdout:5/954: fsync d0/d21/d42/f7d 0 2024-04-18T10:42:54.213 INFO:tasks.workunit.client.0.smithi040.stdout:7/952: write d6/d25/dcf/de4/f4d [4752964,27725] 0 2024-04-18T10:42:54.214 INFO:tasks.workunit.client.0.smithi040.stdout:5/955: write d0/f1b [2675619,29234] 0 2024-04-18T10:42:54.218 INFO:tasks.workunit.client.0.smithi040.stdout:1/989: dwrite d1/d1c/d2b/d32/fc7 [0,4194304] 0 2024-04-18T10:42:54.221 INFO:tasks.workunit.client.0.smithi040.stdout:7/953: rename d6/d25/dcf/de4/f4c to d6/d25/d28/dac/d64/d101/d5c/d6b/ded/dd0/f122 0 2024-04-18T10:42:54.228 INFO:tasks.workunit.client.0.smithi040.stdout:5/956: dwrite d0/d21/d42/f8f [4194304,4194304] 0 2024-04-18T10:42:54.228 INFO:tasks.workunit.client.0.smithi040.stdout:4/977: dwrite d2/d3/d4/dd/d4f/fc3 [0,4194304] 0 2024-04-18T10:42:54.228 INFO:tasks.workunit.client.0.smithi040.stdout:1/990: link d1/d16/d92/dad/lee d1/d1c/d7b/d2e/d3e/d85/d126/l152 0 2024-04-18T10:42:54.228 INFO:tasks.workunit.client.0.smithi040.stdout:4/978: chown d2/d3/d41/d12a 345 1 2024-04-18T10:42:54.231 INFO:tasks.workunit.client.0.smithi040.stdout:5/957: creat d0/d3b/d67/dc7/f135 x:0 0 0 2024-04-18T10:42:54.231 INFO:tasks.workunit.client.0.smithi040.stdout:1/991: write d1/d1c/d7b/d2e/f118 [1265950,53408] 0 2024-04-18T10:42:54.232 INFO:tasks.workunit.client.0.smithi040.stdout:4/979: fsync d2/d3/d4/fab 0 2024-04-18T10:42:54.233 INFO:tasks.workunit.client.0.smithi040.stdout:1/992: chown d1/d16/d92/dad/fc0 1069217 1 2024-04-18T10:42:54.234 INFO:tasks.workunit.client.0.smithi040.stdout:1/993: dread - d1/d1c/d2b/d32/f12f zero size 2024-04-18T10:42:54.238 INFO:tasks.workunit.client.0.smithi040.stdout:5/958: dwrite d0/d3/f1a [0,4194304] 0 2024-04-18T10:42:54.238 INFO:tasks.workunit.client.0.smithi040.stdout:4/980: creat d2/d3/d4/d23/dea/da4/f12b x:0 0 0 2024-04-18T10:42:54.240 INFO:tasks.workunit.client.0.smithi040.stdout:7/954: dread d6/d25/d28/dac/d64/d7e/fb0 [0,4194304] 0 2024-04-18T10:42:54.240 INFO:tasks.workunit.client.0.smithi040.stdout:2/932: sync 2024-04-18T10:42:54.242 INFO:tasks.workunit.client.0.smithi040.stdout:4/981: creat d2/d3/d4/dd/d4f/f12c x:0 0 0 2024-04-18T10:42:54.244 INFO:tasks.workunit.client.0.smithi040.stdout:5/959: getdents d0/d3b/d88/ded 0 2024-04-18T10:42:54.245 INFO:tasks.workunit.client.0.smithi040.stdout:5/960: write d0/d3/fe2 [693925,6990] 0 2024-04-18T10:42:54.246 INFO:tasks.workunit.client.0.smithi040.stdout:7/955: rename d6/d25/dcf/f100 to d6/d25/d28/dac/d64/d101/d5c/d6b/ded/f123 0 2024-04-18T10:42:54.247 INFO:tasks.workunit.client.0.smithi040.stdout:4/982: rmdir d2/d3/d4/d23/dea/d28/de1/dff 39 2024-04-18T10:42:54.249 INFO:tasks.workunit.client.0.smithi040.stdout:5/961: symlink d0/d3/d47/d106/l136 0 2024-04-18T10:42:54.250 INFO:tasks.workunit.client.0.smithi040.stdout:4/983: rmdir d2/d3/d4/d23 39 2024-04-18T10:42:54.252 INFO:tasks.workunit.client.0.smithi040.stdout:2/933: dwrite dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/dc5/f10c [0,4194304] 0 2024-04-18T10:42:54.255 INFO:tasks.workunit.client.0.smithi040.stdout:5/962: rename d0/d3/d47/d106/d115/d5d/ff6 to d0/d3/d47/dac/f137 0 2024-04-18T10:42:54.255 INFO:tasks.workunit.client.0.smithi040.stdout:5/963: fsync d0/d3/d6b/d7b/f85 0 2024-04-18T10:42:54.256 INFO:tasks.workunit.client.0.smithi040.stdout:4/984: mkdir d2/d3/d41/d47/d12d 0 2024-04-18T10:42:54.257 INFO:tasks.workunit.client.0.smithi040.stdout:4/985: dread - d2/d1a/fb8 zero size 2024-04-18T10:42:54.259 INFO:tasks.workunit.client.0.smithi040.stdout:4/986: write d2/d3/d4/d1f/d29/d49/d31/f88 [564695,50000] 0 2024-04-18T10:42:54.260 INFO:tasks.workunit.client.0.smithi040.stdout:4/987: write d2/d3/d4/dd/d4f/fe2 [1334620,27367] 0 2024-04-18T10:42:54.261 INFO:tasks.workunit.client.0.smithi040.stdout:4/988: readlink d2/d3/d4/d1f/d29/d49/d31/lae 0 2024-04-18T10:42:54.265 INFO:tasks.workunit.client.0.smithi040.stdout:4/989: rename d2/d3/f11d to d2/d3/d4/d1f/d29/d49/d31/f12e 0 2024-04-18T10:42:54.265 INFO:tasks.workunit.client.0.smithi040.stdout:5/964: link d0/d21/d42/dcc/ldb d0/d78/d95/db7/d114/l138 0 2024-04-18T10:42:54.266 INFO:tasks.workunit.client.0.smithi040.stdout:1/994: dread d1/d1c/d2b/d32/d36/f59 [0,4194304] 0 2024-04-18T10:42:54.267 INFO:tasks.workunit.client.0.smithi040.stdout:4/990: chown d2/d3/d4/lc4 952218 1 2024-04-18T10:42:54.267 INFO:tasks.workunit.client.0.smithi040.stdout:5/965: symlink d0/d3b/d88/l139 0 2024-04-18T10:42:54.267 INFO:tasks.workunit.client.0.smithi040.stdout:1/995: chown d1/d9b/d75/d84/dac 85 1 2024-04-18T10:42:54.268 INFO:tasks.workunit.client.0.smithi040.stdout:4/991: fsync d2/d3/d41/f105 0 2024-04-18T10:42:54.269 INFO:tasks.workunit.client.0.smithi040.stdout:4/992: chown d2/d3/d2f/f9f 52899906 1 2024-04-18T10:42:54.271 INFO:tasks.workunit.client.0.smithi040.stdout:4/993: dread d2/d3/d4/dd/dde/f110 [0,4194304] 0 2024-04-18T10:42:54.274 INFO:tasks.workunit.client.0.smithi040.stdout:1/996: unlink d1/d1c/d2b/d32/d7e/ceb 0 2024-04-18T10:42:54.275 INFO:tasks.workunit.client.0.smithi040.stdout:5/966: link d0/d3b/f105 d0/d21/d42/f13a 0 2024-04-18T10:42:54.276 INFO:tasks.workunit.client.0.smithi040.stdout:1/997: write d1/d1c/d2b/f13b [933088,76902] 0 2024-04-18T10:42:54.278 INFO:tasks.workunit.client.0.smithi040.stdout:4/994: dwrite d2/fe9 [0,4194304] 0 2024-04-18T10:42:54.279 INFO:tasks.workunit.client.0.smithi040.stdout:5/967: read d0/fc8 [2518232,50717] 0 2024-04-18T10:42:54.280 INFO:tasks.workunit.client.0.smithi040.stdout:5/968: fdatasync d0/f1b 0 2024-04-18T10:42:54.281 INFO:tasks.workunit.client.0.smithi040.stdout:5/969: chown d0/f129 448 1 2024-04-18T10:42:54.281 INFO:tasks.workunit.client.0.smithi040.stdout:7/956: dread d6/fa [0,4194304] 0 2024-04-18T10:42:54.283 INFO:tasks.workunit.client.0.smithi040.stdout:1/998: fsync d1/d16/f116 0 2024-04-18T10:42:54.285 INFO:tasks.workunit.client.0.smithi040.stdout:5/970: creat d0/d4e/d8e/f13b x:0 0 0 2024-04-18T10:42:54.286 INFO:tasks.workunit.client.0.smithi040.stdout:5/971: write d0/d3b/d3f/fbd [5272519,70896] 0 2024-04-18T10:42:54.288 INFO:tasks.workunit.client.0.smithi040.stdout:4/995: rename d2/d3/d4/d23/dea/c9b to d2/d3/d4/d1f/c12f 0 2024-04-18T10:42:54.289 INFO:tasks.workunit.client.0.smithi040.stdout:4/996: dread - d2/d3/d4/dd/d100/f112 zero size 2024-04-18T10:42:54.295 INFO:tasks.workunit.client.0.smithi040.stdout:7/957: creat d6/d25/dcf/de4/f124 x:0 0 0 2024-04-18T10:42:54.299 INFO:tasks.workunit.client.0.smithi040.stdout:4/997: dread d2/d3/d41/d62/db0/ffa [0,4194304] 0 2024-04-18T10:42:54.299 INFO:tasks.workunit.client.0.smithi040.stdout:1/999: dwrite d1/d9b/d75/d84/fc3 [0,4194304] 0 2024-04-18T10:42:54.300 INFO:tasks.workunit.client.0.smithi040.stdout:5/972: link d0/d3b/l127 d0/d3b/d3f/db1/df2/l13c 0 2024-04-18T10:42:54.302 INFO:tasks.workunit.client.0.smithi040.stdout:2/934: dwrite dd/d61/d81/dfb/d2b/dbc/d5f/d82/d72/faf [0,4194304] 0 2024-04-18T10:42:54.305 INFO:tasks.workunit.client.0.smithi040.stdout:4/998: creat d2/d3/d4/dd/dde/f130 x:0 0 0 2024-04-18T10:42:54.310 INFO:tasks.workunit.client.0.smithi040.stdout:2/935: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d6b/f137 x:0 0 0 2024-04-18T10:42:54.311 INFO:tasks.workunit.client.0.smithi040.stdout:7/958: dwrite d6/d25/d28/dac/d64/d7e/fb0 [0,4194304] 0 2024-04-18T10:42:54.311 INFO:tasks.workunit.client.0.smithi040.stdout:4/999: mknod d2/d3/d4/dd/dde/c131 0 2024-04-18T10:42:54.314 INFO:tasks.workunit.client.0.smithi040.stdout:2/936: mknod dd/d61/d81/d127/c138 0 2024-04-18T10:42:54.315 INFO:tasks.workunit.client.0.smithi040.stdout:5/973: dwrite d0/d3b/d3f/f40 [0,4194304] 0 2024-04-18T10:42:54.318 INFO:tasks.workunit.client.0.smithi040.stdout:7/959: rename d6/d25/d28/dac/d64/d101 to d6/d50/d79/d9a/d125 0 2024-04-18T10:42:54.319 INFO:tasks.workunit.client.0.smithi040.stdout:5/974: symlink d0/d3b/d3f/d72/l13d 0 2024-04-18T10:42:54.320 INFO:tasks.workunit.client.0.smithi040.stdout:5/975: chown d0/d21/f22 0 1 2024-04-18T10:42:54.322 INFO:tasks.workunit.client.0.smithi040.stdout:5/976: creat d0/d21/d42/dcc/de6/f13e x:0 0 0 2024-04-18T10:42:54.324 INFO:tasks.workunit.client.0.smithi040.stdout:5/977: fsync d0/d3b/d3f/f130 0 2024-04-18T10:42:54.325 INFO:tasks.workunit.client.0.smithi040.stdout:7/960: dwrite d6/d50/d79/d9a/d125/d55/d58/dc4/df9/f10b [0,4194304] 0 2024-04-18T10:42:54.328 INFO:tasks.workunit.client.0.smithi040.stdout:5/978: creat d0/d21/d42/d76/f13f x:0 0 0 2024-04-18T10:42:54.329 INFO:tasks.workunit.client.0.smithi040.stdout:5/979: readlink d0/d21/d42/dcc/ld7 0 2024-04-18T10:42:54.329 INFO:tasks.workunit.client.0.smithi040.stdout:5/980: fdatasync d0/d3b/d3f/fbd 0 2024-04-18T10:42:54.330 INFO:tasks.workunit.client.0.smithi040.stdout:7/961: dread d6/d50/d79/d9a/d125/d55/d58/d6c/faa [0,4194304] 0 2024-04-18T10:42:54.332 INFO:tasks.workunit.client.0.smithi040.stdout:7/962: mknod d6/d50/d79/d9a/d125/d5c/d6b/ded/c126 0 2024-04-18T10:42:54.333 INFO:tasks.workunit.client.0.smithi040.stdout:5/981: getdents d0/d3/d6b/d7b 0 2024-04-18T10:42:54.335 INFO:tasks.workunit.client.0.smithi040.stdout:7/963: mknod d6/d25/d28/dac/d64/d7e/d106/c127 0 2024-04-18T10:42:54.335 INFO:tasks.workunit.client.0.smithi040.stdout:7/964: fsync d6/d25/d28/f117 0 2024-04-18T10:42:54.335 INFO:tasks.workunit.client.0.smithi040.stdout:5/982: creat d0/d21/d42/d76/f140 x:0 0 0 2024-04-18T10:42:54.337 INFO:tasks.workunit.client.0.smithi040.stdout:5/983: chown d0/d3/d6b/d7b/lb0 32 1 2024-04-18T10:42:54.339 INFO:tasks.workunit.client.0.smithi040.stdout:7/965: creat d6/d50/d79/d9a/d125/d55/d9f/de1/f128 x:0 0 0 2024-04-18T10:42:54.340 INFO:tasks.workunit.client.0.smithi040.stdout:5/984: mknod d0/d3/d6b/d7b/c141 0 2024-04-18T10:42:54.342 INFO:tasks.workunit.client.0.smithi040.stdout:7/966: creat d6/dc1/f129 x:0 0 0 2024-04-18T10:42:54.343 INFO:tasks.workunit.client.0.smithi040.stdout:5/985: chown d0/d4e/c9a 81 1 2024-04-18T10:42:54.345 INFO:tasks.workunit.client.0.smithi040.stdout:7/967: symlink d6/d25/d28/dac/d64/l12a 0 2024-04-18T10:42:54.348 INFO:tasks.workunit.client.0.smithi040.stdout:7/968: creat d6/d50/dff/f12b x:0 0 0 2024-04-18T10:42:54.348 INFO:tasks.workunit.client.0.smithi040.stdout:5/986: dwrite d0/d3/f38 [4194304,4194304] 0 2024-04-18T10:42:54.349 INFO:tasks.workunit.client.0.smithi040.stdout:2/937: truncate dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/fd2 47053 0 2024-04-18T10:42:54.349 INFO:tasks.workunit.client.0.smithi040.stdout:5/987: chown d0/d21 92 1 2024-04-18T10:42:54.351 INFO:tasks.workunit.client.0.smithi040.stdout:2/938: read dd/d61/d8e/fcb [3268034,95849] 0 2024-04-18T10:42:54.352 INFO:tasks.workunit.client.0.smithi040.stdout:5/988: mkdir d0/d4e/d142 0 2024-04-18T10:42:54.354 INFO:tasks.workunit.client.0.smithi040.stdout:7/969: dread d6/d25/d28/dac/d63/f78 [0,4194304] 0 2024-04-18T10:42:54.357 INFO:tasks.workunit.client.0.smithi040.stdout:7/970: rmdir d6/dc1/df8 39 2024-04-18T10:42:54.359 INFO:tasks.workunit.client.0.smithi040.stdout:5/989: dwrite d0/d3/d6b/d7b/f85 [8388608,4194304] 0 2024-04-18T10:42:54.359 INFO:tasks.workunit.client.0.smithi040.stdout:7/971: chown d6/d25/dcf/de4/f3d 110 1 2024-04-18T10:42:54.362 INFO:tasks.workunit.client.0.smithi040.stdout:2/939: rename dd/d61/d81/dfb/d2b/d7c/d37/d38 to dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d139 0 2024-04-18T10:42:54.365 INFO:tasks.workunit.client.0.smithi040.stdout:5/990: dwrite d0/d4e/fe0 [0,4194304] 0 2024-04-18T10:42:54.369 INFO:tasks.workunit.client.0.smithi040.stdout:7/972: creat d6/f12c x:0 0 0 2024-04-18T10:42:54.371 INFO:tasks.workunit.client.0.smithi040.stdout:5/991: unlink d0/d3b/f105 0 2024-04-18T10:42:54.372 INFO:tasks.workunit.client.0.smithi040.stdout:7/973: symlink d6/d50/d79/d9a/d125/d5c/d6b/ded/dd0/l12d 0 2024-04-18T10:42:54.373 INFO:tasks.workunit.client.0.smithi040.stdout:5/992: mknod d0/d21/d42/dcc/de6/c143 0 2024-04-18T10:42:54.376 INFO:tasks.workunit.client.0.smithi040.stdout:5/993: mkdir d0/d3/d6b/d7b/ddc/d133/d144 0 2024-04-18T10:42:54.377 INFO:tasks.workunit.client.0.smithi040.stdout:5/994: chown d0/d78/dc4/l12e 8151343 1 2024-04-18T10:42:54.379 INFO:tasks.workunit.client.0.smithi040.stdout:7/974: dwrite d6/d50/d79/d9a/d125/d55/d58/d6c/d8a/fe5 [0,4194304] 0 2024-04-18T10:42:54.382 INFO:tasks.workunit.client.0.smithi040.stdout:7/975: readlink d6/d50/d79/d9a/d125/d5c/d6b/ded/lbf 0 2024-04-18T10:42:54.384 INFO:tasks.workunit.client.0.smithi040.stdout:5/995: dwrite d0/d21/d42/f111 [0,4194304] 0 2024-04-18T10:42:54.384 INFO:tasks.workunit.client.0.smithi040.stdout:7/976: write d6/dc1/df8/f114 [517444,48092] 0 2024-04-18T10:42:54.386 INFO:tasks.workunit.client.0.smithi040.stdout:7/977: chown d6/d50/d79/d90/cb2 39391 1 2024-04-18T10:42:54.392 INFO:tasks.workunit.client.0.smithi040.stdout:5/996: dwrite d0/d3/fa4 [8388608,4194304] 0 2024-04-18T10:42:54.395 INFO:tasks.workunit.client.0.smithi040.stdout:2/940: truncate dd/d61/d81/dfb/f22 1668585 0 2024-04-18T10:42:54.399 INFO:tasks.workunit.client.0.smithi040.stdout:5/997: dwrite d0/d3b/d88/ded/f11c [4194304,4194304] 0 2024-04-18T10:42:54.403 INFO:tasks.workunit.client.0.smithi040.stdout:5/998: unlink d0/d3b/d3f/c63 0 2024-04-18T10:42:54.404 INFO:tasks.workunit.client.0.smithi040.stdout:2/941: creat dd/d61/d8e/f13a x:0 0 0 2024-04-18T10:42:54.406 INFO:tasks.workunit.client.0.smithi040.stdout:5/999: truncate d0/d3b/fbc 725481 0 2024-04-18T10:42:54.407 INFO:tasks.workunit.client.0.smithi040.stdout:2/942: creat dd/d61/d81/f13b x:0 0 0 2024-04-18T10:42:54.411 INFO:tasks.workunit.client.0.smithi040.stdout:2/943: rename dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/d11b/ff6 to dd/d61/d81/dfb/d2b/dbc/d5f/d9d/f13c 0 2024-04-18T10:42:54.412 INFO:tasks.workunit.client.0.smithi040.stdout:2/944: chown dd/d61/d8e/d98/lbd 8461 1 2024-04-18T10:42:54.415 INFO:tasks.workunit.client.0.smithi040.stdout:2/945: unlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d139/d8c/c129 0 2024-04-18T10:42:54.416 INFO:tasks.workunit.client.0.smithi040.stdout:2/946: fdatasync dd/d61/d81/dfb/d2b/dbc/d5f/d82/d72/f100 0 2024-04-18T10:42:54.418 INFO:tasks.workunit.client.0.smithi040.stdout:2/947: write dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/f12a [841669,67888] 0 2024-04-18T10:42:54.419 INFO:tasks.workunit.client.0.smithi040.stdout:2/948: dread - dd/d61/d81/dfb/d2b/dbc/d5f/d82/d72/f11a zero size 2024-04-18T10:42:54.421 INFO:tasks.workunit.client.0.smithi040.stdout:7/978: write d6/d50/d79/d9a/d125/d55/d58/fc9 [122875,45889] 0 2024-04-18T10:42:54.425 INFO:tasks.workunit.client.0.smithi040.stdout:7/979: mknod d6/d50/d79/d9a/dfa/d10a/c12e 0 2024-04-18T10:42:54.445 INFO:tasks.workunit.client.0.smithi040.stdout:2/949: dread dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/f92 [0,4194304] 0 2024-04-18T10:42:54.447 INFO:tasks.workunit.client.0.smithi040.stdout:7/980: dread d6/d50/d79/d9a/d125/d5c/da2/fe8 [0,4194304] 0 2024-04-18T10:42:54.448 INFO:tasks.workunit.client.0.smithi040.stdout:7/981: fsync d6/d50/d79/d9a/d125/d5c/ff5 0 2024-04-18T10:42:54.449 INFO:tasks.workunit.client.0.smithi040.stdout:2/950: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/d11b/de2/d115/f13d x:0 0 0 2024-04-18T10:42:54.449 INFO:tasks.workunit.client.0.smithi040.stdout:7/982: write d6/d25/d28/dac/d64/d7e/fb0 [195074,60493] 0 2024-04-18T10:42:54.455 INFO:tasks.workunit.client.0.smithi040.stdout:2/951: rename dd/d61/d81/dfb/d2b/dbc/d5f/d82/d72/f100 to dd/d61/d81/dfb/d2b/d7c/d37/de4/f13e 0 2024-04-18T10:42:54.458 INFO:tasks.workunit.client.0.smithi040.stdout:7/983: link d6/d50/d79/d9a/dfa/d10a/c12e d6/d50/d79/d9a/dfa/d10a/c12f 0 2024-04-18T10:42:54.461 INFO:tasks.workunit.client.0.smithi040.stdout:2/952: getdents dd/d61/d81/dfb/d4a/d54 0 2024-04-18T10:42:54.461 INFO:tasks.workunit.client.0.smithi040.stdout:7/984: getdents d6/d25/d28/dac/db1/d110 0 2024-04-18T10:42:54.461 INFO:tasks.workunit.client.0.smithi040.stdout:2/953: readlink dd/d61/d8e/l11d 0 2024-04-18T10:42:54.462 INFO:tasks.workunit.client.0.smithi040.stdout:7/985: truncate d6/d3e/d73/fa9 649158 0 2024-04-18T10:42:54.465 INFO:tasks.workunit.client.0.smithi040.stdout:2/954: unlink dd/d61/f70 0 2024-04-18T10:42:54.467 INFO:tasks.workunit.client.0.smithi040.stdout:7/986: mkdir d6/d25/d28/dac/db1/d110/d130 0 2024-04-18T10:42:54.468 INFO:tasks.workunit.client.0.smithi040.stdout:7/987: truncate d6/d25/d28/dac/d64/fcc 5072762 0 2024-04-18T10:42:54.471 INFO:tasks.workunit.client.0.smithi040.stdout:7/988: creat d6/d50/f131 x:0 0 0 2024-04-18T10:42:54.473 INFO:tasks.workunit.client.0.smithi040.stdout:7/989: symlink d6/d25/d28/dac/db1/l132 0 2024-04-18T10:42:54.475 INFO:tasks.workunit.client.0.smithi040.stdout:7/990: mkdir d6/d50/d79/d133 0 2024-04-18T10:42:54.478 INFO:tasks.workunit.client.0.smithi040.stdout:7/991: creat d6/d25/dcf/de4/d2d/f134 x:0 0 0 2024-04-18T10:42:54.480 INFO:tasks.workunit.client.0.smithi040.stdout:7/992: mknod d6/d25/c135 0 2024-04-18T10:42:54.482 INFO:tasks.workunit.client.0.smithi040.stdout:7/993: rmdir d6/d25/d28/dac/d64/d7e/d106 39 2024-04-18T10:42:54.484 INFO:tasks.workunit.client.0.smithi040.stdout:7/994: symlink d6/d25/dcf/de4/d3c/l136 0 2024-04-18T10:42:54.488 INFO:tasks.workunit.client.0.smithi040.stdout:7/995: dread d6/d25/d28/dac/f7d [0,4194304] 0 2024-04-18T10:42:54.489 INFO:tasks.workunit.client.0.smithi040.stdout:7/996: fsync d6/d50/d79/d9a/d125/d55/d9f/de1/f128 0 2024-04-18T10:42:54.495 INFO:tasks.workunit.client.0.smithi040.stdout:7/997: truncate d6/d50/d79/d9a/d125/d5c/da2/de6/f11b 768237 0 2024-04-18T10:42:54.497 INFO:tasks.workunit.client.0.smithi040.stdout:7/998: mkdir d6/d50/dff/d137 0 2024-04-18T10:42:54.498 INFO:tasks.workunit.client.0.smithi040.stdout:7/999: stat d6/d50/d79/d9a/d125/d55/d9f/fbb 0 2024-04-18T10:42:54.549 INFO:tasks.workunit.client.0.smithi040.stdout:2/955: sync 2024-04-18T10:42:54.566 INFO:tasks.workunit.client.0.smithi040.stdout:2/956: creat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d139/f13f x:0 0 0 2024-04-18T10:42:54.571 INFO:tasks.workunit.client.0.smithi040.stdout:2/957: link dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/c114 dd/d61/d8e/d98/dcc/dd4/c140 0 2024-04-18T10:42:54.574 INFO:tasks.workunit.client.0.smithi040.stdout:2/958: unlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/ce7 0 2024-04-18T10:42:54.586 INFO:tasks.workunit.client.0.smithi040.stdout:2/959: dread dd/f45 [0,4194304] 0 2024-04-18T10:42:54.587 INFO:tasks.workunit.client.0.smithi040.stdout:2/960: fdatasync dd/d61/d81/dfb/d2b/d95/f126 0 2024-04-18T10:42:54.632 INFO:tasks.workunit.client.0.smithi040.stdout:2/961: sync 2024-04-18T10:42:54.634 INFO:tasks.workunit.client.0.smithi040.stdout:2/962: symlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d49/l141 0 2024-04-18T10:42:54.650 INFO:tasks.workunit.client.0.smithi040.stdout:2/963: write dd/f56 [1796031,39977] 0 2024-04-18T10:42:54.651 INFO:tasks.workunit.client.0.smithi040.stdout:2/964: truncate dd/d61/d81/dfb/d4a/d54/f118 660497 0 2024-04-18T10:42:54.653 INFO:tasks.workunit.client.0.smithi040.stdout:2/965: symlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d139/d8c/d10e/l142 0 2024-04-18T10:42:54.654 INFO:tasks.workunit.client.0.smithi040.stdout:2/966: readlink dd/d61/d81/dfb/d2b/lcd 0 2024-04-18T10:42:54.659 INFO:tasks.workunit.client.0.smithi040.stdout:2/967: dread dd/d61/d81/dfb/d4a/f5a [0,4194304] 0 2024-04-18T10:42:54.661 INFO:tasks.workunit.client.0.smithi040.stdout:2/968: mknod dd/d61/d81/dfb/d2b/dbc/d5f/d82/d72/c143 0 2024-04-18T10:42:54.665 INFO:tasks.workunit.client.0.smithi040.stdout:2/969: link dd/d61/d8e/d98/dcc/dd4/f11f dd/d61/d81/dfb/d2b/d7c/d37/d5b/dda/f144 0 2024-04-18T10:42:54.667 INFO:tasks.workunit.client.0.smithi040.stdout:2/970: unlink dd/d61/d81/dfb/d2b/f2e 0 2024-04-18T10:42:54.672 INFO:tasks.workunit.client.0.smithi040.stdout:2/971: write dd/d61/d81/dfb/d2b/fbf [430150,37933] 0 2024-04-18T10:42:54.675 INFO:tasks.workunit.client.0.smithi040.stdout:2/972: symlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/ddf/l145 0 2024-04-18T10:42:54.676 INFO:tasks.workunit.client.0.smithi040.stdout:2/973: chown dd/d61/d81/dfb/d2b/dbc/d5f/ce3 76 1 2024-04-18T10:42:54.678 INFO:tasks.workunit.client.0.smithi040.stdout:2/974: rmdir dd/d61/d8e 39 2024-04-18T10:42:54.681 INFO:tasks.workunit.client.0.smithi040.stdout:2/975: truncate dd/d61/d8e/d98/dcc/dd4/ff5 438745 0 2024-04-18T10:42:54.707 INFO:tasks.workunit.client.0.smithi040.stdout:2/976: sync 2024-04-18T10:42:54.714 INFO:tasks.workunit.client.0.smithi040.stdout:2/977: dwrite dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/f97 [0,4194304] 0 2024-04-18T10:42:54.717 INFO:tasks.workunit.client.0.smithi040.stdout:2/978: write dd/d61/d81/dfb/fa9 [4437809,33751] 0 2024-04-18T10:42:54.718 INFO:tasks.workunit.client.0.smithi040.stdout:2/979: write dd/d61/d81/f13b [988127,125839] 0 2024-04-18T10:42:54.720 INFO:tasks.workunit.client.0.smithi040.stdout:2/980: chown dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/d11b/fd8 162 1 2024-04-18T10:42:54.723 INFO:tasks.workunit.client.0.smithi040.stdout:2/981: mknod dd/d61/c146 0 2024-04-18T10:42:54.741 INFO:tasks.workunit.client.0.smithi040.stdout:2/982: dwrite dd/d61/d81/dfb/d2b/d7c/f84 [0,4194304] 0 2024-04-18T10:42:54.742 INFO:tasks.workunit.client.0.smithi040.stdout:2/983: fdatasync dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/db1/dc5/f10c 0 2024-04-18T10:42:54.747 INFO:tasks.workunit.client.0.smithi040.stdout:2/984: unlink dd/d61/d8e/d98/dcc/lef 0 2024-04-18T10:42:54.750 INFO:tasks.workunit.client.0.smithi040.stdout:2/985: unlink dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d49/l53 0 2024-04-18T10:42:54.756 INFO:tasks.workunit.client.0.smithi040.stdout:2/986: dwrite dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d52/da2/d11b/de2/d115/f13d [0,4194304] 0 2024-04-18T10:42:54.757 INFO:tasks.workunit.client.0.smithi040.stdout:2/987: stat dd/d61/d81/dfb/d2b/dbc/d5f/l103 0 2024-04-18T10:42:54.761 INFO:tasks.workunit.client.0.smithi040.stdout:2/988: link dd/c9f dd/d61/d8e/d98/dcc/dd4/c147 0 2024-04-18T10:42:54.763 INFO:tasks.workunit.client.0.smithi040.stdout:2/989: truncate dd/d61/d81/dfb/d2b/d7c/d37/d5b/dda/f111 881878 0 2024-04-18T10:42:54.767 INFO:tasks.workunit.client.0.smithi040.stdout:2/990: rename dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d139/d8c/d10e to dd/d61/d81/dfb/d4a/d54/d148 0 2024-04-18T10:42:54.768 INFO:tasks.workunit.client.0.smithi040.stdout:2/991: fsync dd/d61/d81/dfb/d2b/d7c/d37/d5b/dda/f133 0 2024-04-18T10:42:54.770 INFO:tasks.workunit.client.0.smithi040.stdout:2/992: creat dd/d61/d8e/d98/f149 x:0 0 0 2024-04-18T10:42:54.772 INFO:tasks.workunit.client.0.smithi040.stdout:2/993: read dd/d61/d81/dfb/d2b/dbc/f99 [3018353,48697] 0 2024-04-18T10:42:54.774 INFO:tasks.workunit.client.0.smithi040.stdout:2/994: fsync dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d139/f57 0 2024-04-18T10:42:54.778 INFO:tasks.workunit.client.0.smithi040.stdout:2/995: rename dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d6b/lfc to dd/l14a 0 2024-04-18T10:42:54.778 INFO:tasks.workunit.client.0.smithi040.stdout:2/996: stat dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d6b/f7e 0 2024-04-18T10:42:54.779 INFO:tasks.workunit.client.0.smithi040.stdout:2/997: stat dd/d61/d81/lc6 0 2024-04-18T10:42:54.782 INFO:tasks.workunit.client.0.smithi040.stdout:2/998: link dd/d61/d81/lc6 dd/d61/d8e/d98/l14b 0 2024-04-18T10:42:54.785 INFO:tasks.workunit.client.0.smithi040.stdout:2/999: rename dd/d61/d81/dfb/d2b/dbc/d5f/d82/da6/d139/fe8 to dd/d61/d81/dfb/d2b/d7c/d37/da3/f14c 0 2024-04-18T10:42:54.789 INFO:tasks.workunit.client.0.smithi040.stderr:+ rm -rf -- ./tmp.yFWT2uSA5X 2024-04-18T10:43:06.456 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-18T10:43:06.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-18T10:43:46.961 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-18T10:43:46.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-18T10:43:47.255 DEBUG:teuthology.parallel:result is None 2024-04-18T10:43:47.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T10:43:47.291 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-18T10:43:47.291 INFO:teuthology.run_tasks:Running task print... 2024-04-18T10:43:47.304 INFO:teuthology.task.print:**** done fsstress 2024-04-18T10:43:47.304 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-18T10:43:47.343 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-18T10:43:47.343 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:43:47.343 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T10:43:47.362 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:43:47.362 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T10:43:47.420 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:43:47.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.548+0000 7fa522529700 1 Processor -- start 2024-04-18T10:43:47.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.548+0000 7fa522529700 1 -- start start 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa522529700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa51c068340 0x7fa51c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa522529700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a4990 0x7fa51c13fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa522529700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c0a7110 0x7fa51c06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa522529700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c0a55b0 con 0x7fa51c068340 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa522529700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1399d0 con 0x7fa51c0a4990 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa522529700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c13f850 con 0x7fa51c0a7110 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa520ac6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c0a7110 0x7fa51c06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a4990 0x7fa51c13fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa51c068340 0x7fa51c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa51c068340 0x7fa51c0a5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56566/0 (socket says 172.21.15.31:56566) 2024-04-18T10:43:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a4990 0x7fa51c13fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38506/0 (socket says 172.21.15.31:38506) 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa520ac6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c0a7110 0x7fa51c06ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43762/0 (socket says 172.21.15.31:43762) 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51bfff700 1 -- 172.21.15.31:0/2797736295 learned_addr learned my addr 172.21.15.31:0/2797736295 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51b7fe700 1 -- 172.21.15.31:0/2797736295 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c0a7110 msgr2=0x7fa51c06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51b7fe700 1 --2- 172.21.15.31:0/2797736295 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c0a7110 0x7fa51c06ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51b7fe700 1 -- 172.21.15.31:0/2797736295 >> v2:172.21.15.31:3300/0 conn(0x7fa51c068340 msgr2=0x7fa51c0a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51b7fe700 1 --2- 172.21.15.31:0/2797736295 >> v2:172.21.15.31:3300/0 conn(0x7fa51c068340 0x7fa51c0a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51b7fe700 1 -- 172.21.15.31:0/2797736295 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c13fb10 con 0x7fa51c0a4990 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa51bfff700 1 --2- 172.21.15.31:0/2797736295 >> v2:172.21.15.31:3300/0 conn(0x7fa51c068340 0x7fa51c0a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.549+0000 7fa520ac6700 1 --2- 172.21.15.31:0/2797736295 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c0a7110 0x7fa51c06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa51b7fe700 1 --2- 172.21.15.31:0/2797736295 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a4990 0x7fa51c13fda0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa51000dd40 tx=0x7fa51000d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99c393dc0734badc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa51affd700 1 -- 172.21.15.31:0/2797736295 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510012070 con 0x7fa51c0a4990 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa51affd700 1 -- 172.21.15.31:0/2797736295 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51000d2e0 con 0x7fa51c0a4990 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa51affd700 1 -- 172.21.15.31:0/2797736295 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51000dea0 con 0x7fa51c0a4990 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa522529700 1 -- 172.21.15.31:0/2797736295 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a4990 msgr2=0x7fa51c13fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa522529700 1 --2- 172.21.15.31:0/2797736295 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a4990 0x7fa51c13fda0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa51000dd40 tx=0x7fa51000d630 comp rx=0 tx=0).stop 2024-04-18T10:43:47.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa522529700 1 -- 172.21.15.31:0/2797736295 shutdown_connections 2024-04-18T10:43:47.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa522529700 1 --2- 172.21.15.31:0/2797736295 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c0a7110 0x7fa51c06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa522529700 1 --2- 172.21.15.31:0/2797736295 >> v2:172.21.15.31:3300/0 conn(0x7fa51c068340 0x7fa51c0a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa522529700 1 --2- 172.21.15.31:0/2797736295 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a4990 0x7fa51c13fda0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa522529700 1 -- 172.21.15.31:0/2797736295 >> 172.21.15.31:0/2797736295 conn(0x7fa51c06bfa0 msgr2=0x7fa51c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:47.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa522529700 1 -- 172.21.15.31:0/2797736295 shutdown_connections 2024-04-18T10:43:47.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.550+0000 7fa522529700 1 -- 172.21.15.31:0/2797736295 wait complete. 2024-04-18T10:43:47.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.552+0000 7fa522529700 1 Processor -- start 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.552+0000 7fa522529700 1 -- start start 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa522529700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c068340 0x7fa51c0a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa522529700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa51c0a4990 0x7fa51c0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa522529700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a7110 0x7fa51c0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa522529700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0a89c0 con 0x7fa51c0a4990 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa522529700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c14c150 con 0x7fa51c0a7110 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa522529700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c14c3f0 con 0x7fa51c068340 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c068340 0x7fa51c0a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c068340 0x7fa51c0a8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43766/0 (socket says 172.21.15.31:43766) 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51bfff700 1 -- 172.21.15.31:0/1499597021 learned_addr learned my addr 172.21.15.31:0/1499597021 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa520ac6700 1 --2- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a7110 0x7fa51c0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51b7fe700 1 --2- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa51c0a4990 0x7fa51c0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51bfff700 1 -- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a7110 msgr2=0x7fa51c0b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:47.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51bfff700 1 --2- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a7110 0x7fa51c0b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51bfff700 1 -- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa51c0a4990 msgr2=0x7fa51c0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51bfff700 1 --2- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa51c0a4990 0x7fa51c0b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51bfff700 1 -- 172.21.15.31:0/1499597021 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0094f0 con 0x7fa51c068340 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa51bfff700 1 --2- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c068340 0x7fa51c0a8ec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00ec50 tx=0x7fa50c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa503fff700 1 -- 172.21.15.31:0/1499597021 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00c920 con 0x7fa51c068340 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa503fff700 1 -- 172.21.15.31:0/1499597021 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c00ca80 con 0x7fa51c068340 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa514009a20 con 0x7fa51c068340 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa503fff700 1 -- 172.21.15.31:0/1499597021 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00ce00 con 0x7fa51c068340 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.553+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51000d8d0 con 0x7fa51c068340 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.554+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c0b32e0 con 0x7fa51c068340 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.554+0000 7fa503fff700 1 -- 172.21.15.31:0/1499597021 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fa50c013680 con 0x7fa51c068340 2024-04-18T10:43:47.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.555+0000 7fa503fff700 1 -- 172.21.15.31:0/1499597021 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fa50c05b3a0 con 0x7fa51c068340 2024-04-18T10:43:47.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.558+0000 7fa503fff700 1 -- 172.21.15.31:0/1499597021 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fa50c039700 con 0x7fa51c068340 2024-04-18T10:43:47.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.729+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa51c13bc70 con 0x7fa51c068340 2024-04-18T10:43:47.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.729+0000 7fa503fff700 1 -- 172.21.15.31:0/1499597021 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12029 (secure 0 0 0) 0x7fa50c03cef0 con 0x7fa51c068340 2024-04-18T10:43:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:43:47.731 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:40:40.522243+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":42,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":42,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2414209880":"2024-04-18T11:40:39.525564+0000","172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.731+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 >> v1:172.21.15.31:6816/46601 conn(0x7fa508045ef0 legacy=0x7fa5080483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.731+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c068340 msgr2=0x7fa51c0a8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.731+0000 7fa522529700 1 --2- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c068340 0x7fa51c0a8ec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00ec50 tx=0x7fa50c009250 comp rx=0 tx=0).stop 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.731+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 shutdown_connections 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.731+0000 7fa522529700 1 --2- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa51c068340 0x7fa51c0a8ec0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.731+0000 7fa522529700 1 --2- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa51c0a7110 0x7fa51c0b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.731+0000 7fa522529700 1 --2- 172.21.15.31:0/1499597021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa51c0a4990 0x7fa51c0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.731+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 >> 172.21.15.31:0/1499597021 conn(0x7fa51c06bfa0 msgr2=0x7fa51c138ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.732+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 shutdown_connections 2024-04-18T10:43:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.732+0000 7fa522529700 1 -- 172.21.15.31:0/1499597021 wait complete. 2024-04-18T10:43:47.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:43:47.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:43:47.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403ffff700 1 Processor -- start 2024-04-18T10:43:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403ffff700 1 -- start start 2024-04-18T10:43:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400b2d60 0x7f40400a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400a94e0 0x7f40400afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403ffff700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40400a8af0 con 0x7f40400a7470 2024-04-18T10:43:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40400a88f0 con 0x7f40400b2d60 2024-04-18T10:43:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403ffff700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404013c200 con 0x7f40400a94e0 2024-04-18T10:43:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400b2d60 0x7f40400a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f40400a7470 0x7f404006e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50352/0 (socket says 172.21.15.31:50352) 2024-04-18T10:43:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403f7fe700 1 -- 172.21.15.31:0/4217486831 learned_addr learned my addr 172.21.15.31:0/4217486831 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:43:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400b2d60 0x7f40400a7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38518/0 (socket says 172.21.15.31:38518) 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.867+0000 7f403e7fc700 1 --2- 172.21.15.31:0/4217486831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400a94e0 0x7f40400afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403e7fc700 1 -- 172.21.15.31:0/4217486831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400b2d60 msgr2=0x7f40400a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403e7fc700 1 --2- 172.21.15.31:0/4217486831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400b2d60 0x7f40400a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403e7fc700 1 -- 172.21.15.31:0/4217486831 >> v1:172.21.15.31:6789/0 conn(0x7f40400a7470 legacy=0x7f404006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403dffb700 1 -- 172.21.15.31:0/4217486831 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270255386 0 0) 0x7f40400a8af0 con 0x7f40400a7470 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403e7fc700 1 -- 172.21.15.31:0/4217486831 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404013c4a0 con 0x7f40400a94e0 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403effd700 1 --2- 172.21.15.31:0/4217486831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400b2d60 0x7f40400a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403e7fc700 1 --2- 172.21.15.31:0/4217486831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400a94e0 0x7f40400afd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4034009910 tx=0x7f40340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a9a13b808a13820 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403dffb700 1 -- 172.21.15.31:0/4217486831 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400b680 con 0x7f40400a94e0 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403dffb700 1 -- 172.21.15.31:0/4217486831 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400b7e0 con 0x7f40400a94e0 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.868+0000 7f403dffb700 1 -- 172.21.15.31:0/4217486831 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400bba0 con 0x7f40400a94e0 2024-04-18T10:43:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.869+0000 7f403ffff700 1 -- 172.21.15.31:0/4217486831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400a94e0 msgr2=0x7f40400afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.869+0000 7f403ffff700 1 --2- 172.21.15.31:0/4217486831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400a94e0 0x7f40400afd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4034009910 tx=0x7f40340091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.869+0000 7f403ffff700 1 -- 172.21.15.31:0/4217486831 shutdown_connections 2024-04-18T10:43:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.869+0000 7f403ffff700 1 --2- 172.21.15.31:0/4217486831 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400b2d60 0x7f40400a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.869+0000 7f403ffff700 1 --2- 172.21.15.31:0/4217486831 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400a94e0 0x7f40400afd00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.869+0000 7f403ffff700 1 -- 172.21.15.31:0/4217486831 >> 172.21.15.31:0/4217486831 conn(0x7f404006dcb0 msgr2=0x7f404006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.869+0000 7f403ffff700 1 -- 172.21.15.31:0/4217486831 shutdown_connections 2024-04-18T10:43:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.869+0000 7f403ffff700 1 -- 172.21.15.31:0/4217486831 wait complete. 2024-04-18T10:43:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403ffff700 1 Processor -- start 2024-04-18T10:43:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403ffff700 1 -- start start 2024-04-18T10:43:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400a7470 0x7f4040069a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40400a94e0 0x7f4040151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400b2d60 0x7f4040151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:47.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403ffff700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40400af680 con 0x7f40400a94e0 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403ffff700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40400ae0b0 con 0x7f40400a7470 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403ffff700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f404006a060 con 0x7f40400b2d60 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400a7470 0x7f4040069a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40400a94e0 0x7f4040151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400a7470 0x7f4040069a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38532/0 (socket says 172.21.15.31:38532) 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400b2d60 0x7f4040151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.870+0000 7f403effd700 1 -- 172.21.15.31:0/1029516781 learned_addr learned my addr 172.21.15.31:0/1029516781 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f403e7fc700 1 -- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400b2d60 msgr2=0x7f4040151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f403e7fc700 1 --2- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400b2d60 0x7f4040151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f403e7fc700 1 -- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400a7470 msgr2=0x7f4040069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f403e7fc700 1 --2- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400a7470 0x7f4040069a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f403e7fc700 1 -- 172.21.15.31:0/1029516781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030009420 con 0x7f40400a94e0 2024-04-18T10:43:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f403effd700 1 --2- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400a7470 0x7f4040069a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f403e7fc700 1 --2- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40400a94e0 0x7f4040151300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4034016000 tx=0x7f4034017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f4026ffd700 1 -- 172.21.15.31:0/1029516781 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403400b950 con 0x7f40400a94e0 2024-04-18T10:43:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f4026ffd700 1 -- 172.21.15.31:0/1029516781 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403400bb10 con 0x7f40400a94e0 2024-04-18T10:43:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4034009420 con 0x7f40400a94e0 2024-04-18T10:43:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f4026ffd700 1 -- 172.21.15.31:0/1029516781 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403401a680 con 0x7f40400a94e0 2024-04-18T10:43:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.871+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40400afc70 con 0x7f40400a94e0 2024-04-18T10:43:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.872+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40400651b0 con 0x7f40400a94e0 2024-04-18T10:43:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.872+0000 7f4026ffd700 1 -- 172.21.15.31:0/1029516781 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f403401a9f0 con 0x7f40400a94e0 2024-04-18T10:43:47.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.872+0000 7f4026ffd700 1 -- 172.21.15.31:0/1029516781 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f403405cca0 con 0x7f40400a94e0 2024-04-18T10:43:47.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:47.876+0000 7f4026ffd700 1 -- 172.21.15.31:0/1029516781 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4034002d70 con 0x7f40400a94e0 2024-04-18T10:43:48.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.043+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40400a6770 con 0x7f40400a94e0 2024-04-18T10:43:48.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.044+0000 7f4026ffd700 1 -- 172.21.15.31:0/1029516781 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4034015020 con 0x7f40400a94e0 2024-04-18T10:43:48.045 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 >> v1:172.21.15.31:6816/46601 conn(0x7f402c045ef0 legacy=0x7f402c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40400a94e0 msgr2=0x7f4040151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 --2- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40400a94e0 0x7f4040151300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4034016000 tx=0x7f4034017000 comp rx=0 tx=0).stop 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 shutdown_connections 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 --2- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f40400b2d60 0x7f4040151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 --2- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f40400a7470 0x7f4040069a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 --2- 172.21.15.31:0/1029516781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40400a94e0 0x7f4040151300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 >> 172.21.15.31:0/1029516781 conn(0x7f404006dcb0 msgr2=0x7f404006f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 shutdown_connections 2024-04-18T10:43:48.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.045+0000 7f403ffff700 1 -- 172.21.15.31:0/1029516781 wait complete. 2024-04-18T10:43:48.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:43:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a665f700 1 Processor -- start 2024-04-18T10:43:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a665f700 1 -- start start 2024-04-18T10:43:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a665f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a006fa70 0x7f70a00a7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a665f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa310 0x7f70a013e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a665f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f70a00aa6e0 0x7f70a013edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a665f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a00a9a80 con 0x7f70a00aa6e0 2024-04-18T10:43:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a665f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00a8c30 con 0x7f70a006fa70 2024-04-18T10:43:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a665f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a013f2f0 con 0x7f70a00aa310 2024-04-18T10:43:48.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa310 0x7f70a013e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a4bfc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f70a00aa6e0 0x7f70a013edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f709ffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a006fa70 0x7f70a00a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa310 0x7f70a013e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43798/0 (socket says 172.21.15.31:43798) 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f709f7fe700 1 -- 172.21.15.31:0/3702802468 learned_addr learned my addr 172.21.15.31:0/3702802468 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f70a4bfc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f70a00aa6e0 0x7f70a013edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56604/0 (socket says 172.21.15.31:56604) 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.183+0000 7f709ffff700 1 --2- 172.21.15.31:0/3702802468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a006fa70 0x7f70a00a7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38542/0 (socket says 172.21.15.31:38542) 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f709f7fe700 1 -- 172.21.15.31:0/3702802468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a006fa70 msgr2=0x7f70a00a7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f709f7fe700 1 --2- 172.21.15.31:0/3702802468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a006fa70 0x7f70a00a7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f709f7fe700 1 -- 172.21.15.31:0/3702802468 >> v2:172.21.15.31:3300/0 conn(0x7f70a00aa6e0 msgr2=0x7f70a013edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f709f7fe700 1 --2- 172.21.15.31:0/3702802468 >> v2:172.21.15.31:3300/0 conn(0x7f70a00aa6e0 0x7f70a013edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f709f7fe700 1 -- 172.21.15.31:0/3702802468 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00a9c80 con 0x7f70a00aa310 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f70a4bfc700 1 --2- 172.21.15.31:0/3702802468 >> v2:172.21.15.31:3300/0 conn(0x7f70a00aa6e0 0x7f70a013edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f709f7fe700 1 --2- 172.21.15.31:0/3702802468 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa310 0x7f70a013e870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70880099e0 tx=0x7f7088009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=238e9aac405f617d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:48.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f709effd700 1 -- 172.21.15.31:0/3702802468 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800b6d0 con 0x7f70a00aa310 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f709effd700 1 -- 172.21.15.31:0/3702802468 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708800b830 con 0x7f70a00aa310 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.184+0000 7f709effd700 1 -- 172.21.15.31:0/3702802468 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800bbd0 con 0x7f70a00aa310 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.185+0000 7f70a665f700 1 -- 172.21.15.31:0/3702802468 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa310 msgr2=0x7f70a013e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.185+0000 7f70a665f700 1 --2- 172.21.15.31:0/3702802468 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa310 0x7f70a013e870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f70880099e0 tx=0x7f7088009250 comp rx=0 tx=0).stop 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.185+0000 7f70a665f700 1 -- 172.21.15.31:0/3702802468 shutdown_connections 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.185+0000 7f70a665f700 1 --2- 172.21.15.31:0/3702802468 >> v2:172.21.15.31:3300/0 conn(0x7f70a00aa6e0 0x7f70a013edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.185+0000 7f70a665f700 1 --2- 172.21.15.31:0/3702802468 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a006fa70 0x7f70a00a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.185+0000 7f70a665f700 1 --2- 172.21.15.31:0/3702802468 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa310 0x7f70a013e870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.185+0000 7f70a665f700 1 -- 172.21.15.31:0/3702802468 >> 172.21.15.31:0/3702802468 conn(0x7f70a00638f0 msgr2=0x7f70a006f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.185+0000 7f70a665f700 1 -- 172.21.15.31:0/3702802468 shutdown_connections 2024-04-18T10:43:48.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.185+0000 7f70a665f700 1 -- 172.21.15.31:0/3702802468 wait complete. 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.186+0000 7f70a665f700 1 Processor -- start 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.186+0000 7f70a665f700 1 -- start start 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f70a665f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a006fa70 0x7f70a00ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f70a665f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a00aa310 0x7f70a01517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f70a665f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa6e0 0x7f70a0151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f70a665f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00b0140 con 0x7f70a006fa70 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f70a665f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00afed0 con 0x7f70a00aa310 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f70a665f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a00b0b70 con 0x7f70a00aa6e0 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a006fa70 0x7f70a00ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f70a4bfc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa6e0 0x7f70a0151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a00aa310 0x7f70a01517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709ffff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a006fa70 0x7f70a00ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56614/0 (socket says 172.21.15.31:56614) 2024-04-18T10:43:48.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709ffff700 1 -- 172.21.15.31:0/1220773496 learned_addr learned my addr 172.21.15.31:0/1220773496 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709ffff700 1 -- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa6e0 msgr2=0x7f70a0151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709ffff700 1 --2- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa6e0 0x7f70a0151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709ffff700 1 -- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a00aa310 msgr2=0x7f70a01517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709ffff700 1 --2- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a00aa310 0x7f70a01517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709ffff700 1 -- 172.21.15.31:0/1220773496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098009a20 con 0x7f70a006fa70 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709f7fe700 1 --2- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a00aa310 0x7f70a01517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.187+0000 7f709ffff700 1 --2- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a006fa70 0x7f70a00ae2d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f709000ec80 tx=0x7f70900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.188+0000 7f7097fff700 1 -- 172.21.15.31:0/1220773496 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709000c850 con 0x7f70a006fa70 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.188+0000 7f7097fff700 1 -- 172.21.15.31:0/1220773496 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709000c9b0 con 0x7f70a006fa70 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.188+0000 7f7097fff700 1 -- 172.21.15.31:0/1220773496 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709000cd50 con 0x7f70a006fa70 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.188+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70880094f0 con 0x7f70a006fa70 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.188+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a00ad310 con 0x7f70a006fa70 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.189+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a00651b0 con 0x7f70a006fa70 2024-04-18T10:43:48.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.189+0000 7f7097fff700 1 -- 172.21.15.31:0/1220773496 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f7090013680 con 0x7f70a006fa70 2024-04-18T10:43:48.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.189+0000 7f7097fff700 1 -- 172.21.15.31:0/1220773496 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f709005b680 con 0x7f70a006fa70 2024-04-18T10:43:48.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.193+0000 7f7097fff700 1 -- 172.21.15.31:0/1220773496 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7090039980 con 0x7f70a006fa70 2024-04-18T10:43:48.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.364+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70a00b1ea0 con 0x7f70a006fa70 2024-04-18T10:43:48.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.365+0000 7f7097fff700 1 -- 172.21.15.31:0/1220773496 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7090021020 con 0x7f70a006fa70 2024-04-18T10:43:48.366 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:43:48.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.367+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 >> v1:172.21.15.31:6816/46601 conn(0x7f7080045ef0 legacy=0x7f70800483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.367+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a006fa70 msgr2=0x7f70a00ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.367+0000 7f70a665f700 1 --2- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a006fa70 0x7f70a00ae2d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f709000ec80 tx=0x7f70900091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.367+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 shutdown_connections 2024-04-18T10:43:48.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.367+0000 7f70a665f700 1 --2- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f70a00aa6e0 0x7f70a0151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.367+0000 7f70a665f700 1 --2- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70a006fa70 0x7f70a00ae2d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.367+0000 7f70a665f700 1 --2- 172.21.15.31:0/1220773496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f70a00aa310 0x7f70a01517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.367+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 >> 172.21.15.31:0/1220773496 conn(0x7f70a00638f0 msgr2=0x7f70a013e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:48.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.368+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 shutdown_connections 2024-04-18T10:43:48.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.368+0000 7f70a665f700 1 -- 172.21.15.31:0/1220773496 wait complete. 2024-04-18T10:43:48.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:43:48.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f03dbb700 1 Processor -- start 2024-04-18T10:43:48.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f03dbb700 1 -- start start 2024-04-18T10:43:48.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f03dbb700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2efc069200 0x7f2efc0a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f03dbb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a6080 0x7f2efc13fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f03dbb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc140090 0x7f2efc0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f03dbb700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc06ff30 con 0x7f2efc069200 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f03dbb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc13f8b0 con 0x7f2efc0a6080 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f03dbb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc13f5a0 con 0x7f2efc140090 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f02358700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc140090 0x7f2efc0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.564+0000 7f2f01356700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a6080 0x7f2efc13fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f01356700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a6080 0x7f2efc13fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38546/0 (socket says 172.21.15.31:38546) 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f02358700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc140090 0x7f2efc0679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43828/0 (socket says 172.21.15.31:43828) 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f01356700 1 -- 172.21.15.31:0/2318720856 learned_addr learned my addr 172.21.15.31:0/2318720856 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f01b57700 1 --2- 172.21.15.31:0/2318720856 >> v2:172.21.15.31:3300/0 conn(0x7f2efc069200 0x7f2efc0a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f02358700 1 -- 172.21.15.31:0/2318720856 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a6080 msgr2=0x7f2efc13fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f02358700 1 --2- 172.21.15.31:0/2318720856 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a6080 0x7f2efc13fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f02358700 1 -- 172.21.15.31:0/2318720856 >> v2:172.21.15.31:3300/0 conn(0x7f2efc069200 msgr2=0x7f2efc0a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f02358700 1 --2- 172.21.15.31:0/2318720856 >> v2:172.21.15.31:3300/0 conn(0x7f2efc069200 0x7f2efc0a4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f02358700 1 -- 172.21.15.31:0/2318720856 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0a3aa0 con 0x7f2efc140090 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f01356700 1 --2- 172.21.15.31:0/2318720856 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a6080 0x7f2efc13fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f01b57700 1 --2- 172.21.15.31:0/2318720856 >> v2:172.21.15.31:3300/0 conn(0x7f2efc069200 0x7f2efc0a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f02358700 1 --2- 172.21.15.31:0/2318720856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc140090 0x7f2efc0679e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40098e0 tx=0x7f2ef40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ffa0ba75243ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f00b55700 1 -- 172.21.15.31:0/2318720856 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4011630 con 0x7f2efc140090 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f00b55700 1 -- 172.21.15.31:0/2318720856 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef4011790 con 0x7f2efc140090 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.565+0000 7f2f00b55700 1 -- 172.21.15.31:0/2318720856 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4011b30 con 0x7f2efc140090 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.566+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2318720856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc140090 msgr2=0x7f2efc0679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.566+0000 7f2f03dbb700 1 --2- 172.21.15.31:0/2318720856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc140090 0x7f2efc0679e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40098e0 tx=0x7f2ef40091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.566+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2318720856 shutdown_connections 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.566+0000 7f2f03dbb700 1 --2- 172.21.15.31:0/2318720856 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc140090 0x7f2efc0679e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.566+0000 7f2f03dbb700 1 --2- 172.21.15.31:0/2318720856 >> v2:172.21.15.31:3300/0 conn(0x7f2efc069200 0x7f2efc0a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.566+0000 7f2f03dbb700 1 --2- 172.21.15.31:0/2318720856 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc0a6080 0x7f2efc13fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.566+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2318720856 >> 172.21.15.31:0/2318720856 conn(0x7f2efc06ae80 msgr2=0x7f2efc068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.566+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2318720856 shutdown_connections 2024-04-18T10:43:48.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.566+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2318720856 wait complete. 2024-04-18T10:43:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.567+0000 7f2f03dbb700 1 Processor -- start 2024-04-18T10:43:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.567+0000 7f2f03dbb700 1 -- start start 2024-04-18T10:43:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f03dbb700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc069200 0x7f2efc13b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f03dbb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a6080 0x7f2efc13a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f03dbb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc140090 0x7f2efc14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f03dbb700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc13a560 con 0x7f2efc069200 2024-04-18T10:43:48.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f03dbb700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc13c1d0 con 0x7f2efc140090 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f03dbb700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc133bf0 con 0x7f2efc0a6080 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01b57700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc069200 0x7f2efc13b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01356700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a6080 0x7f2efc13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01b57700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc069200 0x7f2efc13b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56630/0 (socket says 172.21.15.31:56630) 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f02358700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc140090 0x7f2efc14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01b57700 1 -- 172.21.15.31:0/2553327980 learned_addr learned my addr 172.21.15.31:0/2553327980 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01b57700 1 -- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a6080 msgr2=0x7f2efc13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01b57700 1 --2- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a6080 0x7f2efc13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01b57700 1 -- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc140090 msgr2=0x7f2efc14f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01b57700 1 --2- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc140090 0x7f2efc14f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01b57700 1 -- 172.21.15.31:0/2553327980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef8009a20 con 0x7f2efc069200 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f02358700 1 --2- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc140090 0x7f2efc14f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.568+0000 7f2f01b57700 1 --2- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc069200 0x7f2efc13b830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800c1a0 tx=0x7f2ef800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:48.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.569+0000 7f2ef1ffb700 1 -- 172.21.15.31:0/2553327980 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800cd70 con 0x7f2efc069200 2024-04-18T10:43:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.569+0000 7f2ef1ffb700 1 -- 172.21.15.31:0/2553327980 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef800f040 con 0x7f2efc069200 2024-04-18T10:43:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.569+0000 7f2ef1ffb700 1 -- 172.21.15.31:0/2553327980 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8014690 con 0x7f2efc069200 2024-04-18T10:43:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.569+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eec0094f0 con 0x7f2efc069200 2024-04-18T10:43:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.569+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef4009420 con 0x7f2efc069200 2024-04-18T10:43:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.570+0000 7f2ef1ffb700 1 -- 172.21.15.31:0/2553327980 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f2ef8014a00 con 0x7f2efc069200 2024-04-18T10:43:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.570+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc0651b0 con 0x7f2efc069200 2024-04-18T10:43:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.570+0000 7f2ef1ffb700 1 -- 172.21.15.31:0/2553327980 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f2ef805beb0 con 0x7f2efc069200 2024-04-18T10:43:48.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.574+0000 7f2ef1ffb700 1 -- 172.21.15.31:0/2553327980 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2ef803a150 con 0x7f2efc069200 2024-04-18T10:43:48.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.739+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2efc0b0db0 con 0x7f2efc069200 2024-04-18T10:43:48.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.740+0000 7f2ef1ffb700 1 -- 172.21.15.31:0/2553327980 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ef8014cb0 con 0x7f2efc069200 2024-04-18T10:43:48.741 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:43:48.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 >> v1:172.21.15.31:6816/46601 conn(0x7f2ee0045ef0 legacy=0x7f2ee00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc069200 msgr2=0x7f2efc13b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 --2- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc069200 0x7f2efc13b830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800c1a0 tx=0x7f2ef800b040 comp rx=0 tx=0).stop 2024-04-18T10:43:48.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 shutdown_connections 2024-04-18T10:43:48.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 --2- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2efc140090 0x7f2efc14f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 --2- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2efc069200 0x7f2efc13b830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 --2- 172.21.15.31:0/2553327980 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2efc0a6080 0x7f2efc13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 >> 172.21.15.31:0/2553327980 conn(0x7f2efc06ae80 msgr2=0x7f2efc0b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:48.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 shutdown_connections 2024-04-18T10:43:48.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.741+0000 7f2f03dbb700 1 -- 172.21.15.31:0/2553327980 wait complete. 2024-04-18T10:43:48.754 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:43:48.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.875+0000 7f13acb87700 1 Processor -- start 2024-04-18T10:43:48.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.875+0000 7f13acb87700 1 -- start start 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13acb87700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a806ecf0 0x7f13a80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13acb87700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13a80a7130 0x7f13a81462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13acb87700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a80a3540 con 0x7f13a80a6d60 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13acb87700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a80a37e0 con 0x7f13a80a7130 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13acb87700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80a5d60 con 0x7f13a806ecf0 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13a659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a806ecf0 0x7f13a80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13a6d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13a80a7130 0x7f13a81462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13a5d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f13a80a6d60 0x7f13a8142b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50360/0 (socket says 172.21.15.31:50360) 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13a6d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13a80a7130 0x7f13a81462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56636/0 (socket says 172.21.15.31:56636) 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13a659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a806ecf0 0x7f13a80a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38562/0 (socket says 172.21.15.31:38562) 2024-04-18T10:43:48.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.876+0000 7f13a5d9b700 1 -- 172.21.15.31:0/1195304567 learned_addr learned my addr 172.21.15.31:0/1195304567 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a659c700 1 -- 172.21.15.31:0/1195304567 >> v2:172.21.15.31:3300/0 conn(0x7f13a80a7130 msgr2=0x7f13a81462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a659c700 1 --2- 172.21.15.31:0/1195304567 >> v2:172.21.15.31:3300/0 conn(0x7f13a80a7130 0x7f13a81462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a659c700 1 -- 172.21.15.31:0/1195304567 >> v1:172.21.15.31:6789/0 conn(0x7f13a80a6d60 legacy=0x7f13a8142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a659c700 1 -- 172.21.15.31:0/1195304567 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a806d980 con 0x7f13a806ecf0 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a559a700 1 -- 172.21.15.31:0/1195304567 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652618043 0 0) 0x7f13a80a3540 con 0x7f13a80a6d60 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a6d9d700 1 --2- 172.21.15.31:0/1195304567 >> v2:172.21.15.31:3300/0 conn(0x7f13a80a7130 0x7f13a81462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a659c700 1 --2- 172.21.15.31:0/1195304567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a806ecf0 0x7f13a80a5260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f139c0098e0 tx=0x7f139c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79c88a42d2f7d2d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a559a700 1 -- 172.21.15.31:0/1195304567 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00b640 con 0x7f13a806ecf0 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a559a700 1 -- 172.21.15.31:0/1195304567 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c00b7a0 con 0x7f13a806ecf0 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13a559a700 1 -- 172.21.15.31:0/1195304567 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00bb40 con 0x7f13a806ecf0 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13acb87700 1 -- 172.21.15.31:0/1195304567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a806ecf0 msgr2=0x7f13a80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.877+0000 7f13acb87700 1 --2- 172.21.15.31:0/1195304567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a806ecf0 0x7f13a80a5260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f139c0098e0 tx=0x7f139c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.878+0000 7f13acb87700 1 -- 172.21.15.31:0/1195304567 shutdown_connections 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.878+0000 7f13acb87700 1 --2- 172.21.15.31:0/1195304567 >> v2:172.21.15.31:3300/0 conn(0x7f13a80a7130 0x7f13a81462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.878+0000 7f13acb87700 1 --2- 172.21.15.31:0/1195304567 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a806ecf0 0x7f13a80a5260 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.878+0000 7f13acb87700 1 -- 172.21.15.31:0/1195304567 >> 172.21.15.31:0/1195304567 conn(0x7f13a80679e0 msgr2=0x7f13a8067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:48.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.878+0000 7f13acb87700 1 -- 172.21.15.31:0/1195304567 shutdown_connections 2024-04-18T10:43:48.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.878+0000 7f13acb87700 1 -- 172.21.15.31:0/1195304567 wait complete. 2024-04-18T10:43:48.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.878+0000 7f13acb87700 1 Processor -- start 2024-04-18T10:43:48.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13acb87700 1 -- start start 2024-04-18T10:43:48.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13acb87700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13a806ecf0 0x7f13a80ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13acb87700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a80a6d60 0x7f13a81384f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13acb87700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13a80a7130 0x7f13a8138a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:48.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13acb87700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80aec20 con 0x7f13a80a7130 2024-04-18T10:43:48.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13acb87700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80aeec0 con 0x7f13a80a6d60 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13acb87700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13a806a490 con 0x7f13a806ecf0 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13a5d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a80a6d60 0x7f13a81384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13a659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13a806ecf0 0x7f13a80ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13a6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13a80a7130 0x7f13a8138a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13a659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13a806ecf0 0x7f13a80ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43842/0 (socket says 172.21.15.31:43842) 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13a5d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a80a6d60 0x7f13a81384f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38574/0 (socket says 172.21.15.31:38574) 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13a6d9d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13a80a7130 0x7f13a8138a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56652/0 (socket says 172.21.15.31:56652) 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13a659c700 1 -- 172.21.15.31:0/1532496652 learned_addr learned my addr 172.21.15.31:0/1532496652 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13a6d9d700 1 -- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13a806ecf0 msgr2=0x7f13a80ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.879+0000 7f13a6d9d700 1 --2- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13a806ecf0 0x7f13a80ac8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13a6d9d700 1 -- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a80a6d60 msgr2=0x7f13a81384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13a6d9d700 1 --2- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a80a6d60 0x7f13a81384f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:48.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13a6d9d700 1 -- 172.21.15.31:0/1532496652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a0009a20 con 0x7f13a80a7130 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13a659c700 1 --2- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13a806ecf0 0x7f13a80ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13a5d9b700 1 --2- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a80a6d60 0x7f13a81384f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13a6d9d700 1 --2- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13a80a7130 0x7f13a8138a30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009e70 tx=0x7f13a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13967fc700 1 -- 172.21.15.31:0/1532496652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000caa0 con 0x7f13a80a7130 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13967fc700 1 -- 172.21.15.31:0/1532496652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a000f040 con 0x7f13a80a7130 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c009420 con 0x7f13a80a7130 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13967fc700 1 -- 172.21.15.31:0/1532496652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a000ce90 con 0x7f13a80a7130 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.880+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a80ae7e0 con 0x7f13a80a7130 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.881+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a80651b0 con 0x7f13a80a7130 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.881+0000 7f13967fc700 1 -- 172.21.15.31:0/1532496652 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f13a0003020 con 0x7f13a80a7130 2024-04-18T10:43:48.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.881+0000 7f13967fc700 1 -- 172.21.15.31:0/1532496652 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f13a005b810 con 0x7f13a80a7130 2024-04-18T10:43:48.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:48.885+0000 7f13967fc700 1 -- 172.21.15.31:0/1532496652 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f13a0039ab0 con 0x7f13a80a7130 2024-04-18T10:43:49.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.047+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13a8141e40 con 0x7f13a80a7130 2024-04-18T10:43:49.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.047+0000 7f13967fc700 1 -- 172.21.15.31:0/1532496652 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13a0018020 con 0x7f13a80a7130 2024-04-18T10:43:49.048 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:43:49.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 >> v1:172.21.15.31:6816/46601 conn(0x7f1388045ef0 legacy=0x7f13880483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13a80a7130 msgr2=0x7f13a8138a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 --2- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13a80a7130 0x7f13a8138a30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009e70 tx=0x7f13a000b040 comp rx=0 tx=0).stop 2024-04-18T10:43:49.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 shutdown_connections 2024-04-18T10:43:49.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 --2- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13a806ecf0 0x7f13a80ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 --2- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13a80a7130 0x7f13a8138a30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 --2- 172.21.15.31:0/1532496652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13a80a6d60 0x7f13a81384f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 >> 172.21.15.31:0/1532496652 conn(0x7f13a80679e0 msgr2=0x7f13a813b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:49.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 shutdown_connections 2024-04-18T10:43:49.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.049+0000 7f13acb87700 1 -- 172.21.15.31:0/1532496652 wait complete. 2024-04-18T10:43:49.062 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T10:43:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.182+0000 7faf31fa9700 1 Processor -- start 2024-04-18T10:43:49.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.182+0000 7faf31fa9700 1 -- start start 2024-04-18T10:43:49.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf31fa9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf2c069450 0x7faf2c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf31fa9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c13f130 0x7faf2c145900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf31fa9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0a59e0 con 0x7faf2c0a30c0 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf31fa9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c0a3ad0 con 0x7faf2c069450 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf31fa9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0a57c0 con 0x7faf2c13f130 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf2c069450 0x7faf2c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c13f130 0x7faf2c145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c13f130 0x7faf2c145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38586/0 (socket says 172.21.15.31:38586) 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2b7fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7faf2c069450 0x7faf2c0a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56664/0 (socket says 172.21.15.31:56664) 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2bfff700 1 -- 172.21.15.31:0/1213230202 learned_addr learned my addr 172.21.15.31:0/1213230202 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2affd700 1 --1- 172.21.15.31:0/1213230202 >> v1:172.21.15.31:6789/0 conn(0x7faf2c0a30c0 0x7faf2c13ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50374/0 (socket says 172.21.15.31:50374) 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2b7fe700 1 -- 172.21.15.31:0/1213230202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c13f130 msgr2=0x7faf2c145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2b7fe700 1 --2- 172.21.15.31:0/1213230202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c13f130 0x7faf2c145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2b7fe700 1 -- 172.21.15.31:0/1213230202 >> v1:172.21.15.31:6789/0 conn(0x7faf2c0a30c0 legacy=0x7faf2c13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2b7fe700 1 -- 172.21.15.31:0/1213230202 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0a4bc0 con 0x7faf2c069450 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2a7fc700 1 -- 172.21.15.31:0/1213230202 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438374175 0 0) 0x7faf2c0a59e0 con 0x7faf2c0a30c0 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2bfff700 1 --2- 172.21.15.31:0/1213230202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c13f130 0x7faf2c145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2b7fe700 1 --2- 172.21.15.31:0/1213230202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c069450 0x7faf2c0a2b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009910 tx=0x7faf1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cb3944b5105a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2a7fc700 1 -- 172.21.15.31:0/1213230202 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00b640 con 0x7faf2c069450 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2a7fc700 1 -- 172.21.15.31:0/1213230202 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c00b7a0 con 0x7faf2c069450 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.183+0000 7faf2a7fc700 1 -- 172.21.15.31:0/1213230202 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00bb60 con 0x7faf2c069450 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.184+0000 7faf31fa9700 1 -- 172.21.15.31:0/1213230202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c069450 msgr2=0x7faf2c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.184+0000 7faf31fa9700 1 --2- 172.21.15.31:0/1213230202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c069450 0x7faf2c0a2b80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009910 tx=0x7faf1c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.184+0000 7faf31fa9700 1 -- 172.21.15.31:0/1213230202 shutdown_connections 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.184+0000 7faf31fa9700 1 --2- 172.21.15.31:0/1213230202 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c13f130 0x7faf2c145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.184+0000 7faf31fa9700 1 --2- 172.21.15.31:0/1213230202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c069450 0x7faf2c0a2b80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.184+0000 7faf31fa9700 1 -- 172.21.15.31:0/1213230202 >> 172.21.15.31:0/1213230202 conn(0x7faf2c06ae80 msgr2=0x7faf2c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.184+0000 7faf31fa9700 1 -- 172.21.15.31:0/1213230202 shutdown_connections 2024-04-18T10:43:49.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.184+0000 7faf31fa9700 1 -- 172.21.15.31:0/1213230202 wait complete. 2024-04-18T10:43:49.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.185+0000 7faf31fa9700 1 Processor -- start 2024-04-18T10:43:49.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.185+0000 7faf31fa9700 1 -- start start 2024-04-18T10:43:49.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf31fa9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c069450 0x7faf2c0ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf31fa9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf2c0a30c0 0x7faf2c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf31fa9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c13f130 0x7faf2c14d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf31fa9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0ad7c0 con 0x7faf2c13f130 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf31fa9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0ad500 con 0x7faf2c069450 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf31fa9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c0abea0 con 0x7faf2c0a30c0 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c069450 0x7faf2c0ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c069450 0x7faf2c0ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38602/0 (socket says 172.21.15.31:38602) 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf2c0a30c0 0x7faf2c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2b7fe700 1 -- 172.21.15.31:0/360228789 learned_addr learned my addr 172.21.15.31:0/360228789 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2bfff700 1 --2- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c13f130 0x7faf2c14d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2bfff700 1 -- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf2c0a30c0 msgr2=0x7faf2c14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2bfff700 1 --2- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf2c0a30c0 0x7faf2c14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2bfff700 1 -- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c069450 msgr2=0x7faf2c0ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2bfff700 1 --2- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c069450 0x7faf2c0ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2bfff700 1 -- 172.21.15.31:0/360228789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2400bcf0 con 0x7faf2c13f130 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2b7fe700 1 --2- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c069450 0x7faf2c0ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf2bfff700 1 --2- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c13f130 0x7faf2c14d470 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf2400e140 tx=0x7faf2400d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf237fe700 1 -- 172.21.15.31:0/360228789 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2401a070 con 0x7faf2c13f130 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf237fe700 1 -- 172.21.15.31:0/360228789 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24011040 con 0x7faf2c13f130 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1c009420 con 0x7faf2c13f130 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf237fe700 1 -- 172.21.15.31:0/360228789 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400ea70 con 0x7faf2c13f130 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.186+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c0ae4b0 con 0x7faf2c13f130 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.187+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c0651b0 con 0x7faf2c13f130 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.187+0000 7faf237fe700 1 -- 172.21.15.31:0/360228789 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7faf24003020 con 0x7faf2c13f130 2024-04-18T10:43:49.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.188+0000 7faf237fe700 1 -- 172.21.15.31:0/360228789 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7faf2405d5c0 con 0x7faf2c13f130 2024-04-18T10:43:49.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.191+0000 7faf237fe700 1 -- 172.21.15.31:0/360228789 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7faf2403b860 con 0x7faf2c13f130 2024-04-18T10:43:49.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.380+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faf2c0b16b0 con 0x7faf2c13f130 2024-04-18T10:43:49.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.380+0000 7faf237fe700 1 -- 172.21.15.31:0/360228789 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v44) v1 ==== 80+0+350 (secure 0 0 0) 0x7faf2403f050 con 0x7faf2c13f130 2024-04-18T10:43:49.382 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.137:0/2414209880 2024-04-18T11:40:39.525564+0000 2024-04-18T10:43:49.382 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6819/3321563080 2024-04-19T10:38:52.565121+0000 2024-04-18T10:43:49.382 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2921291208 2024-04-19T10:38:28.389077+0000 2024-04-18T10:43:49.382 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2767636595 2024-04-19T10:38:28.389077+0000 2024-04-18T10:43:49.382 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3252462560 2024-04-19T10:38:28.389077+0000 2024-04-18T10:43:49.382 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6816/39551 2024-04-19T10:38:28.389077+0000 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 >> v1:172.21.15.31:6816/46601 conn(0x7faf0c045ef0 legacy=0x7faf0c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c13f130 msgr2=0x7faf2c14d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 --2- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c13f130 0x7faf2c14d470 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf2400e140 tx=0x7faf2400d040 comp rx=0 tx=0).stop 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 shutdown_connections 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 --2- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf2c13f130 0x7faf2c14d470 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 --2- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf2c069450 0x7faf2c0ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 --2- 172.21.15.31:0/360228789 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf2c0a30c0 0x7faf2c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 >> 172.21.15.31:0/360228789 conn(0x7faf2c06ae80 msgr2=0x7faf2c06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 shutdown_connections 2024-04-18T10:43:49.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.382+0000 7faf31fa9700 1 -- 172.21.15.31:0/360228789 wait complete. 2024-04-18T10:43:49.385 INFO:teuthology.orchestra.run.smithi031.stderr:listed 6 entries 2024-04-18T10:43:49.395 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:43:49.396 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T10:43:49.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:43:49.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.538+0000 7f35f8429700 1 Processor -- start 2024-04-18T10:43:49.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.538+0000 7f35f8429700 1 -- start start 2024-04-18T10:43:49.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.538+0000 7f35f8429700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f00a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.538+0000 7f35f8429700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35f00ab010 0x7f35f0141950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.538+0000 7f35f8429700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f013b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.538+0000 7f35f8429700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f0063f20 con 0x7f35f00ab010 2024-04-18T10:43:49.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.538+0000 7f35f8429700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00abf40 con 0x7f35f0141e90 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.538+0000 7f35f8429700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0142320 con 0x7f35f0063b50 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f61c5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f00a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f59c4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35f00ab010 0x7f35f0141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f69c6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f013b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f61c5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f00a9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43866/0 (socket says 172.21.15.31:43866) 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f69c6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f013b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38606/0 (socket says 172.21.15.31:38606) 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f59c4700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f35f00ab010 0x7f35f0141950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56686/0 (socket says 172.21.15.31:56686) 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f61c5700 1 -- 172.21.15.31:0/2381798652 learned_addr learned my addr 172.21.15.31:0/2381798652 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f61c5700 1 -- 172.21.15.31:0/2381798652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 msgr2=0x7f35f013b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:49.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f61c5700 1 --2- 172.21.15.31:0/2381798652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f013b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f61c5700 1 -- 172.21.15.31:0/2381798652 >> v2:172.21.15.31:3300/0 conn(0x7f35f00ab010 msgr2=0x7f35f0141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f61c5700 1 --2- 172.21.15.31:0/2381798652 >> v2:172.21.15.31:3300/0 conn(0x7f35f00ab010 0x7f35f0141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f61c5700 1 -- 172.21.15.31:0/2381798652 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f01425e0 con 0x7f35f0063b50 2024-04-18T10:43:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f69c6700 1 --2- 172.21.15.31:0/2381798652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f013b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f61c5700 1 --2- 172.21.15.31:0/2381798652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f00a9e20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0099b0 tx=0x7f35ec009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c58b3c79da3502bd server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f51c3700 1 -- 172.21.15.31:0/2381798652 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00b710 con 0x7f35f0063b50 2024-04-18T10:43:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f51c3700 1 -- 172.21.15.31:0/2381798652 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec00b870 con 0x7f35f0063b50 2024-04-18T10:43:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.539+0000 7f35f51c3700 1 -- 172.21.15.31:0/2381798652 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00bc10 con 0x7f35f0063b50 2024-04-18T10:43:49.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.540+0000 7f35f8429700 1 -- 172.21.15.31:0/2381798652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 msgr2=0x7f35f00a9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.540+0000 7f35f8429700 1 --2- 172.21.15.31:0/2381798652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f00a9e20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0099b0 tx=0x7f35ec009250 comp rx=0 tx=0).stop 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.540+0000 7f35f8429700 1 -- 172.21.15.31:0/2381798652 shutdown_connections 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.540+0000 7f35f8429700 1 --2- 172.21.15.31:0/2381798652 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f013b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.540+0000 7f35f8429700 1 --2- 172.21.15.31:0/2381798652 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f00a9e20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.540+0000 7f35f8429700 1 --2- 172.21.15.31:0/2381798652 >> v2:172.21.15.31:3300/0 conn(0x7f35f00ab010 0x7f35f0141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.540+0000 7f35f8429700 1 -- 172.21.15.31:0/2381798652 >> 172.21.15.31:0/2381798652 conn(0x7f35f00b1390 msgr2=0x7f35f00b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.540+0000 7f35f8429700 1 -- 172.21.15.31:0/2381798652 shutdown_connections 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.540+0000 7f35f8429700 1 -- 172.21.15.31:0/2381798652 wait complete. 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.541+0000 7f35f8429700 1 Processor -- start 2024-04-18T10:43:49.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.541+0000 7f35f8429700 1 -- start start 2024-04-18T10:43:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.541+0000 7f35f8429700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f01190a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f8429700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35f00ab010 0x7f35f013e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f8429700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f014b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f8429700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f013c770 con 0x7f35f00ab010 2024-04-18T10:43:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f8429700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f014e190 con 0x7f35f0141e90 2024-04-18T10:43:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f8429700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35f014e430 con 0x7f35f0063b50 2024-04-18T10:43:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f61c5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f01190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f59c4700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35f00ab010 0x7f35f013e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f61c5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f01190a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43872/0 (socket says 172.21.15.31:43872) 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f61c5700 1 -- 172.21.15.31:0/1103969782 learned_addr learned my addr 172.21.15.31:0/1103969782 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f69c6700 1 --2- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f014b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f61c5700 1 -- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 msgr2=0x7f35f014b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f61c5700 1 --2- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f014b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f61c5700 1 -- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35f00ab010 msgr2=0x7f35f013e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f61c5700 1 --2- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35f00ab010 0x7f35f013e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f61c5700 1 -- 172.21.15.31:0/1103969782 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8009a20 con 0x7f35f0063b50 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f59c4700 1 --2- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35f00ab010 0x7f35f013e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f61c5700 1 --2- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f01190a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009290 tx=0x7f35ec017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:49.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35e67fc700 1 -- 172.21.15.31:0/1103969782 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00b9e0 con 0x7f35f0063b50 2024-04-18T10:43:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35e67fc700 1 -- 172.21.15.31:0/1103969782 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec00bb40 con 0x7f35f0063b50 2024-04-18T10:43:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec0094f0 con 0x7f35f0063b50 2024-04-18T10:43:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35e67fc700 1 -- 172.21.15.31:0/1103969782 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec01a680 con 0x7f35f0063b50 2024-04-18T10:43:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.542+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f013ec90 con 0x7f35f0063b50 2024-04-18T10:43:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.543+0000 7f35e67fc700 1 -- 172.21.15.31:0/1103969782 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f35ec01aa30 con 0x7f35f0063b50 2024-04-18T10:43:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.543+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f00651b0 con 0x7f35f0063b50 2024-04-18T10:43:49.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.544+0000 7f35e67fc700 1 -- 172.21.15.31:0/1103969782 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f35ec05ccd0 con 0x7f35f0063b50 2024-04-18T10:43:49.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.547+0000 7f35e67fc700 1 -- 172.21.15.31:0/1103969782 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f35ec002d70 con 0x7f35f0063b50 2024-04-18T10:43:49.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.713+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35f00aa880 con 0x7f35f0063b50 2024-04-18T10:43:49.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.714+0000 7f35e67fc700 1 -- 172.21.15.31:0/1103969782 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12029 (secure 0 0 0) 0x7f35ec015030 con 0x7f35f0063b50 2024-04-18T10:43:49.715 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:43:49.715 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:40:40.522243+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":42,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":42,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2414209880":"2024-04-18T11:40:39.525564+0000","172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:43:49.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.715+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 >> v1:172.21.15.31:6816/46601 conn(0x7f35d4045ef0 legacy=0x7f35d40483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.716+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 msgr2=0x7f35f01190a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.716+0000 7f35f8429700 1 --2- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f01190a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009290 tx=0x7f35ec017000 comp rx=0 tx=0).stop 2024-04-18T10:43:49.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.716+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 shutdown_connections 2024-04-18T10:43:49.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.716+0000 7f35f8429700 1 --2- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f35f0063b50 0x7f35f01190a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.716+0000 7f35f8429700 1 --2- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f35f0141e90 0x7f35f014b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.716+0000 7f35f8429700 1 --2- 172.21.15.31:0/1103969782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35f00ab010 0x7f35f013e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.716+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 >> 172.21.15.31:0/1103969782 conn(0x7f35f00b1390 msgr2=0x7f35f00af230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:49.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.716+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 shutdown_connections 2024-04-18T10:43:49.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.716+0000 7f35f8429700 1 -- 172.21.15.31:0/1103969782 wait complete. 2024-04-18T10:43:49.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:43:49.729 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:43:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.850+0000 7f76234c9700 1 Processor -- start 2024-04-18T10:43:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f76234c9700 1 -- start start 2024-04-18T10:43:49.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f76234c9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c0680f0 0x7f761c0a4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f76234c9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0a7110 0x7f761c13c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f76234c9700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f761c06eab0 0x7f761c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f76234c9700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761c06fd30 con 0x7f761c06eab0 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f76234c9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761c0a4510 con 0x7f761c0680f0 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f76234c9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f761c13c130 con 0x7f761c0a7110 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f7620a64700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0a7110 0x7f761c13c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f7621265700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c0680f0 0x7f761c0a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f7621a66700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f761c06eab0 0x7f761c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f7621a66700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f761c06eab0 0x7f761c06ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56710/0 (socket says 172.21.15.31:56710) 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f7620a64700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0a7110 0x7f761c13c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43884/0 (socket says 172.21.15.31:43884) 2024-04-18T10:43:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f7621a66700 1 -- 172.21.15.31:0/1582747727 learned_addr learned my addr 172.21.15.31:0/1582747727 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.851+0000 7f7621265700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c0680f0 0x7f761c0a4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38616/0 (socket says 172.21.15.31:38616) 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7620a64700 1 -- 172.21.15.31:0/1582747727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c0680f0 msgr2=0x7f761c0a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7620a64700 1 --2- 172.21.15.31:0/1582747727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c0680f0 0x7f761c0a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7620a64700 1 -- 172.21.15.31:0/1582747727 >> v2:172.21.15.31:3300/0 conn(0x7f761c06eab0 msgr2=0x7f761c06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7620a64700 1 --2- 172.21.15.31:0/1582747727 >> v2:172.21.15.31:3300/0 conn(0x7f761c06eab0 0x7f761c06ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7620a64700 1 -- 172.21.15.31:0/1582747727 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761c13c3d0 con 0x7f761c0a7110 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7621a66700 1 --2- 172.21.15.31:0/1582747727 >> v2:172.21.15.31:3300/0 conn(0x7f761c06eab0 0x7f761c06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7621265700 1 --2- 172.21.15.31:0/1582747727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c0680f0 0x7f761c0a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7620a64700 1 --2- 172.21.15.31:0/1582747727 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0a7110 0x7f761c13c800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76180098e0 tx=0x7f76180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d990559bc13951 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7613fff700 1 -- 172.21.15.31:0/1582747727 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618011630 con 0x7f761c0a7110 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7613fff700 1 -- 172.21.15.31:0/1582747727 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7618011790 con 0x7f761c0a7110 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.852+0000 7f7613fff700 1 -- 172.21.15.31:0/1582747727 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618011b30 con 0x7f761c0a7110 2024-04-18T10:43:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.853+0000 7f76234c9700 1 -- 172.21.15.31:0/1582747727 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0a7110 msgr2=0x7f761c13c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.853+0000 7f76234c9700 1 --2- 172.21.15.31:0/1582747727 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0a7110 0x7f761c13c800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76180098e0 tx=0x7f76180091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.853+0000 7f76234c9700 1 -- 172.21.15.31:0/1582747727 shutdown_connections 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.853+0000 7f76234c9700 1 --2- 172.21.15.31:0/1582747727 >> v2:172.21.15.31:3300/0 conn(0x7f761c06eab0 0x7f761c06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.853+0000 7f76234c9700 1 --2- 172.21.15.31:0/1582747727 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c0680f0 0x7f761c0a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.853+0000 7f76234c9700 1 --2- 172.21.15.31:0/1582747727 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0a7110 0x7f761c13c800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.853+0000 7f76234c9700 1 -- 172.21.15.31:0/1582747727 >> 172.21.15.31:0/1582747727 conn(0x7f761c06bfc0 msgr2=0x7f761c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.853+0000 7f76234c9700 1 -- 172.21.15.31:0/1582747727 shutdown_connections 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.853+0000 7f76234c9700 1 -- 172.21.15.31:0/1582747727 wait complete. 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.854+0000 7f76234c9700 1 Processor -- start 2024-04-18T10:43:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.854+0000 7f76234c9700 1 -- start start 2024-04-18T10:43:49.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.854+0000 7f76234c9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0680f0 0x7f761c0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.854+0000 7f76234c9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c06eab0 0x7f761c0ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.854+0000 7f76234c9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f761c0a7110 0x7f761c0abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.854+0000 7f76234c9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c0ae0f0 con 0x7f761c0a7110 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.854+0000 7f76234c9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761c14c4c0 con 0x7f761c06eab0 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.854+0000 7f76234c9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f761c0acb90 con 0x7f761c0680f0 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.854+0000 7f7621265700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0680f0 0x7f761c0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621265700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0680f0 0x7f761c0adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43894/0 (socket says 172.21.15.31:43894) 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621265700 1 -- 172.21.15.31:0/1363259093 learned_addr learned my addr 172.21.15.31:0/1363259093 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621a66700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f761c0a7110 0x7f761c0abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7620a64700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c06eab0 0x7f761c0ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621265700 1 -- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c06eab0 msgr2=0x7f761c0ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621265700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c06eab0 0x7f761c0ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621265700 1 -- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f761c0a7110 msgr2=0x7f761c0abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621265700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f761c0a7110 0x7f761c0abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:49.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621265700 1 -- 172.21.15.31:0/1363259093 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c009420 con 0x7f761c0680f0 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7620a64700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c06eab0 0x7f761c0ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621a66700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f761c0a7110 0x7f761c0abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f7621265700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0680f0 0x7f761c0adbb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f760c00ecb0 tx=0x7f760c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f76117fa700 1 -- 172.21.15.31:0/1363259093 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00c850 con 0x7f761c0680f0 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f76117fa700 1 -- 172.21.15.31:0/1363259093 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c00c9b0 con 0x7f761c0680f0 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7614009ae0 con 0x7f761c0680f0 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f76117fa700 1 -- 172.21.15.31:0/1363259093 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00cd30 con 0x7f761c0680f0 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.855+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7618009420 con 0x7f761c0680f0 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.856+0000 7f76117fa700 1 -- 172.21.15.31:0/1363259093 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f760c013680 con 0x7f761c0680f0 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.856+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c0651b0 con 0x7f761c0680f0 2024-04-18T10:43:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.856+0000 7f76117fa700 1 -- 172.21.15.31:0/1363259093 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f760c05b380 con 0x7f761c0680f0 2024-04-18T10:43:49.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:49.860+0000 7f76117fa700 1 -- 172.21.15.31:0/1363259093 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f760c0395c0 con 0x7f761c0680f0 2024-04-18T10:43:50.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.024+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f761c13b090 con 0x7f761c0680f0 2024-04-18T10:43:50.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.025+0000 7f76117fa700 1 -- 172.21.15.31:0/1363259093 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f760c03cdb0 con 0x7f761c0680f0 2024-04-18T10:43:50.026 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:43:50.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 >> v1:172.21.15.31:6816/46601 conn(0x7f7600045ef0 legacy=0x7f76000483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0680f0 msgr2=0x7f761c0adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0680f0 0x7f761c0adbb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f760c00ecb0 tx=0x7f760c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 shutdown_connections 2024-04-18T10:43:50.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f761c0680f0 0x7f761c0adbb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f761c0a7110 0x7f761c0abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 --2- 172.21.15.31:0/1363259093 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f761c06eab0 0x7f761c0ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 >> 172.21.15.31:0/1363259093 conn(0x7f761c06bfc0 msgr2=0x7f761c137e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:50.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 shutdown_connections 2024-04-18T10:43:50.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.027+0000 7f76234c9700 1 -- 172.21.15.31:0/1363259093 wait complete. 2024-04-18T10:43:50.039 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:43:50.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.161+0000 7fdcc9bfd700 1 Processor -- start 2024-04-18T10:43:50.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.161+0000 7fdcc9bfd700 1 -- start start 2024-04-18T10:43:50.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc9bfd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdcc4069450 0x7fdcc40a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc9bfd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc40a30c0 0x7fdcc413ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc9bfd700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40a59e0 con 0x7fdcc413ef60 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc9bfd700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc40a3ad0 con 0x7fdcc4069450 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc9bfd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40a57c0 con 0x7fdcc40a30c0 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc2ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc40a30c0 0x7fdcc413ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdcc4069450 0x7fdcc40a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc3fff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdcc413ef60 0x7fdcc406d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50390/0 (socket says 172.21.15.31:50390) 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdcc4069450 0x7fdcc40a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56726/0 (socket says 172.21.15.31:56726) 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc2ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc40a30c0 0x7fdcc413ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43910/0 (socket says 172.21.15.31:43910) 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc3fff700 1 -- 172.21.15.31:0/1912124835 learned_addr learned my addr 172.21.15.31:0/1912124835 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc37fe700 1 -- 172.21.15.31:0/1912124835 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc40a30c0 msgr2=0x7fdcc413ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc37fe700 1 --2- 172.21.15.31:0/1912124835 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc40a30c0 0x7fdcc413ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc37fe700 1 -- 172.21.15.31:0/1912124835 >> v1:172.21.15.31:6789/0 conn(0x7fdcc413ef60 legacy=0x7fdcc406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc37fe700 1 -- 172.21.15.31:0/1912124835 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40a4bc0 con 0x7fdcc4069450 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.162+0000 7fdcc27fc700 1 -- 172.21.15.31:0/1912124835 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574963178 0 0) 0x7fdcc40a59e0 con 0x7fdcc413ef60 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc37fe700 1 --2- 172.21.15.31:0/1912124835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc4069450 0x7fdcc40a2b80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00bbc0 tx=0x7fdcac00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2332ab909a7130ac server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc27fc700 1 -- 172.21.15.31:0/1912124835 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac00dae0 con 0x7fdcc4069450 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc27fc700 1 -- 172.21.15.31:0/1912124835 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac00dc40 con 0x7fdcc4069450 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc27fc700 1 -- 172.21.15.31:0/1912124835 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac019480 con 0x7fdcc4069450 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1912124835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc4069450 msgr2=0x7fdcc40a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc9bfd700 1 --2- 172.21.15.31:0/1912124835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc4069450 0x7fdcc40a2b80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00bbc0 tx=0x7fdcac00b430 comp rx=0 tx=0).stop 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1912124835 shutdown_connections 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc9bfd700 1 --2- 172.21.15.31:0/1912124835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc4069450 0x7fdcc40a2b80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc9bfd700 1 --2- 172.21.15.31:0/1912124835 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc40a30c0 0x7fdcc413ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1912124835 >> 172.21.15.31:0/1912124835 conn(0x7fdcc406ae80 msgr2=0x7fdcc4068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:50.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1912124835 shutdown_connections 2024-04-18T10:43:50.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.163+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1912124835 wait complete. 2024-04-18T10:43:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.164+0000 7fdcc9bfd700 1 Processor -- start 2024-04-18T10:43:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.164+0000 7fdcc9bfd700 1 -- start start 2024-04-18T10:43:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc9bfd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc4069450 0x7fdcc40ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc9bfd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdcc40a30c0 0x7fdcc40acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc9bfd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc413ef60 0x7fdcc414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc9bfd700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4096ba0 con 0x7fdcc413ef60 2024-04-18T10:43:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc9bfd700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40ad8a0 con 0x7fdcc40a30c0 2024-04-18T10:43:50.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc9bfd700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40adb40 con 0x7fdcc4069450 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc4069450 0x7fdcc40ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc3fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc413ef60 0x7fdcc414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc37fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc4069450 0x7fdcc40ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43912/0 (socket says 172.21.15.31:43912) 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc2ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdcc40a30c0 0x7fdcc40acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc37fe700 1 -- 172.21.15.31:0/1856747496 learned_addr learned my addr 172.21.15.31:0/1856747496 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc37fe700 1 -- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdcc40a30c0 msgr2=0x7fdcc40acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc37fe700 1 --2- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdcc40a30c0 0x7fdcc40acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc37fe700 1 -- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc413ef60 msgr2=0x7fdcc414d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc37fe700 1 --2- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc413ef60 0x7fdcc414d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc37fe700 1 -- 172.21.15.31:0/1856747496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac00b6d0 con 0x7fdcc4069450 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.165+0000 7fdcc3fff700 1 --2- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc413ef60 0x7fdcc414d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.166+0000 7fdcc37fe700 1 --2- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc4069450 0x7fdcc40ae540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00b6a0 tx=0x7fdcac01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:50.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.166+0000 7fdcbb7fe700 1 -- 172.21.15.31:0/1856747496 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac010470 con 0x7fdcc4069450 2024-04-18T10:43:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.166+0000 7fdcbb7fe700 1 -- 172.21.15.31:0/1856747496 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac0105f0 con 0x7fdcc4069450 2024-04-18T10:43:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.166+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc40ac820 con 0x7fdcc4069450 2024-04-18T10:43:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.166+0000 7fdcbb7fe700 1 -- 172.21.15.31:0/1856747496 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcac0109b0 con 0x7fdcc4069450 2024-04-18T10:43:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.166+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc40a1990 con 0x7fdcc4069450 2024-04-18T10:43:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.167+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc4063610 con 0x7fdcc4069450 2024-04-18T10:43:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.167+0000 7fdcbb7fe700 1 -- 172.21.15.31:0/1856747496 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fdcac023070 con 0x7fdcc4069450 2024-04-18T10:43:50.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.167+0000 7fdcbb7fe700 1 -- 172.21.15.31:0/1856747496 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fdcac014070 con 0x7fdcc4069450 2024-04-18T10:43:50.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.171+0000 7fdcbb7fe700 1 -- 172.21.15.31:0/1856747496 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fdcac05dd00 con 0x7fdcc4069450 2024-04-18T10:43:50.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.336+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdcc40651b0 con 0x7fdcc4069450 2024-04-18T10:43:50.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.337+0000 7fdcbb7fe700 1 -- 172.21.15.31:0/1856747496 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdcac05dd00 con 0x7fdcc4069450 2024-04-18T10:43:50.338 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 >> v1:172.21.15.31:6816/46601 conn(0x7fdca4045ef0 legacy=0x7fdca40483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc4069450 msgr2=0x7fdcc40ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 --2- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc4069450 0x7fdcc40ae540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00b6a0 tx=0x7fdcac01b000 comp rx=0 tx=0).stop 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 shutdown_connections 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 --2- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdcc4069450 0x7fdcc40ae540 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 --2- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdcc413ef60 0x7fdcc414d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 --2- 172.21.15.31:0/1856747496 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdcc40a30c0 0x7fdcc40acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 >> 172.21.15.31:0/1856747496 conn(0x7fdcc406ae80 msgr2=0x7fdcc40b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 shutdown_connections 2024-04-18T10:43:50.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.339+0000 7fdcc9bfd700 1 -- 172.21.15.31:0/1856747496 wait complete. 2024-04-18T10:43:50.351 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:43:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.473+0000 7fdaec41e700 1 Processor -- start 2024-04-18T10:43:50.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.473+0000 7fdaec41e700 1 -- start start 2024-04-18T10:43:50.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.473+0000 7fdaec41e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae4068340 0x7fdae40a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.473+0000 7fdaec41e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae40a3a90 0x7fdae4146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaec41e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae40a73b0 con 0x7fdae40b0560 2024-04-18T10:43:50.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaec41e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40a55e0 con 0x7fdae40a3a90 2024-04-18T10:43:50.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaec41e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40a7130 con 0x7fdae4068340 2024-04-18T10:43:50.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaea9bb700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae40a3a90 0x7fdae4146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdae99b9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdae40b0560 0x7fdae413fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50402/0 (socket says 172.21.15.31:50402) 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdae99b9700 1 -- 172.21.15.31:0/626901374 learned_addr learned my addr 172.21.15.31:0/626901374 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaea1ba700 1 --2- 172.21.15.31:0/626901374 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae4068340 0x7fdae40a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaea9bb700 1 -- 172.21.15.31:0/626901374 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae4068340 msgr2=0x7fdae40a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaea9bb700 1 --2- 172.21.15.31:0/626901374 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae4068340 0x7fdae40a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdae91b8700 1 -- 172.21.15.31:0/626901374 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365947007 0 0) 0x7fdae40a73b0 con 0x7fdae40b0560 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaea9bb700 1 -- 172.21.15.31:0/626901374 >> v1:172.21.15.31:6789/0 conn(0x7fdae40b0560 legacy=0x7fdae413fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaea9bb700 1 -- 172.21.15.31:0/626901374 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae40a41a0 con 0x7fdae40a3a90 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaea1ba700 1 --2- 172.21.15.31:0/626901374 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae4068340 0x7fdae40a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdaea9bb700 1 --2- 172.21.15.31:0/626901374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae40a3a90 0x7fdae4146a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009e90 tx=0x7fdadc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a46eabf229fd3fcf server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdae91b8700 1 -- 172.21.15.31:0/626901374 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc00e070 con 0x7fdae40a3a90 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdae91b8700 1 -- 172.21.15.31:0/626901374 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc00bc30 con 0x7fdae40a3a90 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.474+0000 7fdae91b8700 1 -- 172.21.15.31:0/626901374 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc012430 con 0x7fdae40a3a90 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.475+0000 7fdaec41e700 1 -- 172.21.15.31:0/626901374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae40a3a90 msgr2=0x7fdae4146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.475+0000 7fdaec41e700 1 --2- 172.21.15.31:0/626901374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae40a3a90 0x7fdae4146a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009e90 tx=0x7fdadc009780 comp rx=0 tx=0).stop 2024-04-18T10:43:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.475+0000 7fdaec41e700 1 -- 172.21.15.31:0/626901374 shutdown_connections 2024-04-18T10:43:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.475+0000 7fdaec41e700 1 --2- 172.21.15.31:0/626901374 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae40a3a90 0x7fdae4146a80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.475+0000 7fdaec41e700 1 --2- 172.21.15.31:0/626901374 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae4068340 0x7fdae40a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.475+0000 7fdaec41e700 1 -- 172.21.15.31:0/626901374 >> 172.21.15.31:0/626901374 conn(0x7fdae406dd70 msgr2=0x7fdae40679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.475+0000 7fdaec41e700 1 -- 172.21.15.31:0/626901374 shutdown_connections 2024-04-18T10:43:50.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.475+0000 7fdaec41e700 1 -- 172.21.15.31:0/626901374 wait complete. 2024-04-18T10:43:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.476+0000 7fdaec41e700 1 Processor -- start 2024-04-18T10:43:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.476+0000 7fdaec41e700 1 -- start start 2024-04-18T10:43:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.476+0000 7fdaec41e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae4068340 0x7fdae4098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaec41e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae40a3a90 0x7fdae413e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaec41e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae40b0560 0x7fdae413ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaec41e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4097640 con 0x7fdae40a3a90 2024-04-18T10:43:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaec41e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4099660 con 0x7fdae4068340 2024-04-18T10:43:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaec41e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40a2a00 con 0x7fdae40b0560 2024-04-18T10:43:50.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaea1ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae4068340 0x7fdae4098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdae99b9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae40a3a90 0x7fdae413e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaea9bb700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae40b0560 0x7fdae413ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaea1ba700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae4068340 0x7fdae4098ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38650/0 (socket says 172.21.15.31:38650) 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaea1ba700 1 -- 172.21.15.31:0/3047199980 learned_addr learned my addr 172.21.15.31:0/3047199980 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdae99b9700 1 -- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae40b0560 msgr2=0x7fdae413ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdae99b9700 1 --2- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae40b0560 0x7fdae413ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdae99b9700 1 -- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae4068340 msgr2=0x7fdae4098ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdae99b9700 1 --2- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae4068340 0x7fdae4098ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdae99b9700 1 -- 172.21.15.31:0/3047199980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0009420 con 0x7fdae40a3a90 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaea9bb700 1 --2- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae40b0560 0x7fdae413ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaea1ba700 1 --2- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae4068340 0x7fdae4098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdae99b9700 1 --2- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae40a3a90 0x7fdae413e830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdae406ba60 tx=0x7fdad400e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdada7fc700 1 -- 172.21.15.31:0/3047199980 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4013070 con 0x7fdae40a3a90 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdada7fc700 1 -- 172.21.15.31:0/3047199980 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad400e2e0 con 0x7fdae40a3a90 2024-04-18T10:43:50.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc009a20 con 0x7fdae40a3a90 2024-04-18T10:43:50.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdada7fc700 1 -- 172.21.15.31:0/3047199980 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4005ad0 con 0x7fdae40a3a90 2024-04-18T10:43:50.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.477+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae40a27e0 con 0x7fdae40a3a90 2024-04-18T10:43:50.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.478+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae4097360 con 0x7fdae40a3a90 2024-04-18T10:43:50.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.478+0000 7fdada7fc700 1 -- 172.21.15.31:0/3047199980 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fdad40070f0 con 0x7fdae40a3a90 2024-04-18T10:43:50.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.479+0000 7fdada7fc700 1 -- 172.21.15.31:0/3047199980 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fdad405ec00 con 0x7fdae40a3a90 2024-04-18T10:43:50.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.483+0000 7fdada7fc700 1 -- 172.21.15.31:0/3047199980 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fdae4097360 con 0x7fdae40a3a90 2024-04-18T10:43:50.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.650+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdae4097360 con 0x7fdae40a3a90 2024-04-18T10:43:50.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.650+0000 7fdada7fc700 1 -- 172.21.15.31:0/3047199980 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdae4097360 con 0x7fdae40a3a90 2024-04-18T10:43:50.651 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:43:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 >> v1:172.21.15.31:6816/46601 conn(0x7fdac8045f20 legacy=0x7fdac80483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae40a3a90 msgr2=0x7fdae413e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 --2- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae40a3a90 0x7fdae413e830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdae406ba60 tx=0x7fdad400e470 comp rx=0 tx=0).stop 2024-04-18T10:43:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 shutdown_connections 2024-04-18T10:43:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 --2- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fdae40b0560 0x7fdae413ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 --2- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fdae4068340 0x7fdae4098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 --2- 172.21.15.31:0/3047199980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdae40a3a90 0x7fdae413e830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 >> 172.21.15.31:0/3047199980 conn(0x7fdae406dd70 msgr2=0x7fdae40b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:50.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 shutdown_connections 2024-04-18T10:43:50.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.652+0000 7fdaec41e700 1 -- 172.21.15.31:0/3047199980 wait complete. 2024-04-18T10:43:50.664 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:43:50.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.786+0000 7f08fdcae700 1 Processor -- start 2024-04-18T10:43:50.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.786+0000 7f08fdcae700 1 -- start start 2024-04-18T10:43:50.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.786+0000 7f08fdcae700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f8146620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.786+0000 7f08fdcae700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08f80a4800 0x7f08f8148b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.786+0000 7f08fdcae700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f80a3970 con 0x7f08f80b00b0 2024-04-18T10:43:50.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.786+0000 7f08fdcae700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f8068ef0 con 0x7f08f80a4800 2024-04-18T10:43:50.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.786+0000 7f08fdcae700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08f806a250 con 0x7f08f80a4430 2024-04-18T10:43:50.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08f80a4800 0x7f08f8148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f6ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f8146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f77fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f08f80b00b0 0x7f08f80b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50416/0 (socket says 172.21.15.31:50416) 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f7fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08f80a4800 0x7f08f8148b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56758/0 (socket says 172.21.15.31:56758) 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f6ffd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f8146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43944/0 (socket says 172.21.15.31:43944) 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f77fe700 1 -- 172.21.15.31:0/2911380158 learned_addr learned my addr 172.21.15.31:0/2911380158 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f7fff700 1 -- 172.21.15.31:0/2911380158 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 msgr2=0x7f08f8146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f7fff700 1 --2- 172.21.15.31:0/2911380158 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f8146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f7fff700 1 -- 172.21.15.31:0/2911380158 >> v1:172.21.15.31:6789/0 conn(0x7f08f80b00b0 legacy=0x7f08f80b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f7fff700 1 -- 172.21.15.31:0/2911380158 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f806a4f0 con 0x7f08f80a4800 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f67fc700 1 -- 172.21.15.31:0/2911380158 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277770565 0 0) 0x7f08f80a3970 con 0x7f08f80b00b0 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f6ffd700 1 --2- 172.21.15.31:0/2911380158 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f8146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f7fff700 1 --2- 172.21.15.31:0/2911380158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 0x7f08f8148b70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009e60 tx=0x7f08f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33681bd522ba43 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f67fc700 1 -- 172.21.15.31:0/2911380158 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000e070 con 0x7f08f80a4800 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f67fc700 1 -- 172.21.15.31:0/2911380158 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f000bb60 con 0x7f08f80a4800 2024-04-18T10:43:50.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.787+0000 7f08f67fc700 1 -- 172.21.15.31:0/2911380158 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0012430 con 0x7f08f80a4800 2024-04-18T10:43:50.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.788+0000 7f08fdcae700 1 -- 172.21.15.31:0/2911380158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 msgr2=0x7f08f8148b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.788+0000 7f08fdcae700 1 --2- 172.21.15.31:0/2911380158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 0x7f08f8148b70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009e60 tx=0x7f08f0009780 comp rx=0 tx=0).stop 2024-04-18T10:43:50.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.788+0000 7f08fdcae700 1 -- 172.21.15.31:0/2911380158 shutdown_connections 2024-04-18T10:43:50.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.788+0000 7f08fdcae700 1 --2- 172.21.15.31:0/2911380158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 0x7f08f8148b70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.788+0000 7f08fdcae700 1 --2- 172.21.15.31:0/2911380158 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f8146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.788+0000 7f08fdcae700 1 -- 172.21.15.31:0/2911380158 >> 172.21.15.31:0/2911380158 conn(0x7f08f806e1d0 msgr2=0x7f08f806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:50.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.788+0000 7f08fdcae700 1 -- 172.21.15.31:0/2911380158 shutdown_connections 2024-04-18T10:43:50.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.788+0000 7f08fdcae700 1 -- 172.21.15.31:0/2911380158 wait complete. 2024-04-18T10:43:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.789+0000 7f08fdcae700 1 Processor -- start 2024-04-18T10:43:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.789+0000 7f08fdcae700 1 -- start start 2024-04-18T10:43:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08fdcae700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f809a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08fdcae700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 0x7f08f809bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08fdcae700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08f80b00b0 0x7f08f814db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08fdcae700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8098180 con 0x7f08f80a4800 2024-04-18T10:43:50.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08fdcae700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f809b3c0 con 0x7f08f80b00b0 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08fdcae700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08f809b6a0 con 0x7f08f80a4430 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f77fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f809a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f77fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f809a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43960/0 (socket says 172.21.15.31:43960) 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f77fe700 1 -- 172.21.15.31:0/586207565 learned_addr learned my addr 172.21.15.31:0/586207565 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f6ffd700 1 --2- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 0x7f08f809bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f7fff700 1 --2- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08f80b00b0 0x7f08f814db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f6ffd700 1 -- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 msgr2=0x7f08f809a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f6ffd700 1 --2- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f809a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f6ffd700 1 -- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08f80b00b0 msgr2=0x7f08f814db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f6ffd700 1 --2- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08f80b00b0 0x7f08f814db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f6ffd700 1 -- 172.21.15.31:0/586207565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec009420 con 0x7f08f80a4800 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08f6ffd700 1 --2- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 0x7f08f809bba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00ec80 tx=0x7f08ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08df7fe700 1 -- 172.21.15.31:0/586207565 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00c8e0 con 0x7f08f80a4800 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08df7fe700 1 -- 172.21.15.31:0/586207565 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec00ca40 con 0x7f08f80a4800 2024-04-18T10:43:50.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f0009a20 con 0x7f08f80a4800 2024-04-18T10:43:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08df7fe700 1 -- 172.21.15.31:0/586207565 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00ce00 con 0x7f08f80a4800 2024-04-18T10:43:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.790+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f809c0e0 con 0x7f08f80a4800 2024-04-18T10:43:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.791+0000 7f08df7fe700 1 -- 172.21.15.31:0/586207565 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f08ec013680 con 0x7f08f80a4800 2024-04-18T10:43:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.791+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f80651b0 con 0x7f08f80a4800 2024-04-18T10:43:50.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.792+0000 7f08df7fe700 1 -- 172.21.15.31:0/586207565 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f08ec05b3e0 con 0x7f08f80a4800 2024-04-18T10:43:50.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.795+0000 7f08df7fe700 1 -- 172.21.15.31:0/586207565 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f08ec039680 con 0x7f08f80a4800 2024-04-18T10:43:50.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.958+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f08f80697d0 con 0x7f08f80a4800 2024-04-18T10:43:50.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.959+0000 7f08df7fe700 1 -- 172.21.15.31:0/586207565 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f08ec03ce70 con 0x7f08f80a4800 2024-04-18T10:43:50.960 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.960+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 >> v1:172.21.15.31:6816/46601 conn(0x7f08e4045ef0 legacy=0x7f08e40483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.960+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 msgr2=0x7f08f809bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.960+0000 7f08fdcae700 1 --2- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 0x7f08f809bba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00ec80 tx=0x7f08ec0091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.960+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 shutdown_connections 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.960+0000 7f08fdcae700 1 --2- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f08f80a4430 0x7f08f809a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.960+0000 7f08fdcae700 1 --2- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f08f80b00b0 0x7f08f814db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.960+0000 7f08fdcae700 1 --2- 172.21.15.31:0/586207565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08f80a4800 0x7f08f809bba0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.961+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 >> 172.21.15.31:0/586207565 conn(0x7f08f806e1d0 msgr2=0x7f08f8143720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.961+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 shutdown_connections 2024-04-18T10:43:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:50.961+0000 7f08fdcae700 1 -- 172.21.15.31:0/586207565 wait complete. 2024-04-18T10:43:50.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T10:43:51.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.094+0000 7fca43de9700 1 Processor -- start 2024-04-18T10:43:51.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.094+0000 7fca43de9700 1 -- start start 2024-04-18T10:43:51.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.094+0000 7fca43de9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c068340 0x7fca3c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:51.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.094+0000 7fca43de9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c0a74f0 0x7fca3c13fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:51.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.094+0000 7fca43de9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c06da70 con 0x7fca3c140110 2024-04-18T10:43:51.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.094+0000 7fca43de9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c13f7b0 con 0x7fca3c0a74f0 2024-04-18T10:43:51.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.094+0000 7fca43de9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c06ead0 con 0x7fca3c068340 2024-04-18T10:43:51.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca41384700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c0a74f0 0x7fca3c13fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca42386700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fca3c140110 0x7fca3c06c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50422/0 (socket says 172.21.15.31:50422) 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca41384700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c0a74f0 0x7fca3c13fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38670/0 (socket says 172.21.15.31:38670) 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca42386700 1 -- 172.21.15.31:0/122935070 learned_addr learned my addr 172.21.15.31:0/122935070 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca41b85700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c068340 0x7fca3c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca41384700 1 -- 172.21.15.31:0/122935070 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c068340 msgr2=0x7fca3c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca41384700 1 --2- 172.21.15.31:0/122935070 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c068340 0x7fca3c06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca40b83700 1 -- 172.21.15.31:0/122935070 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734023581 0 0) 0x7fca3c06da70 con 0x7fca3c140110 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca41384700 1 -- 172.21.15.31:0/122935070 >> v1:172.21.15.31:6789/0 conn(0x7fca3c140110 legacy=0x7fca3c06c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca41384700 1 -- 172.21.15.31:0/122935070 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c06ecc0 con 0x7fca3c0a74f0 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca41b85700 1 --2- 172.21.15.31:0/122935070 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c068340 0x7fca3c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca41384700 1 --2- 172.21.15.31:0/122935070 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c0a74f0 0x7fca3c13fbd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009940 tx=0x7fca2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdd5033ee03efd1f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:51.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca40b83700 1 -- 172.21.15.31:0/122935070 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00b670 con 0x7fca3c0a74f0 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca40b83700 1 -- 172.21.15.31:0/122935070 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c00b7d0 con 0x7fca3c0a74f0 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.095+0000 7fca40b83700 1 -- 172.21.15.31:0/122935070 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c00bb90 con 0x7fca3c0a74f0 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.096+0000 7fca43de9700 1 -- 172.21.15.31:0/122935070 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c0a74f0 msgr2=0x7fca3c13fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.096+0000 7fca43de9700 1 --2- 172.21.15.31:0/122935070 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c0a74f0 0x7fca3c13fbd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009940 tx=0x7fca2c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.096+0000 7fca43de9700 1 -- 172.21.15.31:0/122935070 shutdown_connections 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.096+0000 7fca43de9700 1 --2- 172.21.15.31:0/122935070 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c068340 0x7fca3c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.096+0000 7fca43de9700 1 --2- 172.21.15.31:0/122935070 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c0a74f0 0x7fca3c13fbd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.096+0000 7fca43de9700 1 -- 172.21.15.31:0/122935070 >> 172.21.15.31:0/122935070 conn(0x7fca3c069a10 msgr2=0x7fca3c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.096+0000 7fca43de9700 1 -- 172.21.15.31:0/122935070 shutdown_connections 2024-04-18T10:43:51.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.096+0000 7fca43de9700 1 -- 172.21.15.31:0/122935070 wait complete. 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.097+0000 7fca43de9700 1 Processor -- start 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.097+0000 7fca43de9700 1 -- start start 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca43de9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c068340 0x7fca3c0984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca43de9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3c140110 0x7fca3c0ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca43de9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c0970f0 0x7fca3c0abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca43de9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0a28f0 con 0x7fca3c140110 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca43de9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c097cf0 con 0x7fca3c068340 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca43de9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c097a80 con 0x7fca3c0970f0 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca41b85700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c068340 0x7fca3c0984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:51.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca42386700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c0970f0 0x7fca3c0abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca41b85700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c068340 0x7fca3c0984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38686/0 (socket says 172.21.15.31:38686) 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca42386700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c0970f0 0x7fca3c0abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:43978/0 (socket says 172.21.15.31:43978) 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca41b85700 1 -- 172.21.15.31:0/3431559597 learned_addr learned my addr 172.21.15.31:0/3431559597 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca41384700 1 --2- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3c140110 0x7fca3c0ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca42386700 1 -- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c068340 msgr2=0x7fca3c0984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca42386700 1 --2- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c068340 0x7fca3c0984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca42386700 1 -- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3c140110 msgr2=0x7fca3c0ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca42386700 1 --2- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3c140110 0x7fca3c0ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca42386700 1 -- 172.21.15.31:0/3431559597 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38009420 con 0x7fca3c0970f0 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.098+0000 7fca41b85700 1 --2- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c068340 0x7fca3c0984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.099+0000 7fca42386700 1 --2- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c0970f0 0x7fca3c0abc50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca34002130 tx=0x7fca3400e7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.099+0000 7fca31ffb700 1 -- 172.21.15.31:0/3431559597 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34013070 con 0x7fca3c0970f0 2024-04-18T10:43:51.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.099+0000 7fca31ffb700 1 -- 172.21.15.31:0/3431559597 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400e2e0 con 0x7fca3c0970f0 2024-04-18T10:43:51.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.099+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c009420 con 0x7fca3c0970f0 2024-04-18T10:43:51.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.099+0000 7fca31ffb700 1 -- 172.21.15.31:0/3431559597 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34010b80 con 0x7fca3c0970f0 2024-04-18T10:43:51.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.099+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c0ad8a0 con 0x7fca3c0970f0 2024-04-18T10:43:51.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.100+0000 7fca31ffb700 1 -- 172.21.15.31:0/3431559597 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fca3400c450 con 0x7fca3c0970f0 2024-04-18T10:43:51.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.100+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c064920 con 0x7fca3c0970f0 2024-04-18T10:43:51.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.100+0000 7fca31ffb700 1 -- 172.21.15.31:0/3431559597 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fca3405f6e0 con 0x7fca3c0970f0 2024-04-18T10:43:51.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.104+0000 7fca31ffb700 1 -- 172.21.15.31:0/3431559597 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fca3403d9a0 con 0x7fca3c0970f0 2024-04-18T10:43:51.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.287+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fca3c13f590 con 0x7fca3c0970f0 2024-04-18T10:43:51.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.288+0000 7fca31ffb700 1 -- 172.21.15.31:0/3431559597 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v44) v1 ==== 80+0+350 (secure 0 0 0) 0x7fca34041190 con 0x7fca3c0970f0 2024-04-18T10:43:51.289 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.137:0/2414209880 2024-04-18T11:40:39.525564+0000 2024-04-18T10:43:51.289 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6819/3321563080 2024-04-19T10:38:52.565121+0000 2024-04-18T10:43:51.289 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2921291208 2024-04-19T10:38:28.389077+0000 2024-04-18T10:43:51.289 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2767636595 2024-04-19T10:38:28.389077+0000 2024-04-18T10:43:51.289 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3252462560 2024-04-19T10:38:28.389077+0000 2024-04-18T10:43:51.289 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6816/39551 2024-04-19T10:38:28.389077+0000 2024-04-18T10:43:51.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 >> v1:172.21.15.31:6816/46601 conn(0x7fca20045ef0 legacy=0x7fca200483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:51.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c0970f0 msgr2=0x7fca3c0abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:51.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 --2- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c0970f0 0x7fca3c0abc50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca34002130 tx=0x7fca3400e7d0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 shutdown_connections 2024-04-18T10:43:51.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 --2- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fca3c0970f0 0x7fca3c0abc50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 --2- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fca3c068340 0x7fca3c0984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 --2- 172.21.15.31:0/3431559597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca3c140110 0x7fca3c0ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:51.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 >> 172.21.15.31:0/3431559597 conn(0x7fca3c069a10 msgr2=0x7fca3c071230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:51.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 shutdown_connections 2024-04-18T10:43:51.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:51.290+0000 7fca43de9700 1 -- 172.21.15.31:0/3431559597 wait complete. 2024-04-18T10:43:51.292 INFO:teuthology.orchestra.run.smithi031.stderr:listed 6 entries 2024-04-18T10:43:51.302 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-04-18T10:43:51.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:51.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-18T10:43:51.344 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[39046]: fuse finished with error 0 and tester_r 0 2024-04-18T10:43:51.346 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:43:57.448 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-04-18T10:43:57.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.448 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-18T10:43:57.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.471 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-18T10:43:57.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.493 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-18T10:43:57.567 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-18T10:43:57.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:43:57.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.569 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-18T10:43:57.591 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-18T10:43:57.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-18T10:43:57.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.682 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-18T10:43:57.761 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-18T10:43:57.773 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-18T10:43:57.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.773 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-18T10:43:57.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-18T10:43:57.867 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-18T10:43:57.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:43:57.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.868 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-18T10:43:57.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:43:57.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-18T10:43:57.966 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-04-18T10:43:57.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:43:57.968 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2024-04-18T10:43:57.980 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-04-18T10:43:57.991 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2024-04-18T10:43:58.002 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-04-18T10:43:58.013 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-04-18T10:43:58.024 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2024-04-18T10:43:58.035 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-18T10:43:58.046 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-18T10:43:58.046 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-18T10:43:58.046 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T10:43:58.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16254224k,nr_inodes=4063556,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7034 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3254384k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2024-04-18T10:43:58.068 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:43:58.068 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T10:43:58.090 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-18T10:43:58.090 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-18T10:43:58.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:43:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.285+0000 7f852cafc700 1 Processor -- start 2024-04-18T10:43:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.285+0000 7f852cafc700 1 -- start start 2024-04-18T10:43:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.285+0000 7f852cafc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280a6960 0x7f852813e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.285+0000 7f852cafc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f852813ee10 0x7f85281459e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.285+0000 7f852cafc700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852813e6a0 con 0x7f85280682b0 2024-04-18T10:43:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.285+0000 7f852cafc700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8528068680 con 0x7f852813ee10 2024-04-18T10:43:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.285+0000 7f852cafc700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85280a5c50 con 0x7f85280a6960 2024-04-18T10:43:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8525d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280a6960 0x7f852813e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8526d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f852813ee10 0x7f85281459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8525d9b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280a6960 0x7f852813e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44106/0 (socket says 172.21.15.31:44106) 2024-04-18T10:43:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8526d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f852813ee10 0x7f85281459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40106/0 (socket says 172.21.15.31:40106) 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8525d9b700 1 -- 172.21.15.31:0/3593576150 learned_addr learned my addr 172.21.15.31:0/3593576150 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f852659c700 1 --1- 172.21.15.31:0/3593576150 >> v1:172.21.15.31:6789/0 conn(0x7f85280682b0 0x7f85280a4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40392/0 (socket says 172.21.15.31:40392) 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8526d9d700 1 -- 172.21.15.31:0/3593576150 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280a6960 msgr2=0x7f852813e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8526d9d700 1 --2- 172.21.15.31:0/3593576150 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280a6960 0x7f852813e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8526d9d700 1 -- 172.21.15.31:0/3593576150 >> v1:172.21.15.31:6789/0 conn(0x7f85280682b0 legacy=0x7f85280a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8526d9d700 1 -- 172.21.15.31:0/3593576150 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852806f6a0 con 0x7f852813ee10 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8525d9b700 1 --2- 172.21.15.31:0/3593576150 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280a6960 0x7f852813e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f852559a700 1 -- 172.21.15.31:0/3593576150 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135257399 0 0) 0x7f852813e6a0 con 0x7f85280682b0 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f8526d9d700 1 --2- 172.21.15.31:0/3593576150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f852813ee10 0x7f85281459e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8520009e60 tx=0x7f8520009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700aa5d4d5f1a9be server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f852559a700 1 -- 172.21.15.31:0/3593576150 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000e070 con 0x7f852813ee10 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f852559a700 1 -- 172.21.15.31:0/3593576150 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852000bb60 con 0x7f852813ee10 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.286+0000 7f852559a700 1 -- 172.21.15.31:0/3593576150 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520012430 con 0x7f852813ee10 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.287+0000 7f852cafc700 1 -- 172.21.15.31:0/3593576150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f852813ee10 msgr2=0x7f85281459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.287+0000 7f852cafc700 1 --2- 172.21.15.31:0/3593576150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f852813ee10 0x7f85281459e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8520009e60 tx=0x7f8520009780 comp rx=0 tx=0).stop 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.287+0000 7f852cafc700 1 -- 172.21.15.31:0/3593576150 shutdown_connections 2024-04-18T10:43:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.287+0000 7f852cafc700 1 --2- 172.21.15.31:0/3593576150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f852813ee10 0x7f85281459e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.287+0000 7f852cafc700 1 --2- 172.21.15.31:0/3593576150 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280a6960 0x7f852813e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.287+0000 7f852cafc700 1 -- 172.21.15.31:0/3593576150 >> 172.21.15.31:0/3593576150 conn(0x7f8528069a10 msgr2=0x7f85280679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:58.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.287+0000 7f852cafc700 1 -- 172.21.15.31:0/3593576150 shutdown_connections 2024-04-18T10:43:58.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.287+0000 7f852cafc700 1 -- 172.21.15.31:0/3593576150 wait complete. 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.288+0000 7f852cafc700 1 Processor -- start 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.288+0000 7f852cafc700 1 -- start start 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.288+0000 7f852cafc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280682b0 0x7f85280adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.288+0000 7f852cafc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85280a6960 0x7f85280ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.288+0000 7f852cafc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f852813ee10 0x7f8528151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.288+0000 7f852cafc700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280ac460 con 0x7f852813ee10 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.288+0000 7f852cafc700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85280aabc0 con 0x7f85280a6960 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.288+0000 7f852cafc700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85280ad610 con 0x7f85280682b0 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8525d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85280a6960 0x7f85280ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f852659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280682b0 0x7f85280adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8525d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85280a6960 0x7f85280ad0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38218/0 (socket says 172.21.15.31:38218) 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8525d9b700 1 -- 172.21.15.31:0/3501935450 learned_addr learned my addr 172.21.15.31:0/3501935450 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:58.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8526d9d700 1 --2- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f852813ee10 0x7f8528151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8525d9b700 1 -- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280682b0 msgr2=0x7f85280adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8525d9b700 1 --2- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280682b0 0x7f85280adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8525d9b700 1 -- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f852813ee10 msgr2=0x7f8528151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8525d9b700 1 --2- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f852813ee10 0x7f8528151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8525d9b700 1 -- 172.21.15.31:0/3501935450 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0094f0 con 0x7f85280a6960 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f852659c700 1 --2- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280682b0 0x7f85280adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f8525d9b700 1 --2- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85280a6960 0x7f85280ad0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f851c00ec50 tx=0x7f851c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f85167fc700 1 -- 172.21.15.31:0/3501935450 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00c850 con 0x7f85280a6960 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f85167fc700 1 -- 172.21.15.31:0/3501935450 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00c9b0 con 0x7f85280a6960 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.289+0000 7f85167fc700 1 -- 172.21.15.31:0/3501935450 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00cd50 con 0x7f85280a6960 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.290+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8520009a20 con 0x7f85280a6960 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.290+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85280abe30 con 0x7f85280a6960 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.291+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8528064920 con 0x7f85280a6960 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.291+0000 7f85167fc700 1 -- 172.21.15.31:0/3501935450 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f851c013680 con 0x7f85280a6960 2024-04-18T10:43:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.291+0000 7f85167fc700 1 -- 172.21.15.31:0/3501935450 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f851c05b420 con 0x7f85280a6960 2024-04-18T10:43:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.295+0000 7f85167fc700 1 -- 172.21.15.31:0/3501935450 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f851c0396c0 con 0x7f85280a6960 2024-04-18T10:43:58.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.460+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85280a5990 con 0x7f85280a6960 2024-04-18T10:43:58.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.461+0000 7f85167fc700 1 -- 172.21.15.31:0/3501935450 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12029 (secure 0 0 0) 0x7f851c03ceb0 con 0x7f85280a6960 2024-04-18T10:43:58.462 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:43:58.462 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:40:40.522243+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":42,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":42,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2414209880":"2024-04-18T11:40:39.525564+0000","172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:43:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 >> v1:172.21.15.31:6816/46601 conn(0x7f8508045ef0 legacy=0x7f85080483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85280a6960 msgr2=0x7f85280ad0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 --2- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85280a6960 0x7f85280ad0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f851c00ec50 tx=0x7f851c009250 comp rx=0 tx=0).stop 2024-04-18T10:43:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 shutdown_connections 2024-04-18T10:43:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 --2- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f85280682b0 0x7f85280adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 --2- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f852813ee10 0x7f8528151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 --2- 172.21.15.31:0/3501935450 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f85280a6960 0x7f85280ad0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 >> 172.21.15.31:0/3501935450 conn(0x7f8528069a10 msgr2=0x7f852806e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 shutdown_connections 2024-04-18T10:43:58.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.463+0000 7f852cafc700 1 -- 172.21.15.31:0/3501935450 wait complete. 2024-04-18T10:43:58.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-18T10:35:51.422706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-18T10:35:58.551846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-18T10:36:07.428725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-18T10:36:07.976197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-18T10:43:58.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-18T10:43:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cda963700 1 Processor -- start 2024-04-18T10:43:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cda963700 1 -- start start 2024-04-18T10:43:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cda963700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd4087b20 0x7f3cd40b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cda963700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cd40a3530 0x7f3cd406c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cda963700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406e860 0x7f3cd406cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cda963700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd40a5db0 con 0x7f3cd40a3530 2024-04-18T10:43:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cda963700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd406da70 con 0x7f3cd406e860 2024-04-18T10:43:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cda963700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd40a5840 con 0x7f3cd4087b20 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cd37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cd40a3530 0x7f3cd406c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cd3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd4087b20 0x7f3cd40b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cd8f00700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406e860 0x7f3cd406cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cd37fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3cd40a3530 0x7f3cd406c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40130/0 (socket says 172.21.15.31:40130) 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cd37fe700 1 -- 172.21.15.31:0/1059084517 learned_addr learned my addr 172.21.15.31:0/1059084517 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.599+0000 7f3cd3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd4087b20 0x7f3cd40b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44128/0 (socket says 172.21.15.31:44128) 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.603+0000 7f3cd37fe700 1 -- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd4087b20 msgr2=0x7f3cd40b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.603+0000 7f3cd37fe700 1 --2- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd4087b20 0x7f3cd40b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.603+0000 7f3cd37fe700 1 -- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406e860 msgr2=0x7f3cd406cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.603+0000 7f3cd37fe700 1 --2- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406e860 0x7f3cd406cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.603+0000 7f3cd37fe700 1 -- 172.21.15.31:0/1059084517 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40b10b0 con 0x7f3cd40a3530 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.603+0000 7f3cd37fe700 1 --2- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 0x7f3cd406c860 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800ddd0 tx=0x7f3cc800d6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f5dd4b9f5053f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.603+0000 7f3cd2ffd700 1 -- 172.21.15.31:0/1059084517 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8012070 con 0x7f3cd40a3530 2024-04-18T10:43:58.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.603+0000 7f3cd2ffd700 1 -- 172.21.15.31:0/1059084517 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc800d2e0 con 0x7f3cd40a3530 2024-04-18T10:43:58.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.603+0000 7f3cd2ffd700 1 -- 172.21.15.31:0/1059084517 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc800fb60 con 0x7f3cd40a3530 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.604+0000 7f3cda963700 1 -- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 msgr2=0x7f3cd406c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.604+0000 7f3cda963700 1 --2- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 0x7f3cd406c860 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800ddd0 tx=0x7f3cc800d6f0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.604+0000 7f3cda963700 1 -- 172.21.15.31:0/1059084517 shutdown_connections 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.604+0000 7f3cda963700 1 --2- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd406e860 0x7f3cd406cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.604+0000 7f3cda963700 1 --2- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd4087b20 0x7f3cd40b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.604+0000 7f3cda963700 1 --2- 172.21.15.31:0/1059084517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 0x7f3cd406c860 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.604+0000 7f3cda963700 1 -- 172.21.15.31:0/1059084517 >> 172.21.15.31:0/1059084517 conn(0x7f3cd406bbd0 msgr2=0x7f3cd4069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.604+0000 7f3cda963700 1 -- 172.21.15.31:0/1059084517 shutdown_connections 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.604+0000 7f3cda963700 1 -- 172.21.15.31:0/1059084517 wait complete. 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.606+0000 7f3cda963700 1 Processor -- start 2024-04-18T10:43:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.606+0000 7f3cda963700 1 -- start start 2024-04-18T10:43:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cda963700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406e860 0x7f3cd40a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cda963700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd4087b20 0x7f3cd40a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cda963700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 0x7f3cd415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cda963700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd414b620 con 0x7f3cd40a3530 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cda963700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd414df80 con 0x7f3cd4087b20 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cda963700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd414b810 con 0x7f3cd406e860 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd4087b20 0x7f3cd40a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd8f00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 0x7f3cd415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406e860 0x7f3cd40a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd37fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd4087b20 0x7f3cd40a7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38240/0 (socket says 172.21.15.31:38240) 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd37fe700 1 -- 172.21.15.31:0/2551952536 learned_addr learned my addr 172.21.15.31:0/2551952536 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd8f00700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 0x7f3cd415dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40144/0 (socket says 172.21.15.31:40144) 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd3fff700 1 -- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd4087b20 msgr2=0x7f3cd40a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd3fff700 1 --2- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd4087b20 0x7f3cd40a7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd3fff700 1 -- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 msgr2=0x7f3cd415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd3fff700 1 --2- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 0x7f3cd415dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd3fff700 1 -- 172.21.15.31:0/2551952536 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc800d990 con 0x7f3cd406e860 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd8f00700 1 --2- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 0x7f3cd415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd37fe700 1 --2- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd4087b20 0x7f3cd40a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cd3fff700 1 --2- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406e860 0x7f3cd40a7730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400e9d0 tx=0x7f3cc40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cbbfff700 1 -- 172.21.15.31:0/2551952536 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4013680 con 0x7f3cd406e860 2024-04-18T10:43:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cbbfff700 1 -- 172.21.15.31:0/2551952536 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4013800 con 0x7f3cd406e860 2024-04-18T10:43:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd414bab0 con 0x7f3cd406e860 2024-04-18T10:43:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.607+0000 7f3cbbfff700 1 -- 172.21.15.31:0/2551952536 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4013bc0 con 0x7f3cd406e860 2024-04-18T10:43:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.608+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd414d320 con 0x7f3cd406e860 2024-04-18T10:43:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.608+0000 7f3cbbfff700 1 -- 172.21.15.31:0/2551952536 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f3cc400c490 con 0x7f3cd406e860 2024-04-18T10:43:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.608+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd4064920 con 0x7f3cd406e860 2024-04-18T10:43:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.609+0000 7f3cbbfff700 1 -- 172.21.15.31:0/2551952536 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f3cc405b070 con 0x7f3cd406e860 2024-04-18T10:43:58.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.612+0000 7f3cbbfff700 1 -- 172.21.15.31:0/2551952536 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3cc40392b0 con 0x7f3cd406e860 2024-04-18T10:43:58.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.775+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3cd4069030 con 0x7f3cd406e860 2024-04-18T10:43:58.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.776+0000 7f3cbbfff700 1 -- 172.21.15.31:0/2551952536 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3cc403caa0 con 0x7f3cd406e860 2024-04-18T10:43:58.777 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.777+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 >> v1:172.21.15.31:6816/46601 conn(0x7f3cc0045ef0 legacy=0x7f3cc00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.777+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406e860 msgr2=0x7f3cd40a7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.777+0000 7f3cda963700 1 --2- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406e860 0x7f3cd40a7730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400e9d0 tx=0x7f3cc40091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.777+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 shutdown_connections 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.778+0000 7f3cda963700 1 --2- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f3cd406e860 0x7f3cd40a7730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.778+0000 7f3cda963700 1 --2- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cd40a3530 0x7f3cd415dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.778+0000 7f3cda963700 1 --2- 172.21.15.31:0/2551952536 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3cd4087b20 0x7f3cd40a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.778+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 >> 172.21.15.31:0/2551952536 conn(0x7f3cd406bbd0 msgr2=0x7f3cd4071230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.778+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 shutdown_connections 2024-04-18T10:43:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.778+0000 7f3cda963700 1 -- 172.21.15.31:0/2551952536 wait complete. 2024-04-18T10:43:58.790 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-18T10:43:58.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc123d1700 1 Processor -- start 2024-04-18T10:43:58.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc123d1700 1 -- start start 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc123d1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c06ecf0 0x7fcc0c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc123d1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcc0c0a7130 0x7fcc0c1462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc123d1700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c0a3540 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc123d1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c0a37e0 con 0x7fcc0c0a7130 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc123d1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0a5d60 con 0x7fcc0c06ecf0 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc0bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c06ecf0 0x7fcc0c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc0bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c06ecf0 0x7fcc0c0a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44150/0 (socket says 172.21.15.31:44150) 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc0bfff700 1 -- 172.21.15.31:0/3681156541 learned_addr learned my addr 172.21.15.31:0/3681156541 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.913+0000 7fcc1096e700 1 --2- 172.21.15.31:0/3681156541 >> v2:172.21.15.31:3300/0 conn(0x7fcc0c0a7130 0x7fcc0c1462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc1096e700 1 -- 172.21.15.31:0/3681156541 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c06ecf0 msgr2=0x7fcc0c0a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc1096e700 1 --2- 172.21.15.31:0/3681156541 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c06ecf0 0x7fcc0c0a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc1096e700 1 -- 172.21.15.31:0/3681156541 >> v1:172.21.15.31:6789/0 conn(0x7fcc0c0a6d60 legacy=0x7fcc0c142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc1096e700 1 -- 172.21.15.31:0/3681156541 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c06d980 con 0x7fcc0c0a7130 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc0affd700 1 -- 172.21.15.31:0/3681156541 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995720571 0 0) 0x7fcc0c0a3540 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc0bfff700 1 --2- 172.21.15.31:0/3681156541 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c06ecf0 0x7fcc0c0a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc1096e700 1 --2- 172.21.15.31:0/3681156541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a7130 0x7fcc0c1462a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009e60 tx=0x7fcc04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f8c7d31c2c0c6a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc0affd700 1 -- 172.21.15.31:0/3681156541 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400e070 con 0x7fcc0c0a7130 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc0affd700 1 -- 172.21.15.31:0/3681156541 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0400bb60 con 0x7fcc0c0a7130 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.914+0000 7fcc0affd700 1 -- 172.21.15.31:0/3681156541 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04012430 con 0x7fcc0c0a7130 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.915+0000 7fcc123d1700 1 -- 172.21.15.31:0/3681156541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a7130 msgr2=0x7fcc0c1462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.915+0000 7fcc123d1700 1 --2- 172.21.15.31:0/3681156541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a7130 0x7fcc0c1462a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009e60 tx=0x7fcc04009780 comp rx=0 tx=0).stop 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.915+0000 7fcc123d1700 1 -- 172.21.15.31:0/3681156541 shutdown_connections 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.915+0000 7fcc123d1700 1 --2- 172.21.15.31:0/3681156541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a7130 0x7fcc0c1462a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.915+0000 7fcc123d1700 1 --2- 172.21.15.31:0/3681156541 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c06ecf0 0x7fcc0c0a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.915+0000 7fcc123d1700 1 -- 172.21.15.31:0/3681156541 >> 172.21.15.31:0/3681156541 conn(0x7fcc0c0679e0 msgr2=0x7fcc0c067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.915+0000 7fcc123d1700 1 -- 172.21.15.31:0/3681156541 shutdown_connections 2024-04-18T10:43:58.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.915+0000 7fcc123d1700 1 -- 172.21.15.31:0/3681156541 wait complete. 2024-04-18T10:43:58.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.916+0000 7fcc123d1700 1 Processor -- start 2024-04-18T10:43:58.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.916+0000 7fcc123d1700 1 -- start start 2024-04-18T10:43:58.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc123d1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc0c06ecf0 0x7fcc0c0ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc123d1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a6d60 0x7fcc0c0aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc123d1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c0a7130 0x7fcc0c0a78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc123d1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0ab200 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc123d1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0ab7f0 con 0x7fcc0c06ecf0 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc123d1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0a9bd0 con 0x7fcc0c0a7130 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc0bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc0c06ecf0 0x7fcc0c0ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc0b7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a6d60 0x7fcc0c0aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc1096e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c0a7130 0x7fcc0c0a78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc0bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc0c06ecf0 0x7fcc0c0ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38252/0 (socket says 172.21.15.31:38252) 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc0bfff700 1 -- 172.21.15.31:0/3508350949 learned_addr learned my addr 172.21.15.31:0/3508350949 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc0b7fe700 1 -- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c0a7130 msgr2=0x7fcc0c0a78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc0b7fe700 1 --2- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c0a7130 0x7fcc0c0a78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc0b7fe700 1 -- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc0c06ecf0 msgr2=0x7fcc0c0ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc0b7fe700 1 --2- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc0c06ecf0 0x7fcc0c0ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.917+0000 7fcc0b7fe700 1 -- 172.21.15.31:0/3508350949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc0094f0 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.918+0000 7fcc0b7fe700 1 --2- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a6d60 0x7fcc0c0aacc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcc000019b0 tx=0x7fcc00007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:58.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.918+0000 7fcbf3fff700 1 -- 172.21.15.31:0/3508350949 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00013070 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.918+0000 7fcbf3fff700 1 -- 172.21.15.31:0/3508350949 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0000e0d0 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.918+0000 7fcbf3fff700 1 -- 172.21.15.31:0/3508350949 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc000105c0 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.918+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc04009a20 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.918+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c0a9820 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.919+0000 7fcbf3fff700 1 -- 172.21.15.31:0/3508350949 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fcc00010bc0 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.919+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c0651b0 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.919+0000 7fcbf3fff700 1 -- 172.21.15.31:0/3508350949 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fcc0005f0f0 con 0x7fcc0c0a6d60 2024-04-18T10:43:58.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:58.923+0000 7fcbf3fff700 1 -- 172.21.15.31:0/3508350949 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcc0003d390 con 0x7fcc0c0a6d60 2024-04-18T10:43:59.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.087+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcc0c0a7650 con 0x7fcc0c0a6d60 2024-04-18T10:43:59.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.088+0000 7fcbf3fff700 1 -- 172.21.15.31:0/3508350949 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc00040b80 con 0x7fcc0c0a6d60 2024-04-18T10:43:59.089 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 8 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.089+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 >> v1:172.21.15.31:6816/46601 conn(0x7fcbf8045ef0 legacy=0x7fcbf80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.089+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a6d60 msgr2=0x7fcc0c0aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.089+0000 7fcc123d1700 1 --2- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a6d60 0x7fcc0c0aacc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcc000019b0 tx=0x7fcc00007d70 comp rx=0 tx=0).stop 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.089+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 shutdown_connections 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.089+0000 7fcc123d1700 1 --2- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcc0c0a7130 0x7fcc0c0a78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.089+0000 7fcc123d1700 1 --2- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcc0c06ecf0 0x7fcc0c0ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.089+0000 7fcc123d1700 1 --2- 172.21.15.31:0/3508350949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc0c0a6d60 0x7fcc0c0aacc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.089+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 >> 172.21.15.31:0/3508350949 conn(0x7fcc0c0679e0 msgr2=0x7fcc0c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.090+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 shutdown_connections 2024-04-18T10:43:59.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.090+0000 7fcc123d1700 1 -- 172.21.15.31:0/3508350949 wait complete. 2024-04-18T10:43:59.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-18T10:43:59.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.224+0000 7f0759fb1700 1 Processor -- start 2024-04-18T10:43:59.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.224+0000 7f0759fb1700 1 -- start start 2024-04-18T10:43:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.224+0000 7f0759fb1700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0754068340 0x7f07540a4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.224+0000 7f0759fb1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754069580 0x7f0754141e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.224+0000 7f0759fb1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754142360 0x7f075406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.224+0000 7f0759fb1700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07540a47c0 con 0x7f0754068340 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.224+0000 7f0759fb1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07541427c0 con 0x7f0754069580 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.224+0000 7f0759fb1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07540a4540 con 0x7f0754142360 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0752ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754069580 0x7f0754141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f07537fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0754068340 0x7f07540a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0753fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754142360 0x7f075406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0753fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754142360 0x7f075406ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44166/0 (socket says 172.21.15.31:44166) 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f07537fe700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0754068340 0x7f07540a4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40184/0 (socket says 172.21.15.31:40184) 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0752ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754069580 0x7f0754141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38258/0 (socket says 172.21.15.31:38258) 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0753fff700 1 -- 172.21.15.31:0/1955371283 learned_addr learned my addr 172.21.15.31:0/1955371283 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0753fff700 1 -- 172.21.15.31:0/1955371283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754069580 msgr2=0x7f0754141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0753fff700 1 --2- 172.21.15.31:0/1955371283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754069580 0x7f0754141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0753fff700 1 -- 172.21.15.31:0/1955371283 >> v2:172.21.15.31:3300/0 conn(0x7f0754068340 msgr2=0x7f07540a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0753fff700 1 --2- 172.21.15.31:0/1955371283 >> v2:172.21.15.31:3300/0 conn(0x7f0754068340 0x7f07540a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0753fff700 1 -- 172.21.15.31:0/1955371283 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754069c90 con 0x7f0754142360 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f07537fe700 1 --2- 172.21.15.31:0/1955371283 >> v2:172.21.15.31:3300/0 conn(0x7f0754068340 0x7f07540a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:59.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0752ffd700 1 --2- 172.21.15.31:0/1955371283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754069580 0x7f0754141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f0753fff700 1 --2- 172.21.15.31:0/1955371283 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754142360 0x7f075406ea70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f074c009f50 tx=0x7f074c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb9ac66cee49f022 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f07527fc700 1 -- 172.21.15.31:0/1955371283 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00e070 con 0x7f0754142360 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f07527fc700 1 -- 172.21.15.31:0/1955371283 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c00b910 con 0x7f0754142360 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.225+0000 7f07527fc700 1 -- 172.21.15.31:0/1955371283 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0092e0 con 0x7f0754142360 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.226+0000 7f0759fb1700 1 -- 172.21.15.31:0/1955371283 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754142360 msgr2=0x7f075406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.226+0000 7f0759fb1700 1 --2- 172.21.15.31:0/1955371283 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754142360 0x7f075406ea70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f074c009f50 tx=0x7f074c009840 comp rx=0 tx=0).stop 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.226+0000 7f0759fb1700 1 -- 172.21.15.31:0/1955371283 shutdown_connections 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.226+0000 7f0759fb1700 1 --2- 172.21.15.31:0/1955371283 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754142360 0x7f075406ea70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.226+0000 7f0759fb1700 1 --2- 172.21.15.31:0/1955371283 >> v2:172.21.15.31:3300/0 conn(0x7f0754068340 0x7f07540a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.226+0000 7f0759fb1700 1 --2- 172.21.15.31:0/1955371283 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754069580 0x7f0754141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.226+0000 7f0759fb1700 1 -- 172.21.15.31:0/1955371283 >> 172.21.15.31:0/1955371283 conn(0x7f075406bfa0 msgr2=0x7f07540679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.226+0000 7f0759fb1700 1 -- 172.21.15.31:0/1955371283 shutdown_connections 2024-04-18T10:43:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.226+0000 7f0759fb1700 1 -- 172.21.15.31:0/1955371283 wait complete. 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.227+0000 7f0759fb1700 1 Processor -- start 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.227+0000 7f0759fb1700 1 -- start start 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.227+0000 7f0759fb1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0754068340 0x7f07541511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.227+0000 7f0759fb1700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754069580 0x7f0754151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.227+0000 7f0759fb1700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754142360 0x7f0754151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.227+0000 7f0759fb1700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0754096a70 con 0x7f0754068340 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.227+0000 7f0759fb1700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07540983d0 con 0x7f0754142360 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0759fb1700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0754097350 con 0x7f0754069580 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f07537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0754068340 0x7f07541511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0753fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754142360 0x7f0754151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f07537fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0754068340 0x7f07541511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40196/0 (socket says 172.21.15.31:40196) 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f07537fe700 1 -- 172.21.15.31:0/1077355180 learned_addr learned my addr 172.21.15.31:0/1077355180 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0752ffd700 1 --2- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754069580 0x7f0754151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0753fff700 1 -- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754069580 msgr2=0x7f0754151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0753fff700 1 --2- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754069580 0x7f0754151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0753fff700 1 -- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0754068340 msgr2=0x7f07541511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0753fff700 1 --2- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0754068340 0x7f07541511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0753fff700 1 -- 172.21.15.31:0/1077355180 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744009420 con 0x7f0754142360 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0753fff700 1 --2- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754142360 0x7f0754151c50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f074c015000 tx=0x7f074c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f073b7fe700 1 -- 172.21.15.31:0/1077355180 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c007ac0 con 0x7f0754142360 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f073b7fe700 1 -- 172.21.15.31:0/1077355180 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c007c40 con 0x7f0754142360 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0748009420 con 0x7f0754142360 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f073b7fe700 1 -- 172.21.15.31:0/1077355180 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c01d420 con 0x7f0754142360 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.228+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074c009ae0 con 0x7f0754142360 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.229+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0754096be0 con 0x7f0754142360 2024-04-18T10:43:59.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.229+0000 7f073b7fe700 1 -- 172.21.15.31:0/1077355180 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f074c003040 con 0x7f0754142360 2024-04-18T10:43:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.230+0000 7f073b7fe700 1 -- 172.21.15.31:0/1077355180 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f074c05c8f0 con 0x7f0754142360 2024-04-18T10:43:59.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.233+0000 7f073b7fe700 1 -- 172.21.15.31:0/1077355180 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f0754096be0 con 0x7f0754142360 2024-04-18T10:43:59.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.398+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0754096be0 con 0x7f0754142360 2024-04-18T10:43:59.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.398+0000 7f073b7fe700 1 -- 172.21.15.31:0/1077355180 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0754096be0 con 0x7f0754142360 2024-04-18T10:43:59.399 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 >> v1:172.21.15.31:6816/46601 conn(0x7f0740045ef0 legacy=0x7f07400483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754142360 msgr2=0x7f0754151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 --2- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754142360 0x7f0754151c50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f074c015000 tx=0x7f074c018000 comp rx=0 tx=0).stop 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 shutdown_connections 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 --2- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f0754142360 0x7f0754151c50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 --2- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0754068340 0x7f07541511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 --2- 172.21.15.31:0/1077355180 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f0754069580 0x7f0754151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 >> 172.21.15.31:0/1077355180 conn(0x7f075406bfa0 msgr2=0x7f07540a4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 shutdown_connections 2024-04-18T10:43:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.400+0000 7f0759fb1700 1 -- 172.21.15.31:0/1077355180 wait complete. 2024-04-18T10:43:59.413 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-18T10:43:59.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.536+0000 7fc3ac7e7700 1 Processor -- start 2024-04-18T10:43:59.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.536+0000 7fc3ac7e7700 1 -- start start 2024-04-18T10:43:59.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.536+0000 7fc3ac7e7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a40680f0 0x7fc3a40a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.536+0000 7fc3ac7e7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3a4069f20 0x7fc3a406f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.536+0000 7fc3ac7e7700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a406a480 con 0x7fc3a4069b50 2024-04-18T10:43:59.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.536+0000 7fc3ac7e7700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a40a3430 con 0x7fc3a4069f20 2024-04-18T10:43:59.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.536+0000 7fc3ac7e7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a406a720 con 0x7fc3a40680f0 2024-04-18T10:43:59.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3aa583700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a40680f0 0x7fc3a40a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3aad84700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3a4069f20 0x7fc3a406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3a9d82700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc3a4069b50 0x7fc3a406ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40398/0 (socket says 172.21.15.31:40398) 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3a9d82700 1 -- 172.21.15.31:0/2897407148 learned_addr learned my addr 172.21.15.31:0/2897407148 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3a9581700 1 -- 172.21.15.31:0/2897407148 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528338671 0 0) 0x7fc3a406a480 con 0x7fc3a4069b50 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3a9581700 1 -- 172.21.15.31:0/2897407148 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc390003570 con 0x7fc3a4069b50 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3aad84700 1 -- 172.21.15.31:0/2897407148 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a40680f0 msgr2=0x7fc3a40a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3aad84700 1 --2- 172.21.15.31:0/2897407148 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a40680f0 0x7fc3a40a3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3aad84700 1 -- 172.21.15.31:0/2897407148 >> v1:172.21.15.31:6789/0 conn(0x7fc3a4069b50 legacy=0x7fc3a406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3aad84700 1 -- 172.21.15.31:0/2897407148 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a406aa80 con 0x7fc3a4069f20 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3aa583700 1 --2- 172.21.15.31:0/2897407148 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a40680f0 0x7fc3a40a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3aad84700 1 --2- 172.21.15.31:0/2897407148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4069f20 0x7fc3a406f110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009e60 tx=0x7fc39c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacc3d3ce263ad9d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3a9581700 1 -- 172.21.15.31:0/2897407148 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00e070 con 0x7fc3a4069f20 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3a9581700 1 -- 172.21.15.31:0/2897407148 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c00bab0 con 0x7fc3a4069f20 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.537+0000 7fc3a9581700 1 -- 172.21.15.31:0/2897407148 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c00be70 con 0x7fc3a4069f20 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.538+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2897407148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4069f20 msgr2=0x7fc3a406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.538+0000 7fc3ac7e7700 1 --2- 172.21.15.31:0/2897407148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4069f20 0x7fc3a406f110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009e60 tx=0x7fc39c009780 comp rx=0 tx=0).stop 2024-04-18T10:43:59.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.538+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2897407148 shutdown_connections 2024-04-18T10:43:59.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.538+0000 7fc3ac7e7700 1 --2- 172.21.15.31:0/2897407148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a4069f20 0x7fc3a406f110 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.538+0000 7fc3ac7e7700 1 --2- 172.21.15.31:0/2897407148 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a40680f0 0x7fc3a40a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.538+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2897407148 >> 172.21.15.31:0/2897407148 conn(0x7fc3a406dd70 msgr2=0x7fc3a40679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:59.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.538+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2897407148 shutdown_connections 2024-04-18T10:43:59.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.538+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2897407148 wait complete. 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.539+0000 7fc3ac7e7700 1 Processor -- start 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.539+0000 7fc3ac7e7700 1 -- start start 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.539+0000 7fc3ac7e7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40680f0 0x7fc3a4097d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.539+0000 7fc3ac7e7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4069b50 0x7fc3a41514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.539+0000 7fc3ac7e7700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a4069f20 0x7fc3a4151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.539+0000 7fc3ac7e7700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4097260 con 0x7fc3a40680f0 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.539+0000 7fc3ac7e7700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40986a0 con 0x7fc3a4069b50 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.539+0000 7fc3ac7e7700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a40992f0 con 0x7fc3a4069f20 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aad84700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a4069f20 0x7fc3a4151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aa583700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40680f0 0x7fc3a4097d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3a9d82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4069b50 0x7fc3a41514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aad84700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a4069f20 0x7fc3a4151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44198/0 (socket says 172.21.15.31:44198) 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aad84700 1 -- 172.21.15.31:0/2182397034 learned_addr learned my addr 172.21.15.31:0/2182397034 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3a9d82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4069b50 0x7fc3a41514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38266/0 (socket says 172.21.15.31:38266) 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aa583700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40680f0 0x7fc3a4097d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40216/0 (socket says 172.21.15.31:40216) 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aad84700 1 -- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4069b50 msgr2=0x7fc3a41514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aad84700 1 --2- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4069b50 0x7fc3a41514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aad84700 1 -- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40680f0 msgr2=0x7fc3a4097d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aad84700 1 --2- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40680f0 0x7fc3a4097d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aad84700 1 -- 172.21.15.31:0/2182397034 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a0009420 con 0x7fc3a4069f20 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aa583700 1 --2- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40680f0 0x7fc3a4097d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3aad84700 1 --2- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a4069f20 0x7fc3a4151a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00b610 tx=0x7fc39c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc39a7fc700 1 -- 172.21.15.31:0/2182397034 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c012dd0 con 0x7fc3a4069f20 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc39a7fc700 1 -- 172.21.15.31:0/2182397034 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c027470 con 0x7fc3a4069f20 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c009a20 con 0x7fc3a4069f20 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc39a7fc700 1 -- 172.21.15.31:0/2182397034 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c027830 con 0x7fc3a4069f20 2024-04-18T10:43:59.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.540+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a40aeca0 con 0x7fc3a4069f20 2024-04-18T10:43:59.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.541+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a40651b0 con 0x7fc3a4069f20 2024-04-18T10:43:59.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.541+0000 7fc39a7fc700 1 -- 172.21.15.31:0/2182397034 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fc39c024070 con 0x7fc3a4069f20 2024-04-18T10:43:59.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.542+0000 7fc39a7fc700 1 -- 172.21.15.31:0/2182397034 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fc39c05dae0 con 0x7fc3a4069f20 2024-04-18T10:43:59.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.545+0000 7fc39a7fc700 1 -- 172.21.15.31:0/2182397034 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fc39c006860 con 0x7fc3a4069f20 2024-04-18T10:43:59.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.712+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3a40a4520 con 0x7fc3a4069f20 2024-04-18T10:43:59.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.713+0000 7fc39a7fc700 1 -- 172.21.15.31:0/2182397034 <== mon.2 v2:172.21.15.31:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc39c006860 con 0x7fc3a4069f20 2024-04-18T10:43:59.714 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-04-18T10:43:59.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 >> v1:172.21.15.31:6816/46601 conn(0x7fc388045f20 legacy=0x7fc3880483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a4069f20 msgr2=0x7fc3a4151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 --2- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a4069f20 0x7fc3a4151a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00b610 tx=0x7fc39c019000 comp rx=0 tx=0).stop 2024-04-18T10:43:59.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 shutdown_connections 2024-04-18T10:43:59.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 --2- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fc3a4069f20 0x7fc3a4151a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 --2- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3a40680f0 0x7fc3a4097d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 --2- 172.21.15.31:0/2182397034 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fc3a4069b50 0x7fc3a41514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 >> 172.21.15.31:0/2182397034 conn(0x7fc3a406dd70 msgr2=0x7fc3a40b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:59.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 shutdown_connections 2024-04-18T10:43:59.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.715+0000 7fc3ac7e7700 1 -- 172.21.15.31:0/2182397034 wait complete. 2024-04-18T10:43:59.727 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-18T10:43:59.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.847+0000 7f3831a3f700 1 Processor -- start 2024-04-18T10:43:59.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.847+0000 7f3831a3f700 1 -- start start 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.847+0000 7f3831a3f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f382c063f70 0x7f382c0a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.847+0000 7f3831a3f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c13ea30 0x7f382c13eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.847+0000 7f3831a3f700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c13f3e0 con 0x7f382c0a5380 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.847+0000 7f3831a3f700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c0a7e20 con 0x7f382c063f70 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.847+0000 7f3831a3f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0aa260 con 0x7f382c13ea30 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.847+0000 7f382a7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c13ea30 0x7f382c13eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.847+0000 7f382affd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f382c063f70 0x7f382c0a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f382b7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f382c0a5380 0x7f382c0a5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40402/0 (socket says 172.21.15.31:40402) 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f382b7fe700 1 -- 172.21.15.31:0/777792723 learned_addr learned my addr 172.21.15.31:0/777792723 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f3829ffb700 1 -- 172.21.15.31:0/777792723 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107148995 0 0) 0x7f382c13f3e0 con 0x7f382c0a5380 2024-04-18T10:43:59.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f3829ffb700 1 -- 172.21.15.31:0/777792723 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3814003570 con 0x7f382c0a5380 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f382a7fc700 1 -- 172.21.15.31:0/777792723 >> v2:172.21.15.31:3300/0 conn(0x7f382c063f70 msgr2=0x7f382c0a78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f382a7fc700 1 --2- 172.21.15.31:0/777792723 >> v2:172.21.15.31:3300/0 conn(0x7f382c063f70 0x7f382c0a78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f382a7fc700 1 -- 172.21.15.31:0/777792723 >> v1:172.21.15.31:6789/0 conn(0x7f382c0a5380 legacy=0x7f382c0a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f382a7fc700 1 -- 172.21.15.31:0/777792723 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c0a9d60 con 0x7f382c13ea30 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f382affd700 1 --2- 172.21.15.31:0/777792723 >> v2:172.21.15.31:3300/0 conn(0x7f382c063f70 0x7f382c0a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f382a7fc700 1 --2- 172.21.15.31:0/777792723 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c13ea30 0x7f382c13eea0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f38200098e0 tx=0x7f38200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5e097c5e098a6ed server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f3829ffb700 1 -- 172.21.15.31:0/777792723 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820011630 con 0x7f382c13ea30 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f3829ffb700 1 -- 172.21.15.31:0/777792723 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820011790 con 0x7f382c13ea30 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.848+0000 7f3829ffb700 1 -- 172.21.15.31:0/777792723 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820011b30 con 0x7f382c13ea30 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.849+0000 7f3831a3f700 1 -- 172.21.15.31:0/777792723 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c13ea30 msgr2=0x7f382c13eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.849+0000 7f3831a3f700 1 --2- 172.21.15.31:0/777792723 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c13ea30 0x7f382c13eea0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f38200098e0 tx=0x7f38200091a0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.849+0000 7f3831a3f700 1 -- 172.21.15.31:0/777792723 shutdown_connections 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.849+0000 7f3831a3f700 1 --2- 172.21.15.31:0/777792723 >> v2:172.21.15.31:3300/0 conn(0x7f382c063f70 0x7f382c0a78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.849+0000 7f3831a3f700 1 --2- 172.21.15.31:0/777792723 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c13ea30 0x7f382c13eea0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.849+0000 7f3831a3f700 1 -- 172.21.15.31:0/777792723 >> 172.21.15.31:0/777792723 conn(0x7f382c06f110 msgr2=0x7f382c063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:43:59.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.849+0000 7f3831a3f700 1 -- 172.21.15.31:0/777792723 shutdown_connections 2024-04-18T10:43:59.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.849+0000 7f3831a3f700 1 -- 172.21.15.31:0/777792723 wait complete. 2024-04-18T10:43:59.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.850+0000 7f3831a3f700 1 Processor -- start 2024-04-18T10:43:59.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.850+0000 7f3831a3f700 1 -- start start 2024-04-18T10:43:59.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.850+0000 7f3831a3f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f382c063f70 0x7f382c0ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.850+0000 7f3831a3f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c0a5380 0x7f382c0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f3831a3f700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f382c13ea30 0x7f382c0abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:43:59.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f3831a3f700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0af1c0 con 0x7f382c063f70 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f3831a3f700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0b0a00 con 0x7f382c13ea30 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f3831a3f700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0b0cc0 con 0x7f382c0a5380 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382a7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c0a5380 0x7f382c0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f382c063f70 0x7f382c0ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382a7fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c0a5380 0x7f382c0af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44226/0 (socket says 172.21.15.31:44226) 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f382c13ea30 0x7f382c0abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382a7fc700 1 -- 172.21.15.31:0/3285081540 learned_addr learned my addr 172.21.15.31:0/3285081540 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382affd700 1 -- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c0a5380 msgr2=0x7f382c0af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382affd700 1 --2- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c0a5380 0x7f382c0af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382affd700 1 -- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f382c13ea30 msgr2=0x7f382c0abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382affd700 1 --2- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f382c13ea30 0x7f382c0abf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382affd700 1 -- 172.21.15.31:0/3285081540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c009420 con 0x7f382c063f70 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382a7fc700 1 --2- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c0a5380 0x7f382c0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:43:59.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f382affd700 1 --2- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f382c063f70 0x7f382c0ad9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f381c00ec80 tx=0x7f381c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:43:59.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f3812ffd700 1 -- 172.21.15.31:0/3285081540 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00c850 con 0x7f382c063f70 2024-04-18T10:43:59.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f3812ffd700 1 -- 172.21.15.31:0/3285081540 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00c9b0 con 0x7f382c063f70 2024-04-18T10:43:59.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3820009420 con 0x7f382c063f70 2024-04-18T10:43:59.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f3812ffd700 1 -- 172.21.15.31:0/3285081540 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c00cd70 con 0x7f382c063f70 2024-04-18T10:43:59.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.851+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c0aebb0 con 0x7f382c063f70 2024-04-18T10:43:59.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.852+0000 7f3812ffd700 1 -- 172.21.15.31:0/3285081540 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f381c013680 con 0x7f382c063f70 2024-04-18T10:43:59.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.852+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c0ad820 con 0x7f382c063f70 2024-04-18T10:43:59.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.853+0000 7f3812ffd700 1 -- 172.21.15.31:0/3285081540 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f381c05b3d0 con 0x7f382c063f70 2024-04-18T10:43:59.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:43:59.856+0000 7f3812ffd700 1 -- 172.21.15.31:0/3285081540 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f381c0395d0 con 0x7f382c063f70 2024-04-18T10:44:00.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.036+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f382c0aff40 con 0x7f382c063f70 2024-04-18T10:44:00.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.036+0000 7f3812ffd700 1 -- 172.21.15.31:0/3285081540 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v44) v1 ==== 80+0+350 (secure 0 0 0) 0x7f381c03cdc0 con 0x7f382c063f70 2024-04-18T10:44:00.037 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.137:0/2414209880 2024-04-18T11:40:39.525564+0000 2024-04-18T10:44:00.037 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6819/3321563080 2024-04-19T10:38:52.565121+0000 2024-04-18T10:44:00.037 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2921291208 2024-04-19T10:38:28.389077+0000 2024-04-18T10:44:00.038 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/2767636595 2024-04-19T10:38:28.389077+0000 2024-04-18T10:44:00.038 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:0/3252462560 2024-04-19T10:38:28.389077+0000 2024-04-18T10:44:00.038 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6816/39551 2024-04-19T10:38:28.389077+0000 2024-04-18T10:44:00.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 >> v1:172.21.15.31:6816/46601 conn(0x7f3818045ef0 legacy=0x7f38180483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:00.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f382c063f70 msgr2=0x7f382c0ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:00.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 --2- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f382c063f70 0x7f382c0ad9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f381c00ec80 tx=0x7f381c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 shutdown_connections 2024-04-18T10:44:00.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 --2- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f382c13ea30 0x7f382c0abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 --2- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f382c063f70 0x7f382c0ad9d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 --2- 172.21.15.31:0/3285081540 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f382c0a5380 0x7f382c0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 >> 172.21.15.31:0/3285081540 conn(0x7f382c06f110 msgr2=0x7f382c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:00.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 shutdown_connections 2024-04-18T10:44:00.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.038+0000 7f3831a3f700 1 -- 172.21.15.31:0/3285081540 wait complete. 2024-04-18T10:44:00.040 INFO:teuthology.orchestra.run.smithi031.stderr:listed 6 entries 2024-04-18T10:44:00.051 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.1 2024-04-18T10:44:00.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:44:00.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.1 2024-04-18T10:44:00.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi137.stderr:ceph-fuse[37350]: fuse finished with error 0 and tester_r 0 2024-04-18T10:44:00.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-18T10:44:00.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:44:00.098 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-18T10:44:00.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:44:00.353 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-18T10:44:00.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:44:00.375 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-18T10:44:00.447 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-18T10:44:00.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:44:00.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:44:00.449 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-18T10:44:00.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-18T10:44:00.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-18T10:44:00.547 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-04-18T10:44:00.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:44:00.548 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-18T10:44:00.562 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-18T10:44:00.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:44:00.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.688+0000 7fa955839700 1 Processor -- start 2024-04-18T10:44:00.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.688+0000 7fa955839700 1 -- start start 2024-04-18T10:44:00.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa955839700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa950063b80 0x7fa9500ab350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:00.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa955839700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa9500aa7f0 0x7fa95013b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:00.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa955839700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9500aabe0 0x7fa95013bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:00.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa955839700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9500a9fd0 con 0x7fa9500aa7f0 2024-04-18T10:44:00.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa955839700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500acba0 con 0x7fa9500aabe0 2024-04-18T10:44:00.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa955839700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9500ace40 con 0x7fa950063b80 2024-04-18T10:44:00.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa9500aa7f0 0x7fa95013b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:00.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa950063b80 0x7fa9500ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:00.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94f7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9500aabe0 0x7fa95013bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94e7fc700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa9500aa7f0 0x7fa95013b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40244/0 (socket says 172.21.15.31:40244) 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94effd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa950063b80 0x7fa9500ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44240/0 (socket says 172.21.15.31:44240) 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94e7fc700 1 -- 172.21.15.31:0/4094958022 learned_addr learned my addr 172.21.15.31:0/4094958022 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94f7fe700 1 -- 172.21.15.31:0/4094958022 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa950063b80 msgr2=0x7fa9500ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94f7fe700 1 --2- 172.21.15.31:0/4094958022 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa950063b80 0x7fa9500ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94f7fe700 1 -- 172.21.15.31:0/4094958022 >> v2:172.21.15.31:3300/0 conn(0x7fa9500aa7f0 msgr2=0x7fa95013b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94f7fe700 1 --2- 172.21.15.31:0/4094958022 >> v2:172.21.15.31:3300/0 conn(0x7fa9500aa7f0 0x7fa95013b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94f7fe700 1 -- 172.21.15.31:0/4094958022 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9500ac390 con 0x7fa9500aabe0 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94effd700 1 --2- 172.21.15.31:0/4094958022 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa950063b80 0x7fa9500ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.689+0000 7fa94e7fc700 1 --2- 172.21.15.31:0/4094958022 >> v2:172.21.15.31:3300/0 conn(0x7fa9500aa7f0 0x7fa95013b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa94f7fe700 1 --2- 172.21.15.31:0/4094958022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9500aabe0 0x7fa95013bab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa948009e60 tx=0x7fa948009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b1cbe9a0bebc15 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa94dffb700 1 -- 172.21.15.31:0/4094958022 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800e070 con 0x7fa9500aabe0 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa94dffb700 1 -- 172.21.15.31:0/4094958022 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94800bab0 con 0x7fa9500aabe0 2024-04-18T10:44:00.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa94dffb700 1 -- 172.21.15.31:0/4094958022 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94800be70 con 0x7fa9500aabe0 2024-04-18T10:44:00.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa955839700 1 -- 172.21.15.31:0/4094958022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9500aabe0 msgr2=0x7fa95013bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:00.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa955839700 1 --2- 172.21.15.31:0/4094958022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9500aabe0 0x7fa95013bab0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa948009e60 tx=0x7fa948009780 comp rx=0 tx=0).stop 2024-04-18T10:44:00.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa955839700 1 -- 172.21.15.31:0/4094958022 shutdown_connections 2024-04-18T10:44:00.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa955839700 1 --2- 172.21.15.31:0/4094958022 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa9500aabe0 0x7fa95013bab0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa955839700 1 --2- 172.21.15.31:0/4094958022 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa950063b80 0x7fa9500ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa955839700 1 --2- 172.21.15.31:0/4094958022 >> v2:172.21.15.31:3300/0 conn(0x7fa9500aa7f0 0x7fa95013b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa955839700 1 -- 172.21.15.31:0/4094958022 >> 172.21.15.31:0/4094958022 conn(0x7fa9500b1290 msgr2=0x7fa9500b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.690+0000 7fa955839700 1 -- 172.21.15.31:0/4094958022 shutdown_connections 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.691+0000 7fa955839700 1 -- 172.21.15.31:0/4094958022 wait complete. 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa955839700 1 Processor -- start 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa955839700 1 -- start start 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa955839700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa950063b80 0x7fa95006de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa955839700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500aa7f0 0x7fa950137060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa955839700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9500aabe0 0x7fa9501375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa955839700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa950140630 con 0x7fa9500aa7f0 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa955839700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9501403c0 con 0x7fa950063b80 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa955839700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa950140f00 con 0x7fa9500aabe0 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa94e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500aa7f0 0x7fa950137060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:00.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa94effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa950063b80 0x7fa95006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa94e7fc700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500aa7f0 0x7fa950137060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40256/0 (socket says 172.21.15.31:40256) 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa94effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa950063b80 0x7fa95006de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38294/0 (socket says 172.21.15.31:38294) 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa94e7fc700 1 -- 172.21.15.31:0/1215528739 learned_addr learned my addr 172.21.15.31:0/1215528739 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.692+0000 7fa94f7fe700 1 --2- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9500aabe0 0x7fa9501375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa94e7fc700 1 -- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9500aabe0 msgr2=0x7fa9501375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa94e7fc700 1 --2- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9500aabe0 0x7fa9501375a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa94e7fc700 1 -- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa950063b80 msgr2=0x7fa95006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa94e7fc700 1 --2- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa950063b80 0x7fa95006de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa94e7fc700 1 -- 172.21.15.31:0/1215528739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944009420 con 0x7fa9500aa7f0 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa94effd700 1 --2- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa950063b80 0x7fa95006de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:00.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa94e7fc700 1 --2- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500aa7f0 0x7fa950137060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa94000ec50 tx=0x7fa940009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa936ffd700 1 -- 172.21.15.31:0/1215528739 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000c850 con 0x7fa9500aa7f0 2024-04-18T10:44:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa936ffd700 1 -- 172.21.15.31:0/1215528739 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94000c9b0 con 0x7fa9500aa7f0 2024-04-18T10:44:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9400094f0 con 0x7fa9500aa7f0 2024-04-18T10:44:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa936ffd700 1 -- 172.21.15.31:0/1215528739 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94000cd50 con 0x7fa9500aa7f0 2024-04-18T10:44:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.693+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa948009a20 con 0x7fa9500aa7f0 2024-04-18T10:44:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.694+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95006ea80 con 0x7fa9500aa7f0 2024-04-18T10:44:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.694+0000 7fa936ffd700 1 -- 172.21.15.31:0/1215528739 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fa940013680 con 0x7fa9500aa7f0 2024-04-18T10:44:00.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.694+0000 7fa936ffd700 1 -- 172.21.15.31:0/1215528739 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fa94005b400 con 0x7fa9500aa7f0 2024-04-18T10:44:00.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.699+0000 7fa936ffd700 1 -- 172.21.15.31:0/1215528739 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fa9400396a0 con 0x7fa9500aa7f0 2024-04-18T10:44:00.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.855+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9500ad300 con 0x7fa93c045ef0 2024-04-18T10:44:00.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.864+0000 7fa936ffd700 1 -- 172.21.15.31:0/1215528739 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278028 (unknown 2965378022 0 1430237390) 0x7fa9500ad300 con 0x7fa93c045ef0 2024-04-18T10:44:00.868 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 >> v1:172.21.15.31:6816/46601 conn(0x7fa93c045ef0 legacy=0x7fa93c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500aa7f0 msgr2=0x7fa950137060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 --2- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500aa7f0 0x7fa950137060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa94000ec50 tx=0x7fa940009250 comp rx=0 tx=0).stop 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 shutdown_connections 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 --2- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa9500aabe0 0x7fa9501375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 --2- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa950063b80 0x7fa95006de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 --2- 172.21.15.31:0/1215528739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9500aa7f0 0x7fa950137060 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 >> 172.21.15.31:0/1215528739 conn(0x7fa9500b1290 msgr2=0x7fa9500ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 shutdown_connections 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:00.867+0000 7fa955839700 1 -- 172.21.15.31:0/1215528739 wait complete. 2024-04-18T10:44:00.871 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:44:00.879 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-04-18T10:44:00.485129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35077,"ondisk_log_size":35077,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6620104,"num_objects":-910,"num_object_clones":0,"num_object_copies":-1820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-910,"num_whiteouts":0,"num_read":17,"num_read_kb":152,"num_write":1011,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003004"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":522,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452679+0000","last_change":"2024-04-18T10:38:48.515671+0000","last_active":"2024-04-18T10:43:51.452679+0000","last_peered":"2024-04-18T10:43:51.452679+0000","last_clean":"2024-04-18T10:43:51.452679+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:43:51.452679+0000","last_undegraded":"2024-04-18T10:43:51.452679+0000","last_fullsized":"2024-04-18T10:43:51.452679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:55:56.692744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":510,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447019+0000","last_change":"2024-04-18T10:38:47.514349+0000","last_active":"2024-04-18T10:43:51.447019+0000","last_peered":"2024-04-18T10:43:51.447019+0000","last_clean":"2024-04-18T10:43:51.447019+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:43:51.447019+0000","last_undegraded":"2024-04-18T10:43:51.447019+0000","last_fullsized":"2024-04-18T10:43:51.447019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:40:55.175836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":421,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.414072+0000","last_change":"2024-04-18T10:38:46.523814+0000","last_active":"2024-04-18T10:43:51.414072+0000","last_peered":"2024-04-18T10:43:51.414072+0000","last_clean":"2024-04-18T10:43:51.414072+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:43:51.414072+0000","last_undegraded":"2024-04-18T10:43:51.414072+0000","last_fullsized":"2024-04-18T10:43:51.414072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:17.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":453,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.421836+0000","last_change":"2024-04-18T10:38:46.523213+0000","last_active":"2024-04-18T10:43:51.421836+0000","last_peered":"2024-04-18T10:43:51.421836+0000","last_clean":"2024-04-18T10:43:51.421836+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:43:51.421836+0000","last_undegraded":"2024-04-18T10:43:51.421836+0000","last_fullsized":"2024-04-18T10:43:51.421836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:17.296380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446083+0000","last_change":"2024-04-18T10:39:29.510615+0000","last_active":"2024-04-18T10:43:51.446083+0000","last_peered":"2024-04-18T10:43:51.446083+0000","last_clean":"2024-04-18T10:43:51.446083+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:43:51.446083+0000","last_undegraded":"2024-04-18T10:43:51.446083+0000","last_fullsized":"2024-04-18T10:43:51.446083+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:56.036618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":402,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443624+0000","last_change":"2024-04-18T10:39:29.508173+0000","last_active":"2024-04-18T10:43:51.443624+0000","last_peered":"2024-04-18T10:43:51.443624+0000","last_clean":"2024-04-18T10:43:51.443624+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:43:51.443624+0000","last_undegraded":"2024-04-18T10:43:51.443624+0000","last_fullsized":"2024-04-18T10:43:51.443624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:12:51.268277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":518,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431514+0000","last_change":"2024-04-18T10:38:48.526481+0000","last_active":"2024-04-18T10:43:51.431514+0000","last_peered":"2024-04-18T10:43:51.431514+0000","last_clean":"2024-04-18T10:43:51.431514+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:43:51.431514+0000","last_undegraded":"2024-04-18T10:43:51.431514+0000","last_fullsized":"2024-04-18T10:43:51.431514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:52:21.244414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.432661+0000","last_change":"2024-04-18T10:38:46.507263+0000","last_active":"2024-04-18T10:43:51.432661+0000","last_peered":"2024-04-18T10:43:51.432661+0000","last_clean":"2024-04-18T10:43:51.432661+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:43:51.432661+0000","last_undegraded":"2024-04-18T10:43:51.432661+0000","last_fullsized":"2024-04-18T10:43:51.432661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:09:47.927239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":503,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431820+0000","last_change":"2024-04-18T10:38:48.521319+0000","last_active":"2024-04-18T10:43:51.431820+0000","last_peered":"2024-04-18T10:43:51.431820+0000","last_clean":"2024-04-18T10:43:51.431820+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:43:51.431820+0000","last_undegraded":"2024-04-18T10:43:51.431820+0000","last_fullsized":"2024-04-18T10:43:51.431820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:08:27.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.444192+0000","last_change":"2024-04-18T10:38:46.520305+0000","last_active":"2024-04-18T10:43:51.444192+0000","last_peered":"2024-04-18T10:43:51.444192+0000","last_clean":"2024-04-18T10:43:51.444192+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:43:51.444192+0000","last_undegraded":"2024-04-18T10:43:51.444192+0000","last_fullsized":"2024-04-18T10:43:51.444192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.888537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":509,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.428542+0000","last_change":"2024-04-18T10:38:46.520635+0000","last_active":"2024-04-18T10:43:51.428542+0000","last_peered":"2024-04-18T10:43:51.428542+0000","last_clean":"2024-04-18T10:43:51.428542+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:43:51.428542+0000","last_undegraded":"2024-04-18T10:43:51.428542+0000","last_fullsized":"2024-04-18T10:43:51.428542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:25.599792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452935+0000","last_change":"2024-04-18T10:38:48.520598+0000","last_active":"2024-04-18T10:43:51.452935+0000","last_peered":"2024-04-18T10:43:51.452935+0000","last_clean":"2024-04-18T10:43:51.452935+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:43:51.452935+0000","last_undegraded":"2024-04-18T10:43:51.452935+0000","last_fullsized":"2024-04-18T10:43:51.452935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:57:15.523949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452998+0000","last_change":"2024-04-18T10:38:48.531599+0000","last_active":"2024-04-18T10:43:51.452998+0000","last_peered":"2024-04-18T10:43:51.452998+0000","last_clean":"2024-04-18T10:43:51.452998+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:43:51.452998+0000","last_undegraded":"2024-04-18T10:43:51.452998+0000","last_fullsized":"2024-04-18T10:43:51.452998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:07:18.483736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":448,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446075+0000","last_change":"2024-04-18T10:38:47.515586+0000","last_active":"2024-04-18T10:43:51.446075+0000","last_peered":"2024-04-18T10:43:51.446075+0000","last_clean":"2024-04-18T10:43:51.446075+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:43:51.446075+0000","last_undegraded":"2024-04-18T10:43:51.446075+0000","last_fullsized":"2024-04-18T10:43:51.446075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:38.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.415049+0000","last_change":"2024-04-18T10:38:46.523038+0000","last_active":"2024-04-18T10:43:51.415049+0000","last_peered":"2024-04-18T10:43:51.415049+0000","last_clean":"2024-04-18T10:43:51.415049+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:43:51.415049+0000","last_undegraded":"2024-04-18T10:43:51.415049+0000","last_fullsized":"2024-04-18T10:43:51.415049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:47.558311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":479,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445927+0000","last_change":"2024-04-18T10:39:29.508295+0000","last_active":"2024-04-18T10:43:51.445927+0000","last_peered":"2024-04-18T10:43:51.445927+0000","last_clean":"2024-04-18T10:43:51.445927+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:43:51.445927+0000","last_undegraded":"2024-04-18T10:43:51.445927+0000","last_fullsized":"2024-04-18T10:43:51.445927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:26:27.135112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":504,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.420651+0000","last_change":"2024-04-18T10:38:48.527369+0000","last_active":"2024-04-18T10:43:51.420651+0000","last_peered":"2024-04-18T10:43:51.420651+0000","last_clean":"2024-04-18T10:43:51.420651+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:43:51.420651+0000","last_undegraded":"2024-04-18T10:43:51.420651+0000","last_fullsized":"2024-04-18T10:43:51.420651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:05:08.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":469,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443622+0000","last_change":"2024-04-18T10:38:47.514997+0000","last_active":"2024-04-18T10:43:51.443622+0000","last_peered":"2024-04-18T10:43:51.443622+0000","last_clean":"2024-04-18T10:43:51.443622+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:43:51.443622+0000","last_undegraded":"2024-04-18T10:43:51.443622+0000","last_fullsized":"2024-04-18T10:43:51.443622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:28.335154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":526,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.430226+0000","last_change":"2024-04-18T10:38:48.518698+0000","last_active":"2024-04-18T10:43:51.430226+0000","last_peered":"2024-04-18T10:43:51.430226+0000","last_clean":"2024-04-18T10:43:51.430226+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:43:51.430226+0000","last_undegraded":"2024-04-18T10:43:51.430226+0000","last_fullsized":"2024-04-18T10:43:51.430226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:42.362882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":547,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452383+0000","last_change":"2024-04-18T10:38:48.535465+0000","last_active":"2024-04-18T10:43:51.452383+0000","last_peered":"2024-04-18T10:43:51.452383+0000","last_clean":"2024-04-18T10:43:51.452383+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:43:51.452383+0000","last_undegraded":"2024-04-18T10:43:51.452383+0000","last_fullsized":"2024-04-18T10:43:51.452383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:15:57.026266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":502,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452655+0000","last_change":"2024-04-18T10:38:48.536144+0000","last_active":"2024-04-18T10:43:51.452655+0000","last_peered":"2024-04-18T10:43:51.452655+0000","last_clean":"2024-04-18T10:43:51.452655+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:43:51.452655+0000","last_undegraded":"2024-04-18T10:43:51.452655+0000","last_fullsized":"2024-04-18T10:43:51.452655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:30:36.746569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":559,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.422268+0000","last_change":"2024-04-18T10:38:46.523917+0000","last_active":"2024-04-18T10:43:51.422268+0000","last_peered":"2024-04-18T10:43:51.422268+0000","last_clean":"2024-04-18T10:43:51.422268+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:43:51.422268+0000","last_undegraded":"2024-04-18T10:43:51.422268+0000","last_fullsized":"2024-04-18T10:43:51.422268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:50:08.234356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":485,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434563+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:43:51.434563+0000","last_peered":"2024-04-18T10:43:51.434563+0000","last_clean":"2024-04-18T10:43:51.434563+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:43:51.434563+0000","last_undegraded":"2024-04-18T10:43:51.434563+0000","last_fullsized":"2024-04-18T10:43:51.434563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:36:26.788947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":550,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452073+0000","last_change":"2024-04-18T10:38:48.532902+0000","last_active":"2024-04-18T10:43:51.452073+0000","last_peered":"2024-04-18T10:43:51.452073+0000","last_clean":"2024-04-18T10:43:51.452073+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:43:51.452073+0000","last_undegraded":"2024-04-18T10:43:51.452073+0000","last_fullsized":"2024-04-18T10:43:51.452073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:21:05.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":448,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438072+0000","last_change":"2024-04-18T10:39:29.641096+0000","last_active":"2024-04-18T10:43:51.438072+0000","last_peered":"2024-04-18T10:43:51.438072+0000","last_clean":"2024-04-18T10:43:51.438072+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:43:51.438072+0000","last_undegraded":"2024-04-18T10:43:51.438072+0000","last_fullsized":"2024-04-18T10:43:51.438072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:00:39.979232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":613,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448152+0000","last_change":"2024-04-18T10:38:47.515633+0000","last_active":"2024-04-18T10:43:51.448152+0000","last_peered":"2024-04-18T10:43:51.448152+0000","last_clean":"2024-04-18T10:43:51.448152+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:43:51.448152+0000","last_undegraded":"2024-04-18T10:43:51.448152+0000","last_fullsized":"2024-04-18T10:43:51.448152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:29:53.701977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438461+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:43:51.438461+0000","last_peered":"2024-04-18T10:43:51.438461+0000","last_clean":"2024-04-18T10:43:51.438461+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:43:51.438461+0000","last_undegraded":"2024-04-18T10:43:51.438461+0000","last_fullsized":"2024-04-18T10:43:51.438461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:17.044947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'598","reported_seq":632,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.436856+0000","last_change":"2024-04-18T10:38:47.515748+0000","last_active":"2024-04-18T10:43:48.436856+0000","last_peered":"2024-04-18T10:43:48.436856+0000","last_clean":"2024-04-18T10:43:48.436856+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:43:48.436856+0000","last_undegraded":"2024-04-18T10:43:48.436856+0000","last_fullsized":"2024-04-18T10:43:48.436856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:10:22.348842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":473,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453851+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:43:51.453851+0000","last_peered":"2024-04-18T10:43:51.453851+0000","last_clean":"2024-04-18T10:43:51.453851+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:43:51.453851+0000","last_undegraded":"2024-04-18T10:43:51.453851+0000","last_fullsized":"2024-04-18T10:43:51.453851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:21:57.410343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'444","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.399120+0000","last_change":"2024-04-18T10:38:48.531482+0000","last_active":"2024-04-18T10:43:47.399120+0000","last_peered":"2024-04-18T10:43:47.399120+0000","last_clean":"2024-04-18T10:43:47.399120+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:43:47.399120+0000","last_undegraded":"2024-04-18T10:43:47.399120+0000","last_fullsized":"2024-04-18T10:43:47.399120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:13:25.170588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":513,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434732+0000","last_change":"2024-04-18T10:38:46.523785+0000","last_active":"2024-04-18T10:43:51.434732+0000","last_peered":"2024-04-18T10:43:51.434732+0000","last_clean":"2024-04-18T10:43:51.434732+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:43:51.434732+0000","last_undegraded":"2024-04-18T10:43:51.434732+0000","last_fullsized":"2024-04-18T10:43:51.434732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:07:03.397909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'997","reported_seq":1041,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.375424+0000","last_change":"2024-04-18T10:38:48.528981+0000","last_active":"2024-04-18T10:43:49.375424+0000","last_peered":"2024-04-18T10:43:49.375424+0000","last_clean":"2024-04-18T10:43:49.375424+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:43:49.375424+0000","last_undegraded":"2024-04-18T10:43:49.375424+0000","last_fullsized":"2024-04-18T10:43:49.375424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:20:44.914726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":424,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446824+0000","last_change":"2024-04-18T10:39:29.505858+0000","last_active":"2024-04-18T10:43:51.446824+0000","last_peered":"2024-04-18T10:43:51.446824+0000","last_clean":"2024-04-18T10:43:51.446824+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:43:51.446824+0000","last_undegraded":"2024-04-18T10:43:51.446824+0000","last_fullsized":"2024-04-18T10:43:51.446824+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:40:31.972849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'63","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.417600+0000","last_change":"2024-04-18T10:38:48.521507+0000","last_active":"2024-04-18T10:43:45.417600+0000","last_peered":"2024-04-18T10:43:45.417600+0000","last_clean":"2024-04-18T10:43:45.417600+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:43:45.417600+0000","last_undegraded":"2024-04-18T10:43:45.417600+0000","last_fullsized":"2024-04-18T10:43:45.417600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:26:29.367671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449413+0000","last_change":"2024-04-18T10:38:48.528936+0000","last_active":"2024-04-18T10:43:51.449413+0000","last_peered":"2024-04-18T10:43:51.449413+0000","last_clean":"2024-04-18T10:43:51.449413+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:43:51.449413+0000","last_undegraded":"2024-04-18T10:43:51.449413+0000","last_fullsized":"2024-04-18T10:43:51.449413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:03:47.761656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'328","reported_seq":362,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.366130+0000","last_change":"2024-04-18T10:38:48.528847+0000","last_active":"2024-04-18T10:43:47.366130+0000","last_peered":"2024-04-18T10:43:47.366130+0000","last_clean":"2024-04-18T10:43:47.366130+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:43:47.366130+0000","last_undegraded":"2024-04-18T10:43:47.366130+0000","last_fullsized":"2024-04-18T10:43:47.366130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:52:18.159291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":630,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431598+0000","last_change":"2024-04-18T10:38:48.525442+0000","last_active":"2024-04-18T10:43:51.431598+0000","last_peered":"2024-04-18T10:43:51.431598+0000","last_clean":"2024-04-18T10:43:51.431598+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:43:51.431598+0000","last_undegraded":"2024-04-18T10:43:51.431598+0000","last_fullsized":"2024-04-18T10:43:51.431598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:01.154765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'120","reported_seq":160,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.495293+0000","last_change":"2024-04-18T10:38:48.529744+0000","last_active":"2024-04-18T10:43:48.495293+0000","last_peered":"2024-04-18T10:43:48.495293+0000","last_clean":"2024-04-18T10:43:48.495293+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:43:48.495293+0000","last_undegraded":"2024-04-18T10:43:48.495293+0000","last_fullsized":"2024-04-18T10:43:48.495293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:07.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":524,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451542+0000","last_change":"2024-04-18T10:38:48.530788+0000","last_active":"2024-04-18T10:43:51.451542+0000","last_peered":"2024-04-18T10:43:51.451542+0000","last_clean":"2024-04-18T10:43:51.451542+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:43:51.451542+0000","last_undegraded":"2024-04-18T10:43:51.451542+0000","last_fullsized":"2024-04-18T10:43:51.451542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:34.881473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'365","reported_seq":407,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.348545+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:43:51.348545+0000","last_peered":"2024-04-18T10:43:51.348545+0000","last_clean":"2024-04-18T10:43:51.348545+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:43:51.348545+0000","last_undegraded":"2024-04-18T10:43:51.348545+0000","last_fullsized":"2024-04-18T10:43:51.348545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:46.735369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453855+0000","last_change":"2024-04-18T10:38:48.528009+0000","last_active":"2024-04-18T10:43:51.453855+0000","last_peered":"2024-04-18T10:43:51.453855+0000","last_clean":"2024-04-18T10:43:51.453855+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:43:51.453855+0000","last_undegraded":"2024-04-18T10:43:51.453855+0000","last_fullsized":"2024-04-18T10:43:51.453855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:02.092332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'454","reported_seq":500,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.430066+0000","last_change":"2024-04-18T10:38:48.523218+0000","last_active":"2024-04-18T10:43:45.430066+0000","last_peered":"2024-04-18T10:43:45.430066+0000","last_clean":"2024-04-18T10:43:45.430066+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:43:45.430066+0000","last_undegraded":"2024-04-18T10:43:45.430066+0000","last_fullsized":"2024-04-18T10:43:45.430066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:15:59.389767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":430,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450572+0000","last_change":"2024-04-18T10:38:48.524990+0000","last_active":"2024-04-18T10:43:51.450572+0000","last_peered":"2024-04-18T10:43:51.450572+0000","last_clean":"2024-04-18T10:43:51.450572+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:43:51.450572+0000","last_undegraded":"2024-04-18T10:43:51.450572+0000","last_fullsized":"2024-04-18T10:43:51.450572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:13:40.543145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'52","reported_seq":88,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.445416+0000","last_change":"2024-04-18T10:38:48.530631+0000","last_active":"2024-04-18T10:43:46.445416+0000","last_peered":"2024-04-18T10:43:46.445416+0000","last_clean":"2024-04-18T10:43:46.445416+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:43:46.445416+0000","last_undegraded":"2024-04-18T10:43:46.445416+0000","last_fullsized":"2024-04-18T10:43:46.445416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:09:37.349194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":485,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438348+0000","last_change":"2024-04-18T10:38:48.526748+0000","last_active":"2024-04-18T10:43:51.438348+0000","last_peered":"2024-04-18T10:43:51.438348+0000","last_clean":"2024-04-18T10:43:51.438348+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:43:51.438348+0000","last_undegraded":"2024-04-18T10:43:51.438348+0000","last_fullsized":"2024-04-18T10:43:51.438348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:11.074933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":103,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.428382+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:43:45.428382+0000","last_peered":"2024-04-18T10:43:45.428382+0000","last_clean":"2024-04-18T10:43:45.428382+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:43:45.428382+0000","last_undegraded":"2024-04-18T10:43:45.428382+0000","last_fullsized":"2024-04-18T10:43:45.428382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:39:56.234231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445540+0000","last_change":"2024-04-18T10:38:48.522750+0000","last_active":"2024-04-18T10:43:51.445540+0000","last_peered":"2024-04-18T10:43:51.445540+0000","last_clean":"2024-04-18T10:43:51.445540+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:43:51.445540+0000","last_undegraded":"2024-04-18T10:43:51.445540+0000","last_fullsized":"2024-04-18T10:43:51.445540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:51.519415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'70","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367076+0000","last_change":"2024-04-18T10:38:46.524444+0000","last_active":"2024-04-18T10:43:47.367076+0000","last_peered":"2024-04-18T10:43:47.367076+0000","last_clean":"2024-04-18T10:43:47.367076+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:43:47.367076+0000","last_undegraded":"2024-04-18T10:43:47.367076+0000","last_fullsized":"2024-04-18T10:43:47.367076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:29:31.257203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448235+0000","last_change":"2024-04-18T10:38:48.524076+0000","last_active":"2024-04-18T10:43:51.448235+0000","last_peered":"2024-04-18T10:43:51.448235+0000","last_clean":"2024-04-18T10:43:51.448235+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:43:51.448235+0000","last_undegraded":"2024-04-18T10:43:51.448235+0000","last_fullsized":"2024-04-18T10:43:51.448235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:58.250235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'251","reported_seq":286,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.411625+0000","last_change":"2024-04-18T10:38:46.523417+0000","last_active":"2024-04-18T10:43:48.411625+0000","last_peered":"2024-04-18T10:43:48.411625+0000","last_clean":"2024-04-18T10:43:48.411625+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:43:48.411625+0000","last_undegraded":"2024-04-18T10:43:48.411625+0000","last_fullsized":"2024-04-18T10:43:48.411625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:02:29.079358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":476,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450051+0000","last_change":"2024-04-18T10:38:48.528752+0000","last_active":"2024-04-18T10:43:51.450051+0000","last_peered":"2024-04-18T10:43:51.450051+0000","last_clean":"2024-04-18T10:43:51.450051+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:43:51.450051+0000","last_undegraded":"2024-04-18T10:43:51.450051+0000","last_fullsized":"2024-04-18T10:43:51.450051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:31:20.382051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'340","reported_seq":383,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.428802+0000","last_change":"2024-04-18T10:38:47.516780+0000","last_active":"2024-04-18T10:43:45.428802+0000","last_peered":"2024-04-18T10:43:45.428802+0000","last_clean":"2024-04-18T10:43:45.428802+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:43:45.428802+0000","last_undegraded":"2024-04-18T10:43:45.428802+0000","last_fullsized":"2024-04-18T10:43:45.428802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:26.639180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":505,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450036+0000","last_change":"2024-04-18T10:38:48.537651+0000","last_active":"2024-04-18T10:43:51.450036+0000","last_peered":"2024-04-18T10:43:51.450036+0000","last_clean":"2024-04-18T10:43:51.450036+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:43:51.450036+0000","last_undegraded":"2024-04-18T10:43:51.450036+0000","last_fullsized":"2024-04-18T10:43:51.450036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:18.675030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'565","reported_seq":606,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.410751+0000","last_change":"2024-04-18T10:38:48.528245+0000","last_active":"2024-04-18T10:43:47.410751+0000","last_peered":"2024-04-18T10:43:47.410751+0000","last_clean":"2024-04-18T10:43:47.410751+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:43:47.410751+0000","last_undegraded":"2024-04-18T10:43:47.410751+0000","last_fullsized":"2024-04-18T10:43:47.410751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:52.532246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452030+0000","last_change":"2024-04-18T10:38:48.528767+0000","last_active":"2024-04-18T10:43:51.452030+0000","last_peered":"2024-04-18T10:43:51.452030+0000","last_clean":"2024-04-18T10:43:51.452030+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:43:51.452030+0000","last_undegraded":"2024-04-18T10:43:51.452030+0000","last_fullsized":"2024-04-18T10:43:51.452030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:31:30.566152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":96,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.379623+0000","last_change":"2024-04-18T10:38:48.527940+0000","last_active":"2024-04-18T10:43:47.379623+0000","last_peered":"2024-04-18T10:43:47.379623+0000","last_clean":"2024-04-18T10:43:47.379623+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:43:47.379623+0000","last_undegraded":"2024-04-18T10:43:47.379623+0000","last_fullsized":"2024-04-18T10:43:47.379623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:28.013331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":546,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.406957+0000","last_change":"2024-04-18T10:38:46.522705+0000","last_active":"2024-04-18T10:43:51.406957+0000","last_peered":"2024-04-18T10:43:51.406957+0000","last_clean":"2024-04-18T10:43:51.406957+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:43:51.406957+0000","last_undegraded":"2024-04-18T10:43:51.406957+0000","last_fullsized":"2024-04-18T10:43:51.406957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:23:44.645859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'170","reported_seq":215,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367215+0000","last_change":"2024-04-18T10:38:48.523093+0000","last_active":"2024-04-18T10:43:47.367215+0000","last_peered":"2024-04-18T10:43:47.367215+0000","last_clean":"2024-04-18T10:43:47.367215+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:43:47.367215+0000","last_undegraded":"2024-04-18T10:43:47.367215+0000","last_fullsized":"2024-04-18T10:43:47.367215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:20.206383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.422305+0000","last_change":"2024-04-18T10:38:48.528094+0000","last_active":"2024-04-18T10:43:51.422305+0000","last_peered":"2024-04-18T10:43:51.422305+0000","last_clean":"2024-04-18T10:43:51.422305+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:43:51.422305+0000","last_undegraded":"2024-04-18T10:43:51.422305+0000","last_fullsized":"2024-04-18T10:43:51.422305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:02.429215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'249","reported_seq":289,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.386774+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:43:47.386774+0000","last_peered":"2024-04-18T10:43:47.386774+0000","last_clean":"2024-04-18T10:43:47.386774+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:43:47.386774+0000","last_undegraded":"2024-04-18T10:43:47.386774+0000","last_fullsized":"2024-04-18T10:43:47.386774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:47:34.182153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453830+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:43:51.453830+0000","last_peered":"2024-04-18T10:43:51.453830+0000","last_clean":"2024-04-18T10:43:51.453830+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:43:51.453830+0000","last_undegraded":"2024-04-18T10:43:51.453830+0000","last_fullsized":"2024-04-18T10:43:51.453830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:08.173779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'62","reported_seq":99,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.389733+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:43:47.389733+0000","last_peered":"2024-04-18T10:43:47.389733+0000","last_clean":"2024-04-18T10:43:47.389733+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:43:47.389733+0000","last_undegraded":"2024-04-18T10:43:47.389733+0000","last_fullsized":"2024-04-18T10:43:47.389733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:04.645176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451809+0000","last_change":"2024-04-18T10:38:48.528656+0000","last_active":"2024-04-18T10:43:51.451809+0000","last_peered":"2024-04-18T10:43:51.451809+0000","last_clean":"2024-04-18T10:43:51.451809+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:43:51.451809+0000","last_undegraded":"2024-04-18T10:43:51.451809+0000","last_fullsized":"2024-04-18T10:43:51.451809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:53.065322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'492","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.368795+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:43:47.368795+0000","last_peered":"2024-04-18T10:43:47.368795+0000","last_clean":"2024-04-18T10:43:47.368795+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:43:47.368795+0000","last_undegraded":"2024-04-18T10:43:47.368795+0000","last_fullsized":"2024-04-18T10:43:47.368795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:06:10.188847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452204+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:43:51.452204+0000","last_peered":"2024-04-18T10:43:51.452204+0000","last_clean":"2024-04-18T10:43:51.452204+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:43:51.452204+0000","last_undegraded":"2024-04-18T10:43:51.452204+0000","last_fullsized":"2024-04-18T10:43:51.452204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:39:47.463040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.502609+0000","last_change":"2024-04-18T10:38:46.521667+0000","last_active":"2024-04-18T10:39:29.502609+0000","last_peered":"2024-04-18T10:39:29.502609+0000","last_clean":"2024-04-18T10:39:29.502609+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:39:29.502609+0000","last_undegraded":"2024-04-18T10:39:29.502609+0000","last_fullsized":"2024-04-18T10:39:29.502609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:58:33.365320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'347","reported_seq":382,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.458459+0000","last_change":"2024-04-18T10:38:48.518724+0000","last_active":"2024-04-18T10:43:48.458459+0000","last_peered":"2024-04-18T10:43:48.458459+0000","last_clean":"2024-04-18T10:43:48.458459+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:43:48.458459+0000","last_undegraded":"2024-04-18T10:43:48.458459+0000","last_fullsized":"2024-04-18T10:43:48.458459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:42.824622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":400,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451458+0000","last_change":"2024-04-18T10:38:48.529610+0000","last_active":"2024-04-18T10:43:51.451458+0000","last_peered":"2024-04-18T10:43:51.451458+0000","last_clean":"2024-04-18T10:43:51.451458+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:43:51.451458+0000","last_undegraded":"2024-04-18T10:43:51.451458+0000","last_fullsized":"2024-04-18T10:43:51.451458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:22:33.897416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639298+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:39:29.639298+0000","last_peered":"2024-04-18T10:39:29.639298+0000","last_clean":"2024-04-18T10:39:29.639298+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:39:29.639298+0000","last_undegraded":"2024-04-18T10:39:29.639298+0000","last_fullsized":"2024-04-18T10:39:29.639298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:33.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'70","reported_seq":109,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.443753+0000","last_change":"2024-04-18T10:38:47.513344+0000","last_active":"2024-04-18T10:43:48.443753+0000","last_peered":"2024-04-18T10:43:48.443753+0000","last_clean":"2024-04-18T10:43:48.443753+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:43:48.443753+0000","last_undegraded":"2024-04-18T10:43:48.443753+0000","last_fullsized":"2024-04-18T10:43:48.443753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:48.441734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":470,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445285+0000","last_change":"2024-04-18T10:38:47.515107+0000","last_active":"2024-04-18T10:43:51.445285+0000","last_peered":"2024-04-18T10:43:51.445285+0000","last_clean":"2024-04-18T10:43:51.445285+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:43:51.445285+0000","last_undegraded":"2024-04-18T10:43:51.445285+0000","last_fullsized":"2024-04-18T10:43:51.445285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:10:14.119655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.499561+0000","last_change":"2024-04-18T10:38:48.520896+0000","last_active":"2024-04-18T10:39:29.499561+0000","last_peered":"2024-04-18T10:39:29.499561+0000","last_clean":"2024-04-18T10:39:29.499561+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:39:29.499561+0000","last_undegraded":"2024-04-18T10:39:29.499561+0000","last_fullsized":"2024-04-18T10:39:29.499561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:57:03.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'433","reported_seq":468,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.414756+0000","last_change":"2024-04-18T10:38:47.519693+0000","last_active":"2024-04-18T10:43:46.414756+0000","last_peered":"2024-04-18T10:43:46.414756+0000","last_clean":"2024-04-18T10:43:46.414756+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:43:46.414756+0000","last_undegraded":"2024-04-18T10:43:46.414756+0000","last_fullsized":"2024-04-18T10:43:46.414756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:34.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":414,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443347+0000","last_change":"2024-04-18T10:38:46.520198+0000","last_active":"2024-04-18T10:43:51.443347+0000","last_peered":"2024-04-18T10:43:51.443347+0000","last_clean":"2024-04-18T10:43:51.443347+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:43:51.443347+0000","last_undegraded":"2024-04-18T10:43:51.443347+0000","last_fullsized":"2024-04-18T10:43:51.443347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:18:11.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639632+0000","last_change":"2024-04-18T10:38:48.522906+0000","last_active":"2024-04-18T10:39:29.639632+0000","last_peered":"2024-04-18T10:39:29.639632+0000","last_clean":"2024-04-18T10:39:29.639632+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:39:29.639632+0000","last_undegraded":"2024-04-18T10:39:29.639632+0000","last_fullsized":"2024-04-18T10:39:29.639632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:14.552416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'115","reported_seq":194,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.501781+0000","last_change":"2024-04-18T10:38:46.507608+0000","last_active":"2024-04-18T10:39:29.501781+0000","last_peered":"2024-04-18T10:39:29.501781+0000","last_clean":"2024-04-18T10:39:29.501781+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:39:29.501781+0000","last_undegraded":"2024-04-18T10:39:29.501781+0000","last_fullsized":"2024-04-18T10:39:29.501781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:46:55.362151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'526","reported_seq":563,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.404828+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:43:45.404828+0000","last_peered":"2024-04-18T10:43:45.404828+0000","last_clean":"2024-04-18T10:43:45.404828+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:43:45.404828+0000","last_undegraded":"2024-04-18T10:43:45.404828+0000","last_fullsized":"2024-04-18T10:43:45.404828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:23.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":541,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453345+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:43:51.453345+0000","last_peered":"2024-04-18T10:43:51.453345+0000","last_clean":"2024-04-18T10:43:51.453345+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:43:51.453345+0000","last_undegraded":"2024-04-18T10:43:51.453345+0000","last_fullsized":"2024-04-18T10:43:51.453345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:03.109484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639111+0000","last_change":"2024-04-18T10:38:48.529162+0000","last_active":"2024-04-18T10:39:29.639111+0000","last_peered":"2024-04-18T10:39:29.639111+0000","last_clean":"2024-04-18T10:39:29.639111+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:39:29.639111+0000","last_undegraded":"2024-04-18T10:39:29.639111+0000","last_fullsized":"2024-04-18T10:39:29.639111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:18:10.267046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'262","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.366459+0000","last_change":"2024-04-18T10:38:47.513300+0000","last_active":"2024-04-18T10:43:49.366459+0000","last_peered":"2024-04-18T10:43:49.366459+0000","last_clean":"2024-04-18T10:43:49.366459+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:43:49.366459+0000","last_undegraded":"2024-04-18T10:43:49.366459+0000","last_fullsized":"2024-04-18T10:43:49.366459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:38:14.658997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":523,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445123+0000","last_change":"2024-04-18T10:38:46.523777+0000","last_active":"2024-04-18T10:43:51.445123+0000","last_peered":"2024-04-18T10:43:51.445123+0000","last_clean":"2024-04-18T10:43:51.445123+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:43:51.445123+0000","last_undegraded":"2024-04-18T10:43:51.445123+0000","last_fullsized":"2024-04-18T10:43:51.445123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:03:13.518817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.640426+0000","last_change":"2024-04-18T10:38:48.526577+0000","last_active":"2024-04-18T10:39:29.640426+0000","last_peered":"2024-04-18T10:39:29.640426+0000","last_clean":"2024-04-18T10:39:29.640426+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:39:29.640426+0000","last_undegraded":"2024-04-18T10:39:29.640426+0000","last_fullsized":"2024-04-18T10:39:29.640426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:34:26.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":90,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.453422+0000","last_change":"2024-04-18T10:38:47.515422+0000","last_active":"2024-04-18T10:43:48.453422+0000","last_peered":"2024-04-18T10:43:48.453422+0000","last_clean":"2024-04-18T10:43:48.453422+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:43:48.453422+0000","last_undegraded":"2024-04-18T10:43:48.453422+0000","last_fullsized":"2024-04-18T10:43:48.453422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.811949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446175+0000","last_change":"2024-04-18T10:38:47.513292+0000","last_active":"2024-04-18T10:43:51.446175+0000","last_peered":"2024-04-18T10:43:51.446175+0000","last_clean":"2024-04-18T10:43:51.446175+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:43:51.446175+0000","last_undegraded":"2024-04-18T10:43:51.446175+0000","last_fullsized":"2024-04-18T10:43:51.446175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:35.308701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'62","reported_seq":103,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.431314+0000","last_change":"2024-04-18T10:38:48.525344+0000","last_active":"2024-04-18T10:43:48.431314+0000","last_peered":"2024-04-18T10:43:48.431314+0000","last_clean":"2024-04-18T10:43:48.431314+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:43:48.431314+0000","last_undegraded":"2024-04-18T10:43:48.431314+0000","last_fullsized":"2024-04-18T10:43:48.431314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:13:06.871047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.503660+0000","last_change":"2024-04-18T10:38:46.521665+0000","last_active":"2024-04-18T10:39:29.503660+0000","last_peered":"2024-04-18T10:39:29.503660+0000","last_clean":"2024-04-18T10:39:29.503660+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:39:29.503660+0000","last_undegraded":"2024-04-18T10:39:29.503660+0000","last_fullsized":"2024-04-18T10:39:29.503660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:14:41.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450142+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:43:51.450142+0000","last_peered":"2024-04-18T10:43:51.450142+0000","last_clean":"2024-04-18T10:43:51.450142+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:43:51.450142+0000","last_undegraded":"2024-04-18T10:43:51.450142+0000","last_fullsized":"2024-04-18T10:43:51.450142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:16.195736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.640642+0000","last_change":"2024-04-18T10:38:48.519133+0000","last_active":"2024-04-18T10:39:29.640642+0000","last_peered":"2024-04-18T10:39:29.640642+0000","last_clean":"2024-04-18T10:39:29.640642+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:39:29.640642+0000","last_undegraded":"2024-04-18T10:39:29.640642+0000","last_fullsized":"2024-04-18T10:39:29.640642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:47.684869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":120,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.430266+0000","last_change":"2024-04-18T10:38:46.523957+0000","last_active":"2024-04-18T10:43:48.430266+0000","last_peered":"2024-04-18T10:43:48.430266+0000","last_clean":"2024-04-18T10:43:48.430266+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:43:48.430266+0000","last_undegraded":"2024-04-18T10:43:48.430266+0000","last_fullsized":"2024-04-18T10:43:48.430266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:49.311603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":446,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451210+0000","last_change":"2024-04-18T10:38:48.520854+0000","last_active":"2024-04-18T10:43:51.451210+0000","last_peered":"2024-04-18T10:43:51.451210+0000","last_clean":"2024-04-18T10:43:51.451210+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:43:51.451210+0000","last_undegraded":"2024-04-18T10:43:51.451210+0000","last_fullsized":"2024-04-18T10:43:51.451210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:27.953816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'72","reported_seq":111,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.455510+0000","last_change":"2024-04-18T10:38:48.527898+0000","last_active":"2024-04-18T10:43:45.455510+0000","last_peered":"2024-04-18T10:43:45.455510+0000","last_clean":"2024-04-18T10:43:45.455510+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:43:45.455510+0000","last_undegraded":"2024-04-18T10:43:45.455510+0000","last_fullsized":"2024-04-18T10:43:45.455510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:35:58.649968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":441,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447405+0000","last_change":"2024-04-18T10:38:47.514434+0000","last_active":"2024-04-18T10:43:51.447405+0000","last_peered":"2024-04-18T10:43:51.447405+0000","last_clean":"2024-04-18T10:43:51.447405+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:43:51.447405+0000","last_undegraded":"2024-04-18T10:43:51.447405+0000","last_fullsized":"2024-04-18T10:43:51.447405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:22:40.288392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'343","reported_seq":383,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367534+0000","last_change":"2024-04-18T10:38:46.520352+0000","last_active":"2024-04-18T10:43:47.367534+0000","last_peered":"2024-04-18T10:43:47.367534+0000","last_clean":"2024-04-18T10:43:47.367534+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:43:47.367534+0000","last_undegraded":"2024-04-18T10:43:47.367534+0000","last_fullsized":"2024-04-18T10:43:47.367534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:55:53.724349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":409,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452635+0000","last_change":"2024-04-18T10:38:48.528181+0000","last_active":"2024-04-18T10:43:51.452635+0000","last_peered":"2024-04-18T10:43:51.452635+0000","last_clean":"2024-04-18T10:43:51.452635+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:43:51.452635+0000","last_undegraded":"2024-04-18T10:43:51.452635+0000","last_fullsized":"2024-04-18T10:43:51.452635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:38.920913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'287","reported_seq":332,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.414294+0000","last_change":"2024-04-18T10:38:48.526382+0000","last_active":"2024-04-18T10:43:47.414294+0000","last_peered":"2024-04-18T10:43:47.414294+0000","last_clean":"2024-04-18T10:43:47.414294+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:43:47.414294+0000","last_undegraded":"2024-04-18T10:43:47.414294+0000","last_fullsized":"2024-04-18T10:43:47.414294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:36:19.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":466,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445781+0000","last_change":"2024-04-18T10:39:29.508423+0000","last_active":"2024-04-18T10:43:51.445781+0000","last_peered":"2024-04-18T10:43:51.445781+0000","last_clean":"2024-04-18T10:43:51.445781+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:43:51.445781+0000","last_undegraded":"2024-04-18T10:43:51.445781+0000","last_fullsized":"2024-04-18T10:43:51.445781+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:19.178512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'110","reported_seq":147,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.412029+0000","last_change":"2024-04-18T10:38:48.521841+0000","last_active":"2024-04-18T10:43:48.412029+0000","last_peered":"2024-04-18T10:43:48.412029+0000","last_clean":"2024-04-18T10:43:48.412029+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:43:48.412029+0000","last_undegraded":"2024-04-18T10:43:48.412029+0000","last_fullsized":"2024-04-18T10:43:48.412029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:44:53.826636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":515,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449133+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:43:51.449133+0000","last_peered":"2024-04-18T10:43:51.449133+0000","last_clean":"2024-04-18T10:43:51.449133+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:43:51.449133+0000","last_undegraded":"2024-04-18T10:43:51.449133+0000","last_fullsized":"2024-04-18T10:43:51.449133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:44.601528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'99","reported_seq":132,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.354807+0000","last_change":"2024-04-18T10:38:46.523460+0000","last_active":"2024-04-18T10:43:47.354807+0000","last_peered":"2024-04-18T10:43:47.354807+0000","last_clean":"2024-04-18T10:43:47.354807+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:43:47.354807+0000","last_undegraded":"2024-04-18T10:43:47.354807+0000","last_fullsized":"2024-04-18T10:43:47.354807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:33.163273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":509,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448265+0000","last_change":"2024-04-18T10:38:47.514386+0000","last_active":"2024-04-18T10:43:51.448265+0000","last_peered":"2024-04-18T10:43:51.448265+0000","last_clean":"2024-04-18T10:43:51.448265+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:43:51.448265+0000","last_undegraded":"2024-04-18T10:43:51.448265+0000","last_fullsized":"2024-04-18T10:43:51.448265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:25.189215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":499,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446535+0000","last_change":"2024-04-18T10:38:47.515056+0000","last_active":"2024-04-18T10:43:51.446535+0000","last_peered":"2024-04-18T10:43:51.446535+0000","last_clean":"2024-04-18T10:43:51.446535+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:43:51.446535+0000","last_undegraded":"2024-04-18T10:43:51.446535+0000","last_fullsized":"2024-04-18T10:43:51.446535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:09:39.192070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":438,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447899+0000","last_change":"2024-04-18T10:39:29.506707+0000","last_active":"2024-04-18T10:43:51.447899+0000","last_peered":"2024-04-18T10:43:51.447899+0000","last_clean":"2024-04-18T10:43:51.447899+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:43:51.447899+0000","last_undegraded":"2024-04-18T10:43:51.447899+0000","last_fullsized":"2024-04-18T10:43:51.447899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:15:49.305625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":564,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.420162+0000","last_change":"2024-04-18T10:38:48.530823+0000","last_active":"2024-04-18T10:43:51.420162+0000","last_peered":"2024-04-18T10:43:51.420162+0000","last_clean":"2024-04-18T10:43:51.420162+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:43:51.420162+0000","last_undegraded":"2024-04-18T10:43:51.420162+0000","last_fullsized":"2024-04-18T10:43:51.420162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:17.039853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450748+0000","last_change":"2024-04-18T10:38:48.528090+0000","last_active":"2024-04-18T10:43:51.450748+0000","last_peered":"2024-04-18T10:43:51.450748+0000","last_clean":"2024-04-18T10:43:51.450748+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:43:51.450748+0000","last_undegraded":"2024-04-18T10:43:51.450748+0000","last_fullsized":"2024-04-18T10:43:51.450748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:18:27.052176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445610+0000","last_change":"2024-04-18T10:38:47.515405+0000","last_active":"2024-04-18T10:43:51.445610+0000","last_peered":"2024-04-18T10:43:51.445610+0000","last_clean":"2024-04-18T10:43:51.445610+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:43:51.445610+0000","last_undegraded":"2024-04-18T10:43:51.445610+0000","last_fullsized":"2024-04-18T10:43:51.445610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:31.550014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8497,"ondisk_log_size":8497,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953536,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.38,"15min":0.378},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.36599999999999999,"15min":0.38300000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Apr 18 10:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.41799999999999998,"15min":0.42199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.373,"15min":0.38700000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.51600000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.307}]},{"osd":2,"last update":"Thu Apr 18 10:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41899999999999998,"15min":0.437},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":4.181,"5min":4.181,"15min":4.181},"last":0.39000000000000001}]}]},{"osd":2,"up_from":31,"seq":133143986240,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:42:53 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Apr 18 10:42:53 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.372,"15min":0.38700000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52200000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Apr 18 10:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.39300000000000002,"15min":0.41099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.42999999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41899999999999998,"15min":0.42999999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40699999999999997}]}]},{"osd":0,"up_from":29,"seq":124554051649,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34999999999999998,"15min":0.33600000000000002},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.22},{"interface":"front","average":{"1min":0.314,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.216,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.628,"5min":1.224,"15min":1.224},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38400000000000001,"15min":0.35799999999999998},"min":{"1min":0.20599999999999999,"5min":0.19,"15min":0.19},"max":{"1min":1.514,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.254},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.22500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.59499999999999997,"5min":1.173,"15min":1.173},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.38300000000000001,"15min":0.41799999999999998},"min":{"1min":0.23200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.73599999999999999,"5min":1.204,"15min":1.204},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.51500000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.314}]}]},{"osd":1,"up_from":30,"seq":128849018945,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.34899999999999998},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.33900000000000002,"15min":0.35899999999999999},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.325,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.255}]},{"osd":3,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.98599999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.9970000000000001,"5min":2.173,"15min":2.173},"last":0.31900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:44:00.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:44:01.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.038+0000 7fd1ef5e0700 1 Processor -- start 2024-04-18T10:44:01.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1ef5e0700 1 -- start start 2024-04-18T10:44:01.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1ef5e0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e8068340 0x7fd1e80a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1ef5e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b0560 0x7fd1e813fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1ef5e0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e80a73b0 con 0x7fd1e8140360 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1ef5e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80a55e0 con 0x7fd1e80b0560 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1ef5e0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80a7130 con 0x7fd1e8068340 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1ecb7b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b0560 0x7fd1e813fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1edb7d700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd1e8140360 0x7fd1e806ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40414/0 (socket says 172.21.15.31:40414) 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1ed37c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e8068340 0x7fd1e80a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1edb7d700 1 -- 172.21.15.31:0/2511638153 learned_addr learned my addr 172.21.15.31:0/2511638153 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.039+0000 7fd1dbfff700 1 -- 172.21.15.31:0/2511638153 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422942151 0 0) 0x7fd1e80a73b0 con 0x7fd1e8140360 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ecb7b700 1 -- 172.21.15.31:0/2511638153 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e8068340 msgr2=0x7fd1e80a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ecb7b700 1 --2- 172.21.15.31:0/2511638153 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e8068340 0x7fd1e80a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ecb7b700 1 -- 172.21.15.31:0/2511638153 >> v1:172.21.15.31:6789/0 conn(0x7fd1e8140360 legacy=0x7fd1e806ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ecb7b700 1 -- 172.21.15.31:0/2511638153 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80a41a0 con 0x7fd1e80b0560 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ed37c700 1 --2- 172.21.15.31:0/2511638153 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e8068340 0x7fd1e80a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ecb7b700 1 --2- 172.21.15.31:0/2511638153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b0560 0x7fd1e813fe20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009910 tx=0x7fd1dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaeb0b162ea032de server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1dbfff700 1 -- 172.21.15.31:0/2511638153 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00b680 con 0x7fd1e80b0560 2024-04-18T10:44:01.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1dbfff700 1 -- 172.21.15.31:0/2511638153 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc00b7e0 con 0x7fd1e80b0560 2024-04-18T10:44:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1dbfff700 1 -- 172.21.15.31:0/2511638153 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00bba0 con 0x7fd1e80b0560 2024-04-18T10:44:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2511638153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b0560 msgr2=0x7fd1e813fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ef5e0700 1 --2- 172.21.15.31:0/2511638153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b0560 0x7fd1e813fe20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009910 tx=0x7fd1dc0091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2511638153 shutdown_connections 2024-04-18T10:44:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ef5e0700 1 --2- 172.21.15.31:0/2511638153 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e8068340 0x7fd1e80a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ef5e0700 1 --2- 172.21.15.31:0/2511638153 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e80b0560 0x7fd1e813fe20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.040+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2511638153 >> 172.21.15.31:0/2511638153 conn(0x7fd1e806dd70 msgr2=0x7fd1e80679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.041+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2511638153 shutdown_connections 2024-04-18T10:44:01.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.041+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2511638153 wait complete. 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.041+0000 7fd1ef5e0700 1 Processor -- start 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ef5e0700 1 -- start start 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ef5e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8068340 0x7fd1e814c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ef5e0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e80b0560 0x7fd1e814cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ef5e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e8140360 0x7fd1e814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ef5e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80af000 con 0x7fd1e8140360 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ef5e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8097cd0 con 0x7fd1e8068340 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ef5e0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80ad8c0 con 0x7fd1e80b0560 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ed37c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8068340 0x7fd1e814c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ed37c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8068340 0x7fd1e814c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38314/0 (socket says 172.21.15.31:38314) 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1edb7d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e8140360 0x7fd1e814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ed37c700 1 -- 172.21.15.31:0/2746309337 learned_addr learned my addr 172.21.15.31:0/2746309337 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.042+0000 7fd1ecb7b700 1 --2- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e80b0560 0x7fd1e814cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1ed37c700 1 -- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e80b0560 msgr2=0x7fd1e814cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1ed37c700 1 --2- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e80b0560 0x7fd1e814cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1ed37c700 1 -- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e8140360 msgr2=0x7fd1e814f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1ed37c700 1 --2- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e8140360 0x7fd1e814f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1ed37c700 1 -- 172.21.15.31:0/2746309337 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e4009420 con 0x7fd1e8068340 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1edb7d700 1 --2- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e8140360 0x7fd1e814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1ed37c700 1 --2- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8068340 0x7fd1e814c570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400ec80 tx=0x7fd1e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2746309337 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400c920 con 0x7fd1e8068340 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2746309337 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e400ca80 con 0x7fd1e8068340 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2746309337 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400ce00 con 0x7fd1e8068340 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc009420 con 0x7fd1e8068340 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.043+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e814bff0 con 0x7fd1e8068340 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.044+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2746309337 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fd1e4013680 con 0x7fd1e8068340 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.044+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e80651b0 con 0x7fd1e8068340 2024-04-18T10:44:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.044+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2746309337 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fd1e405b550 con 0x7fd1e8068340 2024-04-18T10:44:01.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.048+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2746309337 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd1e40396f0 con 0x7fd1e8068340 2024-04-18T10:44:01.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.205+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1e80a81d0 con 0x7fd1cc045ef0 2024-04-18T10:44:01.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.213+0000 7fd1d97fa700 1 -- 172.21.15.31:0/2746309337 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278028 (unknown 2965378022 0 1430237390) 0x7fd1e80a81d0 con 0x7fd1cc045ef0 2024-04-18T10:44:01.216 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.215+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 >> v1:172.21.15.31:6816/46601 conn(0x7fd1cc045ef0 legacy=0x7fd1cc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.215+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8068340 msgr2=0x7fd1e814c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.215+0000 7fd1ef5e0700 1 --2- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8068340 0x7fd1e814c570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400ec80 tx=0x7fd1e40091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.215+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 shutdown_connections 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.215+0000 7fd1ef5e0700 1 --2- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e8140360 0x7fd1e814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.215+0000 7fd1ef5e0700 1 --2- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd1e8068340 0x7fd1e814c570 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.215+0000 7fd1ef5e0700 1 --2- 172.21.15.31:0/2746309337 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd1e80b0560 0x7fd1e814cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.216+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 >> 172.21.15.31:0/2746309337 conn(0x7fd1e806dd70 msgr2=0x7fd1e8141570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.216+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 shutdown_connections 2024-04-18T10:44:01.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.216+0000 7fd1ef5e0700 1 -- 172.21.15.31:0/2746309337 wait complete. 2024-04-18T10:44:01.219 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:44:01.227 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-04-18T10:44:00.485129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35077,"ondisk_log_size":35077,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6620104,"num_objects":-910,"num_object_clones":0,"num_object_copies":-1820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-910,"num_whiteouts":0,"num_read":17,"num_read_kb":152,"num_write":1011,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003004"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":522,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452679+0000","last_change":"2024-04-18T10:38:48.515671+0000","last_active":"2024-04-18T10:43:51.452679+0000","last_peered":"2024-04-18T10:43:51.452679+0000","last_clean":"2024-04-18T10:43:51.452679+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:43:51.452679+0000","last_undegraded":"2024-04-18T10:43:51.452679+0000","last_fullsized":"2024-04-18T10:43:51.452679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:55:56.692744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":510,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447019+0000","last_change":"2024-04-18T10:38:47.514349+0000","last_active":"2024-04-18T10:43:51.447019+0000","last_peered":"2024-04-18T10:43:51.447019+0000","last_clean":"2024-04-18T10:43:51.447019+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:43:51.447019+0000","last_undegraded":"2024-04-18T10:43:51.447019+0000","last_fullsized":"2024-04-18T10:43:51.447019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:40:55.175836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":421,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.414072+0000","last_change":"2024-04-18T10:38:46.523814+0000","last_active":"2024-04-18T10:43:51.414072+0000","last_peered":"2024-04-18T10:43:51.414072+0000","last_clean":"2024-04-18T10:43:51.414072+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:43:51.414072+0000","last_undegraded":"2024-04-18T10:43:51.414072+0000","last_fullsized":"2024-04-18T10:43:51.414072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:17.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":453,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.421836+0000","last_change":"2024-04-18T10:38:46.523213+0000","last_active":"2024-04-18T10:43:51.421836+0000","last_peered":"2024-04-18T10:43:51.421836+0000","last_clean":"2024-04-18T10:43:51.421836+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:43:51.421836+0000","last_undegraded":"2024-04-18T10:43:51.421836+0000","last_fullsized":"2024-04-18T10:43:51.421836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:17.296380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446083+0000","last_change":"2024-04-18T10:39:29.510615+0000","last_active":"2024-04-18T10:43:51.446083+0000","last_peered":"2024-04-18T10:43:51.446083+0000","last_clean":"2024-04-18T10:43:51.446083+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:43:51.446083+0000","last_undegraded":"2024-04-18T10:43:51.446083+0000","last_fullsized":"2024-04-18T10:43:51.446083+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:56.036618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":402,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443624+0000","last_change":"2024-04-18T10:39:29.508173+0000","last_active":"2024-04-18T10:43:51.443624+0000","last_peered":"2024-04-18T10:43:51.443624+0000","last_clean":"2024-04-18T10:43:51.443624+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:43:51.443624+0000","last_undegraded":"2024-04-18T10:43:51.443624+0000","last_fullsized":"2024-04-18T10:43:51.443624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:12:51.268277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":518,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431514+0000","last_change":"2024-04-18T10:38:48.526481+0000","last_active":"2024-04-18T10:43:51.431514+0000","last_peered":"2024-04-18T10:43:51.431514+0000","last_clean":"2024-04-18T10:43:51.431514+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:43:51.431514+0000","last_undegraded":"2024-04-18T10:43:51.431514+0000","last_fullsized":"2024-04-18T10:43:51.431514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:52:21.244414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.432661+0000","last_change":"2024-04-18T10:38:46.507263+0000","last_active":"2024-04-18T10:43:51.432661+0000","last_peered":"2024-04-18T10:43:51.432661+0000","last_clean":"2024-04-18T10:43:51.432661+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:43:51.432661+0000","last_undegraded":"2024-04-18T10:43:51.432661+0000","last_fullsized":"2024-04-18T10:43:51.432661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:09:47.927239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":503,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431820+0000","last_change":"2024-04-18T10:38:48.521319+0000","last_active":"2024-04-18T10:43:51.431820+0000","last_peered":"2024-04-18T10:43:51.431820+0000","last_clean":"2024-04-18T10:43:51.431820+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:43:51.431820+0000","last_undegraded":"2024-04-18T10:43:51.431820+0000","last_fullsized":"2024-04-18T10:43:51.431820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:08:27.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.444192+0000","last_change":"2024-04-18T10:38:46.520305+0000","last_active":"2024-04-18T10:43:51.444192+0000","last_peered":"2024-04-18T10:43:51.444192+0000","last_clean":"2024-04-18T10:43:51.444192+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:43:51.444192+0000","last_undegraded":"2024-04-18T10:43:51.444192+0000","last_fullsized":"2024-04-18T10:43:51.444192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.888537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":509,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.428542+0000","last_change":"2024-04-18T10:38:46.520635+0000","last_active":"2024-04-18T10:43:51.428542+0000","last_peered":"2024-04-18T10:43:51.428542+0000","last_clean":"2024-04-18T10:43:51.428542+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:43:51.428542+0000","last_undegraded":"2024-04-18T10:43:51.428542+0000","last_fullsized":"2024-04-18T10:43:51.428542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:25.599792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452935+0000","last_change":"2024-04-18T10:38:48.520598+0000","last_active":"2024-04-18T10:43:51.452935+0000","last_peered":"2024-04-18T10:43:51.452935+0000","last_clean":"2024-04-18T10:43:51.452935+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:43:51.452935+0000","last_undegraded":"2024-04-18T10:43:51.452935+0000","last_fullsized":"2024-04-18T10:43:51.452935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:57:15.523949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452998+0000","last_change":"2024-04-18T10:38:48.531599+0000","last_active":"2024-04-18T10:43:51.452998+0000","last_peered":"2024-04-18T10:43:51.452998+0000","last_clean":"2024-04-18T10:43:51.452998+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:43:51.452998+0000","last_undegraded":"2024-04-18T10:43:51.452998+0000","last_fullsized":"2024-04-18T10:43:51.452998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:07:18.483736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":448,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446075+0000","last_change":"2024-04-18T10:38:47.515586+0000","last_active":"2024-04-18T10:43:51.446075+0000","last_peered":"2024-04-18T10:43:51.446075+0000","last_clean":"2024-04-18T10:43:51.446075+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:43:51.446075+0000","last_undegraded":"2024-04-18T10:43:51.446075+0000","last_fullsized":"2024-04-18T10:43:51.446075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:38.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.415049+0000","last_change":"2024-04-18T10:38:46.523038+0000","last_active":"2024-04-18T10:43:51.415049+0000","last_peered":"2024-04-18T10:43:51.415049+0000","last_clean":"2024-04-18T10:43:51.415049+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:43:51.415049+0000","last_undegraded":"2024-04-18T10:43:51.415049+0000","last_fullsized":"2024-04-18T10:43:51.415049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:47.558311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":479,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445927+0000","last_change":"2024-04-18T10:39:29.508295+0000","last_active":"2024-04-18T10:43:51.445927+0000","last_peered":"2024-04-18T10:43:51.445927+0000","last_clean":"2024-04-18T10:43:51.445927+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:43:51.445927+0000","last_undegraded":"2024-04-18T10:43:51.445927+0000","last_fullsized":"2024-04-18T10:43:51.445927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:26:27.135112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":504,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.420651+0000","last_change":"2024-04-18T10:38:48.527369+0000","last_active":"2024-04-18T10:43:51.420651+0000","last_peered":"2024-04-18T10:43:51.420651+0000","last_clean":"2024-04-18T10:43:51.420651+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:43:51.420651+0000","last_undegraded":"2024-04-18T10:43:51.420651+0000","last_fullsized":"2024-04-18T10:43:51.420651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:05:08.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":469,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443622+0000","last_change":"2024-04-18T10:38:47.514997+0000","last_active":"2024-04-18T10:43:51.443622+0000","last_peered":"2024-04-18T10:43:51.443622+0000","last_clean":"2024-04-18T10:43:51.443622+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:43:51.443622+0000","last_undegraded":"2024-04-18T10:43:51.443622+0000","last_fullsized":"2024-04-18T10:43:51.443622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:28.335154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":526,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.430226+0000","last_change":"2024-04-18T10:38:48.518698+0000","last_active":"2024-04-18T10:43:51.430226+0000","last_peered":"2024-04-18T10:43:51.430226+0000","last_clean":"2024-04-18T10:43:51.430226+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:43:51.430226+0000","last_undegraded":"2024-04-18T10:43:51.430226+0000","last_fullsized":"2024-04-18T10:43:51.430226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:42.362882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":547,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452383+0000","last_change":"2024-04-18T10:38:48.535465+0000","last_active":"2024-04-18T10:43:51.452383+0000","last_peered":"2024-04-18T10:43:51.452383+0000","last_clean":"2024-04-18T10:43:51.452383+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:43:51.452383+0000","last_undegraded":"2024-04-18T10:43:51.452383+0000","last_fullsized":"2024-04-18T10:43:51.452383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:15:57.026266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":502,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452655+0000","last_change":"2024-04-18T10:38:48.536144+0000","last_active":"2024-04-18T10:43:51.452655+0000","last_peered":"2024-04-18T10:43:51.452655+0000","last_clean":"2024-04-18T10:43:51.452655+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:43:51.452655+0000","last_undegraded":"2024-04-18T10:43:51.452655+0000","last_fullsized":"2024-04-18T10:43:51.452655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:30:36.746569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":559,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.422268+0000","last_change":"2024-04-18T10:38:46.523917+0000","last_active":"2024-04-18T10:43:51.422268+0000","last_peered":"2024-04-18T10:43:51.422268+0000","last_clean":"2024-04-18T10:43:51.422268+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:43:51.422268+0000","last_undegraded":"2024-04-18T10:43:51.422268+0000","last_fullsized":"2024-04-18T10:43:51.422268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:50:08.234356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":485,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434563+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:43:51.434563+0000","last_peered":"2024-04-18T10:43:51.434563+0000","last_clean":"2024-04-18T10:43:51.434563+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:43:51.434563+0000","last_undegraded":"2024-04-18T10:43:51.434563+0000","last_fullsized":"2024-04-18T10:43:51.434563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:36:26.788947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":550,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452073+0000","last_change":"2024-04-18T10:38:48.532902+0000","last_active":"2024-04-18T10:43:51.452073+0000","last_peered":"2024-04-18T10:43:51.452073+0000","last_clean":"2024-04-18T10:43:51.452073+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:43:51.452073+0000","last_undegraded":"2024-04-18T10:43:51.452073+0000","last_fullsized":"2024-04-18T10:43:51.452073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:21:05.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":448,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438072+0000","last_change":"2024-04-18T10:39:29.641096+0000","last_active":"2024-04-18T10:43:51.438072+0000","last_peered":"2024-04-18T10:43:51.438072+0000","last_clean":"2024-04-18T10:43:51.438072+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:43:51.438072+0000","last_undegraded":"2024-04-18T10:43:51.438072+0000","last_fullsized":"2024-04-18T10:43:51.438072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:00:39.979232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":613,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448152+0000","last_change":"2024-04-18T10:38:47.515633+0000","last_active":"2024-04-18T10:43:51.448152+0000","last_peered":"2024-04-18T10:43:51.448152+0000","last_clean":"2024-04-18T10:43:51.448152+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:43:51.448152+0000","last_undegraded":"2024-04-18T10:43:51.448152+0000","last_fullsized":"2024-04-18T10:43:51.448152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:29:53.701977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438461+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:43:51.438461+0000","last_peered":"2024-04-18T10:43:51.438461+0000","last_clean":"2024-04-18T10:43:51.438461+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:43:51.438461+0000","last_undegraded":"2024-04-18T10:43:51.438461+0000","last_fullsized":"2024-04-18T10:43:51.438461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:17.044947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'598","reported_seq":632,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.436856+0000","last_change":"2024-04-18T10:38:47.515748+0000","last_active":"2024-04-18T10:43:48.436856+0000","last_peered":"2024-04-18T10:43:48.436856+0000","last_clean":"2024-04-18T10:43:48.436856+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:43:48.436856+0000","last_undegraded":"2024-04-18T10:43:48.436856+0000","last_fullsized":"2024-04-18T10:43:48.436856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:10:22.348842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":473,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453851+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:43:51.453851+0000","last_peered":"2024-04-18T10:43:51.453851+0000","last_clean":"2024-04-18T10:43:51.453851+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:43:51.453851+0000","last_undegraded":"2024-04-18T10:43:51.453851+0000","last_fullsized":"2024-04-18T10:43:51.453851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:21:57.410343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'444","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.399120+0000","last_change":"2024-04-18T10:38:48.531482+0000","last_active":"2024-04-18T10:43:47.399120+0000","last_peered":"2024-04-18T10:43:47.399120+0000","last_clean":"2024-04-18T10:43:47.399120+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:43:47.399120+0000","last_undegraded":"2024-04-18T10:43:47.399120+0000","last_fullsized":"2024-04-18T10:43:47.399120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:13:25.170588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":513,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434732+0000","last_change":"2024-04-18T10:38:46.523785+0000","last_active":"2024-04-18T10:43:51.434732+0000","last_peered":"2024-04-18T10:43:51.434732+0000","last_clean":"2024-04-18T10:43:51.434732+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:43:51.434732+0000","last_undegraded":"2024-04-18T10:43:51.434732+0000","last_fullsized":"2024-04-18T10:43:51.434732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:07:03.397909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'997","reported_seq":1041,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.375424+0000","last_change":"2024-04-18T10:38:48.528981+0000","last_active":"2024-04-18T10:43:49.375424+0000","last_peered":"2024-04-18T10:43:49.375424+0000","last_clean":"2024-04-18T10:43:49.375424+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:43:49.375424+0000","last_undegraded":"2024-04-18T10:43:49.375424+0000","last_fullsized":"2024-04-18T10:43:49.375424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:20:44.914726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":424,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446824+0000","last_change":"2024-04-18T10:39:29.505858+0000","last_active":"2024-04-18T10:43:51.446824+0000","last_peered":"2024-04-18T10:43:51.446824+0000","last_clean":"2024-04-18T10:43:51.446824+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:43:51.446824+0000","last_undegraded":"2024-04-18T10:43:51.446824+0000","last_fullsized":"2024-04-18T10:43:51.446824+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:40:31.972849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'63","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.417600+0000","last_change":"2024-04-18T10:38:48.521507+0000","last_active":"2024-04-18T10:43:45.417600+0000","last_peered":"2024-04-18T10:43:45.417600+0000","last_clean":"2024-04-18T10:43:45.417600+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:43:45.417600+0000","last_undegraded":"2024-04-18T10:43:45.417600+0000","last_fullsized":"2024-04-18T10:43:45.417600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:26:29.367671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449413+0000","last_change":"2024-04-18T10:38:48.528936+0000","last_active":"2024-04-18T10:43:51.449413+0000","last_peered":"2024-04-18T10:43:51.449413+0000","last_clean":"2024-04-18T10:43:51.449413+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:43:51.449413+0000","last_undegraded":"2024-04-18T10:43:51.449413+0000","last_fullsized":"2024-04-18T10:43:51.449413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:03:47.761656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'328","reported_seq":362,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.366130+0000","last_change":"2024-04-18T10:38:48.528847+0000","last_active":"2024-04-18T10:43:47.366130+0000","last_peered":"2024-04-18T10:43:47.366130+0000","last_clean":"2024-04-18T10:43:47.366130+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:43:47.366130+0000","last_undegraded":"2024-04-18T10:43:47.366130+0000","last_fullsized":"2024-04-18T10:43:47.366130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:52:18.159291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":630,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431598+0000","last_change":"2024-04-18T10:38:48.525442+0000","last_active":"2024-04-18T10:43:51.431598+0000","last_peered":"2024-04-18T10:43:51.431598+0000","last_clean":"2024-04-18T10:43:51.431598+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:43:51.431598+0000","last_undegraded":"2024-04-18T10:43:51.431598+0000","last_fullsized":"2024-04-18T10:43:51.431598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:01.154765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'120","reported_seq":160,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.495293+0000","last_change":"2024-04-18T10:38:48.529744+0000","last_active":"2024-04-18T10:43:48.495293+0000","last_peered":"2024-04-18T10:43:48.495293+0000","last_clean":"2024-04-18T10:43:48.495293+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:43:48.495293+0000","last_undegraded":"2024-04-18T10:43:48.495293+0000","last_fullsized":"2024-04-18T10:43:48.495293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:07.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":524,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451542+0000","last_change":"2024-04-18T10:38:48.530788+0000","last_active":"2024-04-18T10:43:51.451542+0000","last_peered":"2024-04-18T10:43:51.451542+0000","last_clean":"2024-04-18T10:43:51.451542+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:43:51.451542+0000","last_undegraded":"2024-04-18T10:43:51.451542+0000","last_fullsized":"2024-04-18T10:43:51.451542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:34.881473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'365","reported_seq":407,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.348545+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:43:51.348545+0000","last_peered":"2024-04-18T10:43:51.348545+0000","last_clean":"2024-04-18T10:43:51.348545+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:43:51.348545+0000","last_undegraded":"2024-04-18T10:43:51.348545+0000","last_fullsized":"2024-04-18T10:43:51.348545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:46.735369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453855+0000","last_change":"2024-04-18T10:38:48.528009+0000","last_active":"2024-04-18T10:43:51.453855+0000","last_peered":"2024-04-18T10:43:51.453855+0000","last_clean":"2024-04-18T10:43:51.453855+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:43:51.453855+0000","last_undegraded":"2024-04-18T10:43:51.453855+0000","last_fullsized":"2024-04-18T10:43:51.453855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:02.092332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'454","reported_seq":500,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.430066+0000","last_change":"2024-04-18T10:38:48.523218+0000","last_active":"2024-04-18T10:43:45.430066+0000","last_peered":"2024-04-18T10:43:45.430066+0000","last_clean":"2024-04-18T10:43:45.430066+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:43:45.430066+0000","last_undegraded":"2024-04-18T10:43:45.430066+0000","last_fullsized":"2024-04-18T10:43:45.430066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:15:59.389767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":430,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450572+0000","last_change":"2024-04-18T10:38:48.524990+0000","last_active":"2024-04-18T10:43:51.450572+0000","last_peered":"2024-04-18T10:43:51.450572+0000","last_clean":"2024-04-18T10:43:51.450572+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:43:51.450572+0000","last_undegraded":"2024-04-18T10:43:51.450572+0000","last_fullsized":"2024-04-18T10:43:51.450572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:13:40.543145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'52","reported_seq":88,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.445416+0000","last_change":"2024-04-18T10:38:48.530631+0000","last_active":"2024-04-18T10:43:46.445416+0000","last_peered":"2024-04-18T10:43:46.445416+0000","last_clean":"2024-04-18T10:43:46.445416+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:43:46.445416+0000","last_undegraded":"2024-04-18T10:43:46.445416+0000","last_fullsized":"2024-04-18T10:43:46.445416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:09:37.349194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":485,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438348+0000","last_change":"2024-04-18T10:38:48.526748+0000","last_active":"2024-04-18T10:43:51.438348+0000","last_peered":"2024-04-18T10:43:51.438348+0000","last_clean":"2024-04-18T10:43:51.438348+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:43:51.438348+0000","last_undegraded":"2024-04-18T10:43:51.438348+0000","last_fullsized":"2024-04-18T10:43:51.438348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:11.074933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":103,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.428382+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:43:45.428382+0000","last_peered":"2024-04-18T10:43:45.428382+0000","last_clean":"2024-04-18T10:43:45.428382+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:43:45.428382+0000","last_undegraded":"2024-04-18T10:43:45.428382+0000","last_fullsized":"2024-04-18T10:43:45.428382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:39:56.234231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445540+0000","last_change":"2024-04-18T10:38:48.522750+0000","last_active":"2024-04-18T10:43:51.445540+0000","last_peered":"2024-04-18T10:43:51.445540+0000","last_clean":"2024-04-18T10:43:51.445540+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:43:51.445540+0000","last_undegraded":"2024-04-18T10:43:51.445540+0000","last_fullsized":"2024-04-18T10:43:51.445540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:51.519415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'70","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367076+0000","last_change":"2024-04-18T10:38:46.524444+0000","last_active":"2024-04-18T10:43:47.367076+0000","last_peered":"2024-04-18T10:43:47.367076+0000","last_clean":"2024-04-18T10:43:47.367076+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:43:47.367076+0000","last_undegraded":"2024-04-18T10:43:47.367076+0000","last_fullsized":"2024-04-18T10:43:47.367076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:29:31.257203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448235+0000","last_change":"2024-04-18T10:38:48.524076+0000","last_active":"2024-04-18T10:43:51.448235+0000","last_peered":"2024-04-18T10:43:51.448235+0000","last_clean":"2024-04-18T10:43:51.448235+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:43:51.448235+0000","last_undegraded":"2024-04-18T10:43:51.448235+0000","last_fullsized":"2024-04-18T10:43:51.448235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:58.250235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'251","reported_seq":286,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.411625+0000","last_change":"2024-04-18T10:38:46.523417+0000","last_active":"2024-04-18T10:43:48.411625+0000","last_peered":"2024-04-18T10:43:48.411625+0000","last_clean":"2024-04-18T10:43:48.411625+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:43:48.411625+0000","last_undegraded":"2024-04-18T10:43:48.411625+0000","last_fullsized":"2024-04-18T10:43:48.411625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:02:29.079358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":476,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450051+0000","last_change":"2024-04-18T10:38:48.528752+0000","last_active":"2024-04-18T10:43:51.450051+0000","last_peered":"2024-04-18T10:43:51.450051+0000","last_clean":"2024-04-18T10:43:51.450051+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:43:51.450051+0000","last_undegraded":"2024-04-18T10:43:51.450051+0000","last_fullsized":"2024-04-18T10:43:51.450051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:31:20.382051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'340","reported_seq":383,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.428802+0000","last_change":"2024-04-18T10:38:47.516780+0000","last_active":"2024-04-18T10:43:45.428802+0000","last_peered":"2024-04-18T10:43:45.428802+0000","last_clean":"2024-04-18T10:43:45.428802+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:43:45.428802+0000","last_undegraded":"2024-04-18T10:43:45.428802+0000","last_fullsized":"2024-04-18T10:43:45.428802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:26.639180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":505,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450036+0000","last_change":"2024-04-18T10:38:48.537651+0000","last_active":"2024-04-18T10:43:51.450036+0000","last_peered":"2024-04-18T10:43:51.450036+0000","last_clean":"2024-04-18T10:43:51.450036+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:43:51.450036+0000","last_undegraded":"2024-04-18T10:43:51.450036+0000","last_fullsized":"2024-04-18T10:43:51.450036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:18.675030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'565","reported_seq":606,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.410751+0000","last_change":"2024-04-18T10:38:48.528245+0000","last_active":"2024-04-18T10:43:47.410751+0000","last_peered":"2024-04-18T10:43:47.410751+0000","last_clean":"2024-04-18T10:43:47.410751+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:43:47.410751+0000","last_undegraded":"2024-04-18T10:43:47.410751+0000","last_fullsized":"2024-04-18T10:43:47.410751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:52.532246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452030+0000","last_change":"2024-04-18T10:38:48.528767+0000","last_active":"2024-04-18T10:43:51.452030+0000","last_peered":"2024-04-18T10:43:51.452030+0000","last_clean":"2024-04-18T10:43:51.452030+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:43:51.452030+0000","last_undegraded":"2024-04-18T10:43:51.452030+0000","last_fullsized":"2024-04-18T10:43:51.452030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:31:30.566152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":96,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.379623+0000","last_change":"2024-04-18T10:38:48.527940+0000","last_active":"2024-04-18T10:43:47.379623+0000","last_peered":"2024-04-18T10:43:47.379623+0000","last_clean":"2024-04-18T10:43:47.379623+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:43:47.379623+0000","last_undegraded":"2024-04-18T10:43:47.379623+0000","last_fullsized":"2024-04-18T10:43:47.379623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:28.013331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":546,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.406957+0000","last_change":"2024-04-18T10:38:46.522705+0000","last_active":"2024-04-18T10:43:51.406957+0000","last_peered":"2024-04-18T10:43:51.406957+0000","last_clean":"2024-04-18T10:43:51.406957+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:43:51.406957+0000","last_undegraded":"2024-04-18T10:43:51.406957+0000","last_fullsized":"2024-04-18T10:43:51.406957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:23:44.645859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'170","reported_seq":215,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367215+0000","last_change":"2024-04-18T10:38:48.523093+0000","last_active":"2024-04-18T10:43:47.367215+0000","last_peered":"2024-04-18T10:43:47.367215+0000","last_clean":"2024-04-18T10:43:47.367215+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:43:47.367215+0000","last_undegraded":"2024-04-18T10:43:47.367215+0000","last_fullsized":"2024-04-18T10:43:47.367215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:20.206383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.422305+0000","last_change":"2024-04-18T10:38:48.528094+0000","last_active":"2024-04-18T10:43:51.422305+0000","last_peered":"2024-04-18T10:43:51.422305+0000","last_clean":"2024-04-18T10:43:51.422305+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:43:51.422305+0000","last_undegraded":"2024-04-18T10:43:51.422305+0000","last_fullsized":"2024-04-18T10:43:51.422305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:02.429215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'249","reported_seq":289,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.386774+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:43:47.386774+0000","last_peered":"2024-04-18T10:43:47.386774+0000","last_clean":"2024-04-18T10:43:47.386774+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:43:47.386774+0000","last_undegraded":"2024-04-18T10:43:47.386774+0000","last_fullsized":"2024-04-18T10:43:47.386774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:47:34.182153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453830+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:43:51.453830+0000","last_peered":"2024-04-18T10:43:51.453830+0000","last_clean":"2024-04-18T10:43:51.453830+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:43:51.453830+0000","last_undegraded":"2024-04-18T10:43:51.453830+0000","last_fullsized":"2024-04-18T10:43:51.453830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:08.173779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'62","reported_seq":99,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.389733+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:43:47.389733+0000","last_peered":"2024-04-18T10:43:47.389733+0000","last_clean":"2024-04-18T10:43:47.389733+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:43:47.389733+0000","last_undegraded":"2024-04-18T10:43:47.389733+0000","last_fullsized":"2024-04-18T10:43:47.389733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:04.645176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451809+0000","last_change":"2024-04-18T10:38:48.528656+0000","last_active":"2024-04-18T10:43:51.451809+0000","last_peered":"2024-04-18T10:43:51.451809+0000","last_clean":"2024-04-18T10:43:51.451809+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:43:51.451809+0000","last_undegraded":"2024-04-18T10:43:51.451809+0000","last_fullsized":"2024-04-18T10:43:51.451809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:53.065322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'492","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.368795+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:43:47.368795+0000","last_peered":"2024-04-18T10:43:47.368795+0000","last_clean":"2024-04-18T10:43:47.368795+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:43:47.368795+0000","last_undegraded":"2024-04-18T10:43:47.368795+0000","last_fullsized":"2024-04-18T10:43:47.368795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:06:10.188847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452204+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:43:51.452204+0000","last_peered":"2024-04-18T10:43:51.452204+0000","last_clean":"2024-04-18T10:43:51.452204+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:43:51.452204+0000","last_undegraded":"2024-04-18T10:43:51.452204+0000","last_fullsized":"2024-04-18T10:43:51.452204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:39:47.463040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.502609+0000","last_change":"2024-04-18T10:38:46.521667+0000","last_active":"2024-04-18T10:39:29.502609+0000","last_peered":"2024-04-18T10:39:29.502609+0000","last_clean":"2024-04-18T10:39:29.502609+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:39:29.502609+0000","last_undegraded":"2024-04-18T10:39:29.502609+0000","last_fullsized":"2024-04-18T10:39:29.502609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:58:33.365320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'347","reported_seq":382,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.458459+0000","last_change":"2024-04-18T10:38:48.518724+0000","last_active":"2024-04-18T10:43:48.458459+0000","last_peered":"2024-04-18T10:43:48.458459+0000","last_clean":"2024-04-18T10:43:48.458459+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:43:48.458459+0000","last_undegraded":"2024-04-18T10:43:48.458459+0000","last_fullsized":"2024-04-18T10:43:48.458459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:42.824622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":400,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451458+0000","last_change":"2024-04-18T10:38:48.529610+0000","last_active":"2024-04-18T10:43:51.451458+0000","last_peered":"2024-04-18T10:43:51.451458+0000","last_clean":"2024-04-18T10:43:51.451458+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:43:51.451458+0000","last_undegraded":"2024-04-18T10:43:51.451458+0000","last_fullsized":"2024-04-18T10:43:51.451458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:22:33.897416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639298+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:39:29.639298+0000","last_peered":"2024-04-18T10:39:29.639298+0000","last_clean":"2024-04-18T10:39:29.639298+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:39:29.639298+0000","last_undegraded":"2024-04-18T10:39:29.639298+0000","last_fullsized":"2024-04-18T10:39:29.639298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:33.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'70","reported_seq":109,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.443753+0000","last_change":"2024-04-18T10:38:47.513344+0000","last_active":"2024-04-18T10:43:48.443753+0000","last_peered":"2024-04-18T10:43:48.443753+0000","last_clean":"2024-04-18T10:43:48.443753+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:43:48.443753+0000","last_undegraded":"2024-04-18T10:43:48.443753+0000","last_fullsized":"2024-04-18T10:43:48.443753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:48.441734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":470,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445285+0000","last_change":"2024-04-18T10:38:47.515107+0000","last_active":"2024-04-18T10:43:51.445285+0000","last_peered":"2024-04-18T10:43:51.445285+0000","last_clean":"2024-04-18T10:43:51.445285+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:43:51.445285+0000","last_undegraded":"2024-04-18T10:43:51.445285+0000","last_fullsized":"2024-04-18T10:43:51.445285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:10:14.119655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.499561+0000","last_change":"2024-04-18T10:38:48.520896+0000","last_active":"2024-04-18T10:39:29.499561+0000","last_peered":"2024-04-18T10:39:29.499561+0000","last_clean":"2024-04-18T10:39:29.499561+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:39:29.499561+0000","last_undegraded":"2024-04-18T10:39:29.499561+0000","last_fullsized":"2024-04-18T10:39:29.499561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:57:03.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'433","reported_seq":468,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.414756+0000","last_change":"2024-04-18T10:38:47.519693+0000","last_active":"2024-04-18T10:43:46.414756+0000","last_peered":"2024-04-18T10:43:46.414756+0000","last_clean":"2024-04-18T10:43:46.414756+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:43:46.414756+0000","last_undegraded":"2024-04-18T10:43:46.414756+0000","last_fullsized":"2024-04-18T10:43:46.414756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:34.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":414,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443347+0000","last_change":"2024-04-18T10:38:46.520198+0000","last_active":"2024-04-18T10:43:51.443347+0000","last_peered":"2024-04-18T10:43:51.443347+0000","last_clean":"2024-04-18T10:43:51.443347+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:43:51.443347+0000","last_undegraded":"2024-04-18T10:43:51.443347+0000","last_fullsized":"2024-04-18T10:43:51.443347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:18:11.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639632+0000","last_change":"2024-04-18T10:38:48.522906+0000","last_active":"2024-04-18T10:39:29.639632+0000","last_peered":"2024-04-18T10:39:29.639632+0000","last_clean":"2024-04-18T10:39:29.639632+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:39:29.639632+0000","last_undegraded":"2024-04-18T10:39:29.639632+0000","last_fullsized":"2024-04-18T10:39:29.639632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:14.552416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'115","reported_seq":194,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.501781+0000","last_change":"2024-04-18T10:38:46.507608+0000","last_active":"2024-04-18T10:39:29.501781+0000","last_peered":"2024-04-18T10:39:29.501781+0000","last_clean":"2024-04-18T10:39:29.501781+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:39:29.501781+0000","last_undegraded":"2024-04-18T10:39:29.501781+0000","last_fullsized":"2024-04-18T10:39:29.501781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:46:55.362151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'526","reported_seq":563,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.404828+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:43:45.404828+0000","last_peered":"2024-04-18T10:43:45.404828+0000","last_clean":"2024-04-18T10:43:45.404828+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:43:45.404828+0000","last_undegraded":"2024-04-18T10:43:45.404828+0000","last_fullsized":"2024-04-18T10:43:45.404828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:23.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":541,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453345+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:43:51.453345+0000","last_peered":"2024-04-18T10:43:51.453345+0000","last_clean":"2024-04-18T10:43:51.453345+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:43:51.453345+0000","last_undegraded":"2024-04-18T10:43:51.453345+0000","last_fullsized":"2024-04-18T10:43:51.453345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:03.109484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639111+0000","last_change":"2024-04-18T10:38:48.529162+0000","last_active":"2024-04-18T10:39:29.639111+0000","last_peered":"2024-04-18T10:39:29.639111+0000","last_clean":"2024-04-18T10:39:29.639111+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:39:29.639111+0000","last_undegraded":"2024-04-18T10:39:29.639111+0000","last_fullsized":"2024-04-18T10:39:29.639111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:18:10.267046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'262","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.366459+0000","last_change":"2024-04-18T10:38:47.513300+0000","last_active":"2024-04-18T10:43:49.366459+0000","last_peered":"2024-04-18T10:43:49.366459+0000","last_clean":"2024-04-18T10:43:49.366459+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:43:49.366459+0000","last_undegraded":"2024-04-18T10:43:49.366459+0000","last_fullsized":"2024-04-18T10:43:49.366459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:38:14.658997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":523,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445123+0000","last_change":"2024-04-18T10:38:46.523777+0000","last_active":"2024-04-18T10:43:51.445123+0000","last_peered":"2024-04-18T10:43:51.445123+0000","last_clean":"2024-04-18T10:43:51.445123+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:43:51.445123+0000","last_undegraded":"2024-04-18T10:43:51.445123+0000","last_fullsized":"2024-04-18T10:43:51.445123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:03:13.518817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.640426+0000","last_change":"2024-04-18T10:38:48.526577+0000","last_active":"2024-04-18T10:39:29.640426+0000","last_peered":"2024-04-18T10:39:29.640426+0000","last_clean":"2024-04-18T10:39:29.640426+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:39:29.640426+0000","last_undegraded":"2024-04-18T10:39:29.640426+0000","last_fullsized":"2024-04-18T10:39:29.640426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:34:26.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":90,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.453422+0000","last_change":"2024-04-18T10:38:47.515422+0000","last_active":"2024-04-18T10:43:48.453422+0000","last_peered":"2024-04-18T10:43:48.453422+0000","last_clean":"2024-04-18T10:43:48.453422+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:43:48.453422+0000","last_undegraded":"2024-04-18T10:43:48.453422+0000","last_fullsized":"2024-04-18T10:43:48.453422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.811949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446175+0000","last_change":"2024-04-18T10:38:47.513292+0000","last_active":"2024-04-18T10:43:51.446175+0000","last_peered":"2024-04-18T10:43:51.446175+0000","last_clean":"2024-04-18T10:43:51.446175+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:43:51.446175+0000","last_undegraded":"2024-04-18T10:43:51.446175+0000","last_fullsized":"2024-04-18T10:43:51.446175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:35.308701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'62","reported_seq":103,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.431314+0000","last_change":"2024-04-18T10:38:48.525344+0000","last_active":"2024-04-18T10:43:48.431314+0000","last_peered":"2024-04-18T10:43:48.431314+0000","last_clean":"2024-04-18T10:43:48.431314+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:43:48.431314+0000","last_undegraded":"2024-04-18T10:43:48.431314+0000","last_fullsized":"2024-04-18T10:43:48.431314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:13:06.871047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.503660+0000","last_change":"2024-04-18T10:38:46.521665+0000","last_active":"2024-04-18T10:39:29.503660+0000","last_peered":"2024-04-18T10:39:29.503660+0000","last_clean":"2024-04-18T10:39:29.503660+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:39:29.503660+0000","last_undegraded":"2024-04-18T10:39:29.503660+0000","last_fullsized":"2024-04-18T10:39:29.503660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:14:41.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450142+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:43:51.450142+0000","last_peered":"2024-04-18T10:43:51.450142+0000","last_clean":"2024-04-18T10:43:51.450142+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:43:51.450142+0000","last_undegraded":"2024-04-18T10:43:51.450142+0000","last_fullsized":"2024-04-18T10:43:51.450142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:16.195736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.640642+0000","last_change":"2024-04-18T10:38:48.519133+0000","last_active":"2024-04-18T10:39:29.640642+0000","last_peered":"2024-04-18T10:39:29.640642+0000","last_clean":"2024-04-18T10:39:29.640642+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:39:29.640642+0000","last_undegraded":"2024-04-18T10:39:29.640642+0000","last_fullsized":"2024-04-18T10:39:29.640642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:47.684869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":120,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.430266+0000","last_change":"2024-04-18T10:38:46.523957+0000","last_active":"2024-04-18T10:43:48.430266+0000","last_peered":"2024-04-18T10:43:48.430266+0000","last_clean":"2024-04-18T10:43:48.430266+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:43:48.430266+0000","last_undegraded":"2024-04-18T10:43:48.430266+0000","last_fullsized":"2024-04-18T10:43:48.430266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:49.311603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":446,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451210+0000","last_change":"2024-04-18T10:38:48.520854+0000","last_active":"2024-04-18T10:43:51.451210+0000","last_peered":"2024-04-18T10:43:51.451210+0000","last_clean":"2024-04-18T10:43:51.451210+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:43:51.451210+0000","last_undegraded":"2024-04-18T10:43:51.451210+0000","last_fullsized":"2024-04-18T10:43:51.451210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:27.953816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'72","reported_seq":111,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.455510+0000","last_change":"2024-04-18T10:38:48.527898+0000","last_active":"2024-04-18T10:43:45.455510+0000","last_peered":"2024-04-18T10:43:45.455510+0000","last_clean":"2024-04-18T10:43:45.455510+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:43:45.455510+0000","last_undegraded":"2024-04-18T10:43:45.455510+0000","last_fullsized":"2024-04-18T10:43:45.455510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:35:58.649968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":441,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447405+0000","last_change":"2024-04-18T10:38:47.514434+0000","last_active":"2024-04-18T10:43:51.447405+0000","last_peered":"2024-04-18T10:43:51.447405+0000","last_clean":"2024-04-18T10:43:51.447405+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:43:51.447405+0000","last_undegraded":"2024-04-18T10:43:51.447405+0000","last_fullsized":"2024-04-18T10:43:51.447405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:22:40.288392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'343","reported_seq":383,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367534+0000","last_change":"2024-04-18T10:38:46.520352+0000","last_active":"2024-04-18T10:43:47.367534+0000","last_peered":"2024-04-18T10:43:47.367534+0000","last_clean":"2024-04-18T10:43:47.367534+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:43:47.367534+0000","last_undegraded":"2024-04-18T10:43:47.367534+0000","last_fullsized":"2024-04-18T10:43:47.367534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:55:53.724349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":409,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452635+0000","last_change":"2024-04-18T10:38:48.528181+0000","last_active":"2024-04-18T10:43:51.452635+0000","last_peered":"2024-04-18T10:43:51.452635+0000","last_clean":"2024-04-18T10:43:51.452635+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:43:51.452635+0000","last_undegraded":"2024-04-18T10:43:51.452635+0000","last_fullsized":"2024-04-18T10:43:51.452635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:38.920913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'287","reported_seq":332,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.414294+0000","last_change":"2024-04-18T10:38:48.526382+0000","last_active":"2024-04-18T10:43:47.414294+0000","last_peered":"2024-04-18T10:43:47.414294+0000","last_clean":"2024-04-18T10:43:47.414294+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:43:47.414294+0000","last_undegraded":"2024-04-18T10:43:47.414294+0000","last_fullsized":"2024-04-18T10:43:47.414294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:36:19.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":466,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445781+0000","last_change":"2024-04-18T10:39:29.508423+0000","last_active":"2024-04-18T10:43:51.445781+0000","last_peered":"2024-04-18T10:43:51.445781+0000","last_clean":"2024-04-18T10:43:51.445781+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:43:51.445781+0000","last_undegraded":"2024-04-18T10:43:51.445781+0000","last_fullsized":"2024-04-18T10:43:51.445781+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:19.178512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'110","reported_seq":147,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.412029+0000","last_change":"2024-04-18T10:38:48.521841+0000","last_active":"2024-04-18T10:43:48.412029+0000","last_peered":"2024-04-18T10:43:48.412029+0000","last_clean":"2024-04-18T10:43:48.412029+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:43:48.412029+0000","last_undegraded":"2024-04-18T10:43:48.412029+0000","last_fullsized":"2024-04-18T10:43:48.412029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:44:53.826636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":515,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449133+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:43:51.449133+0000","last_peered":"2024-04-18T10:43:51.449133+0000","last_clean":"2024-04-18T10:43:51.449133+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:43:51.449133+0000","last_undegraded":"2024-04-18T10:43:51.449133+0000","last_fullsized":"2024-04-18T10:43:51.449133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:44.601528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'99","reported_seq":132,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.354807+0000","last_change":"2024-04-18T10:38:46.523460+0000","last_active":"2024-04-18T10:43:47.354807+0000","last_peered":"2024-04-18T10:43:47.354807+0000","last_clean":"2024-04-18T10:43:47.354807+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:43:47.354807+0000","last_undegraded":"2024-04-18T10:43:47.354807+0000","last_fullsized":"2024-04-18T10:43:47.354807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:33.163273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":509,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448265+0000","last_change":"2024-04-18T10:38:47.514386+0000","last_active":"2024-04-18T10:43:51.448265+0000","last_peered":"2024-04-18T10:43:51.448265+0000","last_clean":"2024-04-18T10:43:51.448265+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:43:51.448265+0000","last_undegraded":"2024-04-18T10:43:51.448265+0000","last_fullsized":"2024-04-18T10:43:51.448265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:25.189215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":499,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446535+0000","last_change":"2024-04-18T10:38:47.515056+0000","last_active":"2024-04-18T10:43:51.446535+0000","last_peered":"2024-04-18T10:43:51.446535+0000","last_clean":"2024-04-18T10:43:51.446535+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:43:51.446535+0000","last_undegraded":"2024-04-18T10:43:51.446535+0000","last_fullsized":"2024-04-18T10:43:51.446535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:09:39.192070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":438,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447899+0000","last_change":"2024-04-18T10:39:29.506707+0000","last_active":"2024-04-18T10:43:51.447899+0000","last_peered":"2024-04-18T10:43:51.447899+0000","last_clean":"2024-04-18T10:43:51.447899+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:43:51.447899+0000","last_undegraded":"2024-04-18T10:43:51.447899+0000","last_fullsized":"2024-04-18T10:43:51.447899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:15:49.305625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":564,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.420162+0000","last_change":"2024-04-18T10:38:48.530823+0000","last_active":"2024-04-18T10:43:51.420162+0000","last_peered":"2024-04-18T10:43:51.420162+0000","last_clean":"2024-04-18T10:43:51.420162+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:43:51.420162+0000","last_undegraded":"2024-04-18T10:43:51.420162+0000","last_fullsized":"2024-04-18T10:43:51.420162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:17.039853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450748+0000","last_change":"2024-04-18T10:38:48.528090+0000","last_active":"2024-04-18T10:43:51.450748+0000","last_peered":"2024-04-18T10:43:51.450748+0000","last_clean":"2024-04-18T10:43:51.450748+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:43:51.450748+0000","last_undegraded":"2024-04-18T10:43:51.450748+0000","last_fullsized":"2024-04-18T10:43:51.450748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:18:27.052176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445610+0000","last_change":"2024-04-18T10:38:47.515405+0000","last_active":"2024-04-18T10:43:51.445610+0000","last_peered":"2024-04-18T10:43:51.445610+0000","last_clean":"2024-04-18T10:43:51.445610+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:43:51.445610+0000","last_undegraded":"2024-04-18T10:43:51.445610+0000","last_fullsized":"2024-04-18T10:43:51.445610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:31.550014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8497,"ondisk_log_size":8497,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953536,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.38,"15min":0.378},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.36599999999999999,"15min":0.38300000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Apr 18 10:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.41799999999999998,"15min":0.42199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.373,"15min":0.38700000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.51600000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.307}]},{"osd":2,"last update":"Thu Apr 18 10:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41899999999999998,"15min":0.437},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":4.181,"5min":4.181,"15min":4.181},"last":0.39000000000000001}]}]},{"osd":2,"up_from":31,"seq":133143986240,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:42:53 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Apr 18 10:42:53 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.372,"15min":0.38700000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52200000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Apr 18 10:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.39300000000000002,"15min":0.41099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.42999999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41899999999999998,"15min":0.42999999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40699999999999997}]}]},{"osd":0,"up_from":29,"seq":124554051649,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34999999999999998,"15min":0.33600000000000002},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.22},{"interface":"front","average":{"1min":0.314,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.216,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.628,"5min":1.224,"15min":1.224},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38400000000000001,"15min":0.35799999999999998},"min":{"1min":0.20599999999999999,"5min":0.19,"15min":0.19},"max":{"1min":1.514,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.254},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.22500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.59499999999999997,"5min":1.173,"15min":1.173},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.38300000000000001,"15min":0.41799999999999998},"min":{"1min":0.23200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.73599999999999999,"5min":1.204,"15min":1.204},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.51500000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.314}]}]},{"osd":1,"up_from":30,"seq":128849018945,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.34899999999999998},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.33900000000000002,"15min":0.35899999999999999},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.325,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.255}]},{"osd":3,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.98599999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.9970000000000001,"5min":2.173,"15min":2.173},"last":0.31900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:44:01.231 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-18T10:44:01.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:44:01.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.387+0000 7f5878770700 1 Processor -- start 2024-04-18T10:44:01.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.387+0000 7f5878770700 1 -- start start 2024-04-18T10:44:01.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f5878770700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f587006ecf0 0x7f58700a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f5878770700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a7130 0x7f58701462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f5878770700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58700a3540 con 0x7f58700a6d60 2024-04-18T10:44:01.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f5878770700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58700a37e0 con 0x7f587006ecf0 2024-04-18T10:44:01.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f5878770700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58700a5d60 con 0x7f58700a7130 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587650c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f587006ecf0 0x7f58700a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f5876d0d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a7130 0x7f58701462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f5875d0b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f58700a6d60 0x7f5870142b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40424/0 (socket says 172.21.15.31:40424) 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f5875d0b700 1 -- 172.21.15.31:0/2373869814 learned_addr learned my addr 172.21.15.31:0/2373869814 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587650c700 1 -- 172.21.15.31:0/2373869814 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a7130 msgr2=0x7f58701462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587650c700 1 --2- 172.21.15.31:0/2373869814 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a7130 0x7f58701462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587550a700 1 -- 172.21.15.31:0/2373869814 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312046537 0 0) 0x7f58700a3540 con 0x7f58700a6d60 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587650c700 1 -- 172.21.15.31:0/2373869814 >> v1:172.21.15.31:6789/0 conn(0x7f58700a6d60 legacy=0x7f5870142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587650c700 1 -- 172.21.15.31:0/2373869814 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587006d980 con 0x7f587006ecf0 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f5876d0d700 1 --2- 172.21.15.31:0/2373869814 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a7130 0x7f58701462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587650c700 1 --2- 172.21.15.31:0/2373869814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f587006ecf0 0x7f58700a5260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5860009910 tx=0x7f58600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea04f760b009a593 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587550a700 1 -- 172.21.15.31:0/2373869814 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000b680 con 0x7f587006ecf0 2024-04-18T10:44:01.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587550a700 1 -- 172.21.15.31:0/2373869814 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000b7e0 con 0x7f587006ecf0 2024-04-18T10:44:01.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.388+0000 7f587550a700 1 -- 172.21.15.31:0/2373869814 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000bba0 con 0x7f587006ecf0 2024-04-18T10:44:01.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.389+0000 7f5878770700 1 -- 172.21.15.31:0/2373869814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f587006ecf0 msgr2=0x7f58700a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.389+0000 7f5878770700 1 --2- 172.21.15.31:0/2373869814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f587006ecf0 0x7f58700a5260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5860009910 tx=0x7f58600091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.389+0000 7f5878770700 1 -- 172.21.15.31:0/2373869814 shutdown_connections 2024-04-18T10:44:01.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.389+0000 7f5878770700 1 --2- 172.21.15.31:0/2373869814 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a7130 0x7f58701462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.389+0000 7f5878770700 1 --2- 172.21.15.31:0/2373869814 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f587006ecf0 0x7f58700a5260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.389+0000 7f5878770700 1 -- 172.21.15.31:0/2373869814 >> 172.21.15.31:0/2373869814 conn(0x7f58700679e0 msgr2=0x7f5870067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:01.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.389+0000 7f5878770700 1 -- 172.21.15.31:0/2373869814 shutdown_connections 2024-04-18T10:44:01.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.389+0000 7f5878770700 1 -- 172.21.15.31:0/2373869814 wait complete. 2024-04-18T10:44:01.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.390+0000 7f5878770700 1 Processor -- start 2024-04-18T10:44:01.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.390+0000 7f5878770700 1 -- start start 2024-04-18T10:44:01.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5878770700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587006ecf0 0x7f58700a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5878770700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a6d60 0x7f587014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5878770700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58700a7130 0x7f587014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5878770700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58700a8dc0 con 0x7f587006ecf0 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5878770700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58700a9b00 con 0x7f58700a7130 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5878770700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58700aa030 con 0x7f58700a6d60 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f587650c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587006ecf0 0x7f58700a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f587650c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587006ecf0 0x7f58700a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40276/0 (socket says 172.21.15.31:40276) 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f587650c700 1 -- 172.21.15.31:0/263929326 learned_addr learned my addr 172.21.15.31:0/263929326 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5876d0d700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58700a7130 0x7f587014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5875d0b700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a6d60 0x7f587014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f587650c700 1 -- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a6d60 msgr2=0x7f587014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f587650c700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a6d60 0x7f587014e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f587650c700 1 -- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58700a7130 msgr2=0x7f587014e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f587650c700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58700a7130 0x7f587014e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f587650c700 1 -- 172.21.15.31:0/263929326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868009a20 con 0x7f587006ecf0 2024-04-18T10:44:01.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5876d0d700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58700a7130 0x7f587014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:01.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f587650c700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587006ecf0 0x7f58700a8fb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58700a3970 tx=0x7f5860017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:01.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f58667fc700 1 -- 172.21.15.31:0/263929326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000bb60 con 0x7f587006ecf0 2024-04-18T10:44:01.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f58667fc700 1 -- 172.21.15.31:0/263929326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5860000c90 con 0x7f587006ecf0 2024-04-18T10:44:01.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f58667fc700 1 -- 172.21.15.31:0/263929326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586001a660 con 0x7f587006ecf0 2024-04-18T10:44:01.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5860009420 con 0x7f587006ecf0 2024-04-18T10:44:01.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.391+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587014dd70 con 0x7f587006ecf0 2024-04-18T10:44:01.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.392+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58700651b0 con 0x7f587006ecf0 2024-04-18T10:44:01.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.392+0000 7f58667fc700 1 -- 172.21.15.31:0/263929326 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f586001a9d0 con 0x7f587006ecf0 2024-04-18T10:44:01.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.393+0000 7f58667fc700 1 -- 172.21.15.31:0/263929326 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f586005cc80 con 0x7f587006ecf0 2024-04-18T10:44:01.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.396+0000 7f58667fc700 1 -- 172.21.15.31:0/263929326 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5860062020 con 0x7f587006ecf0 2024-04-18T10:44:01.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.555+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58700a7650 con 0x7f5854045ef0 2024-04-18T10:44:01.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.562+0000 7f58667fc700 1 -- 172.21.15.31:0/263929326 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278028 (unknown 2965378022 0 1430237390) 0x7f58700a7650 con 0x7f5854045ef0 2024-04-18T10:44:01.565 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:44:01.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 >> v1:172.21.15.31:6816/46601 conn(0x7f5854045ef0 legacy=0x7f58540483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587006ecf0 msgr2=0x7f58700a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587006ecf0 0x7f58700a8fb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58700a3970 tx=0x7f5860017000 comp rx=0 tx=0).stop 2024-04-18T10:44:01.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 shutdown_connections 2024-04-18T10:44:01.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f58700a7130 0x7f587014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f587006ecf0 0x7f58700a8fb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 --2- 172.21.15.31:0/263929326 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f58700a6d60 0x7f587014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 >> 172.21.15.31:0/263929326 conn(0x7f58700679e0 msgr2=0x7f58700b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:01.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 shutdown_connections 2024-04-18T10:44:01.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.565+0000 7f5878770700 1 -- 172.21.15.31:0/263929326 wait complete. 2024-04-18T10:44:01.568 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:44:01.576 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-04-18T10:44:00.485129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35077,"ondisk_log_size":35077,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6620104,"num_objects":-910,"num_object_clones":0,"num_object_copies":-1820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-910,"num_whiteouts":0,"num_read":17,"num_read_kb":152,"num_write":1011,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003004"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":522,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452679+0000","last_change":"2024-04-18T10:38:48.515671+0000","last_active":"2024-04-18T10:43:51.452679+0000","last_peered":"2024-04-18T10:43:51.452679+0000","last_clean":"2024-04-18T10:43:51.452679+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:43:51.452679+0000","last_undegraded":"2024-04-18T10:43:51.452679+0000","last_fullsized":"2024-04-18T10:43:51.452679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:55:56.692744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":510,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447019+0000","last_change":"2024-04-18T10:38:47.514349+0000","last_active":"2024-04-18T10:43:51.447019+0000","last_peered":"2024-04-18T10:43:51.447019+0000","last_clean":"2024-04-18T10:43:51.447019+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:43:51.447019+0000","last_undegraded":"2024-04-18T10:43:51.447019+0000","last_fullsized":"2024-04-18T10:43:51.447019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:40:55.175836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":421,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.414072+0000","last_change":"2024-04-18T10:38:46.523814+0000","last_active":"2024-04-18T10:43:51.414072+0000","last_peered":"2024-04-18T10:43:51.414072+0000","last_clean":"2024-04-18T10:43:51.414072+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:43:51.414072+0000","last_undegraded":"2024-04-18T10:43:51.414072+0000","last_fullsized":"2024-04-18T10:43:51.414072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:17.278854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":453,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.421836+0000","last_change":"2024-04-18T10:38:46.523213+0000","last_active":"2024-04-18T10:43:51.421836+0000","last_peered":"2024-04-18T10:43:51.421836+0000","last_clean":"2024-04-18T10:43:51.421836+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:43:51.421836+0000","last_undegraded":"2024-04-18T10:43:51.421836+0000","last_fullsized":"2024-04-18T10:43:51.421836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:17.296380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446083+0000","last_change":"2024-04-18T10:39:29.510615+0000","last_active":"2024-04-18T10:43:51.446083+0000","last_peered":"2024-04-18T10:43:51.446083+0000","last_clean":"2024-04-18T10:43:51.446083+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:43:51.446083+0000","last_undegraded":"2024-04-18T10:43:51.446083+0000","last_fullsized":"2024-04-18T10:43:51.446083+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:56.036618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":402,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443624+0000","last_change":"2024-04-18T10:39:29.508173+0000","last_active":"2024-04-18T10:43:51.443624+0000","last_peered":"2024-04-18T10:43:51.443624+0000","last_clean":"2024-04-18T10:43:51.443624+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:43:51.443624+0000","last_undegraded":"2024-04-18T10:43:51.443624+0000","last_fullsized":"2024-04-18T10:43:51.443624+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:12:51.268277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":518,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431514+0000","last_change":"2024-04-18T10:38:48.526481+0000","last_active":"2024-04-18T10:43:51.431514+0000","last_peered":"2024-04-18T10:43:51.431514+0000","last_clean":"2024-04-18T10:43:51.431514+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:43:51.431514+0000","last_undegraded":"2024-04-18T10:43:51.431514+0000","last_fullsized":"2024-04-18T10:43:51.431514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:52:21.244414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.432661+0000","last_change":"2024-04-18T10:38:46.507263+0000","last_active":"2024-04-18T10:43:51.432661+0000","last_peered":"2024-04-18T10:43:51.432661+0000","last_clean":"2024-04-18T10:43:51.432661+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:43:51.432661+0000","last_undegraded":"2024-04-18T10:43:51.432661+0000","last_fullsized":"2024-04-18T10:43:51.432661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:09:47.927239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":503,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431820+0000","last_change":"2024-04-18T10:38:48.521319+0000","last_active":"2024-04-18T10:43:51.431820+0000","last_peered":"2024-04-18T10:43:51.431820+0000","last_clean":"2024-04-18T10:43:51.431820+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:43:51.431820+0000","last_undegraded":"2024-04-18T10:43:51.431820+0000","last_fullsized":"2024-04-18T10:43:51.431820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:08:27.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.444192+0000","last_change":"2024-04-18T10:38:46.520305+0000","last_active":"2024-04-18T10:43:51.444192+0000","last_peered":"2024-04-18T10:43:51.444192+0000","last_clean":"2024-04-18T10:43:51.444192+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:43:51.444192+0000","last_undegraded":"2024-04-18T10:43:51.444192+0000","last_fullsized":"2024-04-18T10:43:51.444192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.888537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":509,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.428542+0000","last_change":"2024-04-18T10:38:46.520635+0000","last_active":"2024-04-18T10:43:51.428542+0000","last_peered":"2024-04-18T10:43:51.428542+0000","last_clean":"2024-04-18T10:43:51.428542+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:43:51.428542+0000","last_undegraded":"2024-04-18T10:43:51.428542+0000","last_fullsized":"2024-04-18T10:43:51.428542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:25.599792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452935+0000","last_change":"2024-04-18T10:38:48.520598+0000","last_active":"2024-04-18T10:43:51.452935+0000","last_peered":"2024-04-18T10:43:51.452935+0000","last_clean":"2024-04-18T10:43:51.452935+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:43:51.452935+0000","last_undegraded":"2024-04-18T10:43:51.452935+0000","last_fullsized":"2024-04-18T10:43:51.452935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:57:15.523949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452998+0000","last_change":"2024-04-18T10:38:48.531599+0000","last_active":"2024-04-18T10:43:51.452998+0000","last_peered":"2024-04-18T10:43:51.452998+0000","last_clean":"2024-04-18T10:43:51.452998+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:43:51.452998+0000","last_undegraded":"2024-04-18T10:43:51.452998+0000","last_fullsized":"2024-04-18T10:43:51.452998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:07:18.483736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":448,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446075+0000","last_change":"2024-04-18T10:38:47.515586+0000","last_active":"2024-04-18T10:43:51.446075+0000","last_peered":"2024-04-18T10:43:51.446075+0000","last_clean":"2024-04-18T10:43:51.446075+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:43:51.446075+0000","last_undegraded":"2024-04-18T10:43:51.446075+0000","last_fullsized":"2024-04-18T10:43:51.446075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:38.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.415049+0000","last_change":"2024-04-18T10:38:46.523038+0000","last_active":"2024-04-18T10:43:51.415049+0000","last_peered":"2024-04-18T10:43:51.415049+0000","last_clean":"2024-04-18T10:43:51.415049+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:43:51.415049+0000","last_undegraded":"2024-04-18T10:43:51.415049+0000","last_fullsized":"2024-04-18T10:43:51.415049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:43:47.558311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":479,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445927+0000","last_change":"2024-04-18T10:39:29.508295+0000","last_active":"2024-04-18T10:43:51.445927+0000","last_peered":"2024-04-18T10:43:51.445927+0000","last_clean":"2024-04-18T10:43:51.445927+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:43:51.445927+0000","last_undegraded":"2024-04-18T10:43:51.445927+0000","last_fullsized":"2024-04-18T10:43:51.445927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:26:27.135112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":504,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.420651+0000","last_change":"2024-04-18T10:38:48.527369+0000","last_active":"2024-04-18T10:43:51.420651+0000","last_peered":"2024-04-18T10:43:51.420651+0000","last_clean":"2024-04-18T10:43:51.420651+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:43:51.420651+0000","last_undegraded":"2024-04-18T10:43:51.420651+0000","last_fullsized":"2024-04-18T10:43:51.420651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:05:08.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":469,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443622+0000","last_change":"2024-04-18T10:38:47.514997+0000","last_active":"2024-04-18T10:43:51.443622+0000","last_peered":"2024-04-18T10:43:51.443622+0000","last_clean":"2024-04-18T10:43:51.443622+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:43:51.443622+0000","last_undegraded":"2024-04-18T10:43:51.443622+0000","last_fullsized":"2024-04-18T10:43:51.443622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:28.335154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":526,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.430226+0000","last_change":"2024-04-18T10:38:48.518698+0000","last_active":"2024-04-18T10:43:51.430226+0000","last_peered":"2024-04-18T10:43:51.430226+0000","last_clean":"2024-04-18T10:43:51.430226+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:43:51.430226+0000","last_undegraded":"2024-04-18T10:43:51.430226+0000","last_fullsized":"2024-04-18T10:43:51.430226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:42.362882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":547,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452383+0000","last_change":"2024-04-18T10:38:48.535465+0000","last_active":"2024-04-18T10:43:51.452383+0000","last_peered":"2024-04-18T10:43:51.452383+0000","last_clean":"2024-04-18T10:43:51.452383+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:43:51.452383+0000","last_undegraded":"2024-04-18T10:43:51.452383+0000","last_fullsized":"2024-04-18T10:43:51.452383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:15:57.026266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":502,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452655+0000","last_change":"2024-04-18T10:38:48.536144+0000","last_active":"2024-04-18T10:43:51.452655+0000","last_peered":"2024-04-18T10:43:51.452655+0000","last_clean":"2024-04-18T10:43:51.452655+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:43:51.452655+0000","last_undegraded":"2024-04-18T10:43:51.452655+0000","last_fullsized":"2024-04-18T10:43:51.452655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:30:36.746569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":559,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.422268+0000","last_change":"2024-04-18T10:38:46.523917+0000","last_active":"2024-04-18T10:43:51.422268+0000","last_peered":"2024-04-18T10:43:51.422268+0000","last_clean":"2024-04-18T10:43:51.422268+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:43:51.422268+0000","last_undegraded":"2024-04-18T10:43:51.422268+0000","last_fullsized":"2024-04-18T10:43:51.422268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:50:08.234356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":485,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434563+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:43:51.434563+0000","last_peered":"2024-04-18T10:43:51.434563+0000","last_clean":"2024-04-18T10:43:51.434563+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:43:51.434563+0000","last_undegraded":"2024-04-18T10:43:51.434563+0000","last_fullsized":"2024-04-18T10:43:51.434563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:36:26.788947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":550,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452073+0000","last_change":"2024-04-18T10:38:48.532902+0000","last_active":"2024-04-18T10:43:51.452073+0000","last_peered":"2024-04-18T10:43:51.452073+0000","last_clean":"2024-04-18T10:43:51.452073+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:43:51.452073+0000","last_undegraded":"2024-04-18T10:43:51.452073+0000","last_fullsized":"2024-04-18T10:43:51.452073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:21:05.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":448,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438072+0000","last_change":"2024-04-18T10:39:29.641096+0000","last_active":"2024-04-18T10:43:51.438072+0000","last_peered":"2024-04-18T10:43:51.438072+0000","last_clean":"2024-04-18T10:43:51.438072+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:43:51.438072+0000","last_undegraded":"2024-04-18T10:43:51.438072+0000","last_fullsized":"2024-04-18T10:43:51.438072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:00:39.979232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":613,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448152+0000","last_change":"2024-04-18T10:38:47.515633+0000","last_active":"2024-04-18T10:43:51.448152+0000","last_peered":"2024-04-18T10:43:51.448152+0000","last_clean":"2024-04-18T10:43:51.448152+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:43:51.448152+0000","last_undegraded":"2024-04-18T10:43:51.448152+0000","last_fullsized":"2024-04-18T10:43:51.448152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:29:53.701977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438461+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:43:51.438461+0000","last_peered":"2024-04-18T10:43:51.438461+0000","last_clean":"2024-04-18T10:43:51.438461+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:43:51.438461+0000","last_undegraded":"2024-04-18T10:43:51.438461+0000","last_fullsized":"2024-04-18T10:43:51.438461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:17.044947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'598","reported_seq":632,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.436856+0000","last_change":"2024-04-18T10:38:47.515748+0000","last_active":"2024-04-18T10:43:48.436856+0000","last_peered":"2024-04-18T10:43:48.436856+0000","last_clean":"2024-04-18T10:43:48.436856+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:43:48.436856+0000","last_undegraded":"2024-04-18T10:43:48.436856+0000","last_fullsized":"2024-04-18T10:43:48.436856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:10:22.348842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":473,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453851+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:43:51.453851+0000","last_peered":"2024-04-18T10:43:51.453851+0000","last_clean":"2024-04-18T10:43:51.453851+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:43:51.453851+0000","last_undegraded":"2024-04-18T10:43:51.453851+0000","last_fullsized":"2024-04-18T10:43:51.453851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:21:57.410343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'444","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.399120+0000","last_change":"2024-04-18T10:38:48.531482+0000","last_active":"2024-04-18T10:43:47.399120+0000","last_peered":"2024-04-18T10:43:47.399120+0000","last_clean":"2024-04-18T10:43:47.399120+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:43:47.399120+0000","last_undegraded":"2024-04-18T10:43:47.399120+0000","last_fullsized":"2024-04-18T10:43:47.399120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:13:25.170588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":513,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434732+0000","last_change":"2024-04-18T10:38:46.523785+0000","last_active":"2024-04-18T10:43:51.434732+0000","last_peered":"2024-04-18T10:43:51.434732+0000","last_clean":"2024-04-18T10:43:51.434732+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:43:51.434732+0000","last_undegraded":"2024-04-18T10:43:51.434732+0000","last_fullsized":"2024-04-18T10:43:51.434732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:07:03.397909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'997","reported_seq":1041,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.375424+0000","last_change":"2024-04-18T10:38:48.528981+0000","last_active":"2024-04-18T10:43:49.375424+0000","last_peered":"2024-04-18T10:43:49.375424+0000","last_clean":"2024-04-18T10:43:49.375424+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:43:49.375424+0000","last_undegraded":"2024-04-18T10:43:49.375424+0000","last_fullsized":"2024-04-18T10:43:49.375424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:20:44.914726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":424,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446824+0000","last_change":"2024-04-18T10:39:29.505858+0000","last_active":"2024-04-18T10:43:51.446824+0000","last_peered":"2024-04-18T10:43:51.446824+0000","last_clean":"2024-04-18T10:43:51.446824+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:43:51.446824+0000","last_undegraded":"2024-04-18T10:43:51.446824+0000","last_fullsized":"2024-04-18T10:43:51.446824+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:40:31.972849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'63","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.417600+0000","last_change":"2024-04-18T10:38:48.521507+0000","last_active":"2024-04-18T10:43:45.417600+0000","last_peered":"2024-04-18T10:43:45.417600+0000","last_clean":"2024-04-18T10:43:45.417600+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:43:45.417600+0000","last_undegraded":"2024-04-18T10:43:45.417600+0000","last_fullsized":"2024-04-18T10:43:45.417600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:26:29.367671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449413+0000","last_change":"2024-04-18T10:38:48.528936+0000","last_active":"2024-04-18T10:43:51.449413+0000","last_peered":"2024-04-18T10:43:51.449413+0000","last_clean":"2024-04-18T10:43:51.449413+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:43:51.449413+0000","last_undegraded":"2024-04-18T10:43:51.449413+0000","last_fullsized":"2024-04-18T10:43:51.449413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:03:47.761656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'328","reported_seq":362,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.366130+0000","last_change":"2024-04-18T10:38:48.528847+0000","last_active":"2024-04-18T10:43:47.366130+0000","last_peered":"2024-04-18T10:43:47.366130+0000","last_clean":"2024-04-18T10:43:47.366130+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:43:47.366130+0000","last_undegraded":"2024-04-18T10:43:47.366130+0000","last_fullsized":"2024-04-18T10:43:47.366130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:52:18.159291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":630,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431598+0000","last_change":"2024-04-18T10:38:48.525442+0000","last_active":"2024-04-18T10:43:51.431598+0000","last_peered":"2024-04-18T10:43:51.431598+0000","last_clean":"2024-04-18T10:43:51.431598+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:43:51.431598+0000","last_undegraded":"2024-04-18T10:43:51.431598+0000","last_fullsized":"2024-04-18T10:43:51.431598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:01.154765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'120","reported_seq":160,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.495293+0000","last_change":"2024-04-18T10:38:48.529744+0000","last_active":"2024-04-18T10:43:48.495293+0000","last_peered":"2024-04-18T10:43:48.495293+0000","last_clean":"2024-04-18T10:43:48.495293+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:43:48.495293+0000","last_undegraded":"2024-04-18T10:43:48.495293+0000","last_fullsized":"2024-04-18T10:43:48.495293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:07.350838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":524,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451542+0000","last_change":"2024-04-18T10:38:48.530788+0000","last_active":"2024-04-18T10:43:51.451542+0000","last_peered":"2024-04-18T10:43:51.451542+0000","last_clean":"2024-04-18T10:43:51.451542+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:43:51.451542+0000","last_undegraded":"2024-04-18T10:43:51.451542+0000","last_fullsized":"2024-04-18T10:43:51.451542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:34.881473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'365","reported_seq":407,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.348545+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:43:51.348545+0000","last_peered":"2024-04-18T10:43:51.348545+0000","last_clean":"2024-04-18T10:43:51.348545+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:43:51.348545+0000","last_undegraded":"2024-04-18T10:43:51.348545+0000","last_fullsized":"2024-04-18T10:43:51.348545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:46.735369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453855+0000","last_change":"2024-04-18T10:38:48.528009+0000","last_active":"2024-04-18T10:43:51.453855+0000","last_peered":"2024-04-18T10:43:51.453855+0000","last_clean":"2024-04-18T10:43:51.453855+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:43:51.453855+0000","last_undegraded":"2024-04-18T10:43:51.453855+0000","last_fullsized":"2024-04-18T10:43:51.453855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:02.092332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'454","reported_seq":500,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.430066+0000","last_change":"2024-04-18T10:38:48.523218+0000","last_active":"2024-04-18T10:43:45.430066+0000","last_peered":"2024-04-18T10:43:45.430066+0000","last_clean":"2024-04-18T10:43:45.430066+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:43:45.430066+0000","last_undegraded":"2024-04-18T10:43:45.430066+0000","last_fullsized":"2024-04-18T10:43:45.430066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:15:59.389767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":430,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450572+0000","last_change":"2024-04-18T10:38:48.524990+0000","last_active":"2024-04-18T10:43:51.450572+0000","last_peered":"2024-04-18T10:43:51.450572+0000","last_clean":"2024-04-18T10:43:51.450572+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:43:51.450572+0000","last_undegraded":"2024-04-18T10:43:51.450572+0000","last_fullsized":"2024-04-18T10:43:51.450572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:13:40.543145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'52","reported_seq":88,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.445416+0000","last_change":"2024-04-18T10:38:48.530631+0000","last_active":"2024-04-18T10:43:46.445416+0000","last_peered":"2024-04-18T10:43:46.445416+0000","last_clean":"2024-04-18T10:43:46.445416+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:43:46.445416+0000","last_undegraded":"2024-04-18T10:43:46.445416+0000","last_fullsized":"2024-04-18T10:43:46.445416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:09:37.349194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":485,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438348+0000","last_change":"2024-04-18T10:38:48.526748+0000","last_active":"2024-04-18T10:43:51.438348+0000","last_peered":"2024-04-18T10:43:51.438348+0000","last_clean":"2024-04-18T10:43:51.438348+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:43:51.438348+0000","last_undegraded":"2024-04-18T10:43:51.438348+0000","last_fullsized":"2024-04-18T10:43:51.438348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:11.074933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":103,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.428382+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:43:45.428382+0000","last_peered":"2024-04-18T10:43:45.428382+0000","last_clean":"2024-04-18T10:43:45.428382+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:43:45.428382+0000","last_undegraded":"2024-04-18T10:43:45.428382+0000","last_fullsized":"2024-04-18T10:43:45.428382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:39:56.234231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445540+0000","last_change":"2024-04-18T10:38:48.522750+0000","last_active":"2024-04-18T10:43:51.445540+0000","last_peered":"2024-04-18T10:43:51.445540+0000","last_clean":"2024-04-18T10:43:51.445540+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:43:51.445540+0000","last_undegraded":"2024-04-18T10:43:51.445540+0000","last_fullsized":"2024-04-18T10:43:51.445540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:24:51.519415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'70","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367076+0000","last_change":"2024-04-18T10:38:46.524444+0000","last_active":"2024-04-18T10:43:47.367076+0000","last_peered":"2024-04-18T10:43:47.367076+0000","last_clean":"2024-04-18T10:43:47.367076+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:43:47.367076+0000","last_undegraded":"2024-04-18T10:43:47.367076+0000","last_fullsized":"2024-04-18T10:43:47.367076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:29:31.257203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448235+0000","last_change":"2024-04-18T10:38:48.524076+0000","last_active":"2024-04-18T10:43:51.448235+0000","last_peered":"2024-04-18T10:43:51.448235+0000","last_clean":"2024-04-18T10:43:51.448235+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:43:51.448235+0000","last_undegraded":"2024-04-18T10:43:51.448235+0000","last_fullsized":"2024-04-18T10:43:51.448235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:58.250235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'251","reported_seq":286,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.411625+0000","last_change":"2024-04-18T10:38:46.523417+0000","last_active":"2024-04-18T10:43:48.411625+0000","last_peered":"2024-04-18T10:43:48.411625+0000","last_clean":"2024-04-18T10:43:48.411625+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:43:48.411625+0000","last_undegraded":"2024-04-18T10:43:48.411625+0000","last_fullsized":"2024-04-18T10:43:48.411625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:02:29.079358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":476,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450051+0000","last_change":"2024-04-18T10:38:48.528752+0000","last_active":"2024-04-18T10:43:51.450051+0000","last_peered":"2024-04-18T10:43:51.450051+0000","last_clean":"2024-04-18T10:43:51.450051+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:43:51.450051+0000","last_undegraded":"2024-04-18T10:43:51.450051+0000","last_fullsized":"2024-04-18T10:43:51.450051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:31:20.382051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'340","reported_seq":383,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.428802+0000","last_change":"2024-04-18T10:38:47.516780+0000","last_active":"2024-04-18T10:43:45.428802+0000","last_peered":"2024-04-18T10:43:45.428802+0000","last_clean":"2024-04-18T10:43:45.428802+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:43:45.428802+0000","last_undegraded":"2024-04-18T10:43:45.428802+0000","last_fullsized":"2024-04-18T10:43:45.428802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:26.639180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":505,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450036+0000","last_change":"2024-04-18T10:38:48.537651+0000","last_active":"2024-04-18T10:43:51.450036+0000","last_peered":"2024-04-18T10:43:51.450036+0000","last_clean":"2024-04-18T10:43:51.450036+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:43:51.450036+0000","last_undegraded":"2024-04-18T10:43:51.450036+0000","last_fullsized":"2024-04-18T10:43:51.450036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:18.675030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'565","reported_seq":606,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.410751+0000","last_change":"2024-04-18T10:38:48.528245+0000","last_active":"2024-04-18T10:43:47.410751+0000","last_peered":"2024-04-18T10:43:47.410751+0000","last_clean":"2024-04-18T10:43:47.410751+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:43:47.410751+0000","last_undegraded":"2024-04-18T10:43:47.410751+0000","last_fullsized":"2024-04-18T10:43:47.410751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:52.532246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452030+0000","last_change":"2024-04-18T10:38:48.528767+0000","last_active":"2024-04-18T10:43:51.452030+0000","last_peered":"2024-04-18T10:43:51.452030+0000","last_clean":"2024-04-18T10:43:51.452030+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:43:51.452030+0000","last_undegraded":"2024-04-18T10:43:51.452030+0000","last_fullsized":"2024-04-18T10:43:51.452030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:31:30.566152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":96,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.379623+0000","last_change":"2024-04-18T10:38:48.527940+0000","last_active":"2024-04-18T10:43:47.379623+0000","last_peered":"2024-04-18T10:43:47.379623+0000","last_clean":"2024-04-18T10:43:47.379623+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:43:47.379623+0000","last_undegraded":"2024-04-18T10:43:47.379623+0000","last_fullsized":"2024-04-18T10:43:47.379623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:17:28.013331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":546,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.406957+0000","last_change":"2024-04-18T10:38:46.522705+0000","last_active":"2024-04-18T10:43:51.406957+0000","last_peered":"2024-04-18T10:43:51.406957+0000","last_clean":"2024-04-18T10:43:51.406957+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:43:51.406957+0000","last_undegraded":"2024-04-18T10:43:51.406957+0000","last_fullsized":"2024-04-18T10:43:51.406957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:23:44.645859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'170","reported_seq":215,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367215+0000","last_change":"2024-04-18T10:38:48.523093+0000","last_active":"2024-04-18T10:43:47.367215+0000","last_peered":"2024-04-18T10:43:47.367215+0000","last_clean":"2024-04-18T10:43:47.367215+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:43:47.367215+0000","last_undegraded":"2024-04-18T10:43:47.367215+0000","last_fullsized":"2024-04-18T10:43:47.367215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:20.206383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.422305+0000","last_change":"2024-04-18T10:38:48.528094+0000","last_active":"2024-04-18T10:43:51.422305+0000","last_peered":"2024-04-18T10:43:51.422305+0000","last_clean":"2024-04-18T10:43:51.422305+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:43:51.422305+0000","last_undegraded":"2024-04-18T10:43:51.422305+0000","last_fullsized":"2024-04-18T10:43:51.422305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:14:02.429215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'249","reported_seq":289,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.386774+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:43:47.386774+0000","last_peered":"2024-04-18T10:43:47.386774+0000","last_clean":"2024-04-18T10:43:47.386774+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:43:47.386774+0000","last_undegraded":"2024-04-18T10:43:47.386774+0000","last_fullsized":"2024-04-18T10:43:47.386774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:47:34.182153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453830+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:43:51.453830+0000","last_peered":"2024-04-18T10:43:51.453830+0000","last_clean":"2024-04-18T10:43:51.453830+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:43:51.453830+0000","last_undegraded":"2024-04-18T10:43:51.453830+0000","last_fullsized":"2024-04-18T10:43:51.453830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:08.173779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'62","reported_seq":99,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.389733+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:43:47.389733+0000","last_peered":"2024-04-18T10:43:47.389733+0000","last_clean":"2024-04-18T10:43:47.389733+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:43:47.389733+0000","last_undegraded":"2024-04-18T10:43:47.389733+0000","last_fullsized":"2024-04-18T10:43:47.389733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:04.645176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451809+0000","last_change":"2024-04-18T10:38:48.528656+0000","last_active":"2024-04-18T10:43:51.451809+0000","last_peered":"2024-04-18T10:43:51.451809+0000","last_clean":"2024-04-18T10:43:51.451809+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:43:51.451809+0000","last_undegraded":"2024-04-18T10:43:51.451809+0000","last_fullsized":"2024-04-18T10:43:51.451809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:53.065322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'492","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.368795+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:43:47.368795+0000","last_peered":"2024-04-18T10:43:47.368795+0000","last_clean":"2024-04-18T10:43:47.368795+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:43:47.368795+0000","last_undegraded":"2024-04-18T10:43:47.368795+0000","last_fullsized":"2024-04-18T10:43:47.368795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:06:10.188847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452204+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:43:51.452204+0000","last_peered":"2024-04-18T10:43:51.452204+0000","last_clean":"2024-04-18T10:43:51.452204+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:43:51.452204+0000","last_undegraded":"2024-04-18T10:43:51.452204+0000","last_fullsized":"2024-04-18T10:43:51.452204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:39:47.463040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.502609+0000","last_change":"2024-04-18T10:38:46.521667+0000","last_active":"2024-04-18T10:39:29.502609+0000","last_peered":"2024-04-18T10:39:29.502609+0000","last_clean":"2024-04-18T10:39:29.502609+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:39:29.502609+0000","last_undegraded":"2024-04-18T10:39:29.502609+0000","last_fullsized":"2024-04-18T10:39:29.502609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:58:33.365320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'347","reported_seq":382,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.458459+0000","last_change":"2024-04-18T10:38:48.518724+0000","last_active":"2024-04-18T10:43:48.458459+0000","last_peered":"2024-04-18T10:43:48.458459+0000","last_clean":"2024-04-18T10:43:48.458459+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:43:48.458459+0000","last_undegraded":"2024-04-18T10:43:48.458459+0000","last_fullsized":"2024-04-18T10:43:48.458459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:42.824622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":400,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451458+0000","last_change":"2024-04-18T10:38:48.529610+0000","last_active":"2024-04-18T10:43:51.451458+0000","last_peered":"2024-04-18T10:43:51.451458+0000","last_clean":"2024-04-18T10:43:51.451458+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:43:51.451458+0000","last_undegraded":"2024-04-18T10:43:51.451458+0000","last_fullsized":"2024-04-18T10:43:51.451458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:22:33.897416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639298+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:39:29.639298+0000","last_peered":"2024-04-18T10:39:29.639298+0000","last_clean":"2024-04-18T10:39:29.639298+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:39:29.639298+0000","last_undegraded":"2024-04-18T10:39:29.639298+0000","last_fullsized":"2024-04-18T10:39:29.639298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:33.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'70","reported_seq":109,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.443753+0000","last_change":"2024-04-18T10:38:47.513344+0000","last_active":"2024-04-18T10:43:48.443753+0000","last_peered":"2024-04-18T10:43:48.443753+0000","last_clean":"2024-04-18T10:43:48.443753+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:43:48.443753+0000","last_undegraded":"2024-04-18T10:43:48.443753+0000","last_fullsized":"2024-04-18T10:43:48.443753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:36:48.441734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":470,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445285+0000","last_change":"2024-04-18T10:38:47.515107+0000","last_active":"2024-04-18T10:43:51.445285+0000","last_peered":"2024-04-18T10:43:51.445285+0000","last_clean":"2024-04-18T10:43:51.445285+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:43:51.445285+0000","last_undegraded":"2024-04-18T10:43:51.445285+0000","last_fullsized":"2024-04-18T10:43:51.445285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:10:14.119655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.499561+0000","last_change":"2024-04-18T10:38:48.520896+0000","last_active":"2024-04-18T10:39:29.499561+0000","last_peered":"2024-04-18T10:39:29.499561+0000","last_clean":"2024-04-18T10:39:29.499561+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:39:29.499561+0000","last_undegraded":"2024-04-18T10:39:29.499561+0000","last_fullsized":"2024-04-18T10:39:29.499561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:57:03.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'433","reported_seq":468,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.414756+0000","last_change":"2024-04-18T10:38:47.519693+0000","last_active":"2024-04-18T10:43:46.414756+0000","last_peered":"2024-04-18T10:43:46.414756+0000","last_clean":"2024-04-18T10:43:46.414756+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:43:46.414756+0000","last_undegraded":"2024-04-18T10:43:46.414756+0000","last_fullsized":"2024-04-18T10:43:46.414756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:34.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":414,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443347+0000","last_change":"2024-04-18T10:38:46.520198+0000","last_active":"2024-04-18T10:43:51.443347+0000","last_peered":"2024-04-18T10:43:51.443347+0000","last_clean":"2024-04-18T10:43:51.443347+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:43:51.443347+0000","last_undegraded":"2024-04-18T10:43:51.443347+0000","last_fullsized":"2024-04-18T10:43:51.443347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:18:11.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639632+0000","last_change":"2024-04-18T10:38:48.522906+0000","last_active":"2024-04-18T10:39:29.639632+0000","last_peered":"2024-04-18T10:39:29.639632+0000","last_clean":"2024-04-18T10:39:29.639632+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:39:29.639632+0000","last_undegraded":"2024-04-18T10:39:29.639632+0000","last_fullsized":"2024-04-18T10:39:29.639632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:14.552416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'115","reported_seq":194,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.501781+0000","last_change":"2024-04-18T10:38:46.507608+0000","last_active":"2024-04-18T10:39:29.501781+0000","last_peered":"2024-04-18T10:39:29.501781+0000","last_clean":"2024-04-18T10:39:29.501781+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:39:29.501781+0000","last_undegraded":"2024-04-18T10:39:29.501781+0000","last_fullsized":"2024-04-18T10:39:29.501781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:46:55.362151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'526","reported_seq":563,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.404828+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:43:45.404828+0000","last_peered":"2024-04-18T10:43:45.404828+0000","last_clean":"2024-04-18T10:43:45.404828+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:43:45.404828+0000","last_undegraded":"2024-04-18T10:43:45.404828+0000","last_fullsized":"2024-04-18T10:43:45.404828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:23.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":541,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453345+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:43:51.453345+0000","last_peered":"2024-04-18T10:43:51.453345+0000","last_clean":"2024-04-18T10:43:51.453345+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:43:51.453345+0000","last_undegraded":"2024-04-18T10:43:51.453345+0000","last_fullsized":"2024-04-18T10:43:51.453345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:03.109484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639111+0000","last_change":"2024-04-18T10:38:48.529162+0000","last_active":"2024-04-18T10:39:29.639111+0000","last_peered":"2024-04-18T10:39:29.639111+0000","last_clean":"2024-04-18T10:39:29.639111+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:39:29.639111+0000","last_undegraded":"2024-04-18T10:39:29.639111+0000","last_fullsized":"2024-04-18T10:39:29.639111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:18:10.267046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'262","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.366459+0000","last_change":"2024-04-18T10:38:47.513300+0000","last_active":"2024-04-18T10:43:49.366459+0000","last_peered":"2024-04-18T10:43:49.366459+0000","last_clean":"2024-04-18T10:43:49.366459+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:43:49.366459+0000","last_undegraded":"2024-04-18T10:43:49.366459+0000","last_fullsized":"2024-04-18T10:43:49.366459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:38:14.658997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":523,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445123+0000","last_change":"2024-04-18T10:38:46.523777+0000","last_active":"2024-04-18T10:43:51.445123+0000","last_peered":"2024-04-18T10:43:51.445123+0000","last_clean":"2024-04-18T10:43:51.445123+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:43:51.445123+0000","last_undegraded":"2024-04-18T10:43:51.445123+0000","last_fullsized":"2024-04-18T10:43:51.445123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:03:13.518817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.640426+0000","last_change":"2024-04-18T10:38:48.526577+0000","last_active":"2024-04-18T10:39:29.640426+0000","last_peered":"2024-04-18T10:39:29.640426+0000","last_clean":"2024-04-18T10:39:29.640426+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:39:29.640426+0000","last_undegraded":"2024-04-18T10:39:29.640426+0000","last_fullsized":"2024-04-18T10:39:29.640426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:34:26.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":90,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.453422+0000","last_change":"2024-04-18T10:38:47.515422+0000","last_active":"2024-04-18T10:43:48.453422+0000","last_peered":"2024-04-18T10:43:48.453422+0000","last_clean":"2024-04-18T10:43:48.453422+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:43:48.453422+0000","last_undegraded":"2024-04-18T10:43:48.453422+0000","last_fullsized":"2024-04-18T10:43:48.453422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.811949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446175+0000","last_change":"2024-04-18T10:38:47.513292+0000","last_active":"2024-04-18T10:43:51.446175+0000","last_peered":"2024-04-18T10:43:51.446175+0000","last_clean":"2024-04-18T10:43:51.446175+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:43:51.446175+0000","last_undegraded":"2024-04-18T10:43:51.446175+0000","last_fullsized":"2024-04-18T10:43:51.446175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:51:35.308701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'62","reported_seq":103,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.431314+0000","last_change":"2024-04-18T10:38:48.525344+0000","last_active":"2024-04-18T10:43:48.431314+0000","last_peered":"2024-04-18T10:43:48.431314+0000","last_clean":"2024-04-18T10:43:48.431314+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:43:48.431314+0000","last_undegraded":"2024-04-18T10:43:48.431314+0000","last_fullsized":"2024-04-18T10:43:48.431314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:13:06.871047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.503660+0000","last_change":"2024-04-18T10:38:46.521665+0000","last_active":"2024-04-18T10:39:29.503660+0000","last_peered":"2024-04-18T10:39:29.503660+0000","last_clean":"2024-04-18T10:39:29.503660+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:39:29.503660+0000","last_undegraded":"2024-04-18T10:39:29.503660+0000","last_fullsized":"2024-04-18T10:39:29.503660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:14:41.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450142+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:43:51.450142+0000","last_peered":"2024-04-18T10:43:51.450142+0000","last_clean":"2024-04-18T10:43:51.450142+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:43:51.450142+0000","last_undegraded":"2024-04-18T10:43:51.450142+0000","last_fullsized":"2024-04-18T10:43:51.450142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:16.195736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.640642+0000","last_change":"2024-04-18T10:38:48.519133+0000","last_active":"2024-04-18T10:39:29.640642+0000","last_peered":"2024-04-18T10:39:29.640642+0000","last_clean":"2024-04-18T10:39:29.640642+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:39:29.640642+0000","last_undegraded":"2024-04-18T10:39:29.640642+0000","last_fullsized":"2024-04-18T10:39:29.640642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:47.684869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":120,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.430266+0000","last_change":"2024-04-18T10:38:46.523957+0000","last_active":"2024-04-18T10:43:48.430266+0000","last_peered":"2024-04-18T10:43:48.430266+0000","last_clean":"2024-04-18T10:43:48.430266+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:43:48.430266+0000","last_undegraded":"2024-04-18T10:43:48.430266+0000","last_fullsized":"2024-04-18T10:43:48.430266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:27:49.311603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":446,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451210+0000","last_change":"2024-04-18T10:38:48.520854+0000","last_active":"2024-04-18T10:43:51.451210+0000","last_peered":"2024-04-18T10:43:51.451210+0000","last_clean":"2024-04-18T10:43:51.451210+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:43:51.451210+0000","last_undegraded":"2024-04-18T10:43:51.451210+0000","last_fullsized":"2024-04-18T10:43:51.451210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:27.953816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'72","reported_seq":111,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.455510+0000","last_change":"2024-04-18T10:38:48.527898+0000","last_active":"2024-04-18T10:43:45.455510+0000","last_peered":"2024-04-18T10:43:45.455510+0000","last_clean":"2024-04-18T10:43:45.455510+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:43:45.455510+0000","last_undegraded":"2024-04-18T10:43:45.455510+0000","last_fullsized":"2024-04-18T10:43:45.455510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:35:58.649968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":441,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447405+0000","last_change":"2024-04-18T10:38:47.514434+0000","last_active":"2024-04-18T10:43:51.447405+0000","last_peered":"2024-04-18T10:43:51.447405+0000","last_clean":"2024-04-18T10:43:51.447405+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:43:51.447405+0000","last_undegraded":"2024-04-18T10:43:51.447405+0000","last_fullsized":"2024-04-18T10:43:51.447405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:22:40.288392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'343","reported_seq":383,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367534+0000","last_change":"2024-04-18T10:38:46.520352+0000","last_active":"2024-04-18T10:43:47.367534+0000","last_peered":"2024-04-18T10:43:47.367534+0000","last_clean":"2024-04-18T10:43:47.367534+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:43:47.367534+0000","last_undegraded":"2024-04-18T10:43:47.367534+0000","last_fullsized":"2024-04-18T10:43:47.367534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:55:53.724349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":409,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452635+0000","last_change":"2024-04-18T10:38:48.528181+0000","last_active":"2024-04-18T10:43:51.452635+0000","last_peered":"2024-04-18T10:43:51.452635+0000","last_clean":"2024-04-18T10:43:51.452635+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:43:51.452635+0000","last_undegraded":"2024-04-18T10:43:51.452635+0000","last_fullsized":"2024-04-18T10:43:51.452635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:38.920913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'287","reported_seq":332,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.414294+0000","last_change":"2024-04-18T10:38:48.526382+0000","last_active":"2024-04-18T10:43:47.414294+0000","last_peered":"2024-04-18T10:43:47.414294+0000","last_clean":"2024-04-18T10:43:47.414294+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:43:47.414294+0000","last_undegraded":"2024-04-18T10:43:47.414294+0000","last_fullsized":"2024-04-18T10:43:47.414294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:36:19.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":466,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445781+0000","last_change":"2024-04-18T10:39:29.508423+0000","last_active":"2024-04-18T10:43:51.445781+0000","last_peered":"2024-04-18T10:43:51.445781+0000","last_clean":"2024-04-18T10:43:51.445781+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:43:51.445781+0000","last_undegraded":"2024-04-18T10:43:51.445781+0000","last_fullsized":"2024-04-18T10:43:51.445781+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:19.178512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'110","reported_seq":147,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.412029+0000","last_change":"2024-04-18T10:38:48.521841+0000","last_active":"2024-04-18T10:43:48.412029+0000","last_peered":"2024-04-18T10:43:48.412029+0000","last_clean":"2024-04-18T10:43:48.412029+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:43:48.412029+0000","last_undegraded":"2024-04-18T10:43:48.412029+0000","last_fullsized":"2024-04-18T10:43:48.412029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:44:53.826636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":515,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449133+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:43:51.449133+0000","last_peered":"2024-04-18T10:43:51.449133+0000","last_clean":"2024-04-18T10:43:51.449133+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:43:51.449133+0000","last_undegraded":"2024-04-18T10:43:51.449133+0000","last_fullsized":"2024-04-18T10:43:51.449133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:44.601528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'99","reported_seq":132,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.354807+0000","last_change":"2024-04-18T10:38:46.523460+0000","last_active":"2024-04-18T10:43:47.354807+0000","last_peered":"2024-04-18T10:43:47.354807+0000","last_clean":"2024-04-18T10:43:47.354807+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:43:47.354807+0000","last_undegraded":"2024-04-18T10:43:47.354807+0000","last_fullsized":"2024-04-18T10:43:47.354807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:33.163273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":509,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448265+0000","last_change":"2024-04-18T10:38:47.514386+0000","last_active":"2024-04-18T10:43:51.448265+0000","last_peered":"2024-04-18T10:43:51.448265+0000","last_clean":"2024-04-18T10:43:51.448265+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:43:51.448265+0000","last_undegraded":"2024-04-18T10:43:51.448265+0000","last_fullsized":"2024-04-18T10:43:51.448265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:25.189215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":499,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446535+0000","last_change":"2024-04-18T10:38:47.515056+0000","last_active":"2024-04-18T10:43:51.446535+0000","last_peered":"2024-04-18T10:43:51.446535+0000","last_clean":"2024-04-18T10:43:51.446535+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:43:51.446535+0000","last_undegraded":"2024-04-18T10:43:51.446535+0000","last_fullsized":"2024-04-18T10:43:51.446535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:09:39.192070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":438,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447899+0000","last_change":"2024-04-18T10:39:29.506707+0000","last_active":"2024-04-18T10:43:51.447899+0000","last_peered":"2024-04-18T10:43:51.447899+0000","last_clean":"2024-04-18T10:43:51.447899+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:43:51.447899+0000","last_undegraded":"2024-04-18T10:43:51.447899+0000","last_fullsized":"2024-04-18T10:43:51.447899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:15:49.305625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":564,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.420162+0000","last_change":"2024-04-18T10:38:48.530823+0000","last_active":"2024-04-18T10:43:51.420162+0000","last_peered":"2024-04-18T10:43:51.420162+0000","last_clean":"2024-04-18T10:43:51.420162+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:43:51.420162+0000","last_undegraded":"2024-04-18T10:43:51.420162+0000","last_fullsized":"2024-04-18T10:43:51.420162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:17.039853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450748+0000","last_change":"2024-04-18T10:38:48.528090+0000","last_active":"2024-04-18T10:43:51.450748+0000","last_peered":"2024-04-18T10:43:51.450748+0000","last_clean":"2024-04-18T10:43:51.450748+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:43:51.450748+0000","last_undegraded":"2024-04-18T10:43:51.450748+0000","last_fullsized":"2024-04-18T10:43:51.450748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:18:27.052176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445610+0000","last_change":"2024-04-18T10:38:47.515405+0000","last_active":"2024-04-18T10:43:51.445610+0000","last_peered":"2024-04-18T10:43:51.445610+0000","last_clean":"2024-04-18T10:43:51.445610+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:43:51.445610+0000","last_undegraded":"2024-04-18T10:43:51.445610+0000","last_fullsized":"2024-04-18T10:43:51.445610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:31.550014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8497,"ondisk_log_size":8497,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953536,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.38,"15min":0.378},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":3.7429999999999999,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.36599999999999999,"15min":0.38300000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Apr 18 10:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.41799999999999998,"15min":0.42199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":2.8519999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.29899999999999999,"5min":0.373,"15min":0.38700000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.51600000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.307}]},{"osd":2,"last update":"Thu Apr 18 10:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.41899999999999998,"15min":0.437},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.44600000000000001,"15min":0.442},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":4.181,"5min":4.181,"15min":4.181},"last":0.39000000000000001}]}]},{"osd":2,"up_from":31,"seq":133143986240,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:42:53 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36399999999999999,"15min":0.36499999999999999},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.36699999999999999},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Apr 18 10:42:53 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.372,"15min":0.38700000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52600000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.38400000000000001,"15min":0.40000000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.52200000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Apr 18 10:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.39300000000000002,"15min":0.41099999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.42999999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.41899999999999998,"15min":0.42999999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40699999999999997}]}]},{"osd":0,"up_from":29,"seq":124554051649,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34999999999999998,"15min":0.33600000000000002},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.22},{"interface":"front","average":{"1min":0.314,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.216,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.628,"5min":1.224,"15min":1.224},"last":0.26200000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38400000000000001,"15min":0.35799999999999998},"min":{"1min":0.20599999999999999,"5min":0.19,"15min":0.19},"max":{"1min":1.514,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.254},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.22500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.59499999999999997,"5min":1.173,"15min":1.173},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.38300000000000001,"15min":0.41799999999999998},"min":{"1min":0.23200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.73599999999999999,"5min":1.204,"15min":1.204},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.51500000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.314}]}]},{"osd":1,"up_from":30,"seq":128849018945,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.34899999999999998},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.33900000000000002,"15min":0.35899999999999999},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.325,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.255}]},{"osd":3,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.98599999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.9970000000000001,"5min":2.173,"15min":2.173},"last":0.31900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:44:01.580 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:44:01.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.736+0000 7f320c9b8700 1 Processor -- start 2024-04-18T10:44:01.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.736+0000 7f320c9b8700 1 -- start start 2024-04-18T10:44:01.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320c9b8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3208063b00 0x7f320806da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320c9b8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 0x7f3208145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320c9b8700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32080aecf0 con 0x7f320806f020 2024-04-18T10:44:01.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320c9b8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3208063ed0 con 0x7f3208063b00 2024-04-18T10:44:01.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320c9b8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32080ae1c0 con 0x7f320806d0f0 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320659c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3208063b00 0x7f320806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f3206d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 0x7f3208145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f3205d9b700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f320806f020 0x7f3208131330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40430/0 (socket says 172.21.15.31:40430) 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f3205d9b700 1 -- 172.21.15.31:0/3907059301 learned_addr learned my addr 172.21.15.31:0/3907059301 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320559a700 1 -- 172.21.15.31:0/3907059301 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128628470 0 0) 0x7f31fc001110 con 0x7f320806f020 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320659c700 1 -- 172.21.15.31:0/3907059301 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 msgr2=0x7f3208145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320659c700 1 --2- 172.21.15.31:0/3907059301 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 0x7f3208145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320659c700 1 -- 172.21.15.31:0/3907059301 >> v1:172.21.15.31:6789/0 conn(0x7f320806f020 legacy=0x7f3208131330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320659c700 1 -- 172.21.15.31:0/3907059301 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32080ae460 con 0x7f3208063b00 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f3206d9d700 1 --2- 172.21.15.31:0/3907059301 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 0x7f3208145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320659c700 1 --2- 172.21.15.31:0/3907059301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3208063b00 0x7f320806da70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009910 tx=0x7f31f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=773528d12942c395 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320559a700 1 -- 172.21.15.31:0/3907059301 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f800b680 con 0x7f3208063b00 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320559a700 1 -- 172.21.15.31:0/3907059301 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f800b7e0 con 0x7f3208063b00 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.737+0000 7f320559a700 1 -- 172.21.15.31:0/3907059301 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f800bba0 con 0x7f3208063b00 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.738+0000 7f320c9b8700 1 -- 172.21.15.31:0/3907059301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3208063b00 msgr2=0x7f320806da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.738+0000 7f320c9b8700 1 --2- 172.21.15.31:0/3907059301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3208063b00 0x7f320806da70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009910 tx=0x7f31f80091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.738+0000 7f320c9b8700 1 -- 172.21.15.31:0/3907059301 shutdown_connections 2024-04-18T10:44:01.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.738+0000 7f320c9b8700 1 --2- 172.21.15.31:0/3907059301 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 0x7f3208145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.738+0000 7f320c9b8700 1 --2- 172.21.15.31:0/3907059301 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f3208063b00 0x7f320806da70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.738+0000 7f320c9b8700 1 -- 172.21.15.31:0/3907059301 >> 172.21.15.31:0/3907059301 conn(0x7f320806a390 msgr2=0x7f320806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:01.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.738+0000 7f320c9b8700 1 -- 172.21.15.31:0/3907059301 shutdown_connections 2024-04-18T10:44:01.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.738+0000 7f320c9b8700 1 -- 172.21.15.31:0/3907059301 wait complete. 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.739+0000 7f320c9b8700 1 Processor -- start 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.739+0000 7f320c9b8700 1 -- start start 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320c9b8700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3208063b00 0x7f3208137030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320c9b8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 0x7f3208135490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320c9b8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f320806f020 0x7f320814b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320c9b8700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3208136670 con 0x7f3208063b00 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320c9b8700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32081348f0 con 0x7f320806f020 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320c9b8700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f320814b2a0 con 0x7f320806d0f0 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3208063b00 0x7f3208137030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3208063b00 0x7f3208137030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40292/0 (socket says 172.21.15.31:40292) 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f3206d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f320806f020 0x7f320814b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320659c700 1 -- 172.21.15.31:0/4176394025 learned_addr learned my addr 172.21.15.31:0/4176394025 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f3205d9b700 1 --2- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 0x7f3208135490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f3206d9d700 1 -- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 msgr2=0x7f3208135490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f3206d9d700 1 --2- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 0x7f3208135490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f3206d9d700 1 -- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3208063b00 msgr2=0x7f3208137030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f3206d9d700 1 --2- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3208063b00 0x7f3208137030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f3206d9d700 1 -- 172.21.15.31:0/4176394025 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200009a20 con 0x7f320806f020 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f3206d9d700 1 --2- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f320806f020 0x7f320814b500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3200009f10 tx=0x7f320000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f31f67fc700 1 -- 172.21.15.31:0/4176394025 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320000cb70 con 0x7f320806f020 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f31f67fc700 1 -- 172.21.15.31:0/4176394025 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320000f040 con 0x7f320806f020 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f8009420 con 0x7f320806f020 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f31f67fc700 1 -- 172.21.15.31:0/4176394025 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200014480 con 0x7f320806f020 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.740+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3208136850 con 0x7f320806f020 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.741+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320806dd60 con 0x7f320806f020 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.741+0000 7f31f67fc700 1 -- 172.21.15.31:0/4176394025 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f3200003020 con 0x7f320806f020 2024-04-18T10:44:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.742+0000 7f31f67fc700 1 -- 172.21.15.31:0/4176394025 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f320005b8f0 con 0x7f320806f020 2024-04-18T10:44:01.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.745+0000 7f31f67fc700 1 -- 172.21.15.31:0/4176394025 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3200039b90 con 0x7f320806f020 2024-04-18T10:44:01.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.911+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3208134a30 con 0x7f320806f020 2024-04-18T10:44:01.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.911+0000 7f31f67fc700 1 -- 172.21.15.31:0/4176394025 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12029 (secure 0 0 0) 0x7f3200018020 con 0x7f320806f020 2024-04-18T10:44:01.911 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:44:01.912 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:40:40.522243+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":42,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":42,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2414209880":"2024-04-18T11:40:39.525564+0000","172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:44:01.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 >> v1:172.21.15.31:6816/46601 conn(0x7f31e8045ef0 legacy=0x7f31e80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f320806f020 msgr2=0x7f320814b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:01.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 --2- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f320806f020 0x7f320814b500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3200009f10 tx=0x7f320000b040 comp rx=0 tx=0).stop 2024-04-18T10:44:01.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 shutdown_connections 2024-04-18T10:44:01.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 --2- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f320806f020 0x7f320814b500 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 --2- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3208063b00 0x7f3208137030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 --2- 172.21.15.31:0/4176394025 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f320806d0f0 0x7f3208135490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:01.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 >> 172.21.15.31:0/4176394025 conn(0x7f320806a390 msgr2=0x7f3208068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:01.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 shutdown_connections 2024-04-18T10:44:01.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:01.913+0000 7f320c9b8700 1 -- 172.21.15.31:0/4176394025 wait complete. 2024-04-18T10:44:02.926 INFO:tasks.ceph:Scrubbing osd.0 2024-04-18T10:44:02.926 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-18T10:44:03.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.064+0000 7f2cedd82700 1 Processor -- start 2024-04-18T10:44:03.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.064+0000 7f2cedd82700 1 -- start start 2024-04-18T10:44:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2cedd82700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80b2eb0 0x7f2ce80a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2cedd82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 0x7f2ce8146990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2cedd82700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce80a4a70 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2cedd82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80a72a0 con 0x7f2ce80b0540 2024-04-18T10:44:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2cedd82700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce813f630 con 0x7f2ce80b2eb0 2024-04-18T10:44:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce77fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80b2eb0 0x7f2ce80a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce7fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 0x7f2ce8146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce6ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2ce80a4ed0 0x7f2ce813fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40440/0 (socket says 172.21.15.31:40440) 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce6ffd700 1 -- 172.21.15.31:0/1551013929 learned_addr learned my addr 172.21.15.31:0/1551013929 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce67fc700 1 -- 172.21.15.31:0/1551013929 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557578365 0 0) 0x7f2ce80a4a70 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce67fc700 1 -- 172.21.15.31:0/1551013929 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd4003570 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce77fe700 1 -- 172.21.15.31:0/1551013929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 msgr2=0x7f2ce8146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce77fe700 1 --2- 172.21.15.31:0/1551013929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 0x7f2ce8146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce77fe700 1 -- 172.21.15.31:0/1551013929 >> v1:172.21.15.31:6789/0 conn(0x7f2ce80a4ed0 legacy=0x7f2ce813fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce77fe700 1 -- 172.21.15.31:0/1551013929 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce80a3680 con 0x7f2ce80b2eb0 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce77fe700 1 --2- 172.21.15.31:0/1551013929 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80b2eb0 0x7f2ce80a6c60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009910 tx=0x7f2cd00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5418bf96f95e9bc server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.065+0000 7f2ce67fc700 1 -- 172.21.15.31:0/1551013929 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0011630 con 0x7f2ce80b2eb0 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2ce67fc700 1 -- 172.21.15.31:0/1551013929 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0011790 con 0x7f2ce80b2eb0 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2ce67fc700 1 -- 172.21.15.31:0/1551013929 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0011b30 con 0x7f2ce80b2eb0 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2cedd82700 1 -- 172.21.15.31:0/1551013929 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80b2eb0 msgr2=0x7f2ce80a6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2cedd82700 1 --2- 172.21.15.31:0/1551013929 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80b2eb0 0x7f2ce80a6c60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009910 tx=0x7f2cd00091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2cedd82700 1 -- 172.21.15.31:0/1551013929 shutdown_connections 2024-04-18T10:44:03.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2cedd82700 1 --2- 172.21.15.31:0/1551013929 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 0x7f2ce8146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2cedd82700 1 --2- 172.21.15.31:0/1551013929 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80b2eb0 0x7f2ce80a6c60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2cedd82700 1 -- 172.21.15.31:0/1551013929 >> 172.21.15.31:0/1551013929 conn(0x7f2ce806bf50 msgr2=0x7f2ce806de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:03.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2cedd82700 1 -- 172.21.15.31:0/1551013929 shutdown_connections 2024-04-18T10:44:03.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.066+0000 7f2cedd82700 1 -- 172.21.15.31:0/1551013929 wait complete. 2024-04-18T10:44:03.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.067+0000 7f2cedd82700 1 Processor -- start 2024-04-18T10:44:03.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.067+0000 7f2cedd82700 1 -- start start 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2cedd82700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80a4ed0 0x7f2ce8069e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2cedd82700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 0x7f2ce8151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2cedd82700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce80b2eb0 0x7f2ce8151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2cedd82700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce806a590 con 0x7f2ce80b2eb0 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2cedd82700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce806a3a0 con 0x7f2ce80b0540 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2cedd82700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8097090 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce77fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80a4ed0 0x7f2ce8069e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce6ffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 0x7f2ce8151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce77fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80a4ed0 0x7f2ce8069e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44304/0 (socket says 172.21.15.31:44304) 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce7fff700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce80b2eb0 0x7f2ce8151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce77fe700 1 -- 172.21.15.31:0/1511431032 learned_addr learned my addr 172.21.15.31:0/1511431032 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce77fe700 1 -- 172.21.15.31:0/1511431032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 msgr2=0x7f2ce8151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce77fe700 1 --2- 172.21.15.31:0/1511431032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 0x7f2ce8151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce77fe700 1 -- 172.21.15.31:0/1511431032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce80b2eb0 msgr2=0x7f2ce8151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce77fe700 1 --2- 172.21.15.31:0/1511431032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce80b2eb0 0x7f2ce8151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce77fe700 1 -- 172.21.15.31:0/1511431032 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0009420 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce7fff700 1 --2- 172.21.15.31:0/1511431032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ce80b2eb0 0x7f2ce8151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce6ffd700 1 --2- 172.21.15.31:0/1511431032 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2ce80b0540 0x7f2ce8151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.068+0000 7f2ce77fe700 1 --2- 172.21.15.31:0/1511431032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80a4ed0 0x7f2ce8069e60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00091e0 tx=0x7f2cd0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.069+0000 7f2cdf7fe700 1 -- 172.21.15.31:0/1511431032 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0000d10 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.069+0000 7f2cdf7fe700 1 -- 172.21.15.31:0/1511431032 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0011900 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.069+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce8097520 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.069+0000 7f2cdf7fe700 1 -- 172.21.15.31:0/1511431032 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0025420 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.069+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce80af0a0 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.069+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ce8071800 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.070+0000 7f2cdf7fe700 1 -- 172.21.15.31:0/1511431032 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f2cd0023070 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.070+0000 7f2cdf7fe700 1 -- 172.21.15.31:0/1511431032 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f2cd005c440 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.070+0000 7f2cdf7fe700 1 -- 172.21.15.31:0/1511431032 --> v1:172.21.15.31:6800/49212 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2cc8052ba0 con 0x7f2cc804eea0 2024-04-18T10:44:03.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.070+0000 7f2cdf7fe700 1 -- 172.21.15.31:0/1511431032 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cd005ea80 con 0x7f2ce80a4ed0 2024-04-18T10:44:03.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.071+0000 7f2cdf7fe700 1 -- 172.21.15.31:0/1511431032 <== osd.0 v1:172.21.15.31:6800/49212 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f2cc8052ba0 con 0x7f2cc804eea0 2024-04-18T10:44:03.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.085+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 --> v1:172.21.15.31:6800/49212 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ce80b1d40 con 0x7f2cc804eea0 2024-04-18T10:44:03.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.085+0000 7f2cdf7fe700 1 -- 172.21.15.31:0/1511431032 <== osd.0 v1:172.21.15.31:6800/49212 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f2ce80b1d40 con 0x7f2cc804eea0 2024-04-18T10:44:03.085 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:44:03.085 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T10:44:03.086 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:44:03.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.086+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 >> v1:172.21.15.31:6800/49212 conn(0x7f2cc804eea0 legacy=0x7f2cc8051330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.086+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 >> v1:172.21.15.31:6816/46601 conn(0x7f2cc8045ef0 legacy=0x7f2cc80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.086+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80a4ed0 msgr2=0x7f2ce8069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.086+0000 7f2cedd82700 1 --2- 172.21.15.31:0/1511431032 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2ce80a4ed0 0x7f2ce8069e60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00091e0 tx=0x7f2cd0017000 comp rx=0 tx=0).stop 2024-04-18T10:44:03.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.086+0000 7f2ce7fff700 1 -- 172.21.15.31:0/1511431032 reap_dead start 2024-04-18T10:44:03.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.086+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 shutdown_connections 2024-04-18T10:44:03.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.086+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 >> 172.21.15.31:0/1511431032 conn(0x7f2ce806bf50 msgr2=0x7f2ce806f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:03.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.086+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 shutdown_connections 2024-04-18T10:44:03.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.086+0000 7f2cedd82700 1 -- 172.21.15.31:0/1511431032 wait complete. 2024-04-18T10:44:03.097 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-18T10:44:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.218+0000 7fd441f6a700 1 Processor -- start 2024-04-18T10:44:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.218+0000 7fd441f6a700 1 -- start start 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd441f6a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd441f6a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c0a30c0 0x7fd43c13ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd441f6a700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd43c0a59e0 con 0x7fd43c13ef60 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd441f6a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0a3ad0 con 0x7fd43c069450 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd441f6a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c0a57c0 con 0x7fd43c0a30c0 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43affd700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c0a30c0 0x7fd43c13ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43bfff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd43c13ef60 0x7fd43c06d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40450/0 (socket says 172.21.15.31:40450) 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43bfff700 1 -- 172.21.15.31:0/3207657310 learned_addr learned my addr 172.21.15.31:0/3207657310 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43a7fc700 1 -- 172.21.15.31:0/3207657310 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105817743 0 0) 0x7fd43c0a59e0 con 0x7fd43c13ef60 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43b7fe700 1 -- 172.21.15.31:0/3207657310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c0a30c0 msgr2=0x7fd43c13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43b7fe700 1 --2- 172.21.15.31:0/3207657310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c0a30c0 0x7fd43c13ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43b7fe700 1 -- 172.21.15.31:0/3207657310 >> v1:172.21.15.31:6789/0 conn(0x7fd43c13ef60 legacy=0x7fd43c06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43b7fe700 1 -- 172.21.15.31:0/3207657310 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0a4bc0 con 0x7fd43c069450 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.219+0000 7fd43affd700 1 --2- 172.21.15.31:0/3207657310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c0a30c0 0x7fd43c13ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd43b7fe700 1 --2- 172.21.15.31:0/3207657310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c0a2b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd424009940 tx=0x7fd4240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b75456ab26c9238 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd43a7fc700 1 -- 172.21.15.31:0/3207657310 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400b670 con 0x7fd43c069450 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd43a7fc700 1 -- 172.21.15.31:0/3207657310 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400b7d0 con 0x7fd43c069450 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd43a7fc700 1 -- 172.21.15.31:0/3207657310 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400bb90 con 0x7fd43c069450 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd441f6a700 1 -- 172.21.15.31:0/3207657310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 msgr2=0x7fd43c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd441f6a700 1 --2- 172.21.15.31:0/3207657310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c0a2b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd424009940 tx=0x7fd4240091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd441f6a700 1 -- 172.21.15.31:0/3207657310 shutdown_connections 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd441f6a700 1 --2- 172.21.15.31:0/3207657310 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c0a2b80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd441f6a700 1 --2- 172.21.15.31:0/3207657310 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c0a30c0 0x7fd43c13ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd441f6a700 1 -- 172.21.15.31:0/3207657310 >> 172.21.15.31:0/3207657310 conn(0x7fd43c06ae80 msgr2=0x7fd43c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:03.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd441f6a700 1 -- 172.21.15.31:0/3207657310 shutdown_connections 2024-04-18T10:44:03.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.220+0000 7fd441f6a700 1 -- 172.21.15.31:0/3207657310 wait complete. 2024-04-18T10:44:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.221+0000 7fd441f6a700 1 Processor -- start 2024-04-18T10:44:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.221+0000 7fd441f6a700 1 -- start start 2024-04-18T10:44:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd441f6a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c13a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd441f6a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c0a30c0 0x7fd43c14f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd441f6a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c13ef60 0x7fd43c14f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd441f6a700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c137fe0 con 0x7fd43c0a30c0 2024-04-18T10:44:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd441f6a700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c1378f0 con 0x7fd43c069450 2024-04-18T10:44:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd441f6a700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c138870 con 0x7fd43c13ef60 2024-04-18T10:44:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c0a30c0 0x7fd43c14f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c13a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43bfff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c13ef60 0x7fd43c14f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43affd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c0a30c0 0x7fd43c14f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40300/0 (socket says 172.21.15.31:40300) 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43affd700 1 -- 172.21.15.31:0/4181124062 learned_addr learned my addr 172.21.15.31:0/4181124062 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43b7fe700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c13a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38406/0 (socket says 172.21.15.31:38406) 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43affd700 1 -- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c13ef60 msgr2=0x7fd43c14f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43affd700 1 --2- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c13ef60 0x7fd43c14f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43affd700 1 -- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 msgr2=0x7fd43c13a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43affd700 1 --2- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c13a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43affd700 1 -- 172.21.15.31:0/4181124062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c009420 con 0x7fd43c0a30c0 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43b7fe700 1 --2- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c13a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.222+0000 7fd43affd700 1 --2- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c0a30c0 0x7fd43c14f240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00ec80 tx=0x7fd42c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.223+0000 7fd4337fe700 1 -- 172.21.15.31:0/4181124062 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c00c920 con 0x7fd43c0a30c0 2024-04-18T10:44:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.223+0000 7fd4337fe700 1 -- 172.21.15.31:0/4181124062 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42c00ca80 con 0x7fd43c0a30c0 2024-04-18T10:44:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.223+0000 7fd4337fe700 1 -- 172.21.15.31:0/4181124062 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42c00ce00 con 0x7fd43c0a30c0 2024-04-18T10:44:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.223+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd424009420 con 0x7fd43c0a30c0 2024-04-18T10:44:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.223+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43c137dd0 con 0x7fd43c0a30c0 2024-04-18T10:44:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.224+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43c0651b0 con 0x7fd43c0a30c0 2024-04-18T10:44:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.224+0000 7fd4337fe700 1 -- 172.21.15.31:0/4181124062 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fd42c013680 con 0x7fd43c0a30c0 2024-04-18T10:44:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.224+0000 7fd4337fe700 1 -- 172.21.15.31:0/4181124062 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fd42c05b490 con 0x7fd43c0a30c0 2024-04-18T10:44:03.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.227+0000 7fd4337fe700 1 -- 172.21.15.31:0/4181124062 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd42c039730 con 0x7fd43c0a30c0 2024-04-18T10:44:03.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.390+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd43c0b1280 con 0x7fd41c045f20 2024-04-18T10:44:03.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.391+0000 7fd4337fe700 1 -- 172.21.15.31:0/4181124062 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7fd43c0b1280 con 0x7fd41c045f20 2024-04-18T10:44:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 >> v1:172.21.15.31:6816/46601 conn(0x7fd41c045f20 legacy=0x7fd41c0483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c0a30c0 msgr2=0x7fd43c14f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 --2- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c0a30c0 0x7fd43c14f240 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00ec80 tx=0x7fd42c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 shutdown_connections 2024-04-18T10:44:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 --2- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fd43c13ef60 0x7fd43c14f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 --2- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fd43c069450 0x7fd43c13a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 --2- 172.21.15.31:0/4181124062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd43c0a30c0 0x7fd43c14f240 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 >> 172.21.15.31:0/4181124062 conn(0x7fd43c06ae80 msgr2=0x7fd43c0b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 shutdown_connections 2024-04-18T10:44:03.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.393+0000 7fd441f6a700 1 -- 172.21.15.31:0/4181124062 wait complete. 2024-04-18T10:44:03.395 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2024-04-18T10:44:03.404 INFO:tasks.ceph:Scrubbing osd.1 2024-04-18T10:44:03.404 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-18T10:44:03.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.529+0000 7fec62702700 1 Processor -- start 2024-04-18T10:44:03.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.529+0000 7fec62702700 1 -- start start 2024-04-18T10:44:03.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec62702700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec5c068340 0x7fec5c13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec62702700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec62702700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0a3fd0 con 0x7fec5c0a6cf0 2024-04-18T10:44:03.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec62702700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c140770 con 0x7fec5c068340 2024-04-18T10:44:03.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec62702700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0a39b0 con 0x7fec5c0a48f0 2024-04-18T10:44:03.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec5bfff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec5c068340 0x7fec5c13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec5b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec60c9f700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fec5c0a6cf0 0x7fec5c06ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40456/0 (socket says 172.21.15.31:40456) 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec60c9f700 1 -- 172.21.15.31:0/5272004 learned_addr learned my addr 172.21.15.31:0/5272004 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec5bfff700 1 -- 172.21.15.31:0/5272004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 msgr2=0x7fec5c140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec5bfff700 1 --2- 172.21.15.31:0/5272004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec5bfff700 1 -- 172.21.15.31:0/5272004 >> v1:172.21.15.31:6789/0 conn(0x7fec5c0a6cf0 legacy=0x7fec5c06ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec5affd700 1 -- 172.21.15.31:0/5272004 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131694598 0 0) 0x7fec5c0a3fd0 con 0x7fec5c0a6cf0 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec5bfff700 1 -- 172.21.15.31:0/5272004 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0a72c0 con 0x7fec5c068340 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.530+0000 7fec5b7fe700 1 --2- 172.21.15.31:0/5272004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec5bfff700 1 --2- 172.21.15.31:0/5272004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c068340 0x7fec5c13fcf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009910 tx=0x7fec4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46ed4499eae6423 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec5affd700 1 -- 172.21.15.31:0/5272004 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00b640 con 0x7fec5c068340 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec5affd700 1 -- 172.21.15.31:0/5272004 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00b7a0 con 0x7fec5c068340 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec5affd700 1 -- 172.21.15.31:0/5272004 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c00bb60 con 0x7fec5c068340 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec62702700 1 -- 172.21.15.31:0/5272004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c068340 msgr2=0x7fec5c13fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec62702700 1 --2- 172.21.15.31:0/5272004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c068340 0x7fec5c13fcf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009910 tx=0x7fec4c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec62702700 1 -- 172.21.15.31:0/5272004 shutdown_connections 2024-04-18T10:44:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec62702700 1 --2- 172.21.15.31:0/5272004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c068340 0x7fec5c13fcf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec62702700 1 --2- 172.21.15.31:0/5272004 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec62702700 1 -- 172.21.15.31:0/5272004 >> 172.21.15.31:0/5272004 conn(0x7fec5c06bd50 msgr2=0x7fec5c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec62702700 1 -- 172.21.15.31:0/5272004 shutdown_connections 2024-04-18T10:44:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.531+0000 7fec62702700 1 -- 172.21.15.31:0/5272004 wait complete. 2024-04-18T10:44:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.532+0000 7fec62702700 1 Processor -- start 2024-04-18T10:44:03.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.532+0000 7fec62702700 1 -- start start 2024-04-18T10:44:03.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec62702700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec5c068340 0x7fec5c0a81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec62702700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c136800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec62702700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c0a6cf0 0x7fec5c136d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec62702700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c137aa0 con 0x7fec5c0a6cf0 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec62702700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c137280 con 0x7fec5c068340 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec62702700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0a9dd0 con 0x7fec5c0a48f0 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec5c068340 0x7fec5c0a81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c136800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec60c9f700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c0a6cf0 0x7fec5c136d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5bfff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec5c068340 0x7fec5c0a81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38418/0 (socket says 172.21.15.31:38418) 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5bfff700 1 -- 172.21.15.31:0/454838689 learned_addr learned my addr 172.21.15.31:0/454838689 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5b7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c136800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44346/0 (socket says 172.21.15.31:44346) 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5bfff700 1 -- 172.21.15.31:0/454838689 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 msgr2=0x7fec5c136800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5bfff700 1 --2- 172.21.15.31:0/454838689 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c136800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5bfff700 1 -- 172.21.15.31:0/454838689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c0a6cf0 msgr2=0x7fec5c136d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5bfff700 1 --2- 172.21.15.31:0/454838689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c0a6cf0 0x7fec5c136d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5bfff700 1 -- 172.21.15.31:0/454838689 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44009420 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5b7fe700 1 --2- 172.21.15.31:0/454838689 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fec5c0a48f0 0x7fec5c136800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.533+0000 7fec5bfff700 1 --2- 172.21.15.31:0/454838689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec5c068340 0x7fec5c0a81a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fec4c002fe0 tx=0x7fec4c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.534+0000 7fec53fff700 1 -- 172.21.15.31:0/454838689 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c01f070 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.534+0000 7fec53fff700 1 -- 172.21.15.31:0/454838689 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c00b910 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.534+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c009420 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.534+0000 7fec53fff700 1 -- 172.21.15.31:0/454838689 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c011420 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.534+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c1376f0 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.534+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec5c071800 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.535+0000 7fec53fff700 1 -- 172.21.15.31:0/454838689 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fec4c0117b0 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.535+0000 7fec53fff700 1 -- 172.21.15.31:0/454838689 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fec4c05c260 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.535+0000 7fec53fff700 1 -- 172.21.15.31:0/454838689 --> v1:172.21.15.31:6804/49310 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec3c052d10 con 0x7fec3c04f010 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.535+0000 7fec53fff700 1 -- 172.21.15.31:0/454838689 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec4c05e8a0 con 0x7fec5c068340 2024-04-18T10:44:03.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.536+0000 7fec53fff700 1 -- 172.21.15.31:0/454838689 <== osd.1 v1:172.21.15.31:6804/49310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fec3c052d10 con 0x7fec3c04f010 2024-04-18T10:44:03.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.550+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 --> v1:172.21.15.31:6804/49310 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fec5c0afc50 con 0x7fec3c04f010 2024-04-18T10:44:03.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.550+0000 7fec53fff700 1 -- 172.21.15.31:0/454838689 <== osd.1 v1:172.21.15.31:6804/49310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7fec5c0afc50 con 0x7fec3c04f010 2024-04-18T10:44:03.550 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:44:03.550 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T10:44:03.551 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:44:03.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.550+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 >> v1:172.21.15.31:6804/49310 conn(0x7fec3c04f010 legacy=0x7fec3c0514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.550+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 >> v1:172.21.15.31:6816/46601 conn(0x7fec3c045ef0 legacy=0x7fec3c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.551+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec5c068340 msgr2=0x7fec5c0a81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.551+0000 7fec62702700 1 --2- 172.21.15.31:0/454838689 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fec5c068340 0x7fec5c0a81a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fec4c002fe0 tx=0x7fec4c017000 comp rx=0 tx=0).stop 2024-04-18T10:44:03.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.551+0000 7fec60c9f700 1 -- 172.21.15.31:0/454838689 reap_dead start 2024-04-18T10:44:03.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.551+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 shutdown_connections 2024-04-18T10:44:03.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.551+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 >> 172.21.15.31:0/454838689 conn(0x7fec5c06bd50 msgr2=0x7fec5c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:03.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.551+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 shutdown_connections 2024-04-18T10:44:03.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.551+0000 7fec62702700 1 -- 172.21.15.31:0/454838689 wait complete. 2024-04-18T10:44:03.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-18T10:44:03.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.685+0000 7febc8b5b700 1 Processor -- start 2024-04-18T10:44:03.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.685+0000 7febc8b5b700 1 -- start start 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc8b5b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7febc4069450 0x7febc406f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc8b5b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc406e050 0x7febc406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc8b5b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc40a2960 0x7febc40a2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc8b5b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc40a3720 con 0x7febc4069450 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc8b5b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc406ea20 con 0x7febc406e050 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc8b5b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febc40a2420 con 0x7febc40a2960 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7febc4069450 0x7febc406f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc1d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc406e050 0x7febc406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc2d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc40a2960 0x7febc40a2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc259c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7febc4069450 0x7febc406f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40322/0 (socket says 172.21.15.31:40322) 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc1d9b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc406e050 0x7febc406e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38420/0 (socket says 172.21.15.31:38420) 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc259c700 1 -- 172.21.15.31:0/108263707 learned_addr learned my addr 172.21.15.31:0/108263707 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc1d9b700 1 -- 172.21.15.31:0/108263707 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc40a2960 msgr2=0x7febc40a2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc1d9b700 1 --2- 172.21.15.31:0/108263707 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc40a2960 0x7febc40a2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc1d9b700 1 -- 172.21.15.31:0/108263707 >> v2:172.21.15.31:3300/0 conn(0x7febc4069450 msgr2=0x7febc406f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc1d9b700 1 --2- 172.21.15.31:0/108263707 >> v2:172.21.15.31:3300/0 conn(0x7febc4069450 0x7febc406f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc1d9b700 1 -- 172.21.15.31:0/108263707 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc406ee90 con 0x7febc406e050 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc259c700 1 --2- 172.21.15.31:0/108263707 >> v2:172.21.15.31:3300/0 conn(0x7febc4069450 0x7febc406f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc1d9b700 1 --2- 172.21.15.31:0/108263707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc406e050 0x7febc406e440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7febb80098e0 tx=0x7febb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8bfff71873aac30 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc159a700 1 -- 172.21.15.31:0/108263707 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8011630 con 0x7febc406e050 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc159a700 1 -- 172.21.15.31:0/108263707 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb8011790 con 0x7febc406e050 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.686+0000 7febc159a700 1 -- 172.21.15.31:0/108263707 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8011b30 con 0x7febc406e050 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.687+0000 7febc8b5b700 1 -- 172.21.15.31:0/108263707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc406e050 msgr2=0x7febc406e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.687+0000 7febc8b5b700 1 --2- 172.21.15.31:0/108263707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc406e050 0x7febc406e440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7febb80098e0 tx=0x7febb80091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.687+0000 7febc8b5b700 1 -- 172.21.15.31:0/108263707 shutdown_connections 2024-04-18T10:44:03.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.687+0000 7febc8b5b700 1 --2- 172.21.15.31:0/108263707 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc40a2960 0x7febc40a2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.687+0000 7febc8b5b700 1 --2- 172.21.15.31:0/108263707 >> v2:172.21.15.31:3300/0 conn(0x7febc4069450 0x7febc406f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.687+0000 7febc8b5b700 1 --2- 172.21.15.31:0/108263707 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc406e050 0x7febc406e440 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.687+0000 7febc8b5b700 1 -- 172.21.15.31:0/108263707 >> 172.21.15.31:0/108263707 conn(0x7febc406cd10 msgr2=0x7febc4068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:03.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.687+0000 7febc8b5b700 1 -- 172.21.15.31:0/108263707 shutdown_connections 2024-04-18T10:44:03.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.687+0000 7febc8b5b700 1 -- 172.21.15.31:0/108263707 wait complete. 2024-04-18T10:44:03.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.688+0000 7febc8b5b700 1 Processor -- start 2024-04-18T10:44:03.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.688+0000 7febc8b5b700 1 -- start start 2024-04-18T10:44:03.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc8b5b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc4069450 0x7febc4098020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc8b5b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc406e050 0x7febc4096ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc8b5b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febc40a2960 0x7febc41512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc8b5b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc4097840 con 0x7febc40a2960 2024-04-18T10:44:03.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc8b5b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc4098560 con 0x7febc4069450 2024-04-18T10:44:03.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc8b5b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febc40a8f60 con 0x7febc406e050 2024-04-18T10:44:03.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc4069450 0x7febc4098020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc259c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc4069450 0x7febc4098020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38422/0 (socket says 172.21.15.31:38422) 2024-04-18T10:44:03.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc259c700 1 -- 172.21.15.31:0/3122781285 learned_addr learned my addr 172.21.15.31:0/3122781285 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc1d9b700 1 --2- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc406e050 0x7febc4096ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc2d9d700 1 --2- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febc40a2960 0x7febc41512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc259c700 1 -- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc406e050 msgr2=0x7febc4096ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc259c700 1 --2- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc406e050 0x7febc4096ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc259c700 1 -- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febc40a2960 msgr2=0x7febc41512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc259c700 1 --2- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febc40a2960 0x7febc41512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc259c700 1 -- 172.21.15.31:0/3122781285 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb40094f0 con 0x7febc4069450 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc259c700 1 --2- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc4069450 0x7febc4098020 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7febb400ec50 tx=0x7febb4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febb27fc700 1 -- 172.21.15.31:0/3122781285 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400c850 con 0x7febc4069450 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febb27fc700 1 -- 172.21.15.31:0/3122781285 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb400c9b0 con 0x7febc4069450 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb8009420 con 0x7febc4069450 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febb27fc700 1 -- 172.21.15.31:0/3122781285 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400cd50 con 0x7febc4069450 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.689+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc4097020 con 0x7febc4069450 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.690+0000 7febb27fc700 1 -- 172.21.15.31:0/3122781285 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7febb4013680 con 0x7febc4069450 2024-04-18T10:44:03.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.690+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc40986d0 con 0x7febc4069450 2024-04-18T10:44:03.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.691+0000 7febb27fc700 1 -- 172.21.15.31:0/3122781285 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7febb405b420 con 0x7febc4069450 2024-04-18T10:44:03.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.694+0000 7febb27fc700 1 -- 172.21.15.31:0/3122781285 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7febb40396c0 con 0x7febc4069450 2024-04-18T10:44:03.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.857+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7febc4065180 con 0x7feba4045ef0 2024-04-18T10:44:03.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.857+0000 7febb27fc700 1 -- 172.21.15.31:0/3122781285 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7febc4065180 con 0x7feba4045ef0 2024-04-18T10:44:03.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 >> v1:172.21.15.31:6816/46601 conn(0x7feba4045ef0 legacy=0x7feba40483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc4069450 msgr2=0x7febc4098020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 --2- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc4069450 0x7febc4098020 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7febb400ec50 tx=0x7febb4009250 comp rx=0 tx=0).stop 2024-04-18T10:44:03.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 shutdown_connections 2024-04-18T10:44:03.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 --2- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7febc40a2960 0x7febc41512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 --2- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7febc4069450 0x7febc4098020 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 --2- 172.21.15.31:0/3122781285 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7febc406e050 0x7febc4096ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 >> 172.21.15.31:0/3122781285 conn(0x7febc406cd10 msgr2=0x7febc413ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:03.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 shutdown_connections 2024-04-18T10:44:03.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.859+0000 7febc8b5b700 1 -- 172.21.15.31:0/3122781285 wait complete. 2024-04-18T10:44:03.860 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2024-04-18T10:44:03.870 INFO:tasks.ceph:Scrubbing osd.2 2024-04-18T10:44:03.871 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-18T10:44:03.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.994+0000 7f91d41a0700 1 Processor -- start 2024-04-18T10:44:03.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d41a0700 1 -- start start 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d41a0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc0b1e50 0x7f91cc0a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d41a0700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91cc0a2910 0x7f91cc13ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d41a0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc13f1d0 0x7f91cc06d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d41a0700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc0a37e0 con 0x7f91cc0a2910 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d41a0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc06f1f0 con 0x7f91cc0b1e50 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d41a0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc13e7a0 con 0x7f91cc13f1d0 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d173b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91cc0a2910 0x7f91cc13ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d273d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc13f1d0 0x7f91cc06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d1f3c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc0b1e50 0x7f91cc0a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d173b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91cc0a2910 0x7f91cc13ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40330/0 (socket says 172.21.15.31:40330) 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d273d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc13f1d0 0x7f91cc06d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44368/0 (socket says 172.21.15.31:44368) 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.995+0000 7f91d173b700 1 -- 172.21.15.31:0/3473854225 learned_addr learned my addr 172.21.15.31:0/3473854225 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:03.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d173b700 1 -- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc13f1d0 msgr2=0x7f91cc06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d173b700 1 --2- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc13f1d0 0x7f91cc06d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d173b700 1 -- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc0b1e50 msgr2=0x7f91cc0a3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d173b700 1 --2- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc0b1e50 0x7f91cc0a3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d173b700 1 -- 172.21.15.31:0/3473854225 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc0a4470 con 0x7f91cc0a2910 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d273d700 1 --2- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc13f1d0 0x7f91cc06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d1f3c700 1 --2- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc0b1e50 0x7f91cc0a3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d173b700 1 --2- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc0a2910 0x7f91cc13ec90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f91c80099b0 tx=0x7f91c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f9fbc1941a93c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d0f3a700 1 -- 172.21.15.31:0/3473854225 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c800b680 con 0x7f91cc0a2910 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d0f3a700 1 -- 172.21.15.31:0/3473854225 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c800b7e0 con 0x7f91cc0a2910 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d0f3a700 1 -- 172.21.15.31:0/3473854225 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c800bb80 con 0x7f91cc0a2910 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d41a0700 1 -- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc0a2910 msgr2=0x7f91cc13ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.996+0000 7f91d41a0700 1 --2- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc0a2910 0x7f91cc13ec90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f91c80099b0 tx=0x7f91c8009250 comp rx=0 tx=0).stop 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.997+0000 7f91d41a0700 1 -- 172.21.15.31:0/3473854225 shutdown_connections 2024-04-18T10:44:03.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.997+0000 7f91d41a0700 1 --2- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc13f1d0 0x7f91cc06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.997+0000 7f91d41a0700 1 --2- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc0b1e50 0x7f91cc0a3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.997+0000 7f91d41a0700 1 --2- 172.21.15.31:0/3473854225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc0a2910 0x7f91cc13ec90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:03.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.997+0000 7f91d41a0700 1 -- 172.21.15.31:0/3473854225 >> 172.21.15.31:0/3473854225 conn(0x7f91cc06ccf0 msgr2=0x7f91cc06aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:03.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.997+0000 7f91d41a0700 1 -- 172.21.15.31:0/3473854225 shutdown_connections 2024-04-18T10:44:03.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.997+0000 7f91d41a0700 1 -- 172.21.15.31:0/3473854225 wait complete. 2024-04-18T10:44:04.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d41a0700 1 Processor -- start 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d41a0700 1 -- start start 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d41a0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc0a2910 0x7f91cc096fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d41a0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc0b1e50 0x7f91cc097ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d41a0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc13f1d0 0x7f91cc13b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d41a0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0987b0 con 0x7f91cc0a2910 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d41a0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc097810 con 0x7f91cc13f1d0 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d41a0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc097af0 con 0x7f91cc0b1e50 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d173b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc0b1e50 0x7f91cc097ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d273d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc13f1d0 0x7f91cc13b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d173b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc0b1e50 0x7f91cc097ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44374/0 (socket says 172.21.15.31:44374) 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d173b700 1 -- 172.21.15.31:0/3544347027 learned_addr learned my addr 172.21.15.31:0/3544347027 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d273d700 1 --2- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc13f1d0 0x7f91cc13b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38440/0 (socket says 172.21.15.31:38440) 2024-04-18T10:44:04.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.998+0000 7f91d1f3c700 1 --2- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc0a2910 0x7f91cc096fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d273d700 1 -- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc0b1e50 msgr2=0x7f91cc097ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d273d700 1 --2- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc0b1e50 0x7f91cc097ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d273d700 1 -- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc0a2910 msgr2=0x7f91cc096fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d273d700 1 --2- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc0a2910 0x7f91cc096fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d273d700 1 -- 172.21.15.31:0/3544347027 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc009420 con 0x7f91cc13f1d0 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d173b700 1 --2- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f91cc0b1e50 0x7f91cc097ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d1f3c700 1 --2- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91cc0a2910 0x7f91cc096fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d273d700 1 --2- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc13f1d0 0x7f91cc13b870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009ed0 tx=0x7f91c400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91c1ffb700 1 -- 172.21.15.31:0/3544347027 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c400cb70 con 0x7f91cc13f1d0 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91c1ffb700 1 -- 172.21.15.31:0/3544347027 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c400f040 con 0x7f91cc13f1d0 2024-04-18T10:44:04.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c4009a20 con 0x7f91cc13f1d0 2024-04-18T10:44:04.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91c1ffb700 1 -- 172.21.15.31:0/3544347027 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4014480 con 0x7f91cc13f1d0 2024-04-18T10:44:04.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:03.999+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c80094f0 con 0x7f91cc13f1d0 2024-04-18T10:44:04.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.000+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91cc13c7c0 con 0x7f91cc13f1d0 2024-04-18T10:44:04.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.000+0000 7f91c1ffb700 1 -- 172.21.15.31:0/3544347027 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f91c40147f0 con 0x7f91cc13f1d0 2024-04-18T10:44:04.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.000+0000 7f91c1ffb700 1 -- 172.21.15.31:0/3544347027 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f91c405bcd0 con 0x7f91cc13f1d0 2024-04-18T10:44:04.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.001+0000 7f91c1ffb700 1 -- 172.21.15.31:0/3544347027 --> v1:172.21.15.31:6808/49420 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91b0052d10 con 0x7f91b004f010 2024-04-18T10:44:04.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.001+0000 7f91c1ffb700 1 -- 172.21.15.31:0/3544347027 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91c405e310 con 0x7f91cc13f1d0 2024-04-18T10:44:04.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.001+0000 7f91c1ffb700 1 -- 172.21.15.31:0/3544347027 <== osd.2 v1:172.21.15.31:6808/49420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f91b0052d10 con 0x7f91b004f010 2024-04-18T10:44:04.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.015+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 --> v1:172.21.15.31:6808/49420 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f91cc06f450 con 0x7f91b004f010 2024-04-18T10:44:04.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.015+0000 7f91c1ffb700 1 -- 172.21.15.31:0/3544347027 <== osd.2 v1:172.21.15.31:6808/49420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f91cc06f450 con 0x7f91b004f010 2024-04-18T10:44:04.016 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:44:04.016 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T10:44:04.016 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:44:04.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.016+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 >> v1:172.21.15.31:6808/49420 conn(0x7f91b004f010 legacy=0x7f91b00514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.016+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 >> v1:172.21.15.31:6816/46601 conn(0x7f91b0045ef0 legacy=0x7f91b00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.016+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc13f1d0 msgr2=0x7f91cc13b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.016+0000 7f91d41a0700 1 --2- 172.21.15.31:0/3544347027 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f91cc13f1d0 0x7f91cc13b870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009ed0 tx=0x7f91c400b040 comp rx=0 tx=0).stop 2024-04-18T10:44:04.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.016+0000 7f91d273d700 1 -- 172.21.15.31:0/3544347027 reap_dead start 2024-04-18T10:44:04.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.016+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 shutdown_connections 2024-04-18T10:44:04.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.016+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 >> 172.21.15.31:0/3544347027 conn(0x7f91cc06ccf0 msgr2=0x7f91cc0b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:04.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.016+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 shutdown_connections 2024-04-18T10:44:04.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.016+0000 7f91d41a0700 1 -- 172.21.15.31:0/3544347027 wait complete. 2024-04-18T10:44:04.027 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-18T10:44:04.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.148+0000 7fe6ca9d5700 1 Processor -- start 2024-04-18T10:44:04.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.148+0000 7fe6ca9d5700 1 -- start start 2024-04-18T10:44:04.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6ca9d5700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6c4068340 0x7fe6c406a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6ca9d5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c41466b0 0x7fe6c4148a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6ca9d5700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c40696b0 con 0x7fe6c40a4070 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6ca9d5700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c4069950 con 0x7fe6c4068340 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6ca9d5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c40a4f70 con 0x7fe6c41466b0 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c8f72700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c41466b0 0x7fe6c4148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c3fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe6c4068340 0x7fe6c406a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c37fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe6c40a4070 0x7fe6c40a4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40470/0 (socket says 172.21.15.31:40470) 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c8f72700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c41466b0 0x7fe6c4148a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44378/0 (socket says 172.21.15.31:44378) 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c37fe700 1 -- 172.21.15.31:0/970458944 learned_addr learned my addr 172.21.15.31:0/970458944 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c8f72700 1 -- 172.21.15.31:0/970458944 >> v2:172.21.15.31:3300/0 conn(0x7fe6c4068340 msgr2=0x7fe6c406a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c8f72700 1 --2- 172.21.15.31:0/970458944 >> v2:172.21.15.31:3300/0 conn(0x7fe6c4068340 0x7fe6c406a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c8f72700 1 -- 172.21.15.31:0/970458944 >> v1:172.21.15.31:6789/0 conn(0x7fe6c40a4070 legacy=0x7fe6c40a4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c8f72700 1 -- 172.21.15.31:0/970458944 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c406fcc0 con 0x7fe6c41466b0 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c2ffd700 1 -- 172.21.15.31:0/970458944 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996361870 0 0) 0x7fe6c40696b0 con 0x7fe6c40a4070 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c3fff700 1 --2- 172.21.15.31:0/970458944 >> v2:172.21.15.31:3300/0 conn(0x7fe6c4068340 0x7fe6c406a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c8f72700 1 --2- 172.21.15.31:0/970458944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c41466b0 0x7fe6c4148a90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009e60 tx=0x7fe6bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef35975511f20513 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c2ffd700 1 -- 172.21.15.31:0/970458944 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00e070 con 0x7fe6c41466b0 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c2ffd700 1 -- 172.21.15.31:0/970458944 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc00bb60 con 0x7fe6c41466b0 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.149+0000 7fe6c2ffd700 1 -- 172.21.15.31:0/970458944 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc012430 con 0x7fe6c41466b0 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.150+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/970458944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c41466b0 msgr2=0x7fe6c4148a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.150+0000 7fe6ca9d5700 1 --2- 172.21.15.31:0/970458944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c41466b0 0x7fe6c4148a90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009e60 tx=0x7fe6bc009780 comp rx=0 tx=0).stop 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.150+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/970458944 shutdown_connections 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.150+0000 7fe6ca9d5700 1 --2- 172.21.15.31:0/970458944 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c41466b0 0x7fe6c4148a90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.150+0000 7fe6ca9d5700 1 --2- 172.21.15.31:0/970458944 >> v2:172.21.15.31:3300/0 conn(0x7fe6c4068340 0x7fe6c406a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.150+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/970458944 >> 172.21.15.31:0/970458944 conn(0x7fe6c406bfc0 msgr2=0x7fe6c40679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.150+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/970458944 shutdown_connections 2024-04-18T10:44:04.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.150+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/970458944 wait complete. 2024-04-18T10:44:04.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.151+0000 7fe6ca9d5700 1 Processor -- start 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.151+0000 7fe6ca9d5700 1 -- start start 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6ca9d5700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c4068340 0x7fe6c414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6ca9d5700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c40a4070 0x7fe6c4151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6ca9d5700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c41466b0 0x7fe6c41516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6ca9d5700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c4099530 con 0x7fe6c41466b0 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6ca9d5700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c40984d0 con 0x7fe6c40a4070 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6ca9d5700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c409ad20 con 0x7fe6c4068340 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c4068340 0x7fe6c414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c3fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c4068340 0x7fe6c414e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44380/0 (socket says 172.21.15.31:44380) 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c8f72700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c41466b0 0x7fe6c41516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c3fff700 1 -- 172.21.15.31:0/2669500786 learned_addr learned my addr 172.21.15.31:0/2669500786 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c37fe700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c40a4070 0x7fe6c4151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c3fff700 1 -- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c40a4070 msgr2=0x7fe6c4151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c3fff700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c40a4070 0x7fe6c4151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c3fff700 1 -- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c41466b0 msgr2=0x7fe6c41516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c3fff700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c41466b0 0x7fe6c41516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c3fff700 1 -- 172.21.15.31:0/2669500786 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4009420 con 0x7fe6c4068340 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c8f72700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c41466b0 0x7fe6c41516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c37fe700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c40a4070 0x7fe6c4151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6c3fff700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c4068340 0x7fe6c414e5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400ec80 tx=0x7fe6b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6bbfff700 1 -- 172.21.15.31:0/2669500786 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400c8c0 con 0x7fe6c4068340 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6bbfff700 1 -- 172.21.15.31:0/2669500786 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400ca20 con 0x7fe6c4068340 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.152+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc009a20 con 0x7fe6c4068340 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.153+0000 7fe6bbfff700 1 -- 172.21.15.31:0/2669500786 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400cda0 con 0x7fe6c4068340 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.153+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c414eb90 con 0x7fe6c4068340 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.153+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c40651b0 con 0x7fe6c4068340 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.154+0000 7fe6bbfff700 1 -- 172.21.15.31:0/2669500786 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fe6b4013680 con 0x7fe6c4068340 2024-04-18T10:44:04.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.154+0000 7fe6bbfff700 1 -- 172.21.15.31:0/2669500786 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fe6b405bc40 con 0x7fe6c4068340 2024-04-18T10:44:04.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.157+0000 7fe6bbfff700 1 -- 172.21.15.31:0/2669500786 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe6b4039e60 con 0x7fe6c4068340 2024-04-18T10:44:04.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.322+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6c40a2f90 con 0x7fe6a4045f70 2024-04-18T10:44:04.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.322+0000 7fe6bbfff700 1 -- 172.21.15.31:0/2669500786 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7fe6c40a2f90 con 0x7fe6a4045f70 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.324+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 >> v1:172.21.15.31:6816/46601 conn(0x7fe6a4045f70 legacy=0x7fe6a4048420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.324+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c4068340 msgr2=0x7fe6c414e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.324+0000 7fe6ca9d5700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c4068340 0x7fe6c414e5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400ec80 tx=0x7fe6b40091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.324+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 shutdown_connections 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.325+0000 7fe6ca9d5700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe6c4068340 0x7fe6c414e5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.325+0000 7fe6ca9d5700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6c41466b0 0x7fe6c41516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.325+0000 7fe6ca9d5700 1 --2- 172.21.15.31:0/2669500786 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe6c40a4070 0x7fe6c4151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.325+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 >> 172.21.15.31:0/2669500786 conn(0x7fe6c406bfc0 msgr2=0x7fe6c40b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.325+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 shutdown_connections 2024-04-18T10:44:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.325+0000 7fe6ca9d5700 1 -- 172.21.15.31:0/2669500786 wait complete. 2024-04-18T10:44:04.326 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2024-04-18T10:44:04.336 INFO:tasks.ceph:Scrubbing osd.3 2024-04-18T10:44:04.336 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-18T10:44:04.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.461+0000 7effcc7ed700 1 Processor -- start 2024-04-18T10:44:04.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.461+0000 7effcc7ed700 1 -- start start 2024-04-18T10:44:04.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effcc7ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc40a9c60 0x7effc40ab060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effcc7ed700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7effc40638b0 0x7effc413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effcc7ed700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc40aa300 con 0x7effc4063ca0 2024-04-18T10:44:04.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effcc7ed700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc413e580 con 0x7effc40638b0 2024-04-18T10:44:04.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effcc7ed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc413e820 con 0x7effc40a9c60 2024-04-18T10:44:04.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effca589700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc40a9c60 0x7effc40ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9d88700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7effc40638b0 0x7effc413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effcad8a700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7effc4063ca0 0x7effc4141760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52258/0 (socket says 172.21.15.31:52258) 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effcad8a700 1 -- 172.21.15.31:0/1478416293 learned_addr learned my addr 172.21.15.31:0/1478416293 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9d88700 1 -- 172.21.15.31:0/1478416293 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc40a9c60 msgr2=0x7effc40ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9d88700 1 --2- 172.21.15.31:0/1478416293 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc40a9c60 0x7effc40ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9d88700 1 -- 172.21.15.31:0/1478416293 >> v1:172.21.15.31:6789/0 conn(0x7effc4063ca0 legacy=0x7effc4141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9d88700 1 -- 172.21.15.31:0/1478416293 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40aa550 con 0x7effc40638b0 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9587700 1 -- 172.21.15.31:0/1478416293 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800921196 0 0) 0x7effc40aa300 con 0x7effc4063ca0 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effca589700 1 --2- 172.21.15.31:0/1478416293 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc40a9c60 0x7effc40ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9d88700 1 --2- 172.21.15.31:0/1478416293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effc40638b0 0x7effc413b3b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7effb40098e0 tx=0x7effb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14898fd0d45bdc22 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9587700 1 -- 172.21.15.31:0/1478416293 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400b640 con 0x7effc40638b0 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9587700 1 -- 172.21.15.31:0/1478416293 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb400b7a0 con 0x7effc40638b0 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.462+0000 7effc9587700 1 -- 172.21.15.31:0/1478416293 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400bb40 con 0x7effc40638b0 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.463+0000 7effcc7ed700 1 -- 172.21.15.31:0/1478416293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effc40638b0 msgr2=0x7effc413b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.463+0000 7effcc7ed700 1 --2- 172.21.15.31:0/1478416293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effc40638b0 0x7effc413b3b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7effb40098e0 tx=0x7effb40091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.463+0000 7effcc7ed700 1 -- 172.21.15.31:0/1478416293 shutdown_connections 2024-04-18T10:44:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.463+0000 7effcc7ed700 1 --2- 172.21.15.31:0/1478416293 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc40a9c60 0x7effc40ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.463+0000 7effcc7ed700 1 --2- 172.21.15.31:0/1478416293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effc40638b0 0x7effc413b3b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.463+0000 7effcc7ed700 1 -- 172.21.15.31:0/1478416293 >> 172.21.15.31:0/1478416293 conn(0x7effc40679e0 msgr2=0x7effc4067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:04.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.463+0000 7effcc7ed700 1 -- 172.21.15.31:0/1478416293 shutdown_connections 2024-04-18T10:44:04.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.463+0000 7effcc7ed700 1 -- 172.21.15.31:0/1478416293 wait complete. 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.464+0000 7effcc7ed700 1 Processor -- start 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.464+0000 7effcc7ed700 1 -- start start 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.464+0000 7effcc7ed700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7effc40638b0 0x7effc41521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.464+0000 7effcc7ed700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc4063ca0 0x7effc4137680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.464+0000 7effcc7ed700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effc40a9c60 0x7effc414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.464+0000 7effcc7ed700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc4136c50 con 0x7effc40a9c60 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.464+0000 7effcc7ed700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc4152730 con 0x7effc4063ca0 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.464+0000 7effcc7ed700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effc414e5c0 con 0x7effc40638b0 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effca589700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7effc40638b0 0x7effc41521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effcad8a700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effc40a9c60 0x7effc414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effc9d88700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc4063ca0 0x7effc4137680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effca589700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7effc40638b0 0x7effc41521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45110/0 (socket says 172.21.15.31:45110) 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effca589700 1 -- 172.21.15.31:0/1931534847 learned_addr learned my addr 172.21.15.31:0/1931534847 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effc9d88700 1 -- 172.21.15.31:0/1931534847 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7effc40638b0 msgr2=0x7effc41521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effc9d88700 1 --2- 172.21.15.31:0/1931534847 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7effc40638b0 0x7effc41521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effc9d88700 1 -- 172.21.15.31:0/1931534847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effc40a9c60 msgr2=0x7effc414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effc9d88700 1 --2- 172.21.15.31:0/1931534847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7effc40a9c60 0x7effc414e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effc9d88700 1 -- 172.21.15.31:0/1931534847 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0009420 con 0x7effc4063ca0 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effc9d88700 1 --2- 172.21.15.31:0/1931534847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc4063ca0 0x7effc4137680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7effb4016000 tx=0x7effb4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effba7fc700 1 -- 172.21.15.31:0/1931534847 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400b910 con 0x7effc4063ca0 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effba7fc700 1 -- 172.21.15.31:0/1931534847 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb400ba70 con 0x7effc4063ca0 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4009420 con 0x7effc4063ca0 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effba7fc700 1 -- 172.21.15.31:0/1931534847 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4011630 con 0x7effc4063ca0 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.465+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc414e2b0 con 0x7effc4063ca0 2024-04-18T10:44:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.466+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effc40abc80 con 0x7effc4063ca0 2024-04-18T10:44:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.466+0000 7effba7fc700 1 -- 172.21.15.31:0/1931534847 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7effb4011a60 con 0x7effc4063ca0 2024-04-18T10:44:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.467+0000 7effba7fc700 1 -- 172.21.15.31:0/1931534847 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7effb405c4f0 con 0x7effc4063ca0 2024-04-18T10:44:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.467+0000 7effba7fc700 1 -- 172.21.15.31:0/1931534847 --> v1:172.21.15.31:6812/49601 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effa8052d10 con 0x7effa804f010 2024-04-18T10:44:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.467+0000 7effba7fc700 1 -- 172.21.15.31:0/1931534847 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7effb405eb30 con 0x7effc4063ca0 2024-04-18T10:44:04.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.468+0000 7effba7fc700 1 -- 172.21.15.31:0/1931534847 <== osd.3 v1:172.21.15.31:6812/49601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7effa8052d10 con 0x7effa804f010 2024-04-18T10:44:04.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.481+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 --> v1:172.21.15.31:6812/49601 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7effc4071800 con 0x7effa804f010 2024-04-18T10:44:04.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.481+0000 7effba7fc700 1 -- 172.21.15.31:0/1931534847 <== osd.3 v1:172.21.15.31:6812/49601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7effc4071800 con 0x7effa804f010 2024-04-18T10:44:04.482 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-04-18T10:44:04.482 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-18T10:44:04.482 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-04-18T10:44:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.482+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 >> v1:172.21.15.31:6812/49601 conn(0x7effa804f010 legacy=0x7effa80514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.482+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 >> v1:172.21.15.31:6816/46601 conn(0x7effa8045ef0 legacy=0x7effa80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.482+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc4063ca0 msgr2=0x7effc4137680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.482+0000 7effcc7ed700 1 --2- 172.21.15.31:0/1931534847 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7effc4063ca0 0x7effc4137680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7effb4016000 tx=0x7effb4017000 comp rx=0 tx=0).stop 2024-04-18T10:44:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.482+0000 7effcad8a700 1 -- 172.21.15.31:0/1931534847 reap_dead start 2024-04-18T10:44:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.482+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 shutdown_connections 2024-04-18T10:44:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.482+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 >> 172.21.15.31:0/1931534847 conn(0x7effc40679e0 msgr2=0x7effc40b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.482+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 shutdown_connections 2024-04-18T10:44:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.482+0000 7effcc7ed700 1 -- 172.21.15.31:0/1931534847 wait complete. 2024-04-18T10:44:04.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-18T10:44:04.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.614+0000 7f012f169700 1 Processor -- start 2024-04-18T10:44:04.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.614+0000 7f012f169700 1 -- start start 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f012f169700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f012806ecf0 0x7f01280a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f012f169700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f01280a6d60 0x7f0128142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f012f169700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a7130 0x7f01281450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f012f169700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01280a3540 con 0x7f01280a6d60 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f012f169700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01280a37e0 con 0x7f012806ecf0 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f012f169700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01280a5d60 con 0x7f01280a7130 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f0127fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f01280a6d60 0x7f0128142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f0127fff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f01280a6d60 0x7f0128142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46566/0 (socket says 172.21.15.31:46566) 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f0127fff700 1 -- 172.21.15.31:0/2777733183 learned_addr learned my addr 172.21.15.31:0/2777733183 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f012d706700 1 --2- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a7130 0x7f01281450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.615+0000 7f012cf05700 1 --2- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f012806ecf0 0x7f01280a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012d706700 1 -- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f012806ecf0 msgr2=0x7f01280a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012d706700 1 --2- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f012806ecf0 0x7f01280a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012d706700 1 -- 172.21.15.31:0/2777733183 >> v2:172.21.15.31:3300/0 conn(0x7f01280a6d60 msgr2=0x7f0128142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012d706700 1 --2- 172.21.15.31:0/2777733183 >> v2:172.21.15.31:3300/0 conn(0x7f01280a6d60 0x7f0128142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012d706700 1 -- 172.21.15.31:0/2777733183 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012806d980 con 0x7f01280a7130 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f0127fff700 1 --2- 172.21.15.31:0/2777733183 >> v2:172.21.15.31:3300/0 conn(0x7f01280a6d60 0x7f0128142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012cf05700 1 --2- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f012806ecf0 0x7f01280a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012d706700 1 --2- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a7130 0x7f01281450c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0120009e60 tx=0x7f0120009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbaa3dfd5cf2780f server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f01277fe700 1 -- 172.21.15.31:0/2777733183 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012000e070 con 0x7f01280a7130 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f01277fe700 1 -- 172.21.15.31:0/2777733183 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012000bab0 con 0x7f01280a7130 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f01277fe700 1 -- 172.21.15.31:0/2777733183 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012000be70 con 0x7f01280a7130 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012f169700 1 -- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a7130 msgr2=0x7f01281450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012f169700 1 --2- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a7130 0x7f01281450c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0120009e60 tx=0x7f0120009780 comp rx=0 tx=0).stop 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012f169700 1 -- 172.21.15.31:0/2777733183 shutdown_connections 2024-04-18T10:44:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012f169700 1 --2- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a7130 0x7f01281450c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012f169700 1 --2- 172.21.15.31:0/2777733183 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f012806ecf0 0x7f01280a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012f169700 1 --2- 172.21.15.31:0/2777733183 >> v2:172.21.15.31:3300/0 conn(0x7f01280a6d60 0x7f0128142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.616+0000 7f012f169700 1 -- 172.21.15.31:0/2777733183 >> 172.21.15.31:0/2777733183 conn(0x7f01280679e0 msgr2=0x7f0128067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.617+0000 7f012f169700 1 -- 172.21.15.31:0/2777733183 shutdown_connections 2024-04-18T10:44:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.617+0000 7f012f169700 1 -- 172.21.15.31:0/2777733183 wait complete. 2024-04-18T10:44:04.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.617+0000 7f012f169700 1 Processor -- start 2024-04-18T10:44:04.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012f169700 1 -- start start 2024-04-18T10:44:04.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012f169700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012806ecf0 0x7f01280ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012f169700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a6d60 0x7f01280a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012f169700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01280a7130 0x7f012814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012f169700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01280a8830 con 0x7f012806ecf0 2024-04-18T10:44:04.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012f169700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01280a98d0 con 0x7f01280a7130 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012f169700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01280a9630 con 0x7f01280a6d60 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012cf05700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012806ecf0 0x7f01280ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f0127fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a6d60 0x7f01280a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012d706700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01280a7130 0x7f012814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012cf05700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012806ecf0 0x7f01280ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46568/0 (socket says 172.21.15.31:46568) 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f012cf05700 1 -- 172.21.15.31:0/2960242563 learned_addr learned my addr 172.21.15.31:0/2960242563 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.618+0000 7f0127fff700 1 --2- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a6d60 0x7f01280a8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:45122/0 (socket says 172.21.15.31:45122) 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f012cf05700 1 -- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a6d60 msgr2=0x7f01280a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f012cf05700 1 --2- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a6d60 0x7f01280a8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f012cf05700 1 -- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01280a7130 msgr2=0x7f012814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f012cf05700 1 --2- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01280a7130 0x7f012814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f012cf05700 1 -- 172.21.15.31:0/2960242563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c009420 con 0x7f012806ecf0 2024-04-18T10:44:04.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f012d706700 1 --2- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01280a7130 0x7f012814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f012cf05700 1 --2- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012806ecf0 0x7f01280ab170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f011c00ec80 tx=0x7f011c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:04.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f0124ff9700 1 -- 172.21.15.31:0/2960242563 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c00c920 con 0x7f012806ecf0 2024-04-18T10:44:04.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f0124ff9700 1 -- 172.21.15.31:0/2960242563 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c00ca80 con 0x7f012806ecf0 2024-04-18T10:44:04.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01140094f0 con 0x7f012806ecf0 2024-04-18T10:44:04.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f0124ff9700 1 -- 172.21.15.31:0/2960242563 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c00ce00 con 0x7f012806ecf0 2024-04-18T10:44:04.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.619+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0120009a20 con 0x7f012806ecf0 2024-04-18T10:44:04.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.620+0000 7f0124ff9700 1 -- 172.21.15.31:0/2960242563 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f011c013680 con 0x7f012806ecf0 2024-04-18T10:44:04.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.620+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01280651b0 con 0x7f012806ecf0 2024-04-18T10:44:04.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.620+0000 7f0124ff9700 1 -- 172.21.15.31:0/2960242563 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f011c05b480 con 0x7f012806ecf0 2024-04-18T10:44:04.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.624+0000 7f0124ff9700 1 -- 172.21.15.31:0/2960242563 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f011c0396c0 con 0x7f012806ecf0 2024-04-18T10:44:04.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.790+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0128141cb0 con 0x7f010c045ef0 2024-04-18T10:44:04.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.791+0000 7f0124ff9700 1 -- 172.21.15.31:0/2960242563 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7f0128141cb0 con 0x7f010c045ef0 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 >> v1:172.21.15.31:6816/46601 conn(0x7f010c045ef0 legacy=0x7f010c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012806ecf0 msgr2=0x7f01280ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 --2- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012806ecf0 0x7f01280ab170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f011c00ec80 tx=0x7f011c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 shutdown_connections 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 --2- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f01280a7130 0x7f012814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 --2- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f012806ecf0 0x7f01280ab170 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 --2- 172.21.15.31:0/2960242563 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f01280a6d60 0x7f01280a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 >> 172.21.15.31:0/2960242563 conn(0x7f01280679e0 msgr2=0x7f01280b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 shutdown_connections 2024-04-18T10:44:04.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.793+0000 7f012f169700 1 -- 172.21.15.31:0/2960242563 wait complete. 2024-04-18T10:44:04.794 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2024-04-18T10:44:04.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:44:04.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.924+0000 7faf066e0700 1 Processor -- start 2024-04-18T10:44:04.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faf066e0700 1 -- start start 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faf066e0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 0x7faf0013c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faf066e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf00144920 0x7faf00146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faf066e0700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0006fd30 con 0x7faf000680f0 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faf066e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf000a5050 con 0x7faf00144920 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faf066e0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf0013c130 con 0x7faf000a7110 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faefffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7faf000680f0 0x7faf000a4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:52266/0 (socket says 172.21.15.31:52266) 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faefffff700 1 -- 172.21.15.31:0/303281395 learned_addr learned my addr 172.21.15.31:0/303281395 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faf04c7d700 1 --2- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf00144920 0x7faf00146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.925+0000 7faeff7fe700 1 --2- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 0x7faf0013c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faefeffd700 1 -- 172.21.15.31:0/303281395 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563457856 0 0) 0x7faf0006fd30 con 0x7faf000680f0 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faefeffd700 1 -- 172.21.15.31:0/303281395 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faee8003570 con 0x7faf000680f0 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf04c7d700 1 -- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 msgr2=0x7faf0013c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf04c7d700 1 --2- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 0x7faf0013c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf04c7d700 1 -- 172.21.15.31:0/303281395 >> v1:172.21.15.31:6789/0 conn(0x7faf000680f0 legacy=0x7faf000a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf04c7d700 1 -- 172.21.15.31:0/303281395 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000a4510 con 0x7faf00144920 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faeff7fe700 1 --2- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 0x7faf0013c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf04c7d700 1 --2- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf00144920 0x7faf00146d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faef8009e90 tx=0x7faef8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=349fcdf77c97e952 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faefeffd700 1 -- 172.21.15.31:0/303281395 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef800e070 con 0x7faf00144920 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faefeffd700 1 -- 172.21.15.31:0/303281395 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef800bb80 con 0x7faf00144920 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faefeffd700 1 -- 172.21.15.31:0/303281395 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8012430 con 0x7faf00144920 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf066e0700 1 -- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf00144920 msgr2=0x7faf00146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf066e0700 1 --2- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf00144920 0x7faf00146d00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faef8009e90 tx=0x7faef8009780 comp rx=0 tx=0).stop 2024-04-18T10:44:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf066e0700 1 -- 172.21.15.31:0/303281395 shutdown_connections 2024-04-18T10:44:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf066e0700 1 --2- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf00144920 0x7faf00146d00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.926+0000 7faf066e0700 1 --2- 172.21.15.31:0/303281395 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 0x7faf0013c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.927+0000 7faf066e0700 1 -- 172.21.15.31:0/303281395 >> 172.21.15.31:0/303281395 conn(0x7faf0006bfc0 msgr2=0x7faf000679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.927+0000 7faf066e0700 1 -- 172.21.15.31:0/303281395 shutdown_connections 2024-04-18T10:44:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.927+0000 7faf066e0700 1 -- 172.21.15.31:0/303281395 wait complete. 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.927+0000 7faf066e0700 1 Processor -- start 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faf066e0700 1 -- start start 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faf066e0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000680f0 0x7faf00132c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faf066e0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 0x7faf001423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faf066e0700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf00144920 0x7faf000a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faf066e0700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf00142930 con 0x7faf00144920 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faf066e0700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf00141c10 con 0x7faf000680f0 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faf066e0700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf00140ee0 con 0x7faf000a7110 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faefffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000680f0 0x7faf00132c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faf04c7d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf00144920 0x7faf000a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faeff7fe700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 0x7faf001423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faefffff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000680f0 0x7faf00132c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:46282/0 (socket says 172.21.15.31:46282) 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.928+0000 7faefffff700 1 -- 172.21.15.31:0/3814050031 learned_addr learned my addr 172.21.15.31:0/3814050031 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faefffff700 1 -- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 msgr2=0x7faf001423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faefffff700 1 --2- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 0x7faf001423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faefffff700 1 -- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf00144920 msgr2=0x7faf000a2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faefffff700 1 --2- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf00144920 0x7faf000a2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faefffff700 1 -- 172.21.15.31:0/3814050031 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009420 con 0x7faf000680f0 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faefffff700 1 --2- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000680f0 0x7faf00132c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faef000c590 tx=0x7faef0007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faee7fff700 1 -- 172.21.15.31:0/3814050031 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0005b30 con 0x7faf000680f0 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faee7fff700 1 -- 172.21.15.31:0/3814050031 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef0005cb0 con 0x7faf000680f0 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef8009a20 con 0x7faf000680f0 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faee7fff700 1 -- 172.21.15.31:0/3814050031 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0007320 con 0x7faf000680f0 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.929+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf00142b20 con 0x7faf000680f0 2024-04-18T10:44:04.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.930+0000 7faee7fff700 1 -- 172.21.15.31:0/3814050031 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7faef001b3b0 con 0x7faf000680f0 2024-04-18T10:44:04.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.930+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf00144590 con 0x7faf000680f0 2024-04-18T10:44:04.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.930+0000 7faee7fff700 1 -- 172.21.15.31:0/3814050031 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7faef005a5e0 con 0x7faf000680f0 2024-04-18T10:44:04.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:04.934+0000 7faee7fff700 1 -- 172.21.15.31:0/3814050031 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7faef0038820 con 0x7faf000680f0 2024-04-18T10:44:05.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.095+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf000a38b0 con 0x7faeec045f20 2024-04-18T10:44:05.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.102+0000 7faee7fff700 1 -- 172.21.15.31:0/3814050031 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276897 (unknown 2965378022 0 3188812101) 0x7faf000a38b0 con 0x7faeec045f20 2024-04-18T10:44:05.105 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 >> v1:172.21.15.31:6816/46601 conn(0x7faeec045f20 legacy=0x7faeec0483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000680f0 msgr2=0x7faf00132c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 --2- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000680f0 0x7faf00132c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faef000c590 tx=0x7faef0007e00 comp rx=0 tx=0).stop 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 shutdown_connections 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 --2- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faf00144920 0x7faf000a2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 --2- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7faf000680f0 0x7faf00132c70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 --2- 172.21.15.31:0/3814050031 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7faf000a7110 0x7faf001423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 >> 172.21.15.31:0/3814050031 conn(0x7faf0006bfc0 msgr2=0x7faf0013c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 shutdown_connections 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:05.105+0000 7faf066e0700 1 -- 172.21.15.31:0/3814050031 wait complete. 2024-04-18T10:44:05.108 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:44:05.116 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-18T10:44:04.486021+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35077,"ondisk_log_size":35077,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-63903,"num_objects":-9,"num_object_clones":0,"num_object_copies":-18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-9,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003055"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":522,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452679+0000","last_change":"2024-04-18T10:38:48.515671+0000","last_active":"2024-04-18T10:43:51.452679+0000","last_peered":"2024-04-18T10:43:51.452679+0000","last_clean":"2024-04-18T10:43:51.452679+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:43:51.452679+0000","last_undegraded":"2024-04-18T10:43:51.452679+0000","last_fullsized":"2024-04-18T10:43:51.452679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:55:56.692744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":510,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447019+0000","last_change":"2024-04-18T10:38:47.514349+0000","last_active":"2024-04-18T10:43:51.447019+0000","last_peered":"2024-04-18T10:43:51.447019+0000","last_clean":"2024-04-18T10:43:51.447019+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:43:51.447019+0000","last_undegraded":"2024-04-18T10:43:51.447019+0000","last_fullsized":"2024-04-18T10:43:51.447019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:40:55.175836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":422,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.414130+0000","last_change":"2024-04-18T10:38:46.523814+0000","last_active":"2024-04-18T10:43:51.414130+0000","last_peered":"2024-04-18T10:43:51.414130+0000","last_clean":"2024-04-18T10:43:51.414130+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:43:51.414130+0000","last_undegraded":"2024-04-18T10:43:51.414130+0000","last_fullsized":"2024-04-18T10:43:51.414130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":454,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.429724+0000","last_change":"2024-04-18T10:38:46.523213+0000","last_active":"2024-04-18T10:43:51.429724+0000","last_peered":"2024-04-18T10:43:51.429724+0000","last_clean":"2024-04-18T10:43:51.429724+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:43:51.429724+0000","last_undegraded":"2024-04-18T10:43:51.429724+0000","last_fullsized":"2024-04-18T10:43:51.429724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446270+0000","last_change":"2024-04-18T10:39:29.510615+0000","last_active":"2024-04-18T10:43:51.446270+0000","last_peered":"2024-04-18T10:43:51.446270+0000","last_clean":"2024-04-18T10:43:51.446270+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:43:51.446270+0000","last_undegraded":"2024-04-18T10:43:51.446270+0000","last_fullsized":"2024-04-18T10:43:51.446270+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":403,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443750+0000","last_change":"2024-04-18T10:39:29.508173+0000","last_active":"2024-04-18T10:43:51.443750+0000","last_peered":"2024-04-18T10:43:51.443750+0000","last_clean":"2024-04-18T10:43:51.443750+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:43:51.443750+0000","last_undegraded":"2024-04-18T10:43:51.443750+0000","last_fullsized":"2024-04-18T10:43:51.443750+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":518,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431514+0000","last_change":"2024-04-18T10:38:48.526481+0000","last_active":"2024-04-18T10:43:51.431514+0000","last_peered":"2024-04-18T10:43:51.431514+0000","last_clean":"2024-04-18T10:43:51.431514+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:43:51.431514+0000","last_undegraded":"2024-04-18T10:43:51.431514+0000","last_fullsized":"2024-04-18T10:43:51.431514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:52:21.244414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.432661+0000","last_change":"2024-04-18T10:38:46.507263+0000","last_active":"2024-04-18T10:43:51.432661+0000","last_peered":"2024-04-18T10:43:51.432661+0000","last_clean":"2024-04-18T10:43:51.432661+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:43:51.432661+0000","last_undegraded":"2024-04-18T10:43:51.432661+0000","last_fullsized":"2024-04-18T10:43:51.432661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:09:47.927239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":504,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431996+0000","last_change":"2024-04-18T10:38:48.521319+0000","last_active":"2024-04-18T10:43:51.431996+0000","last_peered":"2024-04-18T10:43:51.431996+0000","last_clean":"2024-04-18T10:43:51.431996+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:43:51.431996+0000","last_undegraded":"2024-04-18T10:43:51.431996+0000","last_fullsized":"2024-04-18T10:43:51.431996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.444192+0000","last_change":"2024-04-18T10:38:46.520305+0000","last_active":"2024-04-18T10:43:51.444192+0000","last_peered":"2024-04-18T10:43:51.444192+0000","last_clean":"2024-04-18T10:43:51.444192+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:43:51.444192+0000","last_undegraded":"2024-04-18T10:43:51.444192+0000","last_fullsized":"2024-04-18T10:43:51.444192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:39:13.888537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":509,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.428542+0000","last_change":"2024-04-18T10:38:46.520635+0000","last_active":"2024-04-18T10:43:51.428542+0000","last_peered":"2024-04-18T10:43:51.428542+0000","last_clean":"2024-04-18T10:43:51.428542+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:43:51.428542+0000","last_undegraded":"2024-04-18T10:43:51.428542+0000","last_fullsized":"2024-04-18T10:43:51.428542+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:25.599792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452935+0000","last_change":"2024-04-18T10:38:48.520598+0000","last_active":"2024-04-18T10:43:51.452935+0000","last_peered":"2024-04-18T10:43:51.452935+0000","last_clean":"2024-04-18T10:43:51.452935+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:43:51.452935+0000","last_undegraded":"2024-04-18T10:43:51.452935+0000","last_fullsized":"2024-04-18T10:43:51.452935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:57:15.523949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452998+0000","last_change":"2024-04-18T10:38:48.531599+0000","last_active":"2024-04-18T10:43:51.452998+0000","last_peered":"2024-04-18T10:43:51.452998+0000","last_clean":"2024-04-18T10:43:51.452998+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:43:51.452998+0000","last_undegraded":"2024-04-18T10:43:51.452998+0000","last_fullsized":"2024-04-18T10:43:51.452998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:07:18.483736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":448,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446075+0000","last_change":"2024-04-18T10:38:47.515586+0000","last_active":"2024-04-18T10:43:51.446075+0000","last_peered":"2024-04-18T10:43:51.446075+0000","last_clean":"2024-04-18T10:43:51.446075+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:43:51.446075+0000","last_undegraded":"2024-04-18T10:43:51.446075+0000","last_fullsized":"2024-04-18T10:43:51.446075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:38.749060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":528,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.415110+0000","last_change":"2024-04-18T10:38:46.523038+0000","last_active":"2024-04-18T10:43:51.415110+0000","last_peered":"2024-04-18T10:43:51.415110+0000","last_clean":"2024-04-18T10:43:51.415110+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:43:51.415110+0000","last_undegraded":"2024-04-18T10:43:51.415110+0000","last_fullsized":"2024-04-18T10:43:51.415110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":479,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445927+0000","last_change":"2024-04-18T10:39:29.508295+0000","last_active":"2024-04-18T10:43:51.445927+0000","last_peered":"2024-04-18T10:43:51.445927+0000","last_clean":"2024-04-18T10:43:51.445927+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:43:51.445927+0000","last_undegraded":"2024-04-18T10:43:51.445927+0000","last_fullsized":"2024-04-18T10:43:51.445927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:26:27.135112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":505,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.423311+0000","last_change":"2024-04-18T10:38:48.527369+0000","last_active":"2024-04-18T10:43:51.423311+0000","last_peered":"2024-04-18T10:43:51.423311+0000","last_clean":"2024-04-18T10:43:51.423311+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:43:51.423311+0000","last_undegraded":"2024-04-18T10:43:51.423311+0000","last_fullsized":"2024-04-18T10:43:51.423311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":470,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443708+0000","last_change":"2024-04-18T10:38:47.514997+0000","last_active":"2024-04-18T10:43:51.443708+0000","last_peered":"2024-04-18T10:43:51.443708+0000","last_clean":"2024-04-18T10:43:51.443708+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:43:51.443708+0000","last_undegraded":"2024-04-18T10:43:51.443708+0000","last_fullsized":"2024-04-18T10:43:51.443708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":526,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.430226+0000","last_change":"2024-04-18T10:38:48.518698+0000","last_active":"2024-04-18T10:43:51.430226+0000","last_peered":"2024-04-18T10:43:51.430226+0000","last_clean":"2024-04-18T10:43:51.430226+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:43:51.430226+0000","last_undegraded":"2024-04-18T10:43:51.430226+0000","last_fullsized":"2024-04-18T10:43:51.430226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:54:42.362882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":547,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452383+0000","last_change":"2024-04-18T10:38:48.535465+0000","last_active":"2024-04-18T10:43:51.452383+0000","last_peered":"2024-04-18T10:43:51.452383+0000","last_clean":"2024-04-18T10:43:51.452383+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:43:51.452383+0000","last_undegraded":"2024-04-18T10:43:51.452383+0000","last_fullsized":"2024-04-18T10:43:51.452383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:15:57.026266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":502,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452655+0000","last_change":"2024-04-18T10:38:48.536144+0000","last_active":"2024-04-18T10:43:51.452655+0000","last_peered":"2024-04-18T10:43:51.452655+0000","last_clean":"2024-04-18T10:43:51.452655+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:43:51.452655+0000","last_undegraded":"2024-04-18T10:43:51.452655+0000","last_fullsized":"2024-04-18T10:43:51.452655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:30:36.746569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":560,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.422425+0000","last_change":"2024-04-18T10:38:46.523917+0000","last_active":"2024-04-18T10:43:51.422425+0000","last_peered":"2024-04-18T10:43:51.422425+0000","last_clean":"2024-04-18T10:43:51.422425+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:43:51.422425+0000","last_undegraded":"2024-04-18T10:43:51.422425+0000","last_fullsized":"2024-04-18T10:43:51.422425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":485,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434563+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:43:51.434563+0000","last_peered":"2024-04-18T10:43:51.434563+0000","last_clean":"2024-04-18T10:43:51.434563+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:43:51.434563+0000","last_undegraded":"2024-04-18T10:43:51.434563+0000","last_fullsized":"2024-04-18T10:43:51.434563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:36:26.788947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":550,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452073+0000","last_change":"2024-04-18T10:38:48.532902+0000","last_active":"2024-04-18T10:43:51.452073+0000","last_peered":"2024-04-18T10:43:51.452073+0000","last_clean":"2024-04-18T10:43:51.452073+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:43:51.452073+0000","last_undegraded":"2024-04-18T10:43:51.452073+0000","last_fullsized":"2024-04-18T10:43:51.452073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:21:05.366767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":448,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438072+0000","last_change":"2024-04-18T10:39:29.641096+0000","last_active":"2024-04-18T10:43:51.438072+0000","last_peered":"2024-04-18T10:43:51.438072+0000","last_clean":"2024-04-18T10:43:51.438072+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:43:51.438072+0000","last_undegraded":"2024-04-18T10:43:51.438072+0000","last_fullsized":"2024-04-18T10:43:51.438072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:00:39.979232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":613,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448152+0000","last_change":"2024-04-18T10:38:47.515633+0000","last_active":"2024-04-18T10:43:51.448152+0000","last_peered":"2024-04-18T10:43:51.448152+0000","last_clean":"2024-04-18T10:43:51.448152+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:43:51.448152+0000","last_undegraded":"2024-04-18T10:43:51.448152+0000","last_fullsized":"2024-04-18T10:43:51.448152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:29:53.701977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438461+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:43:51.438461+0000","last_peered":"2024-04-18T10:43:51.438461+0000","last_clean":"2024-04-18T10:43:51.438461+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:43:51.438461+0000","last_undegraded":"2024-04-18T10:43:51.438461+0000","last_fullsized":"2024-04-18T10:43:51.438461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:35:17.044947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'598","reported_seq":632,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.436856+0000","last_change":"2024-04-18T10:38:47.515748+0000","last_active":"2024-04-18T10:43:48.436856+0000","last_peered":"2024-04-18T10:43:48.436856+0000","last_clean":"2024-04-18T10:43:48.436856+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:43:48.436856+0000","last_undegraded":"2024-04-18T10:43:48.436856+0000","last_fullsized":"2024-04-18T10:43:48.436856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:10:22.348842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":473,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453851+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:43:51.453851+0000","last_peered":"2024-04-18T10:43:51.453851+0000","last_clean":"2024-04-18T10:43:51.453851+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:43:51.453851+0000","last_undegraded":"2024-04-18T10:43:51.453851+0000","last_fullsized":"2024-04-18T10:43:51.453851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:21:57.410343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'444","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.399120+0000","last_change":"2024-04-18T10:38:48.531482+0000","last_active":"2024-04-18T10:43:47.399120+0000","last_peered":"2024-04-18T10:43:47.399120+0000","last_clean":"2024-04-18T10:43:47.399120+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:43:47.399120+0000","last_undegraded":"2024-04-18T10:43:47.399120+0000","last_fullsized":"2024-04-18T10:43:47.399120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:13:25.170588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":514,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445228+0000","last_change":"2024-04-18T10:38:46.523785+0000","last_active":"2024-04-18T10:43:51.445228+0000","last_peered":"2024-04-18T10:43:51.445228+0000","last_clean":"2024-04-18T10:43:51.445228+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:43:51.445228+0000","last_undegraded":"2024-04-18T10:43:51.445228+0000","last_fullsized":"2024-04-18T10:43:51.445228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'997","reported_seq":1041,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.375424+0000","last_change":"2024-04-18T10:38:48.528981+0000","last_active":"2024-04-18T10:43:49.375424+0000","last_peered":"2024-04-18T10:43:49.375424+0000","last_clean":"2024-04-18T10:43:49.375424+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:43:49.375424+0000","last_undegraded":"2024-04-18T10:43:49.375424+0000","last_fullsized":"2024-04-18T10:43:49.375424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:20:44.914726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":424,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446824+0000","last_change":"2024-04-18T10:39:29.505858+0000","last_active":"2024-04-18T10:43:51.446824+0000","last_peered":"2024-04-18T10:43:51.446824+0000","last_clean":"2024-04-18T10:43:51.446824+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:43:51.446824+0000","last_undegraded":"2024-04-18T10:43:51.446824+0000","last_fullsized":"2024-04-18T10:43:51.446824+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:40:31.972849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'63","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.398967+0000","last_change":"2024-04-18T10:38:48.521507+0000","last_active":"2024-04-18T10:43:47.398967+0000","last_peered":"2024-04-18T10:43:47.398967+0000","last_clean":"2024-04-18T10:43:47.398967+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:43:47.398967+0000","last_undegraded":"2024-04-18T10:43:47.398967+0000","last_fullsized":"2024-04-18T10:43:47.398967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449413+0000","last_change":"2024-04-18T10:38:48.528936+0000","last_active":"2024-04-18T10:43:51.449413+0000","last_peered":"2024-04-18T10:43:51.449413+0000","last_clean":"2024-04-18T10:43:51.449413+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:43:51.449413+0000","last_undegraded":"2024-04-18T10:43:51.449413+0000","last_fullsized":"2024-04-18T10:43:51.449413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:03:47.761656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'328","reported_seq":362,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.366130+0000","last_change":"2024-04-18T10:38:48.528847+0000","last_active":"2024-04-18T10:43:47.366130+0000","last_peered":"2024-04-18T10:43:47.366130+0000","last_clean":"2024-04-18T10:43:47.366130+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:43:47.366130+0000","last_undegraded":"2024-04-18T10:43:47.366130+0000","last_fullsized":"2024-04-18T10:43:47.366130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:52:18.159291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":630,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.431598+0000","last_change":"2024-04-18T10:38:48.525442+0000","last_active":"2024-04-18T10:43:51.431598+0000","last_peered":"2024-04-18T10:43:51.431598+0000","last_clean":"2024-04-18T10:43:51.431598+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:43:51.431598+0000","last_undegraded":"2024-04-18T10:43:51.431598+0000","last_fullsized":"2024-04-18T10:43:51.431598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:50:01.154765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'120","reported_seq":161,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.378061+0000","last_change":"2024-04-18T10:38:48.529744+0000","last_active":"2024-04-18T10:43:49.378061+0000","last_peered":"2024-04-18T10:43:49.378061+0000","last_clean":"2024-04-18T10:43:49.378061+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:43:49.378061+0000","last_undegraded":"2024-04-18T10:43:49.378061+0000","last_fullsized":"2024-04-18T10:43:49.378061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":524,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451542+0000","last_change":"2024-04-18T10:38:48.530788+0000","last_active":"2024-04-18T10:43:51.451542+0000","last_peered":"2024-04-18T10:43:51.451542+0000","last_clean":"2024-04-18T10:43:51.451542+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:43:51.451542+0000","last_undegraded":"2024-04-18T10:43:51.451542+0000","last_fullsized":"2024-04-18T10:43:51.451542+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:15:34.881473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'365","reported_seq":407,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.348545+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:43:51.348545+0000","last_peered":"2024-04-18T10:43:51.348545+0000","last_clean":"2024-04-18T10:43:51.348545+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:43:51.348545+0000","last_undegraded":"2024-04-18T10:43:51.348545+0000","last_fullsized":"2024-04-18T10:43:51.348545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:27:46.735369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453855+0000","last_change":"2024-04-18T10:38:48.528009+0000","last_active":"2024-04-18T10:43:51.453855+0000","last_peered":"2024-04-18T10:43:51.453855+0000","last_clean":"2024-04-18T10:43:51.453855+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:43:51.453855+0000","last_undegraded":"2024-04-18T10:43:51.453855+0000","last_fullsized":"2024-04-18T10:43:51.453855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:42:02.092332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'454","reported_seq":500,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.430066+0000","last_change":"2024-04-18T10:38:48.523218+0000","last_active":"2024-04-18T10:43:45.430066+0000","last_peered":"2024-04-18T10:43:45.430066+0000","last_clean":"2024-04-18T10:43:45.430066+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:43:45.430066+0000","last_undegraded":"2024-04-18T10:43:45.430066+0000","last_fullsized":"2024-04-18T10:43:45.430066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:15:59.389767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":430,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450572+0000","last_change":"2024-04-18T10:38:48.524990+0000","last_active":"2024-04-18T10:43:51.450572+0000","last_peered":"2024-04-18T10:43:51.450572+0000","last_clean":"2024-04-18T10:43:51.450572+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:43:51.450572+0000","last_undegraded":"2024-04-18T10:43:51.450572+0000","last_fullsized":"2024-04-18T10:43:51.450572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:13:40.543145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'52","reported_seq":89,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.375559+0000","last_change":"2024-04-18T10:38:48.530631+0000","last_active":"2024-04-18T10:43:49.375559+0000","last_peered":"2024-04-18T10:43:49.375559+0000","last_clean":"2024-04-18T10:43:49.375559+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:43:49.375559+0000","last_undegraded":"2024-04-18T10:43:49.375559+0000","last_fullsized":"2024-04-18T10:43:49.375559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":485,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438348+0000","last_change":"2024-04-18T10:38:48.526748+0000","last_active":"2024-04-18T10:43:51.438348+0000","last_peered":"2024-04-18T10:43:51.438348+0000","last_clean":"2024-04-18T10:43:51.438348+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:43:51.438348+0000","last_undegraded":"2024-04-18T10:43:51.438348+0000","last_fullsized":"2024-04-18T10:43:51.438348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:34:11.074933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":103,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.428382+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:43:45.428382+0000","last_peered":"2024-04-18T10:43:45.428382+0000","last_clean":"2024-04-18T10:43:45.428382+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:43:45.428382+0000","last_undegraded":"2024-04-18T10:43:45.428382+0000","last_fullsized":"2024-04-18T10:43:45.428382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:39:56.234231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445646+0000","last_change":"2024-04-18T10:38:48.522750+0000","last_active":"2024-04-18T10:43:51.445646+0000","last_peered":"2024-04-18T10:43:51.445646+0000","last_clean":"2024-04-18T10:43:51.445646+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:43:51.445646+0000","last_undegraded":"2024-04-18T10:43:51.445646+0000","last_fullsized":"2024-04-18T10:43:51.445646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'70","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367076+0000","last_change":"2024-04-18T10:38:46.524444+0000","last_active":"2024-04-18T10:43:47.367076+0000","last_peered":"2024-04-18T10:43:47.367076+0000","last_clean":"2024-04-18T10:43:47.367076+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:43:47.367076+0000","last_undegraded":"2024-04-18T10:43:47.367076+0000","last_fullsized":"2024-04-18T10:43:47.367076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:29:31.257203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448235+0000","last_change":"2024-04-18T10:38:48.524076+0000","last_active":"2024-04-18T10:43:51.448235+0000","last_peered":"2024-04-18T10:43:51.448235+0000","last_clean":"2024-04-18T10:43:51.448235+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:43:51.448235+0000","last_undegraded":"2024-04-18T10:43:51.448235+0000","last_fullsized":"2024-04-18T10:43:51.448235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:20:58.250235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'251","reported_seq":287,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.453588+0000","last_change":"2024-04-18T10:38:46.523417+0000","last_active":"2024-04-18T10:43:48.453588+0000","last_peered":"2024-04-18T10:43:48.453588+0000","last_clean":"2024-04-18T10:43:48.453588+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:43:48.453588+0000","last_undegraded":"2024-04-18T10:43:48.453588+0000","last_fullsized":"2024-04-18T10:43:48.453588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":476,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450051+0000","last_change":"2024-04-18T10:38:48.528752+0000","last_active":"2024-04-18T10:43:51.450051+0000","last_peered":"2024-04-18T10:43:51.450051+0000","last_clean":"2024-04-18T10:43:51.450051+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:43:51.450051+0000","last_undegraded":"2024-04-18T10:43:51.450051+0000","last_fullsized":"2024-04-18T10:43:51.450051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:31:20.382051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'340","reported_seq":383,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.428802+0000","last_change":"2024-04-18T10:38:47.516780+0000","last_active":"2024-04-18T10:43:45.428802+0000","last_peered":"2024-04-18T10:43:45.428802+0000","last_clean":"2024-04-18T10:43:45.428802+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:43:45.428802+0000","last_undegraded":"2024-04-18T10:43:45.428802+0000","last_fullsized":"2024-04-18T10:43:45.428802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:26.639180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":505,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450036+0000","last_change":"2024-04-18T10:38:48.537651+0000","last_active":"2024-04-18T10:43:51.450036+0000","last_peered":"2024-04-18T10:43:51.450036+0000","last_clean":"2024-04-18T10:43:51.450036+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:43:51.450036+0000","last_undegraded":"2024-04-18T10:43:51.450036+0000","last_fullsized":"2024-04-18T10:43:51.450036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:18.675030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'565","reported_seq":606,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.410751+0000","last_change":"2024-04-18T10:38:48.528245+0000","last_active":"2024-04-18T10:43:47.410751+0000","last_peered":"2024-04-18T10:43:47.410751+0000","last_clean":"2024-04-18T10:43:47.410751+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:43:47.410751+0000","last_undegraded":"2024-04-18T10:43:47.410751+0000","last_fullsized":"2024-04-18T10:43:47.410751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:22:52.532246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452030+0000","last_change":"2024-04-18T10:38:48.528767+0000","last_active":"2024-04-18T10:43:51.452030+0000","last_peered":"2024-04-18T10:43:51.452030+0000","last_clean":"2024-04-18T10:43:51.452030+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:43:51.452030+0000","last_undegraded":"2024-04-18T10:43:51.452030+0000","last_fullsized":"2024-04-18T10:43:51.452030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:31:30.566152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":97,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.405829+0000","last_change":"2024-04-18T10:38:48.527940+0000","last_active":"2024-04-18T10:43:48.405829+0000","last_peered":"2024-04-18T10:43:48.405829+0000","last_clean":"2024-04-18T10:43:48.405829+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:43:48.405829+0000","last_undegraded":"2024-04-18T10:43:48.405829+0000","last_fullsized":"2024-04-18T10:43:48.405829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":547,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.412556+0000","last_change":"2024-04-18T10:38:46.522705+0000","last_active":"2024-04-18T10:43:51.412556+0000","last_peered":"2024-04-18T10:43:51.412556+0000","last_clean":"2024-04-18T10:43:51.412556+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:43:51.412556+0000","last_undegraded":"2024-04-18T10:43:51.412556+0000","last_fullsized":"2024-04-18T10:43:51.412556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'170","reported_seq":215,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367215+0000","last_change":"2024-04-18T10:38:48.523093+0000","last_active":"2024-04-18T10:43:47.367215+0000","last_peered":"2024-04-18T10:43:47.367215+0000","last_clean":"2024-04-18T10:43:47.367215+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:43:47.367215+0000","last_undegraded":"2024-04-18T10:43:47.367215+0000","last_fullsized":"2024-04-18T10:43:47.367215+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:59:20.206383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":522,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.428669+0000","last_change":"2024-04-18T10:38:48.528094+0000","last_active":"2024-04-18T10:43:51.428669+0000","last_peered":"2024-04-18T10:43:51.428669+0000","last_clean":"2024-04-18T10:43:51.428669+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:43:51.428669+0000","last_undegraded":"2024-04-18T10:43:51.428669+0000","last_fullsized":"2024-04-18T10:43:51.428669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'249","reported_seq":289,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.386774+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:43:47.386774+0000","last_peered":"2024-04-18T10:43:47.386774+0000","last_clean":"2024-04-18T10:43:47.386774+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:43:47.386774+0000","last_undegraded":"2024-04-18T10:43:47.386774+0000","last_fullsized":"2024-04-18T10:43:47.386774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:47:34.182153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":483,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453830+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:43:51.453830+0000","last_peered":"2024-04-18T10:43:51.453830+0000","last_clean":"2024-04-18T10:43:51.453830+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:43:51.453830+0000","last_undegraded":"2024-04-18T10:43:51.453830+0000","last_fullsized":"2024-04-18T10:43:51.453830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:04:08.173779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'62","reported_seq":99,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.389733+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:43:47.389733+0000","last_peered":"2024-04-18T10:43:47.389733+0000","last_clean":"2024-04-18T10:43:47.389733+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:43:47.389733+0000","last_undegraded":"2024-04-18T10:43:47.389733+0000","last_fullsized":"2024-04-18T10:43:47.389733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:04.645176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":404,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451809+0000","last_change":"2024-04-18T10:38:48.528656+0000","last_active":"2024-04-18T10:43:51.451809+0000","last_peered":"2024-04-18T10:43:51.451809+0000","last_clean":"2024-04-18T10:43:51.451809+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:43:51.451809+0000","last_undegraded":"2024-04-18T10:43:51.451809+0000","last_fullsized":"2024-04-18T10:43:51.451809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:53.065322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'492","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.368795+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:43:47.368795+0000","last_peered":"2024-04-18T10:43:47.368795+0000","last_clean":"2024-04-18T10:43:47.368795+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:43:47.368795+0000","last_undegraded":"2024-04-18T10:43:47.368795+0000","last_fullsized":"2024-04-18T10:43:47.368795+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:06:10.188847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452204+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:43:51.452204+0000","last_peered":"2024-04-18T10:43:51.452204+0000","last_clean":"2024-04-18T10:43:51.452204+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:43:51.452204+0000","last_undegraded":"2024-04-18T10:43:51.452204+0000","last_fullsized":"2024-04-18T10:43:51.452204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:39:47.463040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.502609+0000","last_change":"2024-04-18T10:38:46.521667+0000","last_active":"2024-04-18T10:39:29.502609+0000","last_peered":"2024-04-18T10:39:29.502609+0000","last_clean":"2024-04-18T10:39:29.502609+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:39:29.502609+0000","last_undegraded":"2024-04-18T10:39:29.502609+0000","last_fullsized":"2024-04-18T10:39:29.502609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:58:33.365320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'347","reported_seq":382,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.458459+0000","last_change":"2024-04-18T10:38:48.518724+0000","last_active":"2024-04-18T10:43:48.458459+0000","last_peered":"2024-04-18T10:43:48.458459+0000","last_clean":"2024-04-18T10:43:48.458459+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:43:48.458459+0000","last_undegraded":"2024-04-18T10:43:48.458459+0000","last_fullsized":"2024-04-18T10:43:48.458459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:42.824622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":400,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451458+0000","last_change":"2024-04-18T10:38:48.529610+0000","last_active":"2024-04-18T10:43:51.451458+0000","last_peered":"2024-04-18T10:43:51.451458+0000","last_clean":"2024-04-18T10:43:51.451458+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:43:51.451458+0000","last_undegraded":"2024-04-18T10:43:51.451458+0000","last_fullsized":"2024-04-18T10:43:51.451458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:22:33.897416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639298+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:39:29.639298+0000","last_peered":"2024-04-18T10:39:29.639298+0000","last_clean":"2024-04-18T10:39:29.639298+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:39:29.639298+0000","last_undegraded":"2024-04-18T10:39:29.639298+0000","last_fullsized":"2024-04-18T10:39:29.639298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:33.571914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'70","reported_seq":110,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.376329+0000","last_change":"2024-04-18T10:38:47.513344+0000","last_active":"2024-04-18T10:43:49.376329+0000","last_peered":"2024-04-18T10:43:49.376329+0000","last_clean":"2024-04-18T10:43:49.376329+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:43:49.376329+0000","last_undegraded":"2024-04-18T10:43:49.376329+0000","last_fullsized":"2024-04-18T10:43:49.376329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":470,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445285+0000","last_change":"2024-04-18T10:38:47.515107+0000","last_active":"2024-04-18T10:43:51.445285+0000","last_peered":"2024-04-18T10:43:51.445285+0000","last_clean":"2024-04-18T10:43:51.445285+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:43:51.445285+0000","last_undegraded":"2024-04-18T10:43:51.445285+0000","last_fullsized":"2024-04-18T10:43:51.445285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:10:14.119655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.499561+0000","last_change":"2024-04-18T10:38:48.520896+0000","last_active":"2024-04-18T10:39:29.499561+0000","last_peered":"2024-04-18T10:39:29.499561+0000","last_clean":"2024-04-18T10:39:29.499561+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:39:29.499561+0000","last_undegraded":"2024-04-18T10:39:29.499561+0000","last_fullsized":"2024-04-18T10:39:29.499561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:57:03.533750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'433","reported_seq":468,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.414756+0000","last_change":"2024-04-18T10:38:47.519693+0000","last_active":"2024-04-18T10:43:46.414756+0000","last_peered":"2024-04-18T10:43:46.414756+0000","last_clean":"2024-04-18T10:43:46.414756+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:43:46.414756+0000","last_undegraded":"2024-04-18T10:43:46.414756+0000","last_fullsized":"2024-04-18T10:43:46.414756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:26:34.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":414,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443347+0000","last_change":"2024-04-18T10:38:46.520198+0000","last_active":"2024-04-18T10:43:51.443347+0000","last_peered":"2024-04-18T10:43:51.443347+0000","last_clean":"2024-04-18T10:43:51.443347+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:43:51.443347+0000","last_undegraded":"2024-04-18T10:43:51.443347+0000","last_fullsized":"2024-04-18T10:43:51.443347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:18:11.005073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639632+0000","last_change":"2024-04-18T10:38:48.522906+0000","last_active":"2024-04-18T10:39:29.639632+0000","last_peered":"2024-04-18T10:39:29.639632+0000","last_clean":"2024-04-18T10:39:29.639632+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:39:29.639632+0000","last_undegraded":"2024-04-18T10:39:29.639632+0000","last_fullsized":"2024-04-18T10:39:29.639632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:14.552416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'115","reported_seq":194,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.501781+0000","last_change":"2024-04-18T10:38:46.507608+0000","last_active":"2024-04-18T10:39:29.501781+0000","last_peered":"2024-04-18T10:39:29.501781+0000","last_clean":"2024-04-18T10:39:29.501781+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:39:29.501781+0000","last_undegraded":"2024-04-18T10:39:29.501781+0000","last_fullsized":"2024-04-18T10:39:29.501781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:46:55.362151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'526","reported_seq":563,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.404828+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:43:45.404828+0000","last_peered":"2024-04-18T10:43:45.404828+0000","last_clean":"2024-04-18T10:43:45.404828+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:43:45.404828+0000","last_undegraded":"2024-04-18T10:43:45.404828+0000","last_fullsized":"2024-04-18T10:43:45.404828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:23.071233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":541,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453345+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:43:51.453345+0000","last_peered":"2024-04-18T10:43:51.453345+0000","last_clean":"2024-04-18T10:43:51.453345+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:43:51.453345+0000","last_undegraded":"2024-04-18T10:43:51.453345+0000","last_fullsized":"2024-04-18T10:43:51.453345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:01:03.109484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.639111+0000","last_change":"2024-04-18T10:38:48.529162+0000","last_active":"2024-04-18T10:39:29.639111+0000","last_peered":"2024-04-18T10:39:29.639111+0000","last_clean":"2024-04-18T10:39:29.639111+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:39:29.639111+0000","last_undegraded":"2024-04-18T10:39:29.639111+0000","last_fullsized":"2024-04-18T10:39:29.639111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:18:10.267046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'262","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.366594+0000","last_change":"2024-04-18T10:38:47.513300+0000","last_active":"2024-04-18T10:43:49.366594+0000","last_peered":"2024-04-18T10:43:49.366594+0000","last_clean":"2024-04-18T10:43:49.366594+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:43:49.366594+0000","last_undegraded":"2024-04-18T10:43:49.366594+0000","last_fullsized":"2024-04-18T10:43:49.366594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":524,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445315+0000","last_change":"2024-04-18T10:38:46.523777+0000","last_active":"2024-04-18T10:43:51.445315+0000","last_peered":"2024-04-18T10:43:51.445315+0000","last_clean":"2024-04-18T10:43:51.445315+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:43:51.445315+0000","last_undegraded":"2024-04-18T10:43:51.445315+0000","last_fullsized":"2024-04-18T10:43:51.445315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.640426+0000","last_change":"2024-04-18T10:38:48.526577+0000","last_active":"2024-04-18T10:39:29.640426+0000","last_peered":"2024-04-18T10:39:29.640426+0000","last_clean":"2024-04-18T10:39:29.640426+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:39:29.640426+0000","last_undegraded":"2024-04-18T10:39:29.640426+0000","last_fullsized":"2024-04-18T10:39:29.640426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:34:26.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":90,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.453422+0000","last_change":"2024-04-18T10:38:47.515422+0000","last_active":"2024-04-18T10:43:48.453422+0000","last_peered":"2024-04-18T10:43:48.453422+0000","last_clean":"2024-04-18T10:43:48.453422+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:43:48.453422+0000","last_undegraded":"2024-04-18T10:43:48.453422+0000","last_fullsized":"2024-04-18T10:43:48.453422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.811949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":517,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446355+0000","last_change":"2024-04-18T10:38:47.513292+0000","last_active":"2024-04-18T10:43:51.446355+0000","last_peered":"2024-04-18T10:43:51.446355+0000","last_clean":"2024-04-18T10:43:51.446355+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:43:51.446355+0000","last_undegraded":"2024-04-18T10:43:51.446355+0000","last_fullsized":"2024-04-18T10:43:51.446355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'62","reported_seq":103,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.431314+0000","last_change":"2024-04-18T10:38:48.525344+0000","last_active":"2024-04-18T10:43:48.431314+0000","last_peered":"2024-04-18T10:43:48.431314+0000","last_clean":"2024-04-18T10:43:48.431314+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:43:48.431314+0000","last_undegraded":"2024-04-18T10:43:48.431314+0000","last_fullsized":"2024-04-18T10:43:48.431314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:13:06.871047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.503660+0000","last_change":"2024-04-18T10:38:46.521665+0000","last_active":"2024-04-18T10:39:29.503660+0000","last_peered":"2024-04-18T10:39:29.503660+0000","last_clean":"2024-04-18T10:39:29.503660+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:39:29.503660+0000","last_undegraded":"2024-04-18T10:39:29.503660+0000","last_fullsized":"2024-04-18T10:39:29.503660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:14:41.732694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450142+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:43:51.450142+0000","last_peered":"2024-04-18T10:43:51.450142+0000","last_clean":"2024-04-18T10:43:51.450142+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:43:51.450142+0000","last_undegraded":"2024-04-18T10:43:51.450142+0000","last_fullsized":"2024-04-18T10:43:51.450142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:49:16.195736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-18T10:39:29.640642+0000","last_change":"2024-04-18T10:38:48.519133+0000","last_active":"2024-04-18T10:39:29.640642+0000","last_peered":"2024-04-18T10:39:29.640642+0000","last_clean":"2024-04-18T10:39:29.640642+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:39:29.640642+0000","last_undegraded":"2024-04-18T10:39:29.640642+0000","last_fullsized":"2024-04-18T10:39:29.640642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:27:47.684869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":121,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:52.504153+0000","last_change":"2024-04-18T10:38:46.523957+0000","last_active":"2024-04-18T10:43:52.504153+0000","last_peered":"2024-04-18T10:43:52.504153+0000","last_clean":"2024-04-18T10:43:52.504153+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:43:52.504153+0000","last_undegraded":"2024-04-18T10:43:52.504153+0000","last_fullsized":"2024-04-18T10:43:52.504153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":446,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451210+0000","last_change":"2024-04-18T10:38:48.520854+0000","last_active":"2024-04-18T10:43:51.451210+0000","last_peered":"2024-04-18T10:43:51.451210+0000","last_clean":"2024-04-18T10:43:51.451210+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:43:51.451210+0000","last_undegraded":"2024-04-18T10:43:51.451210+0000","last_fullsized":"2024-04-18T10:43:51.451210+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:45:27.953816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'72","reported_seq":112,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.392681+0000","last_change":"2024-04-18T10:38:48.527898+0000","last_active":"2024-04-18T10:43:46.392681+0000","last_peered":"2024-04-18T10:43:46.392681+0000","last_clean":"2024-04-18T10:43:46.392681+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:43:46.392681+0000","last_undegraded":"2024-04-18T10:43:46.392681+0000","last_fullsized":"2024-04-18T10:43:46.392681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":441,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447405+0000","last_change":"2024-04-18T10:38:47.514434+0000","last_active":"2024-04-18T10:43:51.447405+0000","last_peered":"2024-04-18T10:43:51.447405+0000","last_clean":"2024-04-18T10:43:51.447405+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:43:51.447405+0000","last_undegraded":"2024-04-18T10:43:51.447405+0000","last_fullsized":"2024-04-18T10:43:51.447405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:22:40.288392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'343","reported_seq":383,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.367534+0000","last_change":"2024-04-18T10:38:46.520352+0000","last_active":"2024-04-18T10:43:47.367534+0000","last_peered":"2024-04-18T10:43:47.367534+0000","last_clean":"2024-04-18T10:43:47.367534+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:43:47.367534+0000","last_undegraded":"2024-04-18T10:43:47.367534+0000","last_fullsized":"2024-04-18T10:43:47.367534+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:55:53.724349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":409,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452635+0000","last_change":"2024-04-18T10:38:48.528181+0000","last_active":"2024-04-18T10:43:51.452635+0000","last_peered":"2024-04-18T10:43:51.452635+0000","last_clean":"2024-04-18T10:43:51.452635+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:43:51.452635+0000","last_undegraded":"2024-04-18T10:43:51.452635+0000","last_fullsized":"2024-04-18T10:43:51.452635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:38.920913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'287","reported_seq":332,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.414294+0000","last_change":"2024-04-18T10:38:48.526382+0000","last_active":"2024-04-18T10:43:47.414294+0000","last_peered":"2024-04-18T10:43:47.414294+0000","last_clean":"2024-04-18T10:43:47.414294+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:43:47.414294+0000","last_undegraded":"2024-04-18T10:43:47.414294+0000","last_fullsized":"2024-04-18T10:43:47.414294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:36:19.412539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":466,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445781+0000","last_change":"2024-04-18T10:39:29.508423+0000","last_active":"2024-04-18T10:43:51.445781+0000","last_peered":"2024-04-18T10:43:51.445781+0000","last_clean":"2024-04-18T10:43:51.445781+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:43:51.445781+0000","last_undegraded":"2024-04-18T10:43:51.445781+0000","last_fullsized":"2024-04-18T10:43:51.445781+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:56:19.178512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'110","reported_seq":147,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.412029+0000","last_change":"2024-04-18T10:38:48.521841+0000","last_active":"2024-04-18T10:43:48.412029+0000","last_peered":"2024-04-18T10:43:48.412029+0000","last_clean":"2024-04-18T10:43:48.412029+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:43:48.412029+0000","last_undegraded":"2024-04-18T10:43:48.412029+0000","last_fullsized":"2024-04-18T10:43:48.412029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:44:53.826636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":515,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449133+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:43:51.449133+0000","last_peered":"2024-04-18T10:43:51.449133+0000","last_clean":"2024-04-18T10:43:51.449133+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:43:51.449133+0000","last_undegraded":"2024-04-18T10:43:51.449133+0000","last_fullsized":"2024-04-18T10:43:51.449133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:44.601528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'99","reported_seq":133,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.427050+0000","last_change":"2024-04-18T10:38:46.523460+0000","last_active":"2024-04-18T10:43:47.427050+0000","last_peered":"2024-04-18T10:43:47.427050+0000","last_clean":"2024-04-18T10:43:47.427050+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:43:47.427050+0000","last_undegraded":"2024-04-18T10:43:47.427050+0000","last_fullsized":"2024-04-18T10:43:47.427050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":509,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448265+0000","last_change":"2024-04-18T10:38:47.514386+0000","last_active":"2024-04-18T10:43:51.448265+0000","last_peered":"2024-04-18T10:43:51.448265+0000","last_clean":"2024-04-18T10:43:51.448265+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:43:51.448265+0000","last_undegraded":"2024-04-18T10:43:51.448265+0000","last_fullsized":"2024-04-18T10:43:51.448265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:25.189215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":499,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446535+0000","last_change":"2024-04-18T10:38:47.515056+0000","last_active":"2024-04-18T10:43:51.446535+0000","last_peered":"2024-04-18T10:43:51.446535+0000","last_clean":"2024-04-18T10:43:51.446535+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:43:51.446535+0000","last_undegraded":"2024-04-18T10:43:51.446535+0000","last_fullsized":"2024-04-18T10:43:51.446535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:09:39.192070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":438,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447899+0000","last_change":"2024-04-18T10:39:29.506707+0000","last_active":"2024-04-18T10:43:51.447899+0000","last_peered":"2024-04-18T10:43:51.447899+0000","last_clean":"2024-04-18T10:43:51.447899+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:43:51.447899+0000","last_undegraded":"2024-04-18T10:43:51.447899+0000","last_fullsized":"2024-04-18T10:43:51.447899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:15:49.305625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":565,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.429252+0000","last_change":"2024-04-18T10:38:48.530823+0000","last_active":"2024-04-18T10:43:51.429252+0000","last_peered":"2024-04-18T10:43:51.429252+0000","last_clean":"2024-04-18T10:43:51.429252+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:43:51.429252+0000","last_undegraded":"2024-04-18T10:43:51.429252+0000","last_fullsized":"2024-04-18T10:43:51.429252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450748+0000","last_change":"2024-04-18T10:38:48.528090+0000","last_active":"2024-04-18T10:43:51.450748+0000","last_peered":"2024-04-18T10:43:51.450748+0000","last_clean":"2024-04-18T10:43:51.450748+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:43:51.450748+0000","last_undegraded":"2024-04-18T10:43:51.450748+0000","last_fullsized":"2024-04-18T10:43:51.450748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:18:27.052176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445610+0000","last_change":"2024-04-18T10:38:47.515405+0000","last_active":"2024-04-18T10:43:51.445610+0000","last_peered":"2024-04-18T10:43:51.445610+0000","last_clean":"2024-04-18T10:43:51.445610+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:43:51.445610+0000","last_undegraded":"2024-04-18T10:43:51.445610+0000","last_fullsized":"2024-04-18T10:43:51.445610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:18:31.550014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8497,"ondisk_log_size":8497,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953537,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.35399999999999998,"15min":0.37},"min":{"1min":0.16700000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.35099999999999998,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.36399999999999999,"15min":0.38200000000000001},"min":{"1min":0.216,"5min":0.187,"15min":0.187},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.24399999999999999}]},{"osd":1,"last update":"Thu Apr 18 10:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.20499999999999999,"5min":0.184,"15min":0.184},"max":{"1min":1.7849999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.247,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.496,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.39400000000000002,"15min":0.42799999999999999},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.47899999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.248,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.41599999999999998,"5min":4.181,"15min":4.181},"last":0.29499999999999998}]}]},{"osd":2,"up_from":31,"seq":133143986241,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.17799999999999999,"5min":0.161,"15min":0.161},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.311},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.71199999999999997,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.29699999999999999}]},{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.35299999999999998,"15min":0.38100000000000001},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.379,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.39900000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.373,"15min":0.40500000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.40999999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.38},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.42999999999999999},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.373}]}]},{"osd":0,"up_from":29,"seq":124554051650,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34999999999999998,"15min":0.33600000000000002},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.216,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.628,"5min":1.224,"15min":1.224},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38400000000000001,"15min":0.35799999999999998},"min":{"1min":0.20599999999999999,"5min":0.19,"15min":0.19},"max":{"1min":1.514,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.22500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.59499999999999997,"5min":1.173,"15min":1.173},"last":0.378}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.38300000000000001,"15min":0.41799999999999998},"min":{"1min":0.23200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.73599999999999999,"5min":1.204,"15min":1.204},"last":0.311},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.51500000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.27900000000000003}]}]},{"osd":1,"up_from":30,"seq":128849018945,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.34899999999999998},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.33900000000000002,"15min":0.35899999999999999},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.325,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.255}]},{"osd":3,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.98599999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.9970000000000001,"5min":2.173,"15min":2.173},"last":0.31900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:44:05.125 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.125 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.125 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.125 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.125 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.125 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.126 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.126 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.126 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.126 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.126 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.126 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.126 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.126 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.126 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.127 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.127 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.127 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.127 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.127 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.127 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.127 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.127 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.127 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.128 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.128 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.128 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.128 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.128 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.128 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.128 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.128 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.129 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.130 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.130 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.130 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.130 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.130 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.130 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.130 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.130 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.130 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.131 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.131 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.131 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.131 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.131 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.131 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.131 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.131 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.131 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.132 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.132 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.132 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.132 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.132 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.132 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.132 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.132 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.132 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.133 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.133 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.133 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.133 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.133 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.133 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.133 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-18T10:35:52.382960+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.133 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.133 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.134 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.134 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.134 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.134 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.134 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.134 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.134 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.134 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.134 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.135 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.136 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.136 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.136 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.136 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.136 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.136 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.136 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.136 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:05.136 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T10:44:25.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:44:25.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.271+0000 7f72ff874700 1 Processor -- start 2024-04-18T10:44:25.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.271+0000 7f72ff874700 1 -- start start 2024-04-18T10:44:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72ff874700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f806fa70 0x7f72f80a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72ff874700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f72f80a7920 0x7f72f813e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72ff874700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f80a9870 con 0x7f72f813ee70 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72ff874700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f80a6de0 con 0x7f72f80a7920 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72ff874700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80a8790 con 0x7f72f806fa70 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72fce0f700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f72f80a7920 0x7f72f813e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72fd610700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f806fa70 0x7f72f80a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72fde11700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f72f813ee70 0x7f72f80a5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38426/0 (socket says 172.21.15.31:38426) 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72fde11700 1 -- 172.21.15.31:0/454151630 learned_addr learned my addr 172.21.15.31:0/454151630 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72fce0f700 1 -- 172.21.15.31:0/454151630 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f806fa70 msgr2=0x7f72f80a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72fce0f700 1 --2- 172.21.15.31:0/454151630 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f806fa70 0x7f72f80a8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72fce0f700 1 -- 172.21.15.31:0/454151630 >> v1:172.21.15.31:6789/0 conn(0x7f72f813ee70 legacy=0x7f72f80a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72effff700 1 -- 172.21.15.31:0/454151630 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172778556 0 0) 0x7f72f80a9870 con 0x7f72f813ee70 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72fce0f700 1 -- 172.21.15.31:0/454151630 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f80aa440 con 0x7f72f80a7920 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.272+0000 7f72fd610700 1 --2- 172.21.15.31:0/454151630 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f806fa70 0x7f72f80a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72fce0f700 1 --2- 172.21.15.31:0/454151630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f80a7920 0x7f72f813e930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f72f40098e0 tx=0x7f72f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4f3784b8528deb server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72effff700 1 -- 172.21.15.31:0/454151630 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400b640 con 0x7f72f80a7920 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72effff700 1 -- 172.21.15.31:0/454151630 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f400b7a0 con 0x7f72f80a7920 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72effff700 1 -- 172.21.15.31:0/454151630 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400bb40 con 0x7f72f80a7920 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72ff874700 1 -- 172.21.15.31:0/454151630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f80a7920 msgr2=0x7f72f813e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72ff874700 1 --2- 172.21.15.31:0/454151630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f80a7920 0x7f72f813e930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f72f40098e0 tx=0x7f72f40091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72ff874700 1 -- 172.21.15.31:0/454151630 shutdown_connections 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72ff874700 1 --2- 172.21.15.31:0/454151630 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f806fa70 0x7f72f80a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72ff874700 1 --2- 172.21.15.31:0/454151630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f80a7920 0x7f72f813e930 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72ff874700 1 -- 172.21.15.31:0/454151630 >> 172.21.15.31:0/454151630 conn(0x7f72f8063970 msgr2=0x7f72f806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72ff874700 1 -- 172.21.15.31:0/454151630 shutdown_connections 2024-04-18T10:44:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.273+0000 7f72ff874700 1 -- 172.21.15.31:0/454151630 wait complete. 2024-04-18T10:44:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.274+0000 7f72ff874700 1 Processor -- start 2024-04-18T10:44:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.274+0000 7f72ff874700 1 -- start start 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72ff874700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f806fa70 0x7f72f80afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72ff874700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f80a7920 0x7f72f80aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72ff874700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f813ee70 0x7f72f814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72ff874700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80af360 con 0x7f72f806fa70 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72ff874700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80af5c0 con 0x7f72f813ee70 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72ff874700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80ae6c0 con 0x7f72f80a7920 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72fd610700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f806fa70 0x7f72f80afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72fce0f700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f80a7920 0x7f72f80aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72fd610700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f806fa70 0x7f72f80afb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59090/0 (socket says 172.21.15.31:59090) 2024-04-18T10:44:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72fd610700 1 -- 172.21.15.31:0/4055910130 learned_addr learned my addr 172.21.15.31:0/4055910130 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72fde11700 1 --2- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f813ee70 0x7f72f814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72fce0f700 1 -- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f813ee70 msgr2=0x7f72f814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.275+0000 7f72fce0f700 1 --2- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f813ee70 0x7f72f814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72fce0f700 1 -- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f806fa70 msgr2=0x7f72f80afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72fce0f700 1 --2- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f806fa70 0x7f72f80afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72fce0f700 1 -- 172.21.15.31:0/4055910130 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8009420 con 0x7f72f80a7920 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72fd610700 1 --2- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f806fa70 0x7f72f80afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72fce0f700 1 --2- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f80a7920 0x7f72f80aee20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f72f4016000 tx=0x7f72f4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72ed7fa700 1 -- 172.21.15.31:0/4055910130 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400bb20 con 0x7f72f80a7920 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72ed7fa700 1 -- 172.21.15.31:0/4055910130 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4000c90 con 0x7f72f80a7920 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f4009420 con 0x7f72f80a7920 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72ed7fa700 1 -- 172.21.15.31:0/4055910130 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4011630 con 0x7f72f80a7920 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.276+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f80ad980 con 0x7f72f80a7920 2024-04-18T10:44:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.277+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f80651b0 con 0x7f72f80a7920 2024-04-18T10:44:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.277+0000 7f72ed7fa700 1 -- 172.21.15.31:0/4055910130 <== mon.2 v2:172.21.15.31:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f72f4011a60 con 0x7f72f80a7920 2024-04-18T10:44:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.277+0000 7f72ed7fa700 1 -- 172.21.15.31:0/4055910130 <== mon.2 v2:172.21.15.31:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f72f405c8f0 con 0x7f72f80a7920 2024-04-18T10:44:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.281+0000 7f72ed7fa700 1 -- 172.21.15.31:0/4055910130 <== mon.2 v2:172.21.15.31:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f72f40064a0 con 0x7f72f80a7920 2024-04-18T10:44:25.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.440+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72f80adbd0 con 0x7f72dc045ef0 2024-04-18T10:44:25.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.447+0000 7f72ed7fa700 1 -- 172.21.15.31:0/4055910130 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275649 (unknown 2965378022 0 2077679448) 0x7f72f80adbd0 con 0x7f72dc045ef0 2024-04-18T10:44:25.451 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:44:25.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 >> v1:172.21.15.31:6816/46601 conn(0x7f72dc045ef0 legacy=0x7f72dc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:25.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f80a7920 msgr2=0x7f72f80aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:25.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 --2- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f80a7920 0x7f72f80aee20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f72f4016000 tx=0x7f72f4017000 comp rx=0 tx=0).stop 2024-04-18T10:44:25.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 shutdown_connections 2024-04-18T10:44:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 --2- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f72f813ee70 0x7f72f814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 --2- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72f806fa70 0x7f72f80afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 --2- 172.21.15.31:0/4055910130 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f72f80a7920 0x7f72f80aee20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 >> 172.21.15.31:0/4055910130 conn(0x7f72f8063970 msgr2=0x7f72f80a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 shutdown_connections 2024-04-18T10:44:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:25.450+0000 7f72ff874700 1 -- 172.21.15.31:0/4055910130 wait complete. 2024-04-18T10:44:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:44:25.463 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-04-18T10:44:24.491624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35089,"ondisk_log_size":35089,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003570"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":523,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452831+0000","last_change":"2024-04-18T10:38:48.515671+0000","last_active":"2024-04-18T10:43:51.452831+0000","last_peered":"2024-04-18T10:43:51.452831+0000","last_clean":"2024-04-18T10:43:51.452831+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:43:51.452831+0000","last_undegraded":"2024-04-18T10:43:51.452831+0000","last_fullsized":"2024-04-18T10:43:51.452831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.529297+0000","last_change":"2024-04-18T10:44:11.529249+0000","last_active":"2024-04-18T10:44:11.529297+0000","last_peered":"2024-04-18T10:44:11.529297+0000","last_clean":"2024-04-18T10:44:11.529297+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:44:11.529297+0000","last_undegraded":"2024-04-18T10:44:11.529297+0000","last_fullsized":"2024-04-18T10:44:11.529297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'425","last_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_deep_scrub":"44'425","last_deep_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.529136+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:31:02.859668+0000","scrub_duration":0.002289952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":432,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.557510+0000","last_change":"2024-04-18T10:44:21.557477+0000","last_active":"2024-04-18T10:44:21.557510+0000","last_peered":"2024-04-18T10:44:21.557510+0000","last_clean":"2024-04-18T10:44:21.557510+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:44:21.557510+0000","last_undegraded":"2024-04-18T10:44:21.557510+0000","last_fullsized":"2024-04-18T10:44:21.557510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.557376+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:19:59.466067+0000","scrub_duration":0.0022859669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":454,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.429724+0000","last_change":"2024-04-18T10:38:46.523213+0000","last_active":"2024-04-18T10:43:51.429724+0000","last_peered":"2024-04-18T10:43:51.429724+0000","last_clean":"2024-04-18T10:43:51.429724+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:43:51.429724+0000","last_undegraded":"2024-04-18T10:43:51.429724+0000","last_fullsized":"2024-04-18T10:43:51.429724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":543,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:22.581671+0000","last_change":"2024-04-18T10:44:22.581628+0000","last_active":"2024-04-18T10:44:22.581671+0000","last_peered":"2024-04-18T10:44:22.581671+0000","last_clean":"2024-04-18T10:44:22.581671+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:44:22.581671+0000","last_undegraded":"2024-04-18T10:44:22.581671+0000","last_fullsized":"2024-04-18T10:44:22.581671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'428","last_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_deep_scrub":"44'428","last_deep_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_clean_scrub_stamp":"2024-04-18T10:44:22.581473+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:42:51.909519+0000","scrub_duration":0.0023658939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":403,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443750+0000","last_change":"2024-04-18T10:39:29.508173+0000","last_active":"2024-04-18T10:43:51.443750+0000","last_peered":"2024-04-18T10:43:51.443750+0000","last_clean":"2024-04-18T10:43:51.443750+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:43:51.443750+0000","last_undegraded":"2024-04-18T10:43:51.443750+0000","last_fullsized":"2024-04-18T10:43:51.443750+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":529,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.334276+0000","last_change":"2024-04-18T10:44:18.334236+0000","last_active":"2024-04-18T10:44:18.334276+0000","last_peered":"2024-04-18T10:44:18.334276+0000","last_clean":"2024-04-18T10:44:18.334276+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:44:18.334276+0000","last_undegraded":"2024-04-18T10:44:18.334276+0000","last_fullsized":"2024-04-18T10:44:18.334276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.334127+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:41:16.742027+0000","scrub_duration":0.0024997970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":478,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.432747+0000","last_change":"2024-04-18T10:38:46.507263+0000","last_active":"2024-04-18T10:43:51.432747+0000","last_peered":"2024-04-18T10:43:51.432747+0000","last_clean":"2024-04-18T10:43:51.432747+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:43:51.432747+0000","last_undegraded":"2024-04-18T10:43:51.432747+0000","last_fullsized":"2024-04-18T10:43:51.432747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":514,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.557807+0000","last_change":"2024-04-18T10:44:11.557779+0000","last_active":"2024-04-18T10:44:11.557807+0000","last_peered":"2024-04-18T10:44:11.557807+0000","last_clean":"2024-04-18T10:44:11.557807+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:44:11.557807+0000","last_undegraded":"2024-04-18T10:44:11.557807+0000","last_fullsized":"2024-04-18T10:44:11.557807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'422","last_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_deep_scrub":"44'422","last_deep_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.557669+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:00:02.279295+0000","scrub_duration":0.0024686619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.144649+0000","last_change":"2024-04-18T10:44:09.144611+0000","last_active":"2024-04-18T10:44:09.144649+0000","last_peered":"2024-04-18T10:44:09.144649+0000","last_clean":"2024-04-18T10:44:09.144649+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:44:09.144649+0000","last_undegraded":"2024-04-18T10:44:09.144649+0000","last_fullsized":"2024-04-18T10:44:09.144649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'421","last_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_deep_scrub":"44'421","last_deep_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.144503+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:16.445422+0000","scrub_duration":0.0024088249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.195610+0000","last_change":"2024-04-18T10:44:14.195578+0000","last_active":"2024-04-18T10:44:14.195610+0000","last_peered":"2024-04-18T10:44:14.195610+0000","last_clean":"2024-04-18T10:44:14.195610+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:44:14.195610+0000","last_undegraded":"2024-04-18T10:44:14.195610+0000","last_fullsized":"2024-04-18T10:44:14.195610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.195443+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:06.505533+0000","scrub_duration":0.0024248439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":405,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453038+0000","last_change":"2024-04-18T10:38:48.520598+0000","last_active":"2024-04-18T10:43:51.453038+0000","last_peered":"2024-04-18T10:43:51.453038+0000","last_clean":"2024-04-18T10:43:51.453038+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:43:51.453038+0000","last_undegraded":"2024-04-18T10:43:51.453038+0000","last_fullsized":"2024-04-18T10:43:51.453038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453778+0000","last_change":"2024-04-18T10:38:48.531599+0000","last_active":"2024-04-18T10:43:51.453778+0000","last_peered":"2024-04-18T10:43:51.453778+0000","last_clean":"2024-04-18T10:43:51.453778+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:43:51.453778+0000","last_undegraded":"2024-04-18T10:43:51.453778+0000","last_fullsized":"2024-04-18T10:43:51.453778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:13.165805+0000","last_change":"2024-04-18T10:44:13.165763+0000","last_active":"2024-04-18T10:44:13.165805+0000","last_peered":"2024-04-18T10:44:13.165805+0000","last_clean":"2024-04-18T10:44:13.165805+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:44:13.165805+0000","last_undegraded":"2024-04-18T10:44:13.165805+0000","last_fullsized":"2024-04-18T10:44:13.165805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_clean_scrub_stamp":"2024-04-18T10:44:13.165654+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:05:30.099837+0000","scrub_duration":0.0022553650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":528,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.415110+0000","last_change":"2024-04-18T10:38:46.523038+0000","last_active":"2024-04-18T10:43:51.415110+0000","last_peered":"2024-04-18T10:43:51.415110+0000","last_clean":"2024-04-18T10:43:51.415110+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:43:51.415110+0000","last_undegraded":"2024-04-18T10:43:51.415110+0000","last_fullsized":"2024-04-18T10:43:51.415110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445979+0000","last_change":"2024-04-18T10:39:29.508295+0000","last_active":"2024-04-18T10:43:51.445979+0000","last_peered":"2024-04-18T10:43:51.445979+0000","last_clean":"2024-04-18T10:43:51.445979+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:43:51.445979+0000","last_undegraded":"2024-04-18T10:43:51.445979+0000","last_fullsized":"2024-04-18T10:43:51.445979+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":505,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.423311+0000","last_change":"2024-04-18T10:38:48.527369+0000","last_active":"2024-04-18T10:43:51.423311+0000","last_peered":"2024-04-18T10:43:51.423311+0000","last_clean":"2024-04-18T10:43:51.423311+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:43:51.423311+0000","last_undegraded":"2024-04-18T10:43:51.423311+0000","last_fullsized":"2024-04-18T10:43:51.423311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":470,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443708+0000","last_change":"2024-04-18T10:38:47.514997+0000","last_active":"2024-04-18T10:43:51.443708+0000","last_peered":"2024-04-18T10:43:51.443708+0000","last_clean":"2024-04-18T10:43:51.443708+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:43:51.443708+0000","last_undegraded":"2024-04-18T10:43:51.443708+0000","last_fullsized":"2024-04-18T10:43:51.443708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451779+0000","last_change":"2024-04-18T10:38:48.518698+0000","last_active":"2024-04-18T10:43:51.451779+0000","last_peered":"2024-04-18T10:43:51.451779+0000","last_clean":"2024-04-18T10:43:51.451779+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:43:51.451779+0000","last_undegraded":"2024-04-18T10:43:51.451779+0000","last_fullsized":"2024-04-18T10:43:51.451779+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":548,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452467+0000","last_change":"2024-04-18T10:38:48.535465+0000","last_active":"2024-04-18T10:43:51.452467+0000","last_peered":"2024-04-18T10:43:51.452467+0000","last_clean":"2024-04-18T10:43:51.452467+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:43:51.452467+0000","last_undegraded":"2024-04-18T10:43:51.452467+0000","last_fullsized":"2024-04-18T10:43:51.452467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":503,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452761+0000","last_change":"2024-04-18T10:38:48.536144+0000","last_active":"2024-04-18T10:43:51.452761+0000","last_peered":"2024-04-18T10:43:51.452761+0000","last_clean":"2024-04-18T10:43:51.452761+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:43:51.452761+0000","last_undegraded":"2024-04-18T10:43:51.452761+0000","last_fullsized":"2024-04-18T10:43:51.452761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":560,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.422425+0000","last_change":"2024-04-18T10:38:46.523917+0000","last_active":"2024-04-18T10:43:51.422425+0000","last_peered":"2024-04-18T10:43:51.422425+0000","last_clean":"2024-04-18T10:43:51.422425+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:43:51.422425+0000","last_undegraded":"2024-04-18T10:43:51.422425+0000","last_fullsized":"2024-04-18T10:43:51.422425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434965+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:43:51.434965+0000","last_peered":"2024-04-18T10:43:51.434965+0000","last_clean":"2024-04-18T10:43:51.434965+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:43:51.434965+0000","last_undegraded":"2024-04-18T10:43:51.434965+0000","last_fullsized":"2024-04-18T10:43:51.434965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":551,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452120+0000","last_change":"2024-04-18T10:38:48.532902+0000","last_active":"2024-04-18T10:43:51.452120+0000","last_peered":"2024-04-18T10:43:51.452120+0000","last_clean":"2024-04-18T10:43:51.452120+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:43:51.452120+0000","last_undegraded":"2024-04-18T10:43:51.452120+0000","last_fullsized":"2024-04-18T10:43:51.452120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":449,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452767+0000","last_change":"2024-04-18T10:39:29.641096+0000","last_active":"2024-04-18T10:43:51.452767+0000","last_peered":"2024-04-18T10:43:51.452767+0000","last_clean":"2024-04-18T10:43:51.452767+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:43:51.452767+0000","last_undegraded":"2024-04-18T10:43:51.452767+0000","last_fullsized":"2024-04-18T10:43:51.452767+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":614,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448234+0000","last_change":"2024-04-18T10:38:47.515633+0000","last_active":"2024-04-18T10:43:51.448234+0000","last_peered":"2024-04-18T10:43:51.448234+0000","last_clean":"2024-04-18T10:43:51.448234+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:43:51.448234+0000","last_undegraded":"2024-04-18T10:43:51.448234+0000","last_fullsized":"2024-04-18T10:43:51.448234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.328008+0000","last_change":"2024-04-18T10:44:19.327977+0000","last_active":"2024-04-18T10:44:19.328008+0000","last_peered":"2024-04-18T10:44:19.328008+0000","last_clean":"2024-04-18T10:44:19.328008+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:44:19.328008+0000","last_undegraded":"2024-04-18T10:44:19.328008+0000","last_fullsized":"2024-04-18T10:44:19.328008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'420","last_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_deep_scrub":"44'420","last_deep_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.327882+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:32.007720+0000","scrub_duration":0.0021444820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'598","reported_seq":633,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.459076+0000","last_change":"2024-04-18T10:38:47.515748+0000","last_active":"2024-04-18T10:43:48.459076+0000","last_peered":"2024-04-18T10:43:48.459076+0000","last_clean":"2024-04-18T10:43:48.459076+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:43:48.459076+0000","last_undegraded":"2024-04-18T10:43:48.459076+0000","last_fullsized":"2024-04-18T10:43:48.459076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":474,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453949+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:43:51.453949+0000","last_peered":"2024-04-18T10:43:51.453949+0000","last_clean":"2024-04-18T10:43:51.453949+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:43:51.453949+0000","last_undegraded":"2024-04-18T10:43:51.453949+0000","last_fullsized":"2024-04-18T10:43:51.453949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'444","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.376089+0000","last_change":"2024-04-18T10:38:48.531482+0000","last_active":"2024-04-18T10:43:49.376089+0000","last_peered":"2024-04-18T10:43:49.376089+0000","last_clean":"2024-04-18T10:43:49.376089+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:43:49.376089+0000","last_undegraded":"2024-04-18T10:43:49.376089+0000","last_fullsized":"2024-04-18T10:43:49.376089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":514,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445228+0000","last_change":"2024-04-18T10:38:46.523785+0000","last_active":"2024-04-18T10:43:51.445228+0000","last_peered":"2024-04-18T10:43:51.445228+0000","last_clean":"2024-04-18T10:43:51.445228+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:43:51.445228+0000","last_undegraded":"2024-04-18T10:43:51.445228+0000","last_fullsized":"2024-04-18T10:43:51.445228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'997","reported_seq":1042,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.375535+0000","last_change":"2024-04-18T10:38:48.528981+0000","last_active":"2024-04-18T10:43:49.375535+0000","last_peered":"2024-04-18T10:43:49.375535+0000","last_clean":"2024-04-18T10:43:49.375535+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:43:49.375535+0000","last_undegraded":"2024-04-18T10:43:49.375535+0000","last_fullsized":"2024-04-18T10:43:49.375535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446910+0000","last_change":"2024-04-18T10:39:29.505858+0000","last_active":"2024-04-18T10:43:51.446910+0000","last_peered":"2024-04-18T10:43:51.446910+0000","last_clean":"2024-04-18T10:43:51.446910+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:43:51.446910+0000","last_undegraded":"2024-04-18T10:43:51.446910+0000","last_fullsized":"2024-04-18T10:43:51.446910+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'65","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:05.559848+0000","last_change":"2024-04-18T10:44:05.559808+0000","last_active":"2024-04-18T10:44:05.559848+0000","last_peered":"2024-04-18T10:44:05.559848+0000","last_clean":"2024-04-18T10:44:05.559848+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:44:05.559848+0000","last_undegraded":"2024-04-18T10:44:05.559848+0000","last_fullsized":"2024-04-18T10:44:05.559848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'65","last_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_deep_scrub":"44'65","last_deep_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_clean_scrub_stamp":"2024-04-18T10:44:05.559716+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:36:17.724033+0000","scrub_duration":0.0036096679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.370178+0000","last_change":"2024-04-18T10:44:16.370147+0000","last_active":"2024-04-18T10:44:16.370178+0000","last_peered":"2024-04-18T10:44:16.370178+0000","last_clean":"2024-04-18T10:44:16.370178+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:44:16.370178+0000","last_undegraded":"2024-04-18T10:44:16.370178+0000","last_fullsized":"2024-04-18T10:44:16.370178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'423","last_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_deep_scrub":"44'423","last_deep_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.370037+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:39:35.585001+0000","scrub_duration":0.0021961260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'328","reported_seq":363,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.366221+0000","last_change":"2024-04-18T10:38:48.528847+0000","last_active":"2024-04-18T10:43:47.366221+0000","last_peered":"2024-04-18T10:43:47.366221+0000","last_clean":"2024-04-18T10:43:47.366221+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:43:47.366221+0000","last_undegraded":"2024-04-18T10:43:47.366221+0000","last_fullsized":"2024-04-18T10:43:47.366221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":631,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.439347+0000","last_change":"2024-04-18T10:38:48.525442+0000","last_active":"2024-04-18T10:43:51.439347+0000","last_peered":"2024-04-18T10:43:51.439347+0000","last_clean":"2024-04-18T10:43:51.439347+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:43:51.439347+0000","last_undegraded":"2024-04-18T10:43:51.439347+0000","last_fullsized":"2024-04-18T10:43:51.439347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'122","reported_seq":173,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.560499+0000","last_change":"2024-04-18T10:44:18.560459+0000","last_active":"2024-04-18T10:44:18.560499+0000","last_peered":"2024-04-18T10:44:18.560499+0000","last_clean":"2024-04-18T10:44:18.560499+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:44:18.560499+0000","last_undegraded":"2024-04-18T10:44:18.560499+0000","last_fullsized":"2024-04-18T10:44:18.560499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'122","last_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_deep_scrub":"44'122","last_deep_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.560319+0000","objects_scrubbed":3,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:09:23.261625+0000","scrub_duration":0.0040023589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":525,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452244+0000","last_change":"2024-04-18T10:38:48.530788+0000","last_active":"2024-04-18T10:43:51.452244+0000","last_peered":"2024-04-18T10:43:51.452244+0000","last_clean":"2024-04-18T10:43:51.452244+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:43:51.452244+0000","last_undegraded":"2024-04-18T10:43:51.452244+0000","last_fullsized":"2024-04-18T10:43:51.452244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'365","reported_seq":408,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.455289+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:43:51.455289+0000","last_peered":"2024-04-18T10:43:51.455289+0000","last_clean":"2024-04-18T10:43:51.455289+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:43:51.455289+0000","last_undegraded":"2024-04-18T10:43:51.455289+0000","last_fullsized":"2024-04-18T10:43:51.455289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":546,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453922+0000","last_change":"2024-04-18T10:38:48.528009+0000","last_active":"2024-04-18T10:43:51.453922+0000","last_peered":"2024-04-18T10:43:51.453922+0000","last_clean":"2024-04-18T10:43:51.453922+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:43:51.453922+0000","last_undegraded":"2024-04-18T10:43:51.453922+0000","last_fullsized":"2024-04-18T10:43:51.453922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'454","reported_seq":501,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.414963+0000","last_change":"2024-04-18T10:38:48.523218+0000","last_active":"2024-04-18T10:43:47.414963+0000","last_peered":"2024-04-18T10:43:47.414963+0000","last_clean":"2024-04-18T10:43:47.414963+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:43:47.414963+0000","last_undegraded":"2024-04-18T10:43:47.414963+0000","last_fullsized":"2024-04-18T10:43:47.414963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":431,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450654+0000","last_change":"2024-04-18T10:38:48.524990+0000","last_active":"2024-04-18T10:43:51.450654+0000","last_peered":"2024-04-18T10:43:51.450654+0000","last_clean":"2024-04-18T10:43:51.450654+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:43:51.450654+0000","last_undegraded":"2024-04-18T10:43:51.450654+0000","last_fullsized":"2024-04-18T10:43:51.450654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'52","reported_seq":89,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.375559+0000","last_change":"2024-04-18T10:38:48.530631+0000","last_active":"2024-04-18T10:43:49.375559+0000","last_peered":"2024-04-18T10:43:49.375559+0000","last_clean":"2024-04-18T10:43:49.375559+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:43:49.375559+0000","last_undegraded":"2024-04-18T10:43:49.375559+0000","last_fullsized":"2024-04-18T10:43:49.375559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438405+0000","last_change":"2024-04-18T10:38:48.526748+0000","last_active":"2024-04-18T10:43:51.438405+0000","last_peered":"2024-04-18T10:43:51.438405+0000","last_clean":"2024-04-18T10:43:51.438405+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:43:51.438405+0000","last_undegraded":"2024-04-18T10:43:51.438405+0000","last_fullsized":"2024-04-18T10:43:51.438405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":104,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.432580+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:43:46.432580+0000","last_peered":"2024-04-18T10:43:46.432580+0000","last_clean":"2024-04-18T10:43:46.432580+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:43:46.432580+0000","last_undegraded":"2024-04-18T10:43:46.432580+0000","last_fullsized":"2024-04-18T10:43:46.432580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445646+0000","last_change":"2024-04-18T10:38:48.522750+0000","last_active":"2024-04-18T10:43:51.445646+0000","last_peered":"2024-04-18T10:43:51.445646+0000","last_clean":"2024-04-18T10:43:51.445646+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:43:51.445646+0000","last_undegraded":"2024-04-18T10:43:51.445646+0000","last_fullsized":"2024-04-18T10:43:51.445646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'70","reported_seq":114,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.374289+0000","last_change":"2024-04-18T10:38:46.524444+0000","last_active":"2024-04-18T10:43:49.374289+0000","last_peered":"2024-04-18T10:43:49.374289+0000","last_clean":"2024-04-18T10:43:49.374289+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:43:49.374289+0000","last_undegraded":"2024-04-18T10:43:49.374289+0000","last_fullsized":"2024-04-18T10:43:49.374289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":489,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448327+0000","last_change":"2024-04-18T10:38:48.524076+0000","last_active":"2024-04-18T10:43:51.448327+0000","last_peered":"2024-04-18T10:43:51.448327+0000","last_clean":"2024-04-18T10:43:51.448327+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:43:51.448327+0000","last_undegraded":"2024-04-18T10:43:51.448327+0000","last_fullsized":"2024-04-18T10:43:51.448327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'251","reported_seq":287,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.453588+0000","last_change":"2024-04-18T10:38:46.523417+0000","last_active":"2024-04-18T10:43:48.453588+0000","last_peered":"2024-04-18T10:43:48.453588+0000","last_clean":"2024-04-18T10:43:48.453588+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:43:48.453588+0000","last_undegraded":"2024-04-18T10:43:48.453588+0000","last_fullsized":"2024-04-18T10:43:48.453588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450230+0000","last_change":"2024-04-18T10:38:48.528752+0000","last_active":"2024-04-18T10:43:51.450230+0000","last_peered":"2024-04-18T10:43:51.450230+0000","last_clean":"2024-04-18T10:43:51.450230+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:43:51.450230+0000","last_undegraded":"2024-04-18T10:43:51.450230+0000","last_fullsized":"2024-04-18T10:43:51.450230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'340","reported_seq":384,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.378379+0000","last_change":"2024-04-18T10:38:47.516780+0000","last_active":"2024-04-18T10:43:47.378379+0000","last_peered":"2024-04-18T10:43:47.378379+0000","last_clean":"2024-04-18T10:43:47.378379+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:43:47.378379+0000","last_undegraded":"2024-04-18T10:43:47.378379+0000","last_fullsized":"2024-04-18T10:43:47.378379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":506,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450127+0000","last_change":"2024-04-18T10:38:48.537651+0000","last_active":"2024-04-18T10:43:51.450127+0000","last_peered":"2024-04-18T10:43:51.450127+0000","last_clean":"2024-04-18T10:43:51.450127+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:43:51.450127+0000","last_undegraded":"2024-04-18T10:43:51.450127+0000","last_fullsized":"2024-04-18T10:43:51.450127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'565","reported_seq":607,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.465737+0000","last_change":"2024-04-18T10:38:48.528245+0000","last_active":"2024-04-18T10:43:48.465737+0000","last_peered":"2024-04-18T10:43:48.465737+0000","last_clean":"2024-04-18T10:43:48.465737+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:43:48.465737+0000","last_undegraded":"2024-04-18T10:43:48.465737+0000","last_fullsized":"2024-04-18T10:43:48.465737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.525196+0000","last_change":"2024-04-18T10:44:09.525165+0000","last_active":"2024-04-18T10:44:09.525196+0000","last_peered":"2024-04-18T10:44:09.525196+0000","last_clean":"2024-04-18T10:44:09.525196+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:44:09.525196+0000","last_undegraded":"2024-04-18T10:44:09.525196+0000","last_fullsized":"2024-04-18T10:44:09.525196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'414","last_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_deep_scrub":"44'414","last_deep_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.525069+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:25:30.256844+0000","scrub_duration":0.002236264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":107,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:08.605199+0000","last_change":"2024-04-18T10:44:08.605160+0000","last_active":"2024-04-18T10:44:08.605199+0000","last_peered":"2024-04-18T10:44:08.605199+0000","last_clean":"2024-04-18T10:44:08.605199+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:44:08.605199+0000","last_undegraded":"2024-04-18T10:44:08.605199+0000","last_fullsized":"2024-04-18T10:44:08.605199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'60","last_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_deep_scrub":"44'60","last_deep_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_clean_scrub_stamp":"2024-04-18T10:44:08.605009+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:45:04.374538+0000","scrub_duration":0.0018151350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":557,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:06.589224+0000","last_change":"2024-04-18T10:44:06.589194+0000","last_active":"2024-04-18T10:44:06.589224+0000","last_peered":"2024-04-18T10:44:06.589224+0000","last_clean":"2024-04-18T10:44:06.589224+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:44:06.589224+0000","last_undegraded":"2024-04-18T10:44:06.589224+0000","last_fullsized":"2024-04-18T10:44:06.589224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'457","last_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_deep_scrub":"44'457","last_deep_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_clean_scrub_stamp":"2024-04-18T10:44:06.589080+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:14:25.178162+0000","scrub_duration":0.0023982220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'170","reported_seq":216,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.416597+0000","last_change":"2024-04-18T10:38:48.523093+0000","last_active":"2024-04-18T10:43:47.416597+0000","last_peered":"2024-04-18T10:43:47.416597+0000","last_clean":"2024-04-18T10:43:47.416597+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:43:47.416597+0000","last_undegraded":"2024-04-18T10:43:47.416597+0000","last_fullsized":"2024-04-18T10:43:47.416597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":522,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.428669+0000","last_change":"2024-04-18T10:38:48.528094+0000","last_active":"2024-04-18T10:43:51.428669+0000","last_peered":"2024-04-18T10:43:51.428669+0000","last_clean":"2024-04-18T10:43:51.428669+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:43:51.428669+0000","last_undegraded":"2024-04-18T10:43:51.428669+0000","last_fullsized":"2024-04-18T10:43:51.428669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'249","reported_seq":290,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.405567+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:43:48.405567+0000","last_peered":"2024-04-18T10:43:48.405567+0000","last_clean":"2024-04-18T10:43:48.405567+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:43:48.405567+0000","last_undegraded":"2024-04-18T10:43:48.405567+0000","last_fullsized":"2024-04-18T10:43:48.405567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.454009+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:43:51.454009+0000","last_peered":"2024-04-18T10:43:51.454009+0000","last_clean":"2024-04-18T10:43:51.454009+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:43:51.454009+0000","last_undegraded":"2024-04-18T10:43:51.454009+0000","last_fullsized":"2024-04-18T10:43:51.454009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'62","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.389838+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:43:47.389838+0000","last_peered":"2024-04-18T10:43:47.389838+0000","last_clean":"2024-04-18T10:43:47.389838+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:43:47.389838+0000","last_undegraded":"2024-04-18T10:43:47.389838+0000","last_fullsized":"2024-04-18T10:43:47.389838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":405,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451903+0000","last_change":"2024-04-18T10:38:48.528656+0000","last_active":"2024-04-18T10:43:51.451903+0000","last_peered":"2024-04-18T10:43:51.451903+0000","last_clean":"2024-04-18T10:43:51.451903+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:43:51.451903+0000","last_undegraded":"2024-04-18T10:43:51.451903+0000","last_fullsized":"2024-04-18T10:43:51.451903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'492","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.379895+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:43:47.379895+0000","last_peered":"2024-04-18T10:43:47.379895+0000","last_clean":"2024-04-18T10:43:47.379895+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:43:47.379895+0000","last_undegraded":"2024-04-18T10:43:47.379895+0000","last_fullsized":"2024-04-18T10:43:47.379895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":517,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452398+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:43:51.452398+0000","last_peered":"2024-04-18T10:43:51.452398+0000","last_clean":"2024-04-18T10:43:51.452398+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:43:51.452398+0000","last_undegraded":"2024-04-18T10:43:51.452398+0000","last_fullsized":"2024-04-18T10:43:51.452398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.547505+0000","last_change":"2024-04-18T10:38:46.521667+0000","last_active":"2024-04-18T10:40:40.547505+0000","last_peered":"2024-04-18T10:40:40.547505+0000","last_clean":"2024-04-18T10:40:40.547505+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:40:40.547505+0000","last_undegraded":"2024-04-18T10:40:40.547505+0000","last_fullsized":"2024-04-18T10:40:40.547505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'347","reported_seq":383,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.374771+0000","last_change":"2024-04-18T10:38:48.518724+0000","last_active":"2024-04-18T10:43:49.374771+0000","last_peered":"2024-04-18T10:43:49.374771+0000","last_clean":"2024-04-18T10:43:49.374771+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:43:49.374771+0000","last_undegraded":"2024-04-18T10:43:49.374771+0000","last_fullsized":"2024-04-18T10:43:49.374771+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":401,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452310+0000","last_change":"2024-04-18T10:38:48.529610+0000","last_active":"2024-04-18T10:43:51.452310+0000","last_peered":"2024-04-18T10:43:51.452310+0000","last_clean":"2024-04-18T10:43:51.452310+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:43:51.452310+0000","last_undegraded":"2024-04-18T10:43:51.452310+0000","last_fullsized":"2024-04-18T10:43:51.452310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.533267+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:40:40.533267+0000","last_peered":"2024-04-18T10:40:40.533267+0000","last_clean":"2024-04-18T10:40:40.533267+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:40:40.533267+0000","last_undegraded":"2024-04-18T10:40:40.533267+0000","last_fullsized":"2024-04-18T10:40:40.533267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'72","reported_seq":122,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.533181+0000","last_change":"2024-04-18T10:44:19.533110+0000","last_active":"2024-04-18T10:44:19.533181+0000","last_peered":"2024-04-18T10:44:19.533181+0000","last_clean":"2024-04-18T10:44:19.533181+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:44:19.533181+0000","last_undegraded":"2024-04-18T10:44:19.533181+0000","last_fullsized":"2024-04-18T10:44:19.533181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'72","last_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_deep_scrub":"44'72","last_deep_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.533013+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:08:26.074171+0000","scrub_duration":0.003923078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.114134+0000","last_change":"2024-04-18T10:44:19.114101+0000","last_active":"2024-04-18T10:44:19.114134+0000","last_peered":"2024-04-18T10:44:19.114134+0000","last_clean":"2024-04-18T10:44:19.114134+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:44:19.114134+0000","last_undegraded":"2024-04-18T10:44:19.114134+0000","last_fullsized":"2024-04-18T10:44:19.114134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.113999+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:07:38.747202+0000","scrub_duration":0.002438047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.528464+0000","last_change":"2024-04-18T10:38:48.520896+0000","last_active":"2024-04-18T10:40:40.528464+0000","last_peered":"2024-04-18T10:40:40.528464+0000","last_clean":"2024-04-18T10:40:40.528464+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:40:40.528464+0000","last_undegraded":"2024-04-18T10:40:40.528464+0000","last_fullsized":"2024-04-18T10:40:40.528464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'433","reported_seq":469,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.388428+0000","last_change":"2024-04-18T10:38:47.519693+0000","last_active":"2024-04-18T10:43:47.388428+0000","last_peered":"2024-04-18T10:43:47.388428+0000","last_clean":"2024-04-18T10:43:47.388428+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:43:47.388428+0000","last_undegraded":"2024-04-18T10:43:47.388428+0000","last_fullsized":"2024-04-18T10:43:47.388428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.106706+0000","last_change":"2024-04-18T10:44:17.106676+0000","last_active":"2024-04-18T10:44:17.106706+0000","last_peered":"2024-04-18T10:44:17.106706+0000","last_clean":"2024-04-18T10:44:17.106706+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:44:17.106706+0000","last_undegraded":"2024-04-18T10:44:17.106706+0000","last_fullsized":"2024-04-18T10:44:17.106706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.106562+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:13:53.441711+0000","scrub_duration":0.0023480530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.534468+0000","last_change":"2024-04-18T10:38:48.522906+0000","last_active":"2024-04-18T10:40:40.534468+0000","last_peered":"2024-04-18T10:40:40.534468+0000","last_clean":"2024-04-18T10:40:40.534468+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:40:40.534468+0000","last_undegraded":"2024-04-18T10:40:40.534468+0000","last_fullsized":"2024-04-18T10:40:40.534468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"23'115","reported_seq":195,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.547059+0000","last_change":"2024-04-18T10:38:46.507608+0000","last_active":"2024-04-18T10:40:40.547059+0000","last_peered":"2024-04-18T10:40:40.547059+0000","last_clean":"2024-04-18T10:40:40.547059+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:40:40.547059+0000","last_undegraded":"2024-04-18T10:40:40.547059+0000","last_fullsized":"2024-04-18T10:40:40.547059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:52.382960+0000","last_clean_scrub_stamp":"2024-04-18T10:35:52.382960+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'526","reported_seq":564,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.416391+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:43:45.416391+0000","last_peered":"2024-04-18T10:43:45.416391+0000","last_clean":"2024-04-18T10:43:45.416391+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:43:45.416391+0000","last_undegraded":"2024-04-18T10:43:45.416391+0000","last_fullsized":"2024-04-18T10:43:45.416391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":542,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453925+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:43:51.453925+0000","last_peered":"2024-04-18T10:43:51.453925+0000","last_clean":"2024-04-18T10:43:51.453925+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:43:51.453925+0000","last_undegraded":"2024-04-18T10:43:51.453925+0000","last_fullsized":"2024-04-18T10:43:51.453925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.534030+0000","last_change":"2024-04-18T10:38:48.529162+0000","last_active":"2024-04-18T10:40:40.534030+0000","last_peered":"2024-04-18T10:40:40.534030+0000","last_clean":"2024-04-18T10:40:40.534030+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:40:40.534030+0000","last_undegraded":"2024-04-18T10:40:40.534030+0000","last_fullsized":"2024-04-18T10:40:40.534030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'262","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.366594+0000","last_change":"2024-04-18T10:38:47.513300+0000","last_active":"2024-04-18T10:43:49.366594+0000","last_peered":"2024-04-18T10:43:49.366594+0000","last_clean":"2024-04-18T10:43:49.366594+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:43:49.366594+0000","last_undegraded":"2024-04-18T10:43:49.366594+0000","last_fullsized":"2024-04-18T10:43:49.366594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.595841+0000","last_change":"2024-04-18T10:44:16.595810+0000","last_active":"2024-04-18T10:44:16.595841+0000","last_peered":"2024-04-18T10:44:16.595841+0000","last_clean":"2024-04-18T10:44:16.595841+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:44:16.595841+0000","last_undegraded":"2024-04-18T10:44:16.595841+0000","last_fullsized":"2024-04-18T10:44:16.595841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.595707+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:47.126670+0000","scrub_duration":0.002372323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.534977+0000","last_change":"2024-04-18T10:38:48.526577+0000","last_active":"2024-04-18T10:40:40.534977+0000","last_peered":"2024-04-18T10:40:40.534977+0000","last_clean":"2024-04-18T10:40:40.534977+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:40:40.534977+0000","last_undegraded":"2024-04-18T10:40:40.534977+0000","last_fullsized":"2024-04-18T10:40:40.534977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":91,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.453487+0000","last_change":"2024-04-18T10:38:47.515422+0000","last_active":"2024-04-18T10:43:48.453487+0000","last_peered":"2024-04-18T10:43:48.453487+0000","last_clean":"2024-04-18T10:43:48.453487+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:43:48.453487+0000","last_undegraded":"2024-04-18T10:43:48.453487+0000","last_fullsized":"2024-04-18T10:43:48.453487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.572462+0000","last_change":"2024-04-18T10:44:20.572430+0000","last_active":"2024-04-18T10:44:20.572462+0000","last_peered":"2024-04-18T10:44:20.572462+0000","last_clean":"2024-04-18T10:44:20.572462+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:44:20.572462+0000","last_undegraded":"2024-04-18T10:44:20.572462+0000","last_fullsized":"2024-04-18T10:44:20.572462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.572320+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:05.780336+0000","scrub_duration":0.0024798110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'64","reported_seq":116,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.293206+0000","last_change":"2024-04-18T10:44:21.293174+0000","last_active":"2024-04-18T10:44:21.293206+0000","last_peered":"2024-04-18T10:44:21.293206+0000","last_clean":"2024-04-18T10:44:21.293206+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:44:21.293206+0000","last_undegraded":"2024-04-18T10:44:21.293206+0000","last_fullsized":"2024-04-18T10:44:21.293206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'64","last_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_deep_scrub":"44'64","last_deep_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.293058+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:02.602650+0000","scrub_duration":0.0072041329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.116265+0000","last_change":"2024-04-18T10:44:16.116227+0000","last_active":"2024-04-18T10:44:16.116265+0000","last_peered":"2024-04-18T10:44:16.116265+0000","last_clean":"2024-04-18T10:44:16.116265+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:44:16.116265+0000","last_undegraded":"2024-04-18T10:44:16.116265+0000","last_fullsized":"2024-04-18T10:44:16.116265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.116120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:38:35.456110+0000","scrub_duration":0.001526194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":482,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450321+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:43:51.450321+0000","last_peered":"2024-04-18T10:43:51.450321+0000","last_clean":"2024-04-18T10:43:51.450321+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:43:51.450321+0000","last_undegraded":"2024-04-18T10:43:51.450321+0000","last_fullsized":"2024-04-18T10:43:51.450321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.536305+0000","last_change":"2024-04-18T10:38:48.519133+0000","last_active":"2024-04-18T10:40:40.536305+0000","last_peered":"2024-04-18T10:40:40.536305+0000","last_clean":"2024-04-18T10:40:40.536305+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:40:40.536305+0000","last_undegraded":"2024-04-18T10:40:40.536305+0000","last_fullsized":"2024-04-18T10:40:40.536305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":131,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.630059+0000","last_change":"2024-04-18T10:44:14.630013+0000","last_active":"2024-04-18T10:44:14.630059+0000","last_peered":"2024-04-18T10:44:14.630059+0000","last_clean":"2024-04-18T10:44:14.630059+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:44:14.630059+0000","last_undegraded":"2024-04-18T10:44:14.630059+0000","last_fullsized":"2024-04-18T10:44:14.630059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'83","last_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_deep_scrub":"44'83","last_deep_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.629894+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:04:39.848103+0000","scrub_duration":0.0054998199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":457,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:15.610348+0000","last_change":"2024-04-18T10:44:15.610317+0000","last_active":"2024-04-18T10:44:15.610348+0000","last_peered":"2024-04-18T10:44:15.610348+0000","last_clean":"2024-04-18T10:44:15.610348+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:44:15.610348+0000","last_undegraded":"2024-04-18T10:44:15.610348+0000","last_fullsized":"2024-04-18T10:44:15.610348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'377","last_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_deep_scrub":"44'377","last_deep_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_clean_scrub_stamp":"2024-04-18T10:44:15.610194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:21:45.794459+0000","scrub_duration":0.0023276400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'72","reported_seq":112,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.392681+0000","last_change":"2024-04-18T10:38:48.527898+0000","last_active":"2024-04-18T10:43:46.392681+0000","last_peered":"2024-04-18T10:43:46.392681+0000","last_clean":"2024-04-18T10:43:46.392681+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:43:46.392681+0000","last_undegraded":"2024-04-18T10:43:46.392681+0000","last_fullsized":"2024-04-18T10:43:46.392681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":442,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453133+0000","last_change":"2024-04-18T10:38:47.514434+0000","last_active":"2024-04-18T10:43:51.453133+0000","last_peered":"2024-04-18T10:43:51.453133+0000","last_clean":"2024-04-18T10:43:51.453133+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:43:51.453133+0000","last_undegraded":"2024-04-18T10:43:51.453133+0000","last_fullsized":"2024-04-18T10:43:51.453133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'343","reported_seq":384,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.416645+0000","last_change":"2024-04-18T10:38:46.520352+0000","last_active":"2024-04-18T10:43:48.416645+0000","last_peered":"2024-04-18T10:43:48.416645+0000","last_clean":"2024-04-18T10:43:48.416645+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:43:48.416645+0000","last_undegraded":"2024-04-18T10:43:48.416645+0000","last_fullsized":"2024-04-18T10:43:48.416645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":420,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:10.529301+0000","last_change":"2024-04-18T10:44:10.529249+0000","last_active":"2024-04-18T10:44:10.529301+0000","last_peered":"2024-04-18T10:44:10.529301+0000","last_clean":"2024-04-18T10:44:10.529301+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:44:10.529301+0000","last_undegraded":"2024-04-18T10:44:10.529301+0000","last_fullsized":"2024-04-18T10:44:10.529301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'352","last_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_deep_scrub":"44'352","last_deep_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:10.529127+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:12:28.231944+0000","scrub_duration":0.0022035800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'291","reported_seq":347,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.377930+0000","last_change":"2024-04-18T10:44:17.377889+0000","last_active":"2024-04-18T10:44:17.377930+0000","last_peered":"2024-04-18T10:44:17.377930+0000","last_clean":"2024-04-18T10:44:17.377930+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:44:17.377930+0000","last_undegraded":"2024-04-18T10:44:17.377930+0000","last_fullsized":"2024-04-18T10:44:17.377930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'291","last_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_deep_scrub":"44'291","last_deep_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.377743+0000","objects_scrubbed":4,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:37.743454+0000","scrub_duration":0.030049699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.575444+0000","last_change":"2024-04-18T10:44:19.575417+0000","last_active":"2024-04-18T10:44:19.575444+0000","last_peered":"2024-04-18T10:44:19.575444+0000","last_clean":"2024-04-18T10:44:19.575444+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:44:19.575444+0000","last_undegraded":"2024-04-18T10:44:19.575444+0000","last_fullsized":"2024-04-18T10:44:19.575444+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.575311+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:47:55.784007+0000","scrub_duration":0.0020110480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'110","reported_seq":148,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.469632+0000","last_change":"2024-04-18T10:38:48.521841+0000","last_active":"2024-04-18T10:43:48.469632+0000","last_peered":"2024-04-18T10:43:48.469632+0000","last_clean":"2024-04-18T10:43:48.469632+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:43:48.469632+0000","last_undegraded":"2024-04-18T10:43:48.469632+0000","last_fullsized":"2024-04-18T10:43:48.469632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449223+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:43:51.449223+0000","last_peered":"2024-04-18T10:43:51.449223+0000","last_clean":"2024-04-18T10:43:51.449223+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:43:51.449223+0000","last_undegraded":"2024-04-18T10:43:51.449223+0000","last_fullsized":"2024-04-18T10:43:51.449223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'99","reported_seq":133,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.427050+0000","last_change":"2024-04-18T10:38:46.523460+0000","last_active":"2024-04-18T10:43:47.427050+0000","last_peered":"2024-04-18T10:43:47.427050+0000","last_clean":"2024-04-18T10:43:47.427050+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:43:47.427050+0000","last_undegraded":"2024-04-18T10:43:47.427050+0000","last_fullsized":"2024-04-18T10:43:47.427050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":510,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448361+0000","last_change":"2024-04-18T10:38:47.514386+0000","last_active":"2024-04-18T10:43:51.448361+0000","last_peered":"2024-04-18T10:43:51.448361+0000","last_clean":"2024-04-18T10:43:51.448361+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:43:51.448361+0000","last_undegraded":"2024-04-18T10:43:51.448361+0000","last_fullsized":"2024-04-18T10:43:51.448361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":500,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446619+0000","last_change":"2024-04-18T10:38:47.515056+0000","last_active":"2024-04-18T10:43:51.446619+0000","last_peered":"2024-04-18T10:43:51.446619+0000","last_clean":"2024-04-18T10:43:51.446619+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:43:51.446619+0000","last_undegraded":"2024-04-18T10:43:51.446619+0000","last_fullsized":"2024-04-18T10:43:51.446619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":439,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447983+0000","last_change":"2024-04-18T10:39:29.506707+0000","last_active":"2024-04-18T10:43:51.447983+0000","last_peered":"2024-04-18T10:43:51.447983+0000","last_clean":"2024-04-18T10:43:51.447983+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:43:51.447983+0000","last_undegraded":"2024-04-18T10:43:51.447983+0000","last_fullsized":"2024-04-18T10:43:51.447983+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":565,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.429252+0000","last_change":"2024-04-18T10:38:48.530823+0000","last_active":"2024-04-18T10:43:51.429252+0000","last_peered":"2024-04-18T10:43:51.429252+0000","last_clean":"2024-04-18T10:43:51.429252+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:43:51.429252+0000","last_undegraded":"2024-04-18T10:43:51.429252+0000","last_fullsized":"2024-04-18T10:43:51.429252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":487,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450827+0000","last_change":"2024-04-18T10:38:48.528090+0000","last_active":"2024-04-18T10:43:51.450827+0000","last_peered":"2024-04-18T10:43:51.450827+0000","last_clean":"2024-04-18T10:43:51.450827+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:43:51.450827+0000","last_undegraded":"2024-04-18T10:43:51.450827+0000","last_fullsized":"2024-04-18T10:43:51.450827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":498,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445695+0000","last_change":"2024-04-18T10:38:47.515405+0000","last_active":"2024-04-18T10:43:51.445695+0000","last_peered":"2024-04-18T10:43:51.445695+0000","last_clean":"2024-04-18T10:43:51.445695+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:43:51.445695+0000","last_undegraded":"2024-04-18T10:43:51.445695+0000","last_fullsized":"2024-04-18T10:43:51.445695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8509,"ondisk_log_size":8509,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953541,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.35399999999999998,"15min":0.37},"min":{"1min":0.16700000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.35099999999999998,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38,"5min":0.36399999999999999,"15min":0.38200000000000001},"min":{"1min":0.216,"5min":0.187,"15min":0.187},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Apr 18 10:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.20499999999999999,"5min":0.184,"15min":0.184},"max":{"1min":1.7849999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.247,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.496,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.39400000000000002,"15min":0.42799999999999999},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.47899999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.498},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.248,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.41599999999999998,"5min":4.181,"15min":4.181},"last":0.41599999999999998}]}]},{"osd":2,"up_from":31,"seq":133143986245,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.17799999999999999,"5min":0.161,"15min":0.161},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.71199999999999997,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.378}]},{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.35299999999999998,"15min":0.38100000000000001},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.379,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.39900000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.373,"15min":0.40500000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.40999999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.42999999999999999},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.44400000000000001}]}]},{"osd":0,"up_from":29,"seq":124554051654,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34999999999999998,"15min":0.33600000000000002},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.216,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.628,"5min":1.224,"15min":1.224},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38400000000000001,"15min":0.35799999999999998},"min":{"1min":0.20599999999999999,"5min":0.19,"15min":0.19},"max":{"1min":1.514,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.22500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.59499999999999997,"5min":1.173,"15min":1.173},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.38300000000000001,"15min":0.41799999999999998},"min":{"1min":0.23200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.73599999999999999,"5min":1.204,"15min":1.204},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.51500000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.56799999999999995}]}]},{"osd":1,"up_from":30,"seq":128849018949,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.34899999999999998},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.33900000000000002,"15min":0.35899999999999999},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.325,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.433}]},{"osd":3,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.98599999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.9970000000000001,"5min":2.173,"15min":2.173},"last":0.45100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:44:25.467 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.467 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.467 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.468 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.468 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.468 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.468 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.468 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.468 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.468 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.468 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.468 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.469 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.470 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.470 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.470 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.470 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.470 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.470 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.470 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.470 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.471 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.472 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-18T10:35:52.382960+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=52, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.473 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.474 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.474 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.474 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.474 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.474 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.474 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.474 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.475 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.475 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.475 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.475 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.475 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.475 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.475 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.475 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.475 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:25.476 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T10:44:45.476 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:44:45.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.612+0000 7fa1996e9700 1 Processor -- start 2024-04-18T10:44:45.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.612+0000 7fa1996e9700 1 -- start start 2024-04-18T10:44:45.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.612+0000 7fa1996e9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa19413efd0 0x7fa194146f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:45.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.612+0000 7fa1996e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa194147450 0x7fa194149830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:45.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.612+0000 7fa1996e9700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1940ab140 con 0x7fa1940aa8e0 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1996e9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19413e660 con 0x7fa194147450 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1996e9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940a7160 con 0x7fa19413efd0 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1927fc700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa19413efd0 0x7fa194146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa192ffd700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa1940aa8e0 0x7fa1940a8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58938/0 (socket says 172.21.15.31:58938) 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa192ffd700 1 -- 172.21.15.31:0/2982240630 learned_addr learned my addr 172.21.15.31:0/2982240630 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1937fe700 1 --2- 172.21.15.31:0/2982240630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa194147450 0x7fa194149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1927fc700 1 -- 172.21.15.31:0/2982240630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa194147450 msgr2=0x7fa194149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa191ffb700 1 -- 172.21.15.31:0/2982240630 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557955289 0 0) 0x7fa1940ab140 con 0x7fa1940aa8e0 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1927fc700 1 --2- 172.21.15.31:0/2982240630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa194147450 0x7fa194149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1927fc700 1 -- 172.21.15.31:0/2982240630 >> v1:172.21.15.31:6789/0 conn(0x7fa1940aa8e0 legacy=0x7fa1940a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1927fc700 1 -- 172.21.15.31:0/2982240630 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19413e900 con 0x7fa19413efd0 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1937fe700 1 --2- 172.21.15.31:0/2982240630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa194147450 0x7fa194149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa1927fc700 1 --2- 172.21.15.31:0/2982240630 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa19413efd0 0x7fa194146f10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa184009910 tx=0x7fa1840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39388a667967f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa191ffb700 1 -- 172.21.15.31:0/2982240630 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18400b680 con 0x7fa19413efd0 2024-04-18T10:44:45.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa191ffb700 1 -- 172.21.15.31:0/2982240630 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18400b7e0 con 0x7fa19413efd0 2024-04-18T10:44:45.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.613+0000 7fa191ffb700 1 -- 172.21.15.31:0/2982240630 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18400bba0 con 0x7fa19413efd0 2024-04-18T10:44:45.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.614+0000 7fa1996e9700 1 -- 172.21.15.31:0/2982240630 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa19413efd0 msgr2=0x7fa194146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:45.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.614+0000 7fa1996e9700 1 --2- 172.21.15.31:0/2982240630 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa19413efd0 0x7fa194146f10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa184009910 tx=0x7fa1840091a0 comp rx=0 tx=0).stop 2024-04-18T10:44:45.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.614+0000 7fa1996e9700 1 -- 172.21.15.31:0/2982240630 shutdown_connections 2024-04-18T10:44:45.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.614+0000 7fa1996e9700 1 --2- 172.21.15.31:0/2982240630 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa194147450 0x7fa194149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:45.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.614+0000 7fa1996e9700 1 --2- 172.21.15.31:0/2982240630 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa19413efd0 0x7fa194146f10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:45.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.614+0000 7fa1996e9700 1 -- 172.21.15.31:0/2982240630 >> 172.21.15.31:0/2982240630 conn(0x7fa194069450 msgr2=0x7fa194063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:45.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.614+0000 7fa1996e9700 1 -- 172.21.15.31:0/2982240630 shutdown_connections 2024-04-18T10:44:45.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.614+0000 7fa1996e9700 1 -- 172.21.15.31:0/2982240630 wait complete. 2024-04-18T10:44:45.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.615+0000 7fa1996e9700 1 Processor -- start 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.615+0000 7fa1996e9700 1 -- start start 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1996e9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1940aa8e0 0x7fa1940b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1996e9700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa19413efd0 0x7fa194134890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1996e9700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa194147450 0x7fa194134dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1996e9700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940b5870 con 0x7fa1940aa8e0 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1996e9700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa194135f60 con 0x7fa19413efd0 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1996e9700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940b55f0 con 0x7fa194147450 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa192ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1940aa8e0 0x7fa1940b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa192ffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1940aa8e0 0x7fa1940b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45928/0 (socket says 172.21.15.31:45928) 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa192ffd700 1 -- 172.21.15.31:0/154291528 learned_addr learned my addr 172.21.15.31:0/154291528 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1927fc700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa19413efd0 0x7fa194134890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1937fe700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa194147450 0x7fa194134dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:44:45.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa192ffd700 1 -- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa194147450 msgr2=0x7fa194134dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa192ffd700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa194147450 0x7fa194134dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa192ffd700 1 -- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa19413efd0 msgr2=0x7fa194134890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa192ffd700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa19413efd0 0x7fa194134890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa192ffd700 1 -- 172.21.15.31:0/154291528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c009a20 con 0x7fa1940aa8e0 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1927fc700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa19413efd0 0x7fa194134890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa192ffd700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1940aa8e0 0x7fa1940b50b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c870 tx=0x7fa188007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa17affd700 1 -- 172.21.15.31:0/154291528 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188005c00 con 0x7fa1940aa8e0 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa17affd700 1 -- 172.21.15.31:0/154291528 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa188005d60 con 0x7fa1940aa8e0 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa184009420 con 0x7fa1940aa8e0 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.616+0000 7fa17affd700 1 -- 172.21.15.31:0/154291528 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188007320 con 0x7fa1940aa8e0 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.617+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1940b48d0 con 0x7fa1940aa8e0 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.617+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa194146ab0 con 0x7fa1940aa8e0 2024-04-18T10:44:45.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.617+0000 7fa17affd700 1 -- 172.21.15.31:0/154291528 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fa18801b3b0 con 0x7fa1940aa8e0 2024-04-18T10:44:45.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.618+0000 7fa17affd700 1 -- 172.21.15.31:0/154291528 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fa18805a570 con 0x7fa1940aa8e0 2024-04-18T10:44:45.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.622+0000 7fa17affd700 1 -- 172.21.15.31:0/154291528 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fa188038870 con 0x7fa1940aa8e0 2024-04-18T10:44:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.783+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa194064920 con 0x7fa180045f20 2024-04-18T10:44:45.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.790+0000 7fa17affd700 1 -- 172.21.15.31:0/154291528 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277268 (unknown 2965378022 0 3975983846) 0x7fa194064920 con 0x7fa180045f20 2024-04-18T10:44:45.795 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 >> v1:172.21.15.31:6816/46601 conn(0x7fa180045f20 legacy=0x7fa1800483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1940aa8e0 msgr2=0x7fa1940b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1940aa8e0 0x7fa1940b50b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c870 tx=0x7fa188007d90 comp rx=0 tx=0).stop 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 shutdown_connections 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fa194147450 0x7fa194134dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1940aa8e0 0x7fa1940b50b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 --2- 172.21.15.31:0/154291528 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fa19413efd0 0x7fa194134890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 >> 172.21.15.31:0/154291528 conn(0x7fa194069450 msgr2=0x7fa194064b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 shutdown_connections 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:44:45.793+0000 7fa1996e9700 1 -- 172.21.15.31:0/154291528 wait complete. 2024-04-18T10:44:45.797 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:44:45.806 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-04-18T10:44:44.496499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35108,"ondisk_log_size":35108,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003142"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.637320+0000","last_change":"2024-04-18T10:44:26.637274+0000","last_active":"2024-04-18T10:44:26.637320+0000","last_peered":"2024-04-18T10:44:26.637320+0000","last_clean":"2024-04-18T10:44:26.637320+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:44:26.637320+0000","last_undegraded":"2024-04-18T10:44:26.637320+0000","last_fullsized":"2024-04-18T10:44:26.637320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'406","last_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_deep_scrub":"44'406","last_deep_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.637158+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:46.367442+0000","scrub_duration":0.0019350299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.529297+0000","last_change":"2024-04-18T10:44:11.529249+0000","last_active":"2024-04-18T10:44:11.529297+0000","last_peered":"2024-04-18T10:44:11.529297+0000","last_clean":"2024-04-18T10:44:11.529297+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:44:11.529297+0000","last_undegraded":"2024-04-18T10:44:11.529297+0000","last_fullsized":"2024-04-18T10:44:11.529297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'425","last_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_deep_scrub":"44'425","last_deep_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.529136+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:31:02.859668+0000","scrub_duration":0.002289952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":432,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.557510+0000","last_change":"2024-04-18T10:44:21.557477+0000","last_active":"2024-04-18T10:44:21.557510+0000","last_peered":"2024-04-18T10:44:21.557510+0000","last_clean":"2024-04-18T10:44:21.557510+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:44:21.557510+0000","last_undegraded":"2024-04-18T10:44:21.557510+0000","last_fullsized":"2024-04-18T10:44:21.557510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.557376+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:19:59.466067+0000","scrub_duration":0.0022859669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":454,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.429724+0000","last_change":"2024-04-18T10:38:46.523213+0000","last_active":"2024-04-18T10:43:51.429724+0000","last_peered":"2024-04-18T10:43:51.429724+0000","last_clean":"2024-04-18T10:43:51.429724+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:43:51.429724+0000","last_undegraded":"2024-04-18T10:43:51.429724+0000","last_fullsized":"2024-04-18T10:43:51.429724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":543,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:22.581671+0000","last_change":"2024-04-18T10:44:22.581628+0000","last_active":"2024-04-18T10:44:22.581671+0000","last_peered":"2024-04-18T10:44:22.581671+0000","last_clean":"2024-04-18T10:44:22.581671+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:44:22.581671+0000","last_undegraded":"2024-04-18T10:44:22.581671+0000","last_fullsized":"2024-04-18T10:44:22.581671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'428","last_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_deep_scrub":"44'428","last_deep_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_clean_scrub_stamp":"2024-04-18T10:44:22.581473+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:42:51.909519+0000","scrub_duration":0.0023658939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":403,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.443750+0000","last_change":"2024-04-18T10:39:29.508173+0000","last_active":"2024-04-18T10:43:51.443750+0000","last_peered":"2024-04-18T10:43:51.443750+0000","last_clean":"2024-04-18T10:43:51.443750+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:43:51.443750+0000","last_undegraded":"2024-04-18T10:43:51.443750+0000","last_fullsized":"2024-04-18T10:43:51.443750+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":529,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.334276+0000","last_change":"2024-04-18T10:44:18.334236+0000","last_active":"2024-04-18T10:44:18.334276+0000","last_peered":"2024-04-18T10:44:18.334276+0000","last_clean":"2024-04-18T10:44:18.334276+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:44:18.334276+0000","last_undegraded":"2024-04-18T10:44:18.334276+0000","last_fullsized":"2024-04-18T10:44:18.334276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.334127+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:41:16.742027+0000","scrub_duration":0.0024997970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.989712+0000","last_change":"2024-04-18T10:44:24.989685+0000","last_active":"2024-04-18T10:44:24.989712+0000","last_peered":"2024-04-18T10:44:24.989712+0000","last_clean":"2024-04-18T10:44:24.989712+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:44:24.989712+0000","last_undegraded":"2024-04-18T10:44:24.989712+0000","last_fullsized":"2024-04-18T10:44:24.989712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'383","last_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_deep_scrub":"44'383","last_deep_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.989580+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:01:44.688357+0000","scrub_duration":0.0023556649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":514,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.557807+0000","last_change":"2024-04-18T10:44:11.557779+0000","last_active":"2024-04-18T10:44:11.557807+0000","last_peered":"2024-04-18T10:44:11.557807+0000","last_clean":"2024-04-18T10:44:11.557807+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:44:11.557807+0000","last_undegraded":"2024-04-18T10:44:11.557807+0000","last_fullsized":"2024-04-18T10:44:11.557807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'422","last_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_deep_scrub":"44'422","last_deep_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.557669+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:00:02.279295+0000","scrub_duration":0.0024686619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.144649+0000","last_change":"2024-04-18T10:44:09.144611+0000","last_active":"2024-04-18T10:44:09.144649+0000","last_peered":"2024-04-18T10:44:09.144649+0000","last_clean":"2024-04-18T10:44:09.144649+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:44:09.144649+0000","last_undegraded":"2024-04-18T10:44:09.144649+0000","last_fullsized":"2024-04-18T10:44:09.144649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'421","last_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_deep_scrub":"44'421","last_deep_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.144503+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:16.445422+0000","scrub_duration":0.0024088249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.195610+0000","last_change":"2024-04-18T10:44:14.195578+0000","last_active":"2024-04-18T10:44:14.195610+0000","last_peered":"2024-04-18T10:44:14.195610+0000","last_clean":"2024-04-18T10:44:14.195610+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:44:14.195610+0000","last_undegraded":"2024-04-18T10:44:14.195610+0000","last_fullsized":"2024-04-18T10:44:14.195610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.195443+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:06.505533+0000","scrub_duration":0.0024248439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":415,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:38.631266+0000","last_change":"2024-04-18T10:44:38.631204+0000","last_active":"2024-04-18T10:44:38.631266+0000","last_peered":"2024-04-18T10:44:38.631266+0000","last_clean":"2024-04-18T10:44:38.631266+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:44:38.631266+0000","last_undegraded":"2024-04-18T10:44:38.631266+0000","last_fullsized":"2024-04-18T10:44:38.631266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_clean_scrub_stamp":"2024-04-18T10:44:38.631083+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:27.239036+0000","scrub_duration":0.002062871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453778+0000","last_change":"2024-04-18T10:38:48.531599+0000","last_active":"2024-04-18T10:43:51.453778+0000","last_peered":"2024-04-18T10:43:51.453778+0000","last_clean":"2024-04-18T10:43:51.453778+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:43:51.453778+0000","last_undegraded":"2024-04-18T10:43:51.453778+0000","last_fullsized":"2024-04-18T10:43:51.453778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:13.165805+0000","last_change":"2024-04-18T10:44:13.165763+0000","last_active":"2024-04-18T10:44:13.165805+0000","last_peered":"2024-04-18T10:44:13.165805+0000","last_clean":"2024-04-18T10:44:13.165805+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:44:13.165805+0000","last_undegraded":"2024-04-18T10:44:13.165805+0000","last_fullsized":"2024-04-18T10:44:13.165805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_clean_scrub_stamp":"2024-04-18T10:44:13.165654+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:05:30.099837+0000","scrub_duration":0.0022553650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":528,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.415110+0000","last_change":"2024-04-18T10:38:46.523038+0000","last_active":"2024-04-18T10:43:51.415110+0000","last_peered":"2024-04-18T10:43:51.415110+0000","last_clean":"2024-04-18T10:43:51.415110+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:43:51.415110+0000","last_undegraded":"2024-04-18T10:43:51.415110+0000","last_fullsized":"2024-04-18T10:43:51.415110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445979+0000","last_change":"2024-04-18T10:39:29.508295+0000","last_active":"2024-04-18T10:43:51.445979+0000","last_peered":"2024-04-18T10:43:51.445979+0000","last_clean":"2024-04-18T10:43:51.445979+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:43:51.445979+0000","last_undegraded":"2024-04-18T10:43:51.445979+0000","last_fullsized":"2024-04-18T10:43:51.445979+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":505,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.423311+0000","last_change":"2024-04-18T10:38:48.527369+0000","last_active":"2024-04-18T10:43:51.423311+0000","last_peered":"2024-04-18T10:43:51.423311+0000","last_clean":"2024-04-18T10:43:51.423311+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:43:51.423311+0000","last_undegraded":"2024-04-18T10:43:51.423311+0000","last_fullsized":"2024-04-18T10:43:51.423311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:25.567371+0000","last_change":"2024-04-18T10:44:25.567348+0000","last_active":"2024-04-18T10:44:25.567371+0000","last_peered":"2024-04-18T10:44:25.567371+0000","last_clean":"2024-04-18T10:44:25.567371+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:44:25.567371+0000","last_undegraded":"2024-04-18T10:44:25.567371+0000","last_fullsized":"2024-04-18T10:44:25.567371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'411","last_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_deep_scrub":"44'411","last_deep_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_clean_scrub_stamp":"2024-04-18T10:44:25.567250+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:30:08.433037+0000","scrub_duration":0.001860376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":537,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.678041+0000","last_change":"2024-04-18T10:44:28.678009+0000","last_active":"2024-04-18T10:44:28.678041+0000","last_peered":"2024-04-18T10:44:28.678041+0000","last_clean":"2024-04-18T10:44:28.678041+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:44:28.678041+0000","last_undegraded":"2024-04-18T10:44:28.678041+0000","last_fullsized":"2024-04-18T10:44:28.678041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.677897+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:19:26.570868+0000","scrub_duration":0.0024894269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":558,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.040362+0000","last_change":"2024-04-18T10:44:23.040332+0000","last_active":"2024-04-18T10:44:23.040362+0000","last_peered":"2024-04-18T10:44:23.040362+0000","last_clean":"2024-04-18T10:44:23.040362+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:44:23.040362+0000","last_undegraded":"2024-04-18T10:44:23.040362+0000","last_fullsized":"2024-04-18T10:44:23.040362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'459","last_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_deep_scrub":"44'459","last_deep_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.040211+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:27:20.385741+0000","scrub_duration":0.0023176189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":513,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:30.040466+0000","last_change":"2024-04-18T10:44:30.040439+0000","last_active":"2024-04-18T10:44:30.040466+0000","last_peered":"2024-04-18T10:44:30.040466+0000","last_clean":"2024-04-18T10:44:30.040466+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:44:30.040466+0000","last_undegraded":"2024-04-18T10:44:30.040466+0000","last_fullsized":"2024-04-18T10:44:30.040466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'413","last_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_deep_scrub":"44'413","last_deep_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_clean_scrub_stamp":"2024-04-18T10:44:30.040312+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:29:22.491578+0000","scrub_duration":0.0023350599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":570,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.532351+0000","last_change":"2024-04-18T10:44:23.532321+0000","last_active":"2024-04-18T10:44:23.532351+0000","last_peered":"2024-04-18T10:44:23.532351+0000","last_clean":"2024-04-18T10:44:23.532351+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:44:23.532351+0000","last_undegraded":"2024-04-18T10:44:23.532351+0000","last_fullsized":"2024-04-18T10:44:23.532351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.532201+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:17:09.342669+0000","scrub_duration":0.00234395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434965+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:43:51.434965+0000","last_peered":"2024-04-18T10:43:51.434965+0000","last_clean":"2024-04-18T10:43:51.434965+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:43:51.434965+0000","last_undegraded":"2024-04-18T10:43:51.434965+0000","last_fullsized":"2024-04-18T10:43:51.434965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":561,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.076667+0000","last_change":"2024-04-18T10:44:20.076638+0000","last_active":"2024-04-18T10:44:20.076667+0000","last_peered":"2024-04-18T10:44:20.076667+0000","last_clean":"2024-04-18T10:44:20.076667+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:44:20.076667+0000","last_undegraded":"2024-04-18T10:44:20.076667+0000","last_fullsized":"2024-04-18T10:44:20.076667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'444","last_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_deep_scrub":"44'444","last_deep_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.076529+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:32:07.735061+0000","scrub_duration":0.0023703510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":449,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452767+0000","last_change":"2024-04-18T10:39:29.641096+0000","last_active":"2024-04-18T10:43:51.452767+0000","last_peered":"2024-04-18T10:43:51.452767+0000","last_clean":"2024-04-18T10:43:51.452767+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:43:51.452767+0000","last_undegraded":"2024-04-18T10:43:51.452767+0000","last_fullsized":"2024-04-18T10:43:51.452767+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":614,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448234+0000","last_change":"2024-04-18T10:38:47.515633+0000","last_active":"2024-04-18T10:43:51.448234+0000","last_peered":"2024-04-18T10:43:51.448234+0000","last_clean":"2024-04-18T10:43:51.448234+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:43:51.448234+0000","last_undegraded":"2024-04-18T10:43:51.448234+0000","last_fullsized":"2024-04-18T10:43:51.448234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.328008+0000","last_change":"2024-04-18T10:44:19.327977+0000","last_active":"2024-04-18T10:44:19.328008+0000","last_peered":"2024-04-18T10:44:19.328008+0000","last_clean":"2024-04-18T10:44:19.328008+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:44:19.328008+0000","last_undegraded":"2024-04-18T10:44:19.328008+0000","last_fullsized":"2024-04-18T10:44:19.328008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'420","last_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_deep_scrub":"44'420","last_deep_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.327882+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:32.007720+0000","scrub_duration":0.0021444820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'598","reported_seq":633,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.459076+0000","last_change":"2024-04-18T10:38:47.515748+0000","last_active":"2024-04-18T10:43:48.459076+0000","last_peered":"2024-04-18T10:43:48.459076+0000","last_clean":"2024-04-18T10:43:48.459076+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:43:48.459076+0000","last_undegraded":"2024-04-18T10:43:48.459076+0000","last_fullsized":"2024-04-18T10:43:48.459076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":474,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453949+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:43:51.453949+0000","last_peered":"2024-04-18T10:43:51.453949+0000","last_clean":"2024-04-18T10:43:51.453949+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:43:51.453949+0000","last_undegraded":"2024-04-18T10:43:51.453949+0000","last_fullsized":"2024-04-18T10:43:51.453949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'445","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.993981+0000","last_change":"2024-04-18T10:44:34.993954+0000","last_active":"2024-04-18T10:44:34.993981+0000","last_peered":"2024-04-18T10:44:34.993981+0000","last_clean":"2024-04-18T10:44:34.993981+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:44:34.993981+0000","last_undegraded":"2024-04-18T10:44:34.993981+0000","last_fullsized":"2024-04-18T10:44:34.993981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'445","last_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_deep_scrub":"44'445","last_deep_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.993858+0000","objects_scrubbed":1,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:14:56.923345+0000","scrub_duration":0.014572485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":514,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445228+0000","last_change":"2024-04-18T10:38:46.523785+0000","last_active":"2024-04-18T10:43:51.445228+0000","last_peered":"2024-04-18T10:43:51.445228+0000","last_clean":"2024-04-18T10:43:51.445228+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:43:51.445228+0000","last_undegraded":"2024-04-18T10:43:51.445228+0000","last_fullsized":"2024-04-18T10:43:51.445228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'997","reported_seq":1042,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.375535+0000","last_change":"2024-04-18T10:38:48.528981+0000","last_active":"2024-04-18T10:43:49.375535+0000","last_peered":"2024-04-18T10:43:49.375535+0000","last_clean":"2024-04-18T10:43:49.375535+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:43:49.375535+0000","last_undegraded":"2024-04-18T10:43:49.375535+0000","last_fullsized":"2024-04-18T10:43:49.375535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446910+0000","last_change":"2024-04-18T10:39:29.505858+0000","last_active":"2024-04-18T10:43:51.446910+0000","last_peered":"2024-04-18T10:43:51.446910+0000","last_clean":"2024-04-18T10:43:51.446910+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:43:51.446910+0000","last_undegraded":"2024-04-18T10:43:51.446910+0000","last_fullsized":"2024-04-18T10:43:51.446910+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'65","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:05.559848+0000","last_change":"2024-04-18T10:44:05.559808+0000","last_active":"2024-04-18T10:44:05.559848+0000","last_peered":"2024-04-18T10:44:05.559848+0000","last_clean":"2024-04-18T10:44:05.559848+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:44:05.559848+0000","last_undegraded":"2024-04-18T10:44:05.559848+0000","last_fullsized":"2024-04-18T10:44:05.559848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'65","last_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_deep_scrub":"44'65","last_deep_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_clean_scrub_stamp":"2024-04-18T10:44:05.559716+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:36:17.724033+0000","scrub_duration":0.0036096679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.370178+0000","last_change":"2024-04-18T10:44:16.370147+0000","last_active":"2024-04-18T10:44:16.370178+0000","last_peered":"2024-04-18T10:44:16.370178+0000","last_clean":"2024-04-18T10:44:16.370178+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:44:16.370178+0000","last_undegraded":"2024-04-18T10:44:16.370178+0000","last_fullsized":"2024-04-18T10:44:16.370178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'423","last_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_deep_scrub":"44'423","last_deep_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.370037+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:39:35.585001+0000","scrub_duration":0.0021961260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'328","reported_seq":363,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.366221+0000","last_change":"2024-04-18T10:38:48.528847+0000","last_active":"2024-04-18T10:43:47.366221+0000","last_peered":"2024-04-18T10:43:47.366221+0000","last_clean":"2024-04-18T10:43:47.366221+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:43:47.366221+0000","last_undegraded":"2024-04-18T10:43:47.366221+0000","last_fullsized":"2024-04-18T10:43:47.366221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":641,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.177788+0000","last_change":"2024-04-18T10:44:27.177742+0000","last_active":"2024-04-18T10:44:27.177788+0000","last_peered":"2024-04-18T10:44:27.177788+0000","last_clean":"2024-04-18T10:44:27.177788+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:44:27.177788+0000","last_undegraded":"2024-04-18T10:44:27.177788+0000","last_fullsized":"2024-04-18T10:44:27.177788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'482","last_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_deep_scrub":"44'482","last_deep_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.177629+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:47:19.941357+0000","scrub_duration":0.0024789170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'122","reported_seq":173,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.560499+0000","last_change":"2024-04-18T10:44:18.560459+0000","last_active":"2024-04-18T10:44:18.560499+0000","last_peered":"2024-04-18T10:44:18.560499+0000","last_clean":"2024-04-18T10:44:18.560499+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:44:18.560499+0000","last_undegraded":"2024-04-18T10:44:18.560499+0000","last_fullsized":"2024-04-18T10:44:18.560499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'122","last_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_deep_scrub":"44'122","last_deep_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.560319+0000","objects_scrubbed":3,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:09:23.261625+0000","scrub_duration":0.0040023589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":525,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452244+0000","last_change":"2024-04-18T10:38:48.530788+0000","last_active":"2024-04-18T10:43:51.452244+0000","last_peered":"2024-04-18T10:43:51.452244+0000","last_clean":"2024-04-18T10:43:51.452244+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:43:51.452244+0000","last_undegraded":"2024-04-18T10:43:51.452244+0000","last_fullsized":"2024-04-18T10:43:51.452244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'365","reported_seq":408,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.455289+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:43:51.455289+0000","last_peered":"2024-04-18T10:43:51.455289+0000","last_clean":"2024-04-18T10:43:51.455289+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:43:51.455289+0000","last_undegraded":"2024-04-18T10:43:51.455289+0000","last_fullsized":"2024-04-18T10:43:51.455289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":546,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453922+0000","last_change":"2024-04-18T10:38:48.528009+0000","last_active":"2024-04-18T10:43:51.453922+0000","last_peered":"2024-04-18T10:43:51.453922+0000","last_clean":"2024-04-18T10:43:51.453922+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:43:51.453922+0000","last_undegraded":"2024-04-18T10:43:51.453922+0000","last_fullsized":"2024-04-18T10:43:51.453922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'454","reported_seq":501,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.414963+0000","last_change":"2024-04-18T10:38:48.523218+0000","last_active":"2024-04-18T10:43:47.414963+0000","last_peered":"2024-04-18T10:43:47.414963+0000","last_clean":"2024-04-18T10:43:47.414963+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:43:47.414963+0000","last_undegraded":"2024-04-18T10:43:47.414963+0000","last_fullsized":"2024-04-18T10:43:47.414963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":431,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450654+0000","last_change":"2024-04-18T10:38:48.524990+0000","last_active":"2024-04-18T10:43:51.450654+0000","last_peered":"2024-04-18T10:43:51.450654+0000","last_clean":"2024-04-18T10:43:51.450654+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:43:51.450654+0000","last_undegraded":"2024-04-18T10:43:51.450654+0000","last_fullsized":"2024-04-18T10:43:51.450654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'53","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.595939+0000","last_change":"2024-04-18T10:44:26.595910+0000","last_active":"2024-04-18T10:44:26.595939+0000","last_peered":"2024-04-18T10:44:26.595939+0000","last_clean":"2024-04-18T10:44:26.595939+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:44:26.595939+0000","last_undegraded":"2024-04-18T10:44:26.595939+0000","last_fullsized":"2024-04-18T10:44:26.595939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'53","last_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_deep_scrub":"44'53","last_deep_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.595811+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:16:49.585489+0000","scrub_duration":0.0030095930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438405+0000","last_change":"2024-04-18T10:38:48.526748+0000","last_active":"2024-04-18T10:43:51.438405+0000","last_peered":"2024-04-18T10:43:51.438405+0000","last_clean":"2024-04-18T10:43:51.438405+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:43:51.438405+0000","last_undegraded":"2024-04-18T10:43:51.438405+0000","last_fullsized":"2024-04-18T10:43:51.438405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":104,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.432580+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:43:46.432580+0000","last_peered":"2024-04-18T10:43:46.432580+0000","last_clean":"2024-04-18T10:43:46.432580+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:43:46.432580+0000","last_undegraded":"2024-04-18T10:43:46.432580+0000","last_fullsized":"2024-04-18T10:43:46.432580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445646+0000","last_change":"2024-04-18T10:38:48.522750+0000","last_active":"2024-04-18T10:43:51.445646+0000","last_peered":"2024-04-18T10:43:51.445646+0000","last_clean":"2024-04-18T10:43:51.445646+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:43:51.445646+0000","last_undegraded":"2024-04-18T10:43:51.445646+0000","last_fullsized":"2024-04-18T10:43:51.445646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'75","reported_seq":129,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.009173+0000","last_change":"2024-04-18T10:44:28.009140+0000","last_active":"2024-04-18T10:44:28.009173+0000","last_peered":"2024-04-18T10:44:28.009173+0000","last_clean":"2024-04-18T10:44:28.009173+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:44:28.009173+0000","last_undegraded":"2024-04-18T10:44:28.009173+0000","last_fullsized":"2024-04-18T10:44:28.009173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'75","last_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_deep_scrub":"44'75","last_deep_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.009038+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:08:03.526122+0000","scrub_duration":0.0053935800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":499,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:29.118675+0000","last_change":"2024-04-18T10:44:29.118645+0000","last_active":"2024-04-18T10:44:29.118675+0000","last_peered":"2024-04-18T10:44:29.118675+0000","last_clean":"2024-04-18T10:44:29.118675+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:44:29.118675+0000","last_undegraded":"2024-04-18T10:44:29.118675+0000","last_fullsized":"2024-04-18T10:44:29.118675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'395","last_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_deep_scrub":"44'395","last_deep_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_clean_scrub_stamp":"2024-04-18T10:44:29.118542+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:28:54.989556+0000","scrub_duration":0.0023004689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'253","reported_seq":299,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.557411+0000","last_change":"2024-04-18T10:44:24.557383+0000","last_active":"2024-04-18T10:44:24.557411+0000","last_peered":"2024-04-18T10:44:24.557411+0000","last_clean":"2024-04-18T10:44:24.557411+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:44:24.557411+0000","last_undegraded":"2024-04-18T10:44:24.557411+0000","last_fullsized":"2024-04-18T10:44:24.557411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'253","last_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_deep_scrub":"44'253","last_deep_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.557282+0000","objects_scrubbed":2,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:50:13.889591+0000","scrub_duration":0.013433855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450230+0000","last_change":"2024-04-18T10:38:48.528752+0000","last_active":"2024-04-18T10:43:51.450230+0000","last_peered":"2024-04-18T10:43:51.450230+0000","last_clean":"2024-04-18T10:43:51.450230+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:43:51.450230+0000","last_undegraded":"2024-04-18T10:43:51.450230+0000","last_fullsized":"2024-04-18T10:43:51.450230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'342","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.598760+0000","last_change":"2024-04-18T10:44:24.598713+0000","last_active":"2024-04-18T10:44:24.598760+0000","last_peered":"2024-04-18T10:44:24.598760+0000","last_clean":"2024-04-18T10:44:24.598760+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:44:24.598760+0000","last_undegraded":"2024-04-18T10:44:24.598760+0000","last_fullsized":"2024-04-18T10:44:24.598760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'342","last_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_deep_scrub":"44'342","last_deep_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.598616+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:33.105351+0000","scrub_duration":0.013052151999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.025191+0000","last_change":"2024-04-18T10:44:24.025155+0000","last_active":"2024-04-18T10:44:24.025191+0000","last_peered":"2024-04-18T10:44:24.025191+0000","last_clean":"2024-04-18T10:44:24.025191+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:44:24.025191+0000","last_undegraded":"2024-04-18T10:44:24.025191+0000","last_fullsized":"2024-04-18T10:44:24.025191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'435","last_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_deep_scrub":"44'435","last_deep_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.025044+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:05.200707+0000","scrub_duration":0.0023369929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'565","reported_seq":607,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.465737+0000","last_change":"2024-04-18T10:38:48.528245+0000","last_active":"2024-04-18T10:43:48.465737+0000","last_peered":"2024-04-18T10:43:48.465737+0000","last_clean":"2024-04-18T10:43:48.465737+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:43:48.465737+0000","last_undegraded":"2024-04-18T10:43:48.465737+0000","last_fullsized":"2024-04-18T10:43:48.465737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.525196+0000","last_change":"2024-04-18T10:44:09.525165+0000","last_active":"2024-04-18T10:44:09.525196+0000","last_peered":"2024-04-18T10:44:09.525196+0000","last_clean":"2024-04-18T10:44:09.525196+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:44:09.525196+0000","last_undegraded":"2024-04-18T10:44:09.525196+0000","last_fullsized":"2024-04-18T10:44:09.525196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'414","last_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_deep_scrub":"44'414","last_deep_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.525069+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:25:30.256844+0000","scrub_duration":0.002236264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":107,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:08.605199+0000","last_change":"2024-04-18T10:44:08.605160+0000","last_active":"2024-04-18T10:44:08.605199+0000","last_peered":"2024-04-18T10:44:08.605199+0000","last_clean":"2024-04-18T10:44:08.605199+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:44:08.605199+0000","last_undegraded":"2024-04-18T10:44:08.605199+0000","last_fullsized":"2024-04-18T10:44:08.605199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'60","last_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_deep_scrub":"44'60","last_deep_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_clean_scrub_stamp":"2024-04-18T10:44:08.605009+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:45:04.374538+0000","scrub_duration":0.0018151350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":557,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:06.589224+0000","last_change":"2024-04-18T10:44:06.589194+0000","last_active":"2024-04-18T10:44:06.589224+0000","last_peered":"2024-04-18T10:44:06.589224+0000","last_clean":"2024-04-18T10:44:06.589224+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:44:06.589224+0000","last_undegraded":"2024-04-18T10:44:06.589224+0000","last_fullsized":"2024-04-18T10:44:06.589224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'457","last_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_deep_scrub":"44'457","last_deep_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_clean_scrub_stamp":"2024-04-18T10:44:06.589080+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:14:25.178162+0000","scrub_duration":0.0023982220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'170","reported_seq":216,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.416597+0000","last_change":"2024-04-18T10:38:48.523093+0000","last_active":"2024-04-18T10:43:47.416597+0000","last_peered":"2024-04-18T10:43:47.416597+0000","last_clean":"2024-04-18T10:43:47.416597+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:43:47.416597+0000","last_undegraded":"2024-04-18T10:43:47.416597+0000","last_fullsized":"2024-04-18T10:43:47.416597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":522,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.428669+0000","last_change":"2024-04-18T10:38:48.528094+0000","last_active":"2024-04-18T10:43:51.428669+0000","last_peered":"2024-04-18T10:43:51.428669+0000","last_clean":"2024-04-18T10:43:51.428669+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:43:51.428669+0000","last_undegraded":"2024-04-18T10:43:51.428669+0000","last_fullsized":"2024-04-18T10:43:51.428669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'249","reported_seq":290,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.405567+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:43:48.405567+0000","last_peered":"2024-04-18T10:43:48.405567+0000","last_clean":"2024-04-18T10:43:48.405567+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:43:48.405567+0000","last_undegraded":"2024-04-18T10:43:48.405567+0000","last_fullsized":"2024-04-18T10:43:48.405567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.454009+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:43:51.454009+0000","last_peered":"2024-04-18T10:43:51.454009+0000","last_clean":"2024-04-18T10:43:51.454009+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:43:51.454009+0000","last_undegraded":"2024-04-18T10:43:51.454009+0000","last_fullsized":"2024-04-18T10:43:51.454009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'62","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.389838+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:43:47.389838+0000","last_peered":"2024-04-18T10:43:47.389838+0000","last_clean":"2024-04-18T10:43:47.389838+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:43:47.389838+0000","last_undegraded":"2024-04-18T10:43:47.389838+0000","last_fullsized":"2024-04-18T10:43:47.389838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":405,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.451903+0000","last_change":"2024-04-18T10:38:48.528656+0000","last_active":"2024-04-18T10:43:51.451903+0000","last_peered":"2024-04-18T10:43:51.451903+0000","last_clean":"2024-04-18T10:43:51.451903+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:43:51.451903+0000","last_undegraded":"2024-04-18T10:43:51.451903+0000","last_fullsized":"2024-04-18T10:43:51.451903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'492","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.379895+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:43:47.379895+0000","last_peered":"2024-04-18T10:43:47.379895+0000","last_clean":"2024-04-18T10:43:47.379895+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:43:47.379895+0000","last_undegraded":"2024-04-18T10:43:47.379895+0000","last_fullsized":"2024-04-18T10:43:47.379895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":517,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452398+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:43:51.452398+0000","last_peered":"2024-04-18T10:43:51.452398+0000","last_clean":"2024-04-18T10:43:51.452398+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:43:51.452398+0000","last_undegraded":"2024-04-18T10:43:51.452398+0000","last_fullsized":"2024-04-18T10:43:51.452398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.547505+0000","last_change":"2024-04-18T10:38:46.521667+0000","last_active":"2024-04-18T10:40:40.547505+0000","last_peered":"2024-04-18T10:40:40.547505+0000","last_clean":"2024-04-18T10:40:40.547505+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:40:40.547505+0000","last_undegraded":"2024-04-18T10:40:40.547505+0000","last_fullsized":"2024-04-18T10:40:40.547505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'349","reported_seq":395,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.613083+0000","last_change":"2024-04-18T10:44:37.613042+0000","last_active":"2024-04-18T10:44:37.613083+0000","last_peered":"2024-04-18T10:44:37.613083+0000","last_clean":"2024-04-18T10:44:37.613083+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:44:37.613083+0000","last_undegraded":"2024-04-18T10:44:37.613083+0000","last_fullsized":"2024-04-18T10:44:37.613083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.612936+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:48.492165+0000","scrub_duration":0.014537654000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":401,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452310+0000","last_change":"2024-04-18T10:38:48.529610+0000","last_active":"2024-04-18T10:43:51.452310+0000","last_peered":"2024-04-18T10:43:51.452310+0000","last_clean":"2024-04-18T10:43:51.452310+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:43:51.452310+0000","last_undegraded":"2024-04-18T10:43:51.452310+0000","last_fullsized":"2024-04-18T10:43:51.452310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.533267+0000","last_change":"2024-04-18T10:38:48.525361+0000","last_active":"2024-04-18T10:40:40.533267+0000","last_peered":"2024-04-18T10:40:40.533267+0000","last_clean":"2024-04-18T10:40:40.533267+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:40:40.533267+0000","last_undegraded":"2024-04-18T10:40:40.533267+0000","last_fullsized":"2024-04-18T10:40:40.533267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'72","reported_seq":122,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.533181+0000","last_change":"2024-04-18T10:44:19.533110+0000","last_active":"2024-04-18T10:44:19.533181+0000","last_peered":"2024-04-18T10:44:19.533181+0000","last_clean":"2024-04-18T10:44:19.533181+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:44:19.533181+0000","last_undegraded":"2024-04-18T10:44:19.533181+0000","last_fullsized":"2024-04-18T10:44:19.533181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'72","last_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_deep_scrub":"44'72","last_deep_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.533013+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:08:26.074171+0000","scrub_duration":0.003923078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.114134+0000","last_change":"2024-04-18T10:44:19.114101+0000","last_active":"2024-04-18T10:44:19.114134+0000","last_peered":"2024-04-18T10:44:19.114134+0000","last_clean":"2024-04-18T10:44:19.114134+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:44:19.114134+0000","last_undegraded":"2024-04-18T10:44:19.114134+0000","last_fullsized":"2024-04-18T10:44:19.114134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.113999+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:07:38.747202+0000","scrub_duration":0.002438047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:40:40.528464+0000","last_change":"2024-04-18T10:38:48.520896+0000","last_active":"2024-04-18T10:40:40.528464+0000","last_peered":"2024-04-18T10:40:40.528464+0000","last_clean":"2024-04-18T10:40:40.528464+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:40:40.528464+0000","last_undegraded":"2024-04-18T10:40:40.528464+0000","last_fullsized":"2024-04-18T10:40:40.528464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:35:59.503589+0000","last_clean_scrub_stamp":"2024-04-18T10:35:59.503589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'433","reported_seq":469,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.388428+0000","last_change":"2024-04-18T10:38:47.519693+0000","last_active":"2024-04-18T10:43:47.388428+0000","last_peered":"2024-04-18T10:43:47.388428+0000","last_clean":"2024-04-18T10:43:47.388428+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:43:47.388428+0000","last_undegraded":"2024-04-18T10:43:47.388428+0000","last_fullsized":"2024-04-18T10:43:47.388428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.106706+0000","last_change":"2024-04-18T10:44:17.106676+0000","last_active":"2024-04-18T10:44:17.106706+0000","last_peered":"2024-04-18T10:44:17.106706+0000","last_clean":"2024-04-18T10:44:17.106706+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:44:17.106706+0000","last_undegraded":"2024-04-18T10:44:17.106706+0000","last_fullsized":"2024-04-18T10:44:17.106706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.106562+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:13:53.441711+0000","scrub_duration":0.0023480530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.136129+0000","last_change":"2024-04-18T10:44:28.136098+0000","last_active":"2024-04-18T10:44:28.136129+0000","last_peered":"2024-04-18T10:44:28.136129+0000","last_clean":"2024-04-18T10:44:28.136129+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:44:28.136129+0000","last_undegraded":"2024-04-18T10:44:28.136129+0000","last_fullsized":"2024-04-18T10:44:28.136129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.135985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:42.424822+0000","scrub_duration":0.001452168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"44'117","reported_seq":207,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:36.000064+0000","last_change":"2024-04-18T10:44:36.000033+0000","last_active":"2024-04-18T10:44:36.000064+0000","last_peered":"2024-04-18T10:44:36.000064+0000","last_clean":"2024-04-18T10:44:36.000064+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:44:36.000064+0000","last_undegraded":"2024-04-18T10:44:36.000064+0000","last_fullsized":"2024-04-18T10:44:36.000064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'117","last_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_deep_scrub":"44'117","last_deep_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_clean_scrub_stamp":"2024-04-18T10:44:35.999921+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:44.891493+0000","scrub_duration":0.0075134060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'526","reported_seq":564,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.416391+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:43:45.416391+0000","last_peered":"2024-04-18T10:43:45.416391+0000","last_clean":"2024-04-18T10:43:45.416391+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:43:45.416391+0000","last_undegraded":"2024-04-18T10:43:45.416391+0000","last_fullsized":"2024-04-18T10:43:45.416391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":542,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453925+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:43:51.453925+0000","last_peered":"2024-04-18T10:43:51.453925+0000","last_clean":"2024-04-18T10:43:51.453925+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:43:51.453925+0000","last_undegraded":"2024-04-18T10:43:51.453925+0000","last_fullsized":"2024-04-18T10:43:51.453925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:41.049096+0000","last_change":"2024-04-18T10:44:41.049065+0000","last_active":"2024-04-18T10:44:41.049096+0000","last_peered":"2024-04-18T10:44:41.049096+0000","last_clean":"2024-04-18T10:44:41.049096+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:44:41.049096+0000","last_undegraded":"2024-04-18T10:44:41.049096+0000","last_fullsized":"2024-04-18T10:44:41.049096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_clean_scrub_stamp":"2024-04-18T10:44:41.048965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:40:48.265478+0000","scrub_duration":0.001413037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'263","reported_seq":495,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.603509+0000","last_change":"2024-04-18T10:44:27.603480+0000","last_active":"2024-04-18T10:44:27.603509+0000","last_peered":"2024-04-18T10:44:27.603509+0000","last_clean":"2024-04-18T10:44:27.603509+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:44:27.603509+0000","last_undegraded":"2024-04-18T10:44:27.603509+0000","last_fullsized":"2024-04-18T10:44:27.603509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'263","last_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_deep_scrub":"44'263","last_deep_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.603367+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:00.661142+0000","scrub_duration":0.006809715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.595841+0000","last_change":"2024-04-18T10:44:16.595810+0000","last_active":"2024-04-18T10:44:16.595841+0000","last_peered":"2024-04-18T10:44:16.595841+0000","last_clean":"2024-04-18T10:44:16.595841+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:44:16.595841+0000","last_undegraded":"2024-04-18T10:44:16.595841+0000","last_fullsized":"2024-04-18T10:44:16.595841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.595707+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:47.126670+0000","scrub_duration":0.002372323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.099574+0000","last_change":"2024-04-18T10:44:37.099519+0000","last_active":"2024-04-18T10:44:37.099574+0000","last_peered":"2024-04-18T10:44:37.099574+0000","last_clean":"2024-04-18T10:44:37.099574+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:44:37.099574+0000","last_undegraded":"2024-04-18T10:44:37.099574+0000","last_fullsized":"2024-04-18T10:44:37.099574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.099405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:12.361352+0000","scrub_duration":0.0015369120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":91,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.453487+0000","last_change":"2024-04-18T10:38:47.515422+0000","last_active":"2024-04-18T10:43:48.453487+0000","last_peered":"2024-04-18T10:43:48.453487+0000","last_clean":"2024-04-18T10:43:48.453487+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:43:48.453487+0000","last_undegraded":"2024-04-18T10:43:48.453487+0000","last_fullsized":"2024-04-18T10:43:48.453487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.572462+0000","last_change":"2024-04-18T10:44:20.572430+0000","last_active":"2024-04-18T10:44:20.572462+0000","last_peered":"2024-04-18T10:44:20.572462+0000","last_clean":"2024-04-18T10:44:20.572462+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:44:20.572462+0000","last_undegraded":"2024-04-18T10:44:20.572462+0000","last_fullsized":"2024-04-18T10:44:20.572462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.572320+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:05.780336+0000","scrub_duration":0.0024798110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'64","reported_seq":116,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.293206+0000","last_change":"2024-04-18T10:44:21.293174+0000","last_active":"2024-04-18T10:44:21.293206+0000","last_peered":"2024-04-18T10:44:21.293206+0000","last_clean":"2024-04-18T10:44:21.293206+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:44:21.293206+0000","last_undegraded":"2024-04-18T10:44:21.293206+0000","last_fullsized":"2024-04-18T10:44:21.293206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'64","last_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_deep_scrub":"44'64","last_deep_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.293058+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:02.602650+0000","scrub_duration":0.0072041329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.116265+0000","last_change":"2024-04-18T10:44:16.116227+0000","last_active":"2024-04-18T10:44:16.116265+0000","last_peered":"2024-04-18T10:44:16.116265+0000","last_clean":"2024-04-18T10:44:16.116265+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:44:16.116265+0000","last_undegraded":"2024-04-18T10:44:16.116265+0000","last_fullsized":"2024-04-18T10:44:16.116265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.116120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:38:35.456110+0000","scrub_duration":0.001526194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":482,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450321+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:43:51.450321+0000","last_peered":"2024-04-18T10:43:51.450321+0000","last_clean":"2024-04-18T10:43:51.450321+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:43:51.450321+0000","last_undegraded":"2024-04-18T10:43:51.450321+0000","last_fullsized":"2024-04-18T10:43:51.450321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.163325+0000","last_change":"2024-04-18T10:44:26.163296+0000","last_active":"2024-04-18T10:44:26.163325+0000","last_peered":"2024-04-18T10:44:26.163325+0000","last_clean":"2024-04-18T10:44:26.163325+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:44:26.163325+0000","last_undegraded":"2024-04-18T10:44:26.163325+0000","last_fullsized":"2024-04-18T10:44:26.163325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.163155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:41:33.487472+0000","scrub_duration":0.001544494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":131,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.630059+0000","last_change":"2024-04-18T10:44:14.630013+0000","last_active":"2024-04-18T10:44:14.630059+0000","last_peered":"2024-04-18T10:44:14.630059+0000","last_clean":"2024-04-18T10:44:14.630059+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:44:14.630059+0000","last_undegraded":"2024-04-18T10:44:14.630059+0000","last_fullsized":"2024-04-18T10:44:14.630059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'83","last_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_deep_scrub":"44'83","last_deep_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.629894+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:04:39.848103+0000","scrub_duration":0.0054998199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":457,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:15.610348+0000","last_change":"2024-04-18T10:44:15.610317+0000","last_active":"2024-04-18T10:44:15.610348+0000","last_peered":"2024-04-18T10:44:15.610348+0000","last_clean":"2024-04-18T10:44:15.610348+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:44:15.610348+0000","last_undegraded":"2024-04-18T10:44:15.610348+0000","last_fullsized":"2024-04-18T10:44:15.610348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'377","last_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_deep_scrub":"44'377","last_deep_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_clean_scrub_stamp":"2024-04-18T10:44:15.610194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:21:45.794459+0000","scrub_duration":0.0023276400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'72","reported_seq":112,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.392681+0000","last_change":"2024-04-18T10:38:48.527898+0000","last_active":"2024-04-18T10:43:46.392681+0000","last_peered":"2024-04-18T10:43:46.392681+0000","last_clean":"2024-04-18T10:43:46.392681+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:43:46.392681+0000","last_undegraded":"2024-04-18T10:43:46.392681+0000","last_fullsized":"2024-04-18T10:43:46.392681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":442,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453133+0000","last_change":"2024-04-18T10:38:47.514434+0000","last_active":"2024-04-18T10:43:51.453133+0000","last_peered":"2024-04-18T10:43:51.453133+0000","last_clean":"2024-04-18T10:43:51.453133+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:43:51.453133+0000","last_undegraded":"2024-04-18T10:43:51.453133+0000","last_fullsized":"2024-04-18T10:43:51.453133+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'343","reported_seq":384,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.416645+0000","last_change":"2024-04-18T10:38:46.520352+0000","last_active":"2024-04-18T10:43:48.416645+0000","last_peered":"2024-04-18T10:43:48.416645+0000","last_clean":"2024-04-18T10:43:48.416645+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:43:48.416645+0000","last_undegraded":"2024-04-18T10:43:48.416645+0000","last_fullsized":"2024-04-18T10:43:48.416645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":420,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:10.529301+0000","last_change":"2024-04-18T10:44:10.529249+0000","last_active":"2024-04-18T10:44:10.529301+0000","last_peered":"2024-04-18T10:44:10.529301+0000","last_clean":"2024-04-18T10:44:10.529301+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:44:10.529301+0000","last_undegraded":"2024-04-18T10:44:10.529301+0000","last_fullsized":"2024-04-18T10:44:10.529301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'352","last_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_deep_scrub":"44'352","last_deep_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:10.529127+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:12:28.231944+0000","scrub_duration":0.0022035800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'291","reported_seq":347,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.377930+0000","last_change":"2024-04-18T10:44:17.377889+0000","last_active":"2024-04-18T10:44:17.377930+0000","last_peered":"2024-04-18T10:44:17.377930+0000","last_clean":"2024-04-18T10:44:17.377930+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:44:17.377930+0000","last_undegraded":"2024-04-18T10:44:17.377930+0000","last_fullsized":"2024-04-18T10:44:17.377930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'291","last_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_deep_scrub":"44'291","last_deep_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.377743+0000","objects_scrubbed":4,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:37.743454+0000","scrub_duration":0.030049699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.575444+0000","last_change":"2024-04-18T10:44:19.575417+0000","last_active":"2024-04-18T10:44:19.575444+0000","last_peered":"2024-04-18T10:44:19.575444+0000","last_clean":"2024-04-18T10:44:19.575444+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:44:19.575444+0000","last_undegraded":"2024-04-18T10:44:19.575444+0000","last_fullsized":"2024-04-18T10:44:19.575444+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.575311+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:47:55.784007+0000","scrub_duration":0.0020110480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'110","reported_seq":148,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.469632+0000","last_change":"2024-04-18T10:38:48.521841+0000","last_active":"2024-04-18T10:43:48.469632+0000","last_peered":"2024-04-18T10:43:48.469632+0000","last_clean":"2024-04-18T10:43:48.469632+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:43:48.469632+0000","last_undegraded":"2024-04-18T10:43:48.469632+0000","last_fullsized":"2024-04-18T10:43:48.469632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449223+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:43:51.449223+0000","last_peered":"2024-04-18T10:43:51.449223+0000","last_clean":"2024-04-18T10:43:51.449223+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:43:51.449223+0000","last_undegraded":"2024-04-18T10:43:51.449223+0000","last_fullsized":"2024-04-18T10:43:51.449223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'102","reported_seq":146,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.622673+0000","last_change":"2024-04-18T10:44:34.622627+0000","last_active":"2024-04-18T10:44:34.622673+0000","last_peered":"2024-04-18T10:44:34.622673+0000","last_clean":"2024-04-18T10:44:34.622673+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:44:34.622673+0000","last_undegraded":"2024-04-18T10:44:34.622673+0000","last_fullsized":"2024-04-18T10:44:34.622673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'102","last_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_deep_scrub":"44'102","last_deep_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.622522+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:53:16.158696+0000","scrub_duration":0.012842098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:39.658970+0000","last_change":"2024-04-18T10:44:39.658938+0000","last_active":"2024-04-18T10:44:39.658970+0000","last_peered":"2024-04-18T10:44:39.658970+0000","last_clean":"2024-04-18T10:44:39.658970+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:44:39.658970+0000","last_undegraded":"2024-04-18T10:44:39.658970+0000","last_fullsized":"2024-04-18T10:44:39.658970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'432","last_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_deep_scrub":"44'432","last_deep_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_clean_scrub_stamp":"2024-04-18T10:44:39.658831+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:58:08.433321+0000","scrub_duration":0.0024322020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":500,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446619+0000","last_change":"2024-04-18T10:38:47.515056+0000","last_active":"2024-04-18T10:43:51.446619+0000","last_peered":"2024-04-18T10:43:51.446619+0000","last_clean":"2024-04-18T10:43:51.446619+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:43:51.446619+0000","last_undegraded":"2024-04-18T10:43:51.446619+0000","last_fullsized":"2024-04-18T10:43:51.446619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":439,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.447983+0000","last_change":"2024-04-18T10:39:29.506707+0000","last_active":"2024-04-18T10:43:51.447983+0000","last_peered":"2024-04-18T10:43:51.447983+0000","last_clean":"2024-04-18T10:43:51.447983+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:43:51.447983+0000","last_undegraded":"2024-04-18T10:43:51.447983+0000","last_fullsized":"2024-04-18T10:43:51.447983+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":575,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.634081+0000","last_change":"2024-04-18T10:44:42.634050+0000","last_active":"2024-04-18T10:44:42.634081+0000","last_peered":"2024-04-18T10:44:42.634081+0000","last_clean":"2024-04-18T10:44:42.634081+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:44:42.634081+0000","last_undegraded":"2024-04-18T10:44:42.634081+0000","last_fullsized":"2024-04-18T10:44:42.634081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'470","last_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_deep_scrub":"44'470","last_deep_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.633943+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:34:03.702154+0000","scrub_duration":0.0025497570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.195348+0000","last_change":"2024-04-18T10:44:24.195320+0000","last_active":"2024-04-18T10:44:24.195348+0000","last_peered":"2024-04-18T10:44:24.195348+0000","last_clean":"2024-04-18T10:44:24.195348+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:44:24.195348+0000","last_undegraded":"2024-04-18T10:44:24.195348+0000","last_fullsized":"2024-04-18T10:44:24.195348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.195206+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:51:24.563147+0000","scrub_duration":0.0022383659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":498,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.445695+0000","last_change":"2024-04-18T10:38:47.515405+0000","last_active":"2024-04-18T10:43:51.445695+0000","last_peered":"2024-04-18T10:43:51.445695+0000","last_clean":"2024-04-18T10:43:51.445695+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:43:51.445695+0000","last_undegraded":"2024-04-18T10:43:51.445695+0000","last_fullsized":"2024-04-18T10:43:51.445695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8526,"ondisk_log_size":8526,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953545,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.35399999999999998,"15min":0.37},"min":{"1min":0.16700000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.35099999999999998,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.38,"5min":0.36399999999999999,"15min":0.38200000000000001},"min":{"1min":0.216,"5min":0.187,"15min":0.187},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Apr 18 10:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41099999999999998,"15min":0.41899999999999998},"min":{"1min":0.20499999999999999,"5min":0.184,"15min":0.184},"max":{"1min":1.7849999999999999,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.35399999999999998,"15min":0.38},"min":{"1min":0.247,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.496,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:43:57 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.39400000000000002,"15min":0.42799999999999999},"min":{"1min":0.23000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.47899999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.432},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.42499999999999999,"15min":0.435},"min":{"1min":0.248,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.41599999999999998,"5min":4.181,"15min":4.181},"last":0.47999999999999998}]}]},{"osd":2,"up_from":31,"seq":133143986249,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.17799999999999999,"5min":0.161,"15min":0.161},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.71199999999999997,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.35299999999999998,"15min":0.38100000000000001},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.379,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.39900000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.373,"15min":0.40500000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.40999999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.439},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.42999999999999999},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.46500000000000002}]}]},{"osd":0,"up_from":29,"seq":124554051658,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34999999999999998,"15min":0.33600000000000002},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.216,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.628,"5min":1.224,"15min":1.224},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.38400000000000001,"15min":0.35799999999999998},"min":{"1min":0.20599999999999999,"5min":0.19,"15min":0.19},"max":{"1min":1.514,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.377},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.22500000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.59499999999999997,"5min":1.173,"15min":1.173},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.38300000000000001,"15min":0.41799999999999998},"min":{"1min":0.23200000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.73599999999999999,"5min":1.204,"15min":1.204},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.51500000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.41699999999999998}]}]},{"osd":1,"up_from":30,"seq":128849018953,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.34899999999999998},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.33900000000000002,"15min":0.35899999999999999},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.325,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.98599999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.499},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.9970000000000001,"5min":2.173,"15min":2.173},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:44:45.810 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.810 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.810 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.811 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.811 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.811 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.811 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.811 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.811 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.811 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.811 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.811 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.812 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.812 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.812 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.812 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.812 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.812 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.812 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.812 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.812 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.813 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.813 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.813 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.813 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.813 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.813 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.813 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.813 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.813 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.814 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.814 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.814 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.814 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.814 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.814 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.814 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-18T10:35:59.503589+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=35, tm_sec=59, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.814 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.815 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.815 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.815 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.815 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.815 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.815 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.815 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.815 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.816 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.816 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.816 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.816 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:44:45.816 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T10:45:05.817 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:45:05.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.952+0000 7f11c77af700 1 Processor -- start 2024-04-18T10:45:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c77af700 1 -- start start 2024-04-18T10:45:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c77af700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c00a3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c77af700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11c00679e0 0x7f11c0067e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c77af700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c00a3b50 con 0x7f11c0068370 2024-04-18T10:45:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c77af700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c0068810 con 0x7f11c00679e0 2024-04-18T10:45:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c77af700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00a45d0 con 0x7f11c0069200 2024-04-18T10:45:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c554b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c00a3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c4d4a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11c00679e0 0x7f11c0067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c554b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c00a3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:43924/0 (socket says 172.21.15.31:43924) 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c5d4c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f11c0068370 0x7f11c0148630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:57974/0 (socket says 172.21.15.31:57974) 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c4d4a700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f11c00679e0 0x7f11c0067e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37234/0 (socket says 172.21.15.31:37234) 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.953+0000 7f11c554b700 1 -- 172.21.15.31:0/2774950855 learned_addr learned my addr 172.21.15.31:0/2774950855 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11c554b700 1 -- 172.21.15.31:0/2774950855 >> v2:172.21.15.31:3300/0 conn(0x7f11c00679e0 msgr2=0x7f11c0067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11c554b700 1 --2- 172.21.15.31:0/2774950855 >> v2:172.21.15.31:3300/0 conn(0x7f11c00679e0 0x7f11c0067e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11c554b700 1 -- 172.21.15.31:0/2774950855 >> v1:172.21.15.31:6789/0 conn(0x7f11c0068370 legacy=0x7f11c0148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11b7fff700 1 -- 172.21.15.31:0/2774950855 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881758330 0 0) 0x7f11c00a3b50 con 0x7f11c0068370 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11c554b700 1 -- 172.21.15.31:0/2774950855 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c006e070 con 0x7f11c0069200 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11c4d4a700 1 --2- 172.21.15.31:0/2774950855 >> v2:172.21.15.31:3300/0 conn(0x7f11c00679e0 0x7f11c0067e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11c554b700 1 --2- 172.21.15.31:0/2774950855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c00a3080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0099b0 tx=0x7f11bc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccbdc36ec9df6bf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11b7fff700 1 -- 172.21.15.31:0/2774950855 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc009ea0 con 0x7f11c0069200 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11b7fff700 1 -- 172.21.15.31:0/2774950855 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc00b860 con 0x7f11c0069200 2024-04-18T10:45:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11b7fff700 1 -- 172.21.15.31:0/2774950855 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00bc00 con 0x7f11c0069200 2024-04-18T10:45:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11c77af700 1 -- 172.21.15.31:0/2774950855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 msgr2=0x7f11c00a3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.954+0000 7f11c77af700 1 --2- 172.21.15.31:0/2774950855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c00a3080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11bc0099b0 tx=0x7f11bc009250 comp rx=0 tx=0).stop 2024-04-18T10:45:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.955+0000 7f11c77af700 1 -- 172.21.15.31:0/2774950855 shutdown_connections 2024-04-18T10:45:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.955+0000 7f11c77af700 1 --2- 172.21.15.31:0/2774950855 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c00a3080 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.955+0000 7f11c77af700 1 --2- 172.21.15.31:0/2774950855 >> v2:172.21.15.31:3300/0 conn(0x7f11c00679e0 0x7f11c0067e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.955+0000 7f11c77af700 1 -- 172.21.15.31:0/2774950855 >> 172.21.15.31:0/2774950855 conn(0x7f11c006ae80 msgr2=0x7f11c0068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:45:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.955+0000 7f11c77af700 1 -- 172.21.15.31:0/2774950855 shutdown_connections 2024-04-18T10:45:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.955+0000 7f11c77af700 1 -- 172.21.15.31:0/2774950855 wait complete. 2024-04-18T10:45:05.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.956+0000 7f11c77af700 1 Processor -- start 2024-04-18T10:45:05.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.956+0000 7f11c77af700 1 -- start start 2024-04-18T10:45:05.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c77af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11c00679e0 0x7f11c0097b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:05.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c77af700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f11c0068370 0x7f11c0151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:05.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c77af700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c0151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:05.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c77af700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00974f0 con 0x7f11c00679e0 2024-04-18T10:45:05.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c77af700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0098540 con 0x7f11c0069200 2024-04-18T10:45:05.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c77af700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0098800 con 0x7f11c0068370 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c554b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11c00679e0 0x7f11c0097b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c5d4c700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c0151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c4d4a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f11c0068370 0x7f11c0151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c554b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11c00679e0 0x7f11c0097b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37238/0 (socket says 172.21.15.31:37238) 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c554b700 1 -- 172.21.15.31:0/3293333892 learned_addr learned my addr 172.21.15.31:0/3293333892 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c4d4a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f11c0068370 0x7f11c0151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:46742/0 (socket says 172.21.15.31:46742) 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c5d4c700 1 -- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f11c0068370 msgr2=0x7f11c0151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c5d4c700 1 --2- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f11c0068370 0x7f11c0151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c5d4c700 1 -- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11c00679e0 msgr2=0x7f11c0097b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c5d4c700 1 --2- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11c00679e0 0x7f11c0097b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c5d4c700 1 -- 172.21.15.31:0/3293333892 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009420 con 0x7f11c0069200 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c4d4a700 1 --2- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f11c0068370 0x7f11c0151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.957+0000 7f11c554b700 1 --2- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11c00679e0 0x7f11c0097b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.958+0000 7f11c5d4c700 1 --2- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c0151840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f11b800cc90 tx=0x7f11b8001a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:45:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.958+0000 7f11b57fa700 1 -- 172.21.15.31:0/3293333892 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8005df0 con 0x7f11c0069200 2024-04-18T10:45:05.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.958+0000 7f11b57fa700 1 -- 172.21.15.31:0/3293333892 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b800a6a0 con 0x7f11c0069200 2024-04-18T10:45:05.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.958+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc0094f0 con 0x7f11c0069200 2024-04-18T10:45:05.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.958+0000 7f11b57fa700 1 -- 172.21.15.31:0/3293333892 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800aa60 con 0x7f11c0069200 2024-04-18T10:45:05.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.958+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c0096ec0 con 0x7f11c0069200 2024-04-18T10:45:05.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.959+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c00651b0 con 0x7f11c0069200 2024-04-18T10:45:05.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.959+0000 7f11b57fa700 1 -- 172.21.15.31:0/3293333892 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f11b80070f0 con 0x7f11c0069200 2024-04-18T10:45:05.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.960+0000 7f11b57fa700 1 -- 172.21.15.31:0/3293333892 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f11b805b0b0 con 0x7f11c0069200 2024-04-18T10:45:05.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:05.963+0000 7f11b57fa700 1 -- 172.21.15.31:0/3293333892 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f11b80392d0 con 0x7f11c0069200 2024-04-18T10:45:06.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.123+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11c006e950 con 0x7f11a4045f20 2024-04-18T10:45:06.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.130+0000 7f11b57fa700 1 -- 172.21.15.31:0/3293333892 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278951 (unknown 2965378022 0 1432795681) 0x7f11c006e950 con 0x7f11a4045f20 2024-04-18T10:45:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 >> v1:172.21.15.31:6816/46601 conn(0x7f11a4045f20 legacy=0x7f11a40483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 msgr2=0x7f11c0151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 --2- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c0151840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f11b800cc90 tx=0x7f11b8001a60 comp rx=0 tx=0).stop 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 shutdown_connections 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 --2- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f11c0069200 0x7f11c0151840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 --2- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f11c00679e0 0x7f11c0097b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 --2- 172.21.15.31:0/3293333892 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f11c0068370 0x7f11c0151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 >> 172.21.15.31:0/3293333892 conn(0x7f11c006ae80 msgr2=0x7f11c0143990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 shutdown_connections 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:06.133+0000 7f11c77af700 1 -- 172.21.15.31:0/3293333892 wait complete. 2024-04-18T10:45:06.136 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:45:06.145 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-04-18T10:45:04.501728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35118,"ondisk_log_size":35118,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002993"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.637320+0000","last_change":"2024-04-18T10:44:26.637274+0000","last_active":"2024-04-18T10:44:26.637320+0000","last_peered":"2024-04-18T10:44:26.637320+0000","last_clean":"2024-04-18T10:44:26.637320+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:44:26.637320+0000","last_undegraded":"2024-04-18T10:44:26.637320+0000","last_fullsized":"2024-04-18T10:44:26.637320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'406","last_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_deep_scrub":"44'406","last_deep_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.637158+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:46.367442+0000","scrub_duration":0.0019350299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.529297+0000","last_change":"2024-04-18T10:44:11.529249+0000","last_active":"2024-04-18T10:44:11.529297+0000","last_peered":"2024-04-18T10:44:11.529297+0000","last_clean":"2024-04-18T10:44:11.529297+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:44:11.529297+0000","last_undegraded":"2024-04-18T10:44:11.529297+0000","last_fullsized":"2024-04-18T10:44:11.529297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'425","last_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_deep_scrub":"44'425","last_deep_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.529136+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:31:02.859668+0000","scrub_duration":0.002289952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":432,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.557510+0000","last_change":"2024-04-18T10:44:21.557477+0000","last_active":"2024-04-18T10:44:21.557510+0000","last_peered":"2024-04-18T10:44:21.557510+0000","last_clean":"2024-04-18T10:44:21.557510+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:44:21.557510+0000","last_undegraded":"2024-04-18T10:44:21.557510+0000","last_fullsized":"2024-04-18T10:44:21.557510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.557376+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:19:59.466067+0000","scrub_duration":0.0022859669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":464,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.547987+0000","last_change":"2024-04-18T10:45:01.547955+0000","last_active":"2024-04-18T10:45:01.547987+0000","last_peered":"2024-04-18T10:45:01.547987+0000","last_clean":"2024-04-18T10:45:01.547987+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:45:01.547987+0000","last_undegraded":"2024-04-18T10:45:01.547987+0000","last_fullsized":"2024-04-18T10:45:01.547987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'394","last_scrub_stamp":"2024-04-18T10:45:01.547829+0000","last_deep_scrub":"44'394","last_deep_scrub_stamp":"2024-04-18T10:45:01.547829+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.547829+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.304001+0000","scrub_duration":0.002333431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":543,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:22.581671+0000","last_change":"2024-04-18T10:44:22.581628+0000","last_active":"2024-04-18T10:44:22.581671+0000","last_peered":"2024-04-18T10:44:22.581671+0000","last_clean":"2024-04-18T10:44:22.581671+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:44:22.581671+0000","last_undegraded":"2024-04-18T10:44:22.581671+0000","last_fullsized":"2024-04-18T10:44:22.581671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'428","last_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_deep_scrub":"44'428","last_deep_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_clean_scrub_stamp":"2024-04-18T10:44:22.581473+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:42:51.909519+0000","scrub_duration":0.0023658939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":413,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:02.500797+0000","last_change":"2024-04-18T10:45:02.500763+0000","last_active":"2024-04-18T10:45:02.500797+0000","last_peered":"2024-04-18T10:45:02.500797+0000","last_clean":"2024-04-18T10:45:02.500797+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:45:02.500797+0000","last_undegraded":"2024-04-18T10:45:02.500797+0000","last_fullsized":"2024-04-18T10:45:02.500797+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'374","last_scrub_stamp":"2024-04-18T10:45:02.500644+0000","last_deep_scrub":"44'374","last_deep_scrub_stamp":"2024-04-18T10:45:02.500644+0000","last_clean_scrub_stamp":"2024-04-18T10:45:02.500644+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:35:37.838971+0000","scrub_duration":0.0024023999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":529,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.334276+0000","last_change":"2024-04-18T10:44:18.334236+0000","last_active":"2024-04-18T10:44:18.334276+0000","last_peered":"2024-04-18T10:44:18.334276+0000","last_clean":"2024-04-18T10:44:18.334276+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:44:18.334276+0000","last_undegraded":"2024-04-18T10:44:18.334276+0000","last_fullsized":"2024-04-18T10:44:18.334276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.334127+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:41:16.742027+0000","scrub_duration":0.0024997970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.989712+0000","last_change":"2024-04-18T10:44:24.989685+0000","last_active":"2024-04-18T10:44:24.989712+0000","last_peered":"2024-04-18T10:44:24.989712+0000","last_clean":"2024-04-18T10:44:24.989712+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:44:24.989712+0000","last_undegraded":"2024-04-18T10:44:24.989712+0000","last_fullsized":"2024-04-18T10:44:24.989712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'383","last_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_deep_scrub":"44'383","last_deep_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.989580+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:01:44.688357+0000","scrub_duration":0.0023556649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":514,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.557807+0000","last_change":"2024-04-18T10:44:11.557779+0000","last_active":"2024-04-18T10:44:11.557807+0000","last_peered":"2024-04-18T10:44:11.557807+0000","last_clean":"2024-04-18T10:44:11.557807+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:44:11.557807+0000","last_undegraded":"2024-04-18T10:44:11.557807+0000","last_fullsized":"2024-04-18T10:44:11.557807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'422","last_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_deep_scrub":"44'422","last_deep_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.557669+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:00:02.279295+0000","scrub_duration":0.0024686619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.144649+0000","last_change":"2024-04-18T10:44:09.144611+0000","last_active":"2024-04-18T10:44:09.144649+0000","last_peered":"2024-04-18T10:44:09.144649+0000","last_clean":"2024-04-18T10:44:09.144649+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:44:09.144649+0000","last_undegraded":"2024-04-18T10:44:09.144649+0000","last_fullsized":"2024-04-18T10:44:09.144649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'421","last_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_deep_scrub":"44'421","last_deep_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.144503+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:16.445422+0000","scrub_duration":0.0024088249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.195610+0000","last_change":"2024-04-18T10:44:14.195578+0000","last_active":"2024-04-18T10:44:14.195610+0000","last_peered":"2024-04-18T10:44:14.195610+0000","last_clean":"2024-04-18T10:44:14.195610+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:44:14.195610+0000","last_undegraded":"2024-04-18T10:44:14.195610+0000","last_fullsized":"2024-04-18T10:44:14.195610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.195443+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:06.505533+0000","scrub_duration":0.0024248439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":415,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:38.631266+0000","last_change":"2024-04-18T10:44:38.631204+0000","last_active":"2024-04-18T10:44:38.631266+0000","last_peered":"2024-04-18T10:44:38.631266+0000","last_clean":"2024-04-18T10:44:38.631266+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:44:38.631266+0000","last_undegraded":"2024-04-18T10:44:38.631266+0000","last_fullsized":"2024-04-18T10:44:38.631266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_clean_scrub_stamp":"2024-04-18T10:44:38.631083+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:27.239036+0000","scrub_duration":0.002062871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":494,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:49.732934+0000","last_change":"2024-04-18T10:44:49.732906+0000","last_active":"2024-04-18T10:44:49.732934+0000","last_peered":"2024-04-18T10:44:49.732934+0000","last_clean":"2024-04-18T10:44:49.732934+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:44:49.732934+0000","last_undegraded":"2024-04-18T10:44:49.732934+0000","last_fullsized":"2024-04-18T10:44:49.732934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'406","last_scrub_stamp":"2024-04-18T10:44:49.732801+0000","last_deep_scrub":"44'406","last_deep_scrub_stamp":"2024-04-18T10:44:49.732801+0000","last_clean_scrub_stamp":"2024-04-18T10:44:49.732801+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:41:17.189667+0000","scrub_duration":0.0023307010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:13.165805+0000","last_change":"2024-04-18T10:44:13.165763+0000","last_active":"2024-04-18T10:44:13.165805+0000","last_peered":"2024-04-18T10:44:13.165805+0000","last_clean":"2024-04-18T10:44:13.165805+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:44:13.165805+0000","last_undegraded":"2024-04-18T10:44:13.165805+0000","last_fullsized":"2024-04-18T10:44:13.165805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_clean_scrub_stamp":"2024-04-18T10:44:13.165654+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:05:30.099837+0000","scrub_duration":0.0022553650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":538,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:56.698063+0000","last_change":"2024-04-18T10:44:56.698031+0000","last_active":"2024-04-18T10:44:56.698063+0000","last_peered":"2024-04-18T10:44:56.698063+0000","last_clean":"2024-04-18T10:44:56.698063+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:44:56.698063+0000","last_undegraded":"2024-04-18T10:44:56.698063+0000","last_fullsized":"2024-04-18T10:44:56.698063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'413","last_scrub_stamp":"2024-04-18T10:44:56.697924+0000","last_deep_scrub":"44'413","last_deep_scrub_stamp":"2024-04-18T10:44:56.697924+0000","last_clean_scrub_stamp":"2024-04-18T10:44:56.697924+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:31:37.961106+0000","scrub_duration":0.002392974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":490,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.684875+0000","last_change":"2024-04-18T10:44:54.684839+0000","last_active":"2024-04-18T10:44:54.684875+0000","last_peered":"2024-04-18T10:44:54.684875+0000","last_clean":"2024-04-18T10:44:54.684875+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:44:54.684875+0000","last_undegraded":"2024-04-18T10:44:54.684875+0000","last_fullsized":"2024-04-18T10:44:54.684875+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'439","last_scrub_stamp":"2024-04-18T10:44:54.684729+0000","last_deep_scrub":"44'439","last_deep_scrub_stamp":"2024-04-18T10:44:54.684729+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.684729+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:01.278560+0000","scrub_duration":0.0022394659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":515,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.615863+0000","last_change":"2024-04-18T10:44:54.615831+0000","last_active":"2024-04-18T10:44:54.615863+0000","last_peered":"2024-04-18T10:44:54.615863+0000","last_clean":"2024-04-18T10:44:54.615863+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:44:54.615863+0000","last_undegraded":"2024-04-18T10:44:54.615863+0000","last_fullsized":"2024-04-18T10:44:54.615863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'424","last_scrub_stamp":"2024-04-18T10:44:54.615711+0000","last_deep_scrub":"44'424","last_deep_scrub_stamp":"2024-04-18T10:44:54.615711+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.615711+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:53:30.727391+0000","scrub_duration":0.0024038290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:25.567371+0000","last_change":"2024-04-18T10:44:25.567348+0000","last_active":"2024-04-18T10:44:25.567371+0000","last_peered":"2024-04-18T10:44:25.567371+0000","last_clean":"2024-04-18T10:44:25.567371+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:44:25.567371+0000","last_undegraded":"2024-04-18T10:44:25.567371+0000","last_fullsized":"2024-04-18T10:44:25.567371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'411","last_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_deep_scrub":"44'411","last_deep_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_clean_scrub_stamp":"2024-04-18T10:44:25.567250+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:30:08.433037+0000","scrub_duration":0.001860376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":537,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.678041+0000","last_change":"2024-04-18T10:44:28.678009+0000","last_active":"2024-04-18T10:44:28.678041+0000","last_peered":"2024-04-18T10:44:28.678041+0000","last_clean":"2024-04-18T10:44:28.678041+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:44:28.678041+0000","last_undegraded":"2024-04-18T10:44:28.678041+0000","last_fullsized":"2024-04-18T10:44:28.678041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.677897+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:19:26.570868+0000","scrub_duration":0.0024894269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":558,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.040362+0000","last_change":"2024-04-18T10:44:23.040332+0000","last_active":"2024-04-18T10:44:23.040362+0000","last_peered":"2024-04-18T10:44:23.040362+0000","last_clean":"2024-04-18T10:44:23.040362+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:44:23.040362+0000","last_undegraded":"2024-04-18T10:44:23.040362+0000","last_fullsized":"2024-04-18T10:44:23.040362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'459","last_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_deep_scrub":"44'459","last_deep_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.040211+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:27:20.385741+0000","scrub_duration":0.0023176189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":513,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:30.040466+0000","last_change":"2024-04-18T10:44:30.040439+0000","last_active":"2024-04-18T10:44:30.040466+0000","last_peered":"2024-04-18T10:44:30.040466+0000","last_clean":"2024-04-18T10:44:30.040466+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:44:30.040466+0000","last_undegraded":"2024-04-18T10:44:30.040466+0000","last_fullsized":"2024-04-18T10:44:30.040466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'413","last_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_deep_scrub":"44'413","last_deep_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_clean_scrub_stamp":"2024-04-18T10:44:30.040312+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:29:22.491578+0000","scrub_duration":0.0023350599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":570,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.532351+0000","last_change":"2024-04-18T10:44:23.532321+0000","last_active":"2024-04-18T10:44:23.532351+0000","last_peered":"2024-04-18T10:44:23.532351+0000","last_clean":"2024-04-18T10:44:23.532351+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:44:23.532351+0000","last_undegraded":"2024-04-18T10:44:23.532351+0000","last_fullsized":"2024-04-18T10:44:23.532351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.532201+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:17:09.342669+0000","scrub_duration":0.00234395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434965+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:43:51.434965+0000","last_peered":"2024-04-18T10:43:51.434965+0000","last_clean":"2024-04-18T10:43:51.434965+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:43:51.434965+0000","last_undegraded":"2024-04-18T10:43:51.434965+0000","last_fullsized":"2024-04-18T10:43:51.434965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":561,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.076667+0000","last_change":"2024-04-18T10:44:20.076638+0000","last_active":"2024-04-18T10:44:20.076667+0000","last_peered":"2024-04-18T10:44:20.076667+0000","last_clean":"2024-04-18T10:44:20.076667+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:44:20.076667+0000","last_undegraded":"2024-04-18T10:44:20.076667+0000","last_fullsized":"2024-04-18T10:44:20.076667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'444","last_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_deep_scrub":"44'444","last_deep_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.076529+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:32:07.735061+0000","scrub_duration":0.0023703510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:59.626990+0000","last_change":"2024-04-18T10:44:59.626945+0000","last_active":"2024-04-18T10:44:59.626990+0000","last_peered":"2024-04-18T10:44:59.626990+0000","last_clean":"2024-04-18T10:44:59.626990+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:44:59.626990+0000","last_undegraded":"2024-04-18T10:44:59.626990+0000","last_fullsized":"2024-04-18T10:44:59.626990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:59.626796+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:59.626796+0000","last_clean_scrub_stamp":"2024-04-18T10:44:59.626796+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:10.274438+0000","scrub_duration":0.0025074519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":614,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.448234+0000","last_change":"2024-04-18T10:38:47.515633+0000","last_active":"2024-04-18T10:43:51.448234+0000","last_peered":"2024-04-18T10:43:51.448234+0000","last_clean":"2024-04-18T10:43:51.448234+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:43:51.448234+0000","last_undegraded":"2024-04-18T10:43:51.448234+0000","last_fullsized":"2024-04-18T10:43:51.448234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.328008+0000","last_change":"2024-04-18T10:44:19.327977+0000","last_active":"2024-04-18T10:44:19.328008+0000","last_peered":"2024-04-18T10:44:19.328008+0000","last_clean":"2024-04-18T10:44:19.328008+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:44:19.328008+0000","last_undegraded":"2024-04-18T10:44:19.328008+0000","last_fullsized":"2024-04-18T10:44:19.328008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'420","last_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_deep_scrub":"44'420","last_deep_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.327882+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:32.007720+0000","scrub_duration":0.0021444820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'601","reported_seq":646,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:46.866913+0000","last_change":"2024-04-18T10:44:46.866883+0000","last_active":"2024-04-18T10:44:46.866913+0000","last_peered":"2024-04-18T10:44:46.866913+0000","last_clean":"2024-04-18T10:44:46.866913+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:44:46.866913+0000","last_undegraded":"2024-04-18T10:44:46.866913+0000","last_fullsized":"2024-04-18T10:44:46.866913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'601","last_scrub_stamp":"2024-04-18T10:44:46.866772+0000","last_deep_scrub":"44'601","last_deep_scrub_stamp":"2024-04-18T10:44:46.866772+0000","last_clean_scrub_stamp":"2024-04-18T10:44:46.866772+0000","objects_scrubbed":3,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:05:53.779318+0000","scrub_duration":0.030500271999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":474,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453949+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:43:51.453949+0000","last_peered":"2024-04-18T10:43:51.453949+0000","last_clean":"2024-04-18T10:43:51.453949+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:43:51.453949+0000","last_undegraded":"2024-04-18T10:43:51.453949+0000","last_fullsized":"2024-04-18T10:43:51.453949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'445","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.993981+0000","last_change":"2024-04-18T10:44:34.993954+0000","last_active":"2024-04-18T10:44:34.993981+0000","last_peered":"2024-04-18T10:44:34.993981+0000","last_clean":"2024-04-18T10:44:34.993981+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:44:34.993981+0000","last_undegraded":"2024-04-18T10:44:34.993981+0000","last_fullsized":"2024-04-18T10:44:34.993981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'445","last_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_deep_scrub":"44'445","last_deep_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.993858+0000","objects_scrubbed":1,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:14:56.923345+0000","scrub_duration":0.014572485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":524,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:52.617462+0000","last_change":"2024-04-18T10:44:52.617432+0000","last_active":"2024-04-18T10:44:52.617462+0000","last_peered":"2024-04-18T10:44:52.617462+0000","last_clean":"2024-04-18T10:44:52.617462+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:44:52.617462+0000","last_undegraded":"2024-04-18T10:44:52.617462+0000","last_fullsized":"2024-04-18T10:44:52.617462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'415","last_scrub_stamp":"2024-04-18T10:44:52.617260+0000","last_deep_scrub":"44'415","last_deep_scrub_stamp":"2024-04-18T10:44:52.617260+0000","last_clean_scrub_stamp":"2024-04-18T10:44:52.617260+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:44:47.192766+0000","scrub_duration":0.002343506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'997","reported_seq":1042,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:49.375535+0000","last_change":"2024-04-18T10:38:48.528981+0000","last_active":"2024-04-18T10:43:49.375535+0000","last_peered":"2024-04-18T10:43:49.375535+0000","last_clean":"2024-04-18T10:43:49.375535+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:43:49.375535+0000","last_undegraded":"2024-04-18T10:43:49.375535+0000","last_fullsized":"2024-04-18T10:43:49.375535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":997,"log_dups_size":0,"ondisk_log_size":997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446910+0000","last_change":"2024-04-18T10:39:29.505858+0000","last_active":"2024-04-18T10:43:51.446910+0000","last_peered":"2024-04-18T10:43:51.446910+0000","last_clean":"2024-04-18T10:43:51.446910+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:43:51.446910+0000","last_undegraded":"2024-04-18T10:43:51.446910+0000","last_fullsized":"2024-04-18T10:43:51.446910+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'65","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:05.559848+0000","last_change":"2024-04-18T10:44:05.559808+0000","last_active":"2024-04-18T10:44:05.559848+0000","last_peered":"2024-04-18T10:44:05.559848+0000","last_clean":"2024-04-18T10:44:05.559848+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:44:05.559848+0000","last_undegraded":"2024-04-18T10:44:05.559848+0000","last_fullsized":"2024-04-18T10:44:05.559848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'65","last_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_deep_scrub":"44'65","last_deep_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_clean_scrub_stamp":"2024-04-18T10:44:05.559716+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:36:17.724033+0000","scrub_duration":0.0036096679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.370178+0000","last_change":"2024-04-18T10:44:16.370147+0000","last_active":"2024-04-18T10:44:16.370178+0000","last_peered":"2024-04-18T10:44:16.370178+0000","last_clean":"2024-04-18T10:44:16.370178+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:44:16.370178+0000","last_undegraded":"2024-04-18T10:44:16.370178+0000","last_fullsized":"2024-04-18T10:44:16.370178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'423","last_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_deep_scrub":"44'423","last_deep_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.370037+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:39:35.585001+0000","scrub_duration":0.0021961260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'330","reported_seq":375,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:40.705897+0000","last_change":"2024-04-18T10:44:40.705867+0000","last_active":"2024-04-18T10:44:40.705897+0000","last_peered":"2024-04-18T10:44:40.705897+0000","last_clean":"2024-04-18T10:44:40.705897+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:44:40.705897+0000","last_undegraded":"2024-04-18T10:44:40.705897+0000","last_fullsized":"2024-04-18T10:44:40.705897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'330","last_scrub_stamp":"2024-04-18T10:44:40.705762+0000","last_deep_scrub":"44'330","last_deep_scrub_stamp":"2024-04-18T10:44:40.705762+0000","last_clean_scrub_stamp":"2024-04-18T10:44:40.705762+0000","objects_scrubbed":2,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:02:31.048359+0000","scrub_duration":0.013686825999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":641,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.177788+0000","last_change":"2024-04-18T10:44:27.177742+0000","last_active":"2024-04-18T10:44:27.177788+0000","last_peered":"2024-04-18T10:44:27.177788+0000","last_clean":"2024-04-18T10:44:27.177788+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:44:27.177788+0000","last_undegraded":"2024-04-18T10:44:27.177788+0000","last_fullsized":"2024-04-18T10:44:27.177788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'482","last_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_deep_scrub":"44'482","last_deep_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.177629+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:47:19.941357+0000","scrub_duration":0.0024789170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'122","reported_seq":173,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.560499+0000","last_change":"2024-04-18T10:44:18.560459+0000","last_active":"2024-04-18T10:44:18.560499+0000","last_peered":"2024-04-18T10:44:18.560499+0000","last_clean":"2024-04-18T10:44:18.560499+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:44:18.560499+0000","last_undegraded":"2024-04-18T10:44:18.560499+0000","last_fullsized":"2024-04-18T10:44:18.560499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'122","last_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_deep_scrub":"44'122","last_deep_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.560319+0000","objects_scrubbed":3,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:09:23.261625+0000","scrub_duration":0.0040023589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":525,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452244+0000","last_change":"2024-04-18T10:38:48.530788+0000","last_active":"2024-04-18T10:43:51.452244+0000","last_peered":"2024-04-18T10:43:51.452244+0000","last_clean":"2024-04-18T10:43:51.452244+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:43:51.452244+0000","last_undegraded":"2024-04-18T10:43:51.452244+0000","last_fullsized":"2024-04-18T10:43:51.452244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'365","reported_seq":408,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.455289+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:43:51.455289+0000","last_peered":"2024-04-18T10:43:51.455289+0000","last_clean":"2024-04-18T10:43:51.455289+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:43:51.455289+0000","last_undegraded":"2024-04-18T10:43:51.455289+0000","last_fullsized":"2024-04-18T10:43:51.455289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":556,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.709995+0000","last_change":"2024-04-18T10:44:43.709963+0000","last_active":"2024-04-18T10:44:43.709995+0000","last_peered":"2024-04-18T10:44:43.709995+0000","last_clean":"2024-04-18T10:44:43.709995+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:44:43.709995+0000","last_undegraded":"2024-04-18T10:44:43.709995+0000","last_fullsized":"2024-04-18T10:44:43.709995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'434","last_scrub_stamp":"2024-04-18T10:44:43.709864+0000","last_deep_scrub":"44'434","last_deep_scrub_stamp":"2024-04-18T10:44:43.709864+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.709864+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:40:37.586605+0000","scrub_duration":0.0022503520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'454","reported_seq":501,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.414963+0000","last_change":"2024-04-18T10:38:48.523218+0000","last_active":"2024-04-18T10:43:47.414963+0000","last_peered":"2024-04-18T10:43:47.414963+0000","last_clean":"2024-04-18T10:43:47.414963+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:43:47.414963+0000","last_undegraded":"2024-04-18T10:43:47.414963+0000","last_fullsized":"2024-04-18T10:43:47.414963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":441,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:58.814487+0000","last_change":"2024-04-18T10:44:58.814448+0000","last_active":"2024-04-18T10:44:58.814487+0000","last_peered":"2024-04-18T10:44:58.814487+0000","last_clean":"2024-04-18T10:44:58.814487+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:44:58.814487+0000","last_undegraded":"2024-04-18T10:44:58.814487+0000","last_fullsized":"2024-04-18T10:44:58.814487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:58.814332+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:58.814332+0000","last_clean_scrub_stamp":"2024-04-18T10:44:58.814332+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:38:25.746039+0000","scrub_duration":0.002297543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'53","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.595939+0000","last_change":"2024-04-18T10:44:26.595910+0000","last_active":"2024-04-18T10:44:26.595939+0000","last_peered":"2024-04-18T10:44:26.595939+0000","last_clean":"2024-04-18T10:44:26.595939+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:44:26.595939+0000","last_undegraded":"2024-04-18T10:44:26.595939+0000","last_fullsized":"2024-04-18T10:44:26.595939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'53","last_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_deep_scrub":"44'53","last_deep_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.595811+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:16:49.585489+0000","scrub_duration":0.0030095930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.438405+0000","last_change":"2024-04-18T10:38:48.526748+0000","last_active":"2024-04-18T10:43:51.438405+0000","last_peered":"2024-04-18T10:43:51.438405+0000","last_clean":"2024-04-18T10:43:51.438405+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:43:51.438405+0000","last_undegraded":"2024-04-18T10:43:51.438405+0000","last_fullsized":"2024-04-18T10:43:51.438405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":104,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.432580+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:43:46.432580+0000","last_peered":"2024-04-18T10:43:46.432580+0000","last_clean":"2024-04-18T10:43:46.432580+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:43:46.432580+0000","last_undegraded":"2024-04-18T10:43:46.432580+0000","last_fullsized":"2024-04-18T10:43:46.432580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:57.653310+0000","last_change":"2024-04-18T10:44:57.653280+0000","last_active":"2024-04-18T10:44:57.653310+0000","last_peered":"2024-04-18T10:44:57.653310+0000","last_clean":"2024-04-18T10:44:57.653310+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:44:57.653310+0000","last_undegraded":"2024-04-18T10:44:57.653310+0000","last_fullsized":"2024-04-18T10:44:57.653310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'436","last_scrub_stamp":"2024-04-18T10:44:57.653159+0000","last_deep_scrub":"44'436","last_deep_scrub_stamp":"2024-04-18T10:44:57.653159+0000","last_clean_scrub_stamp":"2024-04-18T10:44:57.653159+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:31:19.842593+0000","scrub_duration":0.002443579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'75","reported_seq":129,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.009173+0000","last_change":"2024-04-18T10:44:28.009140+0000","last_active":"2024-04-18T10:44:28.009173+0000","last_peered":"2024-04-18T10:44:28.009173+0000","last_clean":"2024-04-18T10:44:28.009173+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:44:28.009173+0000","last_undegraded":"2024-04-18T10:44:28.009173+0000","last_fullsized":"2024-04-18T10:44:28.009173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'75","last_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_deep_scrub":"44'75","last_deep_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.009038+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:08:03.526122+0000","scrub_duration":0.0053935800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":499,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:29.118675+0000","last_change":"2024-04-18T10:44:29.118645+0000","last_active":"2024-04-18T10:44:29.118675+0000","last_peered":"2024-04-18T10:44:29.118675+0000","last_clean":"2024-04-18T10:44:29.118675+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:44:29.118675+0000","last_undegraded":"2024-04-18T10:44:29.118675+0000","last_fullsized":"2024-04-18T10:44:29.118675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'395","last_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_deep_scrub":"44'395","last_deep_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_clean_scrub_stamp":"2024-04-18T10:44:29.118542+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:28:54.989556+0000","scrub_duration":0.0023004689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'253","reported_seq":299,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.557411+0000","last_change":"2024-04-18T10:44:24.557383+0000","last_active":"2024-04-18T10:44:24.557411+0000","last_peered":"2024-04-18T10:44:24.557411+0000","last_clean":"2024-04-18T10:44:24.557411+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:44:24.557411+0000","last_undegraded":"2024-04-18T10:44:24.557411+0000","last_fullsized":"2024-04-18T10:44:24.557411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'253","last_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_deep_scrub":"44'253","last_deep_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.557282+0000","objects_scrubbed":2,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:50:13.889591+0000","scrub_duration":0.013433855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":487,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.066217+0000","last_change":"2024-04-18T10:44:42.066187+0000","last_active":"2024-04-18T10:44:42.066217+0000","last_peered":"2024-04-18T10:44:42.066217+0000","last_clean":"2024-04-18T10:44:42.066217+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:44:42.066217+0000","last_undegraded":"2024-04-18T10:44:42.066217+0000","last_fullsized":"2024-04-18T10:44:42.066217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:42.066068+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:42.066068+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.066068+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:04:45.048703+0000","scrub_duration":0.0023960040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'342","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.598760+0000","last_change":"2024-04-18T10:44:24.598713+0000","last_active":"2024-04-18T10:44:24.598760+0000","last_peered":"2024-04-18T10:44:24.598760+0000","last_clean":"2024-04-18T10:44:24.598760+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:44:24.598760+0000","last_undegraded":"2024-04-18T10:44:24.598760+0000","last_fullsized":"2024-04-18T10:44:24.598760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'342","last_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_deep_scrub":"44'342","last_deep_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.598616+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:33.105351+0000","scrub_duration":0.013052151999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.025191+0000","last_change":"2024-04-18T10:44:24.025155+0000","last_active":"2024-04-18T10:44:24.025191+0000","last_peered":"2024-04-18T10:44:24.025191+0000","last_clean":"2024-04-18T10:44:24.025191+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:44:24.025191+0000","last_undegraded":"2024-04-18T10:44:24.025191+0000","last_fullsized":"2024-04-18T10:44:24.025191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'435","last_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_deep_scrub":"44'435","last_deep_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.025044+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:05.200707+0000","scrub_duration":0.0023369929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'565","reported_seq":607,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.465737+0000","last_change":"2024-04-18T10:38:48.528245+0000","last_active":"2024-04-18T10:43:48.465737+0000","last_peered":"2024-04-18T10:43:48.465737+0000","last_clean":"2024-04-18T10:43:48.465737+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:43:48.465737+0000","last_undegraded":"2024-04-18T10:43:48.465737+0000","last_fullsized":"2024-04-18T10:43:48.465737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.525196+0000","last_change":"2024-04-18T10:44:09.525165+0000","last_active":"2024-04-18T10:44:09.525196+0000","last_peered":"2024-04-18T10:44:09.525196+0000","last_clean":"2024-04-18T10:44:09.525196+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:44:09.525196+0000","last_undegraded":"2024-04-18T10:44:09.525196+0000","last_fullsized":"2024-04-18T10:44:09.525196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'414","last_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_deep_scrub":"44'414","last_deep_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.525069+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:25:30.256844+0000","scrub_duration":0.002236264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":107,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:08.605199+0000","last_change":"2024-04-18T10:44:08.605160+0000","last_active":"2024-04-18T10:44:08.605199+0000","last_peered":"2024-04-18T10:44:08.605199+0000","last_clean":"2024-04-18T10:44:08.605199+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:44:08.605199+0000","last_undegraded":"2024-04-18T10:44:08.605199+0000","last_fullsized":"2024-04-18T10:44:08.605199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'60","last_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_deep_scrub":"44'60","last_deep_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_clean_scrub_stamp":"2024-04-18T10:44:08.605009+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:45:04.374538+0000","scrub_duration":0.0018151350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":557,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:06.589224+0000","last_change":"2024-04-18T10:44:06.589194+0000","last_active":"2024-04-18T10:44:06.589224+0000","last_peered":"2024-04-18T10:44:06.589224+0000","last_clean":"2024-04-18T10:44:06.589224+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:44:06.589224+0000","last_undegraded":"2024-04-18T10:44:06.589224+0000","last_fullsized":"2024-04-18T10:44:06.589224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'457","last_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_deep_scrub":"44'457","last_deep_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_clean_scrub_stamp":"2024-04-18T10:44:06.589080+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:14:25.178162+0000","scrub_duration":0.0023982220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'170","reported_seq":216,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.416597+0000","last_change":"2024-04-18T10:38:48.523093+0000","last_active":"2024-04-18T10:43:47.416597+0000","last_peered":"2024-04-18T10:43:47.416597+0000","last_clean":"2024-04-18T10:43:47.416597+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:43:47.416597+0000","last_undegraded":"2024-04-18T10:43:47.416597+0000","last_fullsized":"2024-04-18T10:43:47.416597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:55.648293+0000","last_change":"2024-04-18T10:44:55.648252+0000","last_active":"2024-04-18T10:44:55.648293+0000","last_peered":"2024-04-18T10:44:55.648293+0000","last_clean":"2024-04-18T10:44:55.648293+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:44:55.648293+0000","last_undegraded":"2024-04-18T10:44:55.648293+0000","last_fullsized":"2024-04-18T10:44:55.648293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'449","last_scrub_stamp":"2024-04-18T10:44:55.648144+0000","last_deep_scrub":"44'449","last_deep_scrub_stamp":"2024-04-18T10:44:55.648144+0000","last_clean_scrub_stamp":"2024-04-18T10:44:55.648144+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:49:28.345804+0000","scrub_duration":0.002471123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'249","reported_seq":290,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.405567+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:43:48.405567+0000","last_peered":"2024-04-18T10:43:48.405567+0000","last_clean":"2024-04-18T10:43:48.405567+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:43:48.405567+0000","last_undegraded":"2024-04-18T10:43:48.405567+0000","last_fullsized":"2024-04-18T10:43:48.405567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.454009+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:43:51.454009+0000","last_peered":"2024-04-18T10:43:51.454009+0000","last_clean":"2024-04-18T10:43:51.454009+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:43:51.454009+0000","last_undegraded":"2024-04-18T10:43:51.454009+0000","last_fullsized":"2024-04-18T10:43:51.454009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'62","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.389838+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:43:47.389838+0000","last_peered":"2024-04-18T10:43:47.389838+0000","last_clean":"2024-04-18T10:43:47.389838+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:43:47.389838+0000","last_undegraded":"2024-04-18T10:43:47.389838+0000","last_fullsized":"2024-04-18T10:43:47.389838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":415,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:53.715496+0000","last_change":"2024-04-18T10:44:53.715462+0000","last_active":"2024-04-18T10:44:53.715496+0000","last_peered":"2024-04-18T10:44:53.715496+0000","last_clean":"2024-04-18T10:44:53.715496+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:44:53.715496+0000","last_undegraded":"2024-04-18T10:44:53.715496+0000","last_fullsized":"2024-04-18T10:44:53.715496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'354","last_scrub_stamp":"2024-04-18T10:44:53.715355+0000","last_deep_scrub":"44'354","last_deep_scrub_stamp":"2024-04-18T10:44:53.715355+0000","last_clean_scrub_stamp":"2024-04-18T10:44:53.715355+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:08:56.971258+0000","scrub_duration":0.0023169520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'492","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.379895+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:43:47.379895+0000","last_peered":"2024-04-18T10:43:47.379895+0000","last_clean":"2024-04-18T10:43:47.379895+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:43:47.379895+0000","last_undegraded":"2024-04-18T10:43:47.379895+0000","last_fullsized":"2024-04-18T10:43:47.379895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":517,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452398+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:43:51.452398+0000","last_peered":"2024-04-18T10:43:51.452398+0000","last_clean":"2024-04-18T10:43:51.452398+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:43:51.452398+0000","last_undegraded":"2024-04-18T10:43:51.452398+0000","last_fullsized":"2024-04-18T10:43:51.452398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.876195+0000","last_change":"2024-04-18T10:44:42.876155+0000","last_active":"2024-04-18T10:44:42.876195+0000","last_peered":"2024-04-18T10:44:42.876195+0000","last_clean":"2024-04-18T10:44:42.876195+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:44:42.876195+0000","last_undegraded":"2024-04-18T10:44:42.876195+0000","last_fullsized":"2024-04-18T10:44:42.876195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:42.876035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:42.876035+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.876035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:02.831189+0000","scrub_duration":0.0014149329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'349","reported_seq":395,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.613083+0000","last_change":"2024-04-18T10:44:37.613042+0000","last_active":"2024-04-18T10:44:37.613083+0000","last_peered":"2024-04-18T10:44:37.613083+0000","last_clean":"2024-04-18T10:44:37.613083+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:44:37.613083+0000","last_undegraded":"2024-04-18T10:44:37.613083+0000","last_fullsized":"2024-04-18T10:44:37.613083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.612936+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:48.492165+0000","scrub_duration":0.014537654000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":411,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:48.862502+0000","last_change":"2024-04-18T10:44:48.862438+0000","last_active":"2024-04-18T10:44:48.862502+0000","last_peered":"2024-04-18T10:44:48.862502+0000","last_clean":"2024-04-18T10:44:48.862502+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:44:48.862502+0000","last_undegraded":"2024-04-18T10:44:48.862502+0000","last_fullsized":"2024-04-18T10:44:48.862502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:48.862336+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:48.862336+0000","last_clean_scrub_stamp":"2024-04-18T10:44:48.862336+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:48.226148+0000","scrub_duration":0.002153767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.094073+0000","last_change":"2024-04-18T10:44:43.094046+0000","last_active":"2024-04-18T10:44:43.094073+0000","last_peered":"2024-04-18T10:44:43.094073+0000","last_clean":"2024-04-18T10:44:43.094073+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:44:43.094073+0000","last_undegraded":"2024-04-18T10:44:43.094073+0000","last_fullsized":"2024-04-18T10:44:43.094073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:43.093917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:43.093917+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.093917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:44.980892+0000","scrub_duration":0.001405737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'72","reported_seq":122,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.533181+0000","last_change":"2024-04-18T10:44:19.533110+0000","last_active":"2024-04-18T10:44:19.533181+0000","last_peered":"2024-04-18T10:44:19.533181+0000","last_clean":"2024-04-18T10:44:19.533181+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:44:19.533181+0000","last_undegraded":"2024-04-18T10:44:19.533181+0000","last_fullsized":"2024-04-18T10:44:19.533181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'72","last_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_deep_scrub":"44'72","last_deep_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.533013+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:08:26.074171+0000","scrub_duration":0.003923078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.114134+0000","last_change":"2024-04-18T10:44:19.114101+0000","last_active":"2024-04-18T10:44:19.114134+0000","last_peered":"2024-04-18T10:44:19.114134+0000","last_clean":"2024-04-18T10:44:19.114134+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:44:19.114134+0000","last_undegraded":"2024-04-18T10:44:19.114134+0000","last_fullsized":"2024-04-18T10:44:19.114134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.113999+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:07:38.747202+0000","scrub_duration":0.002438047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:46.672262+0000","last_change":"2024-04-18T10:44:46.672227+0000","last_active":"2024-04-18T10:44:46.672262+0000","last_peered":"2024-04-18T10:44:46.672262+0000","last_clean":"2024-04-18T10:44:46.672262+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:44:46.672262+0000","last_undegraded":"2024-04-18T10:44:46.672262+0000","last_fullsized":"2024-04-18T10:44:46.672262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:46.672112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:46.672112+0000","last_clean_scrub_stamp":"2024-04-18T10:44:46.672112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:10:12.323516+0000","scrub_duration":0.0016045009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'433","reported_seq":469,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.388428+0000","last_change":"2024-04-18T10:38:47.519693+0000","last_active":"2024-04-18T10:43:47.388428+0000","last_peered":"2024-04-18T10:43:47.388428+0000","last_clean":"2024-04-18T10:43:47.388428+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:43:47.388428+0000","last_undegraded":"2024-04-18T10:43:47.388428+0000","last_fullsized":"2024-04-18T10:43:47.388428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.106706+0000","last_change":"2024-04-18T10:44:17.106676+0000","last_active":"2024-04-18T10:44:17.106706+0000","last_peered":"2024-04-18T10:44:17.106706+0000","last_clean":"2024-04-18T10:44:17.106706+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:44:17.106706+0000","last_undegraded":"2024-04-18T10:44:17.106706+0000","last_fullsized":"2024-04-18T10:44:17.106706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.106562+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:13:53.441711+0000","scrub_duration":0.0023480530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.136129+0000","last_change":"2024-04-18T10:44:28.136098+0000","last_active":"2024-04-18T10:44:28.136129+0000","last_peered":"2024-04-18T10:44:28.136129+0000","last_clean":"2024-04-18T10:44:28.136129+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:44:28.136129+0000","last_undegraded":"2024-04-18T10:44:28.136129+0000","last_fullsized":"2024-04-18T10:44:28.136129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.135985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:42.424822+0000","scrub_duration":0.001452168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"44'117","reported_seq":207,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:36.000064+0000","last_change":"2024-04-18T10:44:36.000033+0000","last_active":"2024-04-18T10:44:36.000064+0000","last_peered":"2024-04-18T10:44:36.000064+0000","last_clean":"2024-04-18T10:44:36.000064+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:44:36.000064+0000","last_undegraded":"2024-04-18T10:44:36.000064+0000","last_fullsized":"2024-04-18T10:44:36.000064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'117","last_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_deep_scrub":"44'117","last_deep_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_clean_scrub_stamp":"2024-04-18T10:44:35.999921+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:44.891493+0000","scrub_duration":0.0075134060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'526","reported_seq":564,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.416391+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:43:45.416391+0000","last_peered":"2024-04-18T10:43:45.416391+0000","last_clean":"2024-04-18T10:43:45.416391+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:43:45.416391+0000","last_undegraded":"2024-04-18T10:43:45.416391+0000","last_fullsized":"2024-04-18T10:43:45.416391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":542,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453925+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:43:51.453925+0000","last_peered":"2024-04-18T10:43:51.453925+0000","last_clean":"2024-04-18T10:43:51.453925+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:43:51.453925+0000","last_undegraded":"2024-04-18T10:43:51.453925+0000","last_fullsized":"2024-04-18T10:43:51.453925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:41.049096+0000","last_change":"2024-04-18T10:44:41.049065+0000","last_active":"2024-04-18T10:44:41.049096+0000","last_peered":"2024-04-18T10:44:41.049096+0000","last_clean":"2024-04-18T10:44:41.049096+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:44:41.049096+0000","last_undegraded":"2024-04-18T10:44:41.049096+0000","last_fullsized":"2024-04-18T10:44:41.049096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_clean_scrub_stamp":"2024-04-18T10:44:41.048965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:40:48.265478+0000","scrub_duration":0.001413037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'263","reported_seq":495,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.603509+0000","last_change":"2024-04-18T10:44:27.603480+0000","last_active":"2024-04-18T10:44:27.603509+0000","last_peered":"2024-04-18T10:44:27.603509+0000","last_clean":"2024-04-18T10:44:27.603509+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:44:27.603509+0000","last_undegraded":"2024-04-18T10:44:27.603509+0000","last_fullsized":"2024-04-18T10:44:27.603509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'263","last_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_deep_scrub":"44'263","last_deep_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.603367+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:00.661142+0000","scrub_duration":0.006809715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.595841+0000","last_change":"2024-04-18T10:44:16.595810+0000","last_active":"2024-04-18T10:44:16.595841+0000","last_peered":"2024-04-18T10:44:16.595841+0000","last_clean":"2024-04-18T10:44:16.595841+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:44:16.595841+0000","last_undegraded":"2024-04-18T10:44:16.595841+0000","last_fullsized":"2024-04-18T10:44:16.595841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.595707+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:47.126670+0000","scrub_duration":0.002372323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.099574+0000","last_change":"2024-04-18T10:44:37.099519+0000","last_active":"2024-04-18T10:44:37.099574+0000","last_peered":"2024-04-18T10:44:37.099574+0000","last_clean":"2024-04-18T10:44:37.099574+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:44:37.099574+0000","last_undegraded":"2024-04-18T10:44:37.099574+0000","last_fullsized":"2024-04-18T10:44:37.099574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.099405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:12.361352+0000","scrub_duration":0.0015369120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.904082+0000","last_change":"2024-04-18T10:44:54.904049+0000","last_active":"2024-04-18T10:44:54.904082+0000","last_peered":"2024-04-18T10:44:54.904082+0000","last_clean":"2024-04-18T10:44:54.904082+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:44:54.904082+0000","last_undegraded":"2024-04-18T10:44:54.904082+0000","last_fullsized":"2024-04-18T10:44:54.904082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'57","last_scrub_stamp":"2024-04-18T10:44:54.903953+0000","last_deep_scrub":"44'57","last_deep_scrub_stamp":"2024-04-18T10:44:54.903953+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.903953+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:38.000312+0000","scrub_duration":0.00156953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.572462+0000","last_change":"2024-04-18T10:44:20.572430+0000","last_active":"2024-04-18T10:44:20.572462+0000","last_peered":"2024-04-18T10:44:20.572462+0000","last_clean":"2024-04-18T10:44:20.572462+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:44:20.572462+0000","last_undegraded":"2024-04-18T10:44:20.572462+0000","last_fullsized":"2024-04-18T10:44:20.572462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.572320+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:05.780336+0000","scrub_duration":0.0024798110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'64","reported_seq":116,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.293206+0000","last_change":"2024-04-18T10:44:21.293174+0000","last_active":"2024-04-18T10:44:21.293206+0000","last_peered":"2024-04-18T10:44:21.293206+0000","last_clean":"2024-04-18T10:44:21.293206+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:44:21.293206+0000","last_undegraded":"2024-04-18T10:44:21.293206+0000","last_fullsized":"2024-04-18T10:44:21.293206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'64","last_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_deep_scrub":"44'64","last_deep_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.293058+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:02.602650+0000","scrub_duration":0.0072041329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.116265+0000","last_change":"2024-04-18T10:44:16.116227+0000","last_active":"2024-04-18T10:44:16.116265+0000","last_peered":"2024-04-18T10:44:16.116265+0000","last_clean":"2024-04-18T10:44:16.116265+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:44:16.116265+0000","last_undegraded":"2024-04-18T10:44:16.116265+0000","last_fullsized":"2024-04-18T10:44:16.116265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.116120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:38:35.456110+0000","scrub_duration":0.001526194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":482,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450321+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:43:51.450321+0000","last_peered":"2024-04-18T10:43:51.450321+0000","last_clean":"2024-04-18T10:43:51.450321+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:43:51.450321+0000","last_undegraded":"2024-04-18T10:43:51.450321+0000","last_fullsized":"2024-04-18T10:43:51.450321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.163325+0000","last_change":"2024-04-18T10:44:26.163296+0000","last_active":"2024-04-18T10:44:26.163325+0000","last_peered":"2024-04-18T10:44:26.163325+0000","last_clean":"2024-04-18T10:44:26.163325+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:44:26.163325+0000","last_undegraded":"2024-04-18T10:44:26.163325+0000","last_fullsized":"2024-04-18T10:44:26.163325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.163155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:41:33.487472+0000","scrub_duration":0.001544494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":131,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.630059+0000","last_change":"2024-04-18T10:44:14.630013+0000","last_active":"2024-04-18T10:44:14.630059+0000","last_peered":"2024-04-18T10:44:14.630059+0000","last_clean":"2024-04-18T10:44:14.630059+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:44:14.630059+0000","last_undegraded":"2024-04-18T10:44:14.630059+0000","last_fullsized":"2024-04-18T10:44:14.630059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'83","last_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_deep_scrub":"44'83","last_deep_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.629894+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:04:39.848103+0000","scrub_duration":0.0054998199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":457,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:15.610348+0000","last_change":"2024-04-18T10:44:15.610317+0000","last_active":"2024-04-18T10:44:15.610348+0000","last_peered":"2024-04-18T10:44:15.610348+0000","last_clean":"2024-04-18T10:44:15.610348+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:44:15.610348+0000","last_undegraded":"2024-04-18T10:44:15.610348+0000","last_fullsized":"2024-04-18T10:44:15.610348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'377","last_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_deep_scrub":"44'377","last_deep_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_clean_scrub_stamp":"2024-04-18T10:44:15.610194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:21:45.794459+0000","scrub_duration":0.0023276400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'75","reported_seq":125,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.685768+0000","last_change":"2024-04-18T10:44:43.685728+0000","last_active":"2024-04-18T10:44:43.685768+0000","last_peered":"2024-04-18T10:44:43.685768+0000","last_clean":"2024-04-18T10:44:43.685768+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:44:43.685768+0000","last_undegraded":"2024-04-18T10:44:43.685768+0000","last_fullsized":"2024-04-18T10:44:43.685768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'75","last_scrub_stamp":"2024-04-18T10:44:43.685630+0000","last_deep_scrub":"44'75","last_deep_scrub_stamp":"2024-04-18T10:44:43.685630+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.685630+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:19:47.619608+0000","scrub_duration":0.011221696999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":452,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:48.710591+0000","last_change":"2024-04-18T10:44:48.710558+0000","last_active":"2024-04-18T10:44:48.710591+0000","last_peered":"2024-04-18T10:44:48.710591+0000","last_clean":"2024-04-18T10:44:48.710591+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:44:48.710591+0000","last_undegraded":"2024-04-18T10:44:48.710591+0000","last_fullsized":"2024-04-18T10:44:48.710591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'384","last_scrub_stamp":"2024-04-18T10:44:48.710451+0000","last_deep_scrub":"44'384","last_deep_scrub_stamp":"2024-04-18T10:44:48.710451+0000","last_clean_scrub_stamp":"2024-04-18T10:44:48.710451+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:03:14.715697+0000","scrub_duration":0.0024035810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'345","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:40.861394+0000","last_change":"2024-04-18T10:44:40.861354+0000","last_active":"2024-04-18T10:44:40.861394+0000","last_peered":"2024-04-18T10:44:40.861394+0000","last_clean":"2024-04-18T10:44:40.861394+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:44:40.861394+0000","last_undegraded":"2024-04-18T10:44:40.861394+0000","last_fullsized":"2024-04-18T10:44:40.861394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'345","last_scrub_stamp":"2024-04-18T10:44:40.861207+0000","last_deep_scrub":"44'345","last_deep_scrub_stamp":"2024-04-18T10:44:40.861207+0000","last_clean_scrub_stamp":"2024-04-18T10:44:40.861207+0000","objects_scrubbed":2,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:42:35.225739+0000","scrub_duration":0.01437416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":420,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:10.529301+0000","last_change":"2024-04-18T10:44:10.529249+0000","last_active":"2024-04-18T10:44:10.529301+0000","last_peered":"2024-04-18T10:44:10.529301+0000","last_clean":"2024-04-18T10:44:10.529301+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:44:10.529301+0000","last_undegraded":"2024-04-18T10:44:10.529301+0000","last_fullsized":"2024-04-18T10:44:10.529301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'352","last_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_deep_scrub":"44'352","last_deep_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:10.529127+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:12:28.231944+0000","scrub_duration":0.0022035800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'291","reported_seq":347,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.377930+0000","last_change":"2024-04-18T10:44:17.377889+0000","last_active":"2024-04-18T10:44:17.377930+0000","last_peered":"2024-04-18T10:44:17.377930+0000","last_clean":"2024-04-18T10:44:17.377930+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:44:17.377930+0000","last_undegraded":"2024-04-18T10:44:17.377930+0000","last_fullsized":"2024-04-18T10:44:17.377930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'291","last_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_deep_scrub":"44'291","last_deep_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.377743+0000","objects_scrubbed":4,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:37.743454+0000","scrub_duration":0.030049699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.575444+0000","last_change":"2024-04-18T10:44:19.575417+0000","last_active":"2024-04-18T10:44:19.575444+0000","last_peered":"2024-04-18T10:44:19.575444+0000","last_clean":"2024-04-18T10:44:19.575444+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:44:19.575444+0000","last_undegraded":"2024-04-18T10:44:19.575444+0000","last_fullsized":"2024-04-18T10:44:19.575444+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.575311+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:47:55.784007+0000","scrub_duration":0.0020110480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'110","reported_seq":148,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.469632+0000","last_change":"2024-04-18T10:38:48.521841+0000","last_active":"2024-04-18T10:43:48.469632+0000","last_peered":"2024-04-18T10:43:48.469632+0000","last_clean":"2024-04-18T10:43:48.469632+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:43:48.469632+0000","last_undegraded":"2024-04-18T10:43:48.469632+0000","last_fullsized":"2024-04-18T10:43:48.469632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449223+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:43:51.449223+0000","last_peered":"2024-04-18T10:43:51.449223+0000","last_clean":"2024-04-18T10:43:51.449223+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:43:51.449223+0000","last_undegraded":"2024-04-18T10:43:51.449223+0000","last_fullsized":"2024-04-18T10:43:51.449223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'102","reported_seq":146,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.622673+0000","last_change":"2024-04-18T10:44:34.622627+0000","last_active":"2024-04-18T10:44:34.622673+0000","last_peered":"2024-04-18T10:44:34.622673+0000","last_clean":"2024-04-18T10:44:34.622673+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:44:34.622673+0000","last_undegraded":"2024-04-18T10:44:34.622673+0000","last_fullsized":"2024-04-18T10:44:34.622673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'102","last_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_deep_scrub":"44'102","last_deep_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.622522+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:53:16.158696+0000","scrub_duration":0.012842098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:39.658970+0000","last_change":"2024-04-18T10:44:39.658938+0000","last_active":"2024-04-18T10:44:39.658970+0000","last_peered":"2024-04-18T10:44:39.658970+0000","last_clean":"2024-04-18T10:44:39.658970+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:44:39.658970+0000","last_undegraded":"2024-04-18T10:44:39.658970+0000","last_fullsized":"2024-04-18T10:44:39.658970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'432","last_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_deep_scrub":"44'432","last_deep_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_clean_scrub_stamp":"2024-04-18T10:44:39.658831+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:58:08.433321+0000","scrub_duration":0.0024322020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":500,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.446619+0000","last_change":"2024-04-18T10:38:47.515056+0000","last_active":"2024-04-18T10:43:51.446619+0000","last_peered":"2024-04-18T10:43:51.446619+0000","last_clean":"2024-04-18T10:43:51.446619+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:43:51.446619+0000","last_undegraded":"2024-04-18T10:43:51.446619+0000","last_fullsized":"2024-04-18T10:43:51.446619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":449,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:58.675440+0000","last_change":"2024-04-18T10:44:58.675399+0000","last_active":"2024-04-18T10:44:58.675440+0000","last_peered":"2024-04-18T10:44:58.675440+0000","last_clean":"2024-04-18T10:44:58.675440+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:44:58.675440+0000","last_undegraded":"2024-04-18T10:44:58.675440+0000","last_fullsized":"2024-04-18T10:44:58.675440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'408","last_scrub_stamp":"2024-04-18T10:44:58.675288+0000","last_deep_scrub":"44'408","last_deep_scrub_stamp":"2024-04-18T10:44:58.675288+0000","last_clean_scrub_stamp":"2024-04-18T10:44:58.675288+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:11:15.241591+0000","scrub_duration":0.0022547029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":575,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.634081+0000","last_change":"2024-04-18T10:44:42.634050+0000","last_active":"2024-04-18T10:44:42.634081+0000","last_peered":"2024-04-18T10:44:42.634081+0000","last_clean":"2024-04-18T10:44:42.634081+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:44:42.634081+0000","last_undegraded":"2024-04-18T10:44:42.634081+0000","last_fullsized":"2024-04-18T10:44:42.634081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'470","last_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_deep_scrub":"44'470","last_deep_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.633943+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:34:03.702154+0000","scrub_duration":0.0025497570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.195348+0000","last_change":"2024-04-18T10:44:24.195320+0000","last_active":"2024-04-18T10:44:24.195348+0000","last_peered":"2024-04-18T10:44:24.195348+0000","last_clean":"2024-04-18T10:44:24.195348+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:44:24.195348+0000","last_undegraded":"2024-04-18T10:44:24.195348+0000","last_fullsized":"2024-04-18T10:44:24.195348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.195206+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:51:24.563147+0000","scrub_duration":0.0022383659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":508,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:51.884469+0000","last_change":"2024-04-18T10:44:51.884431+0000","last_active":"2024-04-18T10:44:51.884469+0000","last_peered":"2024-04-18T10:44:51.884469+0000","last_clean":"2024-04-18T10:44:51.884469+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:44:51.884469+0000","last_undegraded":"2024-04-18T10:44:51.884469+0000","last_fullsized":"2024-04-18T10:44:51.884469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'402","last_scrub_stamp":"2024-04-18T10:44:51.884312+0000","last_deep_scrub":"44'402","last_deep_scrub_stamp":"2024-04-18T10:44:51.884312+0000","last_clean_scrub_stamp":"2024-04-18T10:44:51.884312+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:33.666434+0000","scrub_duration":0.0022388320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8536,"ondisk_log_size":8536,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953549,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.36799999999999999},"min":{"1min":0.248,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.46400000000000002,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.38100000000000001},"min":{"1min":0.24399999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.49399999999999999,"5min":1.732,"15min":1.732},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.28499999999999998,"5min":0.184,"15min":0.184},"max":{"1min":0.51900000000000002,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.38200000000000001},"min":{"1min":0.29599999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.57899999999999996},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.42599999999999999},"min":{"1min":0.32100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":4.181,"15min":4.181},"last":0.44800000000000001}]}]},{"osd":2,"up_from":31,"seq":133143986253,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.17799999999999999,"5min":0.161,"15min":0.161},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.71199999999999997,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.35299999999999998,"15min":0.38100000000000001},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.379,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.39900000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Apr 18 10:43:58 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.373,"15min":0.40500000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.40999999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.41799999999999998,"15min":0.42999999999999999},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":0.49099999999999999}]}]},{"osd":0,"up_from":29,"seq":124554051662,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.33800000000000002},"min":{"1min":0.27700000000000002,"5min":0.156,"15min":0.156},"max":{"1min":0.53300000000000003,"5min":1.002,"15min":1.002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55300000000000005,"5min":1.224,"15min":1.224},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.36199999999999999},"min":{"1min":0.32600000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.53000000000000003,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.314,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":1.173,"15min":1.173},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.375,"15min":0.41499999999999998},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51500000000000001,"5min":0.879,"15min":1.204},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.50700000000000001},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56799999999999995,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.61499999999999999}]}]},{"osd":1,"up_from":30,"seq":128849018957,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.33300000000000002,"15min":0.34899999999999998},"min":{"1min":0.16900000000000001,"5min":0.153,"15min":0.153},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.378},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.33900000000000002,"15min":0.35899999999999999},"min":{"1min":0.19700000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.41899999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.325,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.307},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.36799999999999999,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.58099999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Apr 18 10:43:55 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.98599999999999999,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.26000000000000001,"5min":0.217,"15min":0.217},"max":{"1min":1.9970000000000001,"5min":2.173,"15min":2.173},"last":0.39600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:45:06.149 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.149 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.150 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.150 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.150 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.150 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.150 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.150 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.150 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.150 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.151 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.151 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.151 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.151 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.151 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.151 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.151 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.151 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.152 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.152 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.152 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.152 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.152 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.152 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:06.152 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T10:45:26.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:45:26.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.286+0000 7f8b4b114700 1 Processor -- start 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.286+0000 7f8b4b114700 1 -- start start 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.286+0000 7f8b4b114700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b440680f0 0x7f8b440a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.286+0000 7f8b4b114700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b44069b50 0x7f8b4406ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.286+0000 7f8b4b114700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4406a480 con 0x7f8b44069f20 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.286+0000 7f8b4b114700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440a3430 con 0x7f8b440680f0 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.286+0000 7f8b4b114700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4406a720 con 0x7f8b44069b50 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b48eb0700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b440680f0 0x7f8b440a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b43fff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b44069b50 0x7f8b4406ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b496b1700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8b44069f20 0x7f8b4406ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41246/0 (socket says 172.21.15.31:41246) 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b496b1700 1 -- 172.21.15.31:0/2039577474 learned_addr learned my addr 172.21.15.31:0/2039577474 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b48eb0700 1 -- 172.21.15.31:0/2039577474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b44069b50 msgr2=0x7f8b4406ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b437fe700 1 -- 172.21.15.31:0/2039577474 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896789626 0 0) 0x7f8b4406a480 con 0x7f8b44069f20 2024-04-18T10:45:26.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b48eb0700 1 --2- 172.21.15.31:0/2039577474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b44069b50 0x7f8b4406ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b48eb0700 1 -- 172.21.15.31:0/2039577474 >> v1:172.21.15.31:6789/0 conn(0x7f8b44069f20 legacy=0x7f8b4406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:26.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b48eb0700 1 -- 172.21.15.31:0/2039577474 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4406aa80 con 0x7f8b440680f0 2024-04-18T10:45:26.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b43fff700 1 --2- 172.21.15.31:0/2039577474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b44069b50 0x7f8b4406ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:45:26.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b48eb0700 1 --2- 172.21.15.31:0/2039577474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b440680f0 0x7f8b440a3b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009910 tx=0x7f8b380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9c6c06c67edf09d server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:45:26.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b437fe700 1 -- 172.21.15.31:0/2039577474 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800b680 con 0x7f8b440680f0 2024-04-18T10:45:26.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b437fe700 1 -- 172.21.15.31:0/2039577474 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3800b7e0 con 0x7f8b440680f0 2024-04-18T10:45:26.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.287+0000 7f8b437fe700 1 -- 172.21.15.31:0/2039577474 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800bba0 con 0x7f8b440680f0 2024-04-18T10:45:26.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.288+0000 7f8b4b114700 1 -- 172.21.15.31:0/2039577474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b440680f0 msgr2=0x7f8b440a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:26.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.288+0000 7f8b4b114700 1 --2- 172.21.15.31:0/2039577474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b440680f0 0x7f8b440a3b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009910 tx=0x7f8b380091a0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.288+0000 7f8b4b114700 1 -- 172.21.15.31:0/2039577474 shutdown_connections 2024-04-18T10:45:26.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.288+0000 7f8b4b114700 1 --2- 172.21.15.31:0/2039577474 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b440680f0 0x7f8b440a3b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.288+0000 7f8b4b114700 1 --2- 172.21.15.31:0/2039577474 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b44069b50 0x7f8b4406ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.288+0000 7f8b4b114700 1 -- 172.21.15.31:0/2039577474 >> 172.21.15.31:0/2039577474 conn(0x7f8b4406dd70 msgr2=0x7f8b440679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.288+0000 7f8b4b114700 1 -- 172.21.15.31:0/2039577474 shutdown_connections 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.288+0000 7f8b4b114700 1 -- 172.21.15.31:0/2039577474 wait complete. 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.289+0000 7f8b4b114700 1 Processor -- start 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.289+0000 7f8b4b114700 1 -- start start 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b4b114700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b440680f0 0x7f8b44096ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b4b114700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b44069b50 0x7f8b44151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b4b114700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b44069f20 0x7f8b44151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b4b114700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440976b0 con 0x7f8b44069f20 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b4b114700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b44097970 con 0x7f8b44069b50 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b4b114700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b440ad8d0 con 0x7f8b440680f0 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b43fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b44069b50 0x7f8b44151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b48eb0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b440680f0 0x7f8b44096ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b496b1700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b44069f20 0x7f8b44151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:26.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b43fff700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b44069b50 0x7f8b44151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:42448/0 (socket says 172.21.15.31:42448) 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b48eb0700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b440680f0 0x7f8b44096ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:52960/0 (socket says 172.21.15.31:52960) 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b43fff700 1 -- 172.21.15.31:0/2301766314 learned_addr learned my addr 172.21.15.31:0/2301766314 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b43fff700 1 -- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b440680f0 msgr2=0x7f8b44096ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b43fff700 1 --2- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b440680f0 0x7f8b44096ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b43fff700 1 -- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b44069f20 msgr2=0x7f8b44151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b43fff700 1 --2- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b44069f20 0x7f8b44151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b43fff700 1 -- 172.21.15.31:0/2301766314 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30009420 con 0x7f8b44069b50 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b496b1700 1 --2- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b44069f20 0x7f8b44151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b43fff700 1 --2- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b44069b50 0x7f8b44151a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000ec80 tx=0x7f8b300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b40ff9700 1 -- 172.21.15.31:0/2301766314 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000c920 con 0x7f8b44069b50 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b40ff9700 1 -- 172.21.15.31:0/2301766314 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3000ca80 con 0x7f8b44069b50 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b38009420 con 0x7f8b44069b50 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b40ff9700 1 -- 172.21.15.31:0/2301766314 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000ce00 con 0x7f8b44069b50 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.290+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b44098b90 con 0x7f8b44069b50 2024-04-18T10:45:26.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.291+0000 7f8b40ff9700 1 -- 172.21.15.31:0/2301766314 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8b30013680 con 0x7f8b44069b50 2024-04-18T10:45:26.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.291+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b44145cf0 con 0x7f8b44069b50 2024-04-18T10:45:26.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.292+0000 7f8b40ff9700 1 -- 172.21.15.31:0/2301766314 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f8b3005b4b0 con 0x7f8b44069b50 2024-04-18T10:45:26.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.295+0000 7f8b40ff9700 1 -- 172.21.15.31:0/2301766314 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8b300396f0 con 0x7f8b44069b50 2024-04-18T10:45:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.453+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b440651b0 con 0x7f8b28045ef0 2024-04-18T10:45:26.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.460+0000 7f8b40ff9700 1 -- 172.21.15.31:0/2301766314 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279716 (unknown 2965378022 0 4019840750) 0x7f8b440651b0 con 0x7f8b28045ef0 2024-04-18T10:45:26.465 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:45:26.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 >> v1:172.21.15.31:6816/46601 conn(0x7f8b28045ef0 legacy=0x7f8b280483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:26.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b44069b50 msgr2=0x7f8b44151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:26.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 --2- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b44069b50 0x7f8b44151a90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000ec80 tx=0x7f8b300091a0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 shutdown_connections 2024-04-18T10:45:26.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 --2- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f8b440680f0 0x7f8b44096ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 --2- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b44069f20 0x7f8b44151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 --2- 172.21.15.31:0/2301766314 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f8b44069b50 0x7f8b44151a90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:26.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 >> 172.21.15.31:0/2301766314 conn(0x7f8b4406dd70 msgr2=0x7f8b44144e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:45:26.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 shutdown_connections 2024-04-18T10:45:26.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:26.463+0000 7f8b4b114700 1 -- 172.21.15.31:0/2301766314 wait complete. 2024-04-18T10:45:26.468 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:45:26.476 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-04-18T10:45:24.507292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35134,"ondisk_log_size":35134,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003183"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.637320+0000","last_change":"2024-04-18T10:44:26.637274+0000","last_active":"2024-04-18T10:44:26.637320+0000","last_peered":"2024-04-18T10:44:26.637320+0000","last_clean":"2024-04-18T10:44:26.637320+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:44:26.637320+0000","last_undegraded":"2024-04-18T10:44:26.637320+0000","last_fullsized":"2024-04-18T10:44:26.637320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'406","last_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_deep_scrub":"44'406","last_deep_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.637158+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:46.367442+0000","scrub_duration":0.0019350299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.529297+0000","last_change":"2024-04-18T10:44:11.529249+0000","last_active":"2024-04-18T10:44:11.529297+0000","last_peered":"2024-04-18T10:44:11.529297+0000","last_clean":"2024-04-18T10:44:11.529297+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:44:11.529297+0000","last_undegraded":"2024-04-18T10:44:11.529297+0000","last_fullsized":"2024-04-18T10:44:11.529297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'425","last_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_deep_scrub":"44'425","last_deep_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.529136+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:31:02.859668+0000","scrub_duration":0.002289952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":432,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.557510+0000","last_change":"2024-04-18T10:44:21.557477+0000","last_active":"2024-04-18T10:44:21.557510+0000","last_peered":"2024-04-18T10:44:21.557510+0000","last_clean":"2024-04-18T10:44:21.557510+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:44:21.557510+0000","last_undegraded":"2024-04-18T10:44:21.557510+0000","last_fullsized":"2024-04-18T10:44:21.557510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.557376+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:19:59.466067+0000","scrub_duration":0.0022859669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":464,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.547987+0000","last_change":"2024-04-18T10:45:01.547955+0000","last_active":"2024-04-18T10:45:01.547987+0000","last_peered":"2024-04-18T10:45:01.547987+0000","last_clean":"2024-04-18T10:45:01.547987+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:45:01.547987+0000","last_undegraded":"2024-04-18T10:45:01.547987+0000","last_fullsized":"2024-04-18T10:45:01.547987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'394","last_scrub_stamp":"2024-04-18T10:45:01.547829+0000","last_deep_scrub":"44'394","last_deep_scrub_stamp":"2024-04-18T10:45:01.547829+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.547829+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.304001+0000","scrub_duration":0.002333431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":543,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:22.581671+0000","last_change":"2024-04-18T10:44:22.581628+0000","last_active":"2024-04-18T10:44:22.581671+0000","last_peered":"2024-04-18T10:44:22.581671+0000","last_clean":"2024-04-18T10:44:22.581671+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:44:22.581671+0000","last_undegraded":"2024-04-18T10:44:22.581671+0000","last_fullsized":"2024-04-18T10:44:22.581671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'428","last_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_deep_scrub":"44'428","last_deep_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_clean_scrub_stamp":"2024-04-18T10:44:22.581473+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:42:51.909519+0000","scrub_duration":0.0023658939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":413,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:02.500797+0000","last_change":"2024-04-18T10:45:02.500763+0000","last_active":"2024-04-18T10:45:02.500797+0000","last_peered":"2024-04-18T10:45:02.500797+0000","last_clean":"2024-04-18T10:45:02.500797+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:45:02.500797+0000","last_undegraded":"2024-04-18T10:45:02.500797+0000","last_fullsized":"2024-04-18T10:45:02.500797+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'374","last_scrub_stamp":"2024-04-18T10:45:02.500644+0000","last_deep_scrub":"44'374","last_deep_scrub_stamp":"2024-04-18T10:45:02.500644+0000","last_clean_scrub_stamp":"2024-04-18T10:45:02.500644+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:35:37.838971+0000","scrub_duration":0.0024023999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":529,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.334276+0000","last_change":"2024-04-18T10:44:18.334236+0000","last_active":"2024-04-18T10:44:18.334276+0000","last_peered":"2024-04-18T10:44:18.334276+0000","last_clean":"2024-04-18T10:44:18.334276+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:44:18.334276+0000","last_undegraded":"2024-04-18T10:44:18.334276+0000","last_fullsized":"2024-04-18T10:44:18.334276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.334127+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:41:16.742027+0000","scrub_duration":0.0024997970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.989712+0000","last_change":"2024-04-18T10:44:24.989685+0000","last_active":"2024-04-18T10:44:24.989712+0000","last_peered":"2024-04-18T10:44:24.989712+0000","last_clean":"2024-04-18T10:44:24.989712+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:44:24.989712+0000","last_undegraded":"2024-04-18T10:44:24.989712+0000","last_fullsized":"2024-04-18T10:44:24.989712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'383","last_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_deep_scrub":"44'383","last_deep_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.989580+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:01:44.688357+0000","scrub_duration":0.0023556649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":514,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.557807+0000","last_change":"2024-04-18T10:44:11.557779+0000","last_active":"2024-04-18T10:44:11.557807+0000","last_peered":"2024-04-18T10:44:11.557807+0000","last_clean":"2024-04-18T10:44:11.557807+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:44:11.557807+0000","last_undegraded":"2024-04-18T10:44:11.557807+0000","last_fullsized":"2024-04-18T10:44:11.557807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'422","last_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_deep_scrub":"44'422","last_deep_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.557669+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:00:02.279295+0000","scrub_duration":0.0024686619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.144649+0000","last_change":"2024-04-18T10:44:09.144611+0000","last_active":"2024-04-18T10:44:09.144649+0000","last_peered":"2024-04-18T10:44:09.144649+0000","last_clean":"2024-04-18T10:44:09.144649+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:44:09.144649+0000","last_undegraded":"2024-04-18T10:44:09.144649+0000","last_fullsized":"2024-04-18T10:44:09.144649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'421","last_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_deep_scrub":"44'421","last_deep_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.144503+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:16.445422+0000","scrub_duration":0.0024088249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.195610+0000","last_change":"2024-04-18T10:44:14.195578+0000","last_active":"2024-04-18T10:44:14.195610+0000","last_peered":"2024-04-18T10:44:14.195610+0000","last_clean":"2024-04-18T10:44:14.195610+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:44:14.195610+0000","last_undegraded":"2024-04-18T10:44:14.195610+0000","last_fullsized":"2024-04-18T10:44:14.195610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.195443+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:06.505533+0000","scrub_duration":0.0024248439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":415,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:38.631266+0000","last_change":"2024-04-18T10:44:38.631204+0000","last_active":"2024-04-18T10:44:38.631266+0000","last_peered":"2024-04-18T10:44:38.631266+0000","last_clean":"2024-04-18T10:44:38.631266+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:44:38.631266+0000","last_undegraded":"2024-04-18T10:44:38.631266+0000","last_fullsized":"2024-04-18T10:44:38.631266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_clean_scrub_stamp":"2024-04-18T10:44:38.631083+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:27.239036+0000","scrub_duration":0.002062871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":494,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:49.732934+0000","last_change":"2024-04-18T10:44:49.732906+0000","last_active":"2024-04-18T10:44:49.732934+0000","last_peered":"2024-04-18T10:44:49.732934+0000","last_clean":"2024-04-18T10:44:49.732934+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:44:49.732934+0000","last_undegraded":"2024-04-18T10:44:49.732934+0000","last_fullsized":"2024-04-18T10:44:49.732934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'406","last_scrub_stamp":"2024-04-18T10:44:49.732801+0000","last_deep_scrub":"44'406","last_deep_scrub_stamp":"2024-04-18T10:44:49.732801+0000","last_clean_scrub_stamp":"2024-04-18T10:44:49.732801+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:41:17.189667+0000","scrub_duration":0.0023307010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:13.165805+0000","last_change":"2024-04-18T10:44:13.165763+0000","last_active":"2024-04-18T10:44:13.165805+0000","last_peered":"2024-04-18T10:44:13.165805+0000","last_clean":"2024-04-18T10:44:13.165805+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:44:13.165805+0000","last_undegraded":"2024-04-18T10:44:13.165805+0000","last_fullsized":"2024-04-18T10:44:13.165805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_clean_scrub_stamp":"2024-04-18T10:44:13.165654+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:05:30.099837+0000","scrub_duration":0.0022553650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":538,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:56.698063+0000","last_change":"2024-04-18T10:44:56.698031+0000","last_active":"2024-04-18T10:44:56.698063+0000","last_peered":"2024-04-18T10:44:56.698063+0000","last_clean":"2024-04-18T10:44:56.698063+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:44:56.698063+0000","last_undegraded":"2024-04-18T10:44:56.698063+0000","last_fullsized":"2024-04-18T10:44:56.698063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'413","last_scrub_stamp":"2024-04-18T10:44:56.697924+0000","last_deep_scrub":"44'413","last_deep_scrub_stamp":"2024-04-18T10:44:56.697924+0000","last_clean_scrub_stamp":"2024-04-18T10:44:56.697924+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:31:37.961106+0000","scrub_duration":0.002392974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":490,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.684875+0000","last_change":"2024-04-18T10:44:54.684839+0000","last_active":"2024-04-18T10:44:54.684875+0000","last_peered":"2024-04-18T10:44:54.684875+0000","last_clean":"2024-04-18T10:44:54.684875+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:44:54.684875+0000","last_undegraded":"2024-04-18T10:44:54.684875+0000","last_fullsized":"2024-04-18T10:44:54.684875+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'439","last_scrub_stamp":"2024-04-18T10:44:54.684729+0000","last_deep_scrub":"44'439","last_deep_scrub_stamp":"2024-04-18T10:44:54.684729+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.684729+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:01.278560+0000","scrub_duration":0.0022394659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":515,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.615863+0000","last_change":"2024-04-18T10:44:54.615831+0000","last_active":"2024-04-18T10:44:54.615863+0000","last_peered":"2024-04-18T10:44:54.615863+0000","last_clean":"2024-04-18T10:44:54.615863+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:44:54.615863+0000","last_undegraded":"2024-04-18T10:44:54.615863+0000","last_fullsized":"2024-04-18T10:44:54.615863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'424","last_scrub_stamp":"2024-04-18T10:44:54.615711+0000","last_deep_scrub":"44'424","last_deep_scrub_stamp":"2024-04-18T10:44:54.615711+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.615711+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:53:30.727391+0000","scrub_duration":0.0024038290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:25.567371+0000","last_change":"2024-04-18T10:44:25.567348+0000","last_active":"2024-04-18T10:44:25.567371+0000","last_peered":"2024-04-18T10:44:25.567371+0000","last_clean":"2024-04-18T10:44:25.567371+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:44:25.567371+0000","last_undegraded":"2024-04-18T10:44:25.567371+0000","last_fullsized":"2024-04-18T10:44:25.567371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'411","last_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_deep_scrub":"44'411","last_deep_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_clean_scrub_stamp":"2024-04-18T10:44:25.567250+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:30:08.433037+0000","scrub_duration":0.001860376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":537,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.678041+0000","last_change":"2024-04-18T10:44:28.678009+0000","last_active":"2024-04-18T10:44:28.678041+0000","last_peered":"2024-04-18T10:44:28.678041+0000","last_clean":"2024-04-18T10:44:28.678041+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:44:28.678041+0000","last_undegraded":"2024-04-18T10:44:28.678041+0000","last_fullsized":"2024-04-18T10:44:28.678041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.677897+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:19:26.570868+0000","scrub_duration":0.0024894269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":558,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.040362+0000","last_change":"2024-04-18T10:44:23.040332+0000","last_active":"2024-04-18T10:44:23.040362+0000","last_peered":"2024-04-18T10:44:23.040362+0000","last_clean":"2024-04-18T10:44:23.040362+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:44:23.040362+0000","last_undegraded":"2024-04-18T10:44:23.040362+0000","last_fullsized":"2024-04-18T10:44:23.040362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'459","last_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_deep_scrub":"44'459","last_deep_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.040211+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:27:20.385741+0000","scrub_duration":0.0023176189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":513,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:30.040466+0000","last_change":"2024-04-18T10:44:30.040439+0000","last_active":"2024-04-18T10:44:30.040466+0000","last_peered":"2024-04-18T10:44:30.040466+0000","last_clean":"2024-04-18T10:44:30.040466+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:44:30.040466+0000","last_undegraded":"2024-04-18T10:44:30.040466+0000","last_fullsized":"2024-04-18T10:44:30.040466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'413","last_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_deep_scrub":"44'413","last_deep_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_clean_scrub_stamp":"2024-04-18T10:44:30.040312+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:29:22.491578+0000","scrub_duration":0.0023350599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":570,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.532351+0000","last_change":"2024-04-18T10:44:23.532321+0000","last_active":"2024-04-18T10:44:23.532351+0000","last_peered":"2024-04-18T10:44:23.532351+0000","last_clean":"2024-04-18T10:44:23.532351+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:44:23.532351+0000","last_undegraded":"2024-04-18T10:44:23.532351+0000","last_fullsized":"2024-04-18T10:44:23.532351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.532201+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:17:09.342669+0000","scrub_duration":0.00234395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":486,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.434965+0000","last_change":"2024-04-18T10:38:48.525214+0000","last_active":"2024-04-18T10:43:51.434965+0000","last_peered":"2024-04-18T10:43:51.434965+0000","last_clean":"2024-04-18T10:43:51.434965+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:43:51.434965+0000","last_undegraded":"2024-04-18T10:43:51.434965+0000","last_fullsized":"2024-04-18T10:43:51.434965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":561,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.076667+0000","last_change":"2024-04-18T10:44:20.076638+0000","last_active":"2024-04-18T10:44:20.076667+0000","last_peered":"2024-04-18T10:44:20.076667+0000","last_clean":"2024-04-18T10:44:20.076667+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:44:20.076667+0000","last_undegraded":"2024-04-18T10:44:20.076667+0000","last_fullsized":"2024-04-18T10:44:20.076667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'444","last_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_deep_scrub":"44'444","last_deep_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.076529+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:32:07.735061+0000","scrub_duration":0.0023703510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:59.626990+0000","last_change":"2024-04-18T10:44:59.626945+0000","last_active":"2024-04-18T10:44:59.626990+0000","last_peered":"2024-04-18T10:44:59.626990+0000","last_clean":"2024-04-18T10:44:59.626990+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:44:59.626990+0000","last_undegraded":"2024-04-18T10:44:59.626990+0000","last_fullsized":"2024-04-18T10:44:59.626990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:59.626796+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:59.626796+0000","last_clean_scrub_stamp":"2024-04-18T10:44:59.626796+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:10.274438+0000","scrub_duration":0.0025074519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":624,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:12.933898+0000","last_change":"2024-04-18T10:45:12.933849+0000","last_active":"2024-04-18T10:45:12.933898+0000","last_peered":"2024-04-18T10:45:12.933898+0000","last_clean":"2024-04-18T10:45:12.933898+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:45:12.933898+0000","last_undegraded":"2024-04-18T10:45:12.933898+0000","last_fullsized":"2024-04-18T10:45:12.933898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'504","last_scrub_stamp":"2024-04-18T10:45:12.933743+0000","last_deep_scrub":"44'504","last_deep_scrub_stamp":"2024-04-18T10:45:12.933743+0000","last_clean_scrub_stamp":"2024-04-18T10:45:12.933743+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:17.820138+0000","scrub_duration":0.0023169979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.328008+0000","last_change":"2024-04-18T10:44:19.327977+0000","last_active":"2024-04-18T10:44:19.328008+0000","last_peered":"2024-04-18T10:44:19.328008+0000","last_clean":"2024-04-18T10:44:19.328008+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:44:19.328008+0000","last_undegraded":"2024-04-18T10:44:19.328008+0000","last_fullsized":"2024-04-18T10:44:19.328008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'420","last_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_deep_scrub":"44'420","last_deep_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.327882+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:32.007720+0000","scrub_duration":0.0021444820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'601","reported_seq":646,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:46.866913+0000","last_change":"2024-04-18T10:44:46.866883+0000","last_active":"2024-04-18T10:44:46.866913+0000","last_peered":"2024-04-18T10:44:46.866913+0000","last_clean":"2024-04-18T10:44:46.866913+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:44:46.866913+0000","last_undegraded":"2024-04-18T10:44:46.866913+0000","last_fullsized":"2024-04-18T10:44:46.866913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'601","last_scrub_stamp":"2024-04-18T10:44:46.866772+0000","last_deep_scrub":"44'601","last_deep_scrub_stamp":"2024-04-18T10:44:46.866772+0000","last_clean_scrub_stamp":"2024-04-18T10:44:46.866772+0000","objects_scrubbed":3,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:05:53.779318+0000","scrub_duration":0.030500271999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":474,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453949+0000","last_change":"2024-04-18T10:38:48.535848+0000","last_active":"2024-04-18T10:43:51.453949+0000","last_peered":"2024-04-18T10:43:51.453949+0000","last_clean":"2024-04-18T10:43:51.453949+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:43:51.453949+0000","last_undegraded":"2024-04-18T10:43:51.453949+0000","last_fullsized":"2024-04-18T10:43:51.453949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'445","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.993981+0000","last_change":"2024-04-18T10:44:34.993954+0000","last_active":"2024-04-18T10:44:34.993981+0000","last_peered":"2024-04-18T10:44:34.993981+0000","last_clean":"2024-04-18T10:44:34.993981+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:44:34.993981+0000","last_undegraded":"2024-04-18T10:44:34.993981+0000","last_fullsized":"2024-04-18T10:44:34.993981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'445","last_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_deep_scrub":"44'445","last_deep_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.993858+0000","objects_scrubbed":1,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:14:56.923345+0000","scrub_duration":0.014572485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":524,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:52.617462+0000","last_change":"2024-04-18T10:44:52.617432+0000","last_active":"2024-04-18T10:44:52.617462+0000","last_peered":"2024-04-18T10:44:52.617462+0000","last_clean":"2024-04-18T10:44:52.617462+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:44:52.617462+0000","last_undegraded":"2024-04-18T10:44:52.617462+0000","last_fullsized":"2024-04-18T10:44:52.617462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'415","last_scrub_stamp":"2024-04-18T10:44:52.617260+0000","last_deep_scrub":"44'415","last_deep_scrub_stamp":"2024-04-18T10:44:52.617260+0000","last_clean_scrub_stamp":"2024-04-18T10:44:52.617260+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:44:47.192766+0000","scrub_duration":0.002343506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'999","reported_seq":1054,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:10.902038+0000","last_change":"2024-04-18T10:45:10.902005+0000","last_active":"2024-04-18T10:45:10.902038+0000","last_peered":"2024-04-18T10:45:10.902038+0000","last_clean":"2024-04-18T10:45:10.902038+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:45:10.902038+0000","last_undegraded":"2024-04-18T10:45:10.902038+0000","last_fullsized":"2024-04-18T10:45:10.902038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'999","last_scrub_stamp":"2024-04-18T10:45:10.901904+0000","last_deep_scrub":"44'999","last_deep_scrub_stamp":"2024-04-18T10:45:10.901904+0000","last_clean_scrub_stamp":"2024-04-18T10:45:10.901904+0000","objects_scrubbed":2,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:17:40.862195+0000","scrub_duration":0.024304912000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":435,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.689865+0000","last_change":"2024-04-18T10:45:01.689805+0000","last_active":"2024-04-18T10:45:01.689865+0000","last_peered":"2024-04-18T10:45:01.689865+0000","last_clean":"2024-04-18T10:45:01.689865+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:45:01.689865+0000","last_undegraded":"2024-04-18T10:45:01.689865+0000","last_fullsized":"2024-04-18T10:45:01.689865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:45:01.689684+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:45:01.689684+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.689684+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:06.214067+0000","scrub_duration":0.0023057709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'65","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:05.559848+0000","last_change":"2024-04-18T10:44:05.559808+0000","last_active":"2024-04-18T10:44:05.559848+0000","last_peered":"2024-04-18T10:44:05.559848+0000","last_clean":"2024-04-18T10:44:05.559848+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:44:05.559848+0000","last_undegraded":"2024-04-18T10:44:05.559848+0000","last_fullsized":"2024-04-18T10:44:05.559848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'65","last_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_deep_scrub":"44'65","last_deep_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_clean_scrub_stamp":"2024-04-18T10:44:05.559716+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:36:17.724033+0000","scrub_duration":0.0036096679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.370178+0000","last_change":"2024-04-18T10:44:16.370147+0000","last_active":"2024-04-18T10:44:16.370178+0000","last_peered":"2024-04-18T10:44:16.370178+0000","last_clean":"2024-04-18T10:44:16.370178+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:44:16.370178+0000","last_undegraded":"2024-04-18T10:44:16.370178+0000","last_fullsized":"2024-04-18T10:44:16.370178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'423","last_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_deep_scrub":"44'423","last_deep_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.370037+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:39:35.585001+0000","scrub_duration":0.0021961260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'330","reported_seq":375,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:40.705897+0000","last_change":"2024-04-18T10:44:40.705867+0000","last_active":"2024-04-18T10:44:40.705897+0000","last_peered":"2024-04-18T10:44:40.705897+0000","last_clean":"2024-04-18T10:44:40.705897+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:44:40.705897+0000","last_undegraded":"2024-04-18T10:44:40.705897+0000","last_fullsized":"2024-04-18T10:44:40.705897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'330","last_scrub_stamp":"2024-04-18T10:44:40.705762+0000","last_deep_scrub":"44'330","last_deep_scrub_stamp":"2024-04-18T10:44:40.705762+0000","last_clean_scrub_stamp":"2024-04-18T10:44:40.705762+0000","objects_scrubbed":2,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:02:31.048359+0000","scrub_duration":0.013686825999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":641,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.177788+0000","last_change":"2024-04-18T10:44:27.177742+0000","last_active":"2024-04-18T10:44:27.177788+0000","last_peered":"2024-04-18T10:44:27.177788+0000","last_clean":"2024-04-18T10:44:27.177788+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:44:27.177788+0000","last_undegraded":"2024-04-18T10:44:27.177788+0000","last_fullsized":"2024-04-18T10:44:27.177788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'482","last_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_deep_scrub":"44'482","last_deep_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.177629+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:47:19.941357+0000","scrub_duration":0.0024789170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'122","reported_seq":173,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.560499+0000","last_change":"2024-04-18T10:44:18.560459+0000","last_active":"2024-04-18T10:44:18.560499+0000","last_peered":"2024-04-18T10:44:18.560499+0000","last_clean":"2024-04-18T10:44:18.560499+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:44:18.560499+0000","last_undegraded":"2024-04-18T10:44:18.560499+0000","last_fullsized":"2024-04-18T10:44:18.560499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'122","last_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_deep_scrub":"44'122","last_deep_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.560319+0000","objects_scrubbed":3,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:09:23.261625+0000","scrub_duration":0.0040023589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":535,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:09.949815+0000","last_change":"2024-04-18T10:45:09.949784+0000","last_active":"2024-04-18T10:45:09.949815+0000","last_peered":"2024-04-18T10:45:09.949815+0000","last_clean":"2024-04-18T10:45:09.949815+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:45:09.949815+0000","last_undegraded":"2024-04-18T10:45:09.949815+0000","last_fullsized":"2024-04-18T10:45:09.949815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:45:09.949681+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:45:09.949681+0000","last_clean_scrub_stamp":"2024-04-18T10:45:09.949681+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:13.437273+0000","scrub_duration":0.0023086029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'365","reported_seq":408,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.455289+0000","last_change":"2024-04-18T10:38:48.523092+0000","last_active":"2024-04-18T10:43:51.455289+0000","last_peered":"2024-04-18T10:43:51.455289+0000","last_clean":"2024-04-18T10:43:51.455289+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:43:51.455289+0000","last_undegraded":"2024-04-18T10:43:51.455289+0000","last_fullsized":"2024-04-18T10:43:51.455289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":556,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.709995+0000","last_change":"2024-04-18T10:44:43.709963+0000","last_active":"2024-04-18T10:44:43.709995+0000","last_peered":"2024-04-18T10:44:43.709995+0000","last_clean":"2024-04-18T10:44:43.709995+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:44:43.709995+0000","last_undegraded":"2024-04-18T10:44:43.709995+0000","last_fullsized":"2024-04-18T10:44:43.709995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'434","last_scrub_stamp":"2024-04-18T10:44:43.709864+0000","last_deep_scrub":"44'434","last_deep_scrub_stamp":"2024-04-18T10:44:43.709864+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.709864+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:40:37.586605+0000","scrub_duration":0.0022503520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'459","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:20.830738+0000","last_change":"2024-04-18T10:45:20.830699+0000","last_active":"2024-04-18T10:45:20.830738+0000","last_peered":"2024-04-18T10:45:20.830738+0000","last_clean":"2024-04-18T10:45:20.830738+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:45:20.830738+0000","last_undegraded":"2024-04-18T10:45:20.830738+0000","last_fullsized":"2024-04-18T10:45:20.830738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'459","last_scrub_stamp":"2024-04-18T10:45:20.830596+0000","last_deep_scrub":"44'459","last_deep_scrub_stamp":"2024-04-18T10:45:20.830596+0000","last_clean_scrub_stamp":"2024-04-18T10:45:20.830596+0000","objects_scrubbed":5,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:26:15.771848+0000","scrub_duration":0.024028593000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":441,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:58.814487+0000","last_change":"2024-04-18T10:44:58.814448+0000","last_active":"2024-04-18T10:44:58.814487+0000","last_peered":"2024-04-18T10:44:58.814487+0000","last_clean":"2024-04-18T10:44:58.814487+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:44:58.814487+0000","last_undegraded":"2024-04-18T10:44:58.814487+0000","last_fullsized":"2024-04-18T10:44:58.814487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:58.814332+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:58.814332+0000","last_clean_scrub_stamp":"2024-04-18T10:44:58.814332+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:38:25.746039+0000","scrub_duration":0.002297543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'53","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.595939+0000","last_change":"2024-04-18T10:44:26.595910+0000","last_active":"2024-04-18T10:44:26.595939+0000","last_peered":"2024-04-18T10:44:26.595939+0000","last_clean":"2024-04-18T10:44:26.595939+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:44:26.595939+0000","last_undegraded":"2024-04-18T10:44:26.595939+0000","last_fullsized":"2024-04-18T10:44:26.595939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'53","last_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_deep_scrub":"44'53","last_deep_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.595811+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:16:49.585489+0000","scrub_duration":0.0030095930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:12.868156+0000","last_change":"2024-04-18T10:45:12.868098+0000","last_active":"2024-04-18T10:45:12.868156+0000","last_peered":"2024-04-18T10:45:12.868156+0000","last_clean":"2024-04-18T10:45:12.868156+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:45:12.868156+0000","last_undegraded":"2024-04-18T10:45:12.868156+0000","last_fullsized":"2024-04-18T10:45:12.868156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'405","last_scrub_stamp":"2024-04-18T10:45:12.867983+0000","last_deep_scrub":"44'405","last_deep_scrub_stamp":"2024-04-18T10:45:12.867983+0000","last_clean_scrub_stamp":"2024-04-18T10:45:12.867983+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:40:01.021347+0000","scrub_duration":0.0023951160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":104,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.432580+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:43:46.432580+0000","last_peered":"2024-04-18T10:43:46.432580+0000","last_clean":"2024-04-18T10:43:46.432580+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:43:46.432580+0000","last_undegraded":"2024-04-18T10:43:46.432580+0000","last_fullsized":"2024-04-18T10:43:46.432580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:57.653310+0000","last_change":"2024-04-18T10:44:57.653280+0000","last_active":"2024-04-18T10:44:57.653310+0000","last_peered":"2024-04-18T10:44:57.653310+0000","last_clean":"2024-04-18T10:44:57.653310+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:44:57.653310+0000","last_undegraded":"2024-04-18T10:44:57.653310+0000","last_fullsized":"2024-04-18T10:44:57.653310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'436","last_scrub_stamp":"2024-04-18T10:44:57.653159+0000","last_deep_scrub":"44'436","last_deep_scrub_stamp":"2024-04-18T10:44:57.653159+0000","last_clean_scrub_stamp":"2024-04-18T10:44:57.653159+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:31:19.842593+0000","scrub_duration":0.002443579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'75","reported_seq":129,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.009173+0000","last_change":"2024-04-18T10:44:28.009140+0000","last_active":"2024-04-18T10:44:28.009173+0000","last_peered":"2024-04-18T10:44:28.009173+0000","last_clean":"2024-04-18T10:44:28.009173+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:44:28.009173+0000","last_undegraded":"2024-04-18T10:44:28.009173+0000","last_fullsized":"2024-04-18T10:44:28.009173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'75","last_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_deep_scrub":"44'75","last_deep_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.009038+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:08:03.526122+0000","scrub_duration":0.0053935800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":499,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:29.118675+0000","last_change":"2024-04-18T10:44:29.118645+0000","last_active":"2024-04-18T10:44:29.118675+0000","last_peered":"2024-04-18T10:44:29.118675+0000","last_clean":"2024-04-18T10:44:29.118675+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:44:29.118675+0000","last_undegraded":"2024-04-18T10:44:29.118675+0000","last_fullsized":"2024-04-18T10:44:29.118675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'395","last_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_deep_scrub":"44'395","last_deep_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_clean_scrub_stamp":"2024-04-18T10:44:29.118542+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:28:54.989556+0000","scrub_duration":0.0023004689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'253","reported_seq":299,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.557411+0000","last_change":"2024-04-18T10:44:24.557383+0000","last_active":"2024-04-18T10:44:24.557411+0000","last_peered":"2024-04-18T10:44:24.557411+0000","last_clean":"2024-04-18T10:44:24.557411+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:44:24.557411+0000","last_undegraded":"2024-04-18T10:44:24.557411+0000","last_fullsized":"2024-04-18T10:44:24.557411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'253","last_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_deep_scrub":"44'253","last_deep_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.557282+0000","objects_scrubbed":2,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:50:13.889591+0000","scrub_duration":0.013433855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":487,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.066217+0000","last_change":"2024-04-18T10:44:42.066187+0000","last_active":"2024-04-18T10:44:42.066217+0000","last_peered":"2024-04-18T10:44:42.066217+0000","last_clean":"2024-04-18T10:44:42.066217+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:44:42.066217+0000","last_undegraded":"2024-04-18T10:44:42.066217+0000","last_fullsized":"2024-04-18T10:44:42.066217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:42.066068+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:42.066068+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.066068+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:04:45.048703+0000","scrub_duration":0.0023960040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'342","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.598760+0000","last_change":"2024-04-18T10:44:24.598713+0000","last_active":"2024-04-18T10:44:24.598760+0000","last_peered":"2024-04-18T10:44:24.598760+0000","last_clean":"2024-04-18T10:44:24.598760+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:44:24.598760+0000","last_undegraded":"2024-04-18T10:44:24.598760+0000","last_fullsized":"2024-04-18T10:44:24.598760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'342","last_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_deep_scrub":"44'342","last_deep_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.598616+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:33.105351+0000","scrub_duration":0.013052151999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.025191+0000","last_change":"2024-04-18T10:44:24.025155+0000","last_active":"2024-04-18T10:44:24.025191+0000","last_peered":"2024-04-18T10:44:24.025191+0000","last_clean":"2024-04-18T10:44:24.025191+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:44:24.025191+0000","last_undegraded":"2024-04-18T10:44:24.025191+0000","last_fullsized":"2024-04-18T10:44:24.025191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'435","last_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_deep_scrub":"44'435","last_deep_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.025044+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:05.200707+0000","scrub_duration":0.0023369929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'567","reported_seq":619,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.893920+0000","last_change":"2024-04-18T10:45:01.893889+0000","last_active":"2024-04-18T10:45:01.893920+0000","last_peered":"2024-04-18T10:45:01.893920+0000","last_clean":"2024-04-18T10:45:01.893920+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:45:01.893920+0000","last_undegraded":"2024-04-18T10:45:01.893920+0000","last_fullsized":"2024-04-18T10:45:01.893920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'567","last_scrub_stamp":"2024-04-18T10:45:01.893786+0000","last_deep_scrub":"44'567","last_deep_scrub_stamp":"2024-04-18T10:45:01.893786+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.893786+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:16:59.051408+0000","scrub_duration":0.014192883999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.525196+0000","last_change":"2024-04-18T10:44:09.525165+0000","last_active":"2024-04-18T10:44:09.525196+0000","last_peered":"2024-04-18T10:44:09.525196+0000","last_clean":"2024-04-18T10:44:09.525196+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:44:09.525196+0000","last_undegraded":"2024-04-18T10:44:09.525196+0000","last_fullsized":"2024-04-18T10:44:09.525196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'414","last_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_deep_scrub":"44'414","last_deep_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.525069+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:25:30.256844+0000","scrub_duration":0.002236264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":107,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:08.605199+0000","last_change":"2024-04-18T10:44:08.605160+0000","last_active":"2024-04-18T10:44:08.605199+0000","last_peered":"2024-04-18T10:44:08.605199+0000","last_clean":"2024-04-18T10:44:08.605199+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:44:08.605199+0000","last_undegraded":"2024-04-18T10:44:08.605199+0000","last_fullsized":"2024-04-18T10:44:08.605199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'60","last_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_deep_scrub":"44'60","last_deep_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_clean_scrub_stamp":"2024-04-18T10:44:08.605009+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:45:04.374538+0000","scrub_duration":0.0018151350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":557,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:06.589224+0000","last_change":"2024-04-18T10:44:06.589194+0000","last_active":"2024-04-18T10:44:06.589224+0000","last_peered":"2024-04-18T10:44:06.589224+0000","last_clean":"2024-04-18T10:44:06.589224+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:44:06.589224+0000","last_undegraded":"2024-04-18T10:44:06.589224+0000","last_fullsized":"2024-04-18T10:44:06.589224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'457","last_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_deep_scrub":"44'457","last_deep_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_clean_scrub_stamp":"2024-04-18T10:44:06.589080+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:14:25.178162+0000","scrub_duration":0.0023982220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'174","reported_seq":230,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:06.893821+0000","last_change":"2024-04-18T10:45:06.893788+0000","last_active":"2024-04-18T10:45:06.893821+0000","last_peered":"2024-04-18T10:45:06.893821+0000","last_clean":"2024-04-18T10:45:06.893821+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:45:06.893821+0000","last_undegraded":"2024-04-18T10:45:06.893821+0000","last_fullsized":"2024-04-18T10:45:06.893821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'174","last_scrub_stamp":"2024-04-18T10:45:06.893675+0000","last_deep_scrub":"44'174","last_deep_scrub_stamp":"2024-04-18T10:45:06.893675+0000","last_clean_scrub_stamp":"2024-04-18T10:45:06.893675+0000","objects_scrubbed":4,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:51.820998+0000","scrub_duration":0.019093763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:55.648293+0000","last_change":"2024-04-18T10:44:55.648252+0000","last_active":"2024-04-18T10:44:55.648293+0000","last_peered":"2024-04-18T10:44:55.648293+0000","last_clean":"2024-04-18T10:44:55.648293+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:44:55.648293+0000","last_undegraded":"2024-04-18T10:44:55.648293+0000","last_fullsized":"2024-04-18T10:44:55.648293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'449","last_scrub_stamp":"2024-04-18T10:44:55.648144+0000","last_deep_scrub":"44'449","last_deep_scrub_stamp":"2024-04-18T10:44:55.648144+0000","last_clean_scrub_stamp":"2024-04-18T10:44:55.648144+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:49:28.345804+0000","scrub_duration":0.002471123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'249","reported_seq":290,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:48.405567+0000","last_change":"2024-04-18T10:38:48.525179+0000","last_active":"2024-04-18T10:43:48.405567+0000","last_peered":"2024-04-18T10:43:48.405567+0000","last_clean":"2024-04-18T10:43:48.405567+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:43:48.405567+0000","last_undegraded":"2024-04-18T10:43:48.405567+0000","last_fullsized":"2024-04-18T10:43:48.405567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.454009+0000","last_change":"2024-04-18T10:38:48.528056+0000","last_active":"2024-04-18T10:43:51.454009+0000","last_peered":"2024-04-18T10:43:51.454009+0000","last_clean":"2024-04-18T10:43:51.454009+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:43:51.454009+0000","last_undegraded":"2024-04-18T10:43:51.454009+0000","last_fullsized":"2024-04-18T10:43:51.454009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'62","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.389838+0000","last_change":"2024-04-18T10:38:48.524876+0000","last_active":"2024-04-18T10:43:47.389838+0000","last_peered":"2024-04-18T10:43:47.389838+0000","last_clean":"2024-04-18T10:43:47.389838+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:43:47.389838+0000","last_undegraded":"2024-04-18T10:43:47.389838+0000","last_fullsized":"2024-04-18T10:43:47.389838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":415,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:53.715496+0000","last_change":"2024-04-18T10:44:53.715462+0000","last_active":"2024-04-18T10:44:53.715496+0000","last_peered":"2024-04-18T10:44:53.715496+0000","last_clean":"2024-04-18T10:44:53.715496+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:44:53.715496+0000","last_undegraded":"2024-04-18T10:44:53.715496+0000","last_fullsized":"2024-04-18T10:44:53.715496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'354","last_scrub_stamp":"2024-04-18T10:44:53.715355+0000","last_deep_scrub":"44'354","last_deep_scrub_stamp":"2024-04-18T10:44:53.715355+0000","last_clean_scrub_stamp":"2024-04-18T10:44:53.715355+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:08:56.971258+0000","scrub_duration":0.0023169520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'492","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:47.379895+0000","last_change":"2024-04-18T10:38:48.528825+0000","last_active":"2024-04-18T10:43:47.379895+0000","last_peered":"2024-04-18T10:43:47.379895+0000","last_clean":"2024-04-18T10:43:47.379895+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:43:47.379895+0000","last_undegraded":"2024-04-18T10:43:47.379895+0000","last_fullsized":"2024-04-18T10:43:47.379895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":517,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.452398+0000","last_change":"2024-04-18T10:38:48.535280+0000","last_active":"2024-04-18T10:43:51.452398+0000","last_peered":"2024-04-18T10:43:51.452398+0000","last_clean":"2024-04-18T10:43:51.452398+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:43:51.452398+0000","last_undegraded":"2024-04-18T10:43:51.452398+0000","last_fullsized":"2024-04-18T10:43:51.452398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.876195+0000","last_change":"2024-04-18T10:44:42.876155+0000","last_active":"2024-04-18T10:44:42.876195+0000","last_peered":"2024-04-18T10:44:42.876195+0000","last_clean":"2024-04-18T10:44:42.876195+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:44:42.876195+0000","last_undegraded":"2024-04-18T10:44:42.876195+0000","last_fullsized":"2024-04-18T10:44:42.876195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:42.876035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:42.876035+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.876035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:02.831189+0000","scrub_duration":0.0014149329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'349","reported_seq":395,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.613083+0000","last_change":"2024-04-18T10:44:37.613042+0000","last_active":"2024-04-18T10:44:37.613083+0000","last_peered":"2024-04-18T10:44:37.613083+0000","last_clean":"2024-04-18T10:44:37.613083+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:44:37.613083+0000","last_undegraded":"2024-04-18T10:44:37.613083+0000","last_fullsized":"2024-04-18T10:44:37.613083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.612936+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:48.492165+0000","scrub_duration":0.014537654000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":411,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:48.862502+0000","last_change":"2024-04-18T10:44:48.862438+0000","last_active":"2024-04-18T10:44:48.862502+0000","last_peered":"2024-04-18T10:44:48.862502+0000","last_clean":"2024-04-18T10:44:48.862502+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:44:48.862502+0000","last_undegraded":"2024-04-18T10:44:48.862502+0000","last_fullsized":"2024-04-18T10:44:48.862502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:48.862336+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:48.862336+0000","last_clean_scrub_stamp":"2024-04-18T10:44:48.862336+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:48.226148+0000","scrub_duration":0.002153767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.094073+0000","last_change":"2024-04-18T10:44:43.094046+0000","last_active":"2024-04-18T10:44:43.094073+0000","last_peered":"2024-04-18T10:44:43.094073+0000","last_clean":"2024-04-18T10:44:43.094073+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:44:43.094073+0000","last_undegraded":"2024-04-18T10:44:43.094073+0000","last_fullsized":"2024-04-18T10:44:43.094073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:43.093917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:43.093917+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.093917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:44.980892+0000","scrub_duration":0.001405737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'72","reported_seq":122,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.533181+0000","last_change":"2024-04-18T10:44:19.533110+0000","last_active":"2024-04-18T10:44:19.533181+0000","last_peered":"2024-04-18T10:44:19.533181+0000","last_clean":"2024-04-18T10:44:19.533181+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:44:19.533181+0000","last_undegraded":"2024-04-18T10:44:19.533181+0000","last_fullsized":"2024-04-18T10:44:19.533181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'72","last_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_deep_scrub":"44'72","last_deep_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.533013+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:08:26.074171+0000","scrub_duration":0.003923078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.114134+0000","last_change":"2024-04-18T10:44:19.114101+0000","last_active":"2024-04-18T10:44:19.114134+0000","last_peered":"2024-04-18T10:44:19.114134+0000","last_clean":"2024-04-18T10:44:19.114134+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:44:19.114134+0000","last_undegraded":"2024-04-18T10:44:19.114134+0000","last_fullsized":"2024-04-18T10:44:19.114134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.113999+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:07:38.747202+0000","scrub_duration":0.002438047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:46.672262+0000","last_change":"2024-04-18T10:44:46.672227+0000","last_active":"2024-04-18T10:44:46.672262+0000","last_peered":"2024-04-18T10:44:46.672262+0000","last_clean":"2024-04-18T10:44:46.672262+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:44:46.672262+0000","last_undegraded":"2024-04-18T10:44:46.672262+0000","last_fullsized":"2024-04-18T10:44:46.672262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:46.672112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:46.672112+0000","last_clean_scrub_stamp":"2024-04-18T10:44:46.672112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:10:12.323516+0000","scrub_duration":0.0016045009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'435","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:15.907484+0000","last_change":"2024-04-18T10:45:15.907455+0000","last_active":"2024-04-18T10:45:15.907484+0000","last_peered":"2024-04-18T10:45:15.907484+0000","last_clean":"2024-04-18T10:45:15.907484+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:45:15.907484+0000","last_undegraded":"2024-04-18T10:45:15.907484+0000","last_fullsized":"2024-04-18T10:45:15.907484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'435","last_scrub_stamp":"2024-04-18T10:45:15.907356+0000","last_deep_scrub":"44'435","last_deep_scrub_stamp":"2024-04-18T10:45:15.907356+0000","last_clean_scrub_stamp":"2024-04-18T10:45:15.907356+0000","objects_scrubbed":2,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:07.092275+0000","scrub_duration":0.021374672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.106706+0000","last_change":"2024-04-18T10:44:17.106676+0000","last_active":"2024-04-18T10:44:17.106706+0000","last_peered":"2024-04-18T10:44:17.106706+0000","last_clean":"2024-04-18T10:44:17.106706+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:44:17.106706+0000","last_undegraded":"2024-04-18T10:44:17.106706+0000","last_fullsized":"2024-04-18T10:44:17.106706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.106562+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:13:53.441711+0000","scrub_duration":0.0023480530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.136129+0000","last_change":"2024-04-18T10:44:28.136098+0000","last_active":"2024-04-18T10:44:28.136129+0000","last_peered":"2024-04-18T10:44:28.136129+0000","last_clean":"2024-04-18T10:44:28.136129+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:44:28.136129+0000","last_undegraded":"2024-04-18T10:44:28.136129+0000","last_fullsized":"2024-04-18T10:44:28.136129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.135985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:42.424822+0000","scrub_duration":0.001452168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"44'117","reported_seq":207,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:36.000064+0000","last_change":"2024-04-18T10:44:36.000033+0000","last_active":"2024-04-18T10:44:36.000064+0000","last_peered":"2024-04-18T10:44:36.000064+0000","last_clean":"2024-04-18T10:44:36.000064+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:44:36.000064+0000","last_undegraded":"2024-04-18T10:44:36.000064+0000","last_fullsized":"2024-04-18T10:44:36.000064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'117","last_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_deep_scrub":"44'117","last_deep_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_clean_scrub_stamp":"2024-04-18T10:44:35.999921+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:44.891493+0000","scrub_duration":0.0075134060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'526","reported_seq":564,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:45.416391+0000","last_change":"2024-04-18T10:38:48.523529+0000","last_active":"2024-04-18T10:43:45.416391+0000","last_peered":"2024-04-18T10:43:45.416391+0000","last_clean":"2024-04-18T10:43:45.416391+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:43:45.416391+0000","last_undegraded":"2024-04-18T10:43:45.416391+0000","last_fullsized":"2024-04-18T10:43:45.416391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":542,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453925+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:43:51.453925+0000","last_peered":"2024-04-18T10:43:51.453925+0000","last_clean":"2024-04-18T10:43:51.453925+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:43:51.453925+0000","last_undegraded":"2024-04-18T10:43:51.453925+0000","last_fullsized":"2024-04-18T10:43:51.453925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:41.049096+0000","last_change":"2024-04-18T10:44:41.049065+0000","last_active":"2024-04-18T10:44:41.049096+0000","last_peered":"2024-04-18T10:44:41.049096+0000","last_clean":"2024-04-18T10:44:41.049096+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:44:41.049096+0000","last_undegraded":"2024-04-18T10:44:41.049096+0000","last_fullsized":"2024-04-18T10:44:41.049096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_clean_scrub_stamp":"2024-04-18T10:44:41.048965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:40:48.265478+0000","scrub_duration":0.001413037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'263","reported_seq":495,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.603509+0000","last_change":"2024-04-18T10:44:27.603480+0000","last_active":"2024-04-18T10:44:27.603509+0000","last_peered":"2024-04-18T10:44:27.603509+0000","last_clean":"2024-04-18T10:44:27.603509+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:44:27.603509+0000","last_undegraded":"2024-04-18T10:44:27.603509+0000","last_fullsized":"2024-04-18T10:44:27.603509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'263","last_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_deep_scrub":"44'263","last_deep_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.603367+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:00.661142+0000","scrub_duration":0.006809715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.595841+0000","last_change":"2024-04-18T10:44:16.595810+0000","last_active":"2024-04-18T10:44:16.595841+0000","last_peered":"2024-04-18T10:44:16.595841+0000","last_clean":"2024-04-18T10:44:16.595841+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:44:16.595841+0000","last_undegraded":"2024-04-18T10:44:16.595841+0000","last_fullsized":"2024-04-18T10:44:16.595841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.595707+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:47.126670+0000","scrub_duration":0.002372323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.099574+0000","last_change":"2024-04-18T10:44:37.099519+0000","last_active":"2024-04-18T10:44:37.099574+0000","last_peered":"2024-04-18T10:44:37.099574+0000","last_clean":"2024-04-18T10:44:37.099574+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:44:37.099574+0000","last_undegraded":"2024-04-18T10:44:37.099574+0000","last_fullsized":"2024-04-18T10:44:37.099574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.099405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:12.361352+0000","scrub_duration":0.0015369120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.904082+0000","last_change":"2024-04-18T10:44:54.904049+0000","last_active":"2024-04-18T10:44:54.904082+0000","last_peered":"2024-04-18T10:44:54.904082+0000","last_clean":"2024-04-18T10:44:54.904082+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:44:54.904082+0000","last_undegraded":"2024-04-18T10:44:54.904082+0000","last_fullsized":"2024-04-18T10:44:54.904082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'57","last_scrub_stamp":"2024-04-18T10:44:54.903953+0000","last_deep_scrub":"44'57","last_deep_scrub_stamp":"2024-04-18T10:44:54.903953+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.903953+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:38.000312+0000","scrub_duration":0.00156953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.572462+0000","last_change":"2024-04-18T10:44:20.572430+0000","last_active":"2024-04-18T10:44:20.572462+0000","last_peered":"2024-04-18T10:44:20.572462+0000","last_clean":"2024-04-18T10:44:20.572462+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:44:20.572462+0000","last_undegraded":"2024-04-18T10:44:20.572462+0000","last_fullsized":"2024-04-18T10:44:20.572462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.572320+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:05.780336+0000","scrub_duration":0.0024798110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'64","reported_seq":116,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.293206+0000","last_change":"2024-04-18T10:44:21.293174+0000","last_active":"2024-04-18T10:44:21.293206+0000","last_peered":"2024-04-18T10:44:21.293206+0000","last_clean":"2024-04-18T10:44:21.293206+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:44:21.293206+0000","last_undegraded":"2024-04-18T10:44:21.293206+0000","last_fullsized":"2024-04-18T10:44:21.293206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'64","last_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_deep_scrub":"44'64","last_deep_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.293058+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:02.602650+0000","scrub_duration":0.0072041329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.116265+0000","last_change":"2024-04-18T10:44:16.116227+0000","last_active":"2024-04-18T10:44:16.116265+0000","last_peered":"2024-04-18T10:44:16.116265+0000","last_clean":"2024-04-18T10:44:16.116265+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:44:16.116265+0000","last_undegraded":"2024-04-18T10:44:16.116265+0000","last_fullsized":"2024-04-18T10:44:16.116265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.116120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:38:35.456110+0000","scrub_duration":0.001526194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":482,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.450321+0000","last_change":"2024-04-18T10:38:48.529102+0000","last_active":"2024-04-18T10:43:51.450321+0000","last_peered":"2024-04-18T10:43:51.450321+0000","last_clean":"2024-04-18T10:43:51.450321+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:43:51.450321+0000","last_undegraded":"2024-04-18T10:43:51.450321+0000","last_fullsized":"2024-04-18T10:43:51.450321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.163325+0000","last_change":"2024-04-18T10:44:26.163296+0000","last_active":"2024-04-18T10:44:26.163325+0000","last_peered":"2024-04-18T10:44:26.163325+0000","last_clean":"2024-04-18T10:44:26.163325+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:44:26.163325+0000","last_undegraded":"2024-04-18T10:44:26.163325+0000","last_fullsized":"2024-04-18T10:44:26.163325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.163155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:41:33.487472+0000","scrub_duration":0.001544494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":131,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.630059+0000","last_change":"2024-04-18T10:44:14.630013+0000","last_active":"2024-04-18T10:44:14.630059+0000","last_peered":"2024-04-18T10:44:14.630059+0000","last_clean":"2024-04-18T10:44:14.630059+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:44:14.630059+0000","last_undegraded":"2024-04-18T10:44:14.630059+0000","last_fullsized":"2024-04-18T10:44:14.630059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'83","last_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_deep_scrub":"44'83","last_deep_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.629894+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:04:39.848103+0000","scrub_duration":0.0054998199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":457,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:15.610348+0000","last_change":"2024-04-18T10:44:15.610317+0000","last_active":"2024-04-18T10:44:15.610348+0000","last_peered":"2024-04-18T10:44:15.610348+0000","last_clean":"2024-04-18T10:44:15.610348+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:44:15.610348+0000","last_undegraded":"2024-04-18T10:44:15.610348+0000","last_fullsized":"2024-04-18T10:44:15.610348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'377","last_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_deep_scrub":"44'377","last_deep_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_clean_scrub_stamp":"2024-04-18T10:44:15.610194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:21:45.794459+0000","scrub_duration":0.0023276400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'75","reported_seq":125,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.685768+0000","last_change":"2024-04-18T10:44:43.685728+0000","last_active":"2024-04-18T10:44:43.685768+0000","last_peered":"2024-04-18T10:44:43.685768+0000","last_clean":"2024-04-18T10:44:43.685768+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:44:43.685768+0000","last_undegraded":"2024-04-18T10:44:43.685768+0000","last_fullsized":"2024-04-18T10:44:43.685768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'75","last_scrub_stamp":"2024-04-18T10:44:43.685630+0000","last_deep_scrub":"44'75","last_deep_scrub_stamp":"2024-04-18T10:44:43.685630+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.685630+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:19:47.619608+0000","scrub_duration":0.011221696999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":452,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:48.710591+0000","last_change":"2024-04-18T10:44:48.710558+0000","last_active":"2024-04-18T10:44:48.710591+0000","last_peered":"2024-04-18T10:44:48.710591+0000","last_clean":"2024-04-18T10:44:48.710591+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:44:48.710591+0000","last_undegraded":"2024-04-18T10:44:48.710591+0000","last_fullsized":"2024-04-18T10:44:48.710591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'384","last_scrub_stamp":"2024-04-18T10:44:48.710451+0000","last_deep_scrub":"44'384","last_deep_scrub_stamp":"2024-04-18T10:44:48.710451+0000","last_clean_scrub_stamp":"2024-04-18T10:44:48.710451+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:03:14.715697+0000","scrub_duration":0.0024035810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'345","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:40.861394+0000","last_change":"2024-04-18T10:44:40.861354+0000","last_active":"2024-04-18T10:44:40.861394+0000","last_peered":"2024-04-18T10:44:40.861394+0000","last_clean":"2024-04-18T10:44:40.861394+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:44:40.861394+0000","last_undegraded":"2024-04-18T10:44:40.861394+0000","last_fullsized":"2024-04-18T10:44:40.861394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'345","last_scrub_stamp":"2024-04-18T10:44:40.861207+0000","last_deep_scrub":"44'345","last_deep_scrub_stamp":"2024-04-18T10:44:40.861207+0000","last_clean_scrub_stamp":"2024-04-18T10:44:40.861207+0000","objects_scrubbed":2,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:42:35.225739+0000","scrub_duration":0.01437416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":420,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:10.529301+0000","last_change":"2024-04-18T10:44:10.529249+0000","last_active":"2024-04-18T10:44:10.529301+0000","last_peered":"2024-04-18T10:44:10.529301+0000","last_clean":"2024-04-18T10:44:10.529301+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:44:10.529301+0000","last_undegraded":"2024-04-18T10:44:10.529301+0000","last_fullsized":"2024-04-18T10:44:10.529301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'352","last_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_deep_scrub":"44'352","last_deep_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:10.529127+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:12:28.231944+0000","scrub_duration":0.0022035800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'291","reported_seq":347,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.377930+0000","last_change":"2024-04-18T10:44:17.377889+0000","last_active":"2024-04-18T10:44:17.377930+0000","last_peered":"2024-04-18T10:44:17.377930+0000","last_clean":"2024-04-18T10:44:17.377930+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:44:17.377930+0000","last_undegraded":"2024-04-18T10:44:17.377930+0000","last_fullsized":"2024-04-18T10:44:17.377930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'291","last_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_deep_scrub":"44'291","last_deep_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.377743+0000","objects_scrubbed":4,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:37.743454+0000","scrub_duration":0.030049699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.575444+0000","last_change":"2024-04-18T10:44:19.575417+0000","last_active":"2024-04-18T10:44:19.575444+0000","last_peered":"2024-04-18T10:44:19.575444+0000","last_clean":"2024-04-18T10:44:19.575444+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:44:19.575444+0000","last_undegraded":"2024-04-18T10:44:19.575444+0000","last_fullsized":"2024-04-18T10:44:19.575444+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.575311+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:47:55.784007+0000","scrub_duration":0.0020110480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'111","reported_seq":159,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:19.793503+0000","last_change":"2024-04-18T10:45:19.793453+0000","last_active":"2024-04-18T10:45:19.793503+0000","last_peered":"2024-04-18T10:45:19.793503+0000","last_clean":"2024-04-18T10:45:19.793503+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:45:19.793503+0000","last_undegraded":"2024-04-18T10:45:19.793503+0000","last_fullsized":"2024-04-18T10:45:19.793503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'111","last_scrub_stamp":"2024-04-18T10:45:19.793343+0000","last_deep_scrub":"44'111","last_deep_scrub_stamp":"2024-04-18T10:45:19.793343+0000","last_clean_scrub_stamp":"2024-04-18T10:45:19.793343+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:20:42.163995+0000","scrub_duration":0.010971541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.449223+0000","last_change":"2024-04-18T10:38:48.524512+0000","last_active":"2024-04-18T10:43:51.449223+0000","last_peered":"2024-04-18T10:43:51.449223+0000","last_clean":"2024-04-18T10:43:51.449223+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:43:51.449223+0000","last_undegraded":"2024-04-18T10:43:51.449223+0000","last_fullsized":"2024-04-18T10:43:51.449223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'102","reported_seq":146,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.622673+0000","last_change":"2024-04-18T10:44:34.622627+0000","last_active":"2024-04-18T10:44:34.622673+0000","last_peered":"2024-04-18T10:44:34.622673+0000","last_clean":"2024-04-18T10:44:34.622673+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:44:34.622673+0000","last_undegraded":"2024-04-18T10:44:34.622673+0000","last_fullsized":"2024-04-18T10:44:34.622673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'102","last_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_deep_scrub":"44'102","last_deep_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.622522+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:53:16.158696+0000","scrub_duration":0.012842098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:39.658970+0000","last_change":"2024-04-18T10:44:39.658938+0000","last_active":"2024-04-18T10:44:39.658970+0000","last_peered":"2024-04-18T10:44:39.658970+0000","last_clean":"2024-04-18T10:44:39.658970+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:44:39.658970+0000","last_undegraded":"2024-04-18T10:44:39.658970+0000","last_fullsized":"2024-04-18T10:44:39.658970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'432","last_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_deep_scrub":"44'432","last_deep_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_clean_scrub_stamp":"2024-04-18T10:44:39.658831+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:58:08.433321+0000","scrub_duration":0.0024322020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":510,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:05.946782+0000","last_change":"2024-04-18T10:45:05.946758+0000","last_active":"2024-04-18T10:45:05.946782+0000","last_peered":"2024-04-18T10:45:05.946782+0000","last_clean":"2024-04-18T10:45:05.946782+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:45:05.946782+0000","last_undegraded":"2024-04-18T10:45:05.946782+0000","last_fullsized":"2024-04-18T10:45:05.946782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:45:05.946653+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:45:05.946653+0000","last_clean_scrub_stamp":"2024-04-18T10:45:05.946653+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:59:36.714123+0000","scrub_duration":0.002118937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":449,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:58.675440+0000","last_change":"2024-04-18T10:44:58.675399+0000","last_active":"2024-04-18T10:44:58.675440+0000","last_peered":"2024-04-18T10:44:58.675440+0000","last_clean":"2024-04-18T10:44:58.675440+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:44:58.675440+0000","last_undegraded":"2024-04-18T10:44:58.675440+0000","last_fullsized":"2024-04-18T10:44:58.675440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'408","last_scrub_stamp":"2024-04-18T10:44:58.675288+0000","last_deep_scrub":"44'408","last_deep_scrub_stamp":"2024-04-18T10:44:58.675288+0000","last_clean_scrub_stamp":"2024-04-18T10:44:58.675288+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:11:15.241591+0000","scrub_duration":0.0022547029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":575,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.634081+0000","last_change":"2024-04-18T10:44:42.634050+0000","last_active":"2024-04-18T10:44:42.634081+0000","last_peered":"2024-04-18T10:44:42.634081+0000","last_clean":"2024-04-18T10:44:42.634081+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:44:42.634081+0000","last_undegraded":"2024-04-18T10:44:42.634081+0000","last_fullsized":"2024-04-18T10:44:42.634081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'470","last_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_deep_scrub":"44'470","last_deep_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.633943+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:34:03.702154+0000","scrub_duration":0.0025497570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.195348+0000","last_change":"2024-04-18T10:44:24.195320+0000","last_active":"2024-04-18T10:44:24.195348+0000","last_peered":"2024-04-18T10:44:24.195348+0000","last_clean":"2024-04-18T10:44:24.195348+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:44:24.195348+0000","last_undegraded":"2024-04-18T10:44:24.195348+0000","last_fullsized":"2024-04-18T10:44:24.195348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.195206+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:51:24.563147+0000","scrub_duration":0.0022383659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":508,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:51.884469+0000","last_change":"2024-04-18T10:44:51.884431+0000","last_active":"2024-04-18T10:44:51.884469+0000","last_peered":"2024-04-18T10:44:51.884469+0000","last_clean":"2024-04-18T10:44:51.884469+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:44:51.884469+0000","last_undegraded":"2024-04-18T10:44:51.884469+0000","last_fullsized":"2024-04-18T10:44:51.884469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'402","last_scrub_stamp":"2024-04-18T10:44:51.884312+0000","last_deep_scrub":"44'402","last_deep_scrub_stamp":"2024-04-18T10:44:51.884312+0000","last_clean_scrub_stamp":"2024-04-18T10:44:51.884312+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:33.666434+0000","scrub_duration":0.0022388320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8552,"ondisk_log_size":8552,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953553,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.36799999999999999},"min":{"1min":0.248,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.46400000000000002,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.38100000000000001},"min":{"1min":0.24399999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.49399999999999999,"5min":1.732,"15min":1.732},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.28499999999999998,"5min":0.184,"15min":0.184},"max":{"1min":0.51900000000000002,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.38200000000000001},"min":{"1min":0.29599999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.57899999999999996},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.42599999999999999},"min":{"1min":0.32100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":4.181,"15min":4.181},"last":0.45000000000000001}]}]},{"osd":2,"up_from":31,"seq":133143986257,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:45:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.23000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.51800000000000002,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.57199999999999995,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Apr 18 10:45:03 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.38},"min":{"1min":0.29399999999999998,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"last":0.308},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.39900000000000002},"min":{"1min":0.27000000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57399999999999995,"5min":1.53,"15min":1.53},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Apr 18 10:45:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.374,"15min":0.40500000000000003},"min":{"1min":0.34799999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.42999999999999999},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.623,"5min":1.49,"15min":1.49},"last":0.39700000000000002}]}]},{"osd":0,"up_from":29,"seq":124554051666,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.33800000000000002},"min":{"1min":0.27700000000000002,"5min":0.156,"15min":0.156},"max":{"1min":0.53300000000000003,"5min":1.002,"15min":1.002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55300000000000005,"5min":1.224,"15min":1.224},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.36199999999999999},"min":{"1min":0.32600000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.53000000000000003,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.314,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":1.173,"15min":1.173},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.375,"15min":0.41499999999999998},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51500000000000001,"5min":0.879,"15min":1.204},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.50700000000000001},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56799999999999995,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.44600000000000001}]}]},{"osd":1,"up_from":30,"seq":128849018961,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.58499999999999996,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.34300000000000003,"15min":0.35999999999999999},"min":{"1min":0.28100000000000003,"5min":0.187,"15min":0.187},"max":{"1min":0.51200000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.373,"15min":0.37},"min":{"1min":0.28000000000000003,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.61899999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.37,"15min":0.38700000000000001},"min":{"1min":0.255,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.57199999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.37,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59199999999999997,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.438,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.66100000000000003,"5min":2.173,"15min":2.173},"last":0.38300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:45:26.481 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.481 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.481 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.481 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.482 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.482 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.482 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.482 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.482 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.482 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.482 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.483 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.483 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:26.483 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T10:45:46.484 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:45:46.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.620+0000 7fe246156700 1 Processor -- start 2024-04-18T10:45:46.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.620+0000 7fe246156700 1 -- start start 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.620+0000 7fe246156700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe2401464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.620+0000 7fe246156700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe2401469e0 0x7fe240148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.620+0000 7fe246156700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2400a3f00 con 0x7fe2400680f0 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.620+0000 7fe246156700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2400a3430 con 0x7fe2401469e0 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.620+0000 7fe246156700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24006a260 con 0x7fe2400a3b30 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23ffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe2401469e0 0x7fe240148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe2401464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23f7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe2400680f0 0x7fe240069b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33222/0 (socket says 172.21.15.31:33222) 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23f7fe700 1 -- 172.21.15.31:0/285565120 learned_addr learned my addr 172.21.15.31:0/285565120 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23effd700 1 -- 172.21.15.31:0/285565120 >> v2:172.21.15.31:3300/0 conn(0x7fe2401469e0 msgr2=0x7fe240148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23e7fc700 1 -- 172.21.15.31:0/285565120 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649892783 0 0) 0x7fe2400a3f00 con 0x7fe2400680f0 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23effd700 1 --2- 172.21.15.31:0/285565120 >> v2:172.21.15.31:3300/0 conn(0x7fe2401469e0 0x7fe240148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:46.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23effd700 1 -- 172.21.15.31:0/285565120 >> v1:172.21.15.31:6789/0 conn(0x7fe2400680f0 legacy=0x7fe240069b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:46.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23effd700 1 -- 172.21.15.31:0/285565120 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24006a480 con 0x7fe2400a3b30 2024-04-18T10:45:46.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23ffff700 1 --2- 172.21.15.31:0/285565120 >> v2:172.21.15.31:3300/0 conn(0x7fe2401469e0 0x7fe240148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:45:46.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23effd700 1 --2- 172.21.15.31:0/285565120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe2401464a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe234009910 tx=0x7fe2340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ae3a7aa249ccf26 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:45:46.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23e7fc700 1 -- 172.21.15.31:0/285565120 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400b640 con 0x7fe2400a3b30 2024-04-18T10:45:46.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23e7fc700 1 -- 172.21.15.31:0/285565120 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23400b7a0 con 0x7fe2400a3b30 2024-04-18T10:45:46.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.621+0000 7fe23e7fc700 1 -- 172.21.15.31:0/285565120 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400bb60 con 0x7fe2400a3b30 2024-04-18T10:45:46.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.622+0000 7fe246156700 1 -- 172.21.15.31:0/285565120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 msgr2=0x7fe2401464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:46.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.622+0000 7fe246156700 1 --2- 172.21.15.31:0/285565120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe2401464a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe234009910 tx=0x7fe2340091a0 comp rx=0 tx=0).stop 2024-04-18T10:45:46.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.622+0000 7fe246156700 1 -- 172.21.15.31:0/285565120 shutdown_connections 2024-04-18T10:45:46.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.622+0000 7fe246156700 1 --2- 172.21.15.31:0/285565120 >> v2:172.21.15.31:3300/0 conn(0x7fe2401469e0 0x7fe240148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:46.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.622+0000 7fe246156700 1 --2- 172.21.15.31:0/285565120 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe2401464a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:46.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.622+0000 7fe246156700 1 -- 172.21.15.31:0/285565120 >> 172.21.15.31:0/285565120 conn(0x7fe24006dd70 msgr2=0x7fe2400679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.622+0000 7fe246156700 1 -- 172.21.15.31:0/285565120 shutdown_connections 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.622+0000 7fe246156700 1 -- 172.21.15.31:0/285565120 wait complete. 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.623+0000 7fe246156700 1 Processor -- start 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.623+0000 7fe246156700 1 -- start start 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe246156700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2400680f0 0x7fe2400ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe246156700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe24013f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe246156700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2401469e0 0x7fe24013f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe246156700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400af300 con 0x7fe2400680f0 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe246156700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2400af040 con 0x7fe2400a3b30 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe246156700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe240096a70 con 0x7fe2401469e0 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe24013f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2400680f0 0x7fe2400ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2401469e0 0x7fe24013f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:45:46.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23effd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe24013f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:53656/0 (socket says 172.21.15.31:53656) 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23f7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2400680f0 0x7fe2400ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48062/0 (socket says 172.21.15.31:48062) 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2401469e0 0x7fe24013f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:44382/0 (socket says 172.21.15.31:44382) 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23effd700 1 -- 172.21.15.31:0/1609878316 learned_addr learned my addr 172.21.15.31:0/1609878316 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23effd700 1 -- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2401469e0 msgr2=0x7fe24013f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23effd700 1 --2- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2401469e0 0x7fe24013f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23effd700 1 -- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2400680f0 msgr2=0x7fe2400ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23effd700 1 --2- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2400680f0 0x7fe2400ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23effd700 1 -- 172.21.15.31:0/1609878316 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238009a20 con 0x7fe2400a3b30 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23f7fe700 1 --2- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2400680f0 0x7fe2400ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23ffff700 1 --2- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2401469e0 0x7fe24013f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.624+0000 7fe23effd700 1 --2- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe24013f450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe234009fb0 tx=0x7fe234017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.625+0000 7fe2277fe700 1 -- 172.21.15.31:0/1609878316 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23401f070 con 0x7fe2400a3b30 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.625+0000 7fe2277fe700 1 -- 172.21.15.31:0/1609878316 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234000bc0 con 0x7fe2400a3b30 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.625+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe234009420 con 0x7fe2400a3b30 2024-04-18T10:45:46.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.625+0000 7fe2277fe700 1 -- 172.21.15.31:0/1609878316 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400bb60 con 0x7fe2400a3b30 2024-04-18T10:45:46.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.625+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe240098310 con 0x7fe2400a3b30 2024-04-18T10:45:46.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.626+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2400651b0 con 0x7fe2400a3b30 2024-04-18T10:45:46.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.626+0000 7fe2277fe700 1 -- 172.21.15.31:0/1609878316 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fe234023070 con 0x7fe2400a3b30 2024-04-18T10:45:46.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.626+0000 7fe2277fe700 1 -- 172.21.15.31:0/1609878316 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fe23405c4e0 con 0x7fe2400a3b30 2024-04-18T10:45:46.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.630+0000 7fe2277fe700 1 -- 172.21.15.31:0/1609878316 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe234006fe0 con 0x7fe2400a3b30 2024-04-18T10:45:46.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.790+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2400a4520 con 0x7fe22c045ef0 2024-04-18T10:45:46.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.797+0000 7fe2277fe700 1 -- 172.21.15.31:0/1609878316 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280271 (unknown 2965378022 0 2942941108) 0x7fe2400a4520 con 0x7fe22c045ef0 2024-04-18T10:45:46.802 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:45:46.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 >> v1:172.21.15.31:6816/46601 conn(0x7fe22c045ef0 legacy=0x7fe22c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:46.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 msgr2=0x7fe24013f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:45:46.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 --2- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe24013f450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe234009fb0 tx=0x7fe234017000 comp rx=0 tx=0).stop 2024-04-18T10:45:46.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 shutdown_connections 2024-04-18T10:45:46.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 --2- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fe2401469e0 0x7fe24013f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:46.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 --2- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2400680f0 0x7fe2400ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:46.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 --2- 172.21.15.31:0/1609878316 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fe2400a3b30 0x7fe24013f450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:45:46.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 >> 172.21.15.31:0/1609878316 conn(0x7fe24006dd70 msgr2=0x7fe240069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:45:46.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 shutdown_connections 2024-04-18T10:45:46.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:45:46.800+0000 7fe246156700 1 -- 172.21.15.31:0/1609878316 wait complete. 2024-04-18T10:45:46.805 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:45:46.813 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-18T10:45:46.512676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35149,"ondisk_log_size":35149,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003076"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.637320+0000","last_change":"2024-04-18T10:44:26.637274+0000","last_active":"2024-04-18T10:44:26.637320+0000","last_peered":"2024-04-18T10:44:26.637320+0000","last_clean":"2024-04-18T10:44:26.637320+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:44:26.637320+0000","last_undegraded":"2024-04-18T10:44:26.637320+0000","last_fullsized":"2024-04-18T10:44:26.637320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'406","last_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_deep_scrub":"44'406","last_deep_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.637158+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:46.367442+0000","scrub_duration":0.0019350299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.529297+0000","last_change":"2024-04-18T10:44:11.529249+0000","last_active":"2024-04-18T10:44:11.529297+0000","last_peered":"2024-04-18T10:44:11.529297+0000","last_clean":"2024-04-18T10:44:11.529297+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:44:11.529297+0000","last_undegraded":"2024-04-18T10:44:11.529297+0000","last_fullsized":"2024-04-18T10:44:11.529297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'425","last_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_deep_scrub":"44'425","last_deep_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.529136+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:31:02.859668+0000","scrub_duration":0.002289952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":432,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.557510+0000","last_change":"2024-04-18T10:44:21.557477+0000","last_active":"2024-04-18T10:44:21.557510+0000","last_peered":"2024-04-18T10:44:21.557510+0000","last_clean":"2024-04-18T10:44:21.557510+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:44:21.557510+0000","last_undegraded":"2024-04-18T10:44:21.557510+0000","last_fullsized":"2024-04-18T10:44:21.557510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.557376+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:19:59.466067+0000","scrub_duration":0.0022859669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":464,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.547987+0000","last_change":"2024-04-18T10:45:01.547955+0000","last_active":"2024-04-18T10:45:01.547987+0000","last_peered":"2024-04-18T10:45:01.547987+0000","last_clean":"2024-04-18T10:45:01.547987+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:45:01.547987+0000","last_undegraded":"2024-04-18T10:45:01.547987+0000","last_fullsized":"2024-04-18T10:45:01.547987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'394","last_scrub_stamp":"2024-04-18T10:45:01.547829+0000","last_deep_scrub":"44'394","last_deep_scrub_stamp":"2024-04-18T10:45:01.547829+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.547829+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.304001+0000","scrub_duration":0.002333431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":543,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:22.581671+0000","last_change":"2024-04-18T10:44:22.581628+0000","last_active":"2024-04-18T10:44:22.581671+0000","last_peered":"2024-04-18T10:44:22.581671+0000","last_clean":"2024-04-18T10:44:22.581671+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:44:22.581671+0000","last_undegraded":"2024-04-18T10:44:22.581671+0000","last_fullsized":"2024-04-18T10:44:22.581671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'428","last_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_deep_scrub":"44'428","last_deep_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_clean_scrub_stamp":"2024-04-18T10:44:22.581473+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:42:51.909519+0000","scrub_duration":0.0023658939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":413,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:02.500797+0000","last_change":"2024-04-18T10:45:02.500763+0000","last_active":"2024-04-18T10:45:02.500797+0000","last_peered":"2024-04-18T10:45:02.500797+0000","last_clean":"2024-04-18T10:45:02.500797+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:45:02.500797+0000","last_undegraded":"2024-04-18T10:45:02.500797+0000","last_fullsized":"2024-04-18T10:45:02.500797+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'374","last_scrub_stamp":"2024-04-18T10:45:02.500644+0000","last_deep_scrub":"44'374","last_deep_scrub_stamp":"2024-04-18T10:45:02.500644+0000","last_clean_scrub_stamp":"2024-04-18T10:45:02.500644+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:35:37.838971+0000","scrub_duration":0.0024023999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":529,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.334276+0000","last_change":"2024-04-18T10:44:18.334236+0000","last_active":"2024-04-18T10:44:18.334276+0000","last_peered":"2024-04-18T10:44:18.334276+0000","last_clean":"2024-04-18T10:44:18.334276+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:44:18.334276+0000","last_undegraded":"2024-04-18T10:44:18.334276+0000","last_fullsized":"2024-04-18T10:44:18.334276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.334127+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:41:16.742027+0000","scrub_duration":0.0024997970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.989712+0000","last_change":"2024-04-18T10:44:24.989685+0000","last_active":"2024-04-18T10:44:24.989712+0000","last_peered":"2024-04-18T10:44:24.989712+0000","last_clean":"2024-04-18T10:44:24.989712+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:44:24.989712+0000","last_undegraded":"2024-04-18T10:44:24.989712+0000","last_fullsized":"2024-04-18T10:44:24.989712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'383","last_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_deep_scrub":"44'383","last_deep_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.989580+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:01:44.688357+0000","scrub_duration":0.0023556649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":514,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.557807+0000","last_change":"2024-04-18T10:44:11.557779+0000","last_active":"2024-04-18T10:44:11.557807+0000","last_peered":"2024-04-18T10:44:11.557807+0000","last_clean":"2024-04-18T10:44:11.557807+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:44:11.557807+0000","last_undegraded":"2024-04-18T10:44:11.557807+0000","last_fullsized":"2024-04-18T10:44:11.557807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'422","last_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_deep_scrub":"44'422","last_deep_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.557669+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:00:02.279295+0000","scrub_duration":0.0024686619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.144649+0000","last_change":"2024-04-18T10:44:09.144611+0000","last_active":"2024-04-18T10:44:09.144649+0000","last_peered":"2024-04-18T10:44:09.144649+0000","last_clean":"2024-04-18T10:44:09.144649+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:44:09.144649+0000","last_undegraded":"2024-04-18T10:44:09.144649+0000","last_fullsized":"2024-04-18T10:44:09.144649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'421","last_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_deep_scrub":"44'421","last_deep_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.144503+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:16.445422+0000","scrub_duration":0.0024088249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.195610+0000","last_change":"2024-04-18T10:44:14.195578+0000","last_active":"2024-04-18T10:44:14.195610+0000","last_peered":"2024-04-18T10:44:14.195610+0000","last_clean":"2024-04-18T10:44:14.195610+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:44:14.195610+0000","last_undegraded":"2024-04-18T10:44:14.195610+0000","last_fullsized":"2024-04-18T10:44:14.195610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.195443+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:06.505533+0000","scrub_duration":0.0024248439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":415,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:38.631266+0000","last_change":"2024-04-18T10:44:38.631204+0000","last_active":"2024-04-18T10:44:38.631266+0000","last_peered":"2024-04-18T10:44:38.631266+0000","last_clean":"2024-04-18T10:44:38.631266+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:44:38.631266+0000","last_undegraded":"2024-04-18T10:44:38.631266+0000","last_fullsized":"2024-04-18T10:44:38.631266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_clean_scrub_stamp":"2024-04-18T10:44:38.631083+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:27.239036+0000","scrub_duration":0.002062871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":494,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:49.732934+0000","last_change":"2024-04-18T10:44:49.732906+0000","last_active":"2024-04-18T10:44:49.732934+0000","last_peered":"2024-04-18T10:44:49.732934+0000","last_clean":"2024-04-18T10:44:49.732934+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:44:49.732934+0000","last_undegraded":"2024-04-18T10:44:49.732934+0000","last_fullsized":"2024-04-18T10:44:49.732934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'406","last_scrub_stamp":"2024-04-18T10:44:49.732801+0000","last_deep_scrub":"44'406","last_deep_scrub_stamp":"2024-04-18T10:44:49.732801+0000","last_clean_scrub_stamp":"2024-04-18T10:44:49.732801+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:41:17.189667+0000","scrub_duration":0.0023307010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:13.165805+0000","last_change":"2024-04-18T10:44:13.165763+0000","last_active":"2024-04-18T10:44:13.165805+0000","last_peered":"2024-04-18T10:44:13.165805+0000","last_clean":"2024-04-18T10:44:13.165805+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:44:13.165805+0000","last_undegraded":"2024-04-18T10:44:13.165805+0000","last_fullsized":"2024-04-18T10:44:13.165805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_clean_scrub_stamp":"2024-04-18T10:44:13.165654+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:05:30.099837+0000","scrub_duration":0.0022553650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":538,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:56.698063+0000","last_change":"2024-04-18T10:44:56.698031+0000","last_active":"2024-04-18T10:44:56.698063+0000","last_peered":"2024-04-18T10:44:56.698063+0000","last_clean":"2024-04-18T10:44:56.698063+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:44:56.698063+0000","last_undegraded":"2024-04-18T10:44:56.698063+0000","last_fullsized":"2024-04-18T10:44:56.698063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'413","last_scrub_stamp":"2024-04-18T10:44:56.697924+0000","last_deep_scrub":"44'413","last_deep_scrub_stamp":"2024-04-18T10:44:56.697924+0000","last_clean_scrub_stamp":"2024-04-18T10:44:56.697924+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:31:37.961106+0000","scrub_duration":0.002392974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":490,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.684875+0000","last_change":"2024-04-18T10:44:54.684839+0000","last_active":"2024-04-18T10:44:54.684875+0000","last_peered":"2024-04-18T10:44:54.684875+0000","last_clean":"2024-04-18T10:44:54.684875+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:44:54.684875+0000","last_undegraded":"2024-04-18T10:44:54.684875+0000","last_fullsized":"2024-04-18T10:44:54.684875+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'439","last_scrub_stamp":"2024-04-18T10:44:54.684729+0000","last_deep_scrub":"44'439","last_deep_scrub_stamp":"2024-04-18T10:44:54.684729+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.684729+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:01.278560+0000","scrub_duration":0.0022394659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":515,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.615863+0000","last_change":"2024-04-18T10:44:54.615831+0000","last_active":"2024-04-18T10:44:54.615863+0000","last_peered":"2024-04-18T10:44:54.615863+0000","last_clean":"2024-04-18T10:44:54.615863+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:44:54.615863+0000","last_undegraded":"2024-04-18T10:44:54.615863+0000","last_fullsized":"2024-04-18T10:44:54.615863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'424","last_scrub_stamp":"2024-04-18T10:44:54.615711+0000","last_deep_scrub":"44'424","last_deep_scrub_stamp":"2024-04-18T10:44:54.615711+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.615711+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:53:30.727391+0000","scrub_duration":0.0024038290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:25.567371+0000","last_change":"2024-04-18T10:44:25.567348+0000","last_active":"2024-04-18T10:44:25.567371+0000","last_peered":"2024-04-18T10:44:25.567371+0000","last_clean":"2024-04-18T10:44:25.567371+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:44:25.567371+0000","last_undegraded":"2024-04-18T10:44:25.567371+0000","last_fullsized":"2024-04-18T10:44:25.567371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'411","last_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_deep_scrub":"44'411","last_deep_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_clean_scrub_stamp":"2024-04-18T10:44:25.567250+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:30:08.433037+0000","scrub_duration":0.001860376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":537,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.678041+0000","last_change":"2024-04-18T10:44:28.678009+0000","last_active":"2024-04-18T10:44:28.678041+0000","last_peered":"2024-04-18T10:44:28.678041+0000","last_clean":"2024-04-18T10:44:28.678041+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:44:28.678041+0000","last_undegraded":"2024-04-18T10:44:28.678041+0000","last_fullsized":"2024-04-18T10:44:28.678041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.677897+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:19:26.570868+0000","scrub_duration":0.0024894269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":558,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.040362+0000","last_change":"2024-04-18T10:44:23.040332+0000","last_active":"2024-04-18T10:44:23.040362+0000","last_peered":"2024-04-18T10:44:23.040362+0000","last_clean":"2024-04-18T10:44:23.040362+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:44:23.040362+0000","last_undegraded":"2024-04-18T10:44:23.040362+0000","last_fullsized":"2024-04-18T10:44:23.040362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'459","last_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_deep_scrub":"44'459","last_deep_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.040211+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:27:20.385741+0000","scrub_duration":0.0023176189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":513,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:30.040466+0000","last_change":"2024-04-18T10:44:30.040439+0000","last_active":"2024-04-18T10:44:30.040466+0000","last_peered":"2024-04-18T10:44:30.040466+0000","last_clean":"2024-04-18T10:44:30.040466+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:44:30.040466+0000","last_undegraded":"2024-04-18T10:44:30.040466+0000","last_fullsized":"2024-04-18T10:44:30.040466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'413","last_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_deep_scrub":"44'413","last_deep_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_clean_scrub_stamp":"2024-04-18T10:44:30.040312+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:29:22.491578+0000","scrub_duration":0.0023350599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":570,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.532351+0000","last_change":"2024-04-18T10:44:23.532321+0000","last_active":"2024-04-18T10:44:23.532351+0000","last_peered":"2024-04-18T10:44:23.532351+0000","last_clean":"2024-04-18T10:44:23.532351+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:44:23.532351+0000","last_undegraded":"2024-04-18T10:44:23.532351+0000","last_fullsized":"2024-04-18T10:44:23.532351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.532201+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:17:09.342669+0000","scrub_duration":0.00234395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:40.828327+0000","last_change":"2024-04-18T10:45:40.828279+0000","last_active":"2024-04-18T10:45:40.828327+0000","last_peered":"2024-04-18T10:45:40.828327+0000","last_clean":"2024-04-18T10:45:40.828327+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:45:40.828327+0000","last_undegraded":"2024-04-18T10:45:40.828327+0000","last_fullsized":"2024-04-18T10:45:40.828327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'401","last_scrub_stamp":"2024-04-18T10:45:40.828147+0000","last_deep_scrub":"44'401","last_deep_scrub_stamp":"2024-04-18T10:45:40.828147+0000","last_clean_scrub_stamp":"2024-04-18T10:45:40.828147+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:46.025409+0000","scrub_duration":0.0023395719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":561,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.076667+0000","last_change":"2024-04-18T10:44:20.076638+0000","last_active":"2024-04-18T10:44:20.076667+0000","last_peered":"2024-04-18T10:44:20.076667+0000","last_clean":"2024-04-18T10:44:20.076667+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:44:20.076667+0000","last_undegraded":"2024-04-18T10:44:20.076667+0000","last_fullsized":"2024-04-18T10:44:20.076667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'444","last_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_deep_scrub":"44'444","last_deep_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.076529+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:32:07.735061+0000","scrub_duration":0.0023703510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:59.626990+0000","last_change":"2024-04-18T10:44:59.626945+0000","last_active":"2024-04-18T10:44:59.626990+0000","last_peered":"2024-04-18T10:44:59.626990+0000","last_clean":"2024-04-18T10:44:59.626990+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:44:59.626990+0000","last_undegraded":"2024-04-18T10:44:59.626990+0000","last_fullsized":"2024-04-18T10:44:59.626990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:59.626796+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:59.626796+0000","last_clean_scrub_stamp":"2024-04-18T10:44:59.626796+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:10.274438+0000","scrub_duration":0.0025074519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":624,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:12.933898+0000","last_change":"2024-04-18T10:45:12.933849+0000","last_active":"2024-04-18T10:45:12.933898+0000","last_peered":"2024-04-18T10:45:12.933898+0000","last_clean":"2024-04-18T10:45:12.933898+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:45:12.933898+0000","last_undegraded":"2024-04-18T10:45:12.933898+0000","last_fullsized":"2024-04-18T10:45:12.933898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'504","last_scrub_stamp":"2024-04-18T10:45:12.933743+0000","last_deep_scrub":"44'504","last_deep_scrub_stamp":"2024-04-18T10:45:12.933743+0000","last_clean_scrub_stamp":"2024-04-18T10:45:12.933743+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:17.820138+0000","scrub_duration":0.0023169979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.328008+0000","last_change":"2024-04-18T10:44:19.327977+0000","last_active":"2024-04-18T10:44:19.328008+0000","last_peered":"2024-04-18T10:44:19.328008+0000","last_clean":"2024-04-18T10:44:19.328008+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:44:19.328008+0000","last_undegraded":"2024-04-18T10:44:19.328008+0000","last_fullsized":"2024-04-18T10:44:19.328008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'420","last_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_deep_scrub":"44'420","last_deep_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.327882+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:32.007720+0000","scrub_duration":0.0021444820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'601","reported_seq":646,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:46.866913+0000","last_change":"2024-04-18T10:44:46.866883+0000","last_active":"2024-04-18T10:44:46.866913+0000","last_peered":"2024-04-18T10:44:46.866913+0000","last_clean":"2024-04-18T10:44:46.866913+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:44:46.866913+0000","last_undegraded":"2024-04-18T10:44:46.866913+0000","last_fullsized":"2024-04-18T10:44:46.866913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'601","last_scrub_stamp":"2024-04-18T10:44:46.866772+0000","last_deep_scrub":"44'601","last_deep_scrub_stamp":"2024-04-18T10:44:46.866772+0000","last_clean_scrub_stamp":"2024-04-18T10:44:46.866772+0000","objects_scrubbed":3,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:05:53.779318+0000","scrub_duration":0.030500271999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:35.770915+0000","last_change":"2024-04-18T10:45:35.770886+0000","last_active":"2024-04-18T10:45:35.770915+0000","last_peered":"2024-04-18T10:45:35.770915+0000","last_clean":"2024-04-18T10:45:35.770915+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:45:35.770915+0000","last_undegraded":"2024-04-18T10:45:35.770915+0000","last_fullsized":"2024-04-18T10:45:35.770915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'400","last_scrub_stamp":"2024-04-18T10:45:35.770776+0000","last_deep_scrub":"44'400","last_deep_scrub_stamp":"2024-04-18T10:45:35.770776+0000","last_clean_scrub_stamp":"2024-04-18T10:45:35.770776+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:24.411036+0000","scrub_duration":0.0023058129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'445","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.993981+0000","last_change":"2024-04-18T10:44:34.993954+0000","last_active":"2024-04-18T10:44:34.993981+0000","last_peered":"2024-04-18T10:44:34.993981+0000","last_clean":"2024-04-18T10:44:34.993981+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:44:34.993981+0000","last_undegraded":"2024-04-18T10:44:34.993981+0000","last_fullsized":"2024-04-18T10:44:34.993981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'445","last_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_deep_scrub":"44'445","last_deep_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.993858+0000","objects_scrubbed":1,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:14:56.923345+0000","scrub_duration":0.014572485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":524,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:52.617462+0000","last_change":"2024-04-18T10:44:52.617432+0000","last_active":"2024-04-18T10:44:52.617462+0000","last_peered":"2024-04-18T10:44:52.617462+0000","last_clean":"2024-04-18T10:44:52.617462+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:44:52.617462+0000","last_undegraded":"2024-04-18T10:44:52.617462+0000","last_fullsized":"2024-04-18T10:44:52.617462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'415","last_scrub_stamp":"2024-04-18T10:44:52.617260+0000","last_deep_scrub":"44'415","last_deep_scrub_stamp":"2024-04-18T10:44:52.617260+0000","last_clean_scrub_stamp":"2024-04-18T10:44:52.617260+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:44:47.192766+0000","scrub_duration":0.002343506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'999","reported_seq":1054,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:10.902038+0000","last_change":"2024-04-18T10:45:10.902005+0000","last_active":"2024-04-18T10:45:10.902038+0000","last_peered":"2024-04-18T10:45:10.902038+0000","last_clean":"2024-04-18T10:45:10.902038+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:45:10.902038+0000","last_undegraded":"2024-04-18T10:45:10.902038+0000","last_fullsized":"2024-04-18T10:45:10.902038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'999","last_scrub_stamp":"2024-04-18T10:45:10.901904+0000","last_deep_scrub":"44'999","last_deep_scrub_stamp":"2024-04-18T10:45:10.901904+0000","last_clean_scrub_stamp":"2024-04-18T10:45:10.901904+0000","objects_scrubbed":2,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:17:40.862195+0000","scrub_duration":0.024304912000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":435,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.689865+0000","last_change":"2024-04-18T10:45:01.689805+0000","last_active":"2024-04-18T10:45:01.689865+0000","last_peered":"2024-04-18T10:45:01.689865+0000","last_clean":"2024-04-18T10:45:01.689865+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:45:01.689865+0000","last_undegraded":"2024-04-18T10:45:01.689865+0000","last_fullsized":"2024-04-18T10:45:01.689865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:45:01.689684+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:45:01.689684+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.689684+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:06.214067+0000","scrub_duration":0.0023057709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'65","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:05.559848+0000","last_change":"2024-04-18T10:44:05.559808+0000","last_active":"2024-04-18T10:44:05.559848+0000","last_peered":"2024-04-18T10:44:05.559848+0000","last_clean":"2024-04-18T10:44:05.559848+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:44:05.559848+0000","last_undegraded":"2024-04-18T10:44:05.559848+0000","last_fullsized":"2024-04-18T10:44:05.559848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'65","last_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_deep_scrub":"44'65","last_deep_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_clean_scrub_stamp":"2024-04-18T10:44:05.559716+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:36:17.724033+0000","scrub_duration":0.0036096679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.370178+0000","last_change":"2024-04-18T10:44:16.370147+0000","last_active":"2024-04-18T10:44:16.370178+0000","last_peered":"2024-04-18T10:44:16.370178+0000","last_clean":"2024-04-18T10:44:16.370178+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:44:16.370178+0000","last_undegraded":"2024-04-18T10:44:16.370178+0000","last_fullsized":"2024-04-18T10:44:16.370178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'423","last_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_deep_scrub":"44'423","last_deep_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.370037+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:39:35.585001+0000","scrub_duration":0.0021961260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'330","reported_seq":375,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:40.705897+0000","last_change":"2024-04-18T10:44:40.705867+0000","last_active":"2024-04-18T10:44:40.705897+0000","last_peered":"2024-04-18T10:44:40.705897+0000","last_clean":"2024-04-18T10:44:40.705897+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:44:40.705897+0000","last_undegraded":"2024-04-18T10:44:40.705897+0000","last_fullsized":"2024-04-18T10:44:40.705897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'330","last_scrub_stamp":"2024-04-18T10:44:40.705762+0000","last_deep_scrub":"44'330","last_deep_scrub_stamp":"2024-04-18T10:44:40.705762+0000","last_clean_scrub_stamp":"2024-04-18T10:44:40.705762+0000","objects_scrubbed":2,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:02:31.048359+0000","scrub_duration":0.013686825999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":641,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.177788+0000","last_change":"2024-04-18T10:44:27.177742+0000","last_active":"2024-04-18T10:44:27.177788+0000","last_peered":"2024-04-18T10:44:27.177788+0000","last_clean":"2024-04-18T10:44:27.177788+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:44:27.177788+0000","last_undegraded":"2024-04-18T10:44:27.177788+0000","last_fullsized":"2024-04-18T10:44:27.177788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'482","last_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_deep_scrub":"44'482","last_deep_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.177629+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:47:19.941357+0000","scrub_duration":0.0024789170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'122","reported_seq":173,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.560499+0000","last_change":"2024-04-18T10:44:18.560459+0000","last_active":"2024-04-18T10:44:18.560499+0000","last_peered":"2024-04-18T10:44:18.560499+0000","last_clean":"2024-04-18T10:44:18.560499+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:44:18.560499+0000","last_undegraded":"2024-04-18T10:44:18.560499+0000","last_fullsized":"2024-04-18T10:44:18.560499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'122","last_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_deep_scrub":"44'122","last_deep_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.560319+0000","objects_scrubbed":3,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:09:23.261625+0000","scrub_duration":0.0040023589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":535,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:09.949815+0000","last_change":"2024-04-18T10:45:09.949784+0000","last_active":"2024-04-18T10:45:09.949815+0000","last_peered":"2024-04-18T10:45:09.949815+0000","last_clean":"2024-04-18T10:45:09.949815+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:45:09.949815+0000","last_undegraded":"2024-04-18T10:45:09.949815+0000","last_fullsized":"2024-04-18T10:45:09.949815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:45:09.949681+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:45:09.949681+0000","last_clean_scrub_stamp":"2024-04-18T10:45:09.949681+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:13.437273+0000","scrub_duration":0.0023086029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'372","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:25.877905+0000","last_change":"2024-04-18T10:45:25.877866+0000","last_active":"2024-04-18T10:45:25.877905+0000","last_peered":"2024-04-18T10:45:25.877905+0000","last_clean":"2024-04-18T10:45:25.877905+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:45:25.877905+0000","last_undegraded":"2024-04-18T10:45:25.877905+0000","last_fullsized":"2024-04-18T10:45:25.877905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'372","last_scrub_stamp":"2024-04-18T10:45:25.877722+0000","last_deep_scrub":"44'372","last_deep_scrub_stamp":"2024-04-18T10:45:25.877722+0000","last_clean_scrub_stamp":"2024-04-18T10:45:25.877722+0000","objects_scrubbed":7,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:37:38.772207+0000","scrub_duration":0.030722666999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":556,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.709995+0000","last_change":"2024-04-18T10:44:43.709963+0000","last_active":"2024-04-18T10:44:43.709995+0000","last_peered":"2024-04-18T10:44:43.709995+0000","last_clean":"2024-04-18T10:44:43.709995+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:44:43.709995+0000","last_undegraded":"2024-04-18T10:44:43.709995+0000","last_fullsized":"2024-04-18T10:44:43.709995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'434","last_scrub_stamp":"2024-04-18T10:44:43.709864+0000","last_deep_scrub":"44'434","last_deep_scrub_stamp":"2024-04-18T10:44:43.709864+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.709864+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:40:37.586605+0000","scrub_duration":0.0022503520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'459","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:20.830738+0000","last_change":"2024-04-18T10:45:20.830699+0000","last_active":"2024-04-18T10:45:20.830738+0000","last_peered":"2024-04-18T10:45:20.830738+0000","last_clean":"2024-04-18T10:45:20.830738+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:45:20.830738+0000","last_undegraded":"2024-04-18T10:45:20.830738+0000","last_fullsized":"2024-04-18T10:45:20.830738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'459","last_scrub_stamp":"2024-04-18T10:45:20.830596+0000","last_deep_scrub":"44'459","last_deep_scrub_stamp":"2024-04-18T10:45:20.830596+0000","last_clean_scrub_stamp":"2024-04-18T10:45:20.830596+0000","objects_scrubbed":5,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:26:15.771848+0000","scrub_duration":0.024028593000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":441,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:58.814487+0000","last_change":"2024-04-18T10:44:58.814448+0000","last_active":"2024-04-18T10:44:58.814487+0000","last_peered":"2024-04-18T10:44:58.814487+0000","last_clean":"2024-04-18T10:44:58.814487+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:44:58.814487+0000","last_undegraded":"2024-04-18T10:44:58.814487+0000","last_fullsized":"2024-04-18T10:44:58.814487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:58.814332+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:58.814332+0000","last_clean_scrub_stamp":"2024-04-18T10:44:58.814332+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:38:25.746039+0000","scrub_duration":0.002297543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'53","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.595939+0000","last_change":"2024-04-18T10:44:26.595910+0000","last_active":"2024-04-18T10:44:26.595939+0000","last_peered":"2024-04-18T10:44:26.595939+0000","last_clean":"2024-04-18T10:44:26.595939+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:44:26.595939+0000","last_undegraded":"2024-04-18T10:44:26.595939+0000","last_fullsized":"2024-04-18T10:44:26.595939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'53","last_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_deep_scrub":"44'53","last_deep_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.595811+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:16:49.585489+0000","scrub_duration":0.0030095930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:12.868156+0000","last_change":"2024-04-18T10:45:12.868098+0000","last_active":"2024-04-18T10:45:12.868156+0000","last_peered":"2024-04-18T10:45:12.868156+0000","last_clean":"2024-04-18T10:45:12.868156+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:45:12.868156+0000","last_undegraded":"2024-04-18T10:45:12.868156+0000","last_fullsized":"2024-04-18T10:45:12.868156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'405","last_scrub_stamp":"2024-04-18T10:45:12.867983+0000","last_deep_scrub":"44'405","last_deep_scrub_stamp":"2024-04-18T10:45:12.867983+0000","last_clean_scrub_stamp":"2024-04-18T10:45:12.867983+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:40:01.021347+0000","scrub_duration":0.0023951160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":104,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:46.432580+0000","last_change":"2024-04-18T10:38:48.525049+0000","last_active":"2024-04-18T10:43:46.432580+0000","last_peered":"2024-04-18T10:43:46.432580+0000","last_clean":"2024-04-18T10:43:46.432580+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:43:46.432580+0000","last_undegraded":"2024-04-18T10:43:46.432580+0000","last_fullsized":"2024-04-18T10:43:46.432580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:07.664891+0000","last_clean_scrub_stamp":"2024-04-18T10:36:07.664891+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:57.653310+0000","last_change":"2024-04-18T10:44:57.653280+0000","last_active":"2024-04-18T10:44:57.653310+0000","last_peered":"2024-04-18T10:44:57.653310+0000","last_clean":"2024-04-18T10:44:57.653310+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:44:57.653310+0000","last_undegraded":"2024-04-18T10:44:57.653310+0000","last_fullsized":"2024-04-18T10:44:57.653310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'436","last_scrub_stamp":"2024-04-18T10:44:57.653159+0000","last_deep_scrub":"44'436","last_deep_scrub_stamp":"2024-04-18T10:44:57.653159+0000","last_clean_scrub_stamp":"2024-04-18T10:44:57.653159+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:31:19.842593+0000","scrub_duration":0.002443579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'75","reported_seq":129,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.009173+0000","last_change":"2024-04-18T10:44:28.009140+0000","last_active":"2024-04-18T10:44:28.009173+0000","last_peered":"2024-04-18T10:44:28.009173+0000","last_clean":"2024-04-18T10:44:28.009173+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:44:28.009173+0000","last_undegraded":"2024-04-18T10:44:28.009173+0000","last_fullsized":"2024-04-18T10:44:28.009173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'75","last_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_deep_scrub":"44'75","last_deep_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.009038+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:08:03.526122+0000","scrub_duration":0.0053935800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":499,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:29.118675+0000","last_change":"2024-04-18T10:44:29.118645+0000","last_active":"2024-04-18T10:44:29.118675+0000","last_peered":"2024-04-18T10:44:29.118675+0000","last_clean":"2024-04-18T10:44:29.118675+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:44:29.118675+0000","last_undegraded":"2024-04-18T10:44:29.118675+0000","last_fullsized":"2024-04-18T10:44:29.118675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'395","last_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_deep_scrub":"44'395","last_deep_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_clean_scrub_stamp":"2024-04-18T10:44:29.118542+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:28:54.989556+0000","scrub_duration":0.0023004689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'253","reported_seq":299,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.557411+0000","last_change":"2024-04-18T10:44:24.557383+0000","last_active":"2024-04-18T10:44:24.557411+0000","last_peered":"2024-04-18T10:44:24.557411+0000","last_clean":"2024-04-18T10:44:24.557411+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:44:24.557411+0000","last_undegraded":"2024-04-18T10:44:24.557411+0000","last_fullsized":"2024-04-18T10:44:24.557411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'253","last_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_deep_scrub":"44'253","last_deep_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.557282+0000","objects_scrubbed":2,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:50:13.889591+0000","scrub_duration":0.013433855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":487,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.066217+0000","last_change":"2024-04-18T10:44:42.066187+0000","last_active":"2024-04-18T10:44:42.066217+0000","last_peered":"2024-04-18T10:44:42.066217+0000","last_clean":"2024-04-18T10:44:42.066217+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:44:42.066217+0000","last_undegraded":"2024-04-18T10:44:42.066217+0000","last_fullsized":"2024-04-18T10:44:42.066217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:42.066068+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:42.066068+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.066068+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:04:45.048703+0000","scrub_duration":0.0023960040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'342","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.598760+0000","last_change":"2024-04-18T10:44:24.598713+0000","last_active":"2024-04-18T10:44:24.598760+0000","last_peered":"2024-04-18T10:44:24.598760+0000","last_clean":"2024-04-18T10:44:24.598760+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:44:24.598760+0000","last_undegraded":"2024-04-18T10:44:24.598760+0000","last_fullsized":"2024-04-18T10:44:24.598760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'342","last_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_deep_scrub":"44'342","last_deep_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.598616+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:33.105351+0000","scrub_duration":0.013052151999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.025191+0000","last_change":"2024-04-18T10:44:24.025155+0000","last_active":"2024-04-18T10:44:24.025191+0000","last_peered":"2024-04-18T10:44:24.025191+0000","last_clean":"2024-04-18T10:44:24.025191+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:44:24.025191+0000","last_undegraded":"2024-04-18T10:44:24.025191+0000","last_fullsized":"2024-04-18T10:44:24.025191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'435","last_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_deep_scrub":"44'435","last_deep_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.025044+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:05.200707+0000","scrub_duration":0.0023369929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'567","reported_seq":619,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.893920+0000","last_change":"2024-04-18T10:45:01.893889+0000","last_active":"2024-04-18T10:45:01.893920+0000","last_peered":"2024-04-18T10:45:01.893920+0000","last_clean":"2024-04-18T10:45:01.893920+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:45:01.893920+0000","last_undegraded":"2024-04-18T10:45:01.893920+0000","last_fullsized":"2024-04-18T10:45:01.893920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'567","last_scrub_stamp":"2024-04-18T10:45:01.893786+0000","last_deep_scrub":"44'567","last_deep_scrub_stamp":"2024-04-18T10:45:01.893786+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.893786+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:16:59.051408+0000","scrub_duration":0.014192883999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.525196+0000","last_change":"2024-04-18T10:44:09.525165+0000","last_active":"2024-04-18T10:44:09.525196+0000","last_peered":"2024-04-18T10:44:09.525196+0000","last_clean":"2024-04-18T10:44:09.525196+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:44:09.525196+0000","last_undegraded":"2024-04-18T10:44:09.525196+0000","last_fullsized":"2024-04-18T10:44:09.525196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'414","last_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_deep_scrub":"44'414","last_deep_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.525069+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:25:30.256844+0000","scrub_duration":0.002236264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":107,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:08.605199+0000","last_change":"2024-04-18T10:44:08.605160+0000","last_active":"2024-04-18T10:44:08.605199+0000","last_peered":"2024-04-18T10:44:08.605199+0000","last_clean":"2024-04-18T10:44:08.605199+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:44:08.605199+0000","last_undegraded":"2024-04-18T10:44:08.605199+0000","last_fullsized":"2024-04-18T10:44:08.605199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'60","last_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_deep_scrub":"44'60","last_deep_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_clean_scrub_stamp":"2024-04-18T10:44:08.605009+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:45:04.374538+0000","scrub_duration":0.0018151350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":557,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:06.589224+0000","last_change":"2024-04-18T10:44:06.589194+0000","last_active":"2024-04-18T10:44:06.589224+0000","last_peered":"2024-04-18T10:44:06.589224+0000","last_clean":"2024-04-18T10:44:06.589224+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:44:06.589224+0000","last_undegraded":"2024-04-18T10:44:06.589224+0000","last_fullsized":"2024-04-18T10:44:06.589224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'457","last_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_deep_scrub":"44'457","last_deep_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_clean_scrub_stamp":"2024-04-18T10:44:06.589080+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:14:25.178162+0000","scrub_duration":0.0023982220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'174","reported_seq":230,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:06.893821+0000","last_change":"2024-04-18T10:45:06.893788+0000","last_active":"2024-04-18T10:45:06.893821+0000","last_peered":"2024-04-18T10:45:06.893821+0000","last_clean":"2024-04-18T10:45:06.893821+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:45:06.893821+0000","last_undegraded":"2024-04-18T10:45:06.893821+0000","last_fullsized":"2024-04-18T10:45:06.893821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'174","last_scrub_stamp":"2024-04-18T10:45:06.893675+0000","last_deep_scrub":"44'174","last_deep_scrub_stamp":"2024-04-18T10:45:06.893675+0000","last_clean_scrub_stamp":"2024-04-18T10:45:06.893675+0000","objects_scrubbed":4,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:51.820998+0000","scrub_duration":0.019093763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:55.648293+0000","last_change":"2024-04-18T10:44:55.648252+0000","last_active":"2024-04-18T10:44:55.648293+0000","last_peered":"2024-04-18T10:44:55.648293+0000","last_clean":"2024-04-18T10:44:55.648293+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:44:55.648293+0000","last_undegraded":"2024-04-18T10:44:55.648293+0000","last_fullsized":"2024-04-18T10:44:55.648293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'449","last_scrub_stamp":"2024-04-18T10:44:55.648144+0000","last_deep_scrub":"44'449","last_deep_scrub_stamp":"2024-04-18T10:44:55.648144+0000","last_clean_scrub_stamp":"2024-04-18T10:44:55.648144+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:49:28.345804+0000","scrub_duration":0.002471123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'251","reported_seq":302,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:28.745402+0000","last_change":"2024-04-18T10:45:28.745362+0000","last_active":"2024-04-18T10:45:28.745402+0000","last_peered":"2024-04-18T10:45:28.745402+0000","last_clean":"2024-04-18T10:45:28.745402+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:45:28.745402+0000","last_undegraded":"2024-04-18T10:45:28.745402+0000","last_fullsized":"2024-04-18T10:45:28.745402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'251","last_scrub_stamp":"2024-04-18T10:45:28.745235+0000","last_deep_scrub":"44'251","last_deep_scrub_stamp":"2024-04-18T10:45:28.745235+0000","last_clean_scrub_stamp":"2024-04-18T10:45:28.745235+0000","objects_scrubbed":2,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:53:51.627035+0000","scrub_duration":0.013268103999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":494,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:38.838839+0000","last_change":"2024-04-18T10:45:38.838790+0000","last_active":"2024-04-18T10:45:38.838839+0000","last_peered":"2024-04-18T10:45:38.838839+0000","last_clean":"2024-04-18T10:45:38.838839+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:45:38.838839+0000","last_undegraded":"2024-04-18T10:45:38.838839+0000","last_fullsized":"2024-04-18T10:45:38.838839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:45:38.838650+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:45:38.838650+0000","last_clean_scrub_stamp":"2024-04-18T10:45:38.838650+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:02.434095+0000","scrub_duration":0.0024123880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'64","reported_seq":112,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:26.821286+0000","last_change":"2024-04-18T10:45:26.821244+0000","last_active":"2024-04-18T10:45:26.821286+0000","last_peered":"2024-04-18T10:45:26.821286+0000","last_clean":"2024-04-18T10:45:26.821286+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:45:26.821286+0000","last_undegraded":"2024-04-18T10:45:26.821286+0000","last_fullsized":"2024-04-18T10:45:26.821286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'64","last_scrub_stamp":"2024-04-18T10:45:26.821155+0000","last_deep_scrub":"44'64","last_deep_scrub_stamp":"2024-04-18T10:45:26.821155+0000","last_clean_scrub_stamp":"2024-04-18T10:45:26.821155+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:13:01.312926+0000","scrub_duration":0.0032513590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":415,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:53.715496+0000","last_change":"2024-04-18T10:44:53.715462+0000","last_active":"2024-04-18T10:44:53.715496+0000","last_peered":"2024-04-18T10:44:53.715496+0000","last_clean":"2024-04-18T10:44:53.715496+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:44:53.715496+0000","last_undegraded":"2024-04-18T10:44:53.715496+0000","last_fullsized":"2024-04-18T10:44:53.715496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'354","last_scrub_stamp":"2024-04-18T10:44:53.715355+0000","last_deep_scrub":"44'354","last_deep_scrub_stamp":"2024-04-18T10:44:53.715355+0000","last_clean_scrub_stamp":"2024-04-18T10:44:53.715355+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:08:56.971258+0000","scrub_duration":0.0023169520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'494","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:34.750892+0000","last_change":"2024-04-18T10:45:34.750859+0000","last_active":"2024-04-18T10:45:34.750892+0000","last_peered":"2024-04-18T10:45:34.750892+0000","last_clean":"2024-04-18T10:45:34.750892+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:45:34.750892+0000","last_undegraded":"2024-04-18T10:45:34.750892+0000","last_fullsized":"2024-04-18T10:45:34.750892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'494","last_scrub_stamp":"2024-04-18T10:45:34.750760+0000","last_deep_scrub":"44'494","last_deep_scrub_stamp":"2024-04-18T10:45:34.750760+0000","last_clean_scrub_stamp":"2024-04-18T10:45:34.750760+0000","objects_scrubbed":2,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:49:16.447299+0000","scrub_duration":0.0145171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:19.868810+0000","last_change":"2024-04-18T10:45:19.868780+0000","last_active":"2024-04-18T10:45:19.868810+0000","last_peered":"2024-04-18T10:45:19.868810+0000","last_clean":"2024-04-18T10:45:19.868810+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:45:19.868810+0000","last_undegraded":"2024-04-18T10:45:19.868810+0000","last_fullsized":"2024-04-18T10:45:19.868810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'422","last_scrub_stamp":"2024-04-18T10:45:19.868670+0000","last_deep_scrub":"44'422","last_deep_scrub_stamp":"2024-04-18T10:45:19.868670+0000","last_clean_scrub_stamp":"2024-04-18T10:45:19.868670+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:44.590398+0000","scrub_duration":0.0022748130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.876195+0000","last_change":"2024-04-18T10:44:42.876155+0000","last_active":"2024-04-18T10:44:42.876195+0000","last_peered":"2024-04-18T10:44:42.876195+0000","last_clean":"2024-04-18T10:44:42.876195+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:44:42.876195+0000","last_undegraded":"2024-04-18T10:44:42.876195+0000","last_fullsized":"2024-04-18T10:44:42.876195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:42.876035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:42.876035+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.876035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:02.831189+0000","scrub_duration":0.0014149329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'349","reported_seq":395,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.613083+0000","last_change":"2024-04-18T10:44:37.613042+0000","last_active":"2024-04-18T10:44:37.613083+0000","last_peered":"2024-04-18T10:44:37.613083+0000","last_clean":"2024-04-18T10:44:37.613083+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:44:37.613083+0000","last_undegraded":"2024-04-18T10:44:37.613083+0000","last_fullsized":"2024-04-18T10:44:37.613083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.612936+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:48.492165+0000","scrub_duration":0.014537654000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":411,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:48.862502+0000","last_change":"2024-04-18T10:44:48.862438+0000","last_active":"2024-04-18T10:44:48.862502+0000","last_peered":"2024-04-18T10:44:48.862502+0000","last_clean":"2024-04-18T10:44:48.862502+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:44:48.862502+0000","last_undegraded":"2024-04-18T10:44:48.862502+0000","last_fullsized":"2024-04-18T10:44:48.862502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:48.862336+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:48.862336+0000","last_clean_scrub_stamp":"2024-04-18T10:44:48.862336+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:48.226148+0000","scrub_duration":0.002153767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.094073+0000","last_change":"2024-04-18T10:44:43.094046+0000","last_active":"2024-04-18T10:44:43.094073+0000","last_peered":"2024-04-18T10:44:43.094073+0000","last_clean":"2024-04-18T10:44:43.094073+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:44:43.094073+0000","last_undegraded":"2024-04-18T10:44:43.094073+0000","last_fullsized":"2024-04-18T10:44:43.094073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:43.093917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:43.093917+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.093917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:44.980892+0000","scrub_duration":0.001405737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'72","reported_seq":122,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.533181+0000","last_change":"2024-04-18T10:44:19.533110+0000","last_active":"2024-04-18T10:44:19.533181+0000","last_peered":"2024-04-18T10:44:19.533181+0000","last_clean":"2024-04-18T10:44:19.533181+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:44:19.533181+0000","last_undegraded":"2024-04-18T10:44:19.533181+0000","last_fullsized":"2024-04-18T10:44:19.533181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'72","last_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_deep_scrub":"44'72","last_deep_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.533013+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:08:26.074171+0000","scrub_duration":0.003923078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.114134+0000","last_change":"2024-04-18T10:44:19.114101+0000","last_active":"2024-04-18T10:44:19.114134+0000","last_peered":"2024-04-18T10:44:19.114134+0000","last_clean":"2024-04-18T10:44:19.114134+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:44:19.114134+0000","last_undegraded":"2024-04-18T10:44:19.114134+0000","last_fullsized":"2024-04-18T10:44:19.114134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.113999+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:07:38.747202+0000","scrub_duration":0.002438047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:46.672262+0000","last_change":"2024-04-18T10:44:46.672227+0000","last_active":"2024-04-18T10:44:46.672262+0000","last_peered":"2024-04-18T10:44:46.672262+0000","last_clean":"2024-04-18T10:44:46.672262+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:44:46.672262+0000","last_undegraded":"2024-04-18T10:44:46.672262+0000","last_fullsized":"2024-04-18T10:44:46.672262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:46.672112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:46.672112+0000","last_clean_scrub_stamp":"2024-04-18T10:44:46.672112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:10:12.323516+0000","scrub_duration":0.0016045009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'435","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:15.907484+0000","last_change":"2024-04-18T10:45:15.907455+0000","last_active":"2024-04-18T10:45:15.907484+0000","last_peered":"2024-04-18T10:45:15.907484+0000","last_clean":"2024-04-18T10:45:15.907484+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:45:15.907484+0000","last_undegraded":"2024-04-18T10:45:15.907484+0000","last_fullsized":"2024-04-18T10:45:15.907484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'435","last_scrub_stamp":"2024-04-18T10:45:15.907356+0000","last_deep_scrub":"44'435","last_deep_scrub_stamp":"2024-04-18T10:45:15.907356+0000","last_clean_scrub_stamp":"2024-04-18T10:45:15.907356+0000","objects_scrubbed":2,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:07.092275+0000","scrub_duration":0.021374672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.106706+0000","last_change":"2024-04-18T10:44:17.106676+0000","last_active":"2024-04-18T10:44:17.106706+0000","last_peered":"2024-04-18T10:44:17.106706+0000","last_clean":"2024-04-18T10:44:17.106706+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:44:17.106706+0000","last_undegraded":"2024-04-18T10:44:17.106706+0000","last_fullsized":"2024-04-18T10:44:17.106706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.106562+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:13:53.441711+0000","scrub_duration":0.0023480530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.136129+0000","last_change":"2024-04-18T10:44:28.136098+0000","last_active":"2024-04-18T10:44:28.136129+0000","last_peered":"2024-04-18T10:44:28.136129+0000","last_clean":"2024-04-18T10:44:28.136129+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:44:28.136129+0000","last_undegraded":"2024-04-18T10:44:28.136129+0000","last_fullsized":"2024-04-18T10:44:28.136129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.135985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:42.424822+0000","scrub_duration":0.001452168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"44'117","reported_seq":207,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:36.000064+0000","last_change":"2024-04-18T10:44:36.000033+0000","last_active":"2024-04-18T10:44:36.000064+0000","last_peered":"2024-04-18T10:44:36.000064+0000","last_clean":"2024-04-18T10:44:36.000064+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:44:36.000064+0000","last_undegraded":"2024-04-18T10:44:36.000064+0000","last_fullsized":"2024-04-18T10:44:36.000064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'117","last_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_deep_scrub":"44'117","last_deep_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_clean_scrub_stamp":"2024-04-18T10:44:35.999921+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:44.891493+0000","scrub_duration":0.0075134060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'528","reported_seq":576,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:22.794137+0000","last_change":"2024-04-18T10:45:22.794103+0000","last_active":"2024-04-18T10:45:22.794137+0000","last_peered":"2024-04-18T10:45:22.794137+0000","last_clean":"2024-04-18T10:45:22.794137+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:45:22.794137+0000","last_undegraded":"2024-04-18T10:45:22.794137+0000","last_fullsized":"2024-04-18T10:45:22.794137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'528","last_scrub_stamp":"2024-04-18T10:45:22.793980+0000","last_deep_scrub":"44'528","last_deep_scrub_stamp":"2024-04-18T10:45:22.793980+0000","last_clean_scrub_stamp":"2024-04-18T10:45:22.793980+0000","objects_scrubbed":2,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:11:35.670893+0000","scrub_duration":0.022897773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":542,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:43:51.453925+0000","last_change":"2024-04-18T10:38:48.529367+0000","last_active":"2024-04-18T10:43:51.453925+0000","last_peered":"2024-04-18T10:43:51.453925+0000","last_clean":"2024-04-18T10:43:51.453925+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:43:51.453925+0000","last_undegraded":"2024-04-18T10:43:51.453925+0000","last_fullsized":"2024-04-18T10:43:51.453925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:36:08.670552+0000","last_clean_scrub_stamp":"2024-04-18T10:36:08.670552+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:41.049096+0000","last_change":"2024-04-18T10:44:41.049065+0000","last_active":"2024-04-18T10:44:41.049096+0000","last_peered":"2024-04-18T10:44:41.049096+0000","last_clean":"2024-04-18T10:44:41.049096+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:44:41.049096+0000","last_undegraded":"2024-04-18T10:44:41.049096+0000","last_fullsized":"2024-04-18T10:44:41.049096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_clean_scrub_stamp":"2024-04-18T10:44:41.048965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:40:48.265478+0000","scrub_duration":0.001413037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'263","reported_seq":495,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.603509+0000","last_change":"2024-04-18T10:44:27.603480+0000","last_active":"2024-04-18T10:44:27.603509+0000","last_peered":"2024-04-18T10:44:27.603509+0000","last_clean":"2024-04-18T10:44:27.603509+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:44:27.603509+0000","last_undegraded":"2024-04-18T10:44:27.603509+0000","last_fullsized":"2024-04-18T10:44:27.603509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'263","last_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_deep_scrub":"44'263","last_deep_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.603367+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:00.661142+0000","scrub_duration":0.006809715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.595841+0000","last_change":"2024-04-18T10:44:16.595810+0000","last_active":"2024-04-18T10:44:16.595841+0000","last_peered":"2024-04-18T10:44:16.595841+0000","last_clean":"2024-04-18T10:44:16.595841+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:44:16.595841+0000","last_undegraded":"2024-04-18T10:44:16.595841+0000","last_fullsized":"2024-04-18T10:44:16.595841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.595707+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:47.126670+0000","scrub_duration":0.002372323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.099574+0000","last_change":"2024-04-18T10:44:37.099519+0000","last_active":"2024-04-18T10:44:37.099574+0000","last_peered":"2024-04-18T10:44:37.099574+0000","last_clean":"2024-04-18T10:44:37.099574+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:44:37.099574+0000","last_undegraded":"2024-04-18T10:44:37.099574+0000","last_fullsized":"2024-04-18T10:44:37.099574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.099405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:12.361352+0000","scrub_duration":0.0015369120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.904082+0000","last_change":"2024-04-18T10:44:54.904049+0000","last_active":"2024-04-18T10:44:54.904082+0000","last_peered":"2024-04-18T10:44:54.904082+0000","last_clean":"2024-04-18T10:44:54.904082+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:44:54.904082+0000","last_undegraded":"2024-04-18T10:44:54.904082+0000","last_fullsized":"2024-04-18T10:44:54.904082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'57","last_scrub_stamp":"2024-04-18T10:44:54.903953+0000","last_deep_scrub":"44'57","last_deep_scrub_stamp":"2024-04-18T10:44:54.903953+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.903953+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:38.000312+0000","scrub_duration":0.00156953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.572462+0000","last_change":"2024-04-18T10:44:20.572430+0000","last_active":"2024-04-18T10:44:20.572462+0000","last_peered":"2024-04-18T10:44:20.572462+0000","last_clean":"2024-04-18T10:44:20.572462+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:44:20.572462+0000","last_undegraded":"2024-04-18T10:44:20.572462+0000","last_fullsized":"2024-04-18T10:44:20.572462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.572320+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:05.780336+0000","scrub_duration":0.0024798110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'64","reported_seq":116,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.293206+0000","last_change":"2024-04-18T10:44:21.293174+0000","last_active":"2024-04-18T10:44:21.293206+0000","last_peered":"2024-04-18T10:44:21.293206+0000","last_clean":"2024-04-18T10:44:21.293206+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:44:21.293206+0000","last_undegraded":"2024-04-18T10:44:21.293206+0000","last_fullsized":"2024-04-18T10:44:21.293206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'64","last_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_deep_scrub":"44'64","last_deep_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.293058+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:02.602650+0000","scrub_duration":0.0072041329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.116265+0000","last_change":"2024-04-18T10:44:16.116227+0000","last_active":"2024-04-18T10:44:16.116265+0000","last_peered":"2024-04-18T10:44:16.116265+0000","last_clean":"2024-04-18T10:44:16.116265+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:44:16.116265+0000","last_undegraded":"2024-04-18T10:44:16.116265+0000","last_fullsized":"2024-04-18T10:44:16.116265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.116120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:38:35.456110+0000","scrub_duration":0.001526194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:27.775327+0000","last_change":"2024-04-18T10:45:27.775294+0000","last_active":"2024-04-18T10:45:27.775327+0000","last_peered":"2024-04-18T10:45:27.775327+0000","last_clean":"2024-04-18T10:45:27.775327+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:45:27.775327+0000","last_undegraded":"2024-04-18T10:45:27.775327+0000","last_fullsized":"2024-04-18T10:45:27.775327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'420","last_scrub_stamp":"2024-04-18T10:45:27.775174+0000","last_deep_scrub":"44'420","last_deep_scrub_stamp":"2024-04-18T10:45:27.775174+0000","last_clean_scrub_stamp":"2024-04-18T10:45:27.775174+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:09:08.958167+0000","scrub_duration":0.0024068140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.163325+0000","last_change":"2024-04-18T10:44:26.163296+0000","last_active":"2024-04-18T10:44:26.163325+0000","last_peered":"2024-04-18T10:44:26.163325+0000","last_clean":"2024-04-18T10:44:26.163325+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:44:26.163325+0000","last_undegraded":"2024-04-18T10:44:26.163325+0000","last_fullsized":"2024-04-18T10:44:26.163325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.163155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:41:33.487472+0000","scrub_duration":0.001544494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":131,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.630059+0000","last_change":"2024-04-18T10:44:14.630013+0000","last_active":"2024-04-18T10:44:14.630059+0000","last_peered":"2024-04-18T10:44:14.630059+0000","last_clean":"2024-04-18T10:44:14.630059+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:44:14.630059+0000","last_undegraded":"2024-04-18T10:44:14.630059+0000","last_fullsized":"2024-04-18T10:44:14.630059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'83","last_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_deep_scrub":"44'83","last_deep_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.629894+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:04:39.848103+0000","scrub_duration":0.0054998199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":457,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:15.610348+0000","last_change":"2024-04-18T10:44:15.610317+0000","last_active":"2024-04-18T10:44:15.610348+0000","last_peered":"2024-04-18T10:44:15.610348+0000","last_clean":"2024-04-18T10:44:15.610348+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:44:15.610348+0000","last_undegraded":"2024-04-18T10:44:15.610348+0000","last_fullsized":"2024-04-18T10:44:15.610348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'377","last_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_deep_scrub":"44'377","last_deep_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_clean_scrub_stamp":"2024-04-18T10:44:15.610194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:21:45.794459+0000","scrub_duration":0.0023276400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'75","reported_seq":125,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.685768+0000","last_change":"2024-04-18T10:44:43.685728+0000","last_active":"2024-04-18T10:44:43.685768+0000","last_peered":"2024-04-18T10:44:43.685768+0000","last_clean":"2024-04-18T10:44:43.685768+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:44:43.685768+0000","last_undegraded":"2024-04-18T10:44:43.685768+0000","last_fullsized":"2024-04-18T10:44:43.685768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'75","last_scrub_stamp":"2024-04-18T10:44:43.685630+0000","last_deep_scrub":"44'75","last_deep_scrub_stamp":"2024-04-18T10:44:43.685630+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.685630+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:19:47.619608+0000","scrub_duration":0.011221696999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":452,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:48.710591+0000","last_change":"2024-04-18T10:44:48.710558+0000","last_active":"2024-04-18T10:44:48.710591+0000","last_peered":"2024-04-18T10:44:48.710591+0000","last_clean":"2024-04-18T10:44:48.710591+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:44:48.710591+0000","last_undegraded":"2024-04-18T10:44:48.710591+0000","last_fullsized":"2024-04-18T10:44:48.710591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'384","last_scrub_stamp":"2024-04-18T10:44:48.710451+0000","last_deep_scrub":"44'384","last_deep_scrub_stamp":"2024-04-18T10:44:48.710451+0000","last_clean_scrub_stamp":"2024-04-18T10:44:48.710451+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:03:14.715697+0000","scrub_duration":0.0024035810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'345","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:40.861394+0000","last_change":"2024-04-18T10:44:40.861354+0000","last_active":"2024-04-18T10:44:40.861394+0000","last_peered":"2024-04-18T10:44:40.861394+0000","last_clean":"2024-04-18T10:44:40.861394+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:44:40.861394+0000","last_undegraded":"2024-04-18T10:44:40.861394+0000","last_fullsized":"2024-04-18T10:44:40.861394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'345","last_scrub_stamp":"2024-04-18T10:44:40.861207+0000","last_deep_scrub":"44'345","last_deep_scrub_stamp":"2024-04-18T10:44:40.861207+0000","last_clean_scrub_stamp":"2024-04-18T10:44:40.861207+0000","objects_scrubbed":2,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:42:35.225739+0000","scrub_duration":0.01437416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":420,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:10.529301+0000","last_change":"2024-04-18T10:44:10.529249+0000","last_active":"2024-04-18T10:44:10.529301+0000","last_peered":"2024-04-18T10:44:10.529301+0000","last_clean":"2024-04-18T10:44:10.529301+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:44:10.529301+0000","last_undegraded":"2024-04-18T10:44:10.529301+0000","last_fullsized":"2024-04-18T10:44:10.529301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'352","last_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_deep_scrub":"44'352","last_deep_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:10.529127+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:12:28.231944+0000","scrub_duration":0.0022035800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'291","reported_seq":347,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.377930+0000","last_change":"2024-04-18T10:44:17.377889+0000","last_active":"2024-04-18T10:44:17.377930+0000","last_peered":"2024-04-18T10:44:17.377930+0000","last_clean":"2024-04-18T10:44:17.377930+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:44:17.377930+0000","last_undegraded":"2024-04-18T10:44:17.377930+0000","last_fullsized":"2024-04-18T10:44:17.377930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'291","last_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_deep_scrub":"44'291","last_deep_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.377743+0000","objects_scrubbed":4,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:37.743454+0000","scrub_duration":0.030049699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.575444+0000","last_change":"2024-04-18T10:44:19.575417+0000","last_active":"2024-04-18T10:44:19.575444+0000","last_peered":"2024-04-18T10:44:19.575444+0000","last_clean":"2024-04-18T10:44:19.575444+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:44:19.575444+0000","last_undegraded":"2024-04-18T10:44:19.575444+0000","last_fullsized":"2024-04-18T10:44:19.575444+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.575311+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:47:55.784007+0000","scrub_duration":0.0020110480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'111","reported_seq":159,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:19.793503+0000","last_change":"2024-04-18T10:45:19.793453+0000","last_active":"2024-04-18T10:45:19.793503+0000","last_peered":"2024-04-18T10:45:19.793503+0000","last_clean":"2024-04-18T10:45:19.793503+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:45:19.793503+0000","last_undegraded":"2024-04-18T10:45:19.793503+0000","last_fullsized":"2024-04-18T10:45:19.793503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'111","last_scrub_stamp":"2024-04-18T10:45:19.793343+0000","last_deep_scrub":"44'111","last_deep_scrub_stamp":"2024-04-18T10:45:19.793343+0000","last_clean_scrub_stamp":"2024-04-18T10:45:19.793343+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:20:42.163995+0000","scrub_duration":0.010971541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":526,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:31.689206+0000","last_change":"2024-04-18T10:45:31.689169+0000","last_active":"2024-04-18T10:45:31.689206+0000","last_peered":"2024-04-18T10:45:31.689206+0000","last_clean":"2024-04-18T10:45:31.689206+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:45:31.689206+0000","last_undegraded":"2024-04-18T10:45:31.689206+0000","last_fullsized":"2024-04-18T10:45:31.689206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:45:31.689047+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:45:31.689047+0000","last_clean_scrub_stamp":"2024-04-18T10:45:31.689047+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:43.932547+0000","scrub_duration":0.0024883850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'102","reported_seq":146,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.622673+0000","last_change":"2024-04-18T10:44:34.622627+0000","last_active":"2024-04-18T10:44:34.622673+0000","last_peered":"2024-04-18T10:44:34.622673+0000","last_clean":"2024-04-18T10:44:34.622673+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:44:34.622673+0000","last_undegraded":"2024-04-18T10:44:34.622673+0000","last_fullsized":"2024-04-18T10:44:34.622673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'102","last_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_deep_scrub":"44'102","last_deep_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.622522+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:53:16.158696+0000","scrub_duration":0.012842098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:39.658970+0000","last_change":"2024-04-18T10:44:39.658938+0000","last_active":"2024-04-18T10:44:39.658970+0000","last_peered":"2024-04-18T10:44:39.658970+0000","last_clean":"2024-04-18T10:44:39.658970+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:44:39.658970+0000","last_undegraded":"2024-04-18T10:44:39.658970+0000","last_fullsized":"2024-04-18T10:44:39.658970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'432","last_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_deep_scrub":"44'432","last_deep_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_clean_scrub_stamp":"2024-04-18T10:44:39.658831+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:58:08.433321+0000","scrub_duration":0.0024322020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":510,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:05.946782+0000","last_change":"2024-04-18T10:45:05.946758+0000","last_active":"2024-04-18T10:45:05.946782+0000","last_peered":"2024-04-18T10:45:05.946782+0000","last_clean":"2024-04-18T10:45:05.946782+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:45:05.946782+0000","last_undegraded":"2024-04-18T10:45:05.946782+0000","last_fullsized":"2024-04-18T10:45:05.946782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:45:05.946653+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:45:05.946653+0000","last_clean_scrub_stamp":"2024-04-18T10:45:05.946653+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:59:36.714123+0000","scrub_duration":0.002118937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":449,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:58.675440+0000","last_change":"2024-04-18T10:44:58.675399+0000","last_active":"2024-04-18T10:44:58.675440+0000","last_peered":"2024-04-18T10:44:58.675440+0000","last_clean":"2024-04-18T10:44:58.675440+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:44:58.675440+0000","last_undegraded":"2024-04-18T10:44:58.675440+0000","last_fullsized":"2024-04-18T10:44:58.675440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'408","last_scrub_stamp":"2024-04-18T10:44:58.675288+0000","last_deep_scrub":"44'408","last_deep_scrub_stamp":"2024-04-18T10:44:58.675288+0000","last_clean_scrub_stamp":"2024-04-18T10:44:58.675288+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:11:15.241591+0000","scrub_duration":0.0022547029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":575,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.634081+0000","last_change":"2024-04-18T10:44:42.634050+0000","last_active":"2024-04-18T10:44:42.634081+0000","last_peered":"2024-04-18T10:44:42.634081+0000","last_clean":"2024-04-18T10:44:42.634081+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:44:42.634081+0000","last_undegraded":"2024-04-18T10:44:42.634081+0000","last_fullsized":"2024-04-18T10:44:42.634081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'470","last_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_deep_scrub":"44'470","last_deep_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.633943+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:34:03.702154+0000","scrub_duration":0.0025497570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.195348+0000","last_change":"2024-04-18T10:44:24.195320+0000","last_active":"2024-04-18T10:44:24.195348+0000","last_peered":"2024-04-18T10:44:24.195348+0000","last_clean":"2024-04-18T10:44:24.195348+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:44:24.195348+0000","last_undegraded":"2024-04-18T10:44:24.195348+0000","last_fullsized":"2024-04-18T10:44:24.195348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.195206+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:51:24.563147+0000","scrub_duration":0.0022383659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":508,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:51.884469+0000","last_change":"2024-04-18T10:44:51.884431+0000","last_active":"2024-04-18T10:44:51.884469+0000","last_peered":"2024-04-18T10:44:51.884469+0000","last_clean":"2024-04-18T10:44:51.884469+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:44:51.884469+0000","last_undegraded":"2024-04-18T10:44:51.884469+0000","last_fullsized":"2024-04-18T10:44:51.884469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'402","last_scrub_stamp":"2024-04-18T10:44:51.884312+0000","last_deep_scrub":"44'402","last_deep_scrub_stamp":"2024-04-18T10:44:51.884312+0000","last_clean_scrub_stamp":"2024-04-18T10:44:51.884312+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:33.666434+0000","scrub_duration":0.0022388320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8567,"ondisk_log_size":8567,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953557,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.36799999999999999},"min":{"1min":0.248,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.46400000000000002,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.38100000000000001},"min":{"1min":0.24399999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.49399999999999999,"5min":1.732,"15min":1.732},"last":0.377}]},{"osd":1,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.28499999999999998,"5min":0.184,"15min":0.184},"max":{"1min":0.51900000000000002,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.38200000000000001},"min":{"1min":0.29599999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.57899999999999996},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.42599999999999999},"min":{"1min":0.32100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":4.181,"15min":4.181},"last":0.32900000000000001}]}]},{"osd":2,"up_from":31,"seq":133143986262,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:45:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.23000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.51800000000000002,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.57199999999999995,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.432}]},{"osd":1,"last update":"Thu Apr 18 10:45:03 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.38},"min":{"1min":0.29399999999999998,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.39900000000000002},"min":{"1min":0.27000000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57399999999999995,"5min":1.53,"15min":1.53},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Apr 18 10:45:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.374,"15min":0.40500000000000003},"min":{"1min":0.34799999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.42999999999999999},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.623,"5min":1.49,"15min":1.49},"last":0.505}]}]},{"osd":0,"up_from":29,"seq":124554051670,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.33800000000000002},"min":{"1min":0.27700000000000002,"5min":0.156,"15min":0.156},"max":{"1min":0.53300000000000003,"5min":1.002,"15min":1.002},"last":0.245},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26500000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.55300000000000005,"5min":1.224,"15min":1.224},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39500000000000002,"15min":0.36199999999999999},"min":{"1min":0.32600000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.53000000000000003,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.314,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51700000000000002,"5min":1.173,"15min":1.173},"last":0.313}]},{"osd":3,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.375,"15min":0.41499999999999998},"min":{"1min":0.27600000000000002,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51500000000000001,"5min":0.879,"15min":1.204},"last":0.437},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42999999999999999,"15min":0.50700000000000001},"min":{"1min":0.27900000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56799999999999995,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.32300000000000001}]}]},{"osd":1,"up_from":30,"seq":128849018966,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33200000000000002,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.58499999999999996,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.34300000000000003,"15min":0.35999999999999999},"min":{"1min":0.28100000000000003,"5min":0.187,"15min":0.187},"max":{"1min":0.51200000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.373,"15min":0.37},"min":{"1min":0.28000000000000003,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.61899999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.316},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.37,"15min":0.38700000000000001},"min":{"1min":0.255,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.57199999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Apr 18 10:44:59 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.37,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59199999999999997,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.438,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.66100000000000003,"5min":2.173,"15min":2.173},"last":0.41999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:45:46.818 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-18T10:36:07.664891+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=7, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:46.819 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-18T10:36:08.670552+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=36, tm_sec=8, tm_wday=3, tm_yday=109, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=18, tm_hour=10, tm_min=44, tm_sec=1, tm_wday=3, tm_yday=109, tm_isdst=0) 2024-04-18T10:45:46.819 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-18T10:46:06.820 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-18T10:46:06.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.954+0000 7f8666b5b700 1 Processor -- start 2024-04-18T10:46:06.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.954+0000 7f8666b5b700 1 -- start start 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f8666b5b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86600aa8e0 0x7f86600a8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f8666b5b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86601422f0 0x7f8660149f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f8666b5b700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86600ab140 con 0x7f866013efd0 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f8666b5b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86600a8e60 con 0x7f86600aa8e0 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f8666b5b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866013e660 con 0x7f86601422f0 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f86648f7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f86600aa8e0 0x7f86600a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f865ffff700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f866013efd0 0x7f8660141be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48638/0 (socket says 172.21.15.31:48638) 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f865ffff700 1 -- 172.21.15.31:0/1670231815 learned_addr learned my addr 172.21.15.31:0/1670231815 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f86650f8700 1 --2- 172.21.15.31:0/1670231815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86601422f0 0x7f8660149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f86648f7700 1 -- 172.21.15.31:0/1670231815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86601422f0 msgr2=0x7f8660149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:06.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f86648f7700 1 --2- 172.21.15.31:0/1670231815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86601422f0 0x7f8660149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f86648f7700 1 -- 172.21.15.31:0/1670231815 >> v1:172.21.15.31:6789/0 conn(0x7f866013efd0 legacy=0x7f8660141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f86648f7700 1 -- 172.21.15.31:0/1670231815 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600a7160 con 0x7f86600aa8e0 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.955+0000 7f865f7fe700 1 -- 172.21.15.31:0/1670231815 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334695892 0 0) 0x7f86600ab140 con 0x7f866013efd0 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f86650f8700 1 --2- 172.21.15.31:0/1670231815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86601422f0 0x7f8660149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f86648f7700 1 --2- 172.21.15.31:0/1670231815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86600aa8e0 0x7f86600a8920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f86540098e0 tx=0x7f86540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c943b239d1ef090 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f865f7fe700 1 -- 172.21.15.31:0/1670231815 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400b640 con 0x7f86600aa8e0 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f865f7fe700 1 -- 172.21.15.31:0/1670231815 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400b7a0 con 0x7f86600aa8e0 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f865f7fe700 1 -- 172.21.15.31:0/1670231815 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400bb40 con 0x7f86600aa8e0 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f8666b5b700 1 -- 172.21.15.31:0/1670231815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86600aa8e0 msgr2=0x7f86600a8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f8666b5b700 1 --2- 172.21.15.31:0/1670231815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86600aa8e0 0x7f86600a8920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f86540098e0 tx=0x7f86540091a0 comp rx=0 tx=0).stop 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f8666b5b700 1 -- 172.21.15.31:0/1670231815 shutdown_connections 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f8666b5b700 1 --2- 172.21.15.31:0/1670231815 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86601422f0 0x7f8660149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f8666b5b700 1 --2- 172.21.15.31:0/1670231815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86600aa8e0 0x7f86600a8920 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f8666b5b700 1 -- 172.21.15.31:0/1670231815 >> 172.21.15.31:0/1670231815 conn(0x7f8660069450 msgr2=0x7f8660063610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:06.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.956+0000 7f8666b5b700 1 -- 172.21.15.31:0/1670231815 shutdown_connections 2024-04-18T10:46:06.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.957+0000 7f8666b5b700 1 -- 172.21.15.31:0/1670231815 wait complete. 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.957+0000 7f8666b5b700 1 Processor -- start 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f8666b5b700 1 -- start start 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f8666b5b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86600aa8e0 0x7f86600ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f8666b5b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866013efd0 0x7f86601519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f8666b5b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86601422f0 0x7f8660151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f8666b5b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600b1570 con 0x7f86601422f0 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f8666b5b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86600ade50 con 0x7f86600aa8e0 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f8666b5b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86600aedf0 con 0x7f866013efd0 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f86648f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86600aa8e0 0x7f86600ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f865ffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866013efd0 0x7f86601519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f86648f7700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86600aa8e0 0x7f86600ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38238/0 (socket says 172.21.15.31:38238) 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f86648f7700 1 -- 172.21.15.31:0/4156333324 learned_addr learned my addr 172.21.15.31:0/4156333324 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.958+0000 7f86650f8700 1 --2- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86601422f0 0x7f8660151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:06.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f86648f7700 1 -- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866013efd0 msgr2=0x7f86601519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f86648f7700 1 --2- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866013efd0 0x7f86601519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f86648f7700 1 -- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86601422f0 msgr2=0x7f8660151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f86648f7700 1 --2- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86601422f0 0x7f8660151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f86648f7700 1 -- 172.21.15.31:0/4156333324 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658009a20 con 0x7f86600aa8e0 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f86650f8700 1 --2- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86601422f0 0x7f8660151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f86648f7700 1 --2- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86600aa8e0 0x7f86600ae730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f86600a8fa0 tx=0x7f8654017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f865cff9700 1 -- 172.21.15.31:0/4156333324 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654000d10 con 0x7f86600aa8e0 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f865cff9700 1 -- 172.21.15.31:0/4156333324 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400bb20 con 0x7f86600aa8e0 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8654009420 con 0x7f86600aa8e0 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f865cff9700 1 -- 172.21.15.31:0/4156333324 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654011670 con 0x7f86600aa8e0 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.959+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86600b0040 con 0x7f86600aa8e0 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.960+0000 7f865cff9700 1 -- 172.21.15.31:0/4156333324 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8654011a20 con 0x7f86600aa8e0 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.960+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8660064920 con 0x7f86600aa8e0 2024-04-18T10:46:06.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.960+0000 7f865cff9700 1 -- 172.21.15.31:0/4156333324 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f865405c4e0 con 0x7f86600aa8e0 2024-04-18T10:46:06.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:06.964+0000 7f865cff9700 1 -- 172.21.15.31:0/4156333324 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8654005a00 con 0x7f86600aa8e0 2024-04-18T10:46:07.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.124+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 --> v1:172.21.15.31:6816/46601 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86600af160 con 0x7f8644045ef0 2024-04-18T10:46:07.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.131+0000 7f865cff9700 1 -- 172.21.15.31:0/4156333324 <== mgr.24105 v1:172.21.15.31:6816/46601 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280422 (unknown 2965378022 0 755042234) 0x7f86600af160 con 0x7f8644045ef0 2024-04-18T10:46:07.137 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:46:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 >> v1:172.21.15.31:6816/46601 conn(0x7f8644045ef0 legacy=0x7f86440483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86600aa8e0 msgr2=0x7f86600ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 --2- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86600aa8e0 0x7f86600ae730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f86600a8fa0 tx=0x7f8654017000 comp rx=0 tx=0).stop 2024-04-18T10:46:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 shutdown_connections 2024-04-18T10:46:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 --2- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86601422f0 0x7f8660151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 --2- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f86600aa8e0 0x7f86600ae730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 --2- 172.21.15.31:0/4156333324 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f866013efd0 0x7f86601519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 >> 172.21.15.31:0/4156333324 conn(0x7f8660069450 msgr2=0x7f86600b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:07.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 shutdown_connections 2024-04-18T10:46:07.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.134+0000 7f8666b5b700 1 -- 172.21.15.31:0/4156333324 wait complete. 2024-04-18T10:46:07.140 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-04-18T10:46:07.146 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-18T10:46:06.517943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130698639,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3175,"num_read_kb":1476567,"num_write":31254,"num_write_kb":4394586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35149,"ondisk_log_size":35149,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1482840,"kb_used_data":256824,"kb_used_omap":44,"kb_used_meta":1225939,"kb_avail":376004520,"statfs":{"total":386547056640,"available":385028628480,"internally_reserved":0,"allocated":262987776,"data_stored":262066394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45281,"internal_metadata":1255362335},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003167"},"pg_stats":[{"pgid":"4.3f","version":"44'406","reported_seq":533,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.637320+0000","last_change":"2024-04-18T10:44:26.637274+0000","last_active":"2024-04-18T10:44:26.637320+0000","last_peered":"2024-04-18T10:44:26.637320+0000","last_clean":"2024-04-18T10:44:26.637320+0000","last_became_active":"2024-04-18T10:38:48.515392+0000","last_became_peered":"2024-04-18T10:38:48.515392+0000","last_unstale":"2024-04-18T10:44:26.637320+0000","last_undegraded":"2024-04-18T10:44:26.637320+0000","last_fullsized":"2024-04-18T10:44:26.637320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'406","last_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_deep_scrub":"44'406","last_deep_scrub_stamp":"2024-04-18T10:44:26.637158+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.637158+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:40:46.367442+0000","scrub_duration":0.0019350299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":44342,"num_write":369,"num_write_kb":67122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"44'425","reported_seq":521,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.529297+0000","last_change":"2024-04-18T10:44:11.529249+0000","last_active":"2024-04-18T10:44:11.529297+0000","last_peered":"2024-04-18T10:44:11.529297+0000","last_clean":"2024-04-18T10:44:11.529297+0000","last_became_active":"2024-04-18T10:38:47.514066+0000","last_became_peered":"2024-04-18T10:38:47.514066+0000","last_unstale":"2024-04-18T10:44:11.529297+0000","last_undegraded":"2024-04-18T10:44:11.529297+0000","last_fullsized":"2024-04-18T10:44:11.529297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'425","last_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_deep_scrub":"44'425","last_deep_scrub_stamp":"2024-04-18T10:44:11.529136+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.529136+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:31:02.859668+0000","scrub_duration":0.002289952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":33306,"num_write":397,"num_write_kb":63720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"44'375","reported_seq":432,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.557510+0000","last_change":"2024-04-18T10:44:21.557477+0000","last_active":"2024-04-18T10:44:21.557510+0000","last_peered":"2024-04-18T10:44:21.557510+0000","last_clean":"2024-04-18T10:44:21.557510+0000","last_became_active":"2024-04-18T10:38:46.522321+0000","last_became_peered":"2024-04-18T10:38:46.522321+0000","last_unstale":"2024-04-18T10:44:21.557510+0000","last_undegraded":"2024-04-18T10:44:21.557510+0000","last_fullsized":"2024-04-18T10:44:21.557510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:21.557376+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.557376+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:19:59.466067+0000","scrub_duration":0.0022859669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6433,"num_write":347,"num_write_kb":51016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"44'394","reported_seq":464,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.547987+0000","last_change":"2024-04-18T10:45:01.547955+0000","last_active":"2024-04-18T10:45:01.547987+0000","last_peered":"2024-04-18T10:45:01.547987+0000","last_clean":"2024-04-18T10:45:01.547987+0000","last_became_active":"2024-04-18T10:38:46.522690+0000","last_became_peered":"2024-04-18T10:38:46.522690+0000","last_unstale":"2024-04-18T10:45:01.547987+0000","last_undegraded":"2024-04-18T10:45:01.547987+0000","last_fullsized":"2024-04-18T10:45:01.547987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'394","last_scrub_stamp":"2024-04-18T10:45:01.547829+0000","last_deep_scrub":"44'394","last_deep_scrub_stamp":"2024-04-18T10:45:01.547829+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.547829+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:16:23.304001+0000","scrub_duration":0.002333431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":16496,"num_write":360,"num_write_kb":62929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"44'428","reported_seq":543,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:22.581671+0000","last_change":"2024-04-18T10:44:22.581628+0000","last_active":"2024-04-18T10:44:22.581671+0000","last_peered":"2024-04-18T10:44:22.581671+0000","last_clean":"2024-04-18T10:44:22.581671+0000","last_became_active":"2024-04-18T10:39:29.510352+0000","last_became_peered":"2024-04-18T10:39:29.510352+0000","last_unstale":"2024-04-18T10:44:22.581671+0000","last_undegraded":"2024-04-18T10:44:22.581671+0000","last_fullsized":"2024-04-18T10:44:22.581671+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'428","last_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_deep_scrub":"44'428","last_deep_scrub_stamp":"2024-04-18T10:44:22.581473+0000","last_clean_scrub_stamp":"2024-04-18T10:44:22.581473+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:42:51.909519+0000","scrub_duration":0.0023658939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":33392,"num_write":401,"num_write_kb":68388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"44'374","reported_seq":413,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:02.500797+0000","last_change":"2024-04-18T10:45:02.500763+0000","last_active":"2024-04-18T10:45:02.500797+0000","last_peered":"2024-04-18T10:45:02.500797+0000","last_clean":"2024-04-18T10:45:02.500797+0000","last_became_active":"2024-04-18T10:39:29.507848+0000","last_became_peered":"2024-04-18T10:39:29.507848+0000","last_unstale":"2024-04-18T10:45:02.500797+0000","last_undegraded":"2024-04-18T10:45:02.500797+0000","last_fullsized":"2024-04-18T10:45:02.500797+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'374","last_scrub_stamp":"2024-04-18T10:45:02.500644+0000","last_deep_scrub":"44'374","last_deep_scrub_stamp":"2024-04-18T10:45:02.500644+0000","last_clean_scrub_stamp":"2024-04-18T10:45:02.500644+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:35:37.838971+0000","scrub_duration":0.0024023999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":5699,"num_write":349,"num_write_kb":37956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"44'433","reported_seq":529,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.334276+0000","last_change":"2024-04-18T10:44:18.334236+0000","last_active":"2024-04-18T10:44:18.334276+0000","last_peered":"2024-04-18T10:44:18.334276+0000","last_clean":"2024-04-18T10:44:18.334276+0000","last_became_active":"2024-04-18T10:38:48.526174+0000","last_became_peered":"2024-04-18T10:38:48.526174+0000","last_unstale":"2024-04-18T10:44:18.334276+0000","last_undegraded":"2024-04-18T10:44:18.334276+0000","last_fullsized":"2024-04-18T10:44:18.334276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:18.334127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.334127+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:41:16.742027+0000","scrub_duration":0.0024997970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":14237,"num_write":406,"num_write_kb":64983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"44'383","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.989712+0000","last_change":"2024-04-18T10:44:24.989685+0000","last_active":"2024-04-18T10:44:24.989712+0000","last_peered":"2024-04-18T10:44:24.989712+0000","last_clean":"2024-04-18T10:44:24.989712+0000","last_became_active":"2024-04-18T10:38:46.506975+0000","last_became_peered":"2024-04-18T10:38:46.506975+0000","last_unstale":"2024-04-18T10:44:24.989712+0000","last_undegraded":"2024-04-18T10:44:24.989712+0000","last_fullsized":"2024-04-18T10:44:24.989712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'383","last_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_deep_scrub":"44'383","last_deep_scrub_stamp":"2024-04-18T10:44:24.989580+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.989580+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:01:44.688357+0000","scrub_duration":0.0023556649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":28404,"num_write":351,"num_write_kb":87729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"44'422","reported_seq":514,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:11.557807+0000","last_change":"2024-04-18T10:44:11.557779+0000","last_active":"2024-04-18T10:44:11.557807+0000","last_peered":"2024-04-18T10:44:11.557807+0000","last_clean":"2024-04-18T10:44:11.557807+0000","last_became_active":"2024-04-18T10:38:48.520670+0000","last_became_peered":"2024-04-18T10:38:48.520670+0000","last_unstale":"2024-04-18T10:44:11.557807+0000","last_undegraded":"2024-04-18T10:44:11.557807+0000","last_fullsized":"2024-04-18T10:44:11.557807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'422","last_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_deep_scrub":"44'422","last_deep_scrub_stamp":"2024-04-18T10:44:11.557669+0000","last_clean_scrub_stamp":"2024-04-18T10:44:11.557669+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:00:02.279295+0000","scrub_duration":0.0024686619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22154,"num_write":393,"num_write_kb":59393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"44'421","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.144649+0000","last_change":"2024-04-18T10:44:09.144611+0000","last_active":"2024-04-18T10:44:09.144649+0000","last_peered":"2024-04-18T10:44:09.144649+0000","last_clean":"2024-04-18T10:44:09.144649+0000","last_became_active":"2024-04-18T10:38:46.520015+0000","last_became_peered":"2024-04-18T10:38:46.520015+0000","last_unstale":"2024-04-18T10:44:09.144649+0000","last_undegraded":"2024-04-18T10:44:09.144649+0000","last_fullsized":"2024-04-18T10:44:09.144649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'421","last_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_deep_scrub":"44'421","last_deep_scrub_stamp":"2024-04-18T10:44:09.144503+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.144503+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:28:16.445422+0000","scrub_duration":0.0024088249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":37690,"num_write":378,"num_write_kb":88519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"44'396","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.195610+0000","last_change":"2024-04-18T10:44:14.195578+0000","last_active":"2024-04-18T10:44:14.195610+0000","last_peered":"2024-04-18T10:44:14.195610+0000","last_clean":"2024-04-18T10:44:14.195610+0000","last_became_active":"2024-04-18T10:38:46.519922+0000","last_became_peered":"2024-04-18T10:38:46.519922+0000","last_unstale":"2024-04-18T10:44:14.195610+0000","last_undegraded":"2024-04-18T10:44:14.195610+0000","last_fullsized":"2024-04-18T10:44:14.195610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:14.195443+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.195443+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:18:06.505533+0000","scrub_duration":0.0024248439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":44275,"num_write":378,"num_write_kb":91995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"44'349","reported_seq":415,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:38.631266+0000","last_change":"2024-04-18T10:44:38.631204+0000","last_active":"2024-04-18T10:44:38.631266+0000","last_peered":"2024-04-18T10:44:38.631266+0000","last_clean":"2024-04-18T10:44:38.631266+0000","last_became_active":"2024-04-18T10:38:48.520155+0000","last_became_peered":"2024-04-18T10:38:48.520155+0000","last_unstale":"2024-04-18T10:44:38.631266+0000","last_undegraded":"2024-04-18T10:44:38.631266+0000","last_fullsized":"2024-04-18T10:44:38.631266+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:38.631083+0000","last_clean_scrub_stamp":"2024-04-18T10:44:38.631083+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:30:27.239036+0000","scrub_duration":0.002062871,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":10388,"num_write":321,"num_write_kb":33971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"44'406","reported_seq":494,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:49.732934+0000","last_change":"2024-04-18T10:44:49.732906+0000","last_active":"2024-04-18T10:44:49.732934+0000","last_peered":"2024-04-18T10:44:49.732934+0000","last_clean":"2024-04-18T10:44:49.732934+0000","last_became_active":"2024-04-18T10:38:48.527738+0000","last_became_peered":"2024-04-18T10:38:48.527738+0000","last_unstale":"2024-04-18T10:44:49.732934+0000","last_undegraded":"2024-04-18T10:44:49.732934+0000","last_fullsized":"2024-04-18T10:44:49.732934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'406","last_scrub_stamp":"2024-04-18T10:44:49.732801+0000","last_deep_scrub":"44'406","last_deep_scrub_stamp":"2024-04-18T10:44:49.732801+0000","last_clean_scrub_stamp":"2024-04-18T10:44:49.732801+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:41:17.189667+0000","scrub_duration":0.0023307010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":20578,"num_write":374,"num_write_kb":51296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:13.165805+0000","last_change":"2024-04-18T10:44:13.165763+0000","last_active":"2024-04-18T10:44:13.165805+0000","last_peered":"2024-04-18T10:44:13.165805+0000","last_clean":"2024-04-18T10:44:13.165805+0000","last_became_active":"2024-04-18T10:38:47.515058+0000","last_became_peered":"2024-04-18T10:38:47.515058+0000","last_unstale":"2024-04-18T10:44:13.165805+0000","last_undegraded":"2024-04-18T10:44:13.165805+0000","last_fullsized":"2024-04-18T10:44:13.165805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:13.165654+0000","last_clean_scrub_stamp":"2024-04-18T10:44:13.165654+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:05:30.099837+0000","scrub_duration":0.0022553650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1799,"num_write":376,"num_write_kb":46947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"44'413","reported_seq":538,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:56.698063+0000","last_change":"2024-04-18T10:44:56.698031+0000","last_active":"2024-04-18T10:44:56.698063+0000","last_peered":"2024-04-18T10:44:56.698063+0000","last_clean":"2024-04-18T10:44:56.698063+0000","last_became_active":"2024-04-18T10:38:46.522471+0000","last_became_peered":"2024-04-18T10:38:46.522471+0000","last_unstale":"2024-04-18T10:44:56.698063+0000","last_undegraded":"2024-04-18T10:44:56.698063+0000","last_fullsized":"2024-04-18T10:44:56.698063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'413","last_scrub_stamp":"2024-04-18T10:44:56.697924+0000","last_deep_scrub":"44'413","last_deep_scrub_stamp":"2024-04-18T10:44:56.697924+0000","last_clean_scrub_stamp":"2024-04-18T10:44:56.697924+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:31:37.961106+0000","scrub_duration":0.002392974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":43160,"num_write":375,"num_write_kb":67466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"44'439","reported_seq":490,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.684875+0000","last_change":"2024-04-18T10:44:54.684839+0000","last_active":"2024-04-18T10:44:54.684875+0000","last_peered":"2024-04-18T10:44:54.684875+0000","last_clean":"2024-04-18T10:44:54.684875+0000","last_became_active":"2024-04-18T10:39:29.507971+0000","last_became_peered":"2024-04-18T10:39:29.507971+0000","last_unstale":"2024-04-18T10:44:54.684875+0000","last_undegraded":"2024-04-18T10:44:54.684875+0000","last_fullsized":"2024-04-18T10:44:54.684875+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'439","last_scrub_stamp":"2024-04-18T10:44:54.684729+0000","last_deep_scrub":"44'439","last_deep_scrub_stamp":"2024-04-18T10:44:54.684729+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.684729+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:59:01.278560+0000","scrub_duration":0.0022394659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":16154,"num_write":408,"num_write_kb":79315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"44'424","reported_seq":515,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.615863+0000","last_change":"2024-04-18T10:44:54.615831+0000","last_active":"2024-04-18T10:44:54.615863+0000","last_peered":"2024-04-18T10:44:54.615863+0000","last_clean":"2024-04-18T10:44:54.615863+0000","last_became_active":"2024-04-18T10:38:48.527146+0000","last_became_peered":"2024-04-18T10:38:48.527146+0000","last_unstale":"2024-04-18T10:44:54.615863+0000","last_undegraded":"2024-04-18T10:44:54.615863+0000","last_fullsized":"2024-04-18T10:44:54.615863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'424","last_scrub_stamp":"2024-04-18T10:44:54.615711+0000","last_deep_scrub":"44'424","last_deep_scrub_stamp":"2024-04-18T10:44:54.615711+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.615711+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:53:30.727391+0000","scrub_duration":0.0024038290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25746,"num_write":397,"num_write_kb":95783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"44'411","reported_seq":480,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:25.567371+0000","last_change":"2024-04-18T10:44:25.567348+0000","last_active":"2024-04-18T10:44:25.567371+0000","last_peered":"2024-04-18T10:44:25.567371+0000","last_clean":"2024-04-18T10:44:25.567371+0000","last_became_active":"2024-04-18T10:38:47.513824+0000","last_became_peered":"2024-04-18T10:38:47.513824+0000","last_unstale":"2024-04-18T10:44:25.567371+0000","last_undegraded":"2024-04-18T10:44:25.567371+0000","last_fullsized":"2024-04-18T10:44:25.567371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'411","last_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_deep_scrub":"44'411","last_deep_scrub_stamp":"2024-04-18T10:44:25.567250+0000","last_clean_scrub_stamp":"2024-04-18T10:44:25.567250+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:30:08.433037+0000","scrub_duration":0.001860376,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":12588,"num_write":374,"num_write_kb":71503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"44'437","reported_seq":537,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.678041+0000","last_change":"2024-04-18T10:44:28.678009+0000","last_active":"2024-04-18T10:44:28.678041+0000","last_peered":"2024-04-18T10:44:28.678041+0000","last_clean":"2024-04-18T10:44:28.678041+0000","last_became_active":"2024-04-18T10:38:48.518397+0000","last_became_peered":"2024-04-18T10:38:48.518397+0000","last_unstale":"2024-04-18T10:44:28.678041+0000","last_undegraded":"2024-04-18T10:44:28.678041+0000","last_fullsized":"2024-04-18T10:44:28.678041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:28.677897+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.677897+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:19:26.570868+0000","scrub_duration":0.0024894269999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":32525,"num_write":401,"num_write_kb":104924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"44'459","reported_seq":558,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.040362+0000","last_change":"2024-04-18T10:44:23.040332+0000","last_active":"2024-04-18T10:44:23.040362+0000","last_peered":"2024-04-18T10:44:23.040362+0000","last_clean":"2024-04-18T10:44:23.040362+0000","last_became_active":"2024-04-18T10:38:48.535222+0000","last_became_peered":"2024-04-18T10:38:48.535222+0000","last_unstale":"2024-04-18T10:44:23.040362+0000","last_undegraded":"2024-04-18T10:44:23.040362+0000","last_fullsized":"2024-04-18T10:44:23.040362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'459","last_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_deep_scrub":"44'459","last_deep_scrub_stamp":"2024-04-18T10:44:23.040211+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.040211+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:27:20.385741+0000","scrub_duration":0.0023176189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":23805,"num_write":423,"num_write_kb":63329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"44'413","reported_seq":513,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:30.040466+0000","last_change":"2024-04-18T10:44:30.040439+0000","last_active":"2024-04-18T10:44:30.040466+0000","last_peered":"2024-04-18T10:44:30.040466+0000","last_clean":"2024-04-18T10:44:30.040466+0000","last_became_active":"2024-04-18T10:38:48.535885+0000","last_became_peered":"2024-04-18T10:38:48.535885+0000","last_unstale":"2024-04-18T10:44:30.040466+0000","last_undegraded":"2024-04-18T10:44:30.040466+0000","last_fullsized":"2024-04-18T10:44:30.040466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'413","last_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_deep_scrub":"44'413","last_deep_scrub_stamp":"2024-04-18T10:44:30.040312+0000","last_clean_scrub_stamp":"2024-04-18T10:44:30.040312+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:29:22.491578+0000","scrub_duration":0.0023350599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":23935,"num_write":379,"num_write_kb":80167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"44'433","reported_seq":570,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:23.532351+0000","last_change":"2024-04-18T10:44:23.532321+0000","last_active":"2024-04-18T10:44:23.532351+0000","last_peered":"2024-04-18T10:44:23.532351+0000","last_clean":"2024-04-18T10:44:23.532351+0000","last_became_active":"2024-04-18T10:38:46.522877+0000","last_became_peered":"2024-04-18T10:38:46.522877+0000","last_unstale":"2024-04-18T10:44:23.532351+0000","last_undegraded":"2024-04-18T10:44:23.532351+0000","last_fullsized":"2024-04-18T10:44:23.532351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'433","last_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_deep_scrub":"44'433","last_deep_scrub_stamp":"2024-04-18T10:44:23.532201+0000","last_clean_scrub_stamp":"2024-04-18T10:44:23.532201+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:17:09.342669+0000","scrub_duration":0.00234395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":50636,"num_write":399,"num_write_kb":96313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"44'401","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:40.828327+0000","last_change":"2024-04-18T10:45:40.828279+0000","last_active":"2024-04-18T10:45:40.828327+0000","last_peered":"2024-04-18T10:45:40.828327+0000","last_clean":"2024-04-18T10:45:40.828327+0000","last_became_active":"2024-04-18T10:38:48.523849+0000","last_became_peered":"2024-04-18T10:38:48.523849+0000","last_unstale":"2024-04-18T10:45:40.828327+0000","last_undegraded":"2024-04-18T10:45:40.828327+0000","last_fullsized":"2024-04-18T10:45:40.828327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'401","last_scrub_stamp":"2024-04-18T10:45:40.828147+0000","last_deep_scrub":"44'401","last_deep_scrub_stamp":"2024-04-18T10:45:40.828147+0000","last_clean_scrub_stamp":"2024-04-18T10:45:40.828147+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:46.025409+0000","scrub_duration":0.0023395719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25523,"num_write":370,"num_write_kb":59371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"44'444","reported_seq":561,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.076667+0000","last_change":"2024-04-18T10:44:20.076638+0000","last_active":"2024-04-18T10:44:20.076667+0000","last_peered":"2024-04-18T10:44:20.076667+0000","last_clean":"2024-04-18T10:44:20.076667+0000","last_became_active":"2024-04-18T10:38:48.532477+0000","last_became_peered":"2024-04-18T10:38:48.532477+0000","last_unstale":"2024-04-18T10:44:20.076667+0000","last_undegraded":"2024-04-18T10:44:20.076667+0000","last_fullsized":"2024-04-18T10:44:20.076667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'444","last_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_deep_scrub":"44'444","last_deep_scrub_stamp":"2024-04-18T10:44:20.076529+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.076529+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:32:07.735061+0000","scrub_duration":0.0023703510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":44455,"num_write":411,"num_write_kb":79173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"44'412","reported_seq":459,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:59.626990+0000","last_change":"2024-04-18T10:44:59.626945+0000","last_active":"2024-04-18T10:44:59.626990+0000","last_peered":"2024-04-18T10:44:59.626990+0000","last_clean":"2024-04-18T10:44:59.626990+0000","last_became_active":"2024-04-18T10:39:29.640797+0000","last_became_peered":"2024-04-18T10:39:29.640797+0000","last_unstale":"2024-04-18T10:44:59.626990+0000","last_undegraded":"2024-04-18T10:44:59.626990+0000","last_fullsized":"2024-04-18T10:44:59.626990+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:59.626796+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:59.626796+0000","last_clean_scrub_stamp":"2024-04-18T10:44:59.626796+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:08:10.274438+0000","scrub_duration":0.0025074519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":6786,"num_write":393,"num_write_kb":22138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"44'504","reported_seq":624,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:12.933898+0000","last_change":"2024-04-18T10:45:12.933849+0000","last_active":"2024-04-18T10:45:12.933898+0000","last_peered":"2024-04-18T10:45:12.933898+0000","last_clean":"2024-04-18T10:45:12.933898+0000","last_became_active":"2024-04-18T10:38:47.514568+0000","last_became_peered":"2024-04-18T10:38:47.514568+0000","last_unstale":"2024-04-18T10:45:12.933898+0000","last_undegraded":"2024-04-18T10:45:12.933898+0000","last_fullsized":"2024-04-18T10:45:12.933898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'504","last_scrub_stamp":"2024-04-18T10:45:12.933743+0000","last_deep_scrub":"44'504","last_deep_scrub_stamp":"2024-04-18T10:45:12.933743+0000","last_clean_scrub_stamp":"2024-04-18T10:45:12.933743+0000","objects_scrubbed":0,"log_size":504,"log_dups_size":0,"ondisk_log_size":504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:53:17.820138+0000","scrub_duration":0.0023169979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":40109,"num_write":463,"num_write_kb":93299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"44'420","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.328008+0000","last_change":"2024-04-18T10:44:19.327977+0000","last_active":"2024-04-18T10:44:19.328008+0000","last_peered":"2024-04-18T10:44:19.328008+0000","last_clean":"2024-04-18T10:44:19.328008+0000","last_became_active":"2024-04-18T10:38:48.523542+0000","last_became_peered":"2024-04-18T10:38:48.523542+0000","last_unstale":"2024-04-18T10:44:19.328008+0000","last_undegraded":"2024-04-18T10:44:19.328008+0000","last_fullsized":"2024-04-18T10:44:19.328008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'420","last_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_deep_scrub":"44'420","last_deep_scrub_stamp":"2024-04-18T10:44:19.327882+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.327882+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:47:32.007720+0000","scrub_duration":0.0021444820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":31454,"num_write":393,"num_write_kb":59403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"44'601","reported_seq":646,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:46.866913+0000","last_change":"2024-04-18T10:44:46.866883+0000","last_active":"2024-04-18T10:44:46.866913+0000","last_peered":"2024-04-18T10:44:46.866913+0000","last_clean":"2024-04-18T10:44:46.866913+0000","last_became_active":"2024-04-18T10:38:47.515384+0000","last_became_peered":"2024-04-18T10:38:47.515384+0000","last_unstale":"2024-04-18T10:44:46.866913+0000","last_undegraded":"2024-04-18T10:44:46.866913+0000","last_fullsized":"2024-04-18T10:44:46.866913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'601","last_scrub_stamp":"2024-04-18T10:44:46.866772+0000","last_deep_scrub":"44'601","last_deep_scrub_stamp":"2024-04-18T10:44:46.866772+0000","last_clean_scrub_stamp":"2024-04-18T10:44:46.866772+0000","objects_scrubbed":3,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:05:53.779318+0000","scrub_duration":0.030500271999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":525,"num_write_kb":12645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"44'400","reported_seq":484,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:35.770915+0000","last_change":"2024-04-18T10:45:35.770886+0000","last_active":"2024-04-18T10:45:35.770915+0000","last_peered":"2024-04-18T10:45:35.770915+0000","last_clean":"2024-04-18T10:45:35.770915+0000","last_became_active":"2024-04-18T10:38:48.535266+0000","last_became_peered":"2024-04-18T10:38:48.535266+0000","last_unstale":"2024-04-18T10:45:35.770915+0000","last_undegraded":"2024-04-18T10:45:35.770915+0000","last_fullsized":"2024-04-18T10:45:35.770915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'400","last_scrub_stamp":"2024-04-18T10:45:35.770776+0000","last_deep_scrub":"44'400","last_deep_scrub_stamp":"2024-04-18T10:45:35.770776+0000","last_clean_scrub_stamp":"2024-04-18T10:45:35.770776+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:44:24.411036+0000","scrub_duration":0.0023058129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19108,"num_write":353,"num_write_kb":63455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"44'445","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.993981+0000","last_change":"2024-04-18T10:44:34.993954+0000","last_active":"2024-04-18T10:44:34.993981+0000","last_peered":"2024-04-18T10:44:34.993981+0000","last_clean":"2024-04-18T10:44:34.993981+0000","last_became_active":"2024-04-18T10:38:48.531138+0000","last_became_peered":"2024-04-18T10:38:48.531138+0000","last_unstale":"2024-04-18T10:44:34.993981+0000","last_undegraded":"2024-04-18T10:44:34.993981+0000","last_fullsized":"2024-04-18T10:44:34.993981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'445","last_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_deep_scrub":"44'445","last_deep_scrub_stamp":"2024-04-18T10:44:34.993858+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.993858+0000","objects_scrubbed":1,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:14:56.923345+0000","scrub_duration":0.014572485,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"44'415","reported_seq":524,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:52.617462+0000","last_change":"2024-04-18T10:44:52.617432+0000","last_active":"2024-04-18T10:44:52.617462+0000","last_peered":"2024-04-18T10:44:52.617462+0000","last_clean":"2024-04-18T10:44:52.617462+0000","last_became_active":"2024-04-18T10:38:46.523215+0000","last_became_peered":"2024-04-18T10:38:46.523215+0000","last_unstale":"2024-04-18T10:44:52.617462+0000","last_undegraded":"2024-04-18T10:44:52.617462+0000","last_fullsized":"2024-04-18T10:44:52.617462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'415","last_scrub_stamp":"2024-04-18T10:44:52.617260+0000","last_deep_scrub":"44'415","last_deep_scrub_stamp":"2024-04-18T10:44:52.617260+0000","last_clean_scrub_stamp":"2024-04-18T10:44:52.617260+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:44:47.192766+0000","scrub_duration":0.002343506,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":41949,"num_write":385,"num_write_kb":62999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"44'999","reported_seq":1054,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:10.902038+0000","last_change":"2024-04-18T10:45:10.902005+0000","last_active":"2024-04-18T10:45:10.902038+0000","last_peered":"2024-04-18T10:45:10.902038+0000","last_clean":"2024-04-18T10:45:10.902038+0000","last_became_active":"2024-04-18T10:38:48.528415+0000","last_became_peered":"2024-04-18T10:38:48.528415+0000","last_unstale":"2024-04-18T10:45:10.902038+0000","last_undegraded":"2024-04-18T10:45:10.902038+0000","last_fullsized":"2024-04-18T10:45:10.902038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'999","last_scrub_stamp":"2024-04-18T10:45:10.901904+0000","last_deep_scrub":"44'999","last_deep_scrub_stamp":"2024-04-18T10:45:10.901904+0000","last_clean_scrub_stamp":"2024-04-18T10:45:10.901904+0000","objects_scrubbed":2,"log_size":999,"log_dups_size":0,"ondisk_log_size":999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:17:40.862195+0000","scrub_duration":0.024304912000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":927,"num_write_kb":8643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"44'386","reported_seq":435,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.689865+0000","last_change":"2024-04-18T10:45:01.689805+0000","last_active":"2024-04-18T10:45:01.689865+0000","last_peered":"2024-04-18T10:45:01.689865+0000","last_clean":"2024-04-18T10:45:01.689865+0000","last_became_active":"2024-04-18T10:39:29.505539+0000","last_became_peered":"2024-04-18T10:39:29.505539+0000","last_unstale":"2024-04-18T10:45:01.689865+0000","last_undegraded":"2024-04-18T10:45:01.689865+0000","last_fullsized":"2024-04-18T10:45:01.689865+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:45:01.689684+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:45:01.689684+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.689684+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:04:06.214067+0000","scrub_duration":0.0023057709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14042,"num_write":351,"num_write_kb":59676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'65","reported_seq":113,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:05.559848+0000","last_change":"2024-04-18T10:44:05.559808+0000","last_active":"2024-04-18T10:44:05.559848+0000","last_peered":"2024-04-18T10:44:05.559848+0000","last_clean":"2024-04-18T10:44:05.559848+0000","last_became_active":"2024-04-18T10:38:48.521001+0000","last_became_peered":"2024-04-18T10:38:48.521001+0000","last_unstale":"2024-04-18T10:44:05.559848+0000","last_undegraded":"2024-04-18T10:44:05.559848+0000","last_fullsized":"2024-04-18T10:44:05.559848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'65","last_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_deep_scrub":"44'65","last_deep_scrub_stamp":"2024-04-18T10:44:05.559716+0000","last_clean_scrub_stamp":"2024-04-18T10:44:05.559716+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:36:17.724033+0000","scrub_duration":0.0036096679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"44'423","reported_seq":488,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.370178+0000","last_change":"2024-04-18T10:44:16.370147+0000","last_active":"2024-04-18T10:44:16.370178+0000","last_peered":"2024-04-18T10:44:16.370178+0000","last_clean":"2024-04-18T10:44:16.370178+0000","last_became_active":"2024-04-18T10:38:48.528105+0000","last_became_peered":"2024-04-18T10:38:48.528105+0000","last_unstale":"2024-04-18T10:44:16.370178+0000","last_undegraded":"2024-04-18T10:44:16.370178+0000","last_fullsized":"2024-04-18T10:44:16.370178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'423","last_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_deep_scrub":"44'423","last_deep_scrub_stamp":"2024-04-18T10:44:16.370037+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.370037+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:39:35.585001+0000","scrub_duration":0.0021961260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12583,"num_write":394,"num_write_kb":42372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"44'330","reported_seq":375,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:40.705897+0000","last_change":"2024-04-18T10:44:40.705867+0000","last_active":"2024-04-18T10:44:40.705897+0000","last_peered":"2024-04-18T10:44:40.705897+0000","last_clean":"2024-04-18T10:44:40.705897+0000","last_became_active":"2024-04-18T10:38:48.528369+0000","last_became_peered":"2024-04-18T10:38:48.528369+0000","last_unstale":"2024-04-18T10:44:40.705897+0000","last_undegraded":"2024-04-18T10:44:40.705897+0000","last_fullsized":"2024-04-18T10:44:40.705897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'330","last_scrub_stamp":"2024-04-18T10:44:40.705762+0000","last_deep_scrub":"44'330","last_deep_scrub_stamp":"2024-04-18T10:44:40.705762+0000","last_clean_scrub_stamp":"2024-04-18T10:44:40.705762+0000","objects_scrubbed":2,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:02:31.048359+0000","scrub_duration":0.013686825999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":4268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"44'482","reported_seq":641,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.177788+0000","last_change":"2024-04-18T10:44:27.177742+0000","last_active":"2024-04-18T10:44:27.177788+0000","last_peered":"2024-04-18T10:44:27.177788+0000","last_clean":"2024-04-18T10:44:27.177788+0000","last_became_active":"2024-04-18T10:38:48.524223+0000","last_became_peered":"2024-04-18T10:38:48.524223+0000","last_unstale":"2024-04-18T10:44:27.177788+0000","last_undegraded":"2024-04-18T10:44:27.177788+0000","last_fullsized":"2024-04-18T10:44:27.177788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'482","last_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_deep_scrub":"44'482","last_deep_scrub_stamp":"2024-04-18T10:44:27.177629+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.177629+0000","objects_scrubbed":0,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:47:19.941357+0000","scrub_duration":0.0024789170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":59759,"num_write":455,"num_write_kb":101135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"44'122","reported_seq":173,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:18.560499+0000","last_change":"2024-04-18T10:44:18.560459+0000","last_active":"2024-04-18T10:44:18.560499+0000","last_peered":"2024-04-18T10:44:18.560499+0000","last_clean":"2024-04-18T10:44:18.560499+0000","last_became_active":"2024-04-18T10:38:48.529121+0000","last_became_peered":"2024-04-18T10:38:48.529121+0000","last_unstale":"2024-04-18T10:44:18.560499+0000","last_undegraded":"2024-04-18T10:44:18.560499+0000","last_fullsized":"2024-04-18T10:44:18.560499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'122","last_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_deep_scrub":"44'122","last_deep_scrub_stamp":"2024-04-18T10:44:18.560319+0000","last_clean_scrub_stamp":"2024-04-18T10:44:18.560319+0000","objects_scrubbed":3,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:09:23.261625+0000","scrub_duration":0.0040023589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":74,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"44'430","reported_seq":535,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:09.949815+0000","last_change":"2024-04-18T10:45:09.949784+0000","last_active":"2024-04-18T10:45:09.949815+0000","last_peered":"2024-04-18T10:45:09.949815+0000","last_clean":"2024-04-18T10:45:09.949815+0000","last_became_active":"2024-04-18T10:38:48.530116+0000","last_became_peered":"2024-04-18T10:38:48.530116+0000","last_unstale":"2024-04-18T10:45:09.949815+0000","last_undegraded":"2024-04-18T10:45:09.949815+0000","last_fullsized":"2024-04-18T10:45:09.949815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:45:09.949681+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:45:09.949681+0000","last_clean_scrub_stamp":"2024-04-18T10:45:09.949681+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:13.437273+0000","scrub_duration":0.0023086029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":24819,"num_write":395,"num_write_kb":63843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'372","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:25.877905+0000","last_change":"2024-04-18T10:45:25.877866+0000","last_active":"2024-04-18T10:45:25.877905+0000","last_peered":"2024-04-18T10:45:25.877905+0000","last_clean":"2024-04-18T10:45:25.877905+0000","last_became_active":"2024-04-18T10:38:48.518239+0000","last_became_peered":"2024-04-18T10:38:48.518239+0000","last_unstale":"2024-04-18T10:45:25.877905+0000","last_undegraded":"2024-04-18T10:45:25.877905+0000","last_fullsized":"2024-04-18T10:45:25.877905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'372","last_scrub_stamp":"2024-04-18T10:45:25.877722+0000","last_deep_scrub":"44'372","last_deep_scrub_stamp":"2024-04-18T10:45:25.877722+0000","last_clean_scrub_stamp":"2024-04-18T10:45:25.877722+0000","objects_scrubbed":7,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:37:38.772207+0000","scrub_duration":0.030722666999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":312,"num_write_kb":11134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"44'434","reported_seq":556,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.709995+0000","last_change":"2024-04-18T10:44:43.709963+0000","last_active":"2024-04-18T10:44:43.709995+0000","last_peered":"2024-04-18T10:44:43.709995+0000","last_clean":"2024-04-18T10:44:43.709995+0000","last_became_active":"2024-04-18T10:38:48.527395+0000","last_became_peered":"2024-04-18T10:38:48.527395+0000","last_unstale":"2024-04-18T10:44:43.709995+0000","last_undegraded":"2024-04-18T10:44:43.709995+0000","last_fullsized":"2024-04-18T10:44:43.709995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'434","last_scrub_stamp":"2024-04-18T10:44:43.709864+0000","last_deep_scrub":"44'434","last_deep_scrub_stamp":"2024-04-18T10:44:43.709864+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.709864+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:40:37.586605+0000","scrub_duration":0.0022503520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":29515,"num_write":399,"num_write_kb":109827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"44'459","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:20.830738+0000","last_change":"2024-04-18T10:45:20.830699+0000","last_active":"2024-04-18T10:45:20.830738+0000","last_peered":"2024-04-18T10:45:20.830738+0000","last_clean":"2024-04-18T10:45:20.830738+0000","last_became_active":"2024-04-18T10:38:48.522512+0000","last_became_peered":"2024-04-18T10:38:48.522512+0000","last_unstale":"2024-04-18T10:45:20.830738+0000","last_undegraded":"2024-04-18T10:45:20.830738+0000","last_fullsized":"2024-04-18T10:45:20.830738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'459","last_scrub_stamp":"2024-04-18T10:45:20.830596+0000","last_deep_scrub":"44'459","last_deep_scrub_stamp":"2024-04-18T10:45:20.830596+0000","last_clean_scrub_stamp":"2024-04-18T10:45:20.830596+0000","objects_scrubbed":5,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:26:15.771848+0000","scrub_duration":0.024028593000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":402,"num_write_kb":8375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"44'375","reported_seq":441,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:58.814487+0000","last_change":"2024-04-18T10:44:58.814448+0000","last_active":"2024-04-18T10:44:58.814487+0000","last_peered":"2024-04-18T10:44:58.814487+0000","last_clean":"2024-04-18T10:44:58.814487+0000","last_became_active":"2024-04-18T10:38:48.524708+0000","last_became_peered":"2024-04-18T10:38:48.524708+0000","last_unstale":"2024-04-18T10:44:58.814487+0000","last_undegraded":"2024-04-18T10:44:58.814487+0000","last_fullsized":"2024-04-18T10:44:58.814487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'375","last_scrub_stamp":"2024-04-18T10:44:58.814332+0000","last_deep_scrub":"44'375","last_deep_scrub_stamp":"2024-04-18T10:44:58.814332+0000","last_clean_scrub_stamp":"2024-04-18T10:44:58.814332+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:38:25.746039+0000","scrub_duration":0.002297543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":9633,"num_write":333,"num_write_kb":30140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"44'53","reported_seq":100,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.595939+0000","last_change":"2024-04-18T10:44:26.595910+0000","last_active":"2024-04-18T10:44:26.595939+0000","last_peered":"2024-04-18T10:44:26.595939+0000","last_clean":"2024-04-18T10:44:26.595939+0000","last_became_active":"2024-04-18T10:38:48.530016+0000","last_became_peered":"2024-04-18T10:38:48.530016+0000","last_unstale":"2024-04-18T10:44:26.595939+0000","last_undegraded":"2024-04-18T10:44:26.595939+0000","last_fullsized":"2024-04-18T10:44:26.595939+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'53","last_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_deep_scrub":"44'53","last_deep_scrub_stamp":"2024-04-18T10:44:26.595811+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.595811+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:16:49.585489+0000","scrub_duration":0.0030095930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"44'405","reported_seq":496,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:12.868156+0000","last_change":"2024-04-18T10:45:12.868098+0000","last_active":"2024-04-18T10:45:12.868156+0000","last_peered":"2024-04-18T10:45:12.868156+0000","last_clean":"2024-04-18T10:45:12.868156+0000","last_became_active":"2024-04-18T10:38:48.524327+0000","last_became_peered":"2024-04-18T10:38:48.524327+0000","last_unstale":"2024-04-18T10:45:12.868156+0000","last_undegraded":"2024-04-18T10:45:12.868156+0000","last_fullsized":"2024-04-18T10:45:12.868156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'405","last_scrub_stamp":"2024-04-18T10:45:12.867983+0000","last_deep_scrub":"44'405","last_deep_scrub_stamp":"2024-04-18T10:45:12.867983+0000","last_clean_scrub_stamp":"2024-04-18T10:45:12.867983+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:40:01.021347+0000","scrub_duration":0.0023951160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":24600,"num_write":369,"num_write_kb":55192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"44'66","reported_seq":114,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:47.735112+0000","last_change":"2024-04-18T10:45:47.735079+0000","last_active":"2024-04-18T10:45:47.735112+0000","last_peered":"2024-04-18T10:45:47.735112+0000","last_clean":"2024-04-18T10:45:47.735112+0000","last_became_active":"2024-04-18T10:38:48.523379+0000","last_became_peered":"2024-04-18T10:38:48.523379+0000","last_unstale":"2024-04-18T10:45:47.735112+0000","last_undegraded":"2024-04-18T10:45:47.735112+0000","last_fullsized":"2024-04-18T10:45:47.735112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'66","last_scrub_stamp":"2024-04-18T10:45:47.734973+0000","last_deep_scrub":"44'66","last_deep_scrub_stamp":"2024-04-18T10:45:47.734973+0000","last_clean_scrub_stamp":"2024-04-18T10:45:47.734973+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:42:54.985891+0000","scrub_duration":0.0017542289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"44'436","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:57.653310+0000","last_change":"2024-04-18T10:44:57.653280+0000","last_active":"2024-04-18T10:44:57.653310+0000","last_peered":"2024-04-18T10:44:57.653310+0000","last_clean":"2024-04-18T10:44:57.653310+0000","last_became_active":"2024-04-18T10:38:48.522444+0000","last_became_peered":"2024-04-18T10:38:48.522444+0000","last_unstale":"2024-04-18T10:44:57.653310+0000","last_undegraded":"2024-04-18T10:44:57.653310+0000","last_fullsized":"2024-04-18T10:44:57.653310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'436","last_scrub_stamp":"2024-04-18T10:44:57.653159+0000","last_deep_scrub":"44'436","last_deep_scrub_stamp":"2024-04-18T10:44:57.653159+0000","last_clean_scrub_stamp":"2024-04-18T10:44:57.653159+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:31:19.842593+0000","scrub_duration":0.002443579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10784,"num_write":400,"num_write_kb":79471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"44'75","reported_seq":129,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.009173+0000","last_change":"2024-04-18T10:44:28.009140+0000","last_active":"2024-04-18T10:44:28.009173+0000","last_peered":"2024-04-18T10:44:28.009173+0000","last_clean":"2024-04-18T10:44:28.009173+0000","last_became_active":"2024-04-18T10:38:46.524194+0000","last_became_peered":"2024-04-18T10:38:46.524194+0000","last_unstale":"2024-04-18T10:44:28.009173+0000","last_undegraded":"2024-04-18T10:44:28.009173+0000","last_fullsized":"2024-04-18T10:44:28.009173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'75","last_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_deep_scrub":"44'75","last_deep_scrub_stamp":"2024-04-18T10:44:28.009038+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.009038+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:08:03.526122+0000","scrub_duration":0.0053935800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"44'395","reported_seq":499,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:29.118675+0000","last_change":"2024-04-18T10:44:29.118645+0000","last_active":"2024-04-18T10:44:29.118675+0000","last_peered":"2024-04-18T10:44:29.118675+0000","last_clean":"2024-04-18T10:44:29.118675+0000","last_became_active":"2024-04-18T10:38:48.522541+0000","last_became_peered":"2024-04-18T10:38:48.522541+0000","last_unstale":"2024-04-18T10:44:29.118675+0000","last_undegraded":"2024-04-18T10:44:29.118675+0000","last_fullsized":"2024-04-18T10:44:29.118675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'395","last_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_deep_scrub":"44'395","last_deep_scrub_stamp":"2024-04-18T10:44:29.118542+0000","last_clean_scrub_stamp":"2024-04-18T10:44:29.118542+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:28:54.989556+0000","scrub_duration":0.0023004689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":26570,"num_write":368,"num_write_kb":67979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"44'253","reported_seq":299,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.557411+0000","last_change":"2024-04-18T10:44:24.557383+0000","last_active":"2024-04-18T10:44:24.557411+0000","last_peered":"2024-04-18T10:44:24.557411+0000","last_clean":"2024-04-18T10:44:24.557411+0000","last_became_active":"2024-04-18T10:38:46.522424+0000","last_became_peered":"2024-04-18T10:38:46.522424+0000","last_unstale":"2024-04-18T10:44:24.557411+0000","last_undegraded":"2024-04-18T10:44:24.557411+0000","last_fullsized":"2024-04-18T10:44:24.557411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'253","last_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_deep_scrub":"44'253","last_deep_scrub_stamp":"2024-04-18T10:44:24.557282+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.557282+0000","objects_scrubbed":2,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:50:13.889591+0000","scrub_duration":0.013433855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":188,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"44'412","reported_seq":487,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.066217+0000","last_change":"2024-04-18T10:44:42.066187+0000","last_active":"2024-04-18T10:44:42.066217+0000","last_peered":"2024-04-18T10:44:42.066217+0000","last_clean":"2024-04-18T10:44:42.066217+0000","last_became_active":"2024-04-18T10:38:48.524729+0000","last_became_peered":"2024-04-18T10:38:48.524729+0000","last_unstale":"2024-04-18T10:44:42.066217+0000","last_undegraded":"2024-04-18T10:44:42.066217+0000","last_fullsized":"2024-04-18T10:44:42.066217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:44:42.066068+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:44:42.066068+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.066068+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:04:45.048703+0000","scrub_duration":0.0023960040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":14530,"num_write":374,"num_write_kb":46700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"44'342","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.598760+0000","last_change":"2024-04-18T10:44:24.598713+0000","last_active":"2024-04-18T10:44:24.598760+0000","last_peered":"2024-04-18T10:44:24.598760+0000","last_clean":"2024-04-18T10:44:24.598760+0000","last_became_active":"2024-04-18T10:38:47.516219+0000","last_became_peered":"2024-04-18T10:38:47.516219+0000","last_unstale":"2024-04-18T10:44:24.598760+0000","last_undegraded":"2024-04-18T10:44:24.598760+0000","last_fullsized":"2024-04-18T10:44:24.598760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'342","last_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_deep_scrub":"44'342","last_deep_scrub_stamp":"2024-04-18T10:44:24.598616+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.598616+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:50:33.105351+0000","scrub_duration":0.013052151999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":286,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"44'435","reported_seq":516,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.025191+0000","last_change":"2024-04-18T10:44:24.025155+0000","last_active":"2024-04-18T10:44:24.025191+0000","last_peered":"2024-04-18T10:44:24.025191+0000","last_clean":"2024-04-18T10:44:24.025191+0000","last_became_active":"2024-04-18T10:38:48.537404+0000","last_became_peered":"2024-04-18T10:38:48.537404+0000","last_unstale":"2024-04-18T10:44:24.025191+0000","last_undegraded":"2024-04-18T10:44:24.025191+0000","last_fullsized":"2024-04-18T10:44:24.025191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'435","last_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_deep_scrub":"44'435","last_deep_scrub_stamp":"2024-04-18T10:44:24.025044+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.025044+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:01:05.200707+0000","scrub_duration":0.0023369929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19104,"num_write":407,"num_write_kb":50593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"44'567","reported_seq":619,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:01.893920+0000","last_change":"2024-04-18T10:45:01.893889+0000","last_active":"2024-04-18T10:45:01.893920+0000","last_peered":"2024-04-18T10:45:01.893920+0000","last_clean":"2024-04-18T10:45:01.893920+0000","last_became_active":"2024-04-18T10:38:48.526846+0000","last_became_peered":"2024-04-18T10:38:48.526846+0000","last_unstale":"2024-04-18T10:45:01.893920+0000","last_undegraded":"2024-04-18T10:45:01.893920+0000","last_fullsized":"2024-04-18T10:45:01.893920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'567","last_scrub_stamp":"2024-04-18T10:45:01.893786+0000","last_deep_scrub":"44'567","last_deep_scrub_stamp":"2024-04-18T10:45:01.893786+0000","last_clean_scrub_stamp":"2024-04-18T10:45:01.893786+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:16:59.051408+0000","scrub_duration":0.014192883999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":510,"num_write_kb":4345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"44'414","reported_seq":507,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:09.525196+0000","last_change":"2024-04-18T10:44:09.525165+0000","last_active":"2024-04-18T10:44:09.525196+0000","last_peered":"2024-04-18T10:44:09.525196+0000","last_clean":"2024-04-18T10:44:09.525196+0000","last_became_active":"2024-04-18T10:38:48.528516+0000","last_became_peered":"2024-04-18T10:38:48.528516+0000","last_unstale":"2024-04-18T10:44:09.525196+0000","last_undegraded":"2024-04-18T10:44:09.525196+0000","last_fullsized":"2024-04-18T10:44:09.525196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'414","last_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_deep_scrub":"44'414","last_deep_scrub_stamp":"2024-04-18T10:44:09.525069+0000","last_clean_scrub_stamp":"2024-04-18T10:44:09.525069+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:25:30.256844+0000","scrub_duration":0.002236264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27346,"num_write":387,"num_write_kb":59297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"44'60","reported_seq":107,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:08.605199+0000","last_change":"2024-04-18T10:44:08.605160+0000","last_active":"2024-04-18T10:44:08.605199+0000","last_peered":"2024-04-18T10:44:08.605199+0000","last_clean":"2024-04-18T10:44:08.605199+0000","last_became_active":"2024-04-18T10:38:48.527360+0000","last_became_peered":"2024-04-18T10:38:48.527360+0000","last_unstale":"2024-04-18T10:44:08.605199+0000","last_undegraded":"2024-04-18T10:44:08.605199+0000","last_fullsized":"2024-04-18T10:44:08.605199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'60","last_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_deep_scrub":"44'60","last_deep_scrub_stamp":"2024-04-18T10:44:08.605009+0000","last_clean_scrub_stamp":"2024-04-18T10:44:08.605009+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:45:04.374538+0000","scrub_duration":0.0018151350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"44'457","reported_seq":557,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:06.589224+0000","last_change":"2024-04-18T10:44:06.589194+0000","last_active":"2024-04-18T10:44:06.589224+0000","last_peered":"2024-04-18T10:44:06.589224+0000","last_clean":"2024-04-18T10:44:06.589224+0000","last_became_active":"2024-04-18T10:38:46.522326+0000","last_became_peered":"2024-04-18T10:38:46.522326+0000","last_unstale":"2024-04-18T10:44:06.589224+0000","last_undegraded":"2024-04-18T10:44:06.589224+0000","last_fullsized":"2024-04-18T10:44:06.589224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'457","last_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_deep_scrub":"44'457","last_deep_scrub_stamp":"2024-04-18T10:44:06.589080+0000","last_clean_scrub_stamp":"2024-04-18T10:44:06.589080+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:14:25.178162+0000","scrub_duration":0.0023982220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":33712,"num_write":424,"num_write_kb":92912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"44'174","reported_seq":230,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:06.893821+0000","last_change":"2024-04-18T10:45:06.893788+0000","last_active":"2024-04-18T10:45:06.893821+0000","last_peered":"2024-04-18T10:45:06.893821+0000","last_clean":"2024-04-18T10:45:06.893821+0000","last_became_active":"2024-04-18T10:38:48.522258+0000","last_became_peered":"2024-04-18T10:38:48.522258+0000","last_unstale":"2024-04-18T10:45:06.893821+0000","last_undegraded":"2024-04-18T10:45:06.893821+0000","last_fullsized":"2024-04-18T10:45:06.893821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'174","last_scrub_stamp":"2024-04-18T10:45:06.893675+0000","last_deep_scrub":"44'174","last_deep_scrub_stamp":"2024-04-18T10:45:06.893675+0000","last_clean_scrub_stamp":"2024-04-18T10:45:06.893675+0000","objects_scrubbed":4,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:43:51.820998+0000","scrub_duration":0.019093763,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":108,"num_write_kb":8244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"44'449","reported_seq":532,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:55.648293+0000","last_change":"2024-04-18T10:44:55.648252+0000","last_active":"2024-04-18T10:44:55.648293+0000","last_peered":"2024-04-18T10:44:55.648293+0000","last_clean":"2024-04-18T10:44:55.648293+0000","last_became_active":"2024-04-18T10:38:48.527676+0000","last_became_peered":"2024-04-18T10:38:48.527676+0000","last_unstale":"2024-04-18T10:44:55.648293+0000","last_undegraded":"2024-04-18T10:44:55.648293+0000","last_fullsized":"2024-04-18T10:44:55.648293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'449","last_scrub_stamp":"2024-04-18T10:44:55.648144+0000","last_deep_scrub":"44'449","last_deep_scrub_stamp":"2024-04-18T10:44:55.648144+0000","last_clean_scrub_stamp":"2024-04-18T10:44:55.648144+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:49:28.345804+0000","scrub_duration":0.002471123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":24886,"num_write":415,"num_write_kb":67654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"44'251","reported_seq":302,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:28.745402+0000","last_change":"2024-04-18T10:45:28.745362+0000","last_active":"2024-04-18T10:45:28.745402+0000","last_peered":"2024-04-18T10:45:28.745402+0000","last_clean":"2024-04-18T10:45:28.745402+0000","last_became_active":"2024-04-18T10:38:48.524542+0000","last_became_peered":"2024-04-18T10:38:48.524542+0000","last_unstale":"2024-04-18T10:45:28.745402+0000","last_undegraded":"2024-04-18T10:45:28.745402+0000","last_fullsized":"2024-04-18T10:45:28.745402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'251","last_scrub_stamp":"2024-04-18T10:45:28.745235+0000","last_deep_scrub":"44'251","last_deep_scrub_stamp":"2024-04-18T10:45:28.745235+0000","last_clean_scrub_stamp":"2024-04-18T10:45:28.745235+0000","objects_scrubbed":2,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:53:51.627035+0000","scrub_duration":0.013268103999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":182,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"44'412","reported_seq":494,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:38.838839+0000","last_change":"2024-04-18T10:45:38.838790+0000","last_active":"2024-04-18T10:45:38.838839+0000","last_peered":"2024-04-18T10:45:38.838839+0000","last_clean":"2024-04-18T10:45:38.838839+0000","last_became_active":"2024-04-18T10:38:48.525011+0000","last_became_peered":"2024-04-18T10:38:48.525011+0000","last_unstale":"2024-04-18T10:45:38.838839+0000","last_undegraded":"2024-04-18T10:45:38.838839+0000","last_fullsized":"2024-04-18T10:45:38.838839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'412","last_scrub_stamp":"2024-04-18T10:45:38.838650+0000","last_deep_scrub":"44'412","last_deep_scrub_stamp":"2024-04-18T10:45:38.838650+0000","last_clean_scrub_stamp":"2024-04-18T10:45:38.838650+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:32:02.434095+0000","scrub_duration":0.0024123880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":7892,"num_write":384,"num_write_kb":54977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"44'64","reported_seq":112,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:26.821286+0000","last_change":"2024-04-18T10:45:26.821244+0000","last_active":"2024-04-18T10:45:26.821286+0000","last_peered":"2024-04-18T10:45:26.821286+0000","last_clean":"2024-04-18T10:45:26.821286+0000","last_became_active":"2024-04-18T10:38:48.521220+0000","last_became_peered":"2024-04-18T10:38:48.521220+0000","last_unstale":"2024-04-18T10:45:26.821286+0000","last_undegraded":"2024-04-18T10:45:26.821286+0000","last_fullsized":"2024-04-18T10:45:26.821286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'64","last_scrub_stamp":"2024-04-18T10:45:26.821155+0000","last_deep_scrub":"44'64","last_deep_scrub_stamp":"2024-04-18T10:45:26.821155+0000","last_clean_scrub_stamp":"2024-04-18T10:45:26.821155+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:13:01.312926+0000","scrub_duration":0.0032513590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"44'354","reported_seq":415,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:53.715496+0000","last_change":"2024-04-18T10:44:53.715462+0000","last_active":"2024-04-18T10:44:53.715496+0000","last_peered":"2024-04-18T10:44:53.715496+0000","last_clean":"2024-04-18T10:44:53.715496+0000","last_became_active":"2024-04-18T10:38:48.528019+0000","last_became_peered":"2024-04-18T10:38:48.528019+0000","last_unstale":"2024-04-18T10:44:53.715496+0000","last_undegraded":"2024-04-18T10:44:53.715496+0000","last_fullsized":"2024-04-18T10:44:53.715496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'354","last_scrub_stamp":"2024-04-18T10:44:53.715355+0000","last_deep_scrub":"44'354","last_deep_scrub_stamp":"2024-04-18T10:44:53.715355+0000","last_clean_scrub_stamp":"2024-04-18T10:44:53.715355+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:08:56.971258+0000","scrub_duration":0.0023169520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9339,"num_write":318,"num_write_kb":34066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"44'494","reported_seq":545,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:34.750892+0000","last_change":"2024-04-18T10:45:34.750859+0000","last_active":"2024-04-18T10:45:34.750892+0000","last_peered":"2024-04-18T10:45:34.750892+0000","last_clean":"2024-04-18T10:45:34.750892+0000","last_became_active":"2024-04-18T10:38:48.525137+0000","last_became_peered":"2024-04-18T10:38:48.525137+0000","last_unstale":"2024-04-18T10:45:34.750892+0000","last_undegraded":"2024-04-18T10:45:34.750892+0000","last_fullsized":"2024-04-18T10:45:34.750892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'494","last_scrub_stamp":"2024-04-18T10:45:34.750760+0000","last_deep_scrub":"44'494","last_deep_scrub_stamp":"2024-04-18T10:45:34.750760+0000","last_clean_scrub_stamp":"2024-04-18T10:45:34.750760+0000","objects_scrubbed":2,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:49:16.447299+0000","scrub_duration":0.0145171,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":433,"num_write_kb":4284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"44'422","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:19.868810+0000","last_change":"2024-04-18T10:45:19.868780+0000","last_active":"2024-04-18T10:45:19.868810+0000","last_peered":"2024-04-18T10:45:19.868810+0000","last_clean":"2024-04-18T10:45:19.868810+0000","last_became_active":"2024-04-18T10:38:48.534988+0000","last_became_peered":"2024-04-18T10:38:48.534988+0000","last_unstale":"2024-04-18T10:45:19.868810+0000","last_undegraded":"2024-04-18T10:45:19.868810+0000","last_fullsized":"2024-04-18T10:45:19.868810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'422","last_scrub_stamp":"2024-04-18T10:45:19.868670+0000","last_deep_scrub":"44'422","last_deep_scrub_stamp":"2024-04-18T10:45:19.868670+0000","last_clean_scrub_stamp":"2024-04-18T10:45:19.868670+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:09:44.590398+0000","scrub_duration":0.0022748130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":35234,"num_write":390,"num_write_kb":108593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.876195+0000","last_change":"2024-04-18T10:44:42.876155+0000","last_active":"2024-04-18T10:44:42.876195+0000","last_peered":"2024-04-18T10:44:42.876195+0000","last_clean":"2024-04-18T10:44:42.876195+0000","last_became_active":"2024-04-18T10:38:46.521379+0000","last_became_peered":"2024-04-18T10:38:46.521379+0000","last_unstale":"2024-04-18T10:44:42.876195+0000","last_undegraded":"2024-04-18T10:44:42.876195+0000","last_fullsized":"2024-04-18T10:44:42.876195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:42.876035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:42.876035+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.876035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:35:02.831189+0000","scrub_duration":0.0014149329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"44'349","reported_seq":395,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.613083+0000","last_change":"2024-04-18T10:44:37.613042+0000","last_active":"2024-04-18T10:44:37.613083+0000","last_peered":"2024-04-18T10:44:37.613083+0000","last_clean":"2024-04-18T10:44:37.613083+0000","last_became_active":"2024-04-18T10:38:48.518392+0000","last_became_peered":"2024-04-18T10:38:48.518392+0000","last_unstale":"2024-04-18T10:44:37.613083+0000","last_undegraded":"2024-04-18T10:44:37.613083+0000","last_fullsized":"2024-04-18T10:44:37.613083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'349","last_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_deep_scrub":"44'349","last_deep_scrub_stamp":"2024-04-18T10:44:37.612936+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.612936+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:09:48.492165+0000","scrub_duration":0.014537654000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":4293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"44'351","reported_seq":411,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:48.862502+0000","last_change":"2024-04-18T10:44:48.862438+0000","last_active":"2024-04-18T10:44:48.862502+0000","last_peered":"2024-04-18T10:44:48.862502+0000","last_clean":"2024-04-18T10:44:48.862502+0000","last_became_active":"2024-04-18T10:38:48.529332+0000","last_became_peered":"2024-04-18T10:38:48.529332+0000","last_unstale":"2024-04-18T10:44:48.862502+0000","last_undegraded":"2024-04-18T10:44:48.862502+0000","last_fullsized":"2024-04-18T10:44:48.862502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:48.862336+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:48.862336+0000","last_clean_scrub_stamp":"2024-04-18T10:44:48.862336+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:48.226148+0000","scrub_duration":0.002153767,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":2641,"num_write":319,"num_write_kb":29576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.094073+0000","last_change":"2024-04-18T10:44:43.094046+0000","last_active":"2024-04-18T10:44:43.094073+0000","last_peered":"2024-04-18T10:44:43.094073+0000","last_clean":"2024-04-18T10:44:43.094073+0000","last_became_active":"2024-04-18T10:38:48.524890+0000","last_became_peered":"2024-04-18T10:38:48.524890+0000","last_unstale":"2024-04-18T10:44:43.094073+0000","last_undegraded":"2024-04-18T10:44:43.094073+0000","last_fullsized":"2024-04-18T10:44:43.094073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:43.093917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:43.093917+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.093917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:17:44.980892+0000","scrub_duration":0.001405737,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"44'72","reported_seq":122,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.533181+0000","last_change":"2024-04-18T10:44:19.533110+0000","last_active":"2024-04-18T10:44:19.533181+0000","last_peered":"2024-04-18T10:44:19.533181+0000","last_clean":"2024-04-18T10:44:19.533181+0000","last_became_active":"2024-04-18T10:38:47.513048+0000","last_became_peered":"2024-04-18T10:38:47.513048+0000","last_unstale":"2024-04-18T10:44:19.533181+0000","last_undegraded":"2024-04-18T10:44:19.533181+0000","last_fullsized":"2024-04-18T10:44:19.533181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'72","last_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_deep_scrub":"44'72","last_deep_scrub_stamp":"2024-04-18T10:44:19.533013+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.533013+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:08:26.074171+0000","scrub_duration":0.003923078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"44'386","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.114134+0000","last_change":"2024-04-18T10:44:19.114101+0000","last_active":"2024-04-18T10:44:19.114134+0000","last_peered":"2024-04-18T10:44:19.114134+0000","last_clean":"2024-04-18T10:44:19.114134+0000","last_became_active":"2024-04-18T10:38:47.514216+0000","last_became_peered":"2024-04-18T10:38:47.514216+0000","last_unstale":"2024-04-18T10:44:19.114134+0000","last_undegraded":"2024-04-18T10:44:19.114134+0000","last_fullsized":"2024-04-18T10:44:19.114134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.113999+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.113999+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:07:38.747202+0000","scrub_duration":0.002438047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":24934,"num_write":351,"num_write_kb":95834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:46.672262+0000","last_change":"2024-04-18T10:44:46.672227+0000","last_active":"2024-04-18T10:44:46.672262+0000","last_peered":"2024-04-18T10:44:46.672262+0000","last_clean":"2024-04-18T10:44:46.672262+0000","last_became_active":"2024-04-18T10:38:48.520605+0000","last_became_peered":"2024-04-18T10:38:48.520605+0000","last_unstale":"2024-04-18T10:44:46.672262+0000","last_undegraded":"2024-04-18T10:44:46.672262+0000","last_fullsized":"2024-04-18T10:44:46.672262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:46.672112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:46.672112+0000","last_clean_scrub_stamp":"2024-04-18T10:44:46.672112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:10:12.323516+0000","scrub_duration":0.0016045009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"44'435","reported_seq":481,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:15.907484+0000","last_change":"2024-04-18T10:45:15.907455+0000","last_active":"2024-04-18T10:45:15.907484+0000","last_peered":"2024-04-18T10:45:15.907484+0000","last_clean":"2024-04-18T10:45:15.907484+0000","last_became_active":"2024-04-18T10:38:47.519376+0000","last_became_peered":"2024-04-18T10:38:47.519376+0000","last_unstale":"2024-04-18T10:45:15.907484+0000","last_undegraded":"2024-04-18T10:45:15.907484+0000","last_fullsized":"2024-04-18T10:45:15.907484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'435","last_scrub_stamp":"2024-04-18T10:45:15.907356+0000","last_deep_scrub":"44'435","last_deep_scrub_stamp":"2024-04-18T10:45:15.907356+0000","last_clean_scrub_stamp":"2024-04-18T10:45:15.907356+0000","objects_scrubbed":2,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:34:07.092275+0000","scrub_duration":0.021374672000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":374,"num_write_kb":8353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"44'351","reported_seq":425,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.106706+0000","last_change":"2024-04-18T10:44:17.106676+0000","last_active":"2024-04-18T10:44:17.106706+0000","last_peered":"2024-04-18T10:44:17.106706+0000","last_clean":"2024-04-18T10:44:17.106706+0000","last_became_active":"2024-04-18T10:38:46.519897+0000","last_became_peered":"2024-04-18T10:38:46.519897+0000","last_unstale":"2024-04-18T10:44:17.106706+0000","last_undegraded":"2024-04-18T10:44:17.106706+0000","last_fullsized":"2024-04-18T10:44:17.106706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'351","last_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_deep_scrub":"44'351","last_deep_scrub_stamp":"2024-04-18T10:44:17.106562+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.106562+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:13:53.441711+0000","scrub_duration":0.0023480530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16512,"num_write":329,"num_write_kb":67182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:28.136129+0000","last_change":"2024-04-18T10:44:28.136098+0000","last_active":"2024-04-18T10:44:28.136129+0000","last_peered":"2024-04-18T10:44:28.136129+0000","last_clean":"2024-04-18T10:44:28.136129+0000","last_became_active":"2024-04-18T10:38:48.521958+0000","last_became_peered":"2024-04-18T10:38:48.521958+0000","last_unstale":"2024-04-18T10:44:28.136129+0000","last_undegraded":"2024-04-18T10:44:28.136129+0000","last_fullsized":"2024-04-18T10:44:28.136129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:28.135985+0000","last_clean_scrub_stamp":"2024-04-18T10:44:28.135985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:50:42.424822+0000","scrub_duration":0.001452168,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"44'117","reported_seq":207,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:36.000064+0000","last_change":"2024-04-18T10:44:36.000033+0000","last_active":"2024-04-18T10:44:36.000064+0000","last_peered":"2024-04-18T10:44:36.000064+0000","last_clean":"2024-04-18T10:44:36.000064+0000","last_became_active":"2024-04-18T10:38:46.507201+0000","last_became_peered":"2024-04-18T10:38:46.507201+0000","last_unstale":"2024-04-18T10:44:36.000064+0000","last_undegraded":"2024-04-18T10:44:36.000064+0000","last_fullsized":"2024-04-18T10:44:36.000064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'117","last_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_deep_scrub":"44'117","last_deep_scrub_stamp":"2024-04-18T10:44:35.999921+0000","last_clean_scrub_stamp":"2024-04-18T10:44:35.999921+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:41:44.891493+0000","scrub_duration":0.0075134060000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"44'528","reported_seq":576,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:22.794137+0000","last_change":"2024-04-18T10:45:22.794103+0000","last_active":"2024-04-18T10:45:22.794137+0000","last_peered":"2024-04-18T10:45:22.794137+0000","last_clean":"2024-04-18T10:45:22.794137+0000","last_became_active":"2024-04-18T10:38:48.519382+0000","last_became_peered":"2024-04-18T10:38:48.519382+0000","last_unstale":"2024-04-18T10:45:22.794137+0000","last_undegraded":"2024-04-18T10:45:22.794137+0000","last_fullsized":"2024-04-18T10:45:22.794137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'528","last_scrub_stamp":"2024-04-18T10:45:22.793980+0000","last_deep_scrub":"44'528","last_deep_scrub_stamp":"2024-04-18T10:45:22.793980+0000","last_clean_scrub_stamp":"2024-04-18T10:45:22.793980+0000","objects_scrubbed":2,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:11:35.670893+0000","scrub_duration":0.022897773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":8421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"44'446","reported_seq":552,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:46.745842+0000","last_change":"2024-04-18T10:45:46.745809+0000","last_active":"2024-04-18T10:45:46.745842+0000","last_peered":"2024-04-18T10:45:46.745842+0000","last_clean":"2024-04-18T10:45:46.745842+0000","last_became_active":"2024-04-18T10:38:48.524674+0000","last_became_peered":"2024-04-18T10:38:48.524674+0000","last_unstale":"2024-04-18T10:45:46.745842+0000","last_undegraded":"2024-04-18T10:45:46.745842+0000","last_fullsized":"2024-04-18T10:45:46.745842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'446","last_scrub_stamp":"2024-04-18T10:45:46.745676+0000","last_deep_scrub":"44'446","last_deep_scrub_stamp":"2024-04-18T10:45:46.745676+0000","last_clean_scrub_stamp":"2024-04-18T10:45:46.745676+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T10:47:45.408802+0000","scrub_duration":0.0019490130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":29643,"num_write":405,"num_write_kb":84723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:41.049096+0000","last_change":"2024-04-18T10:44:41.049065+0000","last_active":"2024-04-18T10:44:41.049096+0000","last_peered":"2024-04-18T10:44:41.049096+0000","last_clean":"2024-04-18T10:44:41.049096+0000","last_became_active":"2024-04-18T10:38:48.528629+0000","last_became_peered":"2024-04-18T10:38:48.528629+0000","last_unstale":"2024-04-18T10:44:41.049096+0000","last_undegraded":"2024-04-18T10:44:41.049096+0000","last_fullsized":"2024-04-18T10:44:41.049096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:41.048965+0000","last_clean_scrub_stamp":"2024-04-18T10:44:41.048965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:40:48.265478+0000","scrub_duration":0.001413037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"44'263","reported_seq":495,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:27.603509+0000","last_change":"2024-04-18T10:44:27.603480+0000","last_active":"2024-04-18T10:44:27.603509+0000","last_peered":"2024-04-18T10:44:27.603509+0000","last_clean":"2024-04-18T10:44:27.603509+0000","last_became_active":"2024-04-18T10:38:47.512987+0000","last_became_peered":"2024-04-18T10:38:47.512987+0000","last_unstale":"2024-04-18T10:44:27.603509+0000","last_undegraded":"2024-04-18T10:44:27.603509+0000","last_fullsized":"2024-04-18T10:44:27.603509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'263","last_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_deep_scrub":"44'263","last_deep_scrub_stamp":"2024-04-18T10:44:27.603367+0000","last_clean_scrub_stamp":"2024-04-18T10:44:27.603367+0000","objects_scrubbed":1,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T18:25:00.661142+0000","scrub_duration":0.006809715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471974,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":183,"num_read_kb":1556,"num_write":183,"num_write_kb":1556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"44'437","reported_seq":534,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.595841+0000","last_change":"2024-04-18T10:44:16.595810+0000","last_active":"2024-04-18T10:44:16.595841+0000","last_peered":"2024-04-18T10:44:16.595841+0000","last_clean":"2024-04-18T10:44:16.595841+0000","last_became_active":"2024-04-18T10:38:46.522893+0000","last_became_peered":"2024-04-18T10:38:46.522893+0000","last_unstale":"2024-04-18T10:44:16.595841+0000","last_undegraded":"2024-04-18T10:44:16.595841+0000","last_fullsized":"2024-04-18T10:44:16.595841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:44:16.595707+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.595707+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:45:47.126670+0000","scrub_duration":0.002372323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":30023,"num_write":405,"num_write_kb":79728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:37.099574+0000","last_change":"2024-04-18T10:44:37.099519+0000","last_active":"2024-04-18T10:44:37.099574+0000","last_peered":"2024-04-18T10:44:37.099574+0000","last_clean":"2024-04-18T10:44:37.099574+0000","last_became_active":"2024-04-18T10:38:48.523875+0000","last_became_peered":"2024-04-18T10:38:48.523875+0000","last_unstale":"2024-04-18T10:44:37.099574+0000","last_undegraded":"2024-04-18T10:44:37.099574+0000","last_fullsized":"2024-04-18T10:44:37.099574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:37.099405+0000","last_clean_scrub_stamp":"2024-04-18T10:44:37.099405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:38:12.361352+0000","scrub_duration":0.0015369120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"44'57","reported_seq":101,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:54.904082+0000","last_change":"2024-04-18T10:44:54.904049+0000","last_active":"2024-04-18T10:44:54.904082+0000","last_peered":"2024-04-18T10:44:54.904082+0000","last_clean":"2024-04-18T10:44:54.904082+0000","last_became_active":"2024-04-18T10:38:47.515104+0000","last_became_peered":"2024-04-18T10:38:47.515104+0000","last_unstale":"2024-04-18T10:44:54.904082+0000","last_undegraded":"2024-04-18T10:44:54.904082+0000","last_fullsized":"2024-04-18T10:44:54.904082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'57","last_scrub_stamp":"2024-04-18T10:44:54.903953+0000","last_deep_scrub":"44'57","last_deep_scrub_stamp":"2024-04-18T10:44:54.903953+0000","last_clean_scrub_stamp":"2024-04-18T10:44:54.903953+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:44:38.000312+0000","scrub_duration":0.00156953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"44'430","reported_seq":527,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:20.572462+0000","last_change":"2024-04-18T10:44:20.572430+0000","last_active":"2024-04-18T10:44:20.572462+0000","last_peered":"2024-04-18T10:44:20.572462+0000","last_clean":"2024-04-18T10:44:20.572462+0000","last_became_active":"2024-04-18T10:38:47.513007+0000","last_became_peered":"2024-04-18T10:38:47.513007+0000","last_unstale":"2024-04-18T10:44:20.572462+0000","last_undegraded":"2024-04-18T10:44:20.572462+0000","last_fullsized":"2024-04-18T10:44:20.572462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:44:20.572320+0000","last_clean_scrub_stamp":"2024-04-18T10:44:20.572320+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:37:05.780336+0000","scrub_duration":0.0024798110000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":19476,"num_write":402,"num_write_kb":92408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"44'64","reported_seq":116,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:21.293206+0000","last_change":"2024-04-18T10:44:21.293174+0000","last_active":"2024-04-18T10:44:21.293206+0000","last_peered":"2024-04-18T10:44:21.293206+0000","last_clean":"2024-04-18T10:44:21.293206+0000","last_became_active":"2024-04-18T10:38:48.522892+0000","last_became_peered":"2024-04-18T10:38:48.522892+0000","last_unstale":"2024-04-18T10:44:21.293206+0000","last_undegraded":"2024-04-18T10:44:21.293206+0000","last_fullsized":"2024-04-18T10:44:21.293206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'64","last_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_deep_scrub":"44'64","last_deep_scrub_stamp":"2024-04-18T10:44:21.293058+0000","last_clean_scrub_stamp":"2024-04-18T10:44:21.293058+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:06:02.602650+0000","scrub_duration":0.0072041329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:16.116265+0000","last_change":"2024-04-18T10:44:16.116227+0000","last_active":"2024-04-18T10:44:16.116265+0000","last_peered":"2024-04-18T10:44:16.116265+0000","last_clean":"2024-04-18T10:44:16.116265+0000","last_became_active":"2024-04-18T10:38:46.521420+0000","last_became_peered":"2024-04-18T10:38:46.521420+0000","last_unstale":"2024-04-18T10:44:16.116265+0000","last_undegraded":"2024-04-18T10:44:16.116265+0000","last_fullsized":"2024-04-18T10:44:16.116265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:16.116120+0000","last_clean_scrub_stamp":"2024-04-18T10:44:16.116120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T15:38:35.456110+0000","scrub_duration":0.001526194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"44'420","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:27.775327+0000","last_change":"2024-04-18T10:45:27.775294+0000","last_active":"2024-04-18T10:45:27.775327+0000","last_peered":"2024-04-18T10:45:27.775327+0000","last_clean":"2024-04-18T10:45:27.775327+0000","last_became_active":"2024-04-18T10:38:48.525391+0000","last_became_peered":"2024-04-18T10:38:48.525391+0000","last_unstale":"2024-04-18T10:45:27.775327+0000","last_undegraded":"2024-04-18T10:45:27.775327+0000","last_fullsized":"2024-04-18T10:45:27.775327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'420","last_scrub_stamp":"2024-04-18T10:45:27.775174+0000","last_deep_scrub":"44'420","last_deep_scrub_stamp":"2024-04-18T10:45:27.775174+0000","last_clean_scrub_stamp":"2024-04-18T10:45:27.775174+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:09:08.958167+0000","scrub_duration":0.0024068140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":7554,"num_write":390,"num_write_kb":67504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:26.163325+0000","last_change":"2024-04-18T10:44:26.163296+0000","last_active":"2024-04-18T10:44:26.163325+0000","last_peered":"2024-04-18T10:44:26.163325+0000","last_clean":"2024-04-18T10:44:26.163325+0000","last_became_active":"2024-04-18T10:38:48.517621+0000","last_became_peered":"2024-04-18T10:38:48.517621+0000","last_unstale":"2024-04-18T10:44:26.163325+0000","last_undegraded":"2024-04-18T10:44:26.163325+0000","last_fullsized":"2024-04-18T10:44:26.163325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-18T10:44:26.163155+0000","last_clean_scrub_stamp":"2024-04-18T10:44:26.163155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:41:33.487472+0000","scrub_duration":0.001544494,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"44'83","reported_seq":131,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:14.630059+0000","last_change":"2024-04-18T10:44:14.630013+0000","last_active":"2024-04-18T10:44:14.630059+0000","last_peered":"2024-04-18T10:44:14.630059+0000","last_clean":"2024-04-18T10:44:14.630059+0000","last_became_active":"2024-04-18T10:38:46.523469+0000","last_became_peered":"2024-04-18T10:38:46.523469+0000","last_unstale":"2024-04-18T10:44:14.630059+0000","last_undegraded":"2024-04-18T10:44:14.630059+0000","last_fullsized":"2024-04-18T10:44:14.630059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'83","last_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_deep_scrub":"44'83","last_deep_scrub_stamp":"2024-04-18T10:44:14.629894+0000","last_clean_scrub_stamp":"2024-04-18T10:44:14.629894+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:04:39.848103+0000","scrub_duration":0.0054998199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"44'377","reported_seq":457,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:15.610348+0000","last_change":"2024-04-18T10:44:15.610317+0000","last_active":"2024-04-18T10:44:15.610348+0000","last_peered":"2024-04-18T10:44:15.610348+0000","last_clean":"2024-04-18T10:44:15.610348+0000","last_became_active":"2024-04-18T10:38:48.520237+0000","last_became_peered":"2024-04-18T10:38:48.520237+0000","last_unstale":"2024-04-18T10:44:15.610348+0000","last_undegraded":"2024-04-18T10:44:15.610348+0000","last_fullsized":"2024-04-18T10:44:15.610348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'377","last_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_deep_scrub":"44'377","last_deep_scrub_stamp":"2024-04-18T10:44:15.610194+0000","last_clean_scrub_stamp":"2024-04-18T10:44:15.610194+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:21:45.794459+0000","scrub_duration":0.0023276400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":15019,"num_write":349,"num_write_kb":71367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"44'75","reported_seq":125,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:43.685768+0000","last_change":"2024-04-18T10:44:43.685728+0000","last_active":"2024-04-18T10:44:43.685768+0000","last_peered":"2024-04-18T10:44:43.685768+0000","last_clean":"2024-04-18T10:44:43.685768+0000","last_became_active":"2024-04-18T10:38:48.527539+0000","last_became_peered":"2024-04-18T10:38:48.527539+0000","last_unstale":"2024-04-18T10:44:43.685768+0000","last_undegraded":"2024-04-18T10:44:43.685768+0000","last_fullsized":"2024-04-18T10:44:43.685768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'75","last_scrub_stamp":"2024-04-18T10:44:43.685630+0000","last_deep_scrub":"44'75","last_deep_scrub_stamp":"2024-04-18T10:44:43.685630+0000","last_clean_scrub_stamp":"2024-04-18T10:44:43.685630+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:19:47.619608+0000","scrub_duration":0.011221696999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"44'384","reported_seq":452,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:48.710591+0000","last_change":"2024-04-18T10:44:48.710558+0000","last_active":"2024-04-18T10:44:48.710591+0000","last_peered":"2024-04-18T10:44:48.710591+0000","last_clean":"2024-04-18T10:44:48.710591+0000","last_became_active":"2024-04-18T10:38:47.514061+0000","last_became_peered":"2024-04-18T10:38:47.514061+0000","last_unstale":"2024-04-18T10:44:48.710591+0000","last_undegraded":"2024-04-18T10:44:48.710591+0000","last_fullsized":"2024-04-18T10:44:48.710591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'384","last_scrub_stamp":"2024-04-18T10:44:48.710451+0000","last_deep_scrub":"44'384","last_deep_scrub_stamp":"2024-04-18T10:44:48.710451+0000","last_clean_scrub_stamp":"2024-04-18T10:44:48.710451+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:03:14.715697+0000","scrub_duration":0.0024035810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":9536,"num_write":350,"num_write_kb":55410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"44'345","reported_seq":396,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:40.861394+0000","last_change":"2024-04-18T10:44:40.861354+0000","last_active":"2024-04-18T10:44:40.861394+0000","last_peered":"2024-04-18T10:44:40.861394+0000","last_clean":"2024-04-18T10:44:40.861394+0000","last_became_active":"2024-04-18T10:38:46.519964+0000","last_became_peered":"2024-04-18T10:38:46.519964+0000","last_unstale":"2024-04-18T10:44:40.861394+0000","last_undegraded":"2024-04-18T10:44:40.861394+0000","last_fullsized":"2024-04-18T10:44:40.861394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'345","last_scrub_stamp":"2024-04-18T10:44:40.861207+0000","last_deep_scrub":"44'345","last_deep_scrub_stamp":"2024-04-18T10:44:40.861207+0000","last_clean_scrub_stamp":"2024-04-18T10:44:40.861207+0000","objects_scrubbed":2,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T22:42:35.225739+0000","scrub_duration":0.01437416,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":294,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"44'352","reported_seq":420,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:10.529301+0000","last_change":"2024-04-18T10:44:10.529249+0000","last_active":"2024-04-18T10:44:10.529301+0000","last_peered":"2024-04-18T10:44:10.529301+0000","last_clean":"2024-04-18T10:44:10.529301+0000","last_became_active":"2024-04-18T10:38:48.527548+0000","last_became_peered":"2024-04-18T10:38:48.527548+0000","last_unstale":"2024-04-18T10:44:10.529301+0000","last_undegraded":"2024-04-18T10:44:10.529301+0000","last_fullsized":"2024-04-18T10:44:10.529301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'352","last_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_deep_scrub":"44'352","last_deep_scrub_stamp":"2024-04-18T10:44:10.529127+0000","last_clean_scrub_stamp":"2024-04-18T10:44:10.529127+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T20:12:28.231944+0000","scrub_duration":0.0022035800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":4294,"num_write":323,"num_write_kb":13464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"44'291","reported_seq":347,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:17.377930+0000","last_change":"2024-04-18T10:44:17.377889+0000","last_active":"2024-04-18T10:44:17.377930+0000","last_peered":"2024-04-18T10:44:17.377930+0000","last_clean":"2024-04-18T10:44:17.377930+0000","last_became_active":"2024-04-18T10:38:48.523977+0000","last_became_peered":"2024-04-18T10:38:48.523977+0000","last_unstale":"2024-04-18T10:44:17.377930+0000","last_undegraded":"2024-04-18T10:44:17.377930+0000","last_fullsized":"2024-04-18T10:44:17.377930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'291","last_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_deep_scrub":"44'291","last_deep_scrub_stamp":"2024-04-18T10:44:17.377743+0000","last_clean_scrub_stamp":"2024-04-18T10:44:17.377743+0000","objects_scrubbed":4,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T13:00:37.743454+0000","scrub_duration":0.030049699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":222,"num_write_kb":12426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"44'386","reported_seq":477,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:19.575444+0000","last_change":"2024-04-18T10:44:19.575417+0000","last_active":"2024-04-18T10:44:19.575444+0000","last_peered":"2024-04-18T10:44:19.575444+0000","last_clean":"2024-04-18T10:44:19.575444+0000","last_became_active":"2024-04-18T10:39:29.508102+0000","last_became_peered":"2024-04-18T10:39:29.508102+0000","last_unstale":"2024-04-18T10:44:19.575444+0000","last_undegraded":"2024-04-18T10:44:19.575444+0000","last_fullsized":"2024-04-18T10:44:19.575444+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'386","last_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_deep_scrub":"44'386","last_deep_scrub_stamp":"2024-04-18T10:44:19.575311+0000","last_clean_scrub_stamp":"2024-04-18T10:44:19.575311+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T21:47:55.784007+0000","scrub_duration":0.0020110480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":21484,"num_write":355,"num_write_kb":58531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"44'111","reported_seq":159,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:19.793503+0000","last_change":"2024-04-18T10:45:19.793453+0000","last_active":"2024-04-18T10:45:19.793503+0000","last_peered":"2024-04-18T10:45:19.793503+0000","last_clean":"2024-04-18T10:45:19.793503+0000","last_became_active":"2024-04-18T10:38:48.517945+0000","last_became_peered":"2024-04-18T10:38:48.517945+0000","last_unstale":"2024-04-18T10:45:19.793503+0000","last_undegraded":"2024-04-18T10:45:19.793503+0000","last_fullsized":"2024-04-18T10:45:19.793503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'111","last_scrub_stamp":"2024-04-18T10:45:19.793343+0000","last_deep_scrub":"44'111","last_deep_scrub_stamp":"2024-04-18T10:45:19.793343+0000","last_clean_scrub_stamp":"2024-04-18T10:45:19.793343+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T19:20:42.163995+0000","scrub_duration":0.010971541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"44'437","reported_seq":526,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:31.689206+0000","last_change":"2024-04-18T10:45:31.689169+0000","last_active":"2024-04-18T10:45:31.689206+0000","last_peered":"2024-04-18T10:45:31.689206+0000","last_clean":"2024-04-18T10:45:31.689206+0000","last_became_active":"2024-04-18T10:38:48.520281+0000","last_became_peered":"2024-04-18T10:38:48.520281+0000","last_unstale":"2024-04-18T10:45:31.689206+0000","last_undegraded":"2024-04-18T10:45:31.689206+0000","last_fullsized":"2024-04-18T10:45:31.689206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'437","last_scrub_stamp":"2024-04-18T10:45:31.689047+0000","last_deep_scrub":"44'437","last_deep_scrub_stamp":"2024-04-18T10:45:31.689047+0000","last_clean_scrub_stamp":"2024-04-18T10:45:31.689047+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:06:43.932547+0000","scrub_duration":0.0024883850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":21869,"num_write":408,"num_write_kb":92290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"44'102","reported_seq":146,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:34.622673+0000","last_change":"2024-04-18T10:44:34.622627+0000","last_active":"2024-04-18T10:44:34.622673+0000","last_peered":"2024-04-18T10:44:34.622673+0000","last_clean":"2024-04-18T10:44:34.622673+0000","last_became_active":"2024-04-18T10:38:46.523109+0000","last_became_peered":"2024-04-18T10:38:46.523109+0000","last_unstale":"2024-04-18T10:44:34.622673+0000","last_undegraded":"2024-04-18T10:44:34.622673+0000","last_fullsized":"2024-04-18T10:44:34.622673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'102","last_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_deep_scrub":"44'102","last_deep_scrub_stamp":"2024-04-18T10:44:34.622522+0000","last_clean_scrub_stamp":"2024-04-18T10:44:34.622522+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T12:53:16.158696+0000","scrub_duration":0.012842098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":51,"num_write_kb":4124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"44'432","reported_seq":520,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:39.658970+0000","last_change":"2024-04-18T10:44:39.658938+0000","last_active":"2024-04-18T10:44:39.658970+0000","last_peered":"2024-04-18T10:44:39.658970+0000","last_clean":"2024-04-18T10:44:39.658970+0000","last_became_active":"2024-04-18T10:38:47.514108+0000","last_became_peered":"2024-04-18T10:38:47.514108+0000","last_unstale":"2024-04-18T10:44:39.658970+0000","last_undegraded":"2024-04-18T10:44:39.658970+0000","last_fullsized":"2024-04-18T10:44:39.658970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'432","last_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_deep_scrub":"44'432","last_deep_scrub_stamp":"2024-04-18T10:44:39.658831+0000","last_clean_scrub_stamp":"2024-04-18T10:44:39.658831+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T17:58:08.433321+0000","scrub_duration":0.0024322020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":14533,"num_write":399,"num_write_kb":51403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"44'430","reported_seq":510,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:45:05.946782+0000","last_change":"2024-04-18T10:45:05.946758+0000","last_active":"2024-04-18T10:45:05.946782+0000","last_peered":"2024-04-18T10:45:05.946782+0000","last_clean":"2024-04-18T10:45:05.946782+0000","last_became_active":"2024-04-18T10:38:47.514747+0000","last_became_peered":"2024-04-18T10:38:47.514747+0000","last_unstale":"2024-04-18T10:45:05.946782+0000","last_undegraded":"2024-04-18T10:45:05.946782+0000","last_fullsized":"2024-04-18T10:45:05.946782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'430","last_scrub_stamp":"2024-04-18T10:45:05.946653+0000","last_deep_scrub":"44'430","last_deep_scrub_stamp":"2024-04-18T10:45:05.946653+0000","last_clean_scrub_stamp":"2024-04-18T10:45:05.946653+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:59:36.714123+0000","scrub_duration":0.002118937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":22307,"num_write":399,"num_write_kb":48195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"44'408","reported_seq":449,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:58.675440+0000","last_change":"2024-04-18T10:44:58.675399+0000","last_active":"2024-04-18T10:44:58.675440+0000","last_peered":"2024-04-18T10:44:58.675440+0000","last_clean":"2024-04-18T10:44:58.675440+0000","last_became_active":"2024-04-18T10:39:29.506240+0000","last_became_peered":"2024-04-18T10:39:29.506240+0000","last_unstale":"2024-04-18T10:44:58.675440+0000","last_undegraded":"2024-04-18T10:44:58.675440+0000","last_fullsized":"2024-04-18T10:44:58.675440+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'408","last_scrub_stamp":"2024-04-18T10:44:58.675288+0000","last_deep_scrub":"44'408","last_deep_scrub_stamp":"2024-04-18T10:44:58.675288+0000","last_clean_scrub_stamp":"2024-04-18T10:44:58.675288+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T11:11:15.241591+0000","scrub_duration":0.0022547029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":13080,"num_write":378,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"44'470","reported_seq":575,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:42.634081+0000","last_change":"2024-04-18T10:44:42.634050+0000","last_active":"2024-04-18T10:44:42.634081+0000","last_peered":"2024-04-18T10:44:42.634081+0000","last_clean":"2024-04-18T10:44:42.634081+0000","last_became_active":"2024-04-18T10:38:48.530359+0000","last_became_peered":"2024-04-18T10:38:48.530359+0000","last_unstale":"2024-04-18T10:44:42.634081+0000","last_undegraded":"2024-04-18T10:44:42.634081+0000","last_fullsized":"2024-04-18T10:44:42.634081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'470","last_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_deep_scrub":"44'470","last_deep_scrub_stamp":"2024-04-18T10:44:42.633943+0000","last_clean_scrub_stamp":"2024-04-18T10:44:42.633943+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T16:34:03.702154+0000","scrub_duration":0.0025497570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":27546,"num_write":433,"num_write_kb":71207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"44'396","reported_seq":497,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:24.195348+0000","last_change":"2024-04-18T10:44:24.195320+0000","last_active":"2024-04-18T10:44:24.195348+0000","last_peered":"2024-04-18T10:44:24.195348+0000","last_clean":"2024-04-18T10:44:24.195348+0000","last_became_active":"2024-04-18T10:38:48.527830+0000","last_became_peered":"2024-04-18T10:38:48.527830+0000","last_unstale":"2024-04-18T10:44:24.195348+0000","last_undegraded":"2024-04-18T10:44:24.195348+0000","last_fullsized":"2024-04-18T10:44:24.195348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'396","last_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_deep_scrub":"44'396","last_deep_scrub_stamp":"2024-04-18T10:44:24.195206+0000","last_clean_scrub_stamp":"2024-04-18T10:44:24.195206+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:51:24.563147+0000","scrub_duration":0.0022383659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23473,"num_write":370,"num_write_kb":63197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"44'402","reported_seq":508,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-18T10:44:51.884469+0000","last_change":"2024-04-18T10:44:51.884431+0000","last_active":"2024-04-18T10:44:51.884469+0000","last_peered":"2024-04-18T10:44:51.884469+0000","last_clean":"2024-04-18T10:44:51.884469+0000","last_became_active":"2024-04-18T10:38:47.514271+0000","last_became_peered":"2024-04-18T10:38:47.514271+0000","last_unstale":"2024-04-18T10:44:51.884469+0000","last_undegraded":"2024-04-18T10:44:51.884469+0000","last_fullsized":"2024-04-18T10:44:51.884469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'402","last_scrub_stamp":"2024-04-18T10:44:51.884312+0000","last_deep_scrub":"44'402","last_deep_scrub_stamp":"2024-04-18T10:44:51.884312+0000","last_clean_scrub_stamp":"2024-04-18T10:44:51.884312+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T14:06:33.666434+0000","scrub_duration":0.0022388320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29453,"num_write":373,"num_write_kb":88143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2826,"num_read_kb":1474851,"num_write":24425,"num_write_kb":4260614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26465,"ondisk_log_size":26465,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":130108271,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":232,"num_read_kb":1611,"num_write":6672,"num_write_kb":131681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":260325376,"data_stored":260216542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":41256,"internal_metadata":0},"log_size":8567,"ondisk_log_size":8567,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953561,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394640,"kb_used_data":89160,"kb_used_omap":13,"kb_used_meta":305458,"kb_avail":93977200,"statfs":{"total":96636764160,"available":96232652800,"internally_reserved":0,"allocated":91299840,"data_stored":91054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13575,"internal_metadata":312789753},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.36799999999999999},"min":{"1min":0.248,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.46400000000000002,"5min":3.7429999999999999,"15min":3.7429999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.35999999999999999,"15min":0.38100000000000001},"min":{"1min":0.24399999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.49399999999999999,"5min":1.732,"15min":1.732},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.40300000000000002,"15min":0.41699999999999998},"min":{"1min":0.28499999999999998,"5min":0.184,"15min":0.184},"max":{"1min":0.51900000000000002,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.38200000000000001},"min":{"1min":0.29599999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.57899999999999996},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Apr 18 10:44:58 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38800000000000001,"15min":0.42599999999999999},"min":{"1min":0.32100000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.5,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.501},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.434},"min":{"1min":0.29499999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.54400000000000004,"5min":4.181,"15min":4.181},"last":0.51100000000000001}]}]},{"osd":2,"up_from":31,"seq":133143986266,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367316,"kb_used_data":57804,"kb_used_omap":7,"kb_used_meta":309496,"kb_avail":94004524,"statfs":{"total":96636764160,"available":96260632576,"internally_reserved":0,"allocated":59191296,"data_stored":58968726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":316924695},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:45:03 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.23000000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.51800000000000002,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.36399999999999999},"min":{"1min":0.26700000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.57199999999999995,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.5}]},{"osd":1,"last update":"Thu Apr 18 10:45:03 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.35099999999999998,"15min":0.38},"min":{"1min":0.29399999999999998,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60999999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.39900000000000002},"min":{"1min":0.27000000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57399999999999995,"5min":1.53,"15min":1.53},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Apr 18 10:45:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.374,"15min":0.40500000000000003},"min":{"1min":0.34799999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.42999999999999999},"min":{"1min":0.28899999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.623,"5min":1.49,"15min":1.49},"last":0.58799999999999997}]}]},{"osd":0,"up_from":29,"seq":124554051674,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369396,"kb_used_data":59756,"kb_used_omap":17,"kb_used_meta":309614,"kb_avail":94002444,"statfs":{"total":96636764160,"available":96258502656,"internally_reserved":0,"allocated":61190144,"data_stored":60953463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":317045050},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 18 10:46:02 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.36099999999999999,"15min":0.34100000000000003},"min":{"1min":0.23799999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.56000000000000005,"5min":1.002,"15min":1.002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.35199999999999998},"min":{"1min":0.26600000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57799999999999996,"5min":1.224,"15min":1.224},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Apr 18 10:46:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40000000000000002,"15min":0.36599999999999999},"min":{"1min":0.29399999999999998,"5min":0.19,"15min":0.19},"max":{"1min":0.48899999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.313,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53400000000000003,"5min":1.173,"15min":1.173},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Apr 18 10:46:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.38500000000000001,"15min":0.41499999999999998},"min":{"1min":0.29899999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.55700000000000005,"5min":0.879,"15min":1.204},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.435,"15min":0.501},"min":{"1min":0.32300000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.61499999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.51700000000000002}]}]},{"osd":1,"up_from":30,"seq":128849018970,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351488,"kb_used_data":50104,"kb_used_omap":6,"kb_used_meta":301369,"kb_avail":94020352,"statfs":{"total":96636764160,"available":96276840448,"internally_reserved":0,"allocated":51306496,"data_stored":51089940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":308602837},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 18 10:46:00 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.34699999999999998},"min":{"1min":0.19700000000000001,"5min":0.153,"15min":0.153},"max":{"1min":0.435,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.372},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.34200000000000003,"15min":0.35999999999999999},"min":{"1min":0.23799999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Apr 18 10:46:00 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.373,"15min":0.37},"min":{"1min":0.25600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48699999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.371,"15min":0.38700000000000001},"min":{"1min":0.27800000000000002,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.52000000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Apr 18 10:46:00 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36699999999999999,"15min":0.371},"min":{"1min":0.26700000000000002,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45200000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.29199999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.502,"5min":2.173,"15min":2.173},"last":0.48999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60227584,"data_stored":60195816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18118,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6187,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58822656,"data_stored":58801447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7401,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90931200,"data_stored":90886986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9550,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-18T10:46:07.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-18T10:46:07.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.305+0000 7fcfb81af700 1 Processor -- start 2024-04-18T10:46:07.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.305+0000 7fcfb81af700 1 -- start start 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb81af700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb006ecf0 0x7fcfb00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb81af700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb00a6d60 0x7fcfb0142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb81af700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfb00a7130 0x7fcfb01450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb81af700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00a3540 con 0x7fcfb00a7130 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb81af700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00a37e0 con 0x7fcfb00a6d60 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb81af700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00a5d60 con 0x7fcfb006ecf0 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb5f4b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb006ecf0 0x7fcfb00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb574a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb00a6d60 0x7fcfb0142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb674c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfb00a7130 0x7fcfb01450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb5f4b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb006ecf0 0x7fcfb00a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49266/0 (socket says 172.21.15.31:49266) 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb574a700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb00a6d60 0x7fcfb0142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38248/0 (socket says 172.21.15.31:38248) 2024-04-18T10:46:07.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb674c700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcfb00a7130 0x7fcfb01450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51804/0 (socket says 172.21.15.31:51804) 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb5f4b700 1 -- 172.21.15.31:0/3164013639 learned_addr learned my addr 172.21.15.31:0/3164013639 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb5f4b700 1 -- 172.21.15.31:0/3164013639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb00a6d60 msgr2=0x7fcfb0142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb5f4b700 1 --2- 172.21.15.31:0/3164013639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb00a6d60 0x7fcfb0142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb5f4b700 1 -- 172.21.15.31:0/3164013639 >> v2:172.21.15.31:3300/0 conn(0x7fcfb00a7130 msgr2=0x7fcfb01450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb5f4b700 1 --2- 172.21.15.31:0/3164013639 >> v2:172.21.15.31:3300/0 conn(0x7fcfb00a7130 0x7fcfb01450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb5f4b700 1 -- 172.21.15.31:0/3164013639 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb006d980 con 0x7fcfb006ecf0 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb674c700 1 --2- 172.21.15.31:0/3164013639 >> v2:172.21.15.31:3300/0 conn(0x7fcfb00a7130 0x7fcfb01450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.306+0000 7fcfb574a700 1 --2- 172.21.15.31:0/3164013639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb00a6d60 0x7fcfb0142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb5f4b700 1 --2- 172.21.15.31:0/3164013639 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb006ecf0 0x7fcfb00a5260 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00099b0 tx=0x7fcfa0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3686c102b7e216e server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb4f49700 1 -- 172.21.15.31:0/3164013639 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000b680 con 0x7fcfb006ecf0 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb4f49700 1 -- 172.21.15.31:0/3164013639 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa000b7e0 con 0x7fcfb006ecf0 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb4f49700 1 -- 172.21.15.31:0/3164013639 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000bb80 con 0x7fcfb006ecf0 2024-04-18T10:46:07.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb81af700 1 -- 172.21.15.31:0/3164013639 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb006ecf0 msgr2=0x7fcfb00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb81af700 1 --2- 172.21.15.31:0/3164013639 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb006ecf0 0x7fcfb00a5260 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00099b0 tx=0x7fcfa0009250 comp rx=0 tx=0).stop 2024-04-18T10:46:07.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb81af700 1 -- 172.21.15.31:0/3164013639 shutdown_connections 2024-04-18T10:46:07.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb81af700 1 --2- 172.21.15.31:0/3164013639 >> v2:172.21.15.31:3300/0 conn(0x7fcfb00a7130 0x7fcfb01450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb81af700 1 --2- 172.21.15.31:0/3164013639 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb006ecf0 0x7fcfb00a5260 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb81af700 1 --2- 172.21.15.31:0/3164013639 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb00a6d60 0x7fcfb0142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb81af700 1 -- 172.21.15.31:0/3164013639 >> 172.21.15.31:0/3164013639 conn(0x7fcfb00679e0 msgr2=0x7fcfb0067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:07.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb81af700 1 -- 172.21.15.31:0/3164013639 shutdown_connections 2024-04-18T10:46:07.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.307+0000 7fcfb81af700 1 -- 172.21.15.31:0/3164013639 wait complete. 2024-04-18T10:46:07.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.308+0000 7fcfb81af700 1 Processor -- start 2024-04-18T10:46:07.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.308+0000 7fcfb81af700 1 -- start start 2024-04-18T10:46:07.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb81af700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb006ecf0 0x7fcfb00aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb81af700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb00a6d60 0x7fcfb00977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb81af700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb00a7130 0x7fcfb0098c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb81af700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00adaf0 con 0x7fcfb00a7130 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb81af700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0149610 con 0x7fcfb006ecf0 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb81af700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0149870 con 0x7fcfb00a6d60 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb574a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb00a6d60 0x7fcfb00977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb5f4b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb006ecf0 0x7fcfb00aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb674c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb00a7130 0x7fcfb0098c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb574a700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb00a6d60 0x7fcfb00977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49276/0 (socket says 172.21.15.31:49276) 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb5f4b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb006ecf0 0x7fcfb00aed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38262/0 (socket says 172.21.15.31:38262) 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb574a700 1 -- 172.21.15.31:0/435983869 learned_addr learned my addr 172.21.15.31:0/435983869 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb674c700 1 -- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb00a6d60 msgr2=0x7fcfb00977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb674c700 1 --2- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb00a6d60 0x7fcfb00977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb674c700 1 -- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb006ecf0 msgr2=0x7fcfb00aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb674c700 1 --2- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb006ecf0 0x7fcfb00aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb674c700 1 -- 172.21.15.31:0/435983869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac009420 con 0x7fcfb00a7130 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb574a700 1 --2- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb00a6d60 0x7fcfb00977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb5f4b700 1 --2- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb006ecf0 0x7fcfb00aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.309+0000 7fcfb674c700 1 --2- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb00a7130 0x7fcfb0098c70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00a7580 tx=0x7fcfa800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.310+0000 7fcfa5ffb700 1 -- 172.21.15.31:0/435983869 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8012ea0 con 0x7fcfb00a7130 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.310+0000 7fcfa5ffb700 1 -- 172.21.15.31:0/435983869 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8013040 con 0x7fcfb00a7130 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.310+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa800de30 con 0x7fcfb00a7130 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.310+0000 7fcfa5ffb700 1 -- 172.21.15.31:0/435983869 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa800d300 con 0x7fcfb00a7130 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.310+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa00094f0 con 0x7fcfb00a7130 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.311+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb0097dc0 con 0x7fcfb00a7130 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.311+0000 7fcfa5ffb700 1 -- 172.21.15.31:0/435983869 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fcfa800b750 con 0x7fcfb00a7130 2024-04-18T10:46:07.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.311+0000 7fcfa5ffb700 1 -- 172.21.15.31:0/435983869 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fcfa805f670 con 0x7fcfb00a7130 2024-04-18T10:46:07.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.315+0000 7fcfa5ffb700 1 -- 172.21.15.31:0/435983869 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcfb0097dc0 con 0x7fcfb00a7130 2024-04-18T10:46:07.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.478+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fcfb0097d90 con 0x7fcfb00a7130 2024-04-18T10:46:07.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.483+0000 7fcfa5ffb700 1 -- 172.21.15.31:0/435983869 <== mon.0 v2:172.21.15.31:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcfa803d910 con 0x7fcfb00a7130 2024-04-18T10:46:07.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.483+0000 7fcfa5ffb700 1 -- 172.21.15.31:0/435983869 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcfa8041510 con 0x7fcfb00a7130 2024-04-18T10:46:07.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 >> v1:172.21.15.31:6816/46601 conn(0x7fcf94045ef0 legacy=0x7fcf940483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb00a7130 msgr2=0x7fcfb0098c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 --2- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb00a7130 0x7fcfb0098c70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00a7580 tx=0x7fcfa800f040 comp rx=0 tx=0).stop 2024-04-18T10:46:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 shutdown_connections 2024-04-18T10:46:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 --2- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcfb00a7130 0x7fcfb0098c70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 --2- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcfb006ecf0 0x7fcfb00aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 --2- 172.21.15.31:0/435983869 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcfb00a6d60 0x7fcfb00977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 >> 172.21.15.31:0/435983869 conn(0x7fcfb00679e0 msgr2=0x7fcfb0067db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 shutdown_connections 2024-04-18T10:46:07.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.485+0000 7fcfb81af700 1 -- 172.21.15.31:0/435983869 wait complete. 2024-04-18T10:46:07.497 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-18T10:46:07.497 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:46:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.618+0000 7ff7e159d700 1 Processor -- start 2024-04-18T10:46:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.618+0000 7ff7e159d700 1 -- start start 2024-04-18T10:46:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7e159d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7dc063b00 0x7ff7dc0aa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7e159d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc13b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7e159d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7dc0aaa30 con 0x7ff7dc142170 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7e159d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7dc13e4e0 con 0x7ff7dc063b00 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7e159d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc142710 con 0x7ff7dc141d40 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7da7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc13b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7daffd700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff7dc063b00 0x7ff7dc0aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7db7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff7dc142170 0x7ff7dc0ade10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48646/0 (socket says 172.21.15.31:48646) 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7db7fe700 1 -- 172.21.15.31:0/3211113554 learned_addr learned my addr 172.21.15.31:0/3211113554 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7da7fc700 1 -- 172.21.15.31:0/3211113554 >> v2:172.21.15.31:3300/0 conn(0x7ff7dc063b00 msgr2=0x7ff7dc0aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7da7fc700 1 --2- 172.21.15.31:0/3211113554 >> v2:172.21.15.31:3300/0 conn(0x7ff7dc063b00 0x7ff7dc0aa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7da7fc700 1 -- 172.21.15.31:0/3211113554 >> v1:172.21.15.31:6789/0 conn(0x7ff7dc142170 legacy=0x7ff7dc0ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7da7fc700 1 -- 172.21.15.31:0/3211113554 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc0a9a90 con 0x7ff7dc141d40 2024-04-18T10:46:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7daffd700 1 --2- 172.21.15.31:0/3211113554 >> v2:172.21.15.31:3300/0 conn(0x7ff7dc063b00 0x7ff7dc0aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7da7fc700 1 --2- 172.21.15.31:0/3211113554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc13b590 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009910 tx=0x7ff7cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35cd1f3d84751b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.619+0000 7ff7d9ffb700 1 -- 172.21.15.31:0/3211113554 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00b640 con 0x7ff7dc141d40 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7d9ffb700 1 -- 172.21.15.31:0/3211113554 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff7cc00b7a0 con 0x7ff7dc141d40 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7d9ffb700 1 -- 172.21.15.31:0/3211113554 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00bb80 con 0x7ff7dc141d40 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7e159d700 1 -- 172.21.15.31:0/3211113554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 msgr2=0x7ff7dc13b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7e159d700 1 --2- 172.21.15.31:0/3211113554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc13b590 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009910 tx=0x7ff7cc0091a0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7e159d700 1 -- 172.21.15.31:0/3211113554 shutdown_connections 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7e159d700 1 --2- 172.21.15.31:0/3211113554 >> v2:172.21.15.31:3300/0 conn(0x7ff7dc063b00 0x7ff7dc0aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7e159d700 1 --2- 172.21.15.31:0/3211113554 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc13b590 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7e159d700 1 -- 172.21.15.31:0/3211113554 >> 172.21.15.31:0/3211113554 conn(0x7ff7dc06a390 msgr2=0x7ff7dc06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7e159d700 1 -- 172.21.15.31:0/3211113554 shutdown_connections 2024-04-18T10:46:07.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.620+0000 7ff7e159d700 1 -- 172.21.15.31:0/3211113554 wait complete. 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.621+0000 7ff7e159d700 1 Processor -- start 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.621+0000 7ff7e159d700 1 -- start start 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7e159d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7dc063b00 0x7ff7dc119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7e159d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7e159d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7dc142170 0x7ff7dc06d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7e159d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0b0e20 con 0x7ff7dc063b00 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7e159d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc0af2e0 con 0x7ff7dc141d40 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7e159d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc118f80 con 0x7ff7dc142170 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7da7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7da7fc700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc06d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38270/0 (socket says 172.21.15.31:38270) 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7da7fc700 1 -- 172.21.15.31:0/2664873441 learned_addr learned my addr 172.21.15.31:0/2664873441 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7daffd700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7dc063b00 0x7ff7dc119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7db7fe700 1 --2- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7dc142170 0x7ff7dc06d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7daffd700 1 -- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7dc142170 msgr2=0x7ff7dc06d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7daffd700 1 --2- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7dc142170 0x7ff7dc06d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7daffd700 1 -- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 msgr2=0x7ff7dc06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7daffd700 1 --2- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7daffd700 1 -- 172.21.15.31:0/2664873441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d0009420 con 0x7ff7dc063b00 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7da7fc700 1 --2- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.622+0000 7ff7daffd700 1 --2- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7dc063b00 0x7ff7dc119480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000ea00 tx=0x7ff7d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.623+0000 7ff7c2ffd700 1 -- 172.21.15.31:0/2664873441 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d000c6a0 con 0x7ff7dc063b00 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.623+0000 7ff7c2ffd700 1 -- 172.21.15.31:0/2664873441 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff7d000c800 con 0x7ff7dc063b00 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.623+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc009420 con 0x7ff7dc063b00 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.623+0000 7ff7c2ffd700 1 -- 172.21.15.31:0/2664873441 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d000cbc0 con 0x7ff7dc063b00 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.623+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc0b0250 con 0x7ff7dc063b00 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.624+0000 7ff7c2ffd700 1 -- 172.21.15.31:0/2664873441 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7ff7d0013470 con 0x7ff7dc063b00 2024-04-18T10:46:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.624+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc0651b0 con 0x7ff7dc063b00 2024-04-18T10:46:07.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.624+0000 7ff7c2ffd700 1 -- 172.21.15.31:0/2664873441 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7ff7d005b310 con 0x7ff7dc063b00 2024-04-18T10:46:07.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.627+0000 7ff7c2ffd700 1 -- 172.21.15.31:0/2664873441 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ff7d0039550 con 0x7ff7dc063b00 2024-04-18T10:46:07.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.821+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7dc0ad670 con 0x7ff7dc063b00 2024-04-18T10:46:07.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.821+0000 7ff7c2ffd700 1 -- 172.21.15.31:0/2664873441 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3693 (secure 0 0 0) 0x7ff7d003cd40 con 0x7ff7dc063b00 2024-04-18T10:46:07.822 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:46:07.822 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":24422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3164763612","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3164763612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6818/18914605","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":18914605}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:40:39.517104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{"feature_14":"metric_collect"},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24428":{"gid":24428,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/1866692589","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":1866692589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 >> v1:172.21.15.31:6816/46601 conn(0x7ff7c8045f20 legacy=0x7ff7c80483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7dc063b00 msgr2=0x7ff7dc119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 --2- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7dc063b00 0x7ff7dc119480 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000ea00 tx=0x7ff7d00091a0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 shutdown_connections 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 --2- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff7dc142170 0x7ff7dc06d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 --2- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7dc063b00 0x7ff7dc119480 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 --2- 172.21.15.31:0/2664873441 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff7dc141d40 0x7ff7dc06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 >> 172.21.15.31:0/2664873441 conn(0x7ff7dc06a390 msgr2=0x7ff7dc0ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 shutdown_connections 2024-04-18T10:46:07.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.823+0000 7ff7e159d700 1 -- 172.21.15.31:0/2664873441 wait complete. 2024-04-18T10:46:07.825 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-04-18T10:46:07.835 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-18T10:46:07.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.954+0000 7f2b8be4d700 1 Processor -- start 2024-04-18T10:46:07.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.954+0000 7f2b8be4d700 1 -- start start 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b8be4d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2b8406e050 0x7f2b8406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b8be4d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b8be4d700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b840a3720 con 0x7f2b84069450 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b8be4d700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8406fd80 con 0x7f2b8406e050 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b8be4d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8406ea20 con 0x7f2b840a2960 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b893e8700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2b8406e050 0x7f2b8406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b89be9700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2b84069450 0x7f2b8406f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48652/0 (socket says 172.21.15.31:48652) 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b8a3ea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b89be9700 1 -- 172.21.15.31:0/2259362966 learned_addr learned my addr 172.21.15.31:0/2259362966 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b893e8700 1 -- 172.21.15.31:0/2259362966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 msgr2=0x7f2b840a2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b893e8700 1 --2- 172.21.15.31:0/2259362966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840a2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b893e8700 1 -- 172.21.15.31:0/2259362966 >> v1:172.21.15.31:6789/0 conn(0x7f2b84069450 legacy=0x7f2b8406f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b893e8700 1 -- 172.21.15.31:0/2259362966 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b840a2420 con 0x7f2b8406e050 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b88be7700 1 -- 172.21.15.31:0/2259362966 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130039859 0 0) 0x7f2b840a3720 con 0x7f2b84069450 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b8a3ea700 1 --2- 172.21.15.31:0/2259362966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.955+0000 7f2b893e8700 1 --2- 172.21.15.31:0/2259362966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b8406e050 0x7f2b8406e440 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2b800098e0 tx=0x7f2b800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9a1fa6cec267df server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b88be7700 1 -- 172.21.15.31:0/2259362966 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000b640 con 0x7f2b8406e050 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b88be7700 1 -- 172.21.15.31:0/2259362966 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2b8000b7a0 con 0x7f2b8406e050 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b88be7700 1 -- 172.21.15.31:0/2259362966 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000bb60 con 0x7f2b8406e050 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b8be4d700 1 -- 172.21.15.31:0/2259362966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b8406e050 msgr2=0x7f2b8406e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b8be4d700 1 --2- 172.21.15.31:0/2259362966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b8406e050 0x7f2b8406e440 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2b800098e0 tx=0x7f2b800091a0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b8be4d700 1 -- 172.21.15.31:0/2259362966 shutdown_connections 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b8be4d700 1 --2- 172.21.15.31:0/2259362966 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840a2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b8be4d700 1 --2- 172.21.15.31:0/2259362966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b8406e050 0x7f2b8406e440 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b8be4d700 1 -- 172.21.15.31:0/2259362966 >> 172.21.15.31:0/2259362966 conn(0x7f2b8406cd10 msgr2=0x7f2b84068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:07.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b8be4d700 1 -- 172.21.15.31:0/2259362966 shutdown_connections 2024-04-18T10:46:07.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.956+0000 7f2b8be4d700 1 -- 172.21.15.31:0/2259362966 wait complete. 2024-04-18T10:46:07.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.957+0000 7f2b8be4d700 1 Processor -- start 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.957+0000 7f2b8be4d700 1 -- start start 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8be4d700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84069450 0x7f2b8413c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8be4d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b8406e050 0x7f2b8413bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8be4d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8be4d700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84136c80 con 0x7f2b84069450 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8be4d700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b840a5a80 con 0x7f2b840a2960 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8be4d700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8413ce10 con 0x7f2b8406e050 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b893e8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b8406e050 0x7f2b8413bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8a3ea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b89be9700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84069450 0x7f2b8413c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b893e8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b8406e050 0x7f2b8413bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49294/0 (socket says 172.21.15.31:49294) 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b893e8700 1 -- 172.21.15.31:0/3319743595 learned_addr learned my addr 172.21.15.31:0/3319743595 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:07.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8a3ea700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38296/0 (socket says 172.21.15.31:38296) 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8a3ea700 1 -- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b8406e050 msgr2=0x7f2b8413bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8a3ea700 1 --2- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b8406e050 0x7f2b8413bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8a3ea700 1 -- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84069450 msgr2=0x7f2b8413c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8a3ea700 1 --2- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84069450 0x7f2b8413c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8a3ea700 1 -- 172.21.15.31:0/3319743595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c009a20 con 0x7f2b840a2960 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b89be9700 1 --2- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84069450 0x7f2b8413c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b8a3ea700 1 --2- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840679e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009f10 tx=0x7f2b7c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.958+0000 7f2b79ffb700 1 -- 172.21.15.31:0/3319743595 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00cb70 con 0x7f2b840a2960 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.959+0000 7f2b79ffb700 1 -- 172.21.15.31:0/3319743595 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2b7c00f040 con 0x7f2b840a2960 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.959+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b80009420 con 0x7f2b840a2960 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.959+0000 7f2b79ffb700 1 -- 172.21.15.31:0/3319743595 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c014480 con 0x7f2b840a2960 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.959+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b84144250 con 0x7f2b840a2960 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.960+0000 7f2b79ffb700 1 -- 172.21.15.31:0/3319743595 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f2b7c003020 con 0x7f2b840a2960 2024-04-18T10:46:07.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.960+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b840651b0 con 0x7f2b840a2960 2024-04-18T10:46:07.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.960+0000 7f2b79ffb700 1 -- 172.21.15.31:0/3319743595 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7f2b7c05bc20 con 0x7f2b840a2960 2024-04-18T10:46:07.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:07.964+0000 7f2b79ffb700 1 -- 172.21.15.31:0/3319743595 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2b7c03a070 con 0x7f2b840a2960 2024-04-18T10:46:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.160+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b840a3f70 con 0x7f2b840a2960 2024-04-18T10:46:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.161+0000 7f2b79ffb700 1 -- 172.21.15.31:0/3319743595 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3693 (secure 0 0 0) 0x7f2b7c018070 con 0x7f2b840a2960 2024-04-18T10:46:08.161 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:46:08.161 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":24422,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6817/3164763612","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6817","nonce":3164763612}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6818/18914605","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6818","nonce":18914605}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-18T10:36:08.987612+0000","modified":"2024-04-18T10:40:39.517104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{"feature_14":"metric_collect"},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24428},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24428":{"gid":24428,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6819/1866692589","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6819","nonce":1866692589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-18T10:46:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 >> v1:172.21.15.31:6816/46601 conn(0x7f2b68045ef0 legacy=0x7f2b680483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 msgr2=0x7f2b840679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 --2- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840679e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009f10 tx=0x7f2b7c00b040 comp rx=0 tx=0).stop 2024-04-18T10:46:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 shutdown_connections 2024-04-18T10:46:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 --2- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f2b840a2960 0x7f2b840679e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 --2- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84069450 0x7f2b8413c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 --2- 172.21.15.31:0/3319743595 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f2b8406e050 0x7f2b8413bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 >> 172.21.15.31:0/3319743595 conn(0x7f2b8406cd10 msgr2=0x7f2b84144b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 shutdown_connections 2024-04-18T10:46:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.163+0000 7f2b8be4d700 1 -- 172.21.15.31:0/3319743595 wait complete. 2024-04-18T10:46:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 19 2024-04-18T10:46:08.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-18T10:46:08.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.294+0000 7fcae499e700 1 Processor -- start 2024-04-18T10:46:08.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.294+0000 7fcae499e700 1 -- start start 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcae499e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00ab730 0x7fcae006a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcae499e700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcae013e670 0x7fcae013eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcae499e700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae013e410 con 0x7fcae00b2d90 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcae499e700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae013bdf0 con 0x7fcae013e670 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcae499e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae0069bd0 con 0x7fcae00ab730 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcadeffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00ab730 0x7fcae006a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcadffff700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcae013e670 0x7fcae013eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcadf7fe700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcae00b2d90 0x7fcae006a070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48662/0 (socket says 172.21.15.31:48662) 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcadf7fe700 1 -- 172.21.15.31:0/2857516938 learned_addr learned my addr 172.21.15.31:0/2857516938 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcadffff700 1 -- 172.21.15.31:0/2857516938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00ab730 msgr2=0x7fcae006a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcadffff700 1 --2- 172.21.15.31:0/2857516938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00ab730 0x7fcae006a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcadffff700 1 -- 172.21.15.31:0/2857516938 >> v1:172.21.15.31:6789/0 conn(0x7fcae00b2d90 legacy=0x7fcae006a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcadffff700 1 -- 172.21.15.31:0/2857516938 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00692d0 con 0x7fcae013e670 2024-04-18T10:46:08.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcade7fc700 1 -- 172.21.15.31:0/2857516938 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865221336 0 0) 0x7fcae013e410 con 0x7fcae00b2d90 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.295+0000 7fcadeffd700 1 --2- 172.21.15.31:0/2857516938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00ab730 0x7fcae006a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcadffff700 1 --2- 172.21.15.31:0/2857516938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae013e670 0x7fcae013eb10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009e60 tx=0x7fcad8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773ea0a78451e97a server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcade7fc700 1 -- 172.21.15.31:0/2857516938 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800e070 con 0x7fcae013e670 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcade7fc700 1 -- 172.21.15.31:0/2857516938 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcad800bb60 con 0x7fcae013e670 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcade7fc700 1 -- 172.21.15.31:0/2857516938 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8012430 con 0x7fcae013e670 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcae499e700 1 -- 172.21.15.31:0/2857516938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae013e670 msgr2=0x7fcae013eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcae499e700 1 --2- 172.21.15.31:0/2857516938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae013e670 0x7fcae013eb10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009e60 tx=0x7fcad8009780 comp rx=0 tx=0).stop 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcae499e700 1 -- 172.21.15.31:0/2857516938 shutdown_connections 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcae499e700 1 --2- 172.21.15.31:0/2857516938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae013e670 0x7fcae013eb10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcae499e700 1 --2- 172.21.15.31:0/2857516938 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00ab730 0x7fcae006a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcae499e700 1 -- 172.21.15.31:0/2857516938 >> 172.21.15.31:0/2857516938 conn(0x7fcae006dcb0 msgr2=0x7fcae006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcae499e700 1 -- 172.21.15.31:0/2857516938 shutdown_connections 2024-04-18T10:46:08.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.296+0000 7fcae499e700 1 -- 172.21.15.31:0/2857516938 wait complete. 2024-04-18T10:46:08.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.297+0000 7fcae499e700 1 Processor -- start 2024-04-18T10:46:08.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcae499e700 1 -- start start 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcae499e700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae00ab730 0x7fcae0139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcae499e700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00b2d90 0x7fcae013a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcae499e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcae013e670 0x7fcae0150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcae499e700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae013b0f0 con 0x7fcae00ab730 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcae499e700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae0144b20 con 0x7fcae00b2d90 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcae499e700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcae0144dc0 con 0x7fcae013e670 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcadf7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae00ab730 0x7fcae0139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcadffff700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcae013e670 0x7fcae0150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcadeffd700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00b2d90 0x7fcae013a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcadf7fe700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae00ab730 0x7fcae0139e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51878/0 (socket says 172.21.15.31:51878) 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.298+0000 7fcadf7fe700 1 -- 172.21.15.31:0/2080770581 learned_addr learned my addr 172.21.15.31:0/2080770581 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcadf7fe700 1 -- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcae013e670 msgr2=0x7fcae0150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcadf7fe700 1 --2- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcae013e670 0x7fcae0150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcadf7fe700 1 -- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00b2d90 msgr2=0x7fcae013a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcadf7fe700 1 --2- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00b2d90 0x7fcae013a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcadf7fe700 1 -- 172.21.15.31:0/2080770581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0009420 con 0x7fcae00ab730 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcadf7fe700 1 --2- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae00ab730 0x7fcae0139e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcac800c810 tx=0x7fcac8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcad77fe700 1 -- 172.21.15.31:0/2080770581 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8005c00 con 0x7fcae00ab730 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcad77fe700 1 -- 172.21.15.31:0/2080770581 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcac8005d60 con 0x7fcae00ab730 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad8009a20 con 0x7fcae00ab730 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcad77fe700 1 -- 172.21.15.31:0/2080770581 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8007340 con 0x7fcae00ab730 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.299+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae0145d10 con 0x7fcae00ab730 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.300+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae0145f30 con 0x7fcae00ab730 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.300+0000 7fcad77fe700 1 -- 172.21.15.31:0/2080770581 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fcac801b3b0 con 0x7fcae00ab730 2024-04-18T10:46:08.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.300+0000 7fcad77fe700 1 -- 172.21.15.31:0/2080770581 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7fcac805a5c0 con 0x7fcae00ab730 2024-04-18T10:46:08.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.304+0000 7fcad77fe700 1 -- 172.21.15.31:0/2080770581 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcac8038880 con 0x7fcae00ab730 2024-04-18T10:46:08.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.468+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcae00651b0 con 0x7fcae00ab730 2024-04-18T10:46:08.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.469+0000 7fcad77fe700 1 -- 172.21.15.31:0/2080770581 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12029 (secure 0 0 0) 0x7fcac8017020 con 0x7fcae00ab730 2024-04-18T10:46:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-04-18T10:46:08.470 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"2dc05854-5716-4ea6-add8-fd949f4dd05c","created":"2024-04-18T10:35:48.469780+0000","modified":"2024-04-18T10:40:40.522243+0000","last_up_change":"2024-04-18T10:38:47.487613+0000","last_in_change":"2024-04-18T10:35:55.406271+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-18T10:35:51.422706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-18T10:35:58.551846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-18T10:36:07.428725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-18T10:36:07.976197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"26ab35e2-f662-41bb-84a6-ae50230f2ff5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":23,"up_from":29,"up_thru":42,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6800","nonce":49212}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6801","nonce":49212}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6803","nonce":49212}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6802","nonce":49212}]},"public_addr":"172.21.15.31:6800/49212","cluster_addr":"172.21.15.31:6801/49212","heartbeat_back_addr":"172.21.15.31:6803/49212","heartbeat_front_addr":"172.21.15.31:6802/49212","state":["exists","up"]},{"osd":1,"uuid":"4e922862-50c2-4a41-8eba-8450b48538a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6804","nonce":49310}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6805","nonce":49310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6807","nonce":49310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6806","nonce":49310}]},"public_addr":"172.21.15.31:6804/49310","cluster_addr":"172.21.15.31:6805/49310","heartbeat_back_addr":"172.21.15.31:6807/49310","heartbeat_front_addr":"172.21.15.31:6806/49310","state":["exists","up"]},{"osd":2,"uuid":"e7051e98-337d-4aee-91e3-86589be64be4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":25,"up_from":31,"up_thru":42,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6808","nonce":49420}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6809","nonce":49420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6811","nonce":49420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6810","nonce":49420}]},"public_addr":"172.21.15.31:6808/49420","cluster_addr":"172.21.15.31:6809/49420","heartbeat_back_addr":"172.21.15.31:6811/49420","heartbeat_front_addr":"172.21.15.31:6810/49420","state":["exists","up"]},{"osd":3,"uuid":"b3017445-c716-4557-9ef9-5cd838ef1cdf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":26,"up_from":32,"up_thru":32,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6812","nonce":49601}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6813","nonce":49601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6815","nonce":49601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.31:6814","nonce":49601}]},"public_addr":"172.21.15.31:6812/49601","cluster_addr":"172.21.15.31:6813/49601","heartbeat_back_addr":"172.21.15.31:6815/49601","heartbeat_front_addr":"172.21.15.31:6814/49601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.404673+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.409390+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.445864+0000","dead_epoch":26},{"osd":3,"down_stamp":"2024-04-18T10:38:41.447571+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-18T10:35:53.480148+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":0}]},{"pgid":"4.1f","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:0/2414209880":"2024-04-18T11:40:39.525564+0000","172.21.15.31:6819/3321563080":"2024-04-19T10:38:52.565121+0000","172.21.15.31:0/2921291208":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/2767636595":"2024-04-19T10:38:28.389077+0000","172.21.15.31:0/3252462560":"2024-04-19T10:38:28.389077+0000","172.21.15.31:6816/39551":"2024-04-19T10:38:28.389077+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-18T10:46:08.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 >> v1:172.21.15.31:6816/46601 conn(0x7fcac0045ef0 legacy=0x7fcac00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae00ab730 msgr2=0x7fcae0139e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 --2- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae00ab730 0x7fcae0139e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcac800c810 tx=0x7fcac8007d90 comp rx=0 tx=0).stop 2024-04-18T10:46:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 shutdown_connections 2024-04-18T10:46:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 --2- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7fcae013e670 0x7fcae0150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 --2- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcae00ab730 0x7fcae0139e40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 --2- 172.21.15.31:0/2080770581 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7fcae00b2d90 0x7fcae013a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 >> 172.21.15.31:0/2080770581 conn(0x7fcae006dcb0 msgr2=0x7fcae006e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 shutdown_connections 2024-04-18T10:46:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.471+0000 7fcae499e700 1 -- 172.21.15.31:0/2080770581 wait complete. 2024-04-18T10:46:08.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-18T10:46:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.607+0000 7ff684497700 1 Processor -- start 2024-04-18T10:46:08.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.607+0000 7ff684497700 1 -- start start 2024-04-18T10:46:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff684497700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c063b80 0x7ff67c06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff684497700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c13f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff684497700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff67c0abc80 0x7ff67c0ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff684497700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0ad900 con 0x7ff67c0abc80 2024-04-18T10:46:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff684497700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c06e2c0 con 0x7ff67c13ecd0 2024-04-18T10:46:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff684497700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0ada90 con 0x7ff67c063b80 2024-04-18T10:46:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff682233700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c063b80 0x7ff67c06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff682a34700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff67c0abc80 0x7ff67c0ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff681a32700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c13f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff682a34700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff67c0abc80 0x7ff67c0ac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51884/0 (socket says 172.21.15.31:51884) 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff682233700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c063b80 0x7ff67c06efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49314/0 (socket says 172.21.15.31:49314) 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff681a32700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c13f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38340/0 (socket says 172.21.15.31:38340) 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff682a34700 1 -- 172.21.15.31:0/95236953 learned_addr learned my addr 172.21.15.31:0/95236953 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff681a32700 1 -- 172.21.15.31:0/95236953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c063b80 msgr2=0x7ff67c06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff681a32700 1 --2- 172.21.15.31:0/95236953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c063b80 0x7ff67c06efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff681a32700 1 -- 172.21.15.31:0/95236953 >> v2:172.21.15.31:3300/0 conn(0x7ff67c0abc80 msgr2=0x7ff67c0ac0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff681a32700 1 --2- 172.21.15.31:0/95236953 >> v2:172.21.15.31:3300/0 conn(0x7ff67c0abc80 0x7ff67c0ac0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff681a32700 1 -- 172.21.15.31:0/95236953 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0ad480 con 0x7ff67c13ecd0 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff682a34700 1 --2- 172.21.15.31:0/95236953 >> v2:172.21.15.31:3300/0 conn(0x7ff67c0abc80 0x7ff67c0ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff682233700 1 --2- 172.21.15.31:0/95236953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c063b80 0x7ff67c06efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.608+0000 7ff681a32700 1 --2- 172.21.15.31:0/95236953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c13f100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff6780098e0 tx=0x7ff6780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=161198496203fa09 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:08.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff681231700 1 -- 172.21.15.31:0/95236953 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678011630 con 0x7ff67c13ecd0 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff681231700 1 -- 172.21.15.31:0/95236953 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff678011790 con 0x7ff67c13ecd0 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff681231700 1 -- 172.21.15.31:0/95236953 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678011b50 con 0x7ff67c13ecd0 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff684497700 1 -- 172.21.15.31:0/95236953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 msgr2=0x7ff67c13f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff684497700 1 --2- 172.21.15.31:0/95236953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c13f100 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff6780098e0 tx=0x7ff6780091a0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff684497700 1 -- 172.21.15.31:0/95236953 shutdown_connections 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff684497700 1 --2- 172.21.15.31:0/95236953 >> v2:172.21.15.31:3300/0 conn(0x7ff67c0abc80 0x7ff67c0ac0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff684497700 1 --2- 172.21.15.31:0/95236953 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c063b80 0x7ff67c06efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff684497700 1 --2- 172.21.15.31:0/95236953 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c13f100 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff684497700 1 -- 172.21.15.31:0/95236953 >> 172.21.15.31:0/95236953 conn(0x7ff67c0b1290 msgr2=0x7ff67c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff684497700 1 -- 172.21.15.31:0/95236953 shutdown_connections 2024-04-18T10:46:08.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.609+0000 7ff684497700 1 -- 172.21.15.31:0/95236953 wait complete. 2024-04-18T10:46:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.610+0000 7ff684497700 1 Processor -- start 2024-04-18T10:46:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.610+0000 7ff684497700 1 -- start start 2024-04-18T10:46:08.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff684497700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff67c063b80 0x7ff67c12e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff684497700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c0abc80 0x7ff67c14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff684497700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff684497700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c12eec0 con 0x7ff67c063b80 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff684497700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c12e280 con 0x7ff67c13ecd0 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff684497700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c130120 con 0x7ff67c0abc80 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682233700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff67c063b80 0x7ff67c12e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682233700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff67c063b80 0x7ff67c12e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51888/0 (socket says 172.21.15.31:51888) 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682233700 1 -- 172.21.15.31:0/1719775589 learned_addr learned my addr 172.21.15.31:0/1719775589 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff681a32700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c0abc80 0x7ff67c14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682a34700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682233700 1 -- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c0abc80 msgr2=0x7ff67c14dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682233700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c0abc80 0x7ff67c14dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682233700 1 -- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 msgr2=0x7ff67c14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682233700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c14e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682233700 1 -- 172.21.15.31:0/1719775589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c009420 con 0x7ff67c063b80 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff681a32700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c0abc80 0x7ff67c14dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.611+0000 7ff682233700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff67c063b80 0x7ff67c12e980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00ec80 tx=0x7ff66c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.612+0000 7ff6727fc700 1 -- 172.21.15.31:0/1719775589 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00c8e0 con 0x7ff67c063b80 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.612+0000 7ff6727fc700 1 -- 172.21.15.31:0/1719775589 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff66c00ca40 con 0x7ff67c063b80 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.612+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff674009ae0 con 0x7ff67c063b80 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.612+0000 7ff6727fc700 1 -- 172.21.15.31:0/1719775589 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00cde0 con 0x7ff67c063b80 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.612+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff678009420 con 0x7ff67c063b80 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.613+0000 7ff6727fc700 1 -- 172.21.15.31:0/1719775589 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7ff66c013680 con 0x7ff67c063b80 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.613+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c12f290 con 0x7ff67c063b80 2024-04-18T10:46:08.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.613+0000 7ff6727fc700 1 -- 172.21.15.31:0/1719775589 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4129+0+0 (secure 0 0 0) 0x7ff66c05b720 con 0x7ff67c063b80 2024-04-18T10:46:08.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.616+0000 7ff6727fc700 1 -- 172.21.15.31:0/1719775589 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ff66c0399e0 con 0x7ff67c063b80 2024-04-18T10:46:08.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.811+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff67c12df50 con 0x7ff67c063b80 2024-04-18T10:46:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.818+0000 7ff6727fc700 1 -- 172.21.15.31:0/1719775589 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff66c03d1d0 con 0x7ff67c063b80 2024-04-18T10:46:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 >> v1:172.21.15.31:6816/46601 conn(0x7ff660045f20 legacy=0x7ff6600483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff67c063b80 msgr2=0x7ff67c12e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff67c063b80 0x7ff67c12e980 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00ec80 tx=0x7ff66c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 shutdown_connections 2024-04-18T10:46:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7ff67c13ecd0 0x7ff67c14e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff67c063b80 0x7ff67c12e980 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 --2- 172.21.15.31:0/1719775589 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7ff67c0abc80 0x7ff67c14dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 >> 172.21.15.31:0/1719775589 conn(0x7ff67c0b1290 msgr2=0x7ff67c0ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 shutdown_connections 2024-04-18T10:46:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.825+0000 7ff684497700 1 -- 172.21.15.31:0/1719775589 wait complete. 2024-04-18T10:46:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-18T10:46:08.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-18T10:46:08.863 INFO:tasks.ceph.mds.b.smithi031.stdout:starting mds.b at 2024-04-18T10:46:08.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.966+0000 7f714c91b700 1 Processor -- start 2024-04-18T10:46:08.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.967+0000 7f714c91b700 1 -- start start 2024-04-18T10:46:08.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.967+0000 7f714c91b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f71480ac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.967+0000 7f714c91b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71480a5b10 0x7f71480ad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.967+0000 7f714c91b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148131ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.967+0000 7f714c91b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71480a5680 con 0x7f71480a5b10 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.967+0000 7f714c91b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71480a5f80 con 0x7f7148131700 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.967+0000 7f714c91b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71480a6220 con 0x7f7148063b80 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.967+0000 7f714659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f71480ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.967+0000 7f7146d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148131ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f7145d9b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f71480a5b10 0x7f71480ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f71480ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49330/0 (socket says 172.21.15.31:49330) 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f7146d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148131ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38362/0 (socket says 172.21.15.31:38362) 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714659c700 1 -- 172.21.15.31:0/2404570448 learned_addr learned my addr 172.21.15.31:0/2404570448 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714659c700 1 -- 172.21.15.31:0/2404570448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 msgr2=0x7f7148131ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:08.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714659c700 1 --2- 172.21.15.31:0/2404570448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148131ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714659c700 1 -- 172.21.15.31:0/2404570448 >> v2:172.21.15.31:3300/0 conn(0x7f71480a5b10 msgr2=0x7f71480ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714659c700 1 --2- 172.21.15.31:0/2404570448 >> v2:172.21.15.31:3300/0 conn(0x7f71480a5b10 0x7f71480ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714659c700 1 -- 172.21.15.31:0/2404570448 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71480adb30 con 0x7f7148063b80 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f7145d9b700 1 --2- 172.21.15.31:0/2404570448 >> v2:172.21.15.31:3300/0 conn(0x7f71480a5b10 0x7f71480ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f7146d9d700 1 --2- 172.21.15.31:0/2404570448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148131ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714659c700 1 --2- 172.21.15.31:0/2404570448 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f71480ac390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f713c0099b0 tx=0x7f713c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a23898bbda9c987 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714559a700 1 -- 172.21.15.31:0/2404570448 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00b680 con 0x7f7148063b80 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714559a700 1 -- 172.21.15.31:0/2404570448 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f713c00b7e0 con 0x7f7148063b80 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.968+0000 7f714559a700 1 -- 172.21.15.31:0/2404570448 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00bba0 con 0x7f7148063b80 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.969+0000 7f714c91b700 1 -- 172.21.15.31:0/2404570448 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 msgr2=0x7f71480ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.969+0000 7f714c91b700 1 --2- 172.21.15.31:0/2404570448 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f71480ac390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f713c0099b0 tx=0x7f713c009250 comp rx=0 tx=0).stop 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.969+0000 7f714c91b700 1 -- 172.21.15.31:0/2404570448 shutdown_connections 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.969+0000 7f714c91b700 1 --2- 172.21.15.31:0/2404570448 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148131ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.969+0000 7f714c91b700 1 --2- 172.21.15.31:0/2404570448 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f71480ac390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.969+0000 7f714c91b700 1 --2- 172.21.15.31:0/2404570448 >> v2:172.21.15.31:3300/0 conn(0x7f71480a5b10 0x7f71480ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.969+0000 7f714c91b700 1 -- 172.21.15.31:0/2404570448 >> 172.21.15.31:0/2404570448 conn(0x7f71480b1290 msgr2=0x7f71480b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:08.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.969+0000 7f714c91b700 1 -- 172.21.15.31:0/2404570448 shutdown_connections 2024-04-18T10:46:08.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.969+0000 7f714c91b700 1 -- 172.21.15.31:0/2404570448 wait complete. 2024-04-18T10:46:08.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.970+0000 7f714c91b700 1 Processor -- start 2024-04-18T10:46:08.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.970+0000 7f714c91b700 1 -- start start 2024-04-18T10:46:08.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.970+0000 7f714c91b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f7148132ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.970+0000 7f714c91b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71480a5b10 0x7f71481519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.970+0000 7f714c91b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:08.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.970+0000 7f714c91b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7148134140 con 0x7f71480a5b10 2024-04-18T10:46:08.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.970+0000 7f714c91b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7148134ac0 con 0x7f7148131700 2024-04-18T10:46:08.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.970+0000 7f714c91b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7148133410 con 0x7f7148063b80 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7145d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71480a5b10 0x7f71481519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7146d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7145d9b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71480a5b10 0x7f71481519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51922/0 (socket says 172.21.15.31:51922) 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7146d9d700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148151f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38370/0 (socket says 172.21.15.31:38370) 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f714659c700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f7148132ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7145d9b700 1 -- 172.21.15.31:0/3319241291 learned_addr learned my addr 172.21.15.31:0/3319241291 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7145d9b700 1 -- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 msgr2=0x7f7148132ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7145d9b700 1 --2- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f7148132ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7145d9b700 1 -- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 msgr2=0x7f7148151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7145d9b700 1 --2- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7145d9b700 1 -- 172.21.15.31:0/3319241291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7138009420 con 0x7f71480a5b10 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7146d9d700 1 --2- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:08.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f7145d9b700 1 --2- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71480a5b10 0x7f71481519d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f713800ec80 tx=0x7f71380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f71367fc700 1 -- 172.21.15.31:0/3319241291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800c920 con 0x7f71480a5b10 2024-04-18T10:46:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f71367fc700 1 -- 172.21.15.31:0/3319241291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f713800ca80 con 0x7f71480a5b10 2024-04-18T10:46:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7140009a20 con 0x7f71480a5b10 2024-04-18T10:46:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f71367fc700 1 -- 172.21.15.31:0/3319241291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713800ce20 con 0x7f71480a5b10 2024-04-18T10:46:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.971+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0094f0 con 0x7f71480a5b10 2024-04-18T10:46:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.972+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7148133a80 con 0x7f71480a5b10 2024-04-18T10:46:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.972+0000 7f71367fc700 1 -- 172.21.15.31:0/3319241291 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f7138013680 con 0x7f71480a5b10 2024-04-18T10:46:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.973+0000 7f71367fc700 1 -- 172.21.15.31:0/3319241291 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f713805b330 con 0x7f71480a5b10 2024-04-18T10:46:08.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:08.976+0000 7f71367fc700 1 -- 172.21.15.31:0/3319241291 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7148133a80 con 0x7f71480a5b10 2024-04-18T10:46:09.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.173+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7148133a80 con 0x7f71480a5b10 2024-04-18T10:46:09.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.816+0000 7f71367fc700 1 -- 172.21.15.31:0/3319241291 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7148133a80 con 0x7f71480a5b10 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 >> v1:172.21.15.31:6816/46601 conn(0x7f7128045ef0 legacy=0x7f71280483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71480a5b10 msgr2=0x7f71481519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 --2- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71480a5b10 0x7f71481519d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f713800ec80 tx=0x7f71380091a0 comp rx=0 tx=0).stop 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 shutdown_connections 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 --2- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f7148063b80 0x7f7148132ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 --2- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f7148131700 0x7f7148151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 --2- 172.21.15.31:0/3319241291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71480a5b10 0x7f71481519d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 >> 172.21.15.31:0/3319241291 conn(0x7f71480b1290 msgr2=0x7f7148130850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 shutdown_connections 2024-04-18T10:46:09.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:09.819+0000 7f714c91b700 1 -- 172.21.15.31:0/3319241291 wait complete. 2024-04-18T10:46:09.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-18T10:46:10.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.007+0000 7f135863b700 1 Processor -- start 2024-04-18T10:46:10.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.007+0000 7f135863b700 1 -- start start 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f135863b700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13500b1c80 0x7f135006ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f135863b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500a2e50 0x7f13500679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f135863b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1350067f20 0x7f13500683c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f135863b700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13500a2670 con 0x7f13500b1c80 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f135863b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135006f230 con 0x7f1350067f20 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f135863b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f135006f490 con 0x7f13500a2e50 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f13563d7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13500b1c80 0x7f135006ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f1356bd8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1350067f20 0x7f13500683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f1355bd6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500a2e50 0x7f13500679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f13563d7700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f13500b1c80 0x7f135006ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51934/0 (socket says 172.21.15.31:51934) 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f1355bd6700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500a2e50 0x7f13500679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49348/0 (socket says 172.21.15.31:49348) 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f1356bd8700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1350067f20 0x7f13500683c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38376/0 (socket says 172.21.15.31:38376) 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f13563d7700 1 -- 172.21.15.31:0/1987290999 learned_addr learned my addr 172.21.15.31:0/1987290999 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f13563d7700 1 -- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500a2e50 msgr2=0x7f13500679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f13563d7700 1 --2- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500a2e50 0x7f13500679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f13563d7700 1 -- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1350067f20 msgr2=0x7f13500683c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f13563d7700 1 --2- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1350067f20 0x7f13500683c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f13563d7700 1 -- 172.21.15.31:0/1987290999 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135006f730 con 0x7f13500b1c80 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.008+0000 7f1355bd6700 1 --2- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500a2e50 0x7f13500679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.009+0000 7f1356bd8700 1 --2- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1350067f20 0x7f13500683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.009+0000 7f13563d7700 1 --2- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13500b1c80 0x7f135006ecf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f13400099b0 tx=0x7f1340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ff791498cfc8bf server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.009+0000 7f13553d5700 1 -- 172.21.15.31:0/1987290999 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134000b680 con 0x7f13500b1c80 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.009+0000 7f13553d5700 1 -- 172.21.15.31:0/1987290999 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f134000b7e0 con 0x7f13500b1c80 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.009+0000 7f13553d5700 1 -- 172.21.15.31:0/1987290999 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134000bba0 con 0x7f13500b1c80 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.009+0000 7f135863b700 1 -- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13500b1c80 msgr2=0x7f135006ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.009+0000 7f135863b700 1 --2- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13500b1c80 0x7f135006ecf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f13400099b0 tx=0x7f1340009250 comp rx=0 tx=0).stop 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.010+0000 7f135863b700 1 -- 172.21.15.31:0/1987290999 shutdown_connections 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.010+0000 7f135863b700 1 --2- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f1350067f20 0x7f13500683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.010+0000 7f135863b700 1 --2- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13500b1c80 0x7f135006ecf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.010+0000 7f135863b700 1 --2- 172.21.15.31:0/1987290999 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500a2e50 0x7f13500679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.010+0000 7f135863b700 1 -- 172.21.15.31:0/1987290999 >> 172.21.15.31:0/1987290999 conn(0x7f135006ccf0 msgr2=0x7f135006aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.010+0000 7f135863b700 1 -- 172.21.15.31:0/1987290999 shutdown_connections 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.010+0000 7f135863b700 1 -- 172.21.15.31:0/1987290999 wait complete. 2024-04-18T10:46:10.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f135863b700 1 Processor -- start 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f135863b700 1 -- start start 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f135863b700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1350067f20 0x7f1350097050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f135863b700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13500a2e50 0x7f135013d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f135863b700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500b1c80 0x7f135013dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f135863b700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1350097590 con 0x7f1350067f20 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f135863b700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13500ae950 con 0x7f13500a2e50 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f135863b700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13500a18a0 con 0x7f13500b1c80 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f1355bd6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13500a2e50 0x7f135013d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f1356bd8700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500b1c80 0x7f135013dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f13563d7700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1350067f20 0x7f1350097050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f1355bd6700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13500a2e50 0x7f135013d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3301/0 says I am v2:172.21.15.31:38392/0 (socket says 172.21.15.31:38392) 2024-04-18T10:46:10.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f1355bd6700 1 -- 172.21.15.31:0/3949392371 learned_addr learned my addr 172.21.15.31:0/3949392371 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f1355bd6700 1 -- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500b1c80 msgr2=0x7f135013dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f1355bd6700 1 --2- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500b1c80 0x7f135013dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.011+0000 7f1355bd6700 1 -- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1350067f20 msgr2=0x7f1350097050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.012+0000 7f1355bd6700 1 --2- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1350067f20 0x7f1350097050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.012+0000 7f1355bd6700 1 -- 172.21.15.31:0/3949392371 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348009a20 con 0x7f13500a2e50 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.012+0000 7f13563d7700 1 --2- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1350067f20 0x7f1350097050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.012+0000 7f1355bd6700 1 --2- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13500a2e50 0x7f135013d760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f134c00ecb0 tx=0x7f134c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.012+0000 7f13467fc700 1 -- 172.21.15.31:0/3949392371 <== mon.1 v2:172.21.15.31:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00c920 con 0x7f13500a2e50 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.012+0000 7f13467fc700 1 -- 172.21.15.31:0/3949392371 <== mon.1 v2:172.21.15.31:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f134c00ca80 con 0x7f13500a2e50 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.012+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c009420 con 0x7f13500a2e50 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.012+0000 7f13467fc700 1 -- 172.21.15.31:0/3949392371 <== mon.1 v2:172.21.15.31:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00ce40 con 0x7f13500a2e50 2024-04-18T10:46:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.012+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13400094f0 con 0x7f13500a2e50 2024-04-18T10:46:10.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.013+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13500ad3a0 con 0x7f13500a2e50 2024-04-18T10:46:10.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.013+0000 7f13467fc700 1 -- 172.21.15.31:0/3949392371 <== mon.1 v2:172.21.15.31:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f134c013680 con 0x7f13500a2e50 2024-04-18T10:46:10.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.013+0000 7f13467fc700 1 -- 172.21.15.31:0/3949392371 <== mon.1 v2:172.21.15.31:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f134c05b1a0 con 0x7f13500a2e50 2024-04-18T10:46:10.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.017+0000 7f13467fc700 1 -- 172.21.15.31:0/3949392371 <== mon.1 v2:172.21.15.31:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f134c039560 con 0x7f13500a2e50 2024-04-18T10:46:10.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.186+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1350063770 con 0x7f13500a2e50 2024-04-18T10:46:10.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.826+0000 7f13467fc700 1 -- 172.21.15.31:0/3949392371 <== mon.1 v2:172.21.15.31:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7f134c03cd50 con 0x7f13500a2e50 2024-04-18T10:46:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.835+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 >> v1:172.21.15.31:6816/46601 conn(0x7f1334045ef0 legacy=0x7f13340483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.835+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13500a2e50 msgr2=0x7f135013d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.835+0000 7f135863b700 1 --2- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13500a2e50 0x7f135013d760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f134c00ecb0 tx=0x7f134c0091a0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.837+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 shutdown_connections 2024-04-18T10:46:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.837+0000 7f135863b700 1 --2- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f13500b1c80 0x7f135013dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.837+0000 7f135863b700 1 --2- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1350067f20 0x7f1350097050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.837+0000 7f135863b700 1 --2- 172.21.15.31:0/3949392371 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f13500a2e50 0x7f135013d760 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.837+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 >> 172.21.15.31:0/3949392371 conn(0x7f135006ccf0 msgr2=0x7f1350064920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.837+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 shutdown_connections 2024-04-18T10:46:10.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.838+0000 7f135863b700 1 -- 172.21.15.31:0/3949392371 wait complete. 2024-04-18T10:46:10.846 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-04-18T10:46:10.860 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-18T10:46:10.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.988+0000 7f783d096700 1 Processor -- start 2024-04-18T10:46:10.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.988+0000 7f783d096700 1 -- start start 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783d096700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78380b2130 0x7f78380a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783d096700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838149530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783d096700 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783806ef90 con 0x7f783806e5a0 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783d096700 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78380a3f60 con 0x7f78380b2130 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783d096700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f783806ed00 con 0x7f78380680f0 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f7836d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78380b2130 0x7f78380a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783759e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783659c700 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f783806e5a0 0x7f78380679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48686/0 (socket says 172.21.15.31:48686) 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783659c700 1 -- 172.21.15.31:0/2511780744 learned_addr learned my addr 172.21.15.31:0/2511780744 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-04-18T10:46:10.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783759e700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49358/0 (socket says 172.21.15.31:49358) 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f7836d9d700 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f78380b2130 0x7f78380a3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51956/0 (socket says 172.21.15.31:51956) 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783759e700 1 -- 172.21.15.31:0/2511780744 >> v2:172.21.15.31:3300/0 conn(0x7f78380b2130 msgr2=0x7f78380a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783759e700 1 --2- 172.21.15.31:0/2511780744 >> v2:172.21.15.31:3300/0 conn(0x7f78380b2130 0x7f78380a3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783759e700 1 -- 172.21.15.31:0/2511780744 >> v1:172.21.15.31:6789/0 conn(0x7f783806e5a0 legacy=0x7f78380679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783759e700 1 -- 172.21.15.31:0/2511780744 --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380a41c0 con 0x7f78380680f0 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f7835d9b700 1 -- 172.21.15.31:0/2511780744 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848648142 0 0) 0x7f783806ef90 con 0x7f783806e5a0 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f7836d9d700 1 --2- 172.21.15.31:0/2511780744 >> v2:172.21.15.31:3300/0 conn(0x7f78380b2130 0x7f78380a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f783759e700 1 --2- 172.21.15.31:0/2511780744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838149530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7830009e60 tx=0x7f7830009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660ee805a10b9305 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.989+0000 7f7835d9b700 1 -- 172.21.15.31:0/2511780744 <== mon.2 v2:172.21.15.31:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783000e070 con 0x7f78380680f0 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f7835d9b700 1 -- 172.21.15.31:0/2511780744 <== mon.2 v2:172.21.15.31:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f783000bbf0 con 0x7f78380680f0 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f7835d9b700 1 -- 172.21.15.31:0/2511780744 <== mon.2 v2:172.21.15.31:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830012430 con 0x7f78380680f0 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f783d096700 1 -- 172.21.15.31:0/2511780744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 msgr2=0x7f7838149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:10.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f783d096700 1 --2- 172.21.15.31:0/2511780744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838149530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7830009e60 tx=0x7f7830009780 comp rx=0 tx=0).stop 2024-04-18T10:46:10.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f783d096700 1 -- 172.21.15.31:0/2511780744 shutdown_connections 2024-04-18T10:46:10.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f783d096700 1 --2- 172.21.15.31:0/2511780744 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838149530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f783d096700 1 --2- 172.21.15.31:0/2511780744 >> v2:172.21.15.31:3300/0 conn(0x7f78380b2130 0x7f78380a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f783d096700 1 -- 172.21.15.31:0/2511780744 >> 172.21.15.31:0/2511780744 conn(0x7f783806ab20 msgr2=0x7f783806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:10.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f783d096700 1 -- 172.21.15.31:0/2511780744 shutdown_connections 2024-04-18T10:46:10.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.990+0000 7f783d096700 1 -- 172.21.15.31:0/2511780744 wait complete. 2024-04-18T10:46:10.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.991+0000 7f783d096700 1 Processor -- start 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.991+0000 7f783d096700 1 -- start start 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783d096700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838096c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783d096700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783806e5a0 0x7f7838151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783d096700 1 --2- >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380b2130 0x7f7838151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783d096700 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78380ae850 con 0x7f783806e5a0 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783d096700 1 -- --> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78380995c0 con 0x7f78380b2130 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783d096700 1 -- --> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7838097600 con 0x7f78380680f0 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f7836d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838096c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783659c700 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783806e5a0 0x7f7838151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f7836d9d700 1 --2- >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838096c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3302/0 says I am v2:172.21.15.31:49362/0 (socket says 172.21.15.31:49362) 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f7836d9d700 1 -- 172.21.15.31:0/2092625072 learned_addr learned my addr 172.21.15.31:0/2092625072 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-04-18T10:46:10.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783759e700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380b2130 0x7f7838151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783659c700 1 -- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 msgr2=0x7f7838096c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783659c700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838096c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783659c700 1 -- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380b2130 msgr2=0x7f7838151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783659c700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380b2130 0x7f7838151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783659c700 1 -- 172.21.15.31:0/2092625072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c009420 con 0x7f783806e5a0 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f7836d9d700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838096c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783759e700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380b2130 0x7f7838151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783659c700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783806e5a0 0x7f7838151340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f782800c4e0 tx=0x7f7828007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f781effd700 1 -- 172.21.15.31:0/2092625072 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828005b30 con 0x7f783806e5a0 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f781effd700 1 -- 172.21.15.31:0/2092625072 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7828005c90 con 0x7f783806e5a0 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f781effd700 1 -- 172.21.15.31:0/2092625072 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828007340 con 0x7f783806e5a0 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7830009a20 con 0x7f783806e5a0 2024-04-18T10:46:10.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.992+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78380ae220 con 0x7f783806e5a0 2024-04-18T10:46:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.993+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78380adda0 con 0x7f783806e5a0 2024-04-18T10:46:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.994+0000 7f781effd700 1 -- 172.21.15.31:0/2092625072 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f782801b3b0 con 0x7f783806e5a0 2024-04-18T10:46:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.994+0000 7f781effd700 1 -- 172.21.15.31:0/2092625072 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 3734+0+0 (secure 0 0 0) 0x7f782805a670 con 0x7f783806e5a0 2024-04-18T10:46:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:10.998+0000 7f781effd700 1 -- 172.21.15.31:0/2092625072 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7828038aa0 con 0x7f783806e5a0 2024-04-18T10:46:11.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.165+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f78380adda0 con 0x7f783806e5a0 2024-04-18T10:46:11.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.824+0000 7f781effd700 1 -- 172.21.15.31:0/2092625072 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7f78380adda0 con 0x7f783806e5a0 2024-04-18T10:46:11.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.829+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 >> v1:172.21.15.31:6816/46601 conn(0x7f7824045ef0 legacy=0x7f78240483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:11.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.829+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783806e5a0 msgr2=0x7f7838151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-18T10:46:11.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.829+0000 7f783d096700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783806e5a0 0x7f7838151340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f782800c4e0 tx=0x7f7828007f30 comp rx=0 tx=0).stop 2024-04-18T10:46:11.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.830+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 shutdown_connections 2024-04-18T10:46:11.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.830+0000 7f783d096700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3302/0,v1:172.21.15.31:6791/0] conn(0x7f78380680f0 0x7f7838096c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:11.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.830+0000 7f783d096700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3301/0,v1:172.21.15.31:6790/0] conn(0x7f78380b2130 0x7f7838151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:11.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.830+0000 7f783d096700 1 --2- 172.21.15.31:0/2092625072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f783806e5a0 0x7f7838151340 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-18T10:46:11.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.830+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 >> 172.21.15.31:0/2092625072 conn(0x7f783806ab20 msgr2=0x7f7838143960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-18T10:46:11.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.833+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 shutdown_connections 2024-04-18T10:46:11.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-04-18T10:46:11.833+0000 7f783d096700 1 -- 172.21.15.31:0/2092625072 wait complete. 2024-04-18T10:46:11.845 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-04-18T10:46:11.871 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-18T10:46:11.871 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-18T10:46:11.872 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:11.886 INFO:tasks.ceph.mds.a:Stopped 2024-04-18T10:46:11.886 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-18T10:46:11.886 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:11.935 INFO:tasks.ceph.mds.b:Stopped 2024-04-18T10:46:11.935 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-18T10:46:11.935 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:11.984 INFO:tasks.ceph.mds.c:Stopped 2024-04-18T10:46:11.984 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-18T10:46:11.984 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-18T10:46:11.985 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:12.054 INFO:tasks.ceph.osd.0:Stopped 2024-04-18T10:46:12.054 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-18T10:46:12.054 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:12.124 INFO:tasks.ceph.osd.1:Stopped 2024-04-18T10:46:12.124 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-18T10:46:12.125 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:12.194 INFO:tasks.ceph.osd.2:Stopped 2024-04-18T10:46:12.195 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-18T10:46:12.195 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:12.265 INFO:tasks.ceph.osd.3:Stopped 2024-04-18T10:46:12.265 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-18T10:46:12.265 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-18T10:46:12.266 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:12.327 INFO:tasks.ceph.mgr.x:Stopped 2024-04-18T10:46:12.327 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-18T10:46:12.328 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:12.389 INFO:tasks.ceph.mgr.y:Stopped 2024-04-18T10:46:12.389 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-18T10:46:12.389 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-18T10:46:12.390 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:12.440 INFO:tasks.ceph.mon.a:Stopped 2024-04-18T10:46:12.440 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-18T10:46:12.440 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:12.491 INFO:tasks.ceph.mon.b:Stopped 2024-04-18T10:46:12.492 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-18T10:46:12.492 INFO:teuthology.orchestra.run:waiting for 300 2024-04-18T10:46:12.543 INFO:tasks.ceph.mon.c:Stopped 2024-04-18T10:46:12.544 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-18T10:46:12.544 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'missing required features' | head -n 1 2024-04-18T10:46:12.630 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:46:12.631 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-18T10:46:12.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:46:12.996 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-18T10:46:13.099 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:46:13.099 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-18T10:46:13.175 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:46:13.175 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-18T10:46:13.275 INFO:tasks.ceph:Archiving mon data... 2024-04-18T10:46:13.276 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/data/mon.a.tgz 2024-04-18T10:46:13.277 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-18T10:46:13.295 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.lIIHFrqtmx 2024-04-18T10:46:13.296 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.lIIHFrqtmx 2024-04-18T10:46:13.445 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.lIIHFrqtmx 2024-04-18T10:46:13.534 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.lIIHFrqtmx is 352KB 2024-04-18T10:46:13.633 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.lIIHFrqtmx 2024-04-18T10:46:13.651 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/data/mon.b.tgz 2024-04-18T10:46:13.652 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-18T10:46:13.709 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.Sfn0RI6Kil 2024-04-18T10:46:13.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Sfn0RI6Kil 2024-04-18T10:46:13.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.Sfn0RI6Kil 2024-04-18T10:46:13.940 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.Sfn0RI6Kil is 355KB 2024-04-18T10:46:14.038 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.Sfn0RI6Kil 2024-04-18T10:46:14.056 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/data/mon.c.tgz 2024-04-18T10:46:14.056 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-04-18T10:46:14.113 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.RV621dCXdL 2024-04-18T10:46:14.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RV621dCXdL 2024-04-18T10:46:14.255 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.RV621dCXdL 2024-04-18T10:46:14.345 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.RV621dCXdL is 356KB 2024-04-18T10:46:14.444 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.RV621dCXdL 2024-04-18T10:46:14.462 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-18T10:46:14.462 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T10:46:14.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T10:46:14.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-18T10:46:14.587 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T10:46:14.609 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T10:46:14.631 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-18T10:46:14.631 INFO:tasks.ceph:Archiving crash dumps... 2024-04-18T10:46:14.633 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/remote/smithi031/crash 2024-04-18T10:46:14.634 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T10:46:14.662 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/remote/smithi040/crash 2024-04-18T10:46:14.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T10:46:14.697 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/remote/smithi137/crash 2024-04-18T10:46:14.698 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-18T10:46:14.743 INFO:tasks.ceph:Compressing logs... 2024-04-18T10:46:14.744 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T10:46:14.747 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T10:46:14.749 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-18T10:46:14.784 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39046.log 2024-04-18T10:46:14.785 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37421.log 2024-04-18T10:46:14.785 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.39046.log: /var/log/ceph/ceph-client.0.37421.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.37421.log.gz 2024-04-18T10:46:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37350.log 2024-04-18T10:46:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.1.37350.log: 92.9% -- replaced with /var/log/ceph/ceph-client.1.37350.log.gz 2024-04-18T10:46:14.786 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-18T10:46:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m0.015s 2024-04-18T10:46:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m0.016s 2024-04-18T10:46:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m0.009s 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48189.log 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44562.log 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48189.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gz 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51714.log 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48189.log.gz 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43343.log 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44562.log: /var/log/ceph/ceph-client.admin.51714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52858.log 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44562.log.gz 2024-04-18T10:46:14.819 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43343.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51714.log.gz 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47876.log 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43343.log.gz 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54901.log 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52858.log.gz 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55299.log 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54901.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47876.log.gz 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45335.log 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54901.log.gz 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49350.log 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55299.log.gz 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42578.log 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49350.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45335.log.gz 2024-04-18T10:46:14.820 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55473.log 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49350.log.gz 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41691.log 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42578.log.gz 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49163.log 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55473.log: /var/log/ceph/ceph-client.admin.41691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41538.log 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55473.log.gz 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41691.log.gz 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56969.log 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49163.log: /var/log/ceph/ceph-client.admin.41538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52982.log 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49163.log.gz 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56969.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41538.log.gz 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41907.log 2024-04-18T10:46:14.821 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56969.log.gz 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45072.log 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52982.log: /var/log/ceph/ceph-client.admin.41907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47701.log 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52982.log.gz 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41907.log.gz 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52517.log 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47701.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45072.log.gz 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41797.log 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47701.log.gz 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55250.log 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41797.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52517.log.gz 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43904.log 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41797.log.gz 2024-04-18T10:46:14.822 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57282.log 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55250.log.gz 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42323.log 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43904.log.gz 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43598.log 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42323.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57282.log.gz 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45710.log 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43598.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42323.log.gz 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45284.log 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43598.log.gz 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57018.log 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57427.log 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57018.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45710.log.gz 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45284.log.gz 2024-04-18T10:46:14.823 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45386.log 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57018.log.gz 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57476.log 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57427.log: /var/log/ceph/ceph-client.admin.45386.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57427.log.gz 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57476.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45386.log.gz 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56528.log 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57476.log.gz/var/log/ceph/ceph-osd.2.log: 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55940.log 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41383.log 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55940.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56528.log.gz 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42119.log 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55940.log.gz 2024-04-18T10:46:14.824 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55397.log 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41383.log: /var/log/ceph/ceph-client.admin.42119.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41383.log.gz 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55397.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42119.log.gz 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53593.log 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55397.log.gz 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54083.log 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45489.log 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42755.log 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53593.log.gz 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45489.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54083.log.gz 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40266.log 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42755.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45489.log.gz 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47524.log 2024-04-18T10:46:14.825 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42755.log.gz 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.40266.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43394.log 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44460.log 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40266.log.gz 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43394.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47524.log.gz 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42910.log 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43394.log.gz 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57740.log 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44460.log.gz 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57378.log 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42910.log: /var/log/ceph/ceph-client.admin.57740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44307.log 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42910.log.gz 2024-04-18T10:46:14.826 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57378.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57740.log.gz 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53838.log 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47380.log 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44307.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57378.log.gz 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53838.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44307.log.gz 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54132.log 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53838.log.gz 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46938.log 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47380.log: /var/log/ceph/ceph-client.admin.54132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43167.log 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47380.log.gz 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54132.log.gz 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52229.log 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54509.log 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46938.log.gz 2024-04-18T10:46:14.827 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43167.log: /var/log/ceph/ceph-client.admin.52229.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43167.log.gz 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47498.log 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52229.log.gz 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44234.log 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54509.log: /var/log/ceph/ceph-client.admin.47498.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54509.log.gz 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47498.log.gz 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40015.log 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57176.log 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.40015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54279.log 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44234.log.gz 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40015.log.gz 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48600.log 2024-04-18T10:46:14.828 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54279.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57176.log.gz 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56136.log 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54279.log.gz 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54607.log 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45438.log 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56136.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48600.log.gz 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54607.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56136.log.gz 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45438.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54607.log.gz 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45438.log.gz 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41230.log 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40860.log 2024-04-18T10:46:14.829 INFO:teuthology.orchestra.run.smithi031.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46754.log 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40860.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41230.log.gz 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53351.log 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40860.log.gz 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55793.log 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46754.log: /var/log/ceph/ceph-client.admin.53351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45540.log 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46754.log.gz 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53351.log.gz 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52711.log 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45540.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55793.log.gz 2024-04-18T10:46:14.830 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44108.log: gzip -5 --verbose -- 87.4%/var/log/ceph/ceph-client.admin.57225.log -- replaced with /var/log/ceph/ceph-client.admin.45540.log.gz 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43292.log 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52711.log: /var/log/ceph/ceph-client.admin.57225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46936.log 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52711.log.gz 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57225.log.gz 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48796.log 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43292.log.gz 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log /var/log/ceph/ceph-client.admin.46936.log: 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48796.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37017.log 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.46936.log.gz 2024-04-18T10:46:14.831 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44868.log: gzip -5 87.7%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.48796.log.gz/var/log/ceph/ceph-client.admin.49090.log 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54411.log 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.tmp-client.admin.37017.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37017.log.gz 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44358.log 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54754.log 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54411.log.gz 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57641.log 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49090.log.gz 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44358.log.gz 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44919.log 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54754.log: /var/log/ceph/ceph-client.admin.57641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47874.log 2024-04-18T10:46:14.832 INFO:teuthology.orchestra.run.smithi031.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54754.log.gz 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44919.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57641.log.gz 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44919.log.gz 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47142.log 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47874.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56332.log 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47874.log.gz 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46933.log 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56332.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47142.log.gz 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53178.log 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56332.log.gz 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42629.log 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46933.log.gz 2024-04-18T10:46:14.833 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53178.log: /var/log/ceph/ceph-client.admin.57127.log 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53178.log.gz 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57127.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42629.log.gz 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47702.log 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57127.log.gz 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44409.log 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44970.log: /var/log/ceph/ceph-client.admin.47702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39960.log 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44409.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47702.log.gz 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39960.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44409.log.gz 2024-04-18T10:46:14.834 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54034.log 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42962.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39960.log.gz 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55842.log 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56087.log 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55842.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54034.log.gz 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43853.log: gzip 89.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.55842.log.gz-- 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53642.log 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56087.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56087.log.gz 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53642.log: /var/log/ceph/ceph-osd.0.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53642.log.gz 2024-04-18T10:46:14.835 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56381.log 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53386.log 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.56381.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49460.log 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56773.log 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56381.log.gz 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53386.log.gz 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42221.log 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42068.log 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49460.log.gz 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56773.log: /var/log/ceph/ceph-client.admin.42221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54705.log 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56773.log.gz 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42221.log.gz 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55695.log 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42068.log.gz 2024-04-18T10:46:14.836 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48019.log 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55695.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54705.log.gz 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55201.log 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48019.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55695.log.gz 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48019.log.gz 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55201.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55201.log.gz 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52637.log 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57067.log 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56675.log 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52637.log.gz 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57067.log: /var/log/ceph/ceph-client.admin.56675.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57067.log.gz 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56675.log.gz 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42963.log 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2024-04-18T10:46:14.837 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43700.log 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42963.log.gz 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53789.log 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44613.log 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43700.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43649.log 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43700.log.gz 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44613.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53789.log.gz 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57691.log 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44613.log.gz 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54950.log 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48238.log 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43649.log.gz 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57691.log: /var/log/ceph/ceph-client.admin.54950.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57691.log.gz 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39856.log 2024-04-18T10:46:14.838 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56871.log 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48238.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54950.log.gz 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39856.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48238.log.gz 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39856.log.gz 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41856.log 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56871.log.gz 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52613.log 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55744.log 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41856.log.gz 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52613.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45642.log 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52613.log.gz 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55989.log 2024-04-18T10:46:14.839 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-04-18T10:46:14.840 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45642.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55744.log.gz 2024-04-18T10:46:14.840 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55989.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.45642.log.gz-5 2024-04-18T10:46:14.840 INFO:teuthology.orchestra.run.smithi031.stderr:--verbose -- /var/log/ceph/ceph-client.admin.43445.log 2024-04-18T10:46:14.851 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55989.log.gz 2024-04-18T10:46:14.851 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47993.log 2024-04-18T10:46:14.851 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-04-18T10:46:14.851 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41744.log 2024-04-18T10:46:14.851 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54656.log 2024-04-18T10:46:14.851 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47993.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz 2024-04-18T10:46:14.851 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41744.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47993.log.gz 2024-04-18T10:46:14.851 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41744.log.gz 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54656.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54656.log.gz 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48649.log 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr:gzip /var/log/ceph/ceph-client.admin.47140.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48894.log 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55348.log 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48894.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48649.log.gz 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53691.log 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48894.log.gz 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49252.log 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56185.log 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55348.log.gz 2024-04-18T10:46:14.852 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53691.log.gz 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49252.log: /var/log/ceph/ceph-client.admin.56185.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49252.log.gz 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56185.log.gz 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54181.log 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43168.log 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54181.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1%/var/log/ceph/ceph-client.admin.43168.log: -- replaced with /var/log/ceph/ceph-client.admin.54181.log.gzgzip 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.56920.log 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41332.log 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43168.log.gz 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56038.log 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56920.log.gz 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41332.log: /var/log/ceph/ceph-client.admin.56038.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41332.log.gz 2024-04-18T10:46:14.853 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45233.log 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56038.log.gz 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45021.log 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54460.log 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45233.log: /var/log/ceph/ceph-client.admin.45021.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45233.log.gz 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54460.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45021.log.gz 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54460.log.gz 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54852.log 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52687.log 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53887.log 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54852.log.gz 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52687.log: /var/log/ceph/ceph-client.admin.53887.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52687.log.gz 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53887.log.gz 2024-04-18T10:46:14.854 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53544.log 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47304.log 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55891.log 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53544.log.gz 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47304.log: /var/log/ceph/ceph-client.admin.55891.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47304.log.gz 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55891.log.gz 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55093.log 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44057.log 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55093.log: /var/log/ceph/ceph-client.admin.44057.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55093.log.gz 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44057.log.gz 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48072.log 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40170.log 2024-04-18T10:46:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44715.log 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48072.log.gz 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40170.log: /var/log/ceph/ceph-client.admin.44715.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40170.log.gz 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44715.log.gz 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53129.log 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54328.log 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44664.log 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7%/var/log/ceph/ceph-client.admin.54328.log: -- replaced with /var/log/ceph/ceph-client.admin.53129.log.gz 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44664.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44664.log.gz 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41958.log 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54328.log.gz 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48071.log 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53325.log 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41958.log.gz 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48071.log: /var/log/ceph/ceph-client.admin.53325.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48071.log.gz 2024-04-18T10:46:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53325.log.gz 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54230.log 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42476.log 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44766.log: /var/log/ceph/ceph-client.admin.54230.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54230.log.gz 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42476.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42476.log.gz 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55151.log 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54803.log 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55151.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55151.log.gz 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54803.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54803.log.gz 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56724.log 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48287.log 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56724.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56724.log.gz 2024-04-18T10:46:14.857 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48287.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.48287.log.gz--verbose 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:-- /var/log/ceph/ceph-client.admin.54999.log 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45182.log 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54999.log.gz 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.45182.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45182.log.gz 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-mon.a.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48943.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48354.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42374.log 2024-04-18T10:46:14.858 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42374.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42374.log.gz 2024-04-18T10:46:14.859 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56283.log 2024-04-18T10:46:14.859 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56283.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56283.log.gz 2024-04-18T10:46:14.859 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2024-04-18T10:46:14.859 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53324.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2024-04-18T10:46:14.859 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41281.log 2024-04-18T10:46:14.860 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41281.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41281.log.gz 2024-04-18T10:46:14.860 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55597.log 2024-04-18T10:46:14.860 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52760.log 2024-04-18T10:46:14.860 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55597.log.gz 2024-04-18T10:46:14.860 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52760.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52760.log.gz 2024-04-18T10:46:14.861 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52663.log 2024-04-18T10:46:14.861 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52663.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52663.log.gz 2024-04-18T10:46:14.861 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-18T10:46:14.861 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-18T10:46:14.872 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43802.log 2024-04-18T10:46:14.872 INFO:teuthology.orchestra.run.smithi031.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-18T10:46:14.874 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43802.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43802.log.gz 2024-04-18T10:46:14.874 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45591.log 2024-04-18T10:46:14.875 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45591.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45591.log.gz 2024-04-18T10:46:14.875 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48698.log 2024-04-18T10:46:14.876 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48698.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48698.log.gz 2024-04-18T10:46:14.876 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43496.log 2024-04-18T10:46:14.878 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43496.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43496.log.gz 2024-04-18T10:46:14.878 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56822.log 2024-04-18T10:46:14.879 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56822.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56822.log.gz 2024-04-18T10:46:14.879 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-18T10:46:14.890 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40998.log 2024-04-18T10:46:14.902 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40998.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40998.log.gz 2024-04-18T10:46:14.914 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2024-04-18T10:46:14.925 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43751.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2024-04-18T10:46:14.925 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55646.log 2024-04-18T10:46:14.946 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55646.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55646.log.gz 2024-04-18T10:46:14.946 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48502.log 2024-04-18T10:46:14.957 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48502.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48502.log.gz 2024-04-18T10:46:14.957 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2024-04-18T10:46:14.963 INFO:teuthology.orchestra.run.smithi031.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-18T10:46:14.965 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44511.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2024-04-18T10:46:14.965 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53936.log 2024-04-18T10:46:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53936.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53936.log.gz 2024-04-18T10:46:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-18T10:46:14.973 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-18T10:46:14.973 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42009.log 2024-04-18T10:46:14.974 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42009.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42009.log.gz 2024-04-18T10:46:14.974 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57331.log 2024-04-18T10:46:14.974 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47086.log 2024-04-18T10:46:14.975 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47086.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47086.log.gz 2024-04-18T10:46:14.976 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44159.log 2024-04-18T10:46:14.977 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44159.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44159.log.gz 2024-04-18T10:46:14.977 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53495.log 2024-04-18T10:46:14.978 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53495.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53495.log.gz 2024-04-18T10:46:14.978 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55548.log 2024-04-18T10:46:14.979 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55548.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55548.log.gz 2024-04-18T10:46:14.979 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49600.log 2024-04-18T10:46:14.980 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49600.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49600.log.gz 2024-04-18T10:46:14.980 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56626.log 2024-04-18T10:46:14.981 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56626.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56626.log.gz 2024-04-18T10:46:14.981 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41124.log 2024-04-18T10:46:14.982 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41124.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41124.log.gz 2024-04-18T10:46:14.982 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42906.log 2024-04-18T10:46:14.983 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42906.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42906.log.gz 2024-04-18T10:46:14.983 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42527.log 2024-04-18T10:46:14.984 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42527.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42527.log.gz 2024-04-18T10:46:14.984 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39539.log 2024-04-18T10:46:14.986 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39539.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.39539.log.gz 2024-04-18T10:46:14.986 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47060.log 2024-04-18T10:46:14.986 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57331.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57331.log.gz 2024-04-18T10:46:14.987 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47060.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47060.log.gz 2024-04-18T10:46:14.987 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42425.log 2024-04-18T10:46:14.988 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42425.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42425.log.gz 2024-04-18T10:46:14.988 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41487.log 2024-04-18T10:46:14.989 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41487.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41487.log.gz 2024-04-18T10:46:14.989 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42756.log 2024-04-18T10:46:14.990 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42756.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42756.log.gz 2024-04-18T10:46:14.990 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56577.log 2024-04-18T10:46:14.991 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56577.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56577.log.gz 2024-04-18T10:46:14.991 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52984.log 2024-04-18T10:46:14.992 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52984.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52984.log.gz 2024-04-18T10:46:14.992 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52564.log 2024-04-18T10:46:14.993 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52564.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52564.log.gz 2024-04-18T10:46:14.993 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46935.log 2024-04-18T10:46:14.994 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46935.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.46935.log.gz 2024-04-18T10:46:14.994 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41640.log 2024-04-18T10:46:14.995 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41640.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41640.log.gz 2024-04-18T10:46:14.996 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52809.log 2024-04-18T10:46:14.996 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52809.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52809.log.gz 2024-04-18T10:46:14.997 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47823.log 2024-04-18T10:46:14.997 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47823.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47823.log.gz 2024-04-18T10:46:14.998 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-04-18T10:46:14.998 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43955.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-04-18T10:46:14.999 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53740.log 2024-04-18T10:46:15.000 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53740.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53740.log.gz 2024-04-18T10:46:15.000 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2024-04-18T10:46:15.001 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44006.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2024-04-18T10:46:15.001 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44817.log 2024-04-18T10:46:15.002 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44817.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44817.log.gz 2024-04-18T10:46:15.002 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52983.log 2024-04-18T10:46:15.003 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52983.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52983.log.gz 2024-04-18T10:46:15.003 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46660.log 2024-04-18T10:46:15.004 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46660.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46660.log.gz 2024-04-18T10:46:15.004 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42170.log 2024-04-18T10:46:15.005 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42170.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42170.log.gz 2024-04-18T10:46:15.005 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47357.log 2024-04-18T10:46:15.006 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47357.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47357.log.gz 2024-04-18T10:46:15.006 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47797.log 2024-04-18T10:46:15.007 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47797.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47797.log.gz 2024-04-18T10:46:15.007 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57525.log 2024-04-18T10:46:15.008 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57525.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57525.log.gz 2024-04-18T10:46:15.008 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48551.log 2024-04-18T10:46:15.009 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48551.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48551.log.gz 2024-04-18T10:46:15.009 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52353.log 2024-04-18T10:46:15.010 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52353.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52353.log.gz 2024-04-18T10:46:15.010 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41436.log 2024-04-18T10:46:15.011 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41436.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41436.log.gz 2024-04-18T10:46:15.011 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55046.log 2024-04-18T10:46:15.012 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.55046.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55046.log.gz 2024-04-18T10:46:15.012 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43114.log 2024-04-18T10:46:15.013 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43114.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43114.log.gz 2024-04-18T10:46:15.013 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53119.log 2024-04-18T10:46:15.014 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53119.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53119.log.gz 2024-04-18T10:46:15.014 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41589.log 2024-04-18T10:46:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41589.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41589.log.gz 2024-04-18T10:46:15.015 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-18T10:46:15.025 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48747.log 2024-04-18T10:46:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48747.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48747.log.gz 2024-04-18T10:46:15.048 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48429.log 2024-04-18T10:46:15.058 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48429.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48429.log.gz 2024-04-18T10:46:15.059 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39909.log 2024-04-18T10:46:15.069 INFO:teuthology.orchestra.run.smithi031.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-18T10:46:15.071 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39909.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39909.log.gz 2024-04-18T10:46:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42272.log 2024-04-18T10:46:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42272.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42272.log.gz 2024-04-18T10:46:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48992.log 2024-04-18T10:46:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48992.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48992.log.gz 2024-04-18T10:46:15.074 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57574.log 2024-04-18T10:46:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.57574.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57574.log.gz 2024-04-18T10:46:15.075 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47278.log 2024-04-18T10:46:15.076 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47278.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47278.log.gz 2024-04-18T10:46:15.076 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52985.log 2024-04-18T10:46:15.077 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52985.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.52985.log.gz 2024-04-18T10:46:15.077 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49041.log 2024-04-18T10:46:15.078 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49041.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2024-04-18T10:46:15.078 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56430.log 2024-04-18T10:46:15.079 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56430.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56430.log.gz 2024-04-18T10:46:15.079 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53985.log 2024-04-18T10:46:15.080 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53985.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53985.log.gz 2024-04-18T10:46:15.080 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46807.log 2024-04-18T10:46:15.081 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46807.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46807.log.gz 2024-04-18T10:46:15.081 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2024-04-18T10:46:15.082 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40931.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2024-04-18T10:46:15.082 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52470.log 2024-04-18T10:46:15.083 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52470.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52470.log.gz 2024-04-18T10:46:15.083 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53181.log 2024-04-18T10:46:15.084 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53181.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53181.log.gz 2024-04-18T10:46:15.084 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56479.log 2024-04-18T10:46:15.085 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56479.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56479.log.gz 2024-04-18T10:46:15.085 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56234.log 2024-04-18T10:46:15.086 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.56234.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56234.log.gz 2024-04-18T10:46:15.086 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42758.log 2024-04-18T10:46:15.087 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42758.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42758.log.gz 2024-04-18T10:46:15.087 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54558.log 2024-04-18T10:46:15.088 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54558.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54558.log.gz 2024-04-18T10:46:15.143 INFO:teuthology.orchestra.run.smithi031.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-18T10:46:15.379 INFO:teuthology.orchestra.run.smithi031.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-18T10:46:17.374 INFO:teuthology.orchestra.run.smithi031.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-18T10:46:17.777 INFO:teuthology.orchestra.run.smithi031.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-18T10:46:17.855 INFO:teuthology.orchestra.run.smithi031.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-18T10:46:18.826 INFO:teuthology.orchestra.run.smithi031.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-18T10:46:29.202 INFO:teuthology.orchestra.run.smithi040.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.39046.log.gz 2024-04-18T10:46:29.203 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-18T10:46:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m14.436s 2024-04-18T10:46:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m14.013s 2024-04-18T10:46:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.416s 2024-04-18T10:46:57.173 INFO:teuthology.orchestra.run.smithi031.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-18T10:46:57.174 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-04-18T10:46:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m42.413s 2024-04-18T10:46:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m54.293s 2024-04-18T10:46:57.174 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m1.834s 2024-04-18T10:46:57.175 INFO:tasks.ceph:Archiving logs... 2024-04-18T10:46:57.175 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/remote/smithi031/log 2024-04-18T10:46:57.176 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T10:47:04.703 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/remote/smithi040/log 2024-04-18T10:47:04.703 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T10:47:06.729 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/remote/smithi137/log 2024-04-18T10:47:06.730 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-18T10:47:06.763 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-18T10:47:06.776 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-18T10:47:06.776 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T10:47:06.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T10:47:06.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-18T10:47:06.916 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-18T10:47:06.929 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-18T10:47:06.930 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T10:47:06.932 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T10:47:06.935 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-18T10:47:06.951 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2024-04-18T10:47:06.953 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2024-04-18T10:47:06.954 INFO:teuthology.orchestra.run.smithi137.stderr:bash: ntpq: command not found 2024-04-18T10:47:06.956 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-18T10:47:06.956 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-04-18T10:47:06.956 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +166us[ +171us] +/- 52ms 2024-04-18T10:47:06.957 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 -1699us[-1693us] +/- 52ms 2024-04-18T10:47:06.957 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +1830us[+1835us] +/- 64ms 2024-04-18T10:47:06.957 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:47:06.958 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-18T10:47:06.958 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-04-18T10:47:06.958 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +136us[ +128us] +/- 52ms 2024-04-18T10:47:06.959 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 -1733us[-1741us] +/- 52ms 2024-04-18T10:47:06.959 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +1788us[+1788us] +/- 64ms 2024-04-18T10:47:06.959 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:47:06.960 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-18T10:47:06.960 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-04-18T10:47:06.960 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +129us[ +138us] +/- 52ms 2024-04-18T10:47:06.960 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 -1726us[-1717us] +/- 52ms 2024-04-18T10:47:06.961 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +1795us[+1795us] +/- 64ms 2024-04-18T10:47:06.961 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-18T10:47:06.961 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-18T10:47:07.007 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-18T10:47:07.007 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-18T10:47:07.019 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-18T10:47:07.098 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-18T10:47:07.170 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-18T10:47:07.238 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-18T10:47:07.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:47:07.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-18T10:47:07.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:47:07.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-18T10:47:07.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:47:07.339 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-18T10:47:07.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-18T10:47:07.365 INFO:teuthology.task.internal:Duration was 1222.934620 seconds 2024-04-18T10:47:07.365 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-18T10:47:07.379 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-18T10:47:07.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T10:47:07.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T10:47:07.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-18T10:47:07.432 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-18T10:47:07.433 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-18T10:47:07.433 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-18T10:47:07.764 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-18T10:47:07.764 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-04-18T10:47:07.764 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T10:47:07.792 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-04-18T10:47:07.792 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T10:47:07.819 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-04-18T10:47:07.819 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-18T10:47:07.843 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-18T10:47:07.843 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T10:47:07.846 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T10:47:07.862 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-18T10:47:07.927 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-18T10:47:07.927 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T10:47:07.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T10:47:07.931 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-18T10:47:08.034 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-18T10:47:08.049 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-18T10:47:08.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T10:47:08.077 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T10:47:08.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-18T10:47:08.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-18T10:47:08.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T10:47:08.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T10:47:08.150 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-18T10:47:08.174 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-04-18T10:47:08.175 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-04-18T10:47:08.199 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-04-18T10:47:08.212 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T10:47:08.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:47:08.257 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T10:47:08.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:47:08.275 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-18T10:47:08.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T10:47:08.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-18T10:47:08.306 INFO:teuthology.task.internal:Transferring archived files... 2024-04-18T10:47:08.307 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/remote/smithi031 2024-04-18T10:47:08.307 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T10:47:08.346 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/remote/smithi040 2024-04-18T10:47:08.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T10:47:08.385 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660976/remote/smithi137 2024-04-18T10:47:08.385 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-18T10:47:08.422 INFO:teuthology.task.internal:Removing archive directory... 2024-04-18T10:47:08.422 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T10:47:08.425 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T10:47:08.427 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-18T10:47:08.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-18T10:47:08.490 INFO:teuthology.task.internal:Not uploading archives. 2024-04-18T10:47:08.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-18T10:47:08.504 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-18T10:47:08.504 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T10:47:08.506 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T10:47:08.508 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-18T10:47:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 10:47 /home/ubuntu/cephtest 2024-04-18T10:47:08.524 INFO:teuthology.orchestra.run.smithi040.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 10:47 /home/ubuntu/cephtest 2024-04-18T10:47:08.531 INFO:teuthology.orchestra.run.smithi137.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 18 10:47 /home/ubuntu/cephtest 2024-04-18T10:47:08.533 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-18T10:47:08.547 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-18T10:47:08.577 INFO:teuthology.run:Summary data: description: fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} duration: 1222.9346199035645 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-18T10:47:08.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T10:47:08.672 INFO:teuthology.run:pass